You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-13 - 03:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot2.osadl.org (updated Wed Nov 12, 2025 12:45:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
136691210143,23phc2sys0-21swapper/307:06:463
83432206172,23sleep20-21swapper/207:08:442
83192206172,23sleep00-21swapper/007:08:260
82082206172,24sleep10-21swapper/107:06:571
3062821780,7sleep3874599cyclictest07:55:173
1454321760,6sleep1874399cyclictest10:45:011
2263721560,5sleep0874299cyclictest11:00:200
867321410,7sleep1874399cyclictest10:30:241
136591650,1ptp4l401ktimersoftd/309:59:443
136591650,1ptp4l401ktimersoftd/309:59:443
269082610,2sleep10-21swapper/112:15:271
150152600,2sleep30-21swapper/308:30:153
174642560,2sleep20-21swapper/208:35:162
136591550,1ptp4l391rcuc/308:53:253
136591500,1ptp4l401ktimersoftd/311:31:203
136591430,0ptp4l401ktimersoftd/311:03:383
136591410,0ptp4l401ktimersoftd/310:08:493
136591400,1ptp4l391rcuc/307:20:193
136591400,0ptp4l401ktimersoftd/310:59:123
136591400,0ptp4l401ktimersoftd/310:35:203
136591400,0ptp4l401ktimersoftd/308:28:083
8745993922,4cyclictest41-21ksoftirqd/311:11:183
136591390,0ptp4l401ktimersoftd/309:08:393
8744993730,4cyclictest27336-21cron12:19:592
8744993529,4cyclictest33-21ksoftirqd/210:22:072
874299359,23cyclictest424-21dbus-daemon10:00:000
874299359,23cyclictest424-21dbus-daemon10:00:000
8742993512,20cyclictest20792-21df_abs12:05:140
8742993410,21cyclictest8973-21if_enp1s011:40:170
8745993326,4cyclictest41-21ksoftirqd/307:34:243
8744993328,3cyclictest33-21ksoftirqd/211:50:122
8744993327,4cyclictest33-21ksoftirqd/212:36:302
874299339,21cyclictest25575-21date11:05:280
8742993327,4cyclictest9-21ksoftirqd/010:52:540
8742993327,4cyclictest9-21ksoftirqd/010:48:130
8742993327,4cyclictest9-21ksoftirqd/009:37:580
8742993326,5cyclictest9-21ksoftirqd/007:32:470
8742993313,18cyclictest19830-21unixbench_multi09:45:250
8742993310,21cyclictest6032-21perf09:20:000
136591330,7ptp4l401ktimersoftd/312:03:243
136591330,0ptp4l401ktimersoftd/312:05:213
136591330,0ptp4l401ktimersoftd/308:45:263
8745993227,3cyclictest41-21ksoftirqd/312:14:553
8745993227,3cyclictest41-21ksoftirqd/312:14:553
8745993227,3cyclictest41-21ksoftirqd/310:42:253
8745993226,4cyclictest41-21ksoftirqd/311:52:463
8744993227,3cyclictest33-21ksoftirqd/208:31:582
8744993226,4cyclictest33-21ksoftirqd/212:24:552
8744993226,4cyclictest33-21ksoftirqd/212:13:112
8744993226,4cyclictest33-21ksoftirqd/212:13:112
8744993226,4cyclictest33-21ksoftirqd/212:04:292
8744993226,4cyclictest33-21ksoftirqd/210:15:532
8744993226,4cyclictest33-21ksoftirqd/210:00:492
8744993226,4cyclictest33-21ksoftirqd/209:16:242
8744993226,4cyclictest33-21ksoftirqd/208:01:472
8744993226,4cyclictest33-21ksoftirqd/207:21:062
8743993226,4cyclictest25-21ksoftirqd/107:21:451
874299329,3cyclictest31678-21grep12:25:270
874299329,2cyclictest4843-21sshd08:09:470
874299329,2cyclictest4843-21sshd08:09:470
874299329,20cyclictest31430-21expr11:20:140
874299328,4cyclictest226-21systemd-journal11:35:000
874299328,21cyclictest27896-21latency_hist07:50:000
8742993226,4cyclictest9-21ksoftirqd/010:02:210
8742993226,4cyclictest9-21ksoftirqd/009:34:440
8742993226,4cyclictest9-21ksoftirqd/009:26:490
8742993226,4cyclictest9-21ksoftirqd/009:26:490
8742993226,4cyclictest9-21ksoftirqd/007:26:090
8742993210,20cyclictest14874-21find07:20:240
136591320,0ptp4l401ktimersoftd/311:08:003
8745993125,4cyclictest41-21ksoftirqd/312:32:263
8745993125,4cyclictest41-21ksoftirqd/312:28:213
8745993125,4cyclictest41-21ksoftirqd/311:46:253
8745993125,4cyclictest41-21ksoftirqd/311:22:463
8745993125,4cyclictest41-21ksoftirqd/310:49:393
8745993125,4cyclictest41-21ksoftirqd/309:31:133
8745993125,4cyclictest41-21ksoftirqd/309:18:533
8745993125,4cyclictest41-21ksoftirqd/307:13:413
8745993125,4cyclictest41-21ksoftirqd/307:13:413
8744993126,3cyclictest33-21ksoftirqd/210:58:092
8744993126,3cyclictest33-21ksoftirqd/207:58:322
8744993125,4cyclictest33-21ksoftirqd/212:07:382
8744993125,4cyclictest33-21ksoftirqd/211:48:362
8744993124,5cyclictest33-21ksoftirqd/210:41:292
8744993124,5cyclictest33-21ksoftirqd/209:08:492
8744993124,5cyclictest33-21ksoftirqd/207:46:092
8744993124,5cyclictest33-21ksoftirqd/207:39:072
8743993126,3cyclictest25-21ksoftirqd/112:39:141
8743993126,3cyclictest25-21ksoftirqd/108:00:401
8743993126,3cyclictest25-21ksoftirqd/107:34:131
8743993126,3cyclictest25-21ksoftirqd/107:18:151
8743993125,4cyclictest25-21ksoftirqd/107:37:431
874299319,3cyclictest30636-21seq11:16:210
874299319,3cyclictest18237-21phc2sys08:35:230
874299319,19cyclictest1110-21grep10:15:250
874299318,3cyclictest15844-21open_inodes08:30:230
874299312,7cyclictest13148-21apt-get11:50:120
8742993126,3cyclictest9-21ksoftirqd/011:13:320
8742993125,4cyclictest9-21ksoftirqd/010:57:150
8742993125,4cyclictest9-21ksoftirqd/010:43:310
8742993125,4cyclictest9-21ksoftirqd/008:42:090
8742993110,18cyclictest27661-21cpuspeed12:20:130
136591310,9ptp4l401ktimersoftd/309:43:473
8745993025,3cyclictest41-21ksoftirqd/311:55:123
8745993025,3cyclictest41-21ksoftirqd/310:22:393
8745993025,3cyclictest41-21ksoftirqd/310:16:393
8745993024,4cyclictest41-21ksoftirqd/310:54:453
8745993024,4cyclictest41-21ksoftirqd/308:02:153
8745993024,4cyclictest41-21ksoftirqd/307:26:573
8744993025,3cyclictest33-21ksoftirqd/208:46:122
8744993024,4cyclictest33-21ksoftirqd/212:00:002
8744993024,4cyclictest33-21ksoftirqd/211:29:472
8744993024,4cyclictest33-21ksoftirqd/210:49:592
8744993024,4cyclictest33-21ksoftirqd/210:07:512
8744993024,4cyclictest33-21ksoftirqd/209:24:502
8744993024,4cyclictest33-21ksoftirqd/208:52:372
8744993024,4cyclictest33-21ksoftirqd/207:53:112
8744993024,4cyclictest33-21ksoftirqd/207:43:082
8744993024,4cyclictest33-21ksoftirqd/207:13:492
8744993024,4cyclictest33-21ksoftirqd/207:13:492
8743993025,3cyclictest25-21ksoftirqd/108:08:181
8743993025,3cyclictest25-21ksoftirqd/108:08:181
8743993024,4cyclictest25-21ksoftirqd/112:03:271
8743993024,4cyclictest25-21ksoftirqd/111:04:351
8743993024,4cyclictest25-21ksoftirqd/109:49:241
8743993024,4cyclictest25-21ksoftirqd/109:42:501
8743993024,4cyclictest25-21ksoftirqd/108:47:581
8743993024,4cyclictest25-21ksoftirqd/108:32:341
874299309,3cyclictest3374-21uname11:30:010
874299308,3cyclictest31710-21grep07:55:270
874299308,3cyclictest11293-21mailstats08:20:240
874299307,3cyclictest6702-21expr08:10:300
874299307,3cyclictest2259-21gnome-shell07:35:580
874299307,3cyclictest15985-21expr11:55:180
874299306,4cyclictest7734-21df_abs10:30:160
874299305,4cyclictest23117-21/usr/sbin/munin08:45:230
8742993025,3cyclictest9-21ksoftirqd/009:53:240
8742993025,3cyclictest9-21ksoftirqd/008:54:320
8742993024,4cyclictest9-21ksoftirqd/010:14:190
8742993024,4cyclictest9-21ksoftirqd/010:06:480
8742993024,4cyclictest9-21ksoftirqd/007:50:360
8745992924,3cyclictest41-21ksoftirqd/311:16:093
8745992924,3cyclictest41-21ksoftirqd/310:34:393
8745992924,3cyclictest41-21ksoftirqd/309:21:153
8745992924,3cyclictest41-21ksoftirqd/308:20:053
8745992923,4cyclictest41-21ksoftirqd/310:01:583
8745992923,4cyclictest41-21ksoftirqd/308:12:583
8745992922,5cyclictest41-21ksoftirqd/308:07:123
8745992922,5cyclictest41-21ksoftirqd/308:07:123
8745992915,5cyclictest41-21ksoftirqd/312:15:453
8744992923,4cyclictest33-21ksoftirqd/211:38:532
8744992923,4cyclictest33-21ksoftirqd/211:20:522
8744992923,4cyclictest33-21ksoftirqd/211:17:272
8744992923,4cyclictest33-21ksoftirqd/209:01:392
8743992924,3cyclictest25-21ksoftirqd/111:47:381
8743992924,3cyclictest25-21ksoftirqd/110:46:521
8743992924,3cyclictest25-21ksoftirqd/108:57:031
8743992923,4cyclictest25-21ksoftirqd/112:22:401
8743992923,4cyclictest25-21ksoftirqd/110:58:081
8743992923,4cyclictest25-21ksoftirqd/108:21:191
8743992923,4cyclictest25-21ksoftirqd/107:56:471
8743992923,4cyclictest25-21ksoftirqd/107:54:111
8743992923,4cyclictest25-21ksoftirqd/107:47:411
8743992923,4cyclictest25-21ksoftirqd/107:44:171
874299298,3cyclictest31995-21fw_packets09:05:170
874299298,2cyclictest3666-21phc2sys10:20:260
874299297,3cyclictest96572chrt08:19:530
874299296,3cyclictest26653-21expr08:55:160
874299296,3cyclictest18868-21irqrtprio12:00:190
874299296,3cyclictest12096-21latency07:15:210
874299295,3cyclictest3688-21cat09:14:590
874299294,3cyclictest10431-21awk07:10:290
874299294,3cyclictest10431-21awk07:10:290
8742992924,3cyclictest9-21ksoftirqd/011:45:050
8742992924,3cyclictest9-21ksoftirqd/011:35:110
8742992924,3cyclictest9-21ksoftirqd/010:36:490
874299291,6cyclictest5047-21chrt10:25:140
874299291,6cyclictest5047-21chrt10:25:140
874299291,5cyclictest2259-21gnome-shell12:12:590
874299291,5cyclictest2259-21gnome-shell12:12:590
136591290,0ptp4l401ktimersoftd/311:29:143
8745992823,3cyclictest41-21ksoftirqd/309:48:303
8745992822,4cyclictest41-21ksoftirqd/311:43:473
8745992822,4cyclictest41-21ksoftirqd/308:39:183
8744992823,3cyclictest33-21ksoftirqd/212:29:232
8744992822,4cyclictest33-21ksoftirqd/211:44:112
8744992822,4cyclictest33-21ksoftirqd/211:06:482
8744992822,4cyclictest33-21ksoftirqd/210:50:512
8744992822,4cyclictest33-21ksoftirqd/210:37:272
8744992822,4cyclictest33-21ksoftirqd/209:57:562
8744992822,4cyclictest33-21ksoftirqd/209:57:562
8744992822,4cyclictest33-21ksoftirqd/208:17:062
8744992822,4cyclictest33-21ksoftirqd/207:18:452
8743992823,3cyclictest25-21ksoftirqd/112:11:291
8743992823,3cyclictest25-21ksoftirqd/112:11:291
8743992823,3cyclictest25-21ksoftirqd/112:09:521
8743992823,3cyclictest25-21ksoftirqd/111:55:521
8743992823,3cyclictest25-21ksoftirqd/110:19:361
8743992823,3cyclictest25-21ksoftirqd/110:00:551
8743992823,3cyclictest25-21ksoftirqd/109:39:131
8743992822,4cyclictest25-21ksoftirqd/112:33:281
8743992822,4cyclictest25-21ksoftirqd/109:04:551
8743992822,4cyclictest25-21ksoftirqd/108:14:121
8743992822,4cyclictest25-21ksoftirqd/107:29:191
874299289,2cyclictest101ktimersoftd/012:33:560
874299286,3cyclictest1889-21Xorg09:20:260
874299285,4cyclictest24462chrt08:04:300
874299285,3cyclictest3195-21uniq12:35:160
874299285,3cyclictest28989-21cat09:00:010
874299285,3cyclictest23385-21expr07:40:130
874299282,5cyclictest15828-21apt-get09:40:130
136591280,0ptp4l401ktimersoftd/307:50:123
8745992723,3cyclictest41-21ksoftirqd/308:43:533
8745992722,3cyclictest41-21ksoftirqd/309:27:403
8745992722,3cyclictest41-21ksoftirqd/309:27:403
8745992721,4cyclictest41-21ksoftirqd/312:23:073
8745992721,4cyclictest41-21ksoftirqd/310:27:383
8745992721,4cyclictest41-21ksoftirqd/310:27:383
8745992721,4cyclictest41-21ksoftirqd/307:19:223
8744992722,3cyclictest33-21ksoftirqd/212:34:302
8744992722,3cyclictest33-21ksoftirqd/211:10:172
8744992722,3cyclictest33-21ksoftirqd/210:13:072
8744992722,3cyclictest33-21ksoftirqd/208:42:392
8744992721,4cyclictest33-21ksoftirqd/211:03:352
8744992721,4cyclictest33-21ksoftirqd/210:27:162
8744992721,4cyclictest33-21ksoftirqd/210:27:162
8744992721,4cyclictest33-21ksoftirqd/208:27:412
8744992719,5cyclictest33-21ksoftirqd/209:55:002
8743992721,4cyclictest25-21ksoftirqd/110:53:071
8743992721,4cyclictest25-21ksoftirqd/109:23:051
8743992721,4cyclictest25-21ksoftirqd/109:17:031
8743992721,4cyclictest25-21ksoftirqd/109:10:541
8743992721,4cyclictest25-21ksoftirqd/108:50:031
8743992721,4cyclictest25-21ksoftirqd/108:16:371
874299277,2cyclictest101ktimersoftd/008:27:430
874299275,2cyclictest0-21swapper/012:15:220
136591270,7ptp4l401ktimersoftd/309:11:093
136591270,0ptp4l401ktimersoftd/307:38:403
8745992621,3cyclictest41-21ksoftirqd/309:38:393
8745992621,3cyclictest41-21ksoftirqd/307:42:503
8745992620,4cyclictest41-21ksoftirqd/311:37:583
8745992620,4cyclictest41-21ksoftirqd/308:17:563
8744992621,3cyclictest33-21ksoftirqd/209:39:152
8744992621,3cyclictest33-21ksoftirqd/209:11:102
8744992621,3cyclictest33-21ksoftirqd/208:14:502
8744992620,4cyclictest33-21ksoftirqd/211:31:392
8744992620,4cyclictest33-21ksoftirqd/209:48:532
8744992620,4cyclictest33-21ksoftirqd/207:28:562
8744992619,4cyclictest33-21ksoftirqd/208:58:182
8743992621,3cyclictest25-21ksoftirqd/111:42:451
8743992621,3cyclictest25-21ksoftirqd/111:26:561
8743992620,4cyclictest25-21ksoftirqd/111:32:271
8743992620,4cyclictest25-21ksoftirqd/111:24:121
8743992620,4cyclictest25-21ksoftirqd/110:38:511
8743992620,4cyclictest25-21ksoftirqd/108:29:011
8745992520,3cyclictest41-21ksoftirqd/308:57:563
8745992520,3cyclictest41-21ksoftirqd/307:48:023
8745992519,4cyclictest41-21ksoftirqd/310:14:223
8744992520,3cyclictest33-21ksoftirqd/210:33:442
8744992520,3cyclictest33-21ksoftirqd/208:08:232
8744992520,3cyclictest33-21ksoftirqd/208:08:222
8744992519,4cyclictest33-21ksoftirqd/209:28:242
8744992519,4cyclictest33-21ksoftirqd/209:28:232
8743992520,3cyclictest25-21ksoftirqd/111:51:471
8743992520,3cyclictest25-21ksoftirqd/111:17:541
8743992520,3cyclictest25-21ksoftirqd/111:05:051
8743992520,3cyclictest25-21ksoftirqd/110:26:471
8743992520,3cyclictest25-21ksoftirqd/110:26:471
8743992520,3cyclictest25-21ksoftirqd/109:07:491
136591250,0ptp4l401ktimersoftd/312:36:243
8745992419,3cyclictest41-21ksoftirqd/309:00:133
8743992419,3cyclictest25-21ksoftirqd/108:44:301
8743992418,4cyclictest25-21ksoftirqd/112:27:151
8743992417,4cyclictest25-21ksoftirqd/110:20:051
8743992318,3cyclictest25-21ksoftirqd/110:08:451
170112230,7sleep2874499cyclictest09:40:232
136591230,0ptp4l401ktimersoftd/309:50:233
8744992217,3cyclictest33-21ksoftirqd/208:20:382
8743992217,3cyclictest25-21ksoftirqd/109:54:011
8743992216,4cyclictest25-21ksoftirqd/111:36:591
8743992216,4cyclictest25-21ksoftirqd/110:11:231
8743992215,4cyclictest11357-21df09:30:141
8744992116,3cyclictest33-21ksoftirqd/207:30:442
874499210,3cyclictest26236-21kworker/2:009:30:282
8743992115,4cyclictest25-21ksoftirqd/111:11:521
8743992115,4cyclictest25-21ksoftirqd/107:11:031
8743992115,4cyclictest25-21ksoftirqd/107:11:031
8743992014,4cyclictest25-21ksoftirqd/109:57:121
8743992014,4cyclictest25-21ksoftirqd/109:57:111
8743991914,3cyclictest25-21ksoftirqd/109:25:491
8743991914,3cyclictest25-21ksoftirqd/109:25:491
8743991913,3cyclictest19165-21latency_hist08:40:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional