You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 15:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Tue Mar 17, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114499914410,60cyclictest0-21swapper/110:58:331
2959621090,0sleep10-21swapper/109:52:301
198042860,0sleep41145299cyclictest10:23:244
68252750,0sleep20-21swapper/209:19:472
142932740,1sleep233-21ksoftirqd/210:24:592
1145499740,42cyclictest0-21swapper/610:58:336
59862540,1sleep55976-21sshd11:21:565
31512510,0sleep50-21swapper/512:30:125
31512510,0sleep50-21swapper/512:30:125
195842510,0sleep50-21swapper/511:56:005
109492510,2sleep01144899cyclictest12:21:260
109492510,2sleep01144899cyclictest12:21:260
145782490,1sleep4686-21dbus-daemon10:26:534
6842480,0sleep30-21swapper/310:42:383
6842480,0sleep30-21swapper/310:42:383
211902480,1sleep557-21ksoftirqd/509:53:545
1119324825,8sleep60-21swapper/607:04:596
301192470,1sleep3686-21dbus-daemon09:52:323
147362470,0sleep50-21swapper/510:10:125
145612470,0sleep10-21swapper/110:49:001
268532460,0sleep50-21swapper/510:57:055
129882460,0sleep10-21swapper/110:28:341
3492450,1sleep449-21ksoftirqd/412:31:554
150562450,0sleep5723-21in:imjournal09:33:125
121882450,0sleep40-21swapper/409:51:374
121882450,0sleep40-21swapper/409:51:374
93602440,1sleep4686-21dbus-daemon10:45:034
93602440,1sleep4686-21dbus-daemon10:45:034
280492440,0sleep70-21swapper/712:26:067
280492440,0sleep70-21swapper/712:26:067
265312440,0sleep10-21swapper/111:34:101
154102440,0sleep50-21swapper/510:41:445
1111824431,9sleep70-21swapper/707:03:567
324222430,1sleep732424-21bash11:17:507
313652430,0sleep00-21swapper/011:23:190
253412430,0sleep30-21swapper/311:50:463
219402430,1sleep4481ktimersoftd/409:26:144
106752430,1sleep21-21systemd12:25:052
106752430,1sleep21-21systemd12:25:052
67902420,0sleep60-21swapper/610:13:256
312312420,0sleep20-21swapper/212:33:382
296982420,0sleep229695-21systemd-cgroups09:07:382
228622420,0sleep00-21swapper/012:11:010
207652420,0sleep520763-21sshd09:44:415
1103924230,9sleep50-21swapper/507:02:505
291302410,0sleep70-21swapper/711:49:057
272272410,0sleep50-21swapper/510:05:235
265982410,0sleep00-21swapper/010:01:420
249202410,0sleep5551rcuc/512:18:275
249202410,0sleep5551rcuc/512:18:275
168112410,0sleep10-21swapper/111:53:561
1123624128,9sleep10-21swapper/107:05:261
1104424129,8sleep00-21swapper/007:02:530
72232400,0sleep50-21swapper/509:12:215
69712400,0sleep20-21swapper/210:09:452
266382400,0sleep70-21swapper/711:32:157
122132400,0sleep60-21swapper/612:14:036
1122724028,8sleep30-21swapper/307:05:203
63932390,1sleep76394-21grepconf.sh10:52:117
1113323926,9sleep40-21swapper/407:04:094
96732380,0sleep60-21swapper/611:23:576
47052380,0sleep10-21swapper/111:20:001
297662380,0sleep00-21swapper/010:36:580
24792380,0sleep70-21swapper/710:40:577
1145299380,37cyclictest0-21swapper/410:58:334
11450993838,0cyclictest13550irq/24-ahci[00010:58:342
1113123827,8sleep20-21swapper/207:04:072
11451993716,20cyclictest19833-21sshd10:58:333
226332340,1sleep09-21ksoftirqd/009:41:080
11451992712,2cyclictest41-21ksoftirqd/311:34:073
11448992712,15cyclictest763-21NetworkManager10:58:340
11455992524,1cyclictest25034-21kworker/u16:010:58:337
11451992410,2cyclictest41-21ksoftirqd/312:06:093
1145199238,3cyclictest41-21ksoftirqd/311:23:073
1145199229,4cyclictest41-21ksoftirqd/310:27:363
1145199228,3cyclictest41-21ksoftirqd/310:51:463
1145199226,3cyclictest41-21ksoftirqd/312:33:163
1145199224,2cyclictest41-21ksoftirqd/309:31:053
1145199218,3cyclictest41-21ksoftirqd/311:05:493
11451992114,3cyclictest41-21ksoftirqd/311:52:043
11451992113,1cyclictest41-21ksoftirqd/312:30:223
11451992113,1cyclictest41-21ksoftirqd/312:30:223
11451992111,3cyclictest41-21ksoftirqd/309:46:293
26842200,0sleep70-21swapper/709:45:317
1145199209,3cyclictest41-21ksoftirqd/310:14:453
1145199209,3cyclictest41-21ksoftirqd/309:58:093
1145199208,3cyclictest41-21ksoftirqd/312:09:333
1145199208,2cyclictest41-21ksoftirqd/312:17:133
1145199208,2cyclictest41-21ksoftirqd/312:17:133
1145199208,1cyclictest41-21ksoftirqd/310:33:173
1145199208,1cyclictest41-21ksoftirqd/310:25:023
1145199208,1cyclictest41-21ksoftirqd/309:40:493
1145199206,1cyclictest41-21ksoftirqd/309:50:423
1145199206,1cyclictest41-21ksoftirqd/309:50:423
1145199205,3cyclictest41-21ksoftirqd/311:17:003
1145199205,1cyclictest41-21ksoftirqd/310:07:373
1145199204,1cyclictest41-21ksoftirqd/311:08:223
11451992010,4cyclictest41-21ksoftirqd/311:15:373
1145199199,3cyclictest41-21ksoftirqd/310:18:393
1145199197,1cyclictest41-21ksoftirqd/309:17:013
1145199196,2cyclictest41-21ksoftirqd/312:26:003
1145199196,2cyclictest41-21ksoftirqd/312:26:003
1145199194,3cyclictest41-21ksoftirqd/312:15:243
11451991910,3cyclictest41-21ksoftirqd/311:46:103
1145199189,1cyclictest41-21ksoftirqd/310:05:073
1145199188,3cyclictest41-21ksoftirqd/310:56:033
1145199187,1cyclictest41-21ksoftirqd/311:41:403
1145199186,4cyclictest41-21ksoftirqd/311:29:253
1145199186,3cyclictest41-21ksoftirqd/309:13:333
1145199183,2cyclictest41-21ksoftirqd/309:33:163
11451991817,1cyclictest41-21ksoftirqd/310:37:073
1145199180,2cyclictest41-21ksoftirqd/309:22:143
11449991815,2cyclictest25-21ksoftirqd/111:09:491
43232170,1sleep54324-21grepconf.sh10:48:245
1145199176,2cyclictest41-21ksoftirqd/311:57:013
1145199171,2cyclictest121rcu_preempt09:10:373
11449991715,1cyclictest25-21ksoftirqd/112:26:311
11449991715,1cyclictest25-21ksoftirqd/112:26:311
265132160,0sleep40-21swapper/410:14:354
134512160,0sleep00-21swapper/011:48:100
11454991615,1cyclictest65-21ksoftirqd/609:41:106
11454991614,2cyclictest65-21ksoftirqd/612:11:426
11454991614,1cyclictest65-21ksoftirqd/610:44:346
11454991614,1cyclictest65-21ksoftirqd/610:44:346
11454991614,1cyclictest65-21ksoftirqd/609:44:396
1145199160,1cyclictest31296-21cat08:36:593
1145199160,1cyclictest2155-21smartctl08:42:023
11450991612,1cyclictest33-21ksoftirqd/210:29:392
11449991614,1cyclictest25-21ksoftirqd/110:10:521
11448991614,1cyclictest9-21ksoftirqd/010:19:140
1144899160,3cyclictest0-21swapper/008:27:020
309102150,0sleep70-21swapper/709:07:437
11454991514,1cyclictest65-21ksoftirqd/611:44:116
11454991514,1cyclictest65-21ksoftirqd/611:40:106
11454991514,1cyclictest65-21ksoftirqd/610:38:296
11454991513,1cyclictest65-21ksoftirqd/612:22:556
11454991513,1cyclictest65-21ksoftirqd/612:22:556
11454991511,3cyclictest65-21ksoftirqd/610:52:126
11452991512,2cyclictest691-21systemd-logind09:46:184
11452991512,2cyclictest22333-21systemd10:40:144
1145299150,15cyclictest11905-21kworker/4:309:40:234
11449991514,1cyclictest25-21ksoftirqd/111:24:151
11449991514,1cyclictest25-21ksoftirqd/110:32:311
11449991512,1cyclictest25-21ksoftirqd/110:38:121
1144899152,5cyclictest6544-21munin-run11:36:480
1144899150,10cyclictest686-21dbus-daemon09:12:290
191532140,0sleep60-21swapper/609:53:476
188822140,0sleep50-21swapper/510:54:495
1145499149,4cyclictest65-21ksoftirqd/612:01:406
11454991413,1cyclictest12893-21kworker/6:110:17:096
11454991412,1cyclictest65-21ksoftirqd/611:21:476
11454991412,1cyclictest65-21ksoftirqd/610:02:476
11454991412,1cyclictest65-21ksoftirqd/609:25:596
11454991411,2cyclictest1857-21cp12:33:486
11450991413,1cyclictest0-21swapper/210:41:232
11450991411,2cyclictest33-21ksoftirqd/211:52:292
11450991410,3cyclictest33-21ksoftirqd/211:49:472
11449991413,1cyclictest25-21ksoftirqd/112:21:361
11449991413,1cyclictest25-21ksoftirqd/112:21:361
11449991413,1cyclictest25-21ksoftirqd/109:27:051
11449991412,1cyclictest25-21ksoftirqd/111:58:281
11449991412,1cyclictest25-21ksoftirqd/111:37:241
11449991412,1cyclictest25-21ksoftirqd/111:12:561
11449991412,1cyclictest25-21ksoftirqd/111:03:071
11449991412,1cyclictest25-21ksoftirqd/109:23:151
11449991412,1cyclictest25-21ksoftirqd/109:17:091
11449991411,2cyclictest25-21ksoftirqd/109:43:161
11455991311,1cyclictest73-21ksoftirqd/709:53:327
1145599130,13cyclictest5581-21kworker/7:212:18:547
1145599130,13cyclictest5581-21kworker/7:212:18:547
1145499138,4cyclictest65-21ksoftirqd/609:35:436
11454991312,1cyclictest65-21ksoftirqd/612:30:186
11454991312,1cyclictest65-21ksoftirqd/612:30:186
11454991312,1cyclictest65-21ksoftirqd/612:02:476
11454991312,1cyclictest65-21ksoftirqd/611:50:376
11454991312,1cyclictest65-21ksoftirqd/611:29:536
11454991311,2cyclictest65-21ksoftirqd/609:28:446
11454991311,1cyclictest65-21ksoftirqd/611:53:546
11454991311,1cyclictest65-21ksoftirqd/611:05:396
11454991311,1cyclictest65-21ksoftirqd/610:07:066
11454991311,1cyclictest65-21ksoftirqd/609:13:266
11454991311,1cyclictest65-21ksoftirqd/609:09:006
1145499130,2cyclictest131rcu_sched10:33:246
1145399132,5cyclictest15129-21bash12:32:405
11453991311,1cyclictest57-21ksoftirqd/511:39:145
1145399130,12cyclictest24146-21kworker/5:112:25:215
1145399130,12cyclictest24146-21kworker/5:112:25:215
1145399130,0cyclictest88050irq/26-em1-tx-009:22:375
1145299139,3cyclictest49-21ksoftirqd/409:29:364
1145299138,4cyclictest49-21ksoftirqd/411:50:214
11452991312,1cyclictest49-21ksoftirqd/411:10:274
11452991311,1cyclictest49-21ksoftirqd/412:21:434
11452991311,1cyclictest49-21ksoftirqd/412:21:434
11452991311,1cyclictest464-21grepconf.sh12:02:134
1145199131,3cyclictest41-21ksoftirqd/308:46:563
1145099139,3cyclictest33-21ksoftirqd/210:47:312
1145099130,7cyclictest24300-21sshd12:29:322
1145099130,7cyclictest24300-21sshd12:29:322
1144999139,1cyclictest25-21ksoftirqd/109:14:401
11449991312,1cyclictest25-21ksoftirqd/110:24:191
11449991312,1cyclictest25-21ksoftirqd/110:20:421
11449991312,1cyclictest25-21ksoftirqd/110:05:331
11449991312,1cyclictest25-21ksoftirqd/109:32:031
11449991311,1cyclictest25-21ksoftirqd/111:42:131
11449991311,1cyclictest25-21ksoftirqd/110:56:241
11449991311,1cyclictest25-21ksoftirqd/110:46:081
11449991311,1cyclictest25-21ksoftirqd/110:46:081
11449991311,1cyclictest25-21ksoftirqd/110:15:351
49312120,0sleep00-21swapper/009:10:240
285082120,0sleep40-21swapper/411:21:234
128022120,1sleep51-21systemd11:20:285
1145599127,4cyclictest4599-21kill09:30:487
1145599122,4cyclictest686-21dbus-daemon12:04:217
1145599122,4cyclictest2582-21sshd10:09:297
1145599122,4cyclictest21796-21systemd-cgroups11:59:477
1145599122,4cyclictest20065-21systemd11:44:547
1145599122,4cyclictest10905-21sshd09:32:577
11455991210,1cyclictest8553-21iostat10:32:017
11455991210,1cyclictest73-21ksoftirqd/711:31:307
11455991210,1cyclictest73-21ksoftirqd/710:01:587
1145599121,5cyclictest6725-21sshd09:19:477
1145599121,5cyclictest13850-21sshd11:37:077
1145599120,11cyclictest10420-21kworker/7:010:17:547
11454991211,1cyclictest65-21ksoftirqd/610:47:486
11454991211,1cyclictest65-21ksoftirqd/609:48:526
11454991211,1cyclictest65-21ksoftirqd/609:48:526
11454991210,1cyclictest65-21ksoftirqd/612:19:206
11454991210,1cyclictest65-21ksoftirqd/612:19:206
11454991210,1cyclictest65-21ksoftirqd/611:35:326
11454991210,1cyclictest65-21ksoftirqd/611:09:446
11454991210,1cyclictest65-21ksoftirqd/610:28:586
11454991210,1cyclictest65-21ksoftirqd/609:21:186
1145399122,4cyclictest887-21gdbus09:37:245
1145399122,4cyclictest686-21dbus-daemon12:08:175
1145399122,4cyclictest0-21swapper/511:57:085
11453991210,1cyclictest0-21swapper/512:16:055
1145399120,11cyclictest2764-21grepconf.sh11:31:005
1145399120,11cyclictest16932-21kworker/5:110:12:265
1145299128,4cyclictest49-21ksoftirqd/412:14:394
1145299124,5cyclictest887-21gdbus10:35:034
1145299124,5cyclictest29278-21cp09:19:124
11452991211,1cyclictest49-21ksoftirqd/410:20:594
11452991210,1cyclictest49-21ksoftirqd/412:08:404
1145299120,11cyclictest21884-21kworker/4:112:29:144
1145299120,11cyclictest21884-21kworker/4:112:29:144
1145199124,3cyclictest41-21ksoftirqd/307:22:063
1145199121,2cyclictest41-21ksoftirqd/307:37:053
1145199121,1cyclictest14763-21ls09:02:083
1145099122,4cyclictest4119-21sshd11:18:042
1145099122,4cyclictest20686-21systemd10:12:192
1145099122,4cyclictest15000-21id09:12:492
1144999129,2cyclictest25-21ksoftirqd/112:06:071
11449991210,1cyclictest25-21ksoftirqd/112:32:271
11449991210,1cyclictest25-21ksoftirqd/112:16:391
11449991210,1cyclictest25-21ksoftirqd/112:10:031
11449991210,1cyclictest25-21ksoftirqd/111:28:211
11449991210,1cyclictest25-21ksoftirqd/109:36:531
11449991210,1cyclictest25-21ksoftirqd/109:06:541
1144999120,11cyclictest26362-21kworker/1:409:58:551
1144899123,4cyclictest28042-21sshd10:27:340
1144899122,4cyclictest6356-21systemd12:22:560
1144899122,4cyclictest6356-21systemd12:22:560
1144899122,4cyclictest1-21systemd11:02:570
1144899122,1cyclictest12374-21grep11:57:200
11448991210,1cyclictest9-21ksoftirqd/011:44:540
11448991210,1cyclictest9-21ksoftirqd/009:52:180
1144899120,11cyclictest6672-21systemd10:04:110
1144899120,11cyclictest4019-21kworker/0:009:33:120
38042110,0sleep20-21swapper/209:54:472
234422110,0sleep40-21swapper/411:13:384
1145599119,1cyclictest73-21ksoftirqd/712:13:567
1145599115,5cyclictest7877-21sshd11:07:057
1145599113,7cyclictest28270-21sshd11:54:367
1145599112,3cyclictest0-21swapper/710:22:407
11455991110,1cyclictest73-21ksoftirqd/711:15:477
11455991110,1cyclictest0-21swapper/712:35:357
1145599111,4cyclictest492-21systemd-journal10:47:407
1145599111,4cyclictest4682-21grepconf.sh10:28:057
1145599111,4cyclictest0-21swapper/712:06:517
1145599111,4cyclictest0-21swapper/710:01:047
1145599110,11cyclictest3091-21kworker/7:209:47:317
1145599110,11cyclictest3091-21kworker/7:209:47:317
1145599110,11cyclictest12352-21kworker/7:009:13:387
1145499119,1cyclictest65-21ksoftirqd/611:12:136
1145499119,1cyclictest65-21ksoftirqd/610:24:256
1145499119,1cyclictest65-21ksoftirqd/609:57:366
1145399119,1cyclictest57-21ksoftirqd/509:48:035
1145399119,1cyclictest57-21ksoftirqd/509:48:035
1145399119,1cyclictest57-21ksoftirqd/509:19:135
1145399118,1cyclictest57-21ksoftirqd/510:23:525
1145399116,4cyclictest14200-21bash12:04:565
1145399111,4cyclictest4918-21grepconf.sh11:49:355
1145399111,4cyclictest21149-21sshd10:21:425
1145399111,4cyclictest10580-21systemd11:03:345
1145399110,5cyclictest0-21swapper/510:29:225
1145399110,5cyclictest0-21swapper/509:58:215
1145399110,1cyclictest686-21dbus-daemon10:42:085
1145399110,1cyclictest686-21dbus-daemon10:42:085
1145399110,1cyclictest25626-21sshd11:11:565
1145399110,1cyclictest0-21swapper/509:08:485
1145299119,1cyclictest49-21ksoftirqd/412:23:234
1145299119,1cyclictest49-21ksoftirqd/412:23:234
1145299119,1cyclictest49-21ksoftirqd/411:28:384
1145299119,1cyclictest49-21ksoftirqd/411:23:254
1145299119,1cyclictest49-21ksoftirqd/410:50:554
1145299119,1cyclictest49-21ksoftirqd/409:13:084
1145299110,10cyclictest887-21gdbus10:55:514
1145299110,10cyclictest24764-21cp09:31:584
1145299110,10cyclictest0-21swapper/411:44:334
1145199114,1cyclictest41-21ksoftirqd/308:58:423
1145199114,1cyclictest41-21ksoftirqd/308:11:213
1145199114,1cyclictest41-21ksoftirqd/308:11:213
1145199114,1cyclictest41-21ksoftirqd/307:35:483
1145199113,1cyclictest41-21ksoftirqd/308:23:173
11451991110,1cyclictest41-21ksoftirqd/308:32:043
1145199111,2cyclictest41-21ksoftirqd/307:57:083
1145199110,0cyclictest121rcu_preempt07:47:083
1145099119,2cyclictest9847-21kworker/2:110:35:192
1145099119,2cyclictest33-21ksoftirqd/211:15:392
1145099119,1cyclictest0-21swapper/210:19:322
1145099114,4cyclictest16015-21grepconf.sh09:44:242
1145099113,5cyclictest18892-21systemd10:52:552
11450991110,1cyclictest0-21swapper/211:33:472
1145099110,11cyclictest12685-21sshd12:04:502
1145099110,10cyclictest16299-21grepconf.sh12:01:222
1145099110,10cyclictest15987-21bash12:17:552
1145099110,10cyclictest15987-21bash12:17:552
1145099110,10cyclictest1362-21grep09:32:232
1145099110,1cyclictest23191-21sshd11:28:252
1144999119,1cyclictest25-21ksoftirqd/112:27:571
1144999119,1cyclictest25-21ksoftirqd/112:27:571
1144999117,1cyclictest25-21ksoftirqd/109:47:091
1144999117,1cyclictest25-21ksoftirqd/109:47:091
1144899119,1cyclictest9-21ksoftirqd/012:32:080
1144899119,1cyclictest9-21ksoftirqd/011:38:190
1144899119,1cyclictest24179-21grepconf.sh09:24:280
11448991110,1cyclictest9-21ksoftirqd/011:15:320
11448991110,1cyclictest9-21ksoftirqd/010:12:250
1144899110,5cyclictest2350-21sshd09:47:150
1144899110,5cyclictest2350-21sshd09:47:150
1144899110,11cyclictest25813-21kworker/0:310:33:560
1144899110,11cyclictest11414-21kworker/0:309:18:580
1144899110,10cyclictest12778-21sshd09:29:220
1145599106,1cyclictest27661-21perf08:31:477
1145599104,2cyclictest686-21dbus-daemon09:23:387
1145599101,4cyclictest0-21swapper/712:27:317
1145599101,4cyclictest0-21swapper/712:27:317
1145599101,3cyclictest0-21swapper/711:22:317
1145599100,4cyclictest13160-21sshd11:03:437
1145599100,4cyclictest1-21systemd10:13:577
1145599100,4cyclictest0-21swapper/710:42:327
1145599100,4cyclictest0-21swapper/710:42:327
1145599100,10cyclictest0-21swapper/709:36:487
1145399109,1cyclictest0-21swapper/509:27:435
1145399103,6cyclictest24556-21bash11:35:575
1145399102,4cyclictest2495-21bash10:33:315
1145399100,4cyclictest7490-21sshd11:42:155
1145399100,4cyclictest0-21swapper/511:08:095
1145299109,1cyclictest49-21ksoftirqd/411:32:054
1145299108,1cyclictest49-21ksoftirqd/412:00:504
1145299108,1cyclictest49-21ksoftirqd/411:53:294
1145299108,1cyclictest49-21ksoftirqd/411:37:574
1145299108,1cyclictest49-21ksoftirqd/411:03:264
1145299108,1cyclictest49-21ksoftirqd/410:08:184
1145299108,1cyclictest49-21ksoftirqd/410:04:544
1145299108,1cyclictest49-21ksoftirqd/409:52:204
1145299104,2cyclictest22277-21sshd09:59:334
1145199103,1cyclictest41-21ksoftirqd/308:12:373
1145199103,1cyclictest41-21ksoftirqd/307:51:493
1145199103,1cyclictest41-21ksoftirqd/307:51:493
1145199103,1cyclictest41-21ksoftirqd/307:44:323
1145199103,1cyclictest41-21ksoftirqd/307:27:253
1145199103,1cyclictest41-21ksoftirqd/307:15:373
1145199101,1cyclictest0-21swapper/307:17:053
1145199100,0cyclictest121rcu_preempt08:02:043
1145099108,1cyclictest33-21ksoftirqd/209:46:492
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional