You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 13:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Mar 28, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3183722530,24sleep20-21swapper/219:04:252
3183722530,24sleep20-21swapper/219:04:252
1029721090,3sleep1271irq_work/123:50:521
118392940,5sleep00-21swapper/022:05:140
3190899935,30cyclictest87-21kswapd019:04:332
3190899935,30cyclictest87-21kswapd019:04:332
31899999363,22cyclictest15326-21sh23:04:591
31899999360,25cyclictest20622-21fschecks_count23:14:431
3190899923,10cyclictest0-21swapper/223:29:372
3190899923,10cyclictest0-21swapper/223:29:372
31908999146,38cyclictest373-21lldpd21:29:242
3190899913,31cyclictest21360-21cstates00:10:002
3190899905,34cyclictest2604-21modprobe23:39:212
31908999049,35cyclictest31885-21cyclictest21:35:462
3190899903,41cyclictest29053-21/usr/sbin/munin21:40:122
3190899895,9cyclictest0-21swapper/223:54:332
3190899894,43cyclictest27240-21/usr/sbin/munin00:19:322
3190899894,38cyclictest14548-21modprobe19:49:212
3190899893,41cyclictest722-21cpu00:29:372
31908998844,37cyclictest0-21swapper/222:24:212
3190899884,38cyclictest4793-21cstates21:54:392
3190899884,38cyclictest4332-21munin-run21:54:222
31908998827,51cyclictest0-21swapper/219:29:252
3190899882,38cyclictest20510-21cpuspeed23:14:382
31899998864,16cyclictest27263-21timerandwakeup23:24:581
3190899875,36cyclictest11384-21/usr/sbin/munin22:59:552
3190899874,40cyclictest29468-21latency_hist20:34:242
3190899874,39cyclictest352-21runrttasks22:17:202
3190899874,39cyclictest352-21runrttasks22:17:202
3190899874,37cyclictest24503-21latency_hist20:19:252
3190899874,36cyclictest28490-21apt-config22:34:242
3190899874,35cyclictest352-21runrttasks21:22:502
3190899874,33cyclictest5376-21/usr/sbin/munin22:49:562
3190899874,33cyclictest5376-21/usr/sbin/munin22:49:562
3190899873,41cyclictest2910-21ssh23:39:332
3190899873,41cyclictest2910-21ssh23:39:332
3190899873,39cyclictest368-21cron00:29:212
3190899873,38cyclictest21709-21fschecks_count20:09:422
3190899873,34cyclictest24957-21taskset00:14:572
3190899873,34cyclictest24957-21taskset00:14:572
318212879,52sleep131832-21grep19:04:251
318212879,52sleep131832-21grep19:04:251
306962876,51sleep030415-21/usr/sbin/munin18:59:520
306962876,51sleep030415-21/usr/sbin/munin18:59:520
3190899866,10cyclictest0-21swapper/221:59:362
3190899865,35cyclictest27089-21awk23:24:562
3190899865,11cyclictest0-21swapper/223:59:382
3190899863,43cyclictest32244-21if_eth022:39:452
3190899863,41cyclictest15057-21apt-get19:49:342
3190899863,35cyclictest9738-21find23:49:562
31908998570,8cyclictest0-21swapper/200:09:212
31908998564,15cyclictest277-21dbus-daemon22:29:222
3190899854,9cyclictest0-21swapper/220:54:372
3190899854,36cyclictest29947-21/usr/sbin/munin20:34:432
3190899853,36cyclictest26633-21cut20:24:452
3190899852,38cyclictest17635-21grep19:54:572
3190899844,38cyclictest352-21runrttasks23:09:512
3190899844,38cyclictest352-21runrttasks23:09:512
3190899844,37cyclictest13335-21basename22:09:212
3190899844,34cyclictest31746-21latency_hist22:39:242
3190899844,34cyclictest1420-21fschecks_time19:09:292
3190899844,33cyclictest12816-21latency_hist21:14:242
3190899843,38cyclictest31798-21ssh21:44:552
3190899843,37cyclictest22249-21cstates21:29:392
3190899843,36cyclictest5806-21grep19:19:572
3190899843,36cyclictest3615-21modprobe20:54:212
3190899843,36cyclictest19198-21unixbench_multi19:59:572
3190899843,35cyclictest13123-21/usr/sbin/munin21:14:532
31899998462,17cyclictest24612-21latency_hist20:19:241
3190899835,41cyclictest5922-21ssh23:44:372
3190899834,39cyclictest4748-21ssh22:48:282
3190899834,34cyclictest4113-21sort19:14:582
3190899833,38cyclictest6819-21latency_hist21:04:262
3190899833,36cyclictest13897-21ssh22:09:422
3190899833,35cyclictest24750-21/usr/sbin/munin20:19:562
3190899833,33cyclictest10579-21proc_pri19:34:542
3190899833,33cyclictest10579-21proc_pri19:34:542
31899998360,16cyclictest31885-21cyclictest19:39:541
31899998360,16cyclictest31885-21cyclictest19:39:541
3190899824,36cyclictest15135-21taskset23:04:562
3190899823,38cyclictest1962-21latency_hist20:49:212
3190899823,37cyclictest24237-21awk23:19:552
31899998260,11cyclictest0-21swapper/120:49:591
31908998161,14cyclictest7133-21/usr/sbin/munin21:04:492
3190899814,36cyclictest8638-21chrt19:29:442
3190899814,36cyclictest8638-21chrt19:29:442
3190899814,32cyclictest21248-21modprobe20:09:212
31899998162,11cyclictest0-21swapper/119:39:241
31899998162,11cyclictest0-21swapper/119:39:241
31899998154,19cyclictest19525-21kworker/u19:0+events_unbound20:34:221
3189499812,44cyclictest2388-21/usr/sbin/munin22:44:570
31894998118,48cyclictest22372-21ssh22:24:220
31908998064,10cyclictest31590-21cpuspeed20:40:322
31908998064,10cyclictest31590-21cpuspeed20:40:322
3190899804,35cyclictest12485-21timerwakeupswit19:39:572
3190899804,35cyclictest12485-21timerwakeupswit19:39:572
3190899803,36cyclictest9121-21/usr/sbin/munin22:54:552
31899998058,14cyclictest27895-21sh00:20:421
31894998062,13cyclictest5841-21kworker/u19:0+events_unbound22:04:210
31894997949,21cyclictest352-21runrttasks19:19:540
31894997921,22cyclictest0-21swapper/023:09:570
31894997921,22cyclictest0-21swapper/023:09:570
31899997855,13cyclictest0-21swapper/122:14:241
31899997852,14cyclictest0-21swapper/120:24:241
31894997837,29cyclictest3588-21uname23:39:540
31894997837,29cyclictest3588-21uname23:39:540
31894997821,22cyclictest0-21swapper/000:12:340
31899997739,26cyclictest22865-21modprobe20:14:221
31899997660,10cyclictest1666-21kworker/u17:1-writeback22:09:211
31899997653,12cyclictest0-21swapper/120:04:551
31899997650,19cyclictest14555-21munin-plugin-st19:49:231
31899997650,16cyclictest24531-21ssh00:14:471
31899997650,16cyclictest24531-21ssh00:14:471
31899997649,18cyclictest1123-21latency_hist19:09:241
31899997649,18cyclictest1123-21latency_hist19:09:241
31899997647,22cyclictest23617-21fschecks_count23:19:411
31899997630,10cyclictest0-21swapper/121:25:461
31894997656,10cyclictest0-21swapper/023:53:220
31894997640,31cyclictest0-21swapper/022:14:370
31894997640,31cyclictest0-21swapper/022:14:370
31899997556,14cyclictest30651-21latency00:24:471
31899997556,13cyclictest27755-21sh21:39:151
31899997555,12cyclictest4439-21ssh23:41:111
31899997555,12cyclictest4439-21ssh23:41:111
31899997553,16cyclictest297-21systemd-logind21:04:231
31894997557,12cyclictest26835-21apt-key00:19:240
31894997557,12cyclictest26835-21apt-key00:19:240
31894997556,13cyclictest5968-21ntp_kernel_pll_20:59:500
31894997549,18cyclictest30954-21apt-get20:39:220
31894997537,30cyclictest7154-21apt-get21:04:340
31894997528,8cyclictest0-21swapper/022:44:240
31899997450,18cyclictest6532-21apt-key19:24:261
31899997446,20cyclictest16565-21kernelversion21:19:461
31894997457,8cyclictest0-21swapper/019:34:440
31894997457,8cyclictest0-21swapper/019:34:440
31894997454,14cyclictest469-21latency_hist20:44:240
31894997454,14cyclictest469-21latency_hist20:44:240
31894997445,20cyclictest6973-21fschecks_count19:25:060
3191399732,47cyclictest29093-21chrt22:35:093
3189999737,56cyclictest29107-21ssh22:35:121
31899997346,16cyclictest0-21swapper/121:14:231
31894997352,15cyclictest25651-21cpu22:29:370
31894997338,30cyclictest0-21swapper/000:04:350
31894997331,36cyclictest0-21swapper/022:09:350
31894997315,24cyclictest12046-21/usr/sbin/munin19:39:470
31894997315,24cyclictest12046-21/usr/sbin/munin19:39:470
31894997313,38cyclictest28964-21kworker/u17:0+xprtiod23:36:420
31899997255,10cyclictest28964-21kworker/u17:0-xprtiod23:34:561
31899997254,11cyclictest0-21swapper/119:09:451
31899997253,11cyclictest374-21sshd22:41:491
31899997252,11cyclictest0-21swapper/120:29:251
31899997249,15cyclictest429-21latency_hist20:44:231
31899997249,15cyclictest429-21latency_hist20:44:231
3189999724,53cyclictest6493-21ntpq23:44:511
31899997244,20cyclictest15906-21unixbench_multi23:59:591
31894997258,8cyclictest0-21swapper/023:29:560
31894997258,8cyclictest0-21swapper/023:29:560
31894997253,14cyclictest13670-21sh23:56:510
3189499722,34cyclictest23719-21unixbench_singl22:24:590
31894997222,44cyclictest0-21swapper/021:44:360
31894997213,27cyclictest31448-21rm00:25:270
31899997156,10cyclictest31062-21apt-key20:39:231
31899997151,14cyclictest5792-21sh21:55:031
31899997150,12cyclictest0-21swapper/123:59:241
31899997146,17cyclictest0-21swapper/100:14:241
31894997140,22cyclictest3315-21apt-get19:14:350
31894997137,28cyclictest0-21swapper/023:19:320
31894997136,28cyclictest0-21swapper/021:54:330
31894997130,30cyclictest16142-21apt-get21:19:320
31894997129,35cyclictest0-21swapper/021:49:550
3191399702,54cyclictest11274-21taskset22:04:533
31899997050,11cyclictest28554-21ssh21:40:001
31899997029,30cyclictest30849-21kworker/u18:0+nfsiod22:49:481
31899997029,30cyclictest30849-21kworker/u18:0+nfsiod22:49:481
31899997027,33cyclictest818-21cut20:44:431
31894997048,15cyclictest961-21fschecks_time00:29:430
31894997048,15cyclictest4777-21unixbench_multi20:54:580
31894997011,24cyclictest29029-21sh00:22:000
31894997011,23cyclictest21500-21sh21:28:310
285852700,7sleep3451rcuc/320:29:543
31899996952,10cyclictest0-21swapper/119:54:241
31899996946,17cyclictest19886-21fschecks_count22:19:431
31899996941,15cyclictest181rcu_preempt21:49:541
31894996947,14cyclictest6832-21diskmemload21:34:480
31894996946,16cyclictest12446-21kworker/u19:3+events_unbound19:34:220
31894996946,16cyclictest12446-21kworker/u19:3+events_unbound19:34:220
31894996922,12cyclictest0-21swapper/023:47:310
3191399684,44cyclictest0-21swapper/323:19:313
3191399683,51cyclictest26769-21taskset23:24:473
3191399682,51cyclictest3232-21taskset21:51:193
31899996848,11cyclictest0-21swapper/119:14:591
31899996845,14cyclictest25538-21ssh22:29:251
31899996843,16cyclictest365-21ntpd22:44:521
31899996834,19cyclictest31-21ksoftirqd/122:59:471
31899996820,20cyclictest31-21ksoftirqd/121:34:021
3189499683,55cyclictest15940-21ssh21:19:240
31894996832,26cyclictest24998-21taskset21:34:250
31894996826,30cyclictest32306-21grep19:04:430
31894996826,30cyclictest32306-21grep19:04:430
3191399673,50cyclictest26144-21taskset20:24:233
31899996754,8cyclictest3054-21diskmemload00:33:351
31899996750,10cyclictest0-21swapper/122:19:241
31899996750,10cyclictest0-21swapper/122:19:241
31899996746,16cyclictest0-21swapper/100:04:361
31899996746,15cyclictest32011-21cron23:34:211
31899996746,15cyclictest32011-21cron23:34:211
31899996744,16cyclictest20261-21latency_hist23:14:241
31899996744,16cyclictest20261-21latency_hist23:14:241
31899996733,9cyclictest181rcu_preempt22:56:591
31899996733,25cyclictest13952-21cat21:14:551
31894996751,10cyclictest10647-21ssh22:58:090
3189499673,40cyclictest28828-21munin-node22:34:290
3191399663,50cyclictest4655-21chrt20:54:573
3191399663,49cyclictest5374-21taskset22:49:323
3191399663,49cyclictest5374-21taskset22:49:323
31899996650,9cyclictest0-21swapper/119:59:581
31899996648,12cyclictest31885-21cyclictest19:54:491
31899996620,31cyclictest31-21ksoftirqd/122:03:081
31894996650,11cyclictest365-21ntpd21:40:060
31894996646,14cyclictest14582-21apt-key19:49:220
31894996628,27cyclictest14896-21apt-get23:59:330
31894996626,35cyclictest0-21swapper/023:04:380
3191399653,49cyclictest22528-21chrt21:29:463
3191399653,48cyclictest8881-21taskset23:49:323
3191399653,48cyclictest31497-21taskset21:44:463
3191399652,50cyclictest4212-21taskset23:40:323
3191399652,50cyclictest4212-21taskset23:40:323
3191399652,50cyclictest32162-21chrt23:34:243
3191399652,50cyclictest32162-21chrt23:34:243
3191399652,50cyclictest19149-21taskset00:05:253
3191399652,50cyclictest18941-21taskset23:11:173
3191399652,50cyclictest18941-21taskset23:11:173
3191399652,49cyclictest8432-21taskset22:54:353
3191399652,49cyclictest31458-21taskset00:25:293
3191399652,47cyclictest16812-21taskset00:02:173
31899996517,19cyclictest31-21ksoftirqd/121:06:381
31894996534,23cyclictest2228-21apt-get20:49:340
31894996510,19cyclictest27771-21taskset23:25:510
3191399643,48cyclictest7688-21taskset21:59:383
3191399642,50cyclictest2415-21taskset22:44:343
3191399642,49cyclictest12217-21chrt23:54:553
3191399642,48cyclictest16281-21taskset23:07:123
3191399642,48cyclictest0-21swapper/322:14:373
3191399642,48cyclictest0-21swapper/322:14:373
31899996437,20cyclictest31582-21latency21:44:481
3189999643,43cyclictest8819-21sshd19:29:491
3189999643,43cyclictest8819-21sshd19:29:491
3189999643,27cyclictest31-21ksoftirqd/122:29:561
31894996445,14cyclictest11900-21ssh21:11:490
3189499643,30cyclictest27200-21timerwakeupswit20:24:580
3189499642,44cyclictest19200-21tail19:59:570
31894996416,39cyclictest25530-21timerandwakeup20:19:570
3191399634,45cyclictest0-21swapper/300:29:323
3191399633,47cyclictest26751-21chrt22:30:023
3191399632,48cyclictest22663-21chrt22:24:353
3191399632,47cyclictest5998-21taskset19:21:113
3191399632,47cyclictest20603-21taskset23:14:423
31894996345,10cyclictest16693-21apt-get19:54:340
31894996343,13cyclictest23018-21latency_hist20:14:250
3189499633,47cyclictest23117-21latency_hist23:19:230
31894996321,37cyclictest0-21swapper/022:59:360
31894996315,9cyclictest181rcu_preempt22:50:000
31894996315,9cyclictest181rcu_preempt22:50:000
3191399624,46cyclictest14378-21taskset21:15:193
3191399623,46cyclictest7624-21chrt21:04:493
3191399623,46cyclictest15554-21chrt22:12:143
3191399623,45cyclictest1125-21chrt19:09:243
3191399623,45cyclictest1125-21chrt19:09:243
3191399623,45cyclictest0-21swapper/320:24:343
3191399622,48cyclictest15690-21chrt19:50:473
3191399622,48cyclictest11960-21chrt22:59:503
3191399622,47cyclictest7939-21taskset19:27:233
3191399622,47cyclictest16700-21chrt19:54:363
3191399622,46cyclictest9485-21taskset19:31:363
3191399622,46cyclictest9485-21taskset19:31:363
3189999622,47cyclictest12684-21kworker/u18:3+flush-179:019:24:491
31894996242,14cyclictest16090-21unixbench_singl19:50:520
3191399614,45cyclictest1842-21chrt19:09:453
3191399612,47cyclictest23248-21taskset00:13:023
3191399612,46cyclictest26349-21chrt21:35:173
3191399612,46cyclictest1610-21chrt23:36:393
31899996144,12cyclictest4520-21mailstats20:54:551
31894996143,12cyclictest28799-21timerwakeupswit20:29:570
3189499613,35cyclictest23146-21/usr/sbin/munin20:14:400
31894996129,24cyclictest19917-21apt-get20:04:320
31894996123,28cyclictest619-21apt-get20:44:320
31894996112,37cyclictest1371-21cat19:09:290
3191399603,45cyclictest21459-21taskset21:28:243
3191399603,44cyclictest30657-21chrt20:35:413
3191399603,44cyclictest29313-21chrt00:22:503
3191399603,44cyclictest18651-21chrt19:59:463
3191399603,44cyclictest17918-21taskset21:21:513
3191399603,41cyclictest0-21swapper/320:59:363
3191399602,46cyclictest7819-21chrt23:47:173
3191399602,46cyclictest0-21swapper/321:54:333
3191399602,45cyclictest26180-21chrt00:17:533
3191399602,45cyclictest26180-21chrt00:17:533
3191399602,45cyclictest1880-21taskset20:48:293
3191399602,45cyclictest11281-21taskset19:38:443
3191399602,45cyclictest11281-21taskset19:38:443
3191399602,44cyclictest4354-21taskset19:15:403
3191399602,44cyclictest14308-21taskset19:46:223
3191399593,44cyclictest23707-21chrt20:14:523
3191399593,43cyclictest10843-21taskset21:10:083
3191399592,45cyclictest617-21chrt22:40:163
3191399592,45cyclictest28099-21chrt21:39:313
3191399592,45cyclictest21210-21taskset20:08:573
3191399592,45cyclictest12835-21chrt19:43:023
3191399592,45cyclictest12835-21chrt19:43:023
3191399582,44cyclictest32545-21chrt20:41:083
3191399582,44cyclictest32545-21chrt20:41:083
3191399582,44cyclictest21512-21taskset22:22:043
3109725812,25sleep30-21swapper/319:00:073
3109725812,25sleep30-21swapper/319:00:073
3191399573,42cyclictest2202-21chrt20:49:263
3191399572,43cyclictest22608-21taskset20:11:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional