You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-13 - 10:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Sep 13, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30220214611,101sleep030221-21/usr/sbin/munin19:04:290
316969910547,11cyclictest0-21swapper/122:34:381
31003210110,24sleep131-21ksoftirqd/119:05:031
31696999977,14cyclictest14827-21awk00:04:541
31696999563,23cyclictest2947-21latency_hist19:19:221
31696999346,12cyclictest28408-21kworker/u17:0-ext4-rsv-conversion00:04:221
31696999346,12cyclictest28408-21kworker/u17:0-ext4-rsv-conversion00:04:221
31700998961,21cyclictest27541-21sh00:26:272
31700998865,16cyclictest5267-21sh22:54:572
3169699883,65cyclictest12735-21kworker/u19:1+ext4-rsv-conversion20:04:461
3038528812,44sleep30-21swapper/319:04:403
31700998770,11cyclictest317-21dbus-daemon23:24:212
31700998770,11cyclictest317-21dbus-daemon23:24:212
31696998769,12cyclictest10820-21munin-run23:59:211
31696998753,11cyclictest615-21kworker/u17:2-ext4-rsv-conversion19:29:241
31692998758,19cyclictest14296-21latency_hist19:54:230
31700998669,11cyclictest29008-21runrttasks21:45:562
31696998652,22cyclictest19837-21latency_hist00:14:231
31696998652,22cyclictest19837-21latency_hist00:14:231
31700998565,11cyclictest1-21systemd22:37:402
3169299853,60cyclictest10786-21awk23:59:190
31700998468,11cyclictest31685-21cyclictest19:44:232
31692998453,20cyclictest32058-21sh00:34:410
31696998365,12cyclictest317-21dbus-daemon21:34:211
31692998345,30cyclictest17975-21ssh00:10:010
31692998345,30cyclictest17975-21ssh00:10:010
31692998341,10cyclictest31685-21cyclictest00:16:550
31696998255,19cyclictest29438-21fschecks_count20:39:391
31696998245,20cyclictest181rcu_preempt23:29:401
31692998251,26cyclictest58-21kcompactd022:14:410
31692998238,8cyclictest181rcu_preempt21:39:230
31696998159,8cyclictest181rcu_preempt21:59:431
31692998134,9cyclictest181rcu_preempt23:34:560
31700998059,15cyclictest28647-21sh23:34:372
31696998043,9cyclictest181rcu_preempt19:49:351
31696998043,19cyclictest0-21swapper/100:19:311
31696998043,19cyclictest0-21swapper/100:19:311
31692998046,10cyclictest181rcu_preempt19:59:300
31692998036,7cyclictest181rcu_preempt23:11:470
31692998036,7cyclictest181rcu_preempt23:11:470
31692998018,35cyclictest181rcu_preempt23:48:190
31700997962,11cyclictest1251-21ssh22:49:192
31700997958,13cyclictest1-21systemd20:59:492
31700997958,13cyclictest1-21systemd20:59:492
31700997950,21cyclictest6197-21cron21:09:192
31700997933,31cyclictest17086-21grep22:19:562
31700997933,31cyclictest17086-21grep22:19:562
31696997959,14cyclictest29803-21timerandwakeup00:30:001
31692997952,8cyclictest181rcu_preempt00:20:330
31692997952,8cyclictest181rcu_preempt00:20:330
31700997856,16cyclictest21826-21latency_hist22:29:222
31700997821,36cyclictest0-21swapper/223:42:442
31696997853,17cyclictest6225-21diskmemload21:55:021
31696997848,13cyclictest20391-21sh00:14:481
31692997855,17cyclictest18443-21apt-key21:29:220
31692997855,15cyclictest6225-21diskmemload22:54:560
31692997854,18cyclictest2062-21latency_hist23:44:230
31692997840,8cyclictest181rcu_preempt21:10:530
31692997840,8cyclictest181rcu_preempt21:10:530
31692997839,8cyclictest181rcu_preempt23:04:430
31692997838,9cyclictest181rcu_preempt23:49:480
31692997838,9cyclictest181rcu_preempt23:49:480
31692997827,21cyclictest181rcu_preempt00:04:220
31692997827,21cyclictest181rcu_preempt00:04:220
31692997826,11cyclictest181rcu_preempt21:54:430
3170599777,44cyclictest0-21swapper/320:04:373
31700997753,16cyclictest31685-21cyclictest23:04:192
3170099773,54cyclictest18321-21apt-get21:29:342
31700997721,9cyclictest0-21swapper/221:39:552
31700997721,9cyclictest0-21swapper/221:39:552
31696997757,13cyclictest10345-21mailstats21:14:561
31696997755,12cyclictest0-21swapper/120:29:481
31696997755,12cyclictest0-21swapper/120:29:481
3169699772,26cyclictest24332-21latency_hist20:24:241
31692997747,19cyclictest200-21systemd-journal22:26:390
31692997728,14cyclictest0-21swapper/020:14:370
3170599763,34cyclictest8126-21chrt22:04:573
31700997655,14cyclictest9551-21/usr/sbin/munin21:14:502
31700997652,11cyclictest0-21swapper/223:04:572
31696997652,10cyclictest181rcu_preempt23:15:241
31696997649,19cyclictest23584-21sh22:31:101
31696997649,19cyclictest23584-21sh22:31:101
31696997631,33cyclictest7674-21modprobe19:34:201
31696997626,11cyclictest181rcu_preempt22:39:311
31696997626,11cyclictest181rcu_preempt22:39:311
31692997644,9cyclictest30138-21ssh00:30:240
31692997638,13cyclictest181rcu_preempt21:59:310
31692997615,37cyclictest3004-21basename20:59:200
3170599752,36cyclictest22035-21chrt23:23:463
3170599752,36cyclictest22035-21chrt23:23:463
31700997550,17cyclictest25319-21sh23:29:222
3170099754,37cyclictest7689-21apt19:34:202
31700997514,21cyclictest6846-21cut21:09:432
31700997514,21cyclictest6846-21cut21:09:432
31696997545,10cyclictest181rcu_preempt23:35:381
3169299756,35cyclictest15-21ksoftirqd/022:44:370
31692997554,15cyclictest4456-21ssh22:54:240
31692997554,14cyclictest27375-21latency_hist21:44:230
31692997554,14cyclictest27375-21latency_hist21:44:230
31692997551,15cyclictest29766-21ssh21:48:050
315732753,7sleep00-21swapper/020:44:570
31700997457,11cyclictest2211-21ntpq22:49:552
31700997457,11cyclictest2211-21ntpq22:49:552
31700997453,15cyclictest23123-21if_eth020:19:452
31700997452,16cyclictest662-21cron20:54:202
31700997450,18cyclictest930-21latency_hist21:54:232
31700997450,18cyclictest930-21latency_hist21:54:232
3170099744,41cyclictest12975-21fschecks_count19:49:422
31700997420,21cyclictest14371-21tune2fs00:04:432
31700997413,51cyclictest16863-21apt-get23:14:502
31696997452,8cyclictest181rcu_preempt22:54:531
31696997448,13cyclictest0-21swapper/119:19:551
31696997442,11cyclictest181rcu_preempt21:28:591
31692997443,21cyclictest17677-21ls23:15:430
316332747,47sleep231658-21cut19:09:242
3170599733,32cyclictest4811-21chrt21:04:233
3170599733,32cyclictest4811-21chrt21:04:233
31700997346,18cyclictest0-21swapper/221:24:402
31700997325,17cyclictest28401-21cat23:34:232
3170099732,26cyclictest0-21swapper/219:44:502
31696997349,14cyclictest0-21swapper/120:59:241
31696997348,14cyclictest0-21swapper/120:54:221
31696997340,11cyclictest181rcu_preempt22:18:191
3169699732,29cyclictest19721-21sort20:09:421
3169299735,58cyclictest28357-21fschecks_time22:39:430
3169299735,58cyclictest28357-21fschecks_time22:39:430
31692997342,8cyclictest181rcu_preempt20:29:360
31692997342,8cyclictest181rcu_preempt20:29:360
31692997341,22cyclictest0-21swapper/023:02:430
31692997340,9cyclictest181rcu_preempt21:53:030
31692997340,9cyclictest181rcu_preempt21:53:030
31692997340,8cyclictest181rcu_preempt20:59:430
31692997340,8cyclictest181rcu_preempt20:59:430
3170599723,33cyclictest19615-21chrt21:31:033
3170599723,28cyclictest21884-21chrt21:34:443
3170599723,23cyclictest17490-21chrt20:04:213
31700997249,13cyclictest0-21swapper/200:10:022
31700997249,13cyclictest0-21swapper/200:10:022
31700997248,14cyclictest0-21swapper/221:23:102
3170099723,49cyclictest6070-21modprobe19:29:202
31696997252,14cyclictest343-21runrttasks21:04:531
31696997251,14cyclictest0-21swapper/119:49:231
31696997250,16cyclictest26575-21sh00:24:521
31696997249,17cyclictest10595-21sh22:09:481
31692997250,14cyclictest703-21switchtime20:49:540
31692997246,8cyclictest181rcu_preempt22:04:340
31692997239,26cyclictest0-21swapper/022:24:210
31692997239,26cyclictest0-21swapper/022:24:210
3169299722,39cyclictest29338-21cstates20:39:350
31692997223,11cyclictest181rcu_preempt20:19:440
3170599712,29cyclictest29709-21chrt22:41:333
3170599712,29cyclictest29709-21chrt22:41:333
3170099719,15cyclictest0-21swapper/223:59:442
3170099719,15cyclictest0-21swapper/223:59:442
3170099716,41cyclictest0-21swapper/223:59:232
31700997154,11cyclictest0-21swapper/220:19:222
31700997149,16cyclictest343-21runrttasks00:14:552
31700997145,16cyclictest317-21dbus-daemon22:19:212
31700997141,19cyclictest2064-21latency_hist00:39:232
3170099713,46cyclictest24795-21ssh22:34:222
3170099713,46cyclictest24795-21ssh22:34:222
31696997151,13cyclictest877-21sendmail-mta22:29:201
31696997150,15cyclictest6225-21diskmemload23:04:581
31696997149,7cyclictest181rcu_preempt23:12:551
31696997149,7cyclictest181rcu_preempt23:12:551
31696997146,7cyclictest181rcu_preempt22:04:471
31696997132,21cyclictest6013-21kworker/u19:0-rpciod23:52:161
31696997132,21cyclictest6013-21kworker/u19:0-rpciod23:52:161
31696997120,17cyclictest0-21swapper/120:25:101
31696997120,17cyclictest0-21swapper/120:25:101
31692997147,15cyclictest2400-21ssh22:50:010
3169299714,34cyclictest25795-21cut23:29:400
3170599703,27cyclictest29763-21chrt23:35:173
3170599703,22cyclictest8583-21taskset22:59:573
3170599702,28cyclictest5747-21chrt22:55:113
3170599702,27cyclictest23160-21chrt00:19:403
3170599702,27cyclictest23160-21chrt00:19:403
31700997049,15cyclictest31685-21cyclictest00:29:482
31700997040,22cyclictest8130-21tail22:04:572
31700997017,13cyclictest19224-21modprobe20:09:202
31700997015,26cyclictest0-21swapper/221:39:222
31696997052,12cyclictest16117-21cpu22:19:351
31696997052,12cyclictest16117-21cpu22:19:351
31696997049,8cyclictest181rcu_preempt23:23:001
31696997049,8cyclictest181rcu_preempt23:23:001
31696997037,16cyclictest181rcu_preempt23:44:231
31696997034,11cyclictest181rcu_preempt19:09:541
31692997041,11cyclictest31685-21cyclictest20:05:130
31692997037,12cyclictest181rcu_preempt20:34:370
3169299703,35cyclictest22762-21ps22:29:530
3169299703,35cyclictest22762-21ps22:29:530
3169299703,35cyclictest21019-21latency_hist20:14:230
31700996928,31cyclictest28896-21switchtime22:39:562
31700996928,31cyclictest28896-21switchtime22:39:562
31700996911,44cyclictest2349-21apt-get23:44:372
31696996950,13cyclictest8531-21processes19:34:511
31692996945,18cyclictest26054-21cstates00:24:370
3169299694,48cyclictest963-21latency_hist19:14:230
31692996939,8cyclictest181rcu_preempt22:09:440
3169299693,34cyclictest343-21runrttasks19:46:450
3170599683,30cyclictest4411-21chrt23:48:103
3170599683,22cyclictest27513-21chrt22:38:493
3170599683,22cyclictest16683-21chrt22:19:483
3170599683,22cyclictest16683-21chrt22:19:483
3170599682,31cyclictest1474-21chrt20:54:233
3170099683,44cyclictest1886-21cut20:54:432
3170099683,39cyclictest343-21runrttasks23:53:052
3170099683,39cyclictest343-21runrttasks23:53:052
31696996846,12cyclictest0-21swapper/120:49:201
31696996839,7cyclictest181rcu_preempt21:44:381
31696996837,7cyclictest181rcu_preempt21:49:451
31696996837,7cyclictest181rcu_preempt21:49:451
31696996836,19cyclictest0-21swapper/121:42:371
31696996836,19cyclictest0-21swapper/121:42:371
31696996835,21cyclictest8466-21sh22:59:571
31696996828,20cyclictest58-21kcompactd022:47:361
31692996848,13cyclictest9594-21cpu19:39:370
3169299683,30cyclictest14040-21runrttasks21:20:510
31692996822,7cyclictest181rcu_preempt19:24:500
3170599673,26cyclictest20639-21chrt22:26:173
31700996746,15cyclictest1497-21kernelversion21:54:452
3170099674,41cyclictest7930-21/usr/sbin/munin19:34:502
31700996741,16cyclictest0-21swapper/219:16:402
3170099673,47cyclictest16191-21modprobe23:14:202
3170099673,47cyclictest16191-21modprobe23:14:202
31700996714,19cyclictest0-21swapper/219:59:232
31700996714,19cyclictest0-21swapper/219:59:232
31696996746,13cyclictest9334-21ssh21:14:231
31696996746,13cyclictest9334-21ssh21:14:231
31696996745,8cyclictest181rcu_preempt00:34:371
31696996745,12cyclictest0-21swapper/122:49:361
31696996745,12cyclictest0-21swapper/122:49:361
31696996743,14cyclictest0-21swapper/120:35:011
3169699672,34cyclictest17559-21apt-key20:04:221
31692996745,12cyclictest16389-21sh00:08:270
3169299673,34cyclictest18864-21/usr/sbin/munin21:31:090
3170599663,24cyclictest25956-21chrt21:40:443
3170599663,24cyclictest25956-21chrt21:40:443
3170599663,24cyclictest16329-21taskset00:08:173
3170599663,23cyclictest26013-21chrt20:29:363
3170599663,23cyclictest26013-21chrt20:29:363
3170599662,24cyclictest5023-21chrt21:04:393
3170599662,23cyclictest12060-21chrt23:06:053
3170099668,22cyclictest919-21latency_hist19:14:232
3170099664,50cyclictest3330-21fschecks_count19:19:452
3170099664,45cyclictest6932-21rm22:04:232
3170099664,40cyclictest19476-21/usr/sbin/munin20:09:422
3170099664,39cyclictest26263-21fschecks_time20:29:432
3170099664,39cyclictest26263-21fschecks_time20:29:432
31696996642,13cyclictest0-21swapper/121:04:221
31696996642,13cyclictest0-21swapper/121:04:221
31692996651,8cyclictest0-21swapper/023:24:350
3169299663,51cyclictest27868-21latency_hist22:39:220
3169299663,49cyclictest20038-21latency23:19:450
3169299663,49cyclictest20038-21latency23:19:450
3169299663,46cyclictest3060-21latency_hist19:19:240
31692996632,12cyclictest181rcu_preempt19:54:560
31692996632,12cyclictest181rcu_preempt19:54:560
3170599653,27cyclictest12212-21chrt22:12:513
3170599653,23cyclictest13716-21taskset21:19:593
3170599652,24cyclictest6642-21chrt19:29:443
3170599652,20cyclictest23522-21chrt22:30:593
3170599652,20cyclictest23522-21chrt22:30:593
31700996547,11cyclictest317-21dbus-daemon20:44:212
3170099653,43cyclictest28948-21latency_hist20:39:232
3170099652,45cyclictest10748-21proc_pri22:09:542
3170099652,38cyclictest23743-21mailstats00:19:552
3170099652,38cyclictest23743-21mailstats00:19:552
31700996516,14cyclictest0-21swapper/220:24:512
31700996516,14cyclictest0-21swapper/220:24:512
31696996542,10cyclictest0-21swapper/123:44:301
31696996541,14cyclictest0-21swapper/119:54:461
31696996541,14cyclictest0-21swapper/119:54:461
31692996544,15cyclictest0-21swapper/020:29:220
31692996544,15cyclictest0-21swapper/020:29:220
3170599643,24cyclictest23133-21chrt23:24:473
3170599643,23cyclictest2658-21chrt21:56:173
3170599643,22cyclictest18761-21chrt00:11:503
3170599643,22cyclictest18761-21chrt00:11:503
3170599643,22cyclictest1633-21taskset22:49:403
3170599643,22cyclictest1633-21taskset22:49:403
3170599642,40cyclictest16783-21chrt23:14:373
3170599642,26cyclictest12669-21taskset00:01:163
3170599642,26cyclictest12669-21taskset00:01:163
3170599642,23cyclictest15173-21chrt22:17:453
3170599642,22cyclictest31195-21chrt21:49:533
3170599642,22cyclictest31195-21chrt21:49:533
31700996436,14cyclictest0-21swapper/220:04:232
31696996442,16cyclictest15405-21latency_hist21:24:221
31696996440,14cyclictest0-21swapper/119:39:491
3169699643,25cyclictest22505-21seq23:24:241
31692996443,12cyclictest0-21swapper/021:14:440
31692996416,36cyclictest5377-21ntp_kernel_pll_21:04:490
3170599633,22cyclictest9585-21taskset19:39:323
3170599632,23cyclictest31528-21chrt00:34:193
3170599632,23cyclictest27325-21taskset00:25:483
31705996310,13cyclictest0-21swapper/300:39:213
3170099634,40cyclictest343-21runrttasks20:47:072
3169699632,43cyclictest22579-21latency_hist20:19:221
3169299633,22cyclictest4108-21grep19:20:000
3170599623,23cyclictest29457-21chrt21:47:133
3170599623,21cyclictest28744-21chrt20:36:533
3170599622,21cyclictest14858-21chrt23:10:353
3170599622,21cyclictest14858-21chrt23:10:353
3169299623,44cyclictest7930-21/usr/sbin/munin19:34:290
3169299623,44cyclictest6566-21fschecks_count19:29:430
3170599613,22cyclictest13803-21chrt19:50:123
31696996142,13cyclictest0-21swapper/121:34:471
3170599602,25cyclictest10098-21taskset23:57:313
31705996011,12cyclictest0-21swapper/323:39:413
3170599599,15cyclictest0-21swapper/321:29:243
3170599593,37cyclictest8938-21taskset21:13:313
3170599593,37cyclictest8938-21taskset21:13:313
3170599584,22cyclictest6543-21taskset22:03:433
3170599578,12cyclictest0-21swapper/319:19:593
3170599573,35cyclictest9485-21taskset19:39:233
3170599573,22cyclictest21475-21chrt00:16:073
3170599564,35cyclictest25892-21taskset23:29:423
31705995611,12cyclictest0-21swapper/320:41:543
3170599552,23cyclictest31893-21taskset20:45:363
3170599533,35cyclictest15901-21chrt19:59:233
3170599533,35cyclictest15901-21chrt19:59:233
99052520,8sleep30-21swapper/321:14:443
3170599522,37cyclictest2462-21chrt20:54:593
3170599522,34cyclictest6387-21chrt23:50:213
3170599522,34cyclictest6387-21chrt23:50:213
3170599522,32cyclictest5246-21chrt19:24:503
3170599513,34cyclictest12686-21chrt19:49:233
3170599512,31cyclictest20055-21chrt20:09:523
3170599494,33cyclictest31387-21taskset22:44:453
3170599443,30cyclictest3086-21taskset19:19:243
3170599443,28cyclictest25049-21taskset20:24:553
3170599443,28cyclictest25049-21taskset20:24:553
3170599422,28cyclictest22298-21taskset20:16:573
3170599412,27cyclictest24078-21chrt20:23:493
31705993810,15cyclictest0-21swapper/319:14:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional