You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 09:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Jan 11, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
974721318,103sleep019676-21snmpd19:08:430
9010212518,44sleep19016-21ntp_states19:05:011
9962991193,77cyclictest23375-40mandb23:59:261
9962991183,83cyclictest13760-21apt-get22:49:391
9962991123,75cyclictest26388-21apt-get00:04:371
9962991089,76cyclictest32021-21apt-get20:14:501
8642210810,66sleep28653-21/usr/sbin/munin19:04:502
99629910257,38cyclictest28636-21sh22:19:571
99579910159,13cyclictest181rcu_preempt22:31:370
2308621010,6sleep20-21swapper/223:04:432
9957999976,17cyclictest23295-21latency_hist19:49:260
9962999733,57cyclictest0-21swapper/119:59:231
9957999663,11cyclictest181rcu_preempt23:04:110
9962999452,37cyclictest9945-21cyclictest00:12:101
9957999473,14cyclictest9945-21cyclictest00:21:530
996299934,34cyclictest9889-21sort20:46:171
996299914,34cyclictest9185-21date20:44:251
9962999141,44cyclictest9188-21idleruntime-cro21:49:231
9962999141,44cyclictest9188-21idleruntime-cro21:49:231
996299913,37cyclictest2815-21acpi20:24:341
9962999133,37cyclictest181rcu_preempt22:05:011
996299903,40cyclictest11368-21ssh23:39:251
996299903,40cyclictest11368-21ssh23:39:251
996299903,37cyclictest352-21runrttasks00:28:221
996299903,37cyclictest352-21runrttasks00:28:221
996299903,33cyclictest2451-21latency_hist23:24:261
996299902,34cyclictest2287-21timerandwakeup22:29:581
9957999072,12cyclictest18285-21sh21:09:560
9957999072,12cyclictest18285-21sh21:09:560
996299894,38cyclictest17519-21wc22:54:561
9962998938,42cyclictest0-21swapper/119:59:471
9962998936,47cyclictest0-21swapper/123:09:581
996299893,35cyclictest6277-21latency_hist00:24:251
996299893,34cyclictest13688-21sed22:49:271
9957998966,17cyclictest12504-21ssh23:40:010
9957998962,19cyclictest15913-21latency_hist21:04:260
9957998937,21cyclictest29281-21kworker/u18:2-events_unbound23:29:580
9966998871,10cyclictest0-21swapper/221:00:022
9966998870,9cyclictest0-21swapper/220:10:372
9966998870,9cyclictest0-21swapper/220:10:372
996299884,35cyclictest28314-21/usr/sbin/munin20:04:561
996299884,35cyclictest16555-21grep21:04:561
996299884,31cyclictest352-21runrttasks00:17:131
996299883,36cyclictest12084-21unixbench_singl20:50:001
996299883,30cyclictest17406-21grep23:49:251
9962998832,49cyclictest298-21in:imuxsock21:23:241
9966998772,8cyclictest0-21swapper/200:14:442
996299874,33cyclictest21664-21/usr/sbin/munin22:09:521
996299874,30cyclictest13255-21/usr/sbin/munin21:54:561
996299874,30cyclictest13255-21/usr/sbin/munin21:54:561
996299873,37cyclictest5393-21ssh23:29:261
996299873,37cyclictest5393-21ssh23:29:261
996299873,36cyclictest29851-21grep23:14:591
996299873,36cyclictest20343-21latency22:59:481
996299873,35cyclictest25193-21latency22:14:501
996299873,35cyclictest25193-21latency22:14:501
996299873,33cyclictest18409-21awk21:09:571
996299873,33cyclictest18409-21awk21:09:571
9962998731,49cyclictest0-21swapper/120:59:241
9957998752,16cyclictest181rcu_preempt23:12:340
997399863,60cyclictest26952-21chrt00:04:373
9966998668,14cyclictest9945-21cyclictest21:36:152
9966998661,11cyclictest181rcu_preempt21:24:152
996299864,33cyclictest2137-21tail20:20:001
996299863,38cyclictest22878-21/usr/sbin/munin23:04:421
996299863,32cyclictest5762-21latency_hist20:34:231
996299863,32cyclictest5589-21/usr/sbin/munin23:29:491
996299862,31cyclictest26577-21apt-config00:04:251
996299862,31cyclictest26577-21apt-config00:04:251
9957998669,8cyclictest0-21swapper/020:34:270
9957998630,20cyclictest9945-21cyclictest20:19:410
9966998550,13cyclictest181rcu_preempt23:24:462
9966998550,13cyclictest181rcu_preempt23:24:462
9962998534,43cyclictest0-21swapper/123:39:401
996299853,36cyclictest17008-21acpi19:29:341
996299853,33cyclictest352-21runrttasks22:36:201
996299853,32cyclictest29775-21/usr/sbin/munin21:29:471
996299852,35cyclictest7370-21latency_hist20:39:261
9957998564,8cyclictest181rcu_preempt23:36:100
9957998564,8cyclictest181rcu_preempt23:36:100
9966998447,8cyclictest181rcu_preempt23:10:342
9966998439,13cyclictest181rcu_preempt21:49:552
996299844,33cyclictest15668-21fschecks_time19:24:451
996299844,32cyclictest352-21runrttasks21:39:471
996299843,36cyclictest11310-21sshd19:12:261
996299843,34cyclictest31495-21cut22:24:561
996299843,34cyclictest31495-21cut22:24:561
996299843,33cyclictest20960-21sh21:14:441
996299843,31cyclictest14568-21fschecks_count20:59:461
996299842,35cyclictest19428-21runrttasks23:51:581
996299842,35cyclictest19428-21runrttasks23:51:581
996299842,33cyclictest20900-21mailstats19:39:571
996299842,30cyclictest14186-21cut19:19:471
996299842,30cyclictest14186-21cut19:19:471
9957998463,14cyclictest58-21kcompactd020:16:090
9962998355,19cyclictest16663-21unixbench_singl22:00:011
9962998339,38cyclictest17326-21diskmemload22:39:421
996299833,34cyclictest22833-21head19:45:001
996299833,34cyclictest12557-21latency19:14:521
996299833,26cyclictest9841-21fschecks_time00:29:451
9957998361,15cyclictest17326-21diskmemload23:04:480
9957998338,12cyclictest181rcu_preempt23:21:100
9966998262,10cyclictest0-21swapper/200:09:482
996699823,52cyclictest2103-21ssh22:29:552
996299823,36cyclictest27830-21unixbench_singl21:25:021
996299823,34cyclictest19243-21sendmail_mailqu19:34:551
996299823,33cyclictest590-21cut21:34:451
996299823,29cyclictest23651-21cut19:49:441
996299823,29cyclictest23651-21cut19:49:441
9962998221,11cyclictest0-21swapper/100:34:591
9957998261,11cyclictest0-21swapper/020:24:460
9957998260,12cyclictest0-21swapper/020:59:260
9966998155,19cyclictest297-21systemd-logind20:39:262
9966998136,11cyclictest181rcu_preempt21:30:022
996299813,27cyclictest30320-21cpuspeed20:10:231
996299813,27cyclictest30320-21cpuspeed20:10:231
9957998160,15cyclictest3413-21latency_hist00:19:260
9957998133,29cyclictest181rcu_preempt22:38:380
9966998041,13cyclictest181rcu_preempt19:24:262
9966998041,13cyclictest181rcu_preempt19:24:262
9966998038,10cyclictest181rcu_preempt00:27:332
9966998038,10cyclictest181rcu_preempt00:27:332
9966998036,12cyclictest0-21swapper/222:46:282
9966998027,13cyclictest181rcu_preempt20:24:342
996299802,27cyclictest9479-21/usr/sbin/munin21:49:571
9957998066,8cyclictest0-21swapper/021:50:000
9957998065,9cyclictest58-21kcompactd022:40:010
9957998065,8cyclictest0-21swapper/019:34:550
9957998064,10cyclictest29132-21df_inode23:14:430
9957998064,10cyclictest17326-21diskmemload22:04:450
9957998061,8cyclictest0-21swapper/020:39:270
9957998058,7cyclictest181rcu_preempt23:28:520
9957998058,7cyclictest181rcu_preempt23:28:520
9957998049,12cyclictest181rcu_preempt23:45:040
9966997964,9cyclictest29281-21kworker/u18:2+events_unbound23:19:232
9966997963,10cyclictest4413-21/usr/sbin/munin00:19:592
9966997946,8cyclictest181rcu_preempt22:21:242
9966997942,10cyclictest181rcu_preempt21:57:502
9966997942,10cyclictest181rcu_preempt21:57:502
9966997930,17cyclictest181rcu_preempt20:15:332
9966997929,13cyclictest181rcu_preempt22:08:402
9957997964,8cyclictest0-21swapper/022:14:400
9957997964,8cyclictest0-21swapper/022:14:400
9957997960,13cyclictest29998-21latency_hist20:09:270
9957997933,17cyclictest0-21swapper/022:00:360
88282798,51sleep30-21swapper/319:04:553
9966997843,9cyclictest181rcu_preempt22:36:152
9966997834,14cyclictest181rcu_preempt19:34:402
9966997831,16cyclictest181rcu_preempt20:49:272
996699782,45cyclictest39-21ksoftirqd/222:29:222
996699782,45cyclictest39-21ksoftirqd/222:29:222
9957997864,8cyclictest0-21swapper/019:24:450
9957997861,8cyclictest0-21swapper/019:09:440
9957997841,9cyclictest181rcu_preempt19:33:080
995799782,21cyclictest13760-21apt-get22:49:580
9966997754,17cyclictest1-21systemd21:49:242
9966997754,17cyclictest1-21systemd21:49:242
9966997739,12cyclictest181rcu_preempt00:35:162
9957997762,9cyclictest25604-21ntp_offset19:54:540
9957997748,9cyclictest181rcu_preempt22:21:210
9966997635,13cyclictest181rcu_preempt23:44:062
9966997629,14cyclictest181rcu_preempt20:04:402
996699762,32cyclictest39-21ksoftirqd/219:09:372
9957997650,9cyclictest181rcu_preempt21:44:500
9957997650,9cyclictest181rcu_preempt21:44:500
9957997650,19cyclictest26509-21apt-key00:04:260
9957997650,19cyclictest26509-21apt-key00:04:260
9957997649,8cyclictest181rcu_preempt19:39:590
9957997647,19cyclictest0-21swapper/022:24:470
9957997647,19cyclictest0-21swapper/022:24:470
9966997558,9cyclictest0-21swapper/223:20:002
9966997558,11cyclictest14372-21kworker/u17:0-writeback21:04:452
9966997542,13cyclictest181rcu_preempt23:59:572
9966997542,13cyclictest181rcu_preempt23:59:572
9966997538,9cyclictest181rcu_preempt23:38:342
9966997538,9cyclictest181rcu_preempt23:38:342
9966997538,8cyclictest181rcu_preempt21:16:282
9957997558,11cyclictest17878-21fschecks_count23:49:450
9957997558,11cyclictest17878-21fschecks_count23:49:450
9957997553,9cyclictest181rcu_preempt00:09:390
9957997549,8cyclictest181rcu_preempt19:14:540
9957997549,7cyclictest181rcu_preempt20:39:580
9957997549,20cyclictest9945-21cyclictest19:59:350
9957997549,20cyclictest23416-40gzip23:59:250
9957997542,11cyclictest181rcu_preempt22:56:250
9957997535,14cyclictest25404-21runrttasks21:21:320
9957997532,8cyclictest181rcu_preempt21:24:500
9966997454,10cyclictest0-21swapper/200:29:392
9966997427,13cyclictest181rcu_preempt22:52:352
9966997426,16cyclictest181rcu_preempt00:05:262
9957997460,7cyclictest0-21swapper/020:54:260
9957997459,9cyclictest11377-21ssh22:45:000
9957997447,7cyclictest181rcu_preempt21:34:410
9966997355,13cyclictest381ktimers/222:39:392
9966997354,9cyclictest0-21swapper/221:09:552
9966997354,9cyclictest0-21swapper/221:09:552
9966997354,14cyclictest9945-21cyclictest22:12:472
9966997340,11cyclictest23681-21fschecks_count19:49:442
9966997340,11cyclictest23681-21fschecks_count19:49:442
9966997328,8cyclictest181rcu_preempt19:54:482
9966997324,12cyclictest181rcu_preempt19:44:262
995799735,13cyclictest30412-21ntp_states21:29:540
9957997347,8cyclictest181rcu_preempt00:39:170
9957997345,11cyclictest181rcu_preempt20:10:230
9957997345,11cyclictest181rcu_preempt20:10:230
9957997342,8cyclictest181rcu_preempt20:46:180
9957997324,16cyclictest0-21swapper/022:13:210
9966997231,11cyclictest181rcu_preempt23:33:392
9966997227,13cyclictest181rcu_preempt23:52:482
9966997227,13cyclictest181rcu_preempt23:52:482
9957997254,12cyclictest9945-21cyclictest21:39:330
9957997243,23cyclictest24805-21cron19:54:240
9957997243,23cyclictest24805-21cron19:54:240
995799724,20cyclictest15-21ksoftirqd/000:04:460
997399714,52cyclictest19039-21chrt22:04:473
997399713,53cyclictest6196-21taskset21:44:253
9966997138,12cyclictest181rcu_preempt22:15:102
9966997138,12cyclictest181rcu_preempt22:15:102
996699713,54cyclictest19863-21ssh22:59:352
9966997131,14cyclictest181rcu_preempt23:55:102
9957997155,8cyclictest0-21swapper/000:25:010
9957997155,8cyclictest0-21swapper/000:25:010
9957997152,7cyclictest181rcu_preempt21:16:480
9957997122,9cyclictest181rcu_preempt19:19:440
9957997122,9cyclictest181rcu_preempt19:19:440
997399703,53cyclictest15402-21chrt22:51:273
9966997038,11cyclictest181rcu_preempt21:29:132
9957997042,8cyclictest181rcu_preempt00:29:480
9966996933,10cyclictest181rcu_preempt22:54:392
9966996927,14cyclictest181rcu_preempt20:54:572
9966996927,11cyclictest181rcu_preempt19:14:332
9957996941,8cyclictest181rcu_preempt21:04:560
997399683,52cyclictest9508-21chrt20:44:363
997399683,50cyclictest22675-21chrt21:17:253
997399683,50cyclictest18094-21taskset19:31:053
997399682,51cyclictest23896-21chrt22:13:013
9966996848,15cyclictest58-21kcompactd020:44:262
9966996838,8cyclictest181rcu_preempt19:47:102
9966996835,7cyclictest181rcu_preempt20:30:282
9966996834,8cyclictest181rcu_preempt23:44:472
9966996831,9cyclictest181rcu_preempt19:59:552
9966996828,7cyclictest181rcu_preempt19:29:272
9966996824,10cyclictest181rcu_preempt20:21:282
9966996823,13cyclictest181rcu_preempt21:59:342
997399673,51cyclictest2771-21taskset23:24:413
997399673,51cyclictest2771-21taskset23:24:413
997399673,51cyclictest17194-21chrt21:07:573
997399673,51cyclictest11878-21chrt21:53:283
997399672,49cyclictest6436-21taskset00:24:263
9966996733,12cyclictest181rcu_preempt20:49:512
9966996722,33cyclictest18355-21modprobe19:34:232
9957996747,13cyclictest14200-21ssh21:56:300
9957996747,13cyclictest14200-21ssh21:56:300
997399663,51cyclictest15562-21taskset19:24:413
997399663,50cyclictest27399-21chrt21:24:553
997399663,49cyclictest11151-21chrt19:10:243
997399663,48cyclictest22176-21chrt23:56:143
997399663,47cyclictest14233-21taskset21:56:363
997399663,47cyclictest14233-21taskset21:56:363
997399662,51cyclictest23689-21taskset23:59:343
997399662,51cyclictest23689-21taskset23:59:343
9966996619,14cyclictest181rcu_preempt21:40:272
997399653,49cyclictest5764-21chrt20:34:233
997399653,48cyclictest11727-21chrt19:14:293
997399653,47cyclictest28665-21chrt23:14:243
997399652,51cyclictest31272-21chrt20:11:233
997399652,51cyclictest31272-21chrt20:11:233
997399652,50cyclictest5623-21chrt23:29:363
997399652,49cyclictest32025-21chrt23:19:393
997399652,49cyclictest22904-21taskset19:45:353
997399652,49cyclictest19817-21taskset19:37:333
997399652,48cyclictest8200-21taskset20:39:543
997399643,48cyclictest30378-21taskset00:09:483
997399643,48cyclictest28957-21chrt23:14:373
997399643,48cyclictest14967-21chrt19:22:143
997399643,48cyclictest14967-21chrt19:22:143
997399643,47cyclictest7319-21chrt20:38:573
997399643,47cyclictest32029-21chrt20:14:393
997399643,46cyclictest7736-21taskset21:45:263
997399643,46cyclictest7736-21taskset21:45:263
997399642,48cyclictest32290-21taskset22:26:023
997399642,48cyclictest32290-21taskset22:26:023
997399634,46cyclictest5634-21chrt22:35:183
997399633,48cyclictest12435-21chrt22:47:173
997399633,47cyclictest23803-21chrt23:05:003
997399633,46cyclictest29443-21taskset22:21:323
997399633,46cyclictest17348-21taskset22:01:433
997399632,48cyclictest8001-21chrt22:39:523
997399632,48cyclictest29383-21chrt20:05:483
997399632,47cyclictest19899-21chrt21:13:083
997399632,47cyclictest19899-21chrt21:13:083
997399623,47cyclictest11960-21taskset00:33:423
997399623,46cyclictest2551-21chrt21:37:563
997399623,46cyclictest25112-21chrt22:14:483
997399623,46cyclictest25112-21chrt22:14:483
997399623,46cyclictest13468-21chrt20:54:573
997399622,48cyclictest9734-21chrt23:35:073
997399622,48cyclictest9734-21chrt23:35:073
997399622,48cyclictest12210-21chrt20:51:203
997399622,47cyclictest21447-21chrt19:42:313
997399622,47cyclictest12882-21taskset23:40:263
997399622,47cyclictest12500-21chrt00:34:313
997399622,46cyclictest2612-21taskset22:30:203
997399622,46cyclictest24554-21chrt19:51:103
997399622,46cyclictest24554-21chrt19:51:103
997399622,46cyclictest14723-21chrt20:59:513
997399622,45cyclictest25520-21chrt21:21:513
997399622,45cyclictest2193-21taskset20:20:023
997399612,47cyclictest19166-21chrt22:58:283
997399612,46cyclictest3826-21chrt20:25:163
997399612,46cyclictest30898-21chrt21:30:023
997399612,46cyclictest19855-21taskset22:59:333
997399612,46cyclictest18253-21chrt23:49:543
997399612,46cyclictest18253-21chrt23:49:543
997399612,46cyclictest16163-21taskset23:46:133
997399612,45cyclictest27845-21chrt20:01:433
997399592,46cyclictest9256-21taskset00:29:253
997399592,46cyclictest9256-21taskset00:29:253
997399592,43cyclictest26112-21chrt19:55:313
997399582,44cyclictest1821-21chrt00:15:393
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional