You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-17 - 21:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Fri Apr 17, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1983725243,0sleep30-21swapper/307:20:173
1962724233,0sleep20-21swapper/207:17:522
1953423728,0sleep10-21swapper/107:16:471
1968722925,0sleep00-21swapper/007:18:340
19919991111,0cyclictest3524-21snmpd10:57:560
19921991010,0cyclictest26650-21sensors08:50:482
339960,0migration/331681-21sh11:47:303
339960,0migration/331029-21sh10:31:373
339960,0migration/32582-21sh09:55:573
339960,0migration/325248-21sh12:02:273
339960,0migration/321271-21sh10:09:523
339960,0migration/314324-21sh11:37:183
339960,0migration/310971-21sh12:14:363
29805060,0irq/28-eth0-rx-31655-21iostat_ios10:15:423
29805060,0irq/28-eth0-rx-29658-21perl12:25:393
29805060,0irq/28-eth0-rx-21604-21awk08:50:423
27160,0ktimersoftd/20-21swapper/207:30:502
199199960,0cyclictest0-21swapper/008:00:430
149960,0migration/016658-21sh11:57:340
149960,0migration/010118-21sh12:12:100
339950,0migration/38602-21pmu-power09:00:443
339950,0migration/36930-21gltestperf08:40:403
339950,0migration/35685-21if_eth110:00:413
339950,0migration/35647-21taskset08:39:193
339950,0migration/35129-21taskset11:30:543
339950,0migration/3497-21latency_hist11:50:273
339950,0migration/33573-21kthreadcore09:20:443
339950,0migration/33176-21kthreadcore07:50:443
339950,0migration/331491-21fschecks_count12:45:413
339950,0migration/328812-21kthreadcore07:45:443
339950,0migration/327213-21taskset08:10:253
339950,0migration/325366-21kthreadcore12:40:463
339950,0migration/325347-21kthreadcore11:05:443
339950,0migration/324834-21fschecks_time08:30:403
339950,0migration/324259-21kthreadcore12:20:433
339950,0migration/322003-21munin-node10:10:373
339950,0migration/319019-21sshd09:49:453
339950,0migration/315736-21munin-node11:40:383
339950,0migration/313218-21timerandwakeup10:20:503
339950,0migration/310581-21kthreadcore12:30:443
339950,0migration/310136-21fschecks_time07:35:413
329950,0watchdog/36314-21runrttasks10:44:213
329950,0watchdog/33112-21sh11:11:463
329950,0watchdog/323250-21iostat_ios11:25:423
329950,0watchdog/318428-21fschecks_time10:45:373
329950,0watchdog/310328-21ssh10:58:463
329950,0watchdog/30-21swapper/312:36:103
329950,0watchdog/30-21swapper/311:55:423
329950,0watchdog/30-21swapper/308:45:453
29815050,0irq/29-eth0-tx-5035-21munin-node12:30:392
29815050,0irq/29-eth0-tx-31363-21munin-node09:20:390
29815050,0irq/29-eth0-tx-30695-21munin-node11:30:452
29815050,0irq/29-eth0-tx-28773-21munin-node12:25:452
29815050,0irq/29-eth0-tx-28580-21ssh11:10:382
29815050,0irq/29-eth0-tx-16007-21ssh10:41:452
29815050,0irq/29-eth0-tx-0-21swapper/212:44:592
29815050,0irq/29-eth0-tx-0-21swapper/212:21:002
29815050,0irq/29-eth0-tx-0-21swapper/211:47:202
29815050,0irq/29-eth0-tx-0-21swapper/211:20:402
29815050,0irq/29-eth0-tx-0-21swapper/211:04:372
29815050,0irq/29-eth0-tx-0-21swapper/210:36:322
29815050,0irq/29-eth0-tx-0-21swapper/210:20:582
29815050,0irq/29-eth0-tx-0-21swapper/210:06:512
29815050,0irq/29-eth0-tx-0-21swapper/209:55:522
29815050,0irq/29-eth0-tx-0-21swapper/209:49:032
29815050,0irq/29-eth0-tx-0-21swapper/209:24:142
29815050,0irq/29-eth0-tx-0-21swapper/007:32:160
29815050,0irq/29-eth0-tx-0-21swapper/007:20:460
29805050,0irq/28-eth0-rx-6314-21runrttasks12:09:523
29805050,0irq/28-eth0-rx-6279-21diskstats07:55:373
29805050,0irq/28-eth0-rx-18340-21kthreadcore10:25:443
29805050,0irq/28-eth0-rx-0-21swapper/312:18:023
29805050,0irq/28-eth0-rx-0-21swapper/311:20:423
29805050,0irq/28-eth0-rx-0-21swapper/311:15:423
29805050,0irq/28-eth0-rx-0-21swapper/309:40:393
29805050,0irq/28-eth0-rx-0-21swapper/309:35:403
29805050,0irq/28-eth0-rx-0-21swapper/309:32:203
29805050,0irq/28-eth0-rx-0-21swapper/309:26:313
259950,0migration/28311-21kthreadcore12:10:432
259950,0migration/25933-21irqcore10:00:422
259950,0migration/232003-21timerwakeupswit09:35:522
259950,0migration/220505-21gltestperf09:50:392
259950,0migration/217932-21cpuspeed_turbos10:45:362
259950,0migration/217276-21kthreadcore10:25:432
259950,0migration/215540-21munin-node11:55:472
259950,0migration/214338-21kthreadcore12:15:442
259950,0migration/212296-21kthreadcore09:25:442
249950,0watchdog/210215-21perl07:35:412
199219955,0cyclictest0-21swapper/212:00:452
199219955,0cyclictest0-21swapper/210:18:162
199219950,0cyclictest0-21swapper/211:43:242
199219950,0cyclictest0-21swapper/211:28:072
199199955,0cyclictest0-21swapper/010:50:120
199199955,0cyclictest0-21swapper/009:34:030
199199950,0cyclictest0-21swapper/012:49:140
199199950,0cyclictest0-21swapper/011:43:200
199199950,0cyclictest0-21swapper/011:16:410
169950,0watchdog/118146-21kthreadcore08:45:451
149950,0migration/0904-21kthreadcore09:55:450
149950,0migration/08523-21kthreadcore08:40:440
149950,0migration/08249-21missed_timers08:15:440
149950,0migration/0788-21taskset09:38:260
149950,0migration/05477-21kthreadcore11:50:440
149950,0migration/04717-21kthreadcore09:00:410
149950,0migration/031353-21cpuspeed_turbos08:35:380
149950,0migration/031192-21fschecks_time10:15:400
149950,0migration/030198-21kthreadcore07:25:440
149950,0migration/029812-21kthreadcore08:10:430
149950,0migration/028293-21missed_timers12:40:470
149950,0migration/027408-21sh11:08:260
149950,0migration/025735-21kthreadcore12:20:440
149950,0migration/025018-21kthreadcore09:50:430
149950,0migration/024745-21hddtemp_smartct07:45:390
149950,0migration/024601-21fschecks_count09:15:400
149950,0migration/024404-21kthreadcore11:25:430
149950,0migration/020509-21cpuspeed_turbos08:05:390
149950,0migration/020044-21kthreadcore10:25:440
149950,0migration/018797-21kthreadcore09:10:430
149950,0migration/017538-21kthreadcore12:35:450
149950,0migration/014320-21munin-node10:05:450
149950,0migration/013327-21kthreadcore09:45:430
149950,0migration/011869-21kthreadcore09:05:450
149950,0migration/011043-21irqrtprio08:20:430
149950,0migration/011034-21kthreadcore10:40:440
149950,0migration/010155-21fschecks_time07:35:410
8305040,0irq/26-0000:00:0-21swapper/208:30:512
339940,0migration/329547-21kthreadcore08:55:433
339940,0migration/328805-21kthreadcore09:15:443
339940,0migration/317925-21idleruntime09:10:413
339940,0migration/31471-21if_eth1.310:35:413
329940,0watchdog/36314-21runrttasks07:30:253
329940,0watchdog/320174-21aten_r1power_en07:20:373
329940,0watchdog/30-21swapper/311:00:463
29815040,0irq/29-eth0-tx-8061-21ssh11:52:362
29815040,0irq/29-eth0-tx-5317-21ssh12:46:062
29815040,0irq/29-eth0-tx-31110-21diskmemload11:15:282
29815040,0irq/29-eth0-tx-13123-21cat11:35:462
29815040,0irq/29-eth0-tx-0-21swapper/212:35:312
29815040,0irq/29-eth0-tx-0-21swapper/210:50:332
29815040,0irq/29-eth0-tx-0-21swapper/209:40:292
29815040,0irq/29-eth0-tx-0-21swapper/209:30:452
29805040,0irq/28-eth0-rx-0-21swapper/310:50:393
29805040,0irq/28-eth0-rx-0-21swapper/309:50:433
259940,0migration/27097-21kthreadcore10:55:432
259940,0migration/25400-21kthreadcore08:15:432
259940,0migration/23464-21gltestperf09:00:372
259940,0migration/232358-21kthreadcore08:10:442
259940,0migration/225383-21kthreadcore07:20:442
259940,0migration/217120-21fschecks_count07:40:382
259940,0migration/216491-21runrttasks09:08:172
259940,0migration/212059-21taskset08:40:472
249940,0watchdog/224311-21kthreadcore08:05:452
249940,0watchdog/20-21swapper/208:45:452
199219944,0cyclictest0-21swapper/212:05:282
199219944,0cyclictest0-21swapper/210:11:202
199219943,0cyclictest6946-21awk07:55:392
199219943,0cyclictest3571-21lldpd07:27:272
199219943,0cyclictest32172-21awk08:35:412
199219943,0cyclictest25251-21awk10:30:412
199219943,0cyclictest24957-21awk07:45:412
199219943,0cyclictest20968-21awk11:05:412
199209943,0cyclictest3618-21awk10:55:401
199209943,0cyclictest3571-21lldpd12:41:001
199209943,0cyclictest3571-21lldpd10:52:001
199209943,0cyclictest3571-21lldpd10:00:281
199209943,0cyclictest3571-21lldpd08:29:571
199209943,0cyclictest3524-21snmpd12:49:571
199209943,0cyclictest3524-21snmpd12:39:121
199209943,0cyclictest3524-21snmpd12:31:271
199209943,0cyclictest3524-21snmpd12:11:571
199209943,0cyclictest3524-21snmpd09:53:561
199209943,0cyclictest3524-21snmpd09:14:101
199209943,0cyclictest3524-21snmpd08:24:091
199209943,0cyclictest3524-21snmpd07:47:541
199209943,0cyclictest3524-21snmpd07:26:541
199209943,0cyclictest3524-21snmpd07:21:231
199209943,0cyclictest3412-21awk08:15:411
199209943,0cyclictest3250-21irqbalance12:25:531
199209943,0cyclictest3250-21irqbalance11:20:331
199209943,0cyclictest3250-21irqbalance10:36:231
199209943,0cyclictest31822-21awk11:30:421
199209943,0cyclictest31482-21awk10:15:411
199209943,0cyclictest3138-21awk09:40:421
199209943,0cyclictest25132-21awk10:30:411
199209943,0cyclictest25056-21awk08:30:421
199209943,0cyclictest21432-21awk08:05:431
199209943,0cyclictest21299-21awk12:20:411
199209943,0cyclictest14133-21awk08:00:411
199209943,0cyclictest10798-21awk09:05:431
199209943,0cyclictest10555-21awk07:35:431
199209943,0cyclictest10190-21awk10:40:431
199209940,0cyclictest0-21swapper/110:22:151
199199944,0cyclictest0-21swapper/012:18:200
199199944,0cyclictest0-21swapper/011:32:460
199199944,0cyclictest0-21swapper/010:40:260
199199944,0cyclictest0-21swapper/009:27:540
199199943,0cyclictest27405-21awk10:50:420
199199943,0cyclictest25432-21awk11:45:420
199199943,0cyclictest19109-21awk12:00:420
199199941,0cyclictest5644-21basename07:55:250
179940,0migration/18524-21timerandwakeup07:30:501
179940,0migration/127139-21fschecks_count12:05:391
179940,0migration/12426-21kthreadcore08:35:431
179940,0migration/122579-21fschecks_time10:10:381
179940,0migration/117588-21taskset12:00:081
179940,0migration/116985-21kthreadcore10:05:471
179940,0migration/112120-21switchtime07:55:491
179940,0migration/111597-21fschecks_time09:45:391
169940,0watchdog/128550-21aten_r1power_vo11:10:381
169940,0watchdog/128471-21cat08:10:411
169940,0watchdog/124978-21ssh12:01:421
169940,0watchdog/122781-21ssh11:41:501
169940,0watchdog/122277-21cat11:25:381
169940,0watchdog/119743-21ssh12:20:061
169940,0watchdog/11772-21munin-node09:55:451
169940,0watchdog/10-21swapper/110:45:371
169940,0watchdog/10-21swapper/110:29:011
169940,0watchdog/10-21swapper/109:00:371
149940,0migration/06341-21fschecks_count07:55:370
149940,0migration/029487-21kthreadcore08:30:440
149940,0migration/027570-21hddtemp_smartct12:05:390
149940,0migration/024972-21kthreadcore08:50:440
149940,0migration/023107-21irqcore10:10:410
149940,0migration/011776-21sh10:02:270
329930,0watchdog/30-21swapper/308:15:373
329930,0watchdog/30-21swapper/308:12:493
29805030,0irq/28-eth0-rx-0-21swapper/309:05:393
29805030,0irq/28-eth0-rx-0-21swapper/308:25:373
29805030,0irq/28-eth0-rx-0-21swapper/308:20:383
29805030,0irq/28-eth0-rx-0-21swapper/308:02:123
29805030,0irq/28-eth0-rx-0-21swapper/307:40:363
29805030,0irq/28-eth0-rx-0-21swapper/307:30:363
259930,0migration/221954-21kthreadcore09:10:442
199219932,0cyclictest21983-21kthreadcore08:25:442
199219932,0cyclictest19273-21sensors08:00:482
199219932,0cyclictest1467-21sensors08:55:482
199219930,0cyclictest9486-21cat08:20:262
199219930,0cyclictest31813-21perl07:50:402
199219930,0cyclictest0-21swapper/209:15:442
199209933,0cyclictest3571-21lldpd11:50:301
199209932,0cyclictest3571-21lldpd11:16:001
199209932,0cyclictest3250-21irqbalance11:45:331
199209932,0cyclictest32042-21awk07:50:411
199209932,0cyclictest25758-21expr09:35:391
199209932,0cyclictest25264-21awk09:15:421
199209932,0cyclictest22799-21python07:40:481
199209932,0cyclictest12231-21sensors08:40:481
199209932,0cyclictest11775-21cut09:25:441
199209930,0cyclictest9567-21kthreadcore11:35:451
199209930,0cyclictest0-21swapper/109:30:401
199199932,0cyclictest5603-21grep09:40:440
199199932,0cyclictest3571-21lldpd07:40:270
199199932,0cyclictest3524-21snmpd11:12:590
199199932,0cyclictest2702-21sensors12:25:480
199199932,0cyclictest25500-21irqrtprio10:30:420
199199932,0cyclictest17814-21awk08:25:410
199199930,0cyclictest5815-21perl12:30:400
199199930,0cyclictest27651-21munin-node08:55:390
199199930,0cyclictest11151-21cut11:00:270
199199930,0cyclictest0-21swapper/008:45:390
179930,0migration/113298-21kthreadcore11:00:451
179930,0migration/11073-21kthreadcore09:20:441
169930,0watchdog/10-21swapper/111:06:181
169930,0watchdog/10-21swapper/108:55:371
169930,0watchdog/10-21swapper/108:50:411
199199921,0cyclictest7050-21ssh11:35:310
199199921,0cyclictest6514-21latency_hist10:20:260
199199920,0cyclictest0-21swapper/011:20:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional