You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-27 - 14:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Mon Jul 27, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30550994747,0cyclictest24977-21kworker/2:109:23:032
3011124431,0sleep00-21swapper/007:24:240
3013924029,0sleep30-21swapper/307:24:473
3028523728,0sleep20-21swapper/207:26:262
3031923425,0sleep10-21swapper/107:26:531
30550991212,0cyclictest3524-21snmpd09:31:302
305509988,0cyclictest27666-21sensors11:29:062
339970,0migration/314820-21taskset10:26:243
329970,0watchdog/332198-21ssh12:10:553
8305060,0irq/26-0000:00:8863-21crond10:43:432
339960,0migration/38692-21sh10:43:143
339960,0migration/33454-21sh12:51:003
339960,0migration/331289-21sh10:34:383
339960,0migration/329907-21fschecks_time09:58:573
339960,0migration/328541-21sh11:30:373
339960,0migration/319299-21sh12:42:333
339960,0migration/317402-21sh09:32:143
339960,0migration/316443-21sh10:45:533
339960,0migration/311871-21pmu-power08:19:043
339960,0migration/311275-21sh11:20:033
29815060,0irq/29-eth0-tx-27413-21munin-node08:34:010
29805060,0irq/28-eth0-rx-3584-21cut07:29:013
29805060,0irq/28-eth0-rx-3394-21grep10:19:023
29805060,0irq/28-eth0-rx-19468-21if_eth1.309:33:593
29805060,0irq/28-eth0-rx-1751-21kthreadcore11:34:043
29805060,0irq/28-eth0-rx-11708-21perl11:03:573
149960,0migration/07102-21ksmtuned08:19:000
8305050,0irq/26-0000:00:3207-17auditd12:38:432
8305050,0irq/26-0000:00:30827-21date08:13:433
339950,0migration/36361-21hddtemp_smartct10:03:593
339950,0migration/331415-21kthreadcore10:54:043
339950,0migration/329615-21kernelversion11:14:023
339950,0migration/32488-21munin-node09:23:563
339950,0migration/324878-21if_eth1.208:08:573
339950,0migration/320592-21kthreadcore08:49:013
339950,0migration/319355-21kthreadcore08:04:033
339950,0migration/317926-21cpuspeed_turbos10:48:563
339950,0migration/316319-21taskset08:47:093
329950,0watchdog/38806-21python10:59:063
329950,0watchdog/35404-21tune2fs12:53:593
329950,0watchdog/34099-21grep11:54:023
329950,0watchdog/330759-21kthreadcore07:49:023
329950,0watchdog/329228-21cut08:54:023
329950,0watchdog/328561-21awk08:33:583
329950,0watchdog/327639-21gltestperf12:28:593
329950,0watchdog/326293-21port_sshpriv08:29:063
329950,0watchdog/323362-21ssh12:04:593
329950,0watchdog/322814-21ssh11:48:423
329950,0watchdog/320713-21aten_r1power_en09:53:543
329950,0watchdog/310749-21kthreadcore11:39:023
329950,0watchdog/30-21swapper/309:13:583
329950,0watchdog/30-21swapper/309:08:543
305509955,0cyclictest0-21swapper/212:39:012
305509955,0cyclictest0-21swapper/211:44:002
305509955,0cyclictest0-21swapper/210:22:292
305509955,0cyclictest0-21swapper/209:59:092
305509955,0cyclictest0-21swapper/209:34:432
305509950,0cyclictest0-21swapper/210:32:252
305509950,0cyclictest0-21swapper/210:11:372
305499955,0cyclictest2724-21grep07:53:581
305499955,0cyclictest0-21swapper/112:21:041
305499955,0cyclictest0-21swapper/110:02:481
305499950,0cyclictest0-21swapper/112:39:311
305499950,0cyclictest0-21swapper/110:26:081
305489955,0cyclictest16407-21kworker/0:008:29:020
305489955,0cyclictest0-21swapper/008:54:000
305489954,0cyclictest11752-21kworker/0:210:34:080
29815050,0irq/29-eth0-tx-8569-21tune2fs11:58:582
29815050,0irq/29-eth0-tx-5642-21munin-node07:34:020
29815050,0irq/29-eth0-tx-17851-21ssh12:23:342
29815050,0irq/29-eth0-tx-0-21swapper/212:45:282
29815050,0irq/29-eth0-tx-0-21swapper/211:41:282
29815050,0irq/29-eth0-tx-0-21swapper/209:53:502
29815050,0irq/29-eth0-tx-0-21swapper/008:48:590
29815050,0irq/29-eth0-tx-0-21swapper/008:23:560
29805050,0irq/28-eth0-rx-6852-21kthreadcore12:34:043
29805050,0irq/28-eth0-rx-4859-21sed09:44:013
29805050,0irq/28-eth0-rx-2991-21kthreadcore08:59:033
29805050,0irq/28-eth0-rx-24888-21kthreadcore12:44:023
29805050,0irq/28-eth0-rx-16054-21cut10:28:573
29805050,0irq/28-eth0-rx-15292-21kthreadcore11:24:013
29805050,0irq/28-eth0-rx-15023-21cut08:24:003
29805050,0irq/28-eth0-rx-0-21swapper/312:28:313
29805050,0irq/28-eth0-rx-0-21swapper/311:59:023
29805050,0irq/28-eth0-rx-0-21swapper/311:49:323
29805050,0irq/28-eth0-rx-0-21swapper/310:17:343
29805050,0irq/28-eth0-rx-0-21swapper/309:51:333
29805050,0irq/28-eth0-rx-0-21swapper/309:39:353
27741250,0sleep227745-21crond11:13:432
259950,0migration/29132-21sh12:18:072
259950,0migration/232401-21kthreadcore11:34:042
259950,0migration/231686-21sh10:35:512
259950,0migration/227160-21gltestperf10:53:592
259950,0migration/222952-21unixbench-2d12:04:092
259950,0migration/22108-21sh12:32:282
259950,0migration/220107-21kthreadcore12:24:022
259950,0migration/217007-21missed_timers11:04:032
249950,0watchdog/25257-21idleruntime11:18:582
249950,0watchdog/228560-21ethtool08:33:582
249950,0watchdog/221705-21cut10:49:022
179950,0migration/16405-21idleruntime10:04:001
179950,0migration/13822-21fschecks_count09:43:571
179950,0migration/129582-21kthreadcore12:29:021
179950,0migration/126864-21kthreadcore12:09:031
179950,0migration/123632-21sh10:32:131
179950,0migration/121160-21unixbench-2d11:44:111
179950,0migration/12071-21latency_hist08:38:431
179950,0migration/119468-21munin-node09:33:591
179950,0migration/118022-21df_abs10:48:561
179950,0migration/117968-21irqcore08:49:001
179950,0migration/115094-21munin-node10:08:571
179950,0migration/11397-21kthreadcore11:54:021
179950,0migration/113280-21munin-node08:23:551
169950,0watchdog/131138-21grep11:14:021
169950,0watchdog/111891-21tr09:29:021
169950,0watchdog/10-21swapper/112:24:031
149950,0migration/06211-21kthreadcore12:34:040
149950,0migration/05353-21fschecks_time12:53:590
149950,0migration/05119-21kthreadcore12:14:050
149950,0migration/04228-21latency07:29:010
149950,0migration/0396-21kthreadcore11:14:030
149950,0migration/032636-21latency12:29:030
149950,0migration/031099-21kthreadcore10:54:030
149950,0migration/030694-21sh11:51:440
149950,0migration/026913-21taskset07:47:470
149950,0migration/02657-21timerwakeupswit12:49:090
149950,0migration/02480-21aten_r1power_en09:23:560
149950,0migration/023232-21taskset12:04:360
149950,0migration/023111-21sh10:30:410
149950,0migration/020130-21kthreadcore12:24:020
149950,0migration/018941-21sh11:07:520
149950,0migration/018598-21timerandwakeup09:49:110
149950,0migration/018158-21latency_hist09:33:430
149950,0migration/01614-21taskset09:40:070
149950,0migration/015879-21sh12:03:020
149950,0migration/015691-21sendmail_mailtr08:44:060
149950,0migration/014743-21kthreadcore09:29:030
8305040,0irq/26-0000:00:0-21swapper/209:38:432
8305040,0irq/26-0000:00:0-21swapper/208:53:432
8305040,0irq/26-0000:00:0-21swapper/208:49:092
339940,0migration/37780-21kthreadcore07:34:023
339940,0migration/37440-21kthreadcore08:39:013
339940,0migration/36365-21kthreadcore12:14:053
339940,0migration/329501-21kthreadcore09:19:033
339940,0migration/32150-21aten_r1power_fr07:53:563
339940,0migration/315065-21if_eth110:08:573
305509943,0cyclictest3571-21lldpd11:24:362
305509943,0cyclictest3571-21lldpd08:19:052
305509943,0cyclictest3571-21lldpd07:59:352
305509943,0cyclictest3524-21snmpd09:13:542
305509943,0cyclictest3524-21snmpd08:16:082
305509943,0cyclictest3524-21snmpd08:05:532
305509943,0cyclictest31863-21awk07:28:582
305509943,0cyclictest21213-21awk07:43:582
305509943,0cyclictest13222-21awk09:49:012
305499943,0cyclictest3571-21lldpd10:44:361
305499943,0cyclictest3524-21snmpd09:50:401
305499943,0cyclictest32262-21awk08:59:011
305499943,0cyclictest31060-21awk11:34:021
305499943,0cyclictest28422-21awk07:49:001
305499943,0cyclictest28113-21awk09:39:001
305499943,0cyclictest24943-21awk08:53:591
305499943,0cyclictest24814-21awk08:08:561
305499943,0cyclictest17652-21awk08:04:011
305499943,0cyclictest1601-21awk10:38:571
305499943,0cyclictest12065-21awk11:03:591
305489944,0cyclictest11752-21kworker/0:212:44:050
305489944,0cyclictest11752-21kworker/0:210:14:560
305489944,0cyclictest11752-21kworker/0:210:08:520
305489944,0cyclictest11752-21kworker/0:210:06:400
305489943,0cyclictest3571-21lldpd11:24:060
305489943,0cyclictest3571-21lldpd09:22:050
305489943,0cyclictest3571-21lldpd09:14:050
305489943,0cyclictest3571-21lldpd08:14:050
305489943,0cyclictest3571-21lldpd07:55:350
305489943,0cyclictest3250-21irqbalance12:39:500
305489943,0cyclictest3250-21irqbalance11:53:500
305489943,0cyclictest3250-21irqbalance11:43:500
305489943,0cyclictest3250-21irqbalance11:39:100
305489943,0cyclictest3250-21irqbalance11:35:300
305489943,0cyclictest3250-21irqbalance11:32:400
305489943,0cyclictest3250-21irqbalance10:59:000
305489943,0cyclictest3250-21irqbalance10:19:200
305489943,0cyclictest3250-21irqbalance10:00:590
305489943,0cyclictest26076-21awk12:09:020
305489943,0cyclictest14017-21awk07:38:580
305489943,0cyclictest10401-21awk07:58:580
305489940,0cyclictest5961-21munin-node09:04:050
305489940,0cyclictest20183-21awk09:13:430
29815040,0irq/29-eth0-tx-32702-21ssh11:54:002
29815040,0irq/29-eth0-tx-27974-21ssh11:13:452
29815040,0irq/29-eth0-tx-15930-21ssh10:44:202
29815040,0irq/29-eth0-tx-0-21swapper/212:49:002
29815040,0irq/29-eth0-tx-0-21swapper/212:08:532
29815040,0irq/29-eth0-tx-0-21swapper/211:48:512
29815040,0irq/29-eth0-tx-0-21swapper/210:59:012
29815040,0irq/29-eth0-tx-0-21swapper/210:23:562
29815040,0irq/29-eth0-tx-0-21swapper/008:09:060
29815040,0irq/29-eth0-tx-0-21swapper/008:03:570
29805040,0irq/28-eth0-rx-6765-21fschecks_time09:04:003
29805040,0irq/28-eth0-rx-0-21swapper/312:18:553
29805040,0irq/28-eth0-rx-0-21swapper/311:10:543
259940,0migration/27297-21kthreadcore07:34:012
259940,0migration/27172-21kthreadcore09:44:022
259940,0migration/26637-21fschecks_time09:03:592
259940,0migration/25700-21cpuspeed_turbos10:03:572
259940,0migration/25151-21kthreadcore08:39:002
259940,0migration/229720-21munin-node08:09:012
259940,0migration/228418-21latency10:14:022
259940,0migration/220220-21aten_r1power_cu08:28:552
259940,0migration/218632-21latency07:39:012
259940,0migration/214888-21kthreadcore08:24:002
249940,0watchdog/214270-21kthreadcore08:44:022
249940,0watchdog/213197-21aten_r1power_cu09:08:542
249940,0watchdog/20-21swapper/212:53:592
249940,0watchdog/20-21swapper/209:23:582
249940,0watchdog/20-21swapper/208:58:582
179940,0migration/1999-21kthreadcore07:29:001
179940,0migration/16611-21kthreadcore10:59:021
179940,0migration/14359-21aten2.4-expect11:18:551
179940,0migration/129555-21kthreadcore10:34:011
179940,0migration/129404-21kthreadcore09:19:031
179940,0migration/126613-21timerwakeupswit08:29:101
179940,0migration/123754-21munin-node11:48:581
179940,0migration/122906-21kthreadcore12:44:021
179940,0migration/115378-21kthreadcore09:09:001
179940,0migration/114036-21kthreadcore07:59:011
179940,0migration/11178-21aten_r1power_vo12:13:591
179940,0migration/11102-21taskset10:56:001
169940,0watchdog/13730-21ssh12:51:471
169940,0watchdog/13288-21diskstats12:33:591
169940,0watchdog/12986-21tune2fs09:23:581
169940,0watchdog/122448-21chrt10:13:461
169940,0watchdog/114273-21kthreadcore08:44:021
169940,0watchdog/112513-21grep11:59:031
169940,0watchdog/10-21swapper/112:54:031
169940,0watchdog/10-21swapper/111:39:021
169940,0watchdog/10-21swapper/109:53:541
169940,0watchdog/10-21swapper/109:13:581
169940,0watchdog/10-21swapper/107:34:061
149940,0migration/09853-21kthreadcore10:24:010
149940,0migration/09542-21latency_hist12:18:430
149940,0migration/0637-21kthreadcore08:59:020
149940,0migration/04430-21kthreadcore10:39:000
149940,0migration/025121-21kthreadcore11:09:040
149940,0migration/019023-21irqcore10:49:010
149940,0migration/015334-21pmu-power10:44:060
329930,0watchdog/30-21swapper/307:58:583
329930,0watchdog/30-21swapper/307:43:583
305499932,0cyclictest2285-21basename08:38:541
305499931,0cyclictest12129-21processes09:04:081
305499930,0cyclictest20458-21diskstats07:43:551
305489933,0cyclictest27391-21kworker/0:109:43:440
305489933,0cyclictest16407-21kworker/0:008:38:560
305489933,0cyclictest11752-21kworker/0:211:18:510
305489932,0cyclictest21733-21awk09:53:580
29815030,0irq/29-eth0-tx-0-21swapper/007:48:570
29805030,0irq/28-eth0-rx-0-21swapper/307:38:543
249930,0watchdog/20-21swapper/207:54:022
249930,0watchdog/20-21swapper/207:48:462
19660230,0sleep119667-21ssh11:24:351
179930,0migration/17343-21irqrtprio08:19:001
179930,0migration/117255-21fschecks_time12:03:571
169930,0watchdog/12543-21cut10:19:021
169930,0watchdog/10-21swapper/111:29:381
169930,0watchdog/10-21swapper/111:11:541
169930,0watchdog/10-21swapper/108:14:021
305499921,0cyclictest13204-21df_abs07:38:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional