You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 18:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Fri Mar 27, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2666129894,0sleep10-21swapper/107:15:581
2671923627,0sleep30-21swapper/307:16:363
2686823425,0sleep20-21swapper/207:18:232
2690223127,0sleep00-21swapper/007:18:410
2698699140,0cyclictest0-21swapper/009:19:580
269979970,0cyclictest0-21swapper/212:14:022
8305060,0irq/26-0000:00:6056-21ls09:18:413
339960,0migration/34835-21munin-node07:44:073
339960,0migration/34241-21kthreadcore09:53:593
339960,0migration/32597-21sh12:23:343
339960,0migration/319605-21kthreadcore09:04:003
269869966,0cyclictest0-21swapper/007:58:550
149960,0migration/019725-21pmu-power11:34:030
8305050,0irq/26-0000:00:0-21swapper/307:39:023
35150,0ktimersoftd/30-21swapper/311:39:563
339950,0migration/38859-21kthreadcore11:49:003
339950,0migration/36166-21munin-node08:33:533
339950,0migration/35630-21fschecks_count12:43:553
339950,0migration/330977-21kthreadcore12:39:013
339950,0migration/33084-21fschecks_count08:53:543
339950,0migration/330151-21munin-node08:24:023
339950,0migration/326968-21kthreadcore11:58:593
339950,0migration/326637-21cpuspeed_turbos09:48:553
339950,0migration/326373-21munin-node11:19:063
339950,0migration/325257-21munin-node10:43:573
339950,0migration/322937-21rt-features08:19:043
339950,0migration/317748-21kthreadcore10:19:013
339950,0migration/316713-21sh10:56:333
339950,0migration/313781-21kthreadcore09:39:013
339950,0migration/313708-21munin-node11:33:543
339950,0migration/313505-21kthreadcore12:28:593
339950,0migration/313240-21kthreadcore08:58:593
339950,0migration/312381-21munin-node11:13:563
339950,0migration/312273-21kthreadcore12:09:003
339950,0migration/310450-21if_eth107:28:573
329950,0watchdog/33947-21iostat11:08:573
329950,0watchdog/331498-21df08:28:533
329950,0watchdog/326436-21python07:59:053
329950,0watchdog/312958-21memory10:34:013
329950,0watchdog/30-21swapper/307:49:093
29805050,0irq/28-eth0-rx-7140-21fschecks_time09:18:553
29805050,0irq/28-eth0-rx-677-21vmstat11:04:093
29805050,0irq/28-eth0-rx-5970-21kthreadcore12:24:003
29805050,0irq/28-eth0-rx-30677-21ssh09:29:363
29805050,0irq/28-eth0-rx-29077-21tune2fs10:08:553
29805050,0irq/28-eth0-rx-271692chrt07:18:433
29805050,0irq/28-eth0-rx-24076-21munin-node12:14:023
29805050,0irq/28-eth0-rx-2328-21kthreadcore10:29:003
29805050,0irq/28-eth0-rx-22208-21cut08:43:583
29805050,0irq/28-eth0-rx-15923-21runrttasks11:53:553
29805050,0irq/28-eth0-rx-11694-40yum-updatesd-he10:14:403
29805050,0irq/28-eth0-rx-0-21swapper/311:23:553
29805050,0irq/28-eth0-rx-0-21swapper/310:59:073
29805050,0irq/28-eth0-rx-0-21swapper/310:24:113
29805050,0irq/28-eth0-rx-0-21swapper/310:04:513
29805050,0irq/28-eth0-rx-0-21swapper/309:43:593
29805050,0irq/28-eth0-rx-0-21swapper/307:34:003
269979955,0cyclictest0-21swapper/210:18:282
269979950,0cyclictest6053-21diskmemload11:42:302
269979950,0cyclictest0-21swapper/211:37:462
269929955,0cyclictest0-21swapper/112:40:261
269929955,0cyclictest0-21swapper/112:03:041
269929955,0cyclictest0-21swapper/110:17:071
269929955,0cyclictest0-21swapper/109:53:281
269929955,0cyclictest0-21swapper/109:22:061
269929950,0cyclictest0-21swapper/112:35:421
269929950,0cyclictest0-21swapper/112:30:581
269929950,0cyclictest0-21swapper/112:06:421
269929950,0cyclictest0-21swapper/109:28:431
259950,0migration/22473-21kthreadcore12:04:002
249950,0watchdog/29591-21sh11:09:292
179950,0migration/13320-21sh10:10:341
179950,0migration/130811-21latency_hist07:43:421
179950,0migration/129170-21kthreadcore11:04:001
179950,0migration/128233-21fschecks_time08:03:551
179950,0migration/125337-21sh12:15:451
179950,0migration/123012-21pmu-power09:04:031
179950,0migration/117817-21switchtime11:14:071
179950,0migration/11521-21kthreadcore09:13:591
179950,0migration/110867-21kthreadcore10:34:001
169950,0watchdog/16594-21munin-node09:34:051
169950,0watchdog/112676-21ssh12:46:221
169950,0watchdog/110024-21cut11:29:011
149950,0migration/07226-21munin-node07:48:590
149950,0migration/06154-21taskset08:33:520
149950,0migration/05898-21if_eth010:13:570
149950,0migration/03612-21kernelversion07:23:580
149950,0migration/032353-21munin-node09:13:560
149950,0migration/031729-21kthreadcore10:08:590
149950,0migration/030797-21taskset08:27:110
149950,0migration/027851-21kthreadcore09:09:000
149950,0migration/026161-21kthreadcore10:24:010
149950,0migration/024753-21gltestperf09:28:540
149950,0migration/024429-21kthreadcore12:34:010
149950,0migration/024342-21kthreadcore10:04:010
149950,0migration/024206-21switchtime10:59:070
149950,0migration/024174-21kthreadcore11:38:590
149950,0migration/021251-21proc_pri09:24:020
149950,0migration/021101-21kthreadcore08:19:010
149950,0migration/019298-21latency10:19:010
149950,0migration/01859-21kthreadcore10:29:000
149950,0migration/018230-21kthreadcore10:39:010
149950,0migration/018225-21fschecks_count09:43:550
149950,0migration/016518-21taskset09:01:140
149950,0migration/013696-21df_abs08:38:550
149950,0migration/011208-21kthreadcore07:28:580
149950,0migration/010490-21kthreadcore11:49:000
149950,0migration/010380-21kthreadcore11:29:020
8305040,0irq/26-0000:00:0-21swapper/211:18:422
4140,0ktimersoftd/00-21swapper/012:15:160
339940,0migration/36370-21irqcore11:28:593
339940,0migration/331284-21latency_hist09:13:413
339940,0migration/32733-21kthreadcore09:33:593
339940,0migration/32162-21kthreadcore11:44:033
339940,0migration/319030-21kthreadcore10:39:013
339940,0migration/316653-21kthreadcore09:23:583
339940,0migration/310048-21fschecks_count08:13:553
329940,0watchdog/36314-21runrttasks08:38:573
329940,0watchdog/30-21swapper/312:04:023
29815040,0irq/29-eth0-tx-30951-21munin-node07:44:000
29815040,0irq/29-eth0-tx-26635-21ssh12:18:442
29815040,0irq/29-eth0-tx-17375-21ssh12:12:352
29815040,0irq/29-eth0-tx-0-21swapper/212:44:102
29815040,0irq/29-eth0-tx-0-21swapper/212:29:132
29815040,0irq/29-eth0-tx-0-21swapper/212:24:092
29815040,0irq/29-eth0-tx-0-21swapper/211:43:542
29815040,0irq/29-eth0-tx-0-21swapper/211:30:252
29815040,0irq/29-eth0-tx-0-21swapper/211:03:422
29815040,0irq/29-eth0-tx-0-21swapper/210:48:562
29815040,0irq/29-eth0-tx-0-21swapper/210:45:212
29815040,0irq/29-eth0-tx-0-21swapper/210:34:202
29815040,0irq/29-eth0-tx-0-21swapper/210:23:592
29815040,0irq/29-eth0-tx-0-21swapper/210:19:002
29815040,0irq/29-eth0-tx-0-21swapper/209:54:122
29815040,0irq/29-eth0-tx-0-21swapper/209:46:592
29815040,0irq/29-eth0-tx-0-21swapper/209:39:122
29815040,0irq/29-eth0-tx-0-21swapper/209:33:552
29815040,0irq/29-eth0-tx-0-21swapper/209:26:392
29805040,0irq/28-eth0-rx-30139-21kthreadcore08:03:593
29805040,0irq/28-eth0-rx-0-21swapper/312:34:303
29805040,0irq/28-eth0-rx-0-21swapper/310:48:593
29805040,0irq/28-eth0-rx-0-21swapper/310:00:253
29805040,0irq/28-eth0-rx-0-21swapper/308:48:593
269979944,0cyclictest0-21swapper/211:54:292
269979944,0cyclictest0-21swapper/210:11:032
269979944,0cyclictest0-21swapper/209:22:302
269979943,0cyclictest3571-21lldpd11:59:422
269979943,0cyclictest3571-21lldpd11:49:422
269979943,0cyclictest3571-21lldpd11:24:102
269979943,0cyclictest3571-21lldpd09:50:082
269979943,0cyclictest3571-21lldpd08:54:082
269979943,0cyclictest3571-21lldpd08:30:372
269979943,0cyclictest3571-21lldpd08:00:062
269979943,0cyclictest3571-21lldpd07:50:372
269979943,0cyclictest3571-21lldpd07:45:362
269979943,0cyclictest3571-21lldpd07:37:062
269979943,0cyclictest3571-21lldpd07:26:362
269979943,0cyclictest3571-21lldpd07:20:062
269979943,0cyclictest3524-21snmpd11:15:232
269979943,0cyclictest31759-21awk10:28:582
269979943,0cyclictest28849-21awk08:48:572
269979943,0cyclictest24873-21awk09:28:552
269979943,0cyclictest24813-21awk07:38:572
269979943,0cyclictest21406-21awk12:33:592
269979943,0cyclictest18847-21awk10:58:582
269979943,0cyclictest14351-21awk08:38:572
269979943,0cyclictest10298-21awk10:53:572
269929944,0cyclictest0-21swapper/110:59:511
269929944,0cyclictest0-21swapper/110:50:521
269929944,0cyclictest0-21swapper/108:53:531
269929943,0cyclictest6952-21awk07:48:581
269929943,0cyclictest3571-21lldpd11:51:121
269929943,0cyclictest3571-21lldpd10:46:391
269929943,0cyclictest3571-21lldpd08:14:081
269929943,0cyclictest3571-21lldpd08:13:381
269929943,0cyclictest3524-21snmpd10:20:221
269929943,0cyclictest3524-21snmpd08:48:511
269929943,0cyclictest3524-21snmpd08:03:211
269929943,0cyclictest28216-21awk07:18:571
269929943,0cyclictest17657-21awk07:33:571
269929943,0cyclictest10365-21awk07:28:561
269929943,0cyclictest10347-21awk10:53:571
269869944,0cyclictest5414-21kworker/0:107:53:570
269869944,0cyclictest0-21swapper/011:11:150
269869943,0cyclictest7933-21grep10:33:560
269869943,0cyclictest4074-21awk12:23:580
269869943,0cyclictest3571-21lldpd12:05:420
269869943,0cyclictest3571-21lldpd11:56:420
269869943,0cyclictest3250-21irqbalance08:03:580
269869943,0cyclictest3180-21tail08:08:540
269869943,0cyclictest21623-21awk08:43:570
269869943,0cyclictest21155-21awk11:18:570
269869943,0cyclictest17618-21awk07:33:570
269869943,0cyclictest16544-21sadc08:18:420
269869940,0cyclictest0-21swapper/010:53:450
259940,0migration/25259-21kthreadcore08:08:572
259940,0migration/221830-21runrttasks09:04:012
259940,0migration/219405-21kthreadcore08:19:002
259940,0migration/217756-21timerwakeupswit09:59:072
259940,0migration/216010-21kthreadcore07:53:582
259940,0migration/213312-21kthreadcore08:14:002
259940,0migration/213160-21latency_hist08:38:422
249940,0watchdog/2520-21sh12:39:022
249940,0watchdog/20-21swapper/210:03:532
249940,0watchdog/20-21swapper/208:24:452
179940,0migration/15770-21runrttasks11:45:381
179940,0migration/14053-21munin-node09:53:591
179940,0migration/129426-21kthreadcore08:23:591
179940,0migration/127888-21kthreadcore09:09:001
179940,0migration/126965-21sh10:05:191
179940,0migration/126038-21kthreadcore08:43:591
179940,0migration/125928-21latency11:19:001
179940,0migration/122163-21munin-node10:39:081
179940,0migration/117742-21kthreadcore07:53:591
179940,0migration/116694-21latency_hist08:18:421
179940,0migration/115992-21cpu11:53:551
179940,0migration/115977-21kthreadcore08:39:001
179940,0migration/113633-21kthreadcore09:58:591
179940,0migration/110421-21munin-node12:08:581
169940,0watchdog/131671-21ssh10:28:571
169940,0watchdog/126905-21kthreadcore10:24:011
169940,0watchdog/114000-21kthreadcore09:39:011
169940,0watchdog/110802-21ssh11:12:491
169940,0watchdog/10-21swapper/112:21:461
149940,0migration/07539-21kthreadcore08:53:590
149940,0migration/031724-21fschecks_time11:43:580
149940,0migration/026531-21aten_r1power_fr11:03:540
149940,0migration/013149-21kthreadcore11:13:590
149940,0migration/013109-21sh12:47:350
149940,0migration/012811-21sh12:28:580
149940,0migration/01236-21sh12:19:510
29805030,0irq/28-eth0-rx-0-21swapper/308:08:513
29805030,0irq/28-eth0-rx-0-21swapper/307:54:023
29805030,0irq/28-eth0-rx-0-21swapper/307:23:533
269979932,0cyclictest3571-21lldpd08:44:382
269979932,0cyclictest31646-21tr09:13:542
269979932,0cyclictest25212-21awk09:08:572
269979932,0cyclictest16671-21ls10:38:582
269979932,0cyclictest10924-21awk08:58:572
269979932,0cyclictest10484-21awk07:28:572
269929932,0cyclictest7115-21awk08:33:561
269929932,0cyclictest3524-21snmpd12:24:081
269929932,0cyclictest3524-21snmpd08:30:441
269929932,0cyclictest32130-21awk07:43:571
269929932,0cyclictest3183-21awk07:23:571
269929932,0cyclictest21866-21grep09:43:591
269929930,0cyclictest15470-21diskstats09:23:541
269869933,0cyclictest8567-21kworker/0:208:28:430
269869933,0cyclictest4618-21kworker/0:212:08:580
269869933,0cyclictest4618-21kworker/0:211:58:540
269869933,0cyclictest24406-21kworker/0:012:39:020
269869933,0cyclictest21488-21kworker/0:111:23:540
269869933,0cyclictest21488-21kworker/0:109:58:490
269869933,0cyclictest21488-21kworker/0:109:53:550
269869933,0cyclictest21488-21kworker/0:109:48:490
269869933,0cyclictest21488-21kworker/0:109:38:430
269869933,0cyclictest21488-21kworker/0:109:34:190
269869933,0cyclictest21488-21kworker/0:109:03:450
269869933,0cyclictest21488-21kworker/0:108:48:450
269869932,0cyclictest27815-21kthreadcore10:44:000
269869931,0cyclictest21488-21kworker/0:110:48:580
269869930,0cyclictest27182-21munin-node07:18:570
269869930,0cyclictest24383-21tune2fs07:38:550
259930,0migration/228153-21fschecks_time08:03:552
179930,0migration/113523-21latency_hist11:33:431
169930,0watchdog/10-21swapper/111:38:451
169930,0watchdog/10-21swapper/111:24:051
169930,0watchdog/10-21swapper/108:58:531
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional