You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 02:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Mon Mar 16, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3178224837,0sleep00-21swapper/019:16:260
3174323523,0sleep10-21swapper/119:15:591
3161823526,0sleep20-21swapper/219:14:282
3176822824,0sleep30-21swapper/319:16:173
31967991111,0cyclictest8059-21sensors00:38:081
339970,0migration/39446-21kthreadcore23:43:053
319679977,0cyclictest3524-21snmpd23:17:511
339960,0migration/3960-21sh00:36:333
339960,0migration/35344-21sh00:01:543
339960,0migration/33902-21sh21:30:163
339960,0migration/330229-21sh22:59:403
339960,0migration/328448-21taskset20:20:543
339960,0migration/323613-21sh21:59:473
339960,0migration/318968-21sh22:33:383
319689960,0cyclictest0-21swapper/222:29:282
319679965,0cyclictest30561-21kthreadcore19:38:011
319679960,0cyclictest0-21swapper/122:04:481
29815060,0irq/29-eth0-tx-7046-21munin-node19:23:090
29815060,0irq/29-eth0-tx-3524-21snmpd20:38:060
29805060,0irq/28-eth0-rx-0-21swapper/321:43:033
149960,0migration/09931-21idleruntime-cro23:27:450
149960,0migration/0411-21sh22:06:350
149960,0migration/029026-21needreboot22:58:050
149960,0migration/026910-21sh23:37:090
149960,0migration/022430-21sh22:57:070
149960,0migration/021323-21sh00:08:160
149960,0migration/020708-21munin-node20:13:090
8305050,0irq/26-0000:00:14270-21taskset19:27:463
4150,0ktimersoftd/00-21swapper/021:58:570
339950,0migration/3963-21fschecks_time20:47:573
339950,0migration/37779-21aten_r1power_fr21:52:563
339950,0migration/37313-21kthreadcore22:48:023
339950,0migration/37188-21sh00:20:533
339950,0migration/37178-21latency22:08:043
339950,0migration/35574-21munin-node21:48:103
339950,0migration/332492-21kthreadcore23:38:033
339950,0migration/33218-21taskset19:41:563
339950,0migration/331920-21kthreadcore22:43:003
339950,0migration/329924-21vmstat00:13:113
339950,0migration/328910-21taskset22:42:203
339950,0migration/326667-21irqrtprio23:18:023
339950,0migration/324642-21kthreadcore21:23:023
339950,0migration/323437-21kthreadcore22:18:033
339950,0migration/322326-21kthreadcore23:13:043
339950,0migration/318532-21munin-node20:37:583
339950,0migration/314199-21latency_hist22:52:453
339950,0migration/314087-21sh00:07:073
339950,0migration/310682-21fschecks_count23:27:583
329950,0watchdog/33449-21sh22:27:563
329950,0watchdog/331740-21yum19:58:113
329950,0watchdog/329628-21grep21:07:563
329950,0watchdog/32675-21python20:23:073
329950,0watchdog/322285-21diskstats21:02:563
329950,0watchdog/313677-21python20:53:083
329950,0watchdog/312198-21sh21:34:003
329950,0watchdog/310333-21cut20:08:033
329950,0watchdog/30-21swapper/323:09:203
319689955,0cyclictest0-21swapper/223:36:192
319689955,0cyclictest0-21swapper/223:16:562
319689950,0cyclictest0-21swapper/200:07:512
319679955,0cyclictest0-21swapper/122:23:051
319679955,0cyclictest0-21swapper/122:10:381
319679950,0cyclictest0-21swapper/123:41:271
319679950,0cyclictest0-21swapper/122:32:141
319679950,0cyclictest0-21swapper/121:36:351
319679950,0cyclictest0-21swapper/100:29:511
319679950,0cyclictest0-21swapper/100:04:371
319669955,0cyclictest0-21swapper/000:23:310
319669950,0cyclictest0-21swapper/021:39:430
319669950,0cyclictest0-21swapper/000:00:490
29815050,0irq/29-eth0-tx-7470-21munin-node20:53:070
29805050,0irq/28-eth0-rx-16745-21latency20:33:043
29805050,0irq/28-eth0-rx-11776-21irqrtprio00:43:023
29805050,0irq/28-eth0-rx-0-21swapper/323:54:563
29805050,0irq/28-eth0-rx-0-21swapper/323:23:103
29805050,0irq/28-eth0-rx-0-21swapper/323:03:023
29805050,0irq/28-eth0-rx-0-21swapper/322:27:073
29805050,0irq/28-eth0-rx-0-21swapper/300:27:593
29805050,0irq/28-eth0-rx-0-21swapper/300:07:513
19150,0ktimersoftd/10-21swapper/121:19:051
179950,0migration/18901-21kthreadcore20:08:031
179950,0migration/18184-21cpuspeed_turbos23:07:571
179950,0migration/13372-21munin-node23:58:051
179950,0migration/120642-21sh22:53:061
179950,0migration/11180-21kthreadcore22:43:011
149950,0migration/08325-21idleruntime20:08:010
149950,0migration/08164-21bash22:08:440
149950,0migration/07038-21taskset21:51:440
149950,0migration/06784-21taskset23:05:210
149950,0migration/06176-21needreboot20:48:020
149950,0migration/05995-21needreboot20:03:030
149950,0migration/05270-21irqrtprio23:43:030
149950,0migration/032122-21taskset20:02:310
149950,0migration/031585-21kthreadcore22:23:030
149950,0migration/031236-21kthreadcore20:23:020
149950,0migration/0307-21kthreadcore22:43:010
149950,0migration/029668-21kthreadcore00:33:030
149950,0migration/025691-21kthreadcore00:13:020
149950,0migration/02541-21sendmail_mailqu21:28:050
149950,0migration/024230-21kthreadcore19:33:020
149950,0migration/023392-21kthreadcore22:18:030
149950,0migration/022567-21fschecks_time20:17:590
149950,0migration/022356-21kthreadcore22:38:020
149950,0migration/021501-21kthreadcore21:23:010
149950,0migration/018193-21irqcore00:28:020
149950,0migration/014171-21kthreadcore23:48:020
149950,0migration/013423-21sh00:05:160
339940,0migration/38412-21diskmemload00:38:113
339940,0migration/38308-21aten_r1power_vo00:22:573
339940,0migration/33758-21aten_r1power_en20:27:563
339940,0migration/312511-21kthreadcore19:23:023
319689943,0cyclictest8136-21awk19:22:592
319689943,0cyclictest4792-21awk23:43:022
319689943,0cyclictest433-21awk00:18:002
319689943,0cyclictest3571-21lldpd20:47:482
319689943,0cyclictest3571-21lldpd20:42:482
319689943,0cyclictest3571-21lldpd20:33:172
319689943,0cyclictest3571-21lldpd19:46:152
319689943,0cyclictest3571-21lldpd19:18:152
319689943,0cyclictest3524-21snmpd22:18:112
319689943,0cyclictest3524-21snmpd21:54:102
319689943,0cyclictest3524-21snmpd20:24:402
319689943,0cyclictest3524-21snmpd20:22:252
319689943,0cyclictest3524-21snmpd20:16:402
319689943,0cyclictest3524-21snmpd20:10:552
319689943,0cyclictest3524-21snmpd19:28:542
319689943,0cyclictest3524-21snmpd00:15:572
319689943,0cyclictest31387-21munin-node21:47:572
319689943,0cyclictest30392-21awk22:42:582
319689943,0cyclictest29708-21awk19:37:592
319689943,0cyclictest26153-21awk22:03:022
319689943,0cyclictest22899-21awk21:02:582
319689943,0cyclictest22557-21awk19:33:002
319689943,0cyclictest22134-21awk23:53:012
319689943,0cyclictest20886-21awk21:22:592
319689943,0cyclictest19295-21awk20:38:012
319689943,0cyclictest15701-21awk20:58:002
319689943,0cyclictest11932-21awk19:47:592
319679944,0cyclictest0-21swapper/123:29:091
319679944,0cyclictest0-21swapper/123:26:091
319679944,0cyclictest0-21swapper/122:48:001
319679943,0cyclictest9340-21awk00:23:011
319679943,0cyclictest3524-21snmpd21:59:101
319679943,0cyclictest3524-21snmpd21:27:101
319679943,0cyclictest24961-21sadc23:17:451
319679943,0cyclictest1030-21awk20:02:591
319669944,0cyclictest0-21swapper/023:41:440
319669944,0cyclictest0-21swapper/023:16:020
319669944,0cyclictest0-21swapper/021:13:130
319669944,0cyclictest0-21swapper/021:13:130
319669943,0cyclictest3524-21snmpd22:48:560
319669943,0cyclictest26389-21awk20:43:000
319669943,0cyclictest22052-21awk23:53:010
29815040,0irq/29-eth0-tx-4888-21ssh00:00:382
29815040,0irq/29-eth0-tx-31960-21vmstat23:18:112
29815040,0irq/29-eth0-tx-29683-21ssh22:58:112
29815040,0irq/29-eth0-tx-22785-21munin-node21:43:032
29815040,0irq/29-eth0-tx-22368-21kthreadcore00:28:042
29815040,0irq/29-eth0-tx-17272-21ssh00:43:462
29815040,0irq/29-eth0-tx-15881-21ksmtuned23:11:292
29815040,0irq/29-eth0-tx-0-21swapper/223:49:402
29815040,0irq/29-eth0-tx-0-21swapper/223:37:472
29815040,0irq/29-eth0-tx-0-21swapper/223:28:122
29815040,0irq/29-eth0-tx-0-21swapper/223:03:042
29815040,0irq/29-eth0-tx-0-21swapper/222:53:012
29815040,0irq/29-eth0-tx-0-21swapper/222:47:592
29815040,0irq/29-eth0-tx-0-21swapper/222:42:242
29815040,0irq/29-eth0-tx-0-21swapper/222:34:352
29815040,0irq/29-eth0-tx-0-21swapper/222:23:102
29815040,0irq/29-eth0-tx-0-21swapper/221:38:102
29815040,0irq/29-eth0-tx-0-21swapper/221:28:152
29815040,0irq/29-eth0-tx-0-21swapper/200:37:592
29815040,0irq/29-eth0-tx-0-21swapper/200:23:452
29815040,0irq/29-eth0-tx-0-21swapper/021:17:580
29815040,0irq/29-eth0-tx-0-21swapper/019:48:030
29815040,0irq/29-eth0-tx-0-21swapper/019:37:560
29805040,0irq/28-eth0-rx-23047-21kthreadcore19:33:023
29805040,0irq/28-eth0-rx-0-21swapper/323:48:023
29805040,0irq/28-eth0-rx-0-21swapper/323:34:443
29805040,0irq/28-eth0-rx-0-21swapper/322:14:013
29805040,0irq/28-eth0-rx-0-21swapper/322:02:573
29805040,0irq/28-eth0-rx-0-21swapper/321:37:553
29805040,0irq/28-eth0-rx-0-21swapper/321:13:023
29805040,0irq/28-eth0-rx-0-21swapper/321:13:023
29805040,0irq/28-eth0-rx-0-21swapper/319:47:553
259940,0migration/221280-21kthreadcore19:53:012
259940,0migration/218618-21sh21:20:172
259940,0migration/213822-21kthreadcore22:13:032
249940,0watchdog/29023-21grep20:28:032
249940,0watchdog/26971-21kthreadcore22:08:042
249940,0watchdog/225508-21aten_r1power_fr00:32:562
249940,0watchdog/20-21swapper/221:57:562
249940,0watchdog/20-21swapper/221:33:562
179940,0migration/16404-21vmstat19:18:101
179940,0migration/15261-21missed_timers23:03:041
179940,0migration/14027-21aten_r1power_fr21:12:551
179940,0migration/14027-21aten_r1power_fr21:12:551
179940,0migration/13819-21aten2.4-expect20:27:571
179940,0migration/13501-21kthreadcore00:18:021
179940,0migration/131388-21munin-node21:47:551
179940,0migration/129718-21kthreadcore00:33:031
179940,0migration/128908-21aten2.4-expect20:22:561
179940,0migration/128801-21cpu21:27:561
179940,0migration/128617-21kthreadcore19:58:021
179940,0migration/124565-21kthreadcore20:18:031
179940,0migration/123747-21fschecks_count00:12:581
179940,0migration/121849-21latency_hist21:02:451
179940,0migration/120802-21timerandwakeup20:13:091
179940,0migration/119476-21fschecks_time23:32:581
179940,0migration/118959-21df_abs22:17:571
179940,0migration/117205-21kthreadcore22:33:031
179940,0migration/115613-21kthreadcore20:33:031
179940,0migration/115612-21munin-node00:08:011
179940,0migration/114439-21kthreadcore19:48:011
179940,0migration/114432-21munin-node21:37:581
179940,0migration/113343-21missed_timers20:53:041
179940,0migration/111959-21kthreadcore19:23:021
169940,0watchdog/127945-21ssh23:53:521
169940,0watchdog/119970-21ssh23:50:441
169940,0watchdog/117780-21ssh22:16:241
169940,0watchdog/117410-21ssh00:44:081
169940,0watchdog/113131-21kthreadcore21:53:041
169940,0watchdog/10-21swapper/123:02:441
149940,0migration/07721-21aten2.4-expect21:52:550
149940,0migration/07140-21kthreadcore20:28:030
149940,0migration/025551-21kthreadcore21:43:020
149940,0migration/021348-21kthreadcore19:53:010
149940,0migration/020188-21needreboot19:28:020
149940,0migration/015594-21runrttasks23:10:400
149940,0migration/010125-21unixbench_singl22:28:110
329930,0watchdog/30-21swapper/320:43:043
329930,0watchdog/30-21swapper/320:12:553
329930,0watchdog/30-21swapper/319:52:553
329930,0watchdog/30-21swapper/319:43:033
329930,0watchdog/30-21swapper/319:17:513
319689932,0cyclictest8624-21awk20:53:012
319679932,0cyclictest26306-21sh20:42:591
319679932,0cyclictest15327-21awk19:27:581
319679930,0cyclictest25671-21kthreadcore21:43:021
319679930,0cyclictest25078-21kthreadcore19:33:021
319679930,0cyclictest22084-21sed22:38:011
319679930,0cyclictest20018-21kthreadcore19:53:011
319679930,0cyclictest18743-21kthreadcore20:58:031
319679930,0cyclictest0-21swapper/120:50:331
319669932,0cyclictest8048-21sensors00:38:070
319669932,0cyclictest6275-21awk21:33:000
319669932,0cyclictest21865-21munin-node21:02:590
319669932,0cyclictest20449-21sadc22:37:440
319669932,0cyclictest0-21swapper/020:58:050
319669931,0cyclictest27668-21kthreadcore23:18:020
319669930,0cyclictest11235-21perl00:42:590
319669930,0cyclictest0-21swapper/022:13:030
319669930,0cyclictest0-21swapper/021:07:550
319669930,0cyclictest0-21swapper/020:32:570
319669930,0cyclictest0-21swapper/019:19:140
29815030,0irq/29-eth0-tx-0-21swapper/223:22:512
29815030,0irq/29-eth0-tx-0-21swapper/200:02:492
29815030,0irq/29-eth0-tx-0-21swapper/019:42:560
29805030,0irq/28-eth0-rx-0-21swapper/321:17:463
259930,0migration/24582-21kthreadcore20:03:022
259930,0migration/229127-21runrttasks21:07:542
259930,0migration/226164-21hddtemp_smartct19:57:592
249930,0watchdog/20-21swapper/221:12:562
249930,0watchdog/20-21swapper/221:12:562
179930,0migration/18728-21kthreadcore19:43:031
169930,0watchdog/10-21swapper/123:43:041
169930,0watchdog/10-21swapper/121:07:561
169930,0watchdog/10-21swapper/120:38:031
329920,0watchdog/30-21swapper/320:57:483
329920,0watchdog/30-21swapper/320:02:473
319669920,0cyclictest0-21swapper/023:27:500
319669920,0cyclictest0-21swapper/000:17:530
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional