You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 07:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Thu Dec 11, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1365623829,0sleep20-21swapper/218:15:592
1373023728,0sleep10-21swapper/118:16:501
1351223329,0sleep30-21swapper/318:14:203
1361722925,0sleep00-21swapper/018:15:290
329970,0watchdog/322546-21munin-node19:09:023
329970,0watchdog/316627-21rm21:24:503
29925070,0irq/32-eth0-rx-3181-21python23:09:093
29925070,0irq/32-eth0-rx-0-21swapper/323:04:423
29925070,0irq/32-eth0-rx-0-21swapper/322:35:383
29925070,0irq/32-eth0-rx-0-21swapper/321:54:043
139679976,0cyclictest0-21swapper/120:42:541
8315060,0irq/26-0000:00:1436-21crond20:23:452
4160,0ktimersoftd/00-21swapper/021:31:240
339960,0migration/323153-21sh21:10:093
339960,0migration/32256-21sh21:36:483
339960,0migration/31720-21sh22:50:203
329960,0watchdog/331476-21sensors19:34:103
329960,0watchdog/3299250irq/32-eth0-rx-21:46:263
329960,0watchdog/326693-21iostat_ios20:19:023
329960,0watchdog/30-21swapper/320:35:583
29935060,0irq/33-eth0-tx-0-21swapper/020:19:150
29925060,0irq/32-eth0-rx-96672sleep322:54:083
29925060,0irq/32-eth0-rx-4875-21kthreadcore21:19:053
29925060,0irq/32-eth0-rx-27218-21memory18:24:043
29925060,0irq/32-eth0-rx-178452sleep322:42:593
29925060,0irq/32-eth0-rx-15394-21iostat_ios22:04:043
29925060,0irq/32-eth0-rx-0-21swapper/322:59:073
29925060,0irq/32-eth0-rx-0-21swapper/322:31:103
29925060,0irq/32-eth0-rx-0-21swapper/322:24:183
29925060,0irq/32-eth0-rx-0-21swapper/321:30:463
29925060,0irq/32-eth0-rx-0-21swapper/321:06:393
29925060,0irq/32-eth0-rx-0-21swapper/320:59:593
29925060,0irq/32-eth0-rx-0-21swapper/320:46:173
29925060,0irq/32-eth0-rx-0-21swapper/320:29:343
169960,0watchdog/121065-21ssh23:19:571
169960,0watchdog/112559-21ssh20:46:141
139679960,0cyclictest0-21swapper/123:38:031
8315050,0irq/26-0000:00:726-21crond22:33:442
8315050,0irq/26-0000:00:21317-21sed18:23:452
8315050,0irq/26-0000:00:14086-21latency_hist18:18:452
4150,0ktimersoftd/00-21swapper/023:46:590
4150,0ktimersoftd/00-21swapper/020:29:070
339950,0migration/35261-21unixbench-2d23:29:123
339950,0migration/33672-21latency_hist20:03:453
339950,0migration/33582-21aten_r1power_vo18:33:593
339950,0migration/33203-21taskset19:17:163
339950,0migration/322955-21munin-node19:54:023
339950,0migration/321263-21taskset19:07:523
339950,0migration/312081-21kthreadcore22:19:043
339950,0migration/312044-21if_eth1.319:24:023
339950,0migration/311009-21kthreadcore18:59:013
339950,0migration/310662-21runrttasks18:38:463
339950,0migration/31035-21runrttasks19:39:013
329950,0watchdog/318680-21munin-node20:13:583
329950,0watchdog/30-21swapper/323:39:053
329950,0watchdog/30-21swapper/320:04:063
29935050,0irq/33-eth0-tx-24086-21kthreadcore21:49:022
29935050,0irq/33-eth0-tx-24051-21munin-node23:43:592
29935050,0irq/33-eth0-tx-21779-21ssh23:04:012
29935050,0irq/33-eth0-tx-21375-21munin-node18:23:570
29935050,0irq/33-eth0-tx-1219-21kthreadcore20:39:062
29935050,0irq/33-eth0-tx-10677-21munin-node18:38:590
29935050,0irq/33-eth0-tx-0-21swapper/222:46:302
29935050,0irq/33-eth0-tx-0-21swapper/222:16:002
29935050,0irq/33-eth0-tx-0-21swapper/018:54:000
29935050,0irq/33-eth0-tx-0-21swapper/018:52:080
29925050,0irq/32-eth0-rx-15479-21kthreadcore20:49:043
29925050,0irq/32-eth0-rx-0-21swapper/323:43:593
29925050,0irq/32-eth0-rx-0-21swapper/323:34:273
29925050,0irq/32-eth0-rx-0-21swapper/323:27:233
29925050,0irq/32-eth0-rx-0-21swapper/323:19:183
29925050,0irq/32-eth0-rx-0-21swapper/323:15:373
29925050,0irq/32-eth0-rx-0-21swapper/322:44:043
29925050,0irq/32-eth0-rx-0-21swapper/322:14:013
29925050,0irq/32-eth0-rx-0-21swapper/322:10:463
29925050,0irq/32-eth0-rx-0-21swapper/321:58:523
29925050,0irq/32-eth0-rx-0-21swapper/321:53:183
29925050,0irq/32-eth0-rx-0-21swapper/321:39:203
29925050,0irq/32-eth0-rx-0-21swapper/321:15:423
29925050,0irq/32-eth0-rx-0-21swapper/320:55:283
29925050,0irq/32-eth0-rx-0-21swapper/320:39:003
29925050,0irq/32-eth0-rx-0-21swapper/320:25:313
29925050,0irq/32-eth0-rx-0-21swapper/318:43:563
29925050,0irq/32-eth0-rx-0-21swapper/318:29:013
259950,0migration/225732-21kthreadcore23:24:042
259950,0migration/22395-21irqcore22:34:032
259950,0migration/220937-21irqcore20:34:032
259950,0migration/220023-21kthreadcore19:29:022
259950,0migration/213537-21ntp_offset21:04:072
259950,0migration/213274-21irqcore22:59:052
249950,0watchdog/217831-21cut22:04:062
179950,0migration/129826-21irqcore18:29:041
179950,0migration/129708-21taskset23:25:281
179950,0migration/129005-21kthreadcore20:19:031
179950,0migration/124482-21sh20:54:001
179950,0migration/122331-21kthreadcore21:29:031
179950,0migration/120031-21missed_timers18:19:051
179950,0migration/113921-21kthreadcore22:39:031
179950,0migration/111119-21aten_r1power_fr20:08:581
179950,0migration/110175-21kthreadcore18:59:011
169950,0watchdog/14719-21ssh21:57:181
169950,0watchdog/14522-21iostat_ios21:39:021
169950,0watchdog/13719-21diskstats22:53:571
169950,0watchdog/11885-21ssh21:35:461
169950,0watchdog/10-21swapper/121:24:101
169950,0watchdog/10-21swapper/119:59:061
149950,0migration/07320-21latency_hist19:43:460
149950,0migration/07087-21kthreadcore19:19:030
149950,0migration/05140-21taskset20:59:110
149950,0migration/0504-21kthreadcore23:29:040
149950,0migration/04700-21idleruntime-cro20:43:450
149950,0migration/04697-21irqcore22:54:010
149950,0migration/032480-21taskset22:31:450
149950,0migration/031433-21kthreadcore19:14:030
149950,0migration/030072-21fschecks_time23:08:590
149950,0migration/029971-21idleruntime19:59:020
149950,0migration/029683-21munin-node18:29:030
149950,0migration/029530-21cpuspeed_turbos21:53:580
149950,0migration/027004-21sh22:48:510
149950,0migration/025670-21munin-node20:34:060
149950,0migration/024404-21sh21:13:370
149950,0migration/024330-21kthreadcore22:09:030
149950,0migration/023716-21kthreadcore19:09:050
149950,0migration/020493-21switchtime23:19:110
149950,0migration/020372-21kthreadcore18:44:020
149950,0migration/020346-21munin-node19:04:060
149950,0migration/018267-21munin-node21:44:070
149950,0migration/018044-21taskset21:28:450
149950,0migration/017997-21sh22:43:240
149950,0migration/017619-21kthreadcore22:59:070
149950,0migration/014795-21cpuspeed_turbos19:48:570
149950,0migration/013467-21sh20:48:290
149950,0migration/013428-21kthreadcore20:09:040
149950,0migration/012105-21irqcore19:24:030
149950,0migration/011774-21rt-features23:14:110
139679955,0cyclictest0-21swapper/122:36:341
139679955,0cyclictest0-21swapper/122:29:091
139679955,0cyclictest0-21swapper/120:50:281
139679955,0cyclictest0-21swapper/120:36:541
139679955,0cyclictest0-21swapper/119:13:591
139679950,0cyclictest0-21swapper/121:01:491
139669955,0cyclictest0-21swapper/023:38:190
139669955,0cyclictest0-21swapper/020:25:390
139669950,0cyclictest0-21swapper/021:08:320
339940,0migration/38687-21irqcore19:44:033
329940,0watchdog/324487-21timerwakeupswit19:29:103
29935040,0irq/33-eth0-tx-9774-21ssh22:38:532
29935040,0irq/33-eth0-tx-3685-21ssh23:09:302
29935040,0irq/33-eth0-tx-25227-21diskmemload21:58:542
29935040,0irq/33-eth0-tx-24734-21munin-node21:14:002
29935040,0irq/33-eth0-tx-10119-21ssh21:23:582
29935040,0irq/33-eth0-tx-0-21swapper/223:14:042
29935040,0irq/33-eth0-tx-0-21swapper/222:49:042
29935040,0irq/33-eth0-tx-0-21swapper/222:24:062
29935040,0irq/33-eth0-tx-0-21swapper/222:18:582
29935040,0irq/33-eth0-tx-0-21swapper/222:08:552
29935040,0irq/33-eth0-tx-0-21swapper/221:44:042
29935040,0irq/33-eth0-tx-0-21swapper/221:29:262
29935040,0irq/33-eth0-tx-0-21swapper/221:09:482
29935040,0irq/33-eth0-tx-0-21swapper/220:49:022
29935040,0irq/33-eth0-tx-0-21swapper/220:44:002
29935040,0irq/33-eth0-tx-0-21swapper/020:13:560
29935040,0irq/33-eth0-tx-0-21swapper/019:39:090
29935040,0irq/33-eth0-tx-0-21swapper/018:37:050
29925040,0irq/32-eth0-rx-0-21swapper/319:52:483
29925040,0irq/32-eth0-rx-0-21swapper/318:22:543
259940,0migration/29513-21kthreadcore23:34:042
259940,0migration/28429-21irqcore18:59:002
259940,0migration/28129-21kthreadcore22:54:032
259940,0migration/2683-21kthreadcore19:14:042
259940,0migration/232539-21irqrtprio23:29:032
259940,0migration/22522-21timerandwakeup18:29:122
259940,0migration/218571-21fschecks_time18:43:582
259940,0migration/215036-21fschecks_time19:04:002
249940,0watchdog/216524-21grep20:29:062
249940,0watchdog/216388-21grep19:49:022
179940,0migration/16565-21kthreadcore20:04:051
179940,0migration/14025-21fschecks_count18:34:001
179940,0migration/129377-21kthreadcore18:49:051
179940,0migration/125227-21latency_hist19:33:461
179940,0migration/124341-21kthreadcore23:04:021
179940,0migration/123202-21kthreadcore19:29:031
179940,0migration/122406-21fschecks_time19:53:591
179940,0migration/118507-21kthreadcore19:49:031
179940,0migration/118190-21proc_pri22:59:091
179940,0migration/112393-21df_abs21:43:581
179940,0migration/111735-21pmu-power21:59:081
169940,0watchdog/18824-21ssh20:24:501
169940,0watchdog/15810-21ssh23:14:011
169940,0watchdog/130408-21iostat_ios23:09:011
169940,0watchdog/122769-21kthreadcore21:49:021
169940,0watchdog/121576-21needreboot23:39:051
169940,0watchdog/116650-21nfs_client18:39:061
169940,0watchdog/10-21swapper/122:25:451
169940,0watchdog/10-21swapper/122:04:141
169940,0watchdog/10-21swapper/121:18:501
169940,0watchdog/10-21swapper/119:18:581
169940,0watchdog/10-21swapper/119:09:061
169940,0watchdog/10-21swapper/118:23:581
149940,0migration/025994-21kthreadcore23:24:040
149940,0migration/018881-21kthreadcore23:39:040
149940,0migration/015213-21if_err_eth018:19:010
149940,0migration/014605-21runrttasks22:04:010
149940,0migration/01088-21aten_r1power_cu22:33:570
139729943,0cyclictest4497-21awk21:39:012
139729943,0cyclictest3760-21cat20:03:462
139729943,0cyclictest3599-21lldpd20:24:042
139729943,0cyclictest3599-21lldpd19:56:032
139729943,0cyclictest3599-21lldpd19:48:332
139729943,0cyclictest3599-21lldpd19:09:022
139729943,0cyclictest3262-21irqbalance23:39:392
139729943,0cyclictest3262-21irqbalance21:53:492
139729943,0cyclictest3262-21irqbalance20:53:502
139729943,0cyclictest3262-21irqbalance18:54:002
139729943,0cyclictest3262-21irqbalance18:49:102
139729943,0cyclictest3262-21irqbalance18:39:002
139729943,0cyclictest3262-21irqbalance18:33:502
139729943,0cyclictest32242-21sadc19:38:452
139729943,0cyclictest32210-21awk20:59:032
139729943,0cyclictest28168-21awk21:34:022
139729943,0cyclictest23871-21snmpd19:21:032
139729943,0cyclictest2142-21awk21:19:032
139729943,0cyclictest15265-21awk23:19:022
139729943,0cyclictest11907-21awk19:24:012
139729940,0cyclictest0-21swapper/220:13:562
139679944,0cyclictest0-21swapper/122:43:591
139679943,0cyclictest28140-21awk22:49:021
139679943,0cyclictest23871-21snmpd23:46:041
139679943,0cyclictest23871-21snmpd23:30:041
139679943,0cyclictest23871-21snmpd21:06:041
139679943,0cyclictest23871-21snmpd19:42:181
139679943,0cyclictest15513-21awk19:04:021
139669944,0cyclictest0-21swapper/022:27:500
139669944,0cyclictest0-21swapper/022:01:400
139669944,0cyclictest0-21swapper/021:50:280
139669943,0cyclictest3599-21lldpd20:50:080
139669943,0cyclictest3599-21lldpd20:04:030
139669943,0cyclictest3262-21irqbalance22:44:590
139669943,0cyclictest3262-21irqbalance21:34:090
139669943,0cyclictest3262-21irqbalance21:19:000
139669943,0cyclictest3262-21irqbalance21:17:000
139669943,0cyclictest3262-21irqbalance19:29:000
139669943,0cyclictest3262-21irqbalance18:59:500
139669943,0cyclictest28722-21sadc19:58:450
139669943,0cyclictest23871-21snmpd21:39:040
139669943,0cyclictest21648-21awk23:04:000
29925030,0irq/32-eth0-rx-0-21swapper/320:09:573
29925030,0irq/32-eth0-rx-0-21swapper/319:20:503
29925030,0irq/32-eth0-rx-0-21swapper/318:54:033
29925030,0irq/32-eth0-rx-0-21swapper/318:48:593
249930,0watchdog/20-21swapper/220:08:582
179930,0migration/11387-21irqrtprio18:54:061
169930,0watchdog/125227-21diskmemload22:19:171
169930,0watchdog/10-21swapper/122:14:021
169930,0watchdog/10-21swapper/120:28:501
169930,0watchdog/10-21swapper/120:14:021
169930,0watchdog/10-21swapper/119:44:061
169930,0watchdog/10-21swapper/119:23:541
169930,0watchdog/10-21swapper/118:43:461
139729932,0cyclictest3599-21lldpd19:59:032
139729930,0cyclictest1218-21if_eth1.319:39:022
139679932,0cyclictest25940-21awk21:14:031
139679932,0cyclictest23871-21snmpd21:09:041
139679930,0cyclictest26674-21grep22:09:041
139669932,0cyclictest8385-21perl22:18:590
139669932,0cyclictest3599-21lldpd22:13:460
139669932,0cyclictest3262-21irqbalance19:33:500
139669932,0cyclictest28830-21sensors20:54:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional