You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 22:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Sun Nov 23, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
709829187,0sleep10-21swapper/106:14:591
1376825554,0sleep20-21swapper/206:16:522
1363523828,0sleep30-21swapper/306:15:213
1376123625,0sleep00-21swapper/006:16:460
329970,0watchdog/319289-21cut11:00:013
329970,0watchdog/317814-21rt-features06:45:093
29935070,0irq/33-eth0-tx-0-21swapper/008:20:100
339960,0migration/319084-21irqrtprio09:20:083
339960,0migration/310362-21sh09:34:243
329960,0watchdog/3299250irq/32-eth0-rx-11:39:083
329960,0watchdog/3299250irq/32-eth0-rx-09:35:493
329960,0watchdog/315259-21ntpq09:15:093
329960,0watchdog/30-21swapper/311:34:323
329960,0watchdog/30-21swapper/311:28:013
329960,0watchdog/30-21swapper/311:19:253
329960,0watchdog/30-21swapper/311:10:053
329960,0watchdog/30-21swapper/310:50:213
329960,0watchdog/30-21swapper/310:20:053
329960,0watchdog/30-21swapper/310:05:013
329960,0watchdog/30-21swapper/309:54:533
329960,0watchdog/30-21swapper/309:45:093
329960,0watchdog/30-21swapper/309:11:413
329960,0watchdog/30-21swapper/308:57:013
329960,0watchdog/30-21swapper/308:50:173
329960,0watchdog/30-21swapper/308:35:173
329960,0watchdog/30-21swapper/308:30:053
329960,0watchdog/30-21swapper/308:24:533
329960,0watchdog/30-21swapper/308:21:533
329960,0watchdog/30-21swapper/307:55:093
329960,0watchdog/30-21swapper/307:45:013
329960,0watchdog/30-21swapper/307:20:093
329960,0watchdog/30-21swapper/306:30:093
329960,0watchdog/30-21swapper/306:20:133
29935060,0irq/33-eth0-tx-26080-21munin-node06:55:030
29935060,0irq/33-eth0-tx-15520-21munin-node07:55:110
29925060,0irq/32-eth0-rx-0-21swapper/311:22:263
29925060,0irq/32-eth0-rx-0-21swapper/310:14:533
29925060,0irq/32-eth0-rx-0-21swapper/310:11:403
29925060,0irq/32-eth0-rx-0-21swapper/309:51:253
29925060,0irq/32-eth0-rx-0-21swapper/309:27:283
29925060,0irq/32-eth0-rx-0-21swapper/307:50:003
19160,0ktimersoftd/10-21swapper/107:30:111
140949966,0cyclictest83150irq/26-0000:00:10:20:092
140949960,0cyclictest0-21swapper/208:59:492
149960,0migration/031497-21kthreadcore11:25:060
149960,0migration/026868-21sh11:03:250
149960,0migration/015712-21sh08:59:320
8315050,0irq/26-0000:00:0-21swapper/211:39:482
339950,0migration/325934-21latency_hist10:44:483
339950,0migration/314598-21kthreadcore07:30:083
329950,0watchdog/320211-21if_eth1.307:35:053
329950,0watchdog/314091-21cyclictest06:54:533
329950,0watchdog/312783-21kthreadcore07:05:093
329950,0watchdog/30-21swapper/311:04:493
329950,0watchdog/30-21swapper/310:55:413
329950,0watchdog/30-21swapper/310:35:013
329950,0watchdog/30-21swapper/310:29:533
329950,0watchdog/30-21swapper/310:24:493
329950,0watchdog/30-21swapper/310:00:013
329950,0watchdog/30-21swapper/309:40:253
329950,0watchdog/30-21swapper/309:05:013
329950,0watchdog/30-21swapper/308:59:533
329950,0watchdog/30-21swapper/308:39:573
329950,0watchdog/30-21swapper/308:15:133
329950,0watchdog/30-21swapper/308:06:133
329950,0watchdog/30-21swapper/307:59:493
329950,0watchdog/30-21swapper/307:40:533
329950,0watchdog/30-21swapper/307:24:533
329950,0watchdog/30-21swapper/307:14:493
329950,0watchdog/30-21swapper/307:14:493
329950,0watchdog/30-21swapper/307:09:573
329950,0watchdog/30-21swapper/306:59:493
329950,0watchdog/30-21swapper/306:39:533
329950,0watchdog/30-21swapper/306:34:573
329950,0watchdog/30-21swapper/306:27:213
29935050,0irq/33-eth0-tx-7858-21ssh09:11:142
29935050,0irq/33-eth0-tx-6315-21iceccd10:45:052
29935050,0irq/33-eth0-tx-3108-21ssh11:09:022
29935050,0irq/33-eth0-tx-29802-21munin-node08:30:072
29935050,0irq/33-eth0-tx-15361-21munin-node07:10:010
29935050,0irq/33-eth0-tx-0-21swapper/211:39:422
29935050,0irq/33-eth0-tx-0-21swapper/210:50:102
29935050,0irq/33-eth0-tx-0-21swapper/210:38:492
29935050,0irq/33-eth0-tx-0-21swapper/209:20:092
29935050,0irq/33-eth0-tx-0-21swapper/006:26:530
29925050,0irq/32-eth0-rx-4283-21sh08:10:093
29925050,0irq/32-eth0-rx-24492-21ssh08:45:063
29925050,0irq/32-eth0-rx-21235-21kthreadcore10:40:073
29925050,0irq/32-eth0-rx-0-21swapper/311:45:393
29925050,0irq/32-eth0-rx-0-21swapper/311:40:163
29925050,0irq/32-eth0-rx-0-21swapper/306:50:043
27150,0ktimersoftd/20-21swapper/209:47:262
27150,0ktimersoftd/20-21swapper/208:44:502
259950,0migration/27310-21sh11:48:552
259950,0migration/26257-21kthreadcore07:25:092
259950,0migration/25747-21cpuspeed_turbos08:15:022
259950,0migration/25400-21kthreadcore11:10:072
259950,0migration/24759-21kthreadcore10:30:062
259950,0migration/227771-21kthreadcore09:25:092
259950,0migration/223598-21kthreadcore11:00:072
259950,0migration/219001-21timerandwakeup09:55:122
259950,0migration/218562-21munin-node11:15:122
259950,0migration/213369-21sh11:32:562
259950,0migration/211611-21kthreadcore07:05:092
249950,0watchdog/213692-21grep09:35:092
249950,0watchdog/211446-21kthreadcore10:10:092
179950,0migration/15538-21sh08:50:141
179950,0migration/14675-21fschecks_time09:50:031
179950,0migration/132486-21switchtime07:40:141
179950,0migration/128709-21kthreadcore08:45:081
179950,0migration/128545-21kthreadcore10:25:081
179950,0migration/127811-21taskset11:20:531
179950,0migration/122285-21munin-node09:00:161
179950,0migration/114161-21sh10:14:551
179950,0migration/113678-21gltestperf08:20:041
179950,0migration/110005-21fschecks_time09:15:021
169950,0watchdog/16813-21perl08:35:051
169950,0watchdog/11272-21cpuspeed_turbos07:45:011
140949955,0cyclictest0-21swapper/209:16:032
140949950,0cyclictest0-21swapper/209:43:582
140949950,0cyclictest0-21swapper/209:30:342
140949950,0cyclictest0-21swapper/208:28:172
140939950,0cyclictest0-21swapper/111:16:281
149950,0migration/08412-21cpuspeed_turbos07:05:030
149950,0migration/06399-21kthreadcore06:35:060
149950,0migration/04916-21kthreadcore10:30:060
149950,0migration/03412-21latency_hist11:09:480
149950,0migration/0325-21kthreadcore08:30:090
149950,0migration/032084-21fschecks_count11:45:020
149950,0migration/032016-21kthreadcore09:45:080
149950,0migration/030359-21kthreadcore06:30:050
149950,0migration/029187-21kthreadcore10:45:070
149950,0migration/027869-21kthreadcore08:45:080
149950,0migration/027844-21taskset08:25:190
149950,0migration/026321-21aten_r1power_fr07:40:000
149950,0migration/025691-21kthreadcore07:15:060
149950,0migration/025691-21kthreadcore07:15:060
149950,0migration/024663-21sh10:41:350
149950,0migration/024276-21irqcore11:40:070
149950,0migration/021820-21hwlatdetect11:20:050
149950,0migration/019162-21kernelversion09:20:080
149950,0migration/018301-21kthreadcore11:35:040
149950,0migration/018259-21kthreadcore08:40:080
149950,0migration/016996-21proc_pri10:55:100
149950,0migration/015077-21sh10:18:050
149950,0migration/015071-21fschecks_time06:20:100
149950,0migration/013840-21kthreadcore06:45:050
149950,0migration/011564-21kthreadcore09:15:060
4140,0ktimersoftd/00-21swapper/008:54:420
29935040,0irq/33-eth0-tx-24526-21ssh09:04:522
29935040,0irq/33-eth0-tx-12509-21diskmemload08:56:192
29935040,0irq/33-eth0-tx-0-21swapper/211:24:562
29935040,0irq/33-eth0-tx-0-21swapper/210:55:062
29935040,0irq/33-eth0-tx-0-21swapper/210:26:382
29935040,0irq/33-eth0-tx-0-21swapper/210:14:522
29935040,0irq/33-eth0-tx-0-21swapper/210:00:002
29935040,0irq/33-eth0-tx-0-21swapper/209:49:492
29935040,0irq/33-eth0-tx-0-21swapper/208:35:042
29935040,0irq/33-eth0-tx-0-21swapper/208:23:062
29935040,0irq/33-eth0-tx-0-21swapper/007:25:020
29935040,0irq/33-eth0-tx-0-21swapper/007:00:140
259940,0migration/25983-21kthreadcore07:00:072
259940,0migration/23553-21kthreadcore08:50:092
259940,0migration/227128-21kthreadcore08:00:062
259940,0migration/220969-21aten_r1power_vo11:20:022
259940,0migration/217513-21kthreadcore07:10:052
259940,0migration/21638-21kthreadcore07:20:082
259940,0migration/212063-21kthreadcore07:50:072
249940,0watchdog/223626-21awk10:40:092
249940,0watchdog/21273-21cpuspeed_turbos07:45:012
19140,0ktimersoftd/10-21swapper/110:48:521
179940,0migration/1962-21fschecks_count10:30:021
179940,0migration/16794-21missed_timers09:10:081
179940,0migration/14681-21munin-node06:35:041
179940,0migration/131491-21kthreadcore08:30:091
179940,0migration/130601-21kthreadcore06:55:081
179940,0migration/128635-21fschecks_time09:45:031
179940,0migration/126463-21kthreadcore07:15:061
179940,0migration/126463-21kthreadcore07:15:061
179940,0migration/125705-21taskset09:24:241
179940,0migration/124023-21kthreadcore10:00:071
179940,0migration/12380-21kthreadcore07:20:081
179940,0migration/123166-21kthreadcore07:35:071
179940,0migration/12038-21iostat07:00:051
179940,0migration/119751-21kthreadcore06:20:141
179940,0migration/119455-21aten_r1power_vo09:40:011
179940,0migration/119282-21runrttasks06:50:041
179940,0migration/116244-21fschecks_time07:10:021
179940,0migration/115775-21kthreadcore10:55:071
179940,0migration/114860-21taskset07:06:481
179940,0migration/114285-21kthreadcore09:55:051
179940,0migration/112898-21irqcore06:45:051
179940,0migration/111118-21unixbench-2d07:25:171
179940,0migration/110422-21kthreadcore11:30:071
169940,0watchdog/111445-21kthreadcore10:10:091
169940,0watchdog/10-21swapper/111:00:011
169940,0watchdog/10-21swapper/110:05:091
140949944,0cyclictest0-21swapper/210:05:242
140949943,0cyclictest27340-21awk07:40:052
140949943,0cyclictest23871-21snmpd08:42:232
140949943,0cyclictest23871-21snmpd08:05:232
140949943,0cyclictest23871-21snmpd07:16:382
140949943,0cyclictest23871-21snmpd07:16:382
140949943,0cyclictest23871-21snmpd06:44:532
140949943,0cyclictest23871-21snmpd06:41:532
140949943,0cyclictest23871-21snmpd06:39:382
140949943,0cyclictest23871-21snmpd06:29:532
140949943,0cyclictest23871-21snmpd06:24:382
140949943,0cyclictest19964-21awk06:50:062
140949940,0cyclictest22484-21awk07:59:482
140939944,0cyclictest2546-21nvme11:08:001
140939943,0cyclictest3599-21lldpd10:49:581
140939943,0cyclictest3599-21lldpd10:42:271
140939943,0cyclictest3599-21lldpd08:55:191
140939943,0cyclictest3315-21awk09:30:061
140939943,0cyclictest29851-21awk06:30:031
140939943,0cyclictest27220-21awk09:25:071
140939943,0cyclictest25726-21awk09:05:051
140939943,0cyclictest15380-21awk11:35:021
140939943,0cyclictest11885-21awk09:35:071
140939943,0cyclictest10144-21awk10:35:031
140929944,0cyclictest25680-21kworker/0:210:05:490
140929944,0cyclictest0-21swapper/007:45:110
140929943,0cyclictest9389-21awk07:50:040
140929943,0cyclictest6621-21awk08:15:050
140929943,0cyclictest3599-21lldpd09:52:380
140929943,0cyclictest3262-21irqbalance11:30:320
140929943,0cyclictest3262-21irqbalance11:09:520
140929943,0cyclictest3262-21irqbalance10:10:330
140929943,0cyclictest3262-21irqbalance09:30:330
140929943,0cyclictest3262-21irqbalance09:29:430
140929943,0cyclictest3262-21irqbalance09:05:230
140929943,0cyclictest3262-21irqbalance09:01:430
140929943,0cyclictest23871-21snmpd08:34:530
140929943,0cyclictest23750-21awk08:00:030
140929943,0cyclictest22099-21awk10:00:050
140929943,0cyclictest20509-21awk09:40:050
140929943,0cyclictest1730-21awk09:10:030
149940,0migration/021757-21kthreadcore07:35:070
149940,0migration/011312-21fschecks_count09:35:040
149940,0migration/010996-21taskset06:40:330
8315030,0irq/26-0000:00:0-21swapper/206:55:142
29935030,0irq/33-eth0-tx-0-21swapper/007:20:150
249930,0watchdog/20-21swapper/207:35:052
169930,0watchdog/128332-21taskset06:27:491
169930,0watchdog/10-21swapper/111:45:041
169930,0watchdog/10-21swapper/110:24:451
140949932,0cyclictest31734-21awk08:10:052
140949932,0cyclictest22581-21awk06:25:052
140949930,0cyclictest0-21swapper/207:33:062
140939933,0cyclictest6699-21awk08:15:061
140939932,0cyclictest3599-21lldpd08:40:021
140939932,0cyclictest31655-21awk08:10:041
140939932,0cyclictest30580-21awk11:25:051
140939932,0cyclictest25027-21cut08:25:081
140939932,0cyclictest24111-21awk11:40:061
140939932,0cyclictest23871-21snmpd07:52:071
140939932,0cyclictest23820-21awk08:00:041
140939930,0cyclictest4557-21perl11:10:041
140929933,0cyclictest0-21swapper/010:35:550
140929933,0cyclictest0-21swapper/010:22:310
140929932,0cyclictest8565-21sensors10:50:110
140929932,0cyclictest30293-21munin-node10:25:090
140929932,0cyclictest23871-21snmpd08:11:380
140929932,0cyclictest18860-21munin-node06:50:130
140929932,0cyclictest15774-21grep11:15:070
140929932,0cyclictest13007-21awk07:30:060
140929931,0cyclictest0-21swapper/009:55:410
149930,0migration/030158-21runrttasks08:07:280
169920,0watchdog/10-21swapper/107:54:491
140939921,0cyclictest29686-21latency_hist08:04:481
140939921,0cyclictest10733-21date06:39:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional