You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-05 - 18:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Wed Nov 05, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2597223728,0sleep20-21swapper/206:16:262
2603023626,0sleep10-21swapper/106:17:051
2598523228,0sleep00-21swapper/006:16:360
2629022824,0sleep30-21swapper/306:20:083
329970,0watchdog/321271-21fschecks_time10:56:103
329970,0watchdog/30-21swapper/309:10:023
29925070,0irq/32-eth0-rx-13570-21tune2fs09:31:083
339960,0migration/39276-21sh11:43:593
329960,0watchdog/310715-21df_abs10:31:063
329960,0watchdog/30-21swapper/311:38:143
329960,0watchdog/30-21swapper/311:34:183
329960,0watchdog/30-21swapper/311:26:063
329960,0watchdog/30-21swapper/311:22:423
329960,0watchdog/30-21swapper/311:20:063
329960,0watchdog/30-21swapper/310:43:103
329960,0watchdog/30-21swapper/310:26:063
329960,0watchdog/30-21swapper/310:10:583
329960,0watchdog/30-21swapper/310:06:383
329960,0watchdog/30-21swapper/309:41:103
329960,0watchdog/30-21swapper/309:00:263
329960,0watchdog/30-21swapper/308:50:463
329960,0watchdog/30-21swapper/308:36:463
329960,0watchdog/30-21swapper/308:06:223
329960,0watchdog/30-21swapper/307:20:543
329960,0watchdog/30-21swapper/307:12:303
329960,0watchdog/30-21swapper/307:01:423
29935060,0irq/33-eth0-tx-6313-21ssh08:22:150
29935060,0irq/33-eth0-tx-31483-21munin-node07:36:100
29935060,0irq/33-eth0-tx-0-21swapper/007:07:320
29935060,0irq/33-eth0-tx-0-21swapper/006:27:240
29925060,0irq/32-eth0-rx-3120-21cut08:21:133
29925060,0irq/32-eth0-rx-11644-21tune2fs08:51:153
29925060,0irq/32-eth0-rx-0-21swapper/311:46:143
29925060,0irq/32-eth0-rx-0-21swapper/311:11:103
29925060,0irq/32-eth0-rx-0-21swapper/311:07:033
29925060,0irq/32-eth0-rx-0-21swapper/311:02:343
29925060,0irq/32-eth0-rx-0-21swapper/309:48:183
29925060,0irq/32-eth0-rx-0-21swapper/308:40:543
29925060,0irq/32-eth0-rx-0-21swapper/308:31:123
29925060,0irq/32-eth0-rx-0-21swapper/308:27:073
264299966,0cyclictest0-21swapper/011:31:120
264299965,0cyclictest24352-21kworker/0:007:11:120
149960,0migration/07508-21latency_hist11:25:530
149960,0migration/04519-21sh09:26:030
8315050,0irq/26-0000:00:1214-21latency_hist06:25:542
339950,0migration/34963-21munin-node09:26:083
339950,0migration/332529-21missed_timers06:21:133
339950,0migration/31458-21aten_r1power_cu06:26:073
329950,0watchdog/30-21swapper/310:46:463
329950,0watchdog/30-21swapper/310:36:023
329950,0watchdog/30-21swapper/310:00:583
329950,0watchdog/30-21swapper/309:56:583
329950,0watchdog/30-21swapper/309:22:263
329950,0watchdog/30-21swapper/309:15:583
329950,0watchdog/30-21swapper/309:11:223
329950,0watchdog/30-21swapper/308:16:103
329950,0watchdog/30-21swapper/308:12:103
329950,0watchdog/30-21swapper/308:00:583
329950,0watchdog/30-21swapper/307:55:543
329950,0watchdog/30-21swapper/307:50:543
329950,0watchdog/30-21swapper/307:46:303
329950,0watchdog/30-21swapper/307:36:023
329950,0watchdog/30-21swapper/307:30:543
329950,0watchdog/30-21swapper/307:28:063
329950,0watchdog/30-21swapper/307:16:463
329950,0watchdog/30-21swapper/307:06:183
329950,0watchdog/30-21swapper/306:56:023
329950,0watchdog/30-21swapper/306:50:583
329950,0watchdog/30-21swapper/306:47:103
329950,0watchdog/30-21swapper/306:36:063
329950,0watchdog/30-21swapper/306:31:143
29935050,0irq/33-eth0-tx-9427-21ssh08:47:362
29935050,0irq/33-eth0-tx-8341-21ssh08:28:222
29935050,0irq/33-eth0-tx-6172-21munin-node06:56:070
29935050,0irq/33-eth0-tx-27205-21munin-node10:41:092
29935050,0irq/33-eth0-tx-23549-21ssh11:32:472
29935050,0irq/33-eth0-tx-21962-21ssh11:14:222
29935050,0irq/33-eth0-tx-19089-21ssh09:13:262
29935050,0irq/33-eth0-tx-17254-21telnet07:26:080
29935050,0irq/33-eth0-tx-10308-21munin-node10:31:092
29935050,0irq/33-eth0-tx-0-21swapper/211:36:082
29935050,0irq/33-eth0-tx-0-21swapper/007:56:140
29935050,0irq/33-eth0-tx-0-21swapper/007:21:120
29935050,0irq/33-eth0-tx-0-21swapper/006:31:100
29925050,0irq/32-eth0-rx-12234-21missed_timers07:41:133
29925050,0irq/32-eth0-rx-0-21swapper/310:51:333
29925050,0irq/32-eth0-rx-0-21swapper/310:21:043
29925050,0irq/32-eth0-rx-0-21swapper/310:16:363
29925050,0irq/32-eth0-rx-0-21swapper/309:51:063
29925050,0irq/32-eth0-rx-0-21swapper/309:36:193
29925050,0irq/32-eth0-rx-0-21swapper/309:00:553
29925050,0irq/32-eth0-rx-0-21swapper/306:41:153
27150,0ktimersoftd/20-21swapper/210:04:392
264319955,0cyclictest0-21swapper/211:07:232
264319955,0cyclictest0-21swapper/209:00:292
264319955,0cyclictest0-21swapper/207:16:252
264319954,0cyclictest3599-21lldpd09:21:422
264319950,0cyclictest0-21swapper/211:46:012
264319950,0cyclictest0-21swapper/211:16:042
264319950,0cyclictest0-21swapper/208:34:182
264309955,0cyclictest0-21swapper/110:45:031
264309955,0cyclictest0-21swapper/110:24:421
264309955,0cyclictest0-21swapper/110:08:191
264309950,0cyclictest0-21swapper/111:37:331
264309950,0cyclictest0-21swapper/109:11:051
264309950,0cyclictest0-21swapper/109:00:411
264299955,0cyclictest24352-21kworker/0:007:16:140
264299955,0cyclictest16113-21kworker/0:211:45:200
264299955,0cyclictest16113-21kworker/0:211:36:400
264299955,0cyclictest16113-21kworker/0:211:29:120
264299955,0cyclictest16113-21kworker/0:211:06:200
264299955,0cyclictest16113-21kworker/0:211:01:140
264299955,0cyclictest16113-21kworker/0:210:39:240
264299955,0cyclictest16113-21kworker/0:210:20:520
264299955,0cyclictest16113-21kworker/0:210:14:460
264299955,0cyclictest16113-21kworker/0:210:05:560
264299955,0cyclictest16113-21kworker/0:209:59:460
264299955,0cyclictest16113-21kworker/0:209:21:240
264299955,0cyclictest16113-21kworker/0:209:12:420
264299955,0cyclictest16113-21kworker/0:209:10:500
264299955,0cyclictest16113-21kworker/0:208:59:420
264299955,0cyclictest16113-21kworker/0:208:26:300
264299955,0cyclictest16113-21kworker/0:208:01:160
264299955,0cyclictest16113-21kworker/0:207:41:100
264299955,0cyclictest0-21swapper/009:16:150
264299955,0cyclictest0-21swapper/008:11:080
259950,0migration/218560-21kthreadcore09:51:122
259950,0migration/217888-21kthreadcore06:36:112
259950,0migration/215742-21runrttasks11:30:002
259950,0migration/215542-21munin-node10:11:202
259950,0migration/21497-21kthreadcore06:51:122
179950,0migration/17014-21kthreadcore08:01:121
179950,0migration/112856-21kthreadcore08:51:181
169950,0watchdog/17298-21irqrtprio09:46:141
169950,0watchdog/10-21swapper/107:16:141
149950,0migration/03750-21munin-node10:46:060
149950,0migration/03294-21idleruntime08:46:110
149950,0migration/031556-21kthreadcore10:21:100
149950,0migration/031037-21taskset07:33:350
149950,0migration/02898-21idleruntime10:26:100
149950,0migration/028476-21gltestperf09:01:060
149950,0migration/026381-21kthreadcore06:41:140
149950,0migration/025021-21kthreadcore10:56:150
149950,0migration/024615-21munin-node08:16:050
149950,0migration/024297-21sh10:01:060
149950,0migration/019536-21irqrtprio08:36:110
149950,0migration/018611-21sh08:54:390
149950,0migration/017785-21kthreadcore10:51:140
149950,0migration/01741-21sh10:42:030
149950,0migration/017018-21sh08:33:400
149950,0migration/016918-21kthreadcore11:11:130
149950,0migration/016141-21kthreadcore10:31:110
149950,0migration/014839-21kthreadcore11:46:120
29935040,0irq/33-eth0-tx-26590-21ssh08:41:102
29935040,0irq/33-eth0-tx-0-21swapper/211:40:552
29935040,0irq/33-eth0-tx-0-21swapper/211:01:062
29935040,0irq/33-eth0-tx-0-21swapper/210:51:202
29935040,0irq/33-eth0-tx-0-21swapper/210:25:552
29935040,0irq/33-eth0-tx-0-21swapper/210:21:022
29935040,0irq/33-eth0-tx-0-21swapper/210:06:312
29935040,0irq/33-eth0-tx-0-21swapper/209:15:552
29935040,0irq/33-eth0-tx-0-21swapper/209:06:072
29935040,0irq/33-eth0-tx-0-21swapper/008:06:080
264319944,0cyclictest0-21swapper/208:24:512
264319944,0cyclictest0-21swapper/207:11:042
264319943,0cyclictest3599-21lldpd07:05:552
264319943,0cyclictest3262-21irqbalance10:35:582
264319943,0cyclictest3262-21irqbalance09:56:182
264319943,0cyclictest29136-21awk07:56:102
264319943,0cyclictest23871-21snmpd11:20:562
264319943,0cyclictest23871-21snmpd10:15:562
264319943,0cyclictest23871-21snmpd09:40:562
264319943,0cyclictest23871-21snmpd08:50:552
264319943,0cyclictest23871-21snmpd06:57:552
264319943,0cyclictest21597-21awk10:56:112
264319943,0cyclictest18375-21awk08:11:082
264309944,0cyclictest0-21swapper/108:32:271
264309943,0cyclictest7369-21awk06:56:111
264309943,0cyclictest4413-21awk10:46:091
264309943,0cyclictest3599-21lldpd10:15:001
264309943,0cyclictest3599-21lldpd10:04:591
264309943,0cyclictest3599-21lldpd09:30:551
264309943,0cyclictest3599-21lldpd08:24:561
264309943,0cyclictest3599-21lldpd08:00:201
264309943,0cyclictest3599-21lldpd07:00:551
264309943,0cyclictest3599-21lldpd06:31:531
264309943,0cyclictest32561-21awk11:21:091
264309943,0cyclictest28636-21awk09:01:081
264309943,0cyclictest27081-21awk06:21:081
264309943,0cyclictest23871-21snmpd11:45:561
264309943,0cyclictest23871-21snmpd11:01:261
264309943,0cyclictest23871-21snmpd10:50:561
264309943,0cyclictest23871-21snmpd10:28:561
264309943,0cyclictest23863-21awk11:16:071
264309943,0cyclictest21930-21awk07:51:121
264309943,0cyclictest18589-21awk10:16:151
264299944,0cyclictest24352-21kworker/0:006:21:110
264299944,0cyclictest16113-21kworker/0:211:17:540
264299944,0cyclictest16113-21kworker/0:209:50:580
264299944,0cyclictest16113-21kworker/0:209:38:400
264299944,0cyclictest16113-21kworker/0:209:33:120
264299943,0cyclictest3262-21irqbalance09:41:180
264299943,0cyclictest3262-21irqbalance08:41:580
264299943,0cyclictest3262-21irqbalance06:46:480
264299943,0cyclictest3262-21irqbalance06:36:080
264299943,0cyclictest32405-21awk06:51:100
259940,0migration/24689-21kthreadcore08:01:112
259940,0migration/23647-21kthreadcore07:36:132
259940,0migration/224392-21kthreadcore09:36:132
259940,0migration/223195-21aten_r1power_en06:41:052
259940,0migration/222425-21taskset08:36:122
259940,0migration/219474-21proc_pri07:01:162
259940,0migration/21851-21vmstat09:01:192
259940,0migration/216509-21kthreadcore07:46:132
259940,0migration/215039-21kthreadcore09:31:122
259940,0migration/211866-21kthreadcore07:41:122
259940,0migration/211551-21kthreadcore07:21:132
259940,0migration/211266-21runrttasks08:06:112
259940,0migration/211122-21kthreadcore06:31:132
249940,0watchdog/27295-21irqrtprio09:46:142
249940,0watchdog/23507-21head10:46:062
249940,0watchdog/221781-21kthreadcore07:26:142
249940,0watchdog/20-21swapper/209:26:062
249940,0watchdog/20-21swapper/207:51:142
179940,0migration/16264-21fschecks_time11:06:061
179940,0migration/12825-21irqcore06:26:131
179940,0migration/127814-21sh07:11:031
179940,0migration/127622-21taskset08:41:141
179940,0migration/127437-21kthreadcore07:31:131
179940,0migration/122483-21kthreadcore08:11:111
179940,0migration/120551-21kthreadcore11:31:111
179940,0migration/118803-21aten_r1power_fr10:36:041
179940,0migration/114313-21aten2.4-expect11:11:081
179940,0migration/111938-21kthreadcore10:31:101
169940,0watchdog/17791-21ssh08:26:461
169940,0watchdog/14547-21aten_r1power_cu09:26:061
169940,0watchdog/122172-21python06:36:181
169940,0watchdog/121061-21ssh09:51:261
169940,0watchdog/10-21swapper/109:21:141
169940,0watchdog/10-21swapper/109:10:021
169940,0watchdog/10-21swapper/107:26:141
169940,0watchdog/10-21swapper/106:41:221
149940,0migration/023827-21kthreadcore07:51:130
149940,0migration/019213-21runrttasks07:01:130
149940,0migration/010601-21kthreadcore09:46:150
8315030,0irq/26-0000:00:0-21swapper/206:26:002
264319932,0cyclictest3599-21lldpd07:31:462
264319932,0cyclictest25634-21awk08:16:092
264309932,0cyclictest9944-21basename07:21:071
264309932,0cyclictest3599-21lldpd09:35:551
264309932,0cyclictest3599-21lldpd08:46:111
264309932,0cyclictest3599-21lldpd06:46:551
264309932,0cyclictest19638-21irqstats08:36:111
264309932,0cyclictest14656-21awk07:46:111
264309932,0cyclictest12023-21cut08:06:121
264309930,0cyclictest30598-21perl09:41:121
264309930,0cyclictest20124-21sh09:15:551
264309930,0cyclictest0-21swapper/110:56:081
264299933,0cyclictest16113-21kworker/0:207:46:140
259930,0migration/231008-21runrttasks06:50:512
179930,0migration/110000-21kthreadcore11:26:121
169930,0watchdog/10-21swapper/111:41:091
169930,0watchdog/10-21swapper/109:57:341
169930,0watchdog/10-21swapper/107:36:181
169930,0watchdog/10-21swapper/107:06:181
169930,0watchdog/10-21swapper/106:51:141
264309920,0cyclictest0-21swapper/107:40:541
169920,0watchdog/10-21swapper/108:15:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional