You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 20:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Wed Nov 26, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
250725140,0sleep20-21swapper/206:18:462
223124940,0sleep10-21swapper/106:15:331
221224342,0sleep00-21swapper/006:15:200
232424028,0sleep30-21swapper/306:16:393
2664991313,0cyclictest3483-21sensors11:25:000
329970,0watchdog/331484-21sh08:30:183
29925070,0irq/32-eth0-rx-0-21swapper/311:04:403
339960,0migration/33996-21sh09:50:093
339960,0migration/327719-21fschecks_time09:09:513
339960,0migration/32545-21kthreadcore10:30:013
339960,0migration/311680-21sh11:13:363
329960,0watchdog/317775-21ssh10:55:583
329960,0watchdog/30-21swapper/311:47:143
329960,0watchdog/30-21swapper/311:35:103
329960,0watchdog/30-21swapper/311:26:143
329960,0watchdog/30-21swapper/310:49:383
329960,0watchdog/30-21swapper/310:44:503
329960,0watchdog/30-21swapper/310:39:503
329960,0watchdog/30-21swapper/310:29:263
329960,0watchdog/30-21swapper/310:09:543
329960,0watchdog/30-21swapper/310:08:023
329960,0watchdog/30-21swapper/310:02:343
329960,0watchdog/30-21swapper/309:55:143
329960,0watchdog/30-21swapper/309:45:463
329960,0watchdog/30-21swapper/309:40:423
329960,0watchdog/30-21swapper/309:38:503
329960,0watchdog/30-21swapper/309:24:463
329960,0watchdog/30-21swapper/309:19:383
329960,0watchdog/30-21swapper/309:06:423
329960,0watchdog/30-21swapper/309:02:343
329960,0watchdog/30-21swapper/308:57:383
329960,0watchdog/30-21swapper/308:50:103
329960,0watchdog/30-21swapper/308:37:543
329960,0watchdog/30-21swapper/308:21:103
329960,0watchdog/30-21swapper/307:32:503
329960,0watchdog/30-21swapper/307:22:023
329960,0watchdog/30-21swapper/306:50:343
329960,0watchdog/30-21swapper/306:46:543
329960,0watchdog/30-21swapper/306:28:063
29935060,0irq/33-eth0-tx-0-21swapper/008:20:330
29935060,0irq/33-eth0-tx-0-21swapper/007:50:020
29935060,0irq/33-eth0-tx-0-21swapper/007:31:240
29935060,0irq/33-eth0-tx-0-21swapper/006:56:180
29935060,0irq/33-eth0-tx-0-21swapper/006:21:110
29925060,0irq/32-eth0-rx-26001-21kthreadcore11:39:543
29925060,0irq/32-eth0-rx-0-21swapper/311:30:273
29925060,0irq/32-eth0-rx-0-21swapper/311:01:473
29925060,0irq/32-eth0-rx-0-21swapper/310:39:223
29925060,0irq/32-eth0-rx-0-21swapper/310:21:093
29925060,0irq/32-eth0-rx-0-21swapper/309:29:573
29925060,0irq/32-eth0-rx-0-21swapper/309:14:523
29925060,0irq/32-eth0-rx-0-21swapper/308:24:563
26739960,0cyclictest0-21swapper/208:00:072
149960,0migration/05254-21kthreadcore10:30:020
149960,0migration/05053-21hwlatdetect07:54:530
149960,0migration/011338-21sh06:24:570
8315050,0irq/26-0000:00:9162-21latency_hist08:39:382
339950,0migration/320381-21kthreadcore08:04:553
329950,0watchdog/329177-21cpu07:04:503
329950,0watchdog/30-21swapper/311:19:503
329950,0watchdog/30-21swapper/310:15:583
329950,0watchdog/30-21swapper/308:44:463
329950,0watchdog/30-21swapper/308:15:183
329950,0watchdog/30-21swapper/308:09:383
329950,0watchdog/30-21swapper/307:59:423
329950,0watchdog/30-21swapper/307:55:303
329950,0watchdog/30-21swapper/307:53:023
329950,0watchdog/30-21swapper/307:44:423
329950,0watchdog/30-21swapper/307:42:023
329950,0watchdog/30-21swapper/307:34:583
329950,0watchdog/30-21swapper/307:24:583
329950,0watchdog/30-21swapper/307:10:183
329950,0watchdog/30-21swapper/307:00:343
329950,0watchdog/30-21swapper/306:59:063
329950,0watchdog/30-21swapper/306:36:463
329950,0watchdog/30-21swapper/306:19:383
29935050,0irq/33-eth0-tx-29521-21munin-node11:24:532
29935050,0irq/33-eth0-tx-24728-21munin-node08:29:552
29935050,0irq/33-eth0-tx-2128-21ssh09:13:122
29935050,0irq/33-eth0-tx-0-21swapper/211:13:172
29935050,0irq/33-eth0-tx-0-21swapper/210:54:522
29935050,0irq/33-eth0-tx-0-21swapper/209:34:242
29935050,0irq/33-eth0-tx-0-21swapper/208:50:502
29925050,0irq/32-eth0-rx-5283-21memory06:39:573
29925050,0irq/32-eth0-rx-0-21swapper/311:15:163
29925050,0irq/32-eth0-rx-0-21swapper/308:39:583
29925050,0irq/32-eth0-rx-0-21swapper/307:14:513
29925050,0irq/32-eth0-rx-0-21swapper/306:29:593
26739955,0cyclictest0-21swapper/211:16:152
26739955,0cyclictest0-21swapper/210:30:502
26739955,0cyclictest0-21swapper/209:25:152
26739955,0cyclictest0-21swapper/209:19:062
26739955,0cyclictest0-21swapper/208:45:222
26739950,0cyclictest0-21swapper/210:48:202
26739950,0cyclictest0-21swapper/207:30:002
26739950,0cyclictest0-21swapper/206:45:332
26659954,0cyclictest17702-21ps08:24:561
259950,0migration/25192-21kthreadcore10:49:562
259950,0migration/225433-21sh11:00:022
259950,0migration/219055-21fschecks_time07:19:512
259950,0migration/213628-21netstat10:14:572
249950,0watchdog/228068-21proc_pri07:44:582
249950,0watchdog/223873-21if_eth010:04:542
179950,0migration/17943-21cpuspeed_turbos07:34:511
179950,0migration/13825-21fschecks_time09:14:511
179950,0migration/130617-21kthreadcore11:04:561
179950,0migration/124839-21cpuspeed_turbos06:34:491
179950,0migration/124836-21kthreadcore09:24:561
179950,0migration/118884-21munin-node10:39:531
179950,0migration/110078-21kthreadcore10:14:551
149950,0migration/09134-21aten_r1power_fr10:34:500
149950,0migration/05880-21sh10:10:250
149950,0migration/05441-21sh09:54:330
149950,0migration/032371-21sh08:33:190
149950,0migration/032323-21taskset08:11:050
149950,0migration/028874-21kthreadcore09:09:540
149950,0migration/027826-21mdstat07:44:560
149950,0migration/027488-21timerwakeupswit11:20:030
149950,0migration/026943-21kthreadcore10:04:560
149950,0migration/025923-21latency_hist10:44:380
149950,0migration/025660-21sh10:44:230
149950,0migration/025228-21fschecks_time10:24:520
149950,0migration/02274-21kthreadcore07:04:560
149950,0migration/019706-21munin-node09:04:540
149950,0migration/019657-21aten_r1power_en09:24:490
149950,0migration/018967-21fschecks_count08:04:520
149950,0migration/017938-21cpuspeed_turbos08:44:500
149950,0migration/017663-21timerwakeupswit08:00:020
149950,0migration/017538-21irqcore08:24:560
149950,0migration/017373-21aten_r1power_en06:29:520
149950,0migration/017229-21kthreadcore09:59:550
149950,0migration/016857-21kthreadcore09:19:570
149950,0migration/016335-21kthreadcore09:39:580
149950,0migration/015637-21fschecks_time07:39:530
149950,0migration/012799-21sh11:30:330
149950,0migration/012630-21kthreadcore07:34:570
149950,0migration/010590-21kthreadcore09:54:570
149950,0migration/010441-21sh09:35:010
149950,0migration/010279-21unixbench-2d11:10:020
29935040,0irq/33-eth0-tx-25517-21munin-node07:24:570
29935040,0irq/33-eth0-tx-20968-21munin-node11:19:502
29935040,0irq/33-eth0-tx-0-21swapper/210:39:382
29935040,0irq/33-eth0-tx-0-21swapper/210:34:512
29935040,0irq/33-eth0-tx-0-21swapper/210:19:452
29935040,0irq/33-eth0-tx-0-21swapper/210:09:582
29935040,0irq/33-eth0-tx-0-21swapper/209:39:382
29935040,0irq/33-eth0-tx-0-21swapper/209:19:502
29935040,0irq/33-eth0-tx-0-21swapper/209:04:582
29935040,0irq/33-eth0-tx-0-21swapper/008:14:520
29935040,0irq/33-eth0-tx-0-21swapper/007:11:570
29935040,0irq/33-eth0-tx-0-21swapper/006:39:520
29935040,0irq/33-eth0-tx-0-21swapper/006:34:510
26739943,0cyclictest6916-21awk09:54:542
26739943,0cyclictest5100-21awk07:09:552
26739943,0cyclictest3262-21irqbalance11:29:422
26739943,0cyclictest3262-21irqbalance09:50:022
26739943,0cyclictest3262-21irqbalance09:34:422
26739943,0cyclictest3262-21irqbalance08:59:522
26739943,0cyclictest3262-21irqbalance08:34:522
26739943,0cyclictest3262-21irqbalance08:19:422
26739943,0cyclictest3262-21irqbalance08:14:522
26739943,0cyclictest3262-21irqbalance07:54:422
26739943,0cyclictest3262-21irqbalance07:17:122
26739943,0cyclictest3262-21irqbalance07:04:422
26739943,0cyclictest3262-21irqbalance07:00:122
26739943,0cyclictest32606-21awk11:44:522
26739943,0cyclictest28653-21awk11:04:542
26739943,0cyclictest23871-21snmpd07:52:432
26739943,0cyclictest22880-21munin-node11:39:502
26659943,0cyclictest9914-21grep06:24:371
26659943,0cyclictest6966-21awk09:54:551
26659943,0cyclictest5121-21awk07:54:541
26659943,0cyclictest3599-21lldpd06:56:181
26659943,0cyclictest3262-21irqbalance08:31:221
26659943,0cyclictest3070-21awk08:54:561
26659943,0cyclictest25510-21awk10:24:541
26659943,0cyclictest23871-21snmpd10:46:131
26659943,0cyclictest23871-21snmpd09:59:431
26659943,0cyclictest23871-21snmpd09:36:131
26659943,0cyclictest23871-21snmpd09:20:281
26659943,0cyclictest23871-21snmpd08:53:281
26659943,0cyclictest23871-21snmpd08:14:431
26659943,0cyclictest23871-21snmpd07:21:131
26659943,0cyclictest23871-21snmpd07:09:431
26659943,0cyclictest23871-21snmpd06:40:431
26659943,0cyclictest22230-21awk09:44:531
26659943,0cyclictest17030-21awk10:19:531
26659943,0cyclictest13670-21awk09:39:551
26659943,0cyclictest12342-21awk07:59:531
26659943,0cyclictest11851-21awk10:54:531
26659943,0cyclictest11418-21awk08:59:551
26659940,0cyclictest0-21swapper/111:27:001
26649944,0cyclictest20500-21ps10:59:560
26649944,0cyclictest0-21swapper/006:44:570
26649943,0cyclictest9968-21sadc08:59:380
26649943,0cyclictest4006-21awk09:14:530
26649943,0cyclictest3599-21lldpd10:14:520
26649943,0cyclictest28679-21awk11:04:540
26649943,0cyclictest26998-21awk08:50:030
26649943,0cyclictest17559-21ps10:19:540
26649943,0cyclictest15541-21awk11:34:520
26649943,0cyclictest14919-21awk06:49:540
26649943,0cyclictest11369-21awk08:59:540
259940,0migration/24896-21kthreadcore06:39:562
259940,0migration/230439-21missed_timers10:24:582
259940,0migration/226293-21kthreadcore06:34:532
259940,0migration/226236-21fschecks_time07:24:522
259940,0migration/225652-21runrttasks08:09:472
259940,0migration/224066-21kthreadcore08:04:572
259940,0migration/223267-21kthreadcore06:54:562
259940,0migration/222461-21pmu-power08:25:002
259940,0migration/217413-21kthreadcore07:39:572
259940,0migration/215099-21fschecks_time09:59:522
259940,0migration/214354-21fschecks_count06:49:522
259940,0migration/211181-21kthreadcore07:34:562
259940,0migration/210957-21fschecks_time06:24:552
249940,0watchdog/26607-21tr08:54:582
249940,0watchdog/221349-21ssh09:44:502
249940,0watchdog/214793-21cpuspeed_turbos11:34:502
179940,0migration/18502-21fschecks_time08:19:551
179940,0migration/18310-21kthreadcore11:29:551
179940,0migration/17899-21runrttasks08:36:331
179940,0migration/17816-21kthreadcore11:09:551
179940,0migration/17114-21kthreadcore10:49:571
179940,0migration/16744-21aten_r1power_fr06:44:491
179940,0migration/13695-21kthreadcore07:29:571
179940,0migration/1337-21kthreadcore07:04:561
179940,0migration/130234-21kthreadcore09:30:021
179940,0migration/127208-21kthreadcore07:24:551
179940,0migration/126101-21kthreadcore11:39:541
179940,0migration/122684-21fschecks_time07:44:511
179940,0migration/121019-21aten_r1power_en11:19:491
179940,0migration/114432-21fschecks_count06:49:521
179940,0migration/112655-21irqrtprio07:14:561
179940,0migration/110994-21kthreadcore10:34:571
179940,0migration/110481-21df_abs06:24:541
169940,0watchdog/1797-21cut10:09:581
169940,0watchdog/15767-21cut10:30:021
169940,0watchdog/15354-21pmu-power11:44:581
169940,0watchdog/129119-21kthreadcore09:09:541
169940,0watchdog/12378-21kthreadcore09:49:581
169940,0watchdog/120803-21kthreadcore06:29:581
169940,0watchdog/117792-21cpu08:44:501
149940,0migration/030768-21kthreadcore09:30:030
149940,0migration/02044-21latency_hist10:49:370
149940,0migration/01152-21fschecks_count08:34:560
29935030,0irq/33-eth0-tx-0-21swapper/007:19:540
29935030,0irq/33-eth0-tx-0-21swapper/007:14:500
26739932,0cyclictest8596-21grep06:19:582
26659932,0cyclictest23871-21snmpd07:01:131
26659932,0cyclictest20140-21awk10:59:541
26659932,0cyclictest17565-21kthreadcore11:14:561
26659932,0cyclictest16361-21uname07:39:571
26659930,0cyclictest19525-21perl09:04:531
26649933,0cyclictest27811-21kworker/0:211:44:480
26649933,0cyclictest27811-21kworker/0:211:18:020
26649933,0cyclictest27811-21kworker/0:210:54:500
26649933,0cyclictest27811-21kworker/0:209:44:420
26649933,0cyclictest26489-21kworker/0:008:39:580
26649932,0cyclictest28318-21basename06:59:560
26649930,0cyclictest23967-21munin-node11:39:520
249930,0watchdog/20-21swapper/206:29:582
19130,0ktimersoftd/10-21swapper/108:39:531
179930,0migration/118426-21latency_hist08:04:381
169930,0watchdog/114791-21tr11:34:501
169930,0watchdog/10-21swapper/110:04:541
169930,0watchdog/10-21swapper/108:09:541
169930,0watchdog/10-21swapper/107:49:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional