You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-15 - 17:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Mon Sep 15, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2310627170,0sleep00-21swapper/006:21:460
2307223826,0sleep20-21swapper/206:21:202
2296923726,0sleep30-21swapper/306:20:093
2326323626,0sleep10-21swapper/106:23:351
35170,0ktimersoftd/317581-21fschecks_count09:54:123
329970,0watchdog/325946-21ssh10:17:593
329970,0watchdog/313528-21tune2fs06:39:163
329970,0watchdog/30-21swapper/308:35:363
29925070,0irq/32-eth0-rx-5244-21taskset08:47:513
29925070,0irq/32-eth0-rx-0-21swapper/310:03:303
29925070,0irq/32-eth0-rx-0-21swapper/307:09:183
233709976,0cyclictest2944-21fschecks_time06:54:132
8315060,0irq/26-0000:00:7019-21if_eth1.307:19:142
8315060,0irq/26-0000:00:16327-21munin-plugin-st07:03:592
339960,0migration/321988-21kthreadcore06:44:193
339960,0migration/321846-21munin-node07:29:203
329960,0watchdog/3299250irq/32-eth0-rx-11:09:193
329960,0watchdog/3299250irq/32-eth0-rx-10:40:553
329960,0watchdog/30-21swapper/311:42:233
329960,0watchdog/30-21swapper/311:36:033
329960,0watchdog/30-21swapper/311:26:473
329960,0watchdog/30-21swapper/311:04:153
329960,0watchdog/30-21swapper/310:44:193
329960,0watchdog/30-21swapper/310:36:113
329960,0watchdog/30-21swapper/310:07:193
329960,0watchdog/30-21swapper/309:44:353
329960,0watchdog/30-21swapper/309:28:433
329960,0watchdog/30-21swapper/309:21:593
329960,0watchdog/30-21swapper/309:14:153
329960,0watchdog/30-21swapper/309:04:513
329960,0watchdog/30-21swapper/309:00:193
329960,0watchdog/30-21swapper/308:57:113
329960,0watchdog/30-21swapper/308:43:033
329960,0watchdog/30-21swapper/308:27:283
329960,0watchdog/30-21swapper/308:09:203
329960,0watchdog/30-21swapper/307:55:403
29925060,0irq/32-eth0-rx-0-21swapper/311:44:143
29925060,0irq/32-eth0-rx-0-21swapper/311:30:393
29925060,0irq/32-eth0-rx-0-21swapper/311:02:183
29925060,0irq/32-eth0-rx-0-21swapper/310:57:503
29925060,0irq/32-eth0-rx-0-21swapper/310:50:083
29925060,0irq/32-eth0-rx-0-21swapper/310:28:523
29925060,0irq/32-eth0-rx-0-21swapper/309:40:283
29925060,0irq/32-eth0-rx-0-21swapper/309:29:213
29925060,0irq/32-eth0-rx-0-21swapper/308:50:183
233689966,0cyclictest0-21swapper/008:56:560
233689960,0cyclictest0-21swapper/011:49:150
233689960,0cyclictest0-21swapper/010:34:220
149960,0migration/04538-21kthreadcore06:54:160
8315050,0irq/26-0000:00:31444-21munin-run11:23:582
4150,0ktimersoftd/00-21swapper/007:04:150
339950,0migration/38680-21kthreadcore06:34:173
339950,0migration/332457-21kthreadcore06:49:193
339950,0migration/327532-21timerwakeupswit08:19:273
339950,0migration/316608-21kthreadcore08:14:173
329950,0watchdog/3299250irq/32-eth0-rx-11:14:433
329950,0watchdog/32026-21kthreadcore07:14:203
329950,0watchdog/316563-21hostname07:04:123
329950,0watchdog/30-21swapper/311:49:033
329950,0watchdog/30-21swapper/310:09:033
329950,0watchdog/30-21swapper/309:49:513
329950,0watchdog/30-21swapper/309:34:113
329950,0watchdog/30-21swapper/309:10:553
329950,0watchdog/30-21swapper/308:30:243
329950,0watchdog/30-21swapper/308:04:283
329950,0watchdog/30-21swapper/307:59:003
329950,0watchdog/30-21swapper/307:53:323
329950,0watchdog/30-21swapper/307:44:163
329950,0watchdog/30-21swapper/307:39:403
329950,0watchdog/30-21swapper/307:34:123
329950,0watchdog/30-21swapper/307:24:283
329950,0watchdog/30-21swapper/307:19:323
329950,0watchdog/30-21swapper/306:59:003
329950,0watchdog/30-21swapper/306:31:043
29935050,0irq/33-eth0-tx-8849-21munin-node09:49:202
29935050,0irq/33-eth0-tx-6780-21munin-node08:09:260
29935050,0irq/33-eth0-tx-30443-21ssh09:02:272
29935050,0irq/33-eth0-tx-29840-21munin-node08:44:122
29935050,0irq/33-eth0-tx-12886-21munin-node08:34:132
29935050,0irq/33-eth0-tx-0-21swapper/007:59:210
29935050,0irq/33-eth0-tx-0-21swapper/007:34:270
29935050,0irq/33-eth0-tx-0-21swapper/007:29:140
29935050,0irq/33-eth0-tx-0-21swapper/007:16:430
29935050,0irq/33-eth0-tx-0-21swapper/006:29:110
29925050,0irq/32-eth0-rx-0-21swapper/311:19:103
29925050,0irq/32-eth0-rx-0-21swapper/310:29:193
29925050,0irq/32-eth0-rx-0-21swapper/310:19:563
29925050,0irq/32-eth0-rx-0-21swapper/306:54:163
29925050,0irq/32-eth0-rx-0-21swapper/306:25:303
259950,0migration/219524-21kthreadcore11:34:192
249950,0watchdog/213055-21load09:09:192
249950,0watchdog/20-21swapper/206:39:202
233709955,0cyclictest0-21swapper/211:15:182
233709955,0cyclictest0-21swapper/210:16:482
233709955,0cyclictest0-21swapper/209:04:362
233709954,0cyclictest19020-21cut07:04:182
233709950,0cyclictest0-21swapper/210:02:462
233709950,0cyclictest0-21swapper/209:54:252
233699955,0cyclictest0-21swapper/110:54:121
233699955,0cyclictest0-21swapper/109:49:521
233699955,0cyclictest0-21swapper/108:54:231
233699950,0cyclictest0-21swapper/111:24:091
233699950,0cyclictest0-21swapper/110:06:071
233689955,0cyclictest0-21swapper/011:09:120
233689955,0cyclictest0-21swapper/010:56:070
233689955,0cyclictest0-21swapper/009:13:480
233689954,0cyclictest0-21swapper/008:28:520
233689950,0cyclictest0-21swapper/011:35:420
179950,0migration/1551-21kthreadcore08:44:171
179950,0migration/129111-21kthreadcore10:19:161
179950,0migration/128916-21aten_r1power_vo10:59:121
179950,0migration/126913-21kthreadcore09:39:191
179950,0migration/125570-21aten_r1power_vo09:59:141
179950,0migration/125438-21kthreadcore07:09:191
179950,0migration/122956-21aten2.4-expect08:59:111
179950,0migration/122410-21kthreadcore10:34:181
179950,0migration/121249-21kthreadcore07:54:181
179950,0migration/118942-21taskset10:33:411
179950,0migration/116829-21munin-node07:49:281
179950,0migration/115818-21latency_hist11:33:581
179950,0migration/115498-21kthreadcore06:39:201
169950,0watchdog/10-21swapper/106:54:121
149950,0migration/09241-21kthreadcore06:34:170
149950,0migration/08770-21proc_pri10:24:340
149950,0migration/0805-21kthreadcore09:04:160
149950,0migration/0773-21sh10:03:090
149950,0migration/07701-21sh11:46:400
149950,0migration/0605-21irqcore11:24:180
149950,0migration/05777-21kthreadcore07:44:170
149950,0migration/02968-21unixbench_multi10:59:260
149950,0migration/027312-21aten_r1power_fr06:49:120
149950,0migration/026616-21kthreadcore09:19:210
149950,0migration/024566-21fschecks_time07:09:160
149950,0migration/021933-21sh11:15:430
149950,0migration/021073-21idleruntime06:44:160
149950,0migration/019751-21taskset08:34:530
149950,0migration/019474-21irqcore10:14:180
149950,0migration/019183-21kthreadcore09:54:160
149950,0migration/018894-21latency07:24:180
149950,0migration/017703-21cpuspeed_turbos07:54:130
149950,0migration/015899-21fschecks_count09:14:150
149950,0migration/014334-21kthreadcore06:59:150
149950,0migration/014154-21kthreadcore09:49:180
149950,0migration/013691-21fschecks_time06:39:160
149950,0migration/012251-21irqcore10:29:170
149950,0migration/011370-21taskset10:47:420
29935040,0irq/33-eth0-tx-24469-21telnet11:39:132
29935040,0irq/33-eth0-tx-21417-21munin-node08:39:212
29935040,0irq/33-eth0-tx-14883-21ssh09:30:132
29935040,0irq/33-eth0-tx-0-21swapper/211:24:012
29935040,0irq/33-eth0-tx-0-21swapper/210:54:312
29935040,0irq/33-eth0-tx-0-21swapper/210:44:042
29935040,0irq/33-eth0-tx-0-21swapper/210:39:032
29935040,0irq/33-eth0-tx-0-21swapper/210:32:312
29935040,0irq/33-eth0-tx-0-21swapper/210:24:002
29935040,0irq/33-eth0-tx-0-21swapper/209:26:432
29935040,0irq/33-eth0-tx-0-21swapper/209:19:172
29935040,0irq/33-eth0-tx-0-21swapper/209:14:412
29935040,0irq/33-eth0-tx-0-21swapper/208:29:172
259940,0migration/29458-21kthreadcore06:34:172
259940,0migration/230865-21latency_hist07:13:592
259940,0migration/230507-21ksmtuned06:28:462
259940,0migration/225195-21fschecks_count09:39:152
259940,0migration/224462-21kthreadcore08:19:192
259940,0migration/222984-21kthreadcore07:54:192
259940,0migration/22044-21kthreadcore10:59:192
259940,0migration/214654-21irqcore11:09:182
259940,0migration/212037-21kthreadcore11:49:192
259940,0migration/212030-21munin-node08:49:202
249940,0watchdog/222374-21kthreadcore07:29:202
249940,0watchdog/218060-21kthreadcore08:54:192
249940,0watchdog/213272-21cpuspeed_turbos07:24:122
249940,0watchdog/212456-21diskstats10:49:112
249940,0watchdog/20-21swapper/210:09:192
249940,0watchdog/20-21swapper/209:34:192
233709944,0cyclictest0-21swapper/211:29:102
233709944,0cyclictest0-21swapper/210:34:472
233709943,0cyclictest5932-21awk11:04:162
233709943,0cyclictest3599-21lldpd11:44:122
233709943,0cyclictest3599-21lldpd08:14:142
233709943,0cyclictest3262-21irqbalance10:19:132
233709943,0cyclictest3262-21irqbalance09:44:032
233709943,0cyclictest3262-21irqbalance08:24:132
233709943,0cyclictest3262-21irqbalance08:09:032
233709943,0cyclictest3262-21irqbalance08:04:532
233709943,0cyclictest3262-21irqbalance07:39:042
233709943,0cyclictest3262-21irqbalance07:34:042
233709943,0cyclictest31873-21awk06:29:152
233709943,0cyclictest2545-21awk10:04:132
233709943,0cyclictest11418-21awk07:49:162
233709940,0cyclictest0-21swapper/206:50:162
233699944,0cyclictest0-21swapper/108:50:551
233699943,0cyclictest9915-21awk11:49:171
233699943,0cyclictest9045-21awk09:29:171
233699943,0cyclictest477-21awk09:24:161
233699943,0cyclictest4072-21awk07:44:151
233699943,0cyclictest3599-21lldpd11:18:461
233699943,0cyclictest3599-21lldpd10:28:551
233699943,0cyclictest3599-21lldpd06:59:561
233699943,0cyclictest32271-21awk09:04:141
233699943,0cyclictest25759-21awk07:59:161
233699943,0cyclictest25487-21awk11:39:171
233699943,0cyclictest23871-21snmpd11:05:371
233699943,0cyclictest23871-21snmpd07:41:511
233699943,0cyclictest21158-21awk06:44:171
233699943,0cyclictest17637-21awk07:04:161
233699943,0cyclictest17169-21awk11:34:171
233699943,0cyclictest1529-21awk09:44:151
233699943,0cyclictest15118-21awk08:14:161
233689944,0cyclictest0-21swapper/006:24:190
233689943,0cyclictest8737-21grep11:29:140
233689943,0cyclictest3599-21lldpd07:19:390
233689943,0cyclictest30924-21awk08:44:150
233689943,0cyclictest23871-21snmpd08:41:360
233689943,0cyclictest23871-21snmpd08:07:360
233689943,0cyclictest21246-21kworker/0:209:00:460
233689943,0cyclictest17277-21awk09:34:220
233689943,0cyclictest17228-21sadc07:53:590
233689940,0cyclictest0-21swapper/008:19:240
179940,0migration/18948-21kthreadcore09:09:181
179940,0migration/17671-21kthreadcore10:44:181
179940,0migration/132630-21kthreadcore07:34:191
179940,0migration/132571-21aten_r1power_fr11:44:101
179940,0migration/12797-21taskset08:25:011
179940,0migration/12682-21kthreadcore07:14:201
179940,0migration/121796-21fschecks_count08:19:151
179940,0migration/120446-21kthreadcore09:54:171
179940,0migration/114993-21kthreadcore08:34:181
179940,0migration/110816-21kthreadcore07:19:171
169940,0watchdog/12326-21ssh10:40:551
169940,0watchdog/122376-21kthreadcore07:29:201
169940,0watchdog/10-21swapper/110:09:231
169940,0watchdog/10-21swapper/109:14:191
149940,0migration/06344-21df_abs08:49:130
149940,0migration/04710-21kthreadcore10:04:140
149940,0migration/013306-21kthreadcore10:09:190
259930,0migration/223826-21aten_r1power_fr07:09:132
233709932,0cyclictest3262-21irqbalance07:44:042
233709932,0cyclictest24946-21grep07:59:132
233709932,0cyclictest21103-21awk06:44:172
233699933,0cyclictest505-21awk08:04:161
233699932,0cyclictest22578-21awk08:39:171
233699932,0cyclictest19306-21awk10:14:181
233699932,0cyclictest18317-21sensors_temp10:49:211
233699932,0cyclictest17446-21cut11:09:191
233699930,0cyclictest31622-21perl06:29:131
233699930,0cyclictest27659-21diskstats06:49:141
233689933,0cyclictest24330-21awk11:19:110
233689933,0cyclictest21246-21kworker/0:211:39:150
233689933,0cyclictest21246-21kworker/0:211:04:150
233689933,0cyclictest21246-21kworker/0:210:49:070
233689933,0cyclictest21246-21kworker/0:210:38:590
233689933,0cyclictest21246-21kworker/0:209:39:100
233689933,0cyclictest21246-21kworker/0:209:29:040
233689933,0cyclictest21246-21kworker/0:209:24:020
233689933,0cyclictest21246-21kworker/0:208:29:120
233689933,0cyclictest21246-21kworker/0:208:14:000
233689933,0cyclictest21246-21kworker/0:207:39:380
233689932,0cyclictest27757-21irqcore10:19:150
233689932,0cyclictest1634-21awk09:44:160
179930,0migration/124424-21fschecks_time09:19:171
179930,0migration/123395-21aten_r1power_vo11:19:071
169930,0watchdog/10-21swapper/109:34:191
169930,0watchdog/10-21swapper/108:29:001
169930,0watchdog/10-21swapper/108:09:161
169930,0watchdog/10-21swapper/107:24:121
169930,0watchdog/10-21swapper/106:24:001
233699920,0cyclictest5573-21cat06:33:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional