You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 05:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Sun Dec 07, 2025 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1779023927,0sleep30-21swapper/318:14:273
1825223825,0sleep10-21swapper/118:15:571
1839723728,0sleep20-21swapper/218:17:382
1840823624,0sleep00-21swapper/018:17:440
329970,0watchdog/39497-21timerwakeupswit22:34:243
29925070,0irq/32-eth0-rx-32051-21kthreadcore22:49:183
29925070,0irq/32-eth0-rx-0-21swapper/323:24:333
29925070,0irq/32-eth0-rx-0-21swapper/323:13:383
29925070,0irq/32-eth0-rx-0-21swapper/321:54:263
29925070,0irq/32-eth0-rx-0-21swapper/320:52:203
29925070,0irq/32-eth0-rx-0-21swapper/320:29:163
8315060,0irq/26-0000:00:3233-17sedispatch22:23:592
339960,0migration/37368-21munin-node22:14:203
339960,0migration/330585-21sh21:51:143
339960,0migration/33045-21sh21:15:133
339960,0migration/318310-21munin-node22:24:153
339960,0migration/318291-21sh22:39:423
339960,0migration/311545-21sh22:54:503
329960,0watchdog/30-21swapper/323:33:523
329960,0watchdog/30-21swapper/323:05:283
329960,0watchdog/30-21swapper/322:04:123
329960,0watchdog/30-21swapper/321:09:243
329960,0watchdog/30-21swapper/318:28:293
29925060,0irq/32-eth0-rx-0-21swapper/323:46:073
29925060,0irq/32-eth0-rx-0-21swapper/323:40:113
29925060,0irq/32-eth0-rx-0-21swapper/322:59:183
29925060,0irq/32-eth0-rx-0-21swapper/322:46:143
29925060,0irq/32-eth0-rx-0-21swapper/322:22:283
29925060,0irq/32-eth0-rx-0-21swapper/321:59:303
29925060,0irq/32-eth0-rx-0-21swapper/321:46:553
29925060,0irq/32-eth0-rx-0-21swapper/321:41:493
29925060,0irq/32-eth0-rx-0-21swapper/321:29:193
29925060,0irq/32-eth0-rx-0-21swapper/321:26:193
29925060,0irq/32-eth0-rx-0-21swapper/320:39:053
29925060,0irq/32-eth0-rx-0-21swapper/320:27:503
29925060,0irq/32-eth0-rx-0-21swapper/320:19:523
185869965,0cyclictest18291-21unixbench_multi18:59:271
185869960,0cyclictest0-21swapper/122:02:011
185859965,0cyclictest6112-21processes23:29:230
169960,0watchdog/10-21swapper/121:06:361
149960,0migration/022990-21fschecks_count18:44:140
339950,0migration/34007-21munin-node20:59:183
339950,0migration/33787-21kthreadcore18:29:183
339950,0migration/327508-21kthreadcore22:09:183
339950,0migration/324805-21fschecks_count20:34:153
339950,0migration/324457-21munin-node20:14:183
339950,0migration/322811-21taskset19:29:093
339950,0migration/322123-21taskset18:42:143
339950,0migration/312777-21kthreadcore18:34:193
339950,0migration/311986-21kthreadcore23:34:213
339950,0migration/311554-21ksmtuned18:58:293
339950,0migration/310382-21taskset20:44:143
329950,0watchdog/38599-21cpu19:19:163
329950,0watchdog/34922-21cpuspeed_turbos21:19:163
329950,0watchdog/31787-21kthreadcore21:34:203
329950,0watchdog/313558-21cut21:04:163
329950,0watchdog/30-21swapper/320:04:203
29935050,0irq/33-eth0-tx-8329-21munin-node23:34:292
29935050,0irq/33-eth0-tx-6513-21munin-node23:14:182
29935050,0irq/33-eth0-tx-30756-21ssh20:19:160
29935050,0irq/33-eth0-tx-30550-21sed21:34:152
29935050,0irq/33-eth0-tx-301732sleep221:49:592
29935050,0irq/33-eth0-tx-30052-21diskmemload21:11:082
29935050,0irq/33-eth0-tx-25045-21munin-node22:09:152
29935050,0irq/33-eth0-tx-23711-21munin-node23:24:222
29935050,0irq/33-eth0-tx-0-21swapper/223:09:182
29935050,0irq/33-eth0-tx-0-21swapper/222:59:242
29935050,0irq/33-eth0-tx-0-21swapper/222:56:572
29935050,0irq/33-eth0-tx-0-21swapper/019:44:210
29935050,0irq/33-eth0-tx-0-21swapper/018:54:140
29935050,0irq/33-eth0-tx-0-21swapper/018:34:180
29925050,0irq/32-eth0-rx-27593-21fschecks_time20:54:143
29925050,0irq/32-eth0-rx-18301-21kthreadcore23:19:243
29925050,0irq/32-eth0-rx-0-21swapper/323:17:003
29925050,0irq/32-eth0-rx-0-21swapper/322:29:133
29925050,0irq/32-eth0-rx-0-21swapper/319:46:403
29925050,0irq/32-eth0-rx-0-21swapper/319:42:393
27150,0ktimersoftd/20-21swapper/220:24:532
259950,0migration/28472-21latency_hist20:03:592
259950,0migration/26610-21sh23:29:312
259950,0migration/25488-21fschecks_time21:19:172
259950,0migration/23728-21kthreadcore20:39:202
259950,0migration/227411-21runrttasks22:46:352
259950,0migration/227011-21kthreadcore18:44:192
259950,0migration/225261-21idleruntime20:34:162
259950,0migration/225009-21sh23:44:102
259950,0migration/219590-21sh22:43:372
259950,0migration/217163-21kthreadcore19:44:192
249950,0watchdog/231562-21kthreadcore19:09:202
249950,0watchdog/217026-21fschecks_count23:39:202
185879955,0cyclictest0-21swapper/221:40:052
185879955,0cyclictest0-21swapper/220:54:122
185879955,0cyclictest0-21swapper/219:39:282
185879950,0cyclictest0-21swapper/223:04:262
185879950,0cyclictest0-21swapper/222:34:472
185879950,0cyclictest0-21swapper/220:33:232
185869955,0cyclictest0-21swapper/123:29:211
185869950,0cyclictest0-21swapper/121:14:051
185869950,0cyclictest0-21swapper/120:36:531
185859955,0cyclictest0-21swapper/021:57:470
185859950,0cyclictest0-21swapper/021:48:570
179950,0migration/18662-21kthreadcore19:39:201
179950,0migration/16809-21kthreadcore18:54:191
179950,0migration/14127-21munin-node20:19:231
179950,0migration/13568-21kthreadcore18:29:181
179950,0migration/131213-21kthreadcore20:54:181
179950,0migration/129877-21latency_hist21:34:001
179950,0migration/128046-21kthreadcore19:09:191
179950,0migration/128020-21sendmail_mailst23:04:211
179950,0migration/127261-21taskset22:46:101
179950,0migration/125291-21kthreadcore21:49:191
179950,0migration/122934-21latency_hist20:14:001
179950,0migration/122791-21rt-features22:04:221
179950,0migration/120255-21kthreadcore19:24:201
179950,0migration/117070-21kthreadcore18:39:191
179950,0migration/116333-21kthreadcore21:24:191
179950,0migration/115600-21kthreadcore19:44:181
169950,0watchdog/128933-21munin-node20:14:201
169950,0watchdog/10-21swapper/119:22:041
149950,0migration/04128-21kthreadcore22:14:180
149950,0migration/032300-21kthreadcore21:34:200
149950,0migration/032198-21munin-node18:24:210
149950,0migration/027183-21kthreadcore19:29:190
149950,0migration/024120-21kthreadcore23:04:160
149950,0migration/021567-21kernelversion21:09:190
149950,0migration/014424-21kthreadcore20:04:200
149950,0migration/014112-21kthreadcore20:44:180
329940,0watchdog/30-21swapper/319:24:123
329940,0watchdog/30-21swapper/319:09:203
329940,0watchdog/30-21swapper/319:07:403
329940,0watchdog/30-21swapper/318:51:133
329940,0watchdog/30-21swapper/318:47:333
29935040,0irq/33-eth0-tx-9777-21df_abs20:44:132
29935040,0irq/33-eth0-tx-1143-21munin-node22:14:192
29935040,0irq/33-eth0-tx-0-21swapper/223:19:022
29935040,0irq/33-eth0-tx-0-21swapper/222:49:592
29935040,0irq/33-eth0-tx-0-21swapper/222:29:142
29935040,0irq/33-eth0-tx-0-21swapper/221:29:092
29935040,0irq/33-eth0-tx-0-21swapper/221:24:462
29935040,0irq/33-eth0-tx-0-21swapper/221:14:032
29935040,0irq/33-eth0-tx-0-21swapper/018:49:150
29925040,0irq/32-eth0-rx-0-21swapper/320:09:143
29925040,0irq/32-eth0-rx-0-21swapper/319:59:133
29925040,0irq/32-eth0-rx-0-21swapper/319:34:123
29925040,0irq/32-eth0-rx-0-21swapper/319:14:183
29925040,0irq/32-eth0-rx-0-21swapper/318:19:283
259940,0migration/25000-21kthreadcore21:54:182
259940,0migration/22874-21kthreadcore19:14:182
259940,0migration/223253-21forks19:29:142
259940,0migration/223168-21kthreadcore18:19:182
259940,0migration/222290-21kthreadcore19:04:192
259940,0migration/219898-21kthreadcore22:04:182
259940,0migration/218208-21runrttasks22:24:042
259940,0migration/217624-21kthreadcore21:44:202
259940,0migration/216074-21fschecks_count19:24:152
259940,0migration/213386-21kernelversion18:59:182
259940,0migration/211911-21fschecks_count21:04:122
249940,0watchdog/2986-21aten_r1power_vo18:29:132
249940,0watchdog/2625-21kthreadcore20:19:202
249940,0watchdog/227336-21perl19:54:162
249940,0watchdog/20-21swapper/220:59:202
185879944,0cyclictest0-21swapper/221:59:192
185879944,0cyclictest0-21swapper/220:49:092
185879943,0cyclictest9190-21awk18:34:172
185879943,0cyclictest541-21sadc18:29:002
185879943,0cyclictest4673-21sadc19:38:592
185879943,0cyclictest3599-21lldpd18:58:402
185879943,0cyclictest3599-21lldpd18:42:102
185879943,0cyclictest23871-21snmpd20:14:392
185879943,0cyclictest23871-21snmpd18:51:392
185869944,0cyclictest2546-21nvme19:36:491
185869943,0cyclictest9777-21awk20:04:181
185869943,0cyclictest9406-21awk23:34:181
185869943,0cyclictest503-21awk21:54:161
185869943,0cyclictest31338-21awk23:09:161
185869943,0cyclictest26134-21awk23:44:151
185869943,0cyclictest23871-21snmpd22:59:251
185869943,0cyclictest23871-21snmpd20:46:401
185869943,0cyclictest23871-21snmpd19:31:091
185869943,0cyclictest23871-21snmpd18:36:241
185869943,0cyclictest1633-21awk20:39:181
185859944,0cyclictest21443-21idleruntime-cro23:04:000
185859944,0cyclictest0-21swapper/023:41:120
185859944,0cyclictest0-21swapper/022:49:390
185859944,0cyclictest0-21swapper/022:27:530
185859944,0cyclictest0-21swapper/022:23:000
185859944,0cyclictest0-21swapper/022:01:050
185859943,0cyclictest3599-21lldpd22:39:530
185859943,0cyclictest3599-21lldpd21:24:320
185859943,0cyclictest3599-21lldpd19:24:100
185859943,0cyclictest31118-21awk19:34:160
185859943,0cyclictest28225-21sadc22:49:000
185859943,0cyclictest27889-21awk22:29:170
185859943,0cyclictest24199-21awk20:49:210
185859943,0cyclictest23871-21snmpd20:41:100
185859943,0cyclictest23871-21snmpd20:18:390
185859943,0cyclictest23871-21snmpd19:08:390
185859943,0cyclictest2292-21sort19:14:170
185859943,0cyclictest17647-21awk22:04:160
185859943,0cyclictest16920-21awk20:09:170
185859943,0cyclictest16367-21awk18:39:170
185859943,0cyclictest12500-21awk21:04:140
179940,0migration/17948-21unixbench_singl22:14:261
179940,0migration/16177-21latency_hist21:39:001
179940,0migration/13709-21latency21:34:211
179940,0migration/132567-21kthreadcore22:49:171
179940,0migration/132245-21kthreadcore22:29:201
179940,0migration/130798-21kthreadcore22:09:191
179940,0migration/130416-21kthreadcore19:54:211
179940,0migration/127349-21irqcore18:24:161
179940,0migration/121815-21taskset21:45:241
179940,0migration/120969-21kthreadcore22:24:221
179940,0migration/120289-21cpuspeed_turbos21:09:141
169940,0watchdog/17180-21kthreadcore19:59:201
169940,0watchdog/16386-21runrttasks23:20:161
169940,0watchdog/15037-21tr20:59:201
169940,0watchdog/119071-21cut23:39:241
169940,0watchdog/119049-21munin-node19:04:121
169940,0watchdog/10-21swapper/123:14:161
169940,0watchdog/10-21swapper/122:56:041
169940,0watchdog/10-21swapper/122:39:121
169940,0watchdog/10-21swapper/122:21:241
169940,0watchdog/10-21swapper/121:20:361
169940,0watchdog/10-21swapper/120:29:321
149940,0migration/09348-21kthreadcore20:24:180
149940,0migration/07889-21runrttasks18:33:520
149940,0migration/0782-21sh22:13:520
149940,0migration/06413-21aten_r1power_po21:39:120
149940,0migration/027462-21kthreadcore21:49:190
149940,0migration/023400-21sh20:32:350
149940,0migration/020935-21kthreadcore23:19:250
149940,0migration/01279-21runrttasks20:54:580
149940,0migration/010466-21kthreadcore23:34:200
329930,0watchdog/30-21swapper/318:59:133
29925030,0irq/32-eth0-rx-0-21swapper/319:54:173
249930,0watchdog/20-21swapper/219:19:162
185879932,0cyclictest0-21swapper/220:04:162
185879930,0cyclictest19795-21diskstats19:49:162
185879930,0cyclictest17070-21iostat_ios20:09:182
185869932,0cyclictest8079-21grep20:24:171
185869932,0cyclictest29722-21aten2.4-expect18:49:131
185869932,0cyclictest20454-21awk19:49:191
185869932,0cyclictest19269-21awk20:49:171
185859933,0cyclictest5534-21kworker/0:119:19:170
185859933,0cyclictest27810-21kworker/0:023:14:140
185859933,0cyclictest0-21swapper/020:01:350
185859932,0cyclictest6681-21kthreadcore22:54:180
185859932,0cyclictest5786-21awk21:19:190
185859932,0cyclictest3599-21lldpd19:54:400
185859932,0cyclictest29602-21awk21:14:170
185859932,0cyclictest25587-21cut20:34:180
185859932,0cyclictest24779-21awk23:24:170
185859932,0cyclictest23871-21snmpd19:09:170
185859932,0cyclictest19817-21grep19:49:170
185859930,0cyclictest6124-21iostat_ios19:39:190
185859930,0cyclictest0-21swapper/023:44:590
185859930,0cyclictest0-21swapper/021:29:190
185859930,0cyclictest0-21swapper/018:59:150
185859930,0cyclictest0-21swapper/018:19:130
169930,0watchdog/10-21swapper/123:24:161
169930,0watchdog/10-21swapper/122:34:001
169930,0watchdog/10-21swapper/119:17:521
169930,0watchdog/10-21swapper/118:46:291
169930,0watchdog/10-21swapper/118:19:011
329920,0watchdog/30-21swapper/319:49:003
185859921,0cyclictest2860-21sh20:59:010
185859920,0cyclictest0-21swapper/023:09:060
185859920,0cyclictest0-21swapper/022:34:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional