You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 23:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Thu Sep 17, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1331624839,0sleep30-21swapper/307:32:213
1328523726,0sleep20-21swapper/207:31:562
1319323425,0sleep10-21swapper/107:30:511
1332323127,0sleep00-21swapper/007:32:260
339970,0migration/318046-21sh12:36:413
35160,0ktimersoftd/30-21swapper/308:08:273
339960,0migration/325882-21munin-node11:23:193
339960,0migration/311789-21munin-node10:18:233
339960,0migration/310265-21sh12:48:283
29805060,0irq/28-eth0-rx-9577-21diskstats10:58:153
29805060,0irq/28-eth0-rx-8312-21munin-node12:28:263
29805060,0irq/28-eth0-rx-427-21perl12:08:133
29805060,0irq/28-eth0-rx-28409-21aten2.4-expect11:28:123
29805060,0irq/28-eth0-rx-21445-21perl12:58:143
29805060,0irq/28-eth0-rx-21408-21crond11:42:593
29805060,0irq/28-eth0-rx-18113-21memory10:03:193
27160,0ktimersoftd/20-21swapper/212:58:172
149960,0migration/01835-21fschecks_time09:38:120
134469966,0cyclictest0-21swapper/212:13:122
134469965,0cyclictest19016-21grep09:28:162
8305050,0irq/26-0000:00:3207-17auditd12:58:002
339950,0migration/39904-21kthreadcore08:58:173
339950,0migration/37783-21diskmemload10:54:513
339950,0migration/33514-21taskset09:58:093
339950,0migration/33353-21munin-node09:18:093
339950,0migration/33317-21timerandwakeup10:13:243
339950,0migration/329184-21kthreadcore09:53:153
339950,0migration/325753-21kthreadcore12:03:163
339950,0migration/322832-21if_eth111:43:153
339950,0migration/321400-21kthreadcore09:28:173
339950,0migration/321171-21fschecks_count10:08:123
339950,0migration/320915-21kthreadcore07:58:163
339950,0migration/320477-21taskset07:36:053
339950,0migration/319315-21fschecks_count12:38:143
339950,0migration/318332-21irqrtprio12:18:143
339950,0migration/316933-21kthreadcore09:03:183
339950,0migration/31690-21missed_timers08:28:173
339950,0migration/316274-21kthreadcore11:18:173
339950,0migration/314607-21taskset11:57:343
339950,0migration/311290-21kthreadcore08:13:153
339950,0migration/311290-21kthreadcore08:13:153
339950,0migration/31041-21runrttasks11:09:393
339950,0migration/310274-21latency_hist08:37:593
329950,0watchdog/332407-21sh12:24:153
329950,0watchdog/312682-21kthreadcore10:38:183
329950,0watchdog/30-21swapper/312:43:113
329950,0watchdog/30-21swapper/309:38:183
29815050,0irq/29-eth0-tx-3048-21munin-node08:33:120
29815050,0irq/29-eth0-tx-1715-21kthreadcore11:28:192
29815050,0irq/29-eth0-tx-0-21swapper/008:19:300
29805050,0irq/28-eth0-rx-6607-21cut11:33:173
29805050,0irq/28-eth0-rx-30853-21wc10:48:233
29805050,0irq/28-eth0-rx-29929-21cut08:48:163
29805050,0irq/28-eth0-rx-20726-21ssh10:23:283
29805050,0irq/28-eth0-rx-17453-21cat08:42:593
29805050,0irq/28-eth0-rx-15650-21kthreadcore12:53:173
29805050,0irq/28-eth0-rx-0-21swapper/312:15:173
29805050,0irq/28-eth0-rx-0-21swapper/311:48:003
29805050,0irq/28-eth0-rx-0-21swapper/311:13:483
29805050,0irq/28-eth0-rx-0-21swapper/310:28:043
29805050,0irq/28-eth0-rx-0-21swapper/309:43:103
29805050,0irq/28-eth0-rx-0-21swapper/309:36:073
29805050,0irq/28-eth0-rx-0-21swapper/307:48:163
25050250,0sleep025515-21perl08:48:110
249950,0watchdog/231072-21sh10:48:302
179950,0migration/16203-21kthreadcore11:13:181
179950,0migration/13289-21sh11:30:131
179950,0migration/123758-21munin-node08:43:251
179950,0migration/119485-21taskset12:55:281
179950,0migration/119485-21kthreadcore12:18:151
179950,0migration/110875-21diskmemload11:53:181
169950,0watchdog/19509-21ssh12:31:431
149950,0migration/09148-21fschecks_time12:13:140
149950,0migration/08326-21sh10:38:140
149950,0migration/06811-21latency_hist08:57:580
149950,0migration/05032-21kthreadcore10:53:180
149950,0migration/032353-21kthreadcore12:43:170
149950,0migration/03059-21kthreadcore08:08:160
149950,0migration/027034-21fschecks_time11:08:140
149950,0migration/027027-21kthreadcore08:03:140
149950,0migration/026526-21irqrtprio09:33:160
149950,0migration/026429-21munin-node12:23:140
149950,0migration/026204-21timerandwakeup11:23:230
149950,0migration/025354-21unixbench-2d12:38:260
149950,0migration/023923-21kthreadcore09:48:160
149950,0migration/022937-21irqcore11:43:160
149950,0migration/022913-21kthreadcore08:23:140
149950,0migration/022715-21kthreadcore07:38:150
149950,0migration/022279-21sh12:00:060
149950,0migration/02098-21kthreadcore11:48:170
149950,0migration/019100-21kthreadcore10:23:170
149950,0migration/01694-21kthreadcore11:28:190
149950,0migration/016767-21sh09:44:000
149950,0migration/015876-21aten_r1power_en10:43:100
149950,0migration/012899-21kthreadcore10:58:210
149950,0migration/012099-21aten_r1power_cu10:03:100
149950,0migration/010514-21latency_hist09:22:580
134469955,0cyclictest0-21swapper/210:33:242
134469955,0cyclictest0-21swapper/209:46:442
134469954,0cyclictest3524-21snmpd11:39:042
134469950,0cyclictest0-21swapper/212:42:222
134469950,0cyclictest0-21swapper/212:06:352
134469950,0cyclictest0-21swapper/210:47:542
134469950,0cyclictest0-21swapper/210:10:042
134469950,0cyclictest0-21swapper/209:52:062
134469950,0cyclictest0-21swapper/209:40:072
134459954,0cyclictest8249-21ps08:58:161
134449955,0cyclictest30958-21kworker/0:009:10:000
134449955,0cyclictest0-21swapper/007:43:150
134449950,0cyclictest0-21swapper/012:31:180
134449950,0cyclictest0-21swapper/012:10:190
134449950,0cyclictest0-21swapper/011:37:410
134449950,0cyclictest0-21swapper/010:48:390
134449950,0cyclictest0-21swapper/010:21:140
339940,0migration/35447-21load08:53:173
339940,0migration/322950-21sh10:44:393
329940,0watchdog/38024-21kthreadcore08:33:183
329940,0watchdog/331952-21kthreadcore09:13:183
329940,0watchdog/30-21swapper/311:58:423
329940,0watchdog/30-21swapper/308:23:143
329940,0watchdog/30-21swapper/308:03:143
329940,0watchdog/30-21swapper/307:38:143
29815040,0irq/29-eth0-tx-21919-21ssh10:26:552
29815040,0irq/29-eth0-tx-14031-21munin-node09:03:110
29815040,0irq/29-eth0-tx-0-21swapper/212:21:182
29815040,0irq/29-eth0-tx-0-21swapper/211:16:522
29815040,0irq/29-eth0-tx-0-21swapper/210:56:322
29815040,0irq/29-eth0-tx-0-21swapper/210:15:152
29815040,0irq/29-eth0-tx-0-21swapper/008:53:120
29815040,0irq/29-eth0-tx-0-21swapper/007:58:100
29815040,0irq/29-eth0-tx-0-21swapper/007:50:400
29805040,0irq/28-eth0-rx-0-21swapper/311:03:153
29805040,0irq/28-eth0-rx-0-21swapper/310:33:003
29805040,0irq/28-eth0-rx-0-21swapper/309:49:463
259940,0migration/27619-21kthreadcore10:18:172
259940,0migration/25360-21kthreadcore09:18:162
259940,0migration/231997-21aten_r1power_en08:53:092
259940,0migration/224387-21kthreadcore11:23:162
259940,0migration/218689-21timerwakeupswit10:03:252
259940,0migration/21505-21sh12:28:012
259940,0migration/214951-21latency_hist11:57:592
259940,0migration/211382-21munin-node12:33:152
249940,0watchdog/231493-21awk12:23:192
249940,0watchdog/220396-21cut08:43:182
249940,0watchdog/210546-21kthreadcore08:58:182
249940,0watchdog/20-21swapper/210:38:182
249940,0watchdog/20-21swapper/210:28:182
249940,0watchdog/20-21swapper/209:03:262
179940,0migration/16268-21kthreadcore08:33:171
179940,0migration/13903-21kthreadcore10:53:181
179940,0migration/131831-21latency_hist08:52:581
179940,0migration/130492-21kthreadcore07:43:171
179940,0migration/129534-21munin-node12:03:181
179940,0migration/128632-21taskset11:44:081
179940,0migration/128068-21kthreadcore11:08:181
179940,0migration/127638-21taskset10:09:051
179940,0migration/12585-21kthreadcore10:13:181
179940,0migration/125747-21munin-node12:23:111
179940,0migration/125551-21taskset11:06:351
179940,0migration/121846-21fschecks_count09:08:121
179940,0migration/121738-21taskset11:58:301
179940,0migration/121001-21runrttasks08:23:051
179940,0migration/120406-21sshd08:18:491
179940,0migration/117178-21irqcore10:43:151
179940,0migration/116734-21kthreadcore10:03:181
179940,0migration/11535-21kthreadcore08:53:151
179940,0migration/11278-21kthreadcore08:08:161
179940,0migration/110991-21taskset09:23:111
179940,0migration/110514-21runrttasks12:49:121
169940,0watchdog/127422-21aten_r1power_po12:43:111
169940,0watchdog/126579-21cut08:03:141
169940,0watchdog/123179-21cat07:58:181
169940,0watchdog/117797-21munin-node09:28:181
169940,0watchdog/111521-21ssh11:34:101
169940,0watchdog/11033-21ssh09:38:021
169940,0watchdog/10-21swapper/112:38:151
169940,0watchdog/10-21swapper/111:48:181
169940,0watchdog/10-21swapper/109:13:181
149940,0migration/025287-21kthreadcore12:58:190
149940,0migration/017444-21rt-features11:18:210
149940,0migration/016327-21kthreadcore11:38:170
149940,0migration/013758-21aten_r1power_po07:33:100
134469944,0cyclictest0-21swapper/211:12:592
134469944,0cyclictest0-21swapper/211:03:402
134469943,0cyclictest752-21awk12:08:152
134469943,0cyclictest3954-21awk07:48:132
134469943,0cyclictest3571-21lldpd12:43:362
134469943,0cyclictest3571-21lldpd11:18:052
134469943,0cyclictest3571-21lldpd09:58:032
134469943,0cyclictest3571-21lldpd09:23:322
134469943,0cyclictest3571-21lldpd08:49:012
134469943,0cyclictest3571-21lldpd08:33:012
134469943,0cyclictest3571-21lldpd08:23:002
134469943,0cyclictest3571-21lldpd08:19:302
134469943,0cyclictest3571-21lldpd08:14:002
134469943,0cyclictest3571-21lldpd08:14:002
134469943,0cyclictest3571-21lldpd08:06:592
134469943,0cyclictest3571-21lldpd07:37:592
134469943,0cyclictest3524-21snmpd11:56:492
134469943,0cyclictest3524-21snmpd11:49:042
134469943,0cyclictest3524-21snmpd11:43:192
134469943,0cyclictest3524-21snmpd09:15:182
134469943,0cyclictest3524-21snmpd08:30:172
134469943,0cyclictest3524-21snmpd07:58:172
134469943,0cyclictest3524-21snmpd07:43:172
134469943,0cyclictest3250-21irqbalance11:35:262
134469943,0cyclictest26060-21awk09:33:142
134469943,0cyclictest22313-21awk09:08:142
134469940,0cyclictest0-21swapper/210:58:162
134459943,0cyclictest9412-21awk12:13:161
134459943,0cyclictest4378-21awk09:18:131
134459943,0cyclictest3571-21lldpd11:38:341
134459943,0cyclictest3571-21lldpd10:58:041
134459943,0cyclictest3571-21lldpd09:52:021
134459943,0cyclictest3571-21lldpd07:49:291
134459943,0cyclictest3571-21lldpd07:35:291
134459943,0cyclictest3524-21snmpd07:41:171
134459943,0cyclictest32468-21df12:08:121
134459943,0cyclictest21812-21awk12:58:161
134459943,0cyclictest20820-21awk11:23:131
134459943,0cyclictest15110-21awk10:23:141
134459943,0cyclictest13715-21sadc10:22:591
134449944,0cyclictest30958-21kworker/0:010:11:060
134449944,0cyclictest0-21swapper/012:21:120
134449944,0cyclictest0-21swapper/007:53:110
134449943,0cyclictest7685-21awk08:13:120
134449943,0cyclictest7685-21awk08:13:120
134449943,0cyclictest3524-21snmpd09:32:480
134449943,0cyclictest30958-21kworker/0:012:54:090
134449943,0cyclictest30302-21awk10:13:140
134449943,0cyclictest11514-21awk08:38:150
329930,0watchdog/30-21swapper/309:23:103
329930,0watchdog/30-21swapper/309:08:143
329930,0watchdog/30-21swapper/307:53:143
329930,0watchdog/30-21swapper/307:43:183
29805030,0irq/28-eth0-rx-0-21swapper/308:18:093
259930,0migration/25246-21missed_timers08:08:182
249930,0watchdog/216900-21runrttasks08:38:342
179930,0migration/128978-21kthreadcore09:33:171
179930,0migration/122672-21runrttasks10:28:111
169930,0watchdog/10-21swapper/110:33:181
169930,0watchdog/10-21swapper/109:58:101
169930,0watchdog/10-21swapper/109:53:181
169930,0watchdog/10-21swapper/109:03:261
169930,0watchdog/10-21swapper/107:53:101
134469932,0cyclictest3524-21snmpd07:53:022
134469932,0cyclictest28294-21awk09:53:132
134469931,0cyclictest0-21swapper/212:48:122
134469930,0cyclictest0-21swapper/207:35:562
134459933,0cyclictest3571-21lldpd09:43:021
134459933,0cyclictest3571-21lldpd08:38:001
134459932,0cyclictest7316-21munin-node10:38:131
134459932,0cyclictest3571-21lldpd08:14:301
134459932,0cyclictest3571-21lldpd08:14:301
134459932,0cyclictest3524-21snmpd08:28:471
134459932,0cyclictest24864-21grep10:48:121
134459932,0cyclictest15280-21cut11:18:171
134459930,0cyclictest0-21swapper/112:33:181
134449933,0cyclictest30958-21kworker/0:012:48:110
134449933,0cyclictest30958-21kworker/0:012:33:050
134449933,0cyclictest30958-21kworker/0:012:03:010
134449933,0cyclictest30958-21kworker/0:011:53:030
134449933,0cyclictest30958-21kworker/0:010:33:080
134449933,0cyclictest30958-21kworker/0:010:28:060
134449933,0cyclictest30958-21kworker/0:009:58:000
134449933,0cyclictest30958-21kworker/0:009:53:100
134449933,0cyclictest30958-21kworker/0:009:18:120
134449933,0cyclictest30958-21kworker/0:009:13:040
134449933,0cyclictest21973-21kworker/0:108:43:020
134449933,0cyclictest21973-21kworker/0:108:28:100
134449932,0cyclictest3524-21snmpd11:13:040
134449932,0cyclictest18932-21awk11:03:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional