You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-01 - 15:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Wed Apr 01, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1280523726,0sleep20-21swapper/207:14:382
624923627,0sleep10-21swapper/107:14:131
1307423524,0sleep00-21swapper/007:17:440
1305123228,0sleep30-21swapper/307:17:273
329970,0watchdog/30-21swapper/311:28:423
339960,0migration/3437-21sh09:23:373
339960,0migration/34124-21munin-node09:59:293
339960,0migration/330687-21sh12:44:453
339960,0migration/330435-21unixbench_singl10:14:333
339960,0migration/328396-21sh09:55:063
339960,0migration/326457-21sh09:36:573
339960,0migration/325552-21sh10:33:473
339960,0migration/31889-21sh11:53:543
339960,0migration/317537-21aten_r1power_po11:44:203
339960,0migration/317537-21aten_r1power_po11:44:203
339960,0migration/316146-21munin-node10:09:223
339960,0migration/314312-21sh10:07:403
339960,0migration/313616-21munin-node11:04:213
329960,0watchdog/321010-21irqrtprio12:04:263
29815060,0irq/29-eth0-tx-10188-21munin-node08:24:280
29815060,0irq/29-eth0-tx-0-21swapper/210:14:112
29805060,0irq/28-eth0-rx-17312-21python11:59:323
29805060,0irq/28-eth0-rx-0-21swapper/311:34:043
149960,0migration/023097-21sh11:27:470
149960,0migration/020816-21sh12:22:170
132599960,0cyclictest0-21swapper/212:35:282
132599960,0cyclictest0-21swapper/209:37:472
132599960,0cyclictest0-21swapper/208:24:102
132589960,0cyclictest0-21swapper/109:19:311
132579960,0cyclictest0-21swapper/010:39:070
132579960,0cyclictest0-21swapper/009:39:320
4150,0ktimersoftd/00-21swapper/009:24:240
339950,0migration/39651-21kthreadcore11:19:243
339950,0migration/38278-21kthreadcore07:59:233
339950,0migration/37802-21kthreadcore09:04:263
339950,0migration/37337-21kthreadcore08:19:243
339950,0migration/36280-21kthreadcore11:54:273
339950,0migration/36209-21kthreadcore12:14:253
339950,0migration/35098-21gltestperf09:44:213
339950,0migration/332272-21smart_nvme0n110:34:323
339950,0migration/331521-21kthreadcore08:59:243
339950,0migration/330216-21kthreadcore07:29:243
339950,0migration/329102-21irqrtprio09:39:243
339950,0migration/327988-21smart_nvme0n111:09:303
339950,0migration/322771-21kthreadcore08:54:243
339950,0migration/321901-21kthreadcore08:29:253
339950,0migration/321393-21fschecks_time07:24:203
339950,0migration/320775-21taskset08:53:473
339950,0migration/319919-21munin-node10:49:203
339950,0migration/316848-21taskset07:43:213
339950,0migration/316012-21kthreadcore07:19:253
339950,0migration/314342-21fschecks_time08:04:203
339950,0migration/311540-21kthreadcore10:24:233
329950,0watchdog/332731-21hddtemp_smartct08:39:223
329950,0watchdog/33254-21cut12:29:263
329950,0watchdog/314079-21grep08:24:263
329950,0watchdog/310747-21sensors10:59:303
329950,0watchdog/30-21swapper/311:14:223
29815050,0irq/29-eth0-tx-8232-21ssh11:38:232
29815050,0irq/29-eth0-tx-6495-21munin-node10:04:332
29815050,0irq/29-eth0-tx-571-21ssh11:50:222
29815050,0irq/29-eth0-tx-28270-21ssh09:54:442
29815050,0irq/29-eth0-tx-24564-21munin-node08:34:280
29815050,0irq/29-eth0-tx-23934-21munin-node12:44:222
29815050,0irq/29-eth0-tx-11254-21ssh09:45:242
29815050,0irq/29-eth0-tx-10887-21munin-node10:44:212
29815050,0irq/29-eth0-tx-0-21swapper/211:20:262
29815050,0irq/29-eth0-tx-0-21swapper/211:12:462
29815050,0irq/29-eth0-tx-0-21swapper/008:55:550
29805050,0irq/28-eth0-rx-9500-21ssh10:41:023
29805050,0irq/28-eth0-rx-4054-21ssh12:13:363
29805050,0irq/28-eth0-rx-29587-21sshd12:27:413
29805050,0irq/28-eth0-rx-11927-21munin-node10:44:233
29805050,0irq/28-eth0-rx-0-21swapper/312:42:553
29805050,0irq/28-eth0-rx-0-21swapper/312:34:223
29805050,0irq/28-eth0-rx-0-21swapper/312:20:373
29805050,0irq/28-eth0-rx-0-21swapper/311:43:203
29805050,0irq/28-eth0-rx-0-21swapper/311:34:263
29805050,0irq/28-eth0-rx-0-21swapper/310:54:213
29805050,0irq/28-eth0-rx-0-21swapper/309:29:133
29805050,0irq/28-eth0-rx-0-21swapper/307:46:443
27150,0ktimersoftd/20-21swapper/211:57:092
259950,0migration/224774-21sh10:31:342
249950,0watchdog/225316-21kthreadcore12:24:262
179950,0migration/17433-21kthreadcore10:59:261
179950,0migration/124938-21munin-node11:29:241
179950,0migration/118244-21fschecks_time09:14:201
179950,0migration/117129-21pmu-power11:59:291
179950,0migration/111085-21munin-node09:29:231
169950,0watchdog/14190-21kthreadcore11:34:261
169950,0watchdog/123961-21kthreadcore09:54:261
169950,0watchdog/122401-21ssh10:11:061
169950,0watchdog/10-21swapper/112:24:261
149950,0migration/0988-21kthreadcore08:59:250
149950,0migration/09368-21timerwakeupswit08:19:310
149950,0migration/08916-21timerwakeupswit11:54:340
149950,0migration/08630-21latency_hist10:24:070
149950,0migration/07394-21kthreadcore09:44:240
149950,0migration/07097-21fschecks_count10:04:210
149950,0migration/032529-21kthreadcore07:29:250
149950,0migration/032420-21kthreadcore08:14:260
149950,0migration/031632-21munin-node12:29:250
149950,0migration/030365-21munin-node07:49:260
149950,0migration/02853-21sh12:10:260
149950,0migration/027889-21kthreadcore10:34:260
149950,0migration/026511-21kthreadcore12:44:240
149950,0migration/023613-21switchtime08:29:320
149950,0migration/022236-21kernelversion07:24:230
149950,0migration/020598-21kthreadcore09:14:240
149950,0migration/020083-21taskset11:05:260
149950,0migration/017636-21kthreadcore08:49:230
149950,0migration/017558-21aten_r1power_vo10:29:220
149950,0migration/017316-21taskset09:14:020
149950,0migration/016532-21taskset07:39:430
149950,0migration/014717-21kthreadcore11:59:260
149950,0migration/010338-21kthreadcore12:14:260
132599955,0cyclictest0-21swapper/212:15:552
132599955,0cyclictest0-21swapper/207:29:082
132599950,0cyclictest0-21swapper/212:41:282
132599950,0cyclictest0-21swapper/212:11:302
132599950,0cyclictest0-21swapper/212:03:372
132599950,0cyclictest0-21swapper/211:17:452
132599950,0cyclictest0-21swapper/211:02:272
132589955,0cyclictest23037-21irqcore11:09:241
132589954,0cyclictest25367-21sort10:14:251
132579954,0cyclictest31218-21ssh10:16:350
35140,0ktimersoftd/320925-21kworker/u8:210:19:353
339940,0migration/33792-21kthreadcore09:24:243
329940,0watchdog/33552-21lldpd09:09:103
329940,0watchdog/331769-21kthreadcore08:14:263
329940,0watchdog/328625-21cut08:34:263
29815040,0irq/29-eth0-tx-8710-21munin-node10:24:232
29815040,0irq/29-eth0-tx-30436-21ssh12:29:192
29815040,0irq/29-eth0-tx-17406-21ssh11:44:142
29815040,0irq/29-eth0-tx-17406-21ssh11:44:142
29815040,0irq/29-eth0-tx-0-21swapper/212:19:222
29815040,0irq/29-eth0-tx-0-21swapper/211:39:242
29815040,0irq/29-eth0-tx-0-21swapper/211:24:092
29815040,0irq/29-eth0-tx-0-21swapper/210:34:162
29815040,0irq/29-eth0-tx-0-21swapper/209:49:552
29815040,0irq/29-eth0-tx-0-21swapper/009:19:200
29815040,0irq/29-eth0-tx-0-21swapper/008:09:180
29815040,0irq/29-eth0-tx-0-21swapper/008:05:450
29805040,0irq/28-eth0-rx-0-21swapper/309:49:113
29805040,0irq/28-eth0-rx-0-21swapper/309:14:193
29805040,0irq/28-eth0-rx-0-21swapper/308:09:193
259940,0migration/23466-21fschecks_time07:34:202
259940,0migration/229045-21kthreadcore09:19:252
259940,0migration/226374-21kthreadcore08:54:252
259940,0migration/224487-21latency_hist08:34:062
259940,0migration/22382-21kthreadcore08:39:252
259940,0migration/221422-21kthreadcore12:04:272
259940,0migration/218196-21kthreadcore07:19:262
259940,0migration/21803-21kthreadcore09:59:262
259940,0migration/215333-21irqrtprio08:49:222
259940,0migration/211040-21munin-node07:39:232
249940,0watchdog/25462-21kthreadcore10:19:262
249940,0watchdog/230343-21ntp_states07:49:252
249940,0watchdog/223581-21python08:29:302
249940,0watchdog/213650-21munin-node08:04:212
249940,0watchdog/20-21swapper/211:04:262
249940,0watchdog/20-21swapper/207:24:212
19140,0ktimersoftd/10-21swapper/110:34:331
179940,0migration/17379-21gltestperf07:59:201
179940,0migration/17127-21kthreadcore07:34:251
179940,0migration/1627-21kthreadcore09:59:251
179940,0migration/15328-21kthreadcore10:39:241
179940,0migration/13900-21gltestperf08:19:201
179940,0migration/132763-21kthreadcore12:29:261
179940,0migration/132036-21kthreadcore12:09:241
179940,0migration/130721-21kthreadcore08:14:251
179940,0migration/128006-21munin-node07:29:191
179940,0migration/127799-21kthreadcore08:34:251
179940,0migration/127046-21sendmail_mailqu08:09:281
179940,0migration/12577-21cpuspeed_turbos11:54:221
179940,0migration/122908-21kthreadcore10:49:251
179940,0migration/121892-21fschecks_time08:54:211
179940,0migration/119096-21kthreadcore10:29:281
179940,0migration/118369-21gltestperf11:44:221
179940,0migration/118369-21gltestperf11:44:221
179940,0migration/118235-21fschecks_time08:29:211
179940,0migration/114833-21kthreadcore09:49:251
179940,0migration/114097-21cpuspeed_turbos08:49:171
179940,0migration/113895-21kthreadcore08:24:251
179940,0migration/113829-21fschecks_time11:04:221
179940,0migration/113523-21munin-node07:19:181
179940,0migration/113175-21kthreadcore10:44:251
179940,0migration/11107-21munin-node10:19:231
169940,0watchdog/16314-21runrttasks12:23:341
169940,0watchdog/14532-21aten_r1power_cu12:14:181
169940,0watchdog/131110-21fschecks_time11:14:221
169940,0watchdog/128810-21cut10:54:221
169940,0watchdog/122351-21ssh12:40:301
169940,0watchdog/122087-21ssh11:24:581
169940,0watchdog/112637-21kthreadcore11:39:261
169940,0watchdog/10-21swapper/112:44:181
169940,0watchdog/10-21swapper/110:04:261
169940,0watchdog/10-21swapper/109:04:261
169940,0watchdog/10-21swapper/108:39:261
169940,0watchdog/10-21swapper/108:04:211
149940,0migration/032613-21kthreadcore10:54:270
149940,0migration/029626-21sh11:13:040
149940,0migration/023694-21kthreadcore09:54:260
149940,0migration/018724-21irqcore11:44:250
149940,0migration/018724-21irqcore11:44:250
149940,0migration/018042-21kthreadcore12:39:250
149940,0migration/01754-21kthreadcore10:19:250
149940,0migration/017062-21kthreadcore09:49:260
149940,0migration/016061-21sh11:41:060
149940,0migration/010630-21kthreadcore07:59:240
132599943,0cyclictest7800-21awk08:44:232
132599943,0cyclictest3571-21lldpd10:09:112
132599943,0cyclictest3571-21lldpd09:29:102
132599943,0cyclictest3571-21lldpd08:14:382
132599943,0cyclictest3571-21lldpd08:12:382
132599943,0cyclictest3571-21lldpd07:59:072
132599943,0cyclictest3524-21snmpd07:47:122
132599943,0cyclictest3250-21irqbalance10:54:132
132599943,0cyclictest3250-21irqbalance10:49:132
132599943,0cyclictest3250-21irqbalance09:14:132
132599943,0cyclictest3250-21irqbalance09:09:132
132599943,0cyclictest3250-21irqbalance09:04:132
132599943,0cyclictest3250-21irqbalance08:59:132
132599943,0cyclictest3250-21irqbalance08:21:132
132599943,0cyclictest28696-21awk09:39:222
132599943,0cyclictest25033-21awk11:29:252
132599943,0cyclictest1008-21munin-node09:24:202
132599940,0cyclictest0-21swapper/210:39:242
132589944,0cyclictest0-21swapper/109:44:251
132589943,0cyclictest9817-21awk10:24:211
132589943,0cyclictest7815-21awk12:34:231
132589943,0cyclictest7752-21awk11:19:221
132589943,0cyclictest3571-21lldpd12:04:121
132589943,0cyclictest3571-21lldpd09:02:091
132589943,0cyclictest3571-21lldpd07:48:071
132589943,0cyclictest3524-21snmpd07:24:271
132579943,0cyclictest7671-21awk11:19:220
132579943,0cyclictest3524-21snmpd07:44:120
132579943,0cyclictest3250-21irqbalance12:28:340
132579943,0cyclictest3250-21irqbalance11:30:340
132579943,0cyclictest3250-21irqbalance07:37:230
132579943,0cyclictest30069-21kworker/0:110:11:540
132579943,0cyclictest19787-21awk09:34:210
132579943,0cyclictest11973-21awk10:44:230
132579940,0cyclictest0-21swapper/010:51:160
329930,0watchdog/30-21swapper/308:44:223
329930,0watchdog/30-21swapper/307:54:213
329930,0watchdog/30-21swapper/307:49:253
29805030,0irq/28-eth0-rx-0-21swapper/307:34:193
179930,0migration/127036-21diskmemload11:49:211
169930,0watchdog/10-21swapper/109:40:541
169930,0watchdog/10-21swapper/107:39:251
132599932,0cyclictest5071-21cat07:54:252
132589932,0cyclictest3571-21lldpd09:34:111
132589932,0cyclictest32679-21awk07:54:221
132589932,0cyclictest1096-21hostname09:24:181
132589931,0cyclictest6651-21munin-node08:44:231
132589930,0cyclictest24771-21diskstats07:49:181
132589930,0cyclictest0-21swapper/109:09:251
132579933,0cyclictest7255-21kworker/0:209:29:360
132579933,0cyclictest7255-21kworker/0:209:04:180
132579933,0cyclictest7255-21kworker/0:208:44:140
132579933,0cyclictest7255-21kworker/0:208:39:160
132579933,0cyclictest7255-21kworker/0:207:54:100
132579933,0cyclictest7255-21kworker/0:207:19:180
132579933,0cyclictest30069-21kworker/0:110:59:140
132579933,0cyclictest30069-21kworker/0:109:59:120
132579933,0cyclictest21355-21kworker/0:012:34:310
132579933,0cyclictest21355-21kworker/0:012:04:170
132579933,0cyclictest21355-21kworker/0:011:34:120
132579933,0cyclictest21355-21kworker/0:011:14:080
132579932,0cyclictest27125-21awk11:49:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional