You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 01:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Sat Apr 18, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1975726665,0sleep00-21swapper/019:20:070
1950123829,0sleep20-21swapper/219:17:092
1960123430,0sleep30-21swapper/319:18:143
1957823425,0sleep10-21swapper/119:18:001
339960,0migration/3845-21sh21:38:423
339960,0migration/34060-21sh00:29:163
339960,0migration/33861-21munin-node22:15:483
339960,0migration/327694-21sh23:10:173
339960,0migration/326975-21sh21:53:353
339960,0migration/315841-21switchtime20:20:533
339960,0migration/312900-21sh00:34:423
329960,0watchdog/39595-21sh00:12:003
29805060,0irq/28-eth0-rx-13173-21cut22:40:463
29805060,0irq/28-eth0-rx-0-21swapper/300:02:133
198639960,0cyclictest0-21swapper/200:18:512
198639960,0cyclictest0-21swapper/200:05:462
198609965,0cyclictest0-21swapper/000:42:040
198609960,0cyclictest0-21swapper/022:31:030
8305050,0irq/26-0000:00:19189-21latency_hist21:50:292
4150,0ktimersoftd/00-21swapper/023:46:320
35150,0ktimersoftd/30-21swapper/322:35:323
339950,0migration/37156-21fschecks_count23:35:423
339950,0migration/36787-21kthreadcore21:40:463
339950,0migration/35963-21aten_r1power_vo19:55:393
339950,0migration/34655-21kthreadcore21:00:433
339950,0migration/332444-21kthreadcore20:55:463
339950,0migration/327644-21irqrtprio00:05:463
339950,0migration/327001-21taskset19:24:553
339950,0migration/320463-21fschecks_time00:20:413
339950,0migration/318302-21irqcore21:10:453
339950,0migration/315850-21kthreadcore23:00:473
339950,0migration/314893-21munin-node23:55:473
339950,0migration/313609-21kthreadcore00:15:463
339950,0migration/312802-21taskset20:42:363
339950,0migration/312543-21taskset23:20:023
339950,0migration/311521-21kthreadcore21:05:453
329950,0watchdog/39221-21sh22:56:483
329950,0watchdog/36314-21runrttasks19:50:393
329950,0watchdog/328068-21cut23:10:403
329950,0watchdog/323324-21yum21:30:563
329950,0watchdog/322762-21python19:40:513
329950,0watchdog/318703-21kthreadcore00:35:483
329950,0watchdog/310623-21python22:00:523
329950,0watchdog/30-21swapper/322:05:403
29815050,0irq/29-eth0-tx-32570-21munin-node23:50:452
29815050,0irq/29-eth0-tx-32271-21munin-node22:35:452
29815050,0irq/29-eth0-tx-31228-21tune2fs00:45:432
29815050,0irq/29-eth0-tx-30265-21munin-node23:30:502
29815050,0irq/29-eth0-tx-23660-21munin-node22:30:412
29815050,0irq/29-eth0-tx-16543-21munin-node19:40:450
29815050,0irq/29-eth0-tx-15073-21munin-node22:25:442
29815050,0irq/29-eth0-tx-13466-21munin-node00:35:512
29815050,0irq/29-eth0-tx-10854-21unixbench-2d22:00:552
29815050,0irq/29-eth0-tx-0-21swapper/222:54:582
29815050,0irq/29-eth0-tx-0-21swapper/200:28:012
29815050,0irq/29-eth0-tx-0-21swapper/200:22:132
29805050,0irq/28-eth0-rx-596-21latency19:25:473
29805050,0irq/28-eth0-rx-31515-21irqcore23:30:453
29805050,0irq/28-eth0-rx-27448-21cut00:40:483
29805050,0irq/28-eth0-rx-27445-21munin-node22:10:453
29805050,0irq/28-eth0-rx-23837-21cut20:05:463
29805050,0irq/28-eth0-rx-14434-21unixbench_multi21:25:543
29805050,0irq/28-eth0-rx-0-21swapper/323:45:473
29805050,0irq/28-eth0-rx-0-21swapper/323:28:473
29805050,0irq/28-eth0-rx-0-21swapper/323:21:173
29805050,0irq/28-eth0-rx-0-21swapper/322:45:463
29805050,0irq/28-eth0-rx-0-21swapper/322:28:523
29805050,0irq/28-eth0-rx-0-21swapper/321:45:303
259950,0migration/225230-21sh22:49:242
259950,0migration/224625-21fschecks_time23:45:432
259950,0migration/221701-21kthreadcore19:20:452
259950,0migration/220825-21df_abs20:50:422
259950,0migration/22051-21munin-node21:55:542
259950,0migration/215975-21munin-node21:05:502
259950,0migration/214339-21kthreadcore23:55:472
259950,0migration/212913-21rt-features23:35:502
249950,0watchdog/223074-21sh00:40:442
249950,0watchdog/214299-21idleruntime20:45:442
198639955,0cyclictest0-21swapper/223:10:452
198639955,0cyclictest0-21swapper/223:08:042
198639955,0cyclictest0-21swapper/223:05:232
198639954,0cyclictest10495-21awk19:35:442
198639950,0cyclictest0-21swapper/222:43:382
198609955,0cyclictest0-21swapper/023:00:410
198609950,0cyclictest0-21swapper/022:46:580
198609950,0cyclictest0-21swapper/022:29:090
198609950,0cyclictest0-21swapper/000:12:070
198609950,0cyclictest0-21swapper/000:02:290
179950,0migration/15278-21runrttasks00:46:271
179950,0migration/14175-21kthreadcore22:55:451
179950,0migration/131370-21cpuspeed_turbos20:35:391
179950,0migration/125360-21kthreadcore19:45:451
179950,0migration/124895-21hddtemp_smartct23:45:431
179950,0migration/12332-21aten_r1power_fr20:15:391
179950,0migration/12186-21kthreadcore19:50:461
179950,0migration/120768-21cpuspeed_turbos20:50:411
179950,0migration/119454-21taskset00:20:191
179950,0migration/118305-21idleruntime22:45:431
179950,0migration/114196-21switchtime21:25:541
169950,0watchdog/18170-21sh19:30:471
169950,0watchdog/16988-21if_eth1.319:55:431
169950,0watchdog/121223-21ps00:20:441
149950,0migration/04229-21switchtime22:15:540
149950,0migration/031715-21kthreadcore23:10:470
339940,0migration/331814-21kthreadcore20:10:463
339940,0migration/331618-21kthreadcore22:50:473
339940,0migration/31213-21kthreadcore20:35:443
329940,0watchdog/30-21swapper/320:45:443
329940,0watchdog/30-21swapper/320:04:513
329940,0watchdog/30-21swapper/319:30:473
29815040,0irq/29-eth0-tx-25396-21ssh21:35:392
29815040,0irq/29-eth0-tx-17656-21ssh21:46:392
29815040,0irq/29-eth0-tx-16155-21fschecks_time23:40:432
29815040,0irq/29-eth0-tx-0-21swapper/223:25:382
29815040,0irq/29-eth0-tx-0-21swapper/223:20:392
29815040,0irq/29-eth0-tx-0-21swapper/223:15:522
29815040,0irq/29-eth0-tx-0-21swapper/222:55:532
29815040,0irq/29-eth0-tx-0-21swapper/222:11:232
29815040,0irq/29-eth0-tx-0-21swapper/221:40:532
29815040,0irq/29-eth0-tx-0-21swapper/221:30:582
29815040,0irq/29-eth0-tx-0-21swapper/221:21:442
29815040,0irq/29-eth0-tx-0-21swapper/200:00:472
29815040,0irq/29-eth0-tx-0-21swapper/020:45:490
29805040,0irq/28-eth0-rx-6574-21munin-node23:50:513
29805040,0irq/28-eth0-rx-0-21swapper/323:40:403
29805040,0irq/28-eth0-rx-0-21swapper/322:30:443
29805040,0irq/28-eth0-rx-0-21swapper/322:20:383
29805040,0irq/28-eth0-rx-0-21swapper/321:55:403
29805040,0irq/28-eth0-rx-0-21swapper/321:21:293
29805040,0irq/28-eth0-rx-0-21swapper/320:25:383
29805040,0irq/28-eth0-rx-0-21swapper/300:46:273
259940,0migration/27669-21kthreadcore20:40:462
259940,0migration/25151-21unixbench_singl19:50:542
259940,0migration/230250-21kthreadcore20:10:452
259940,0migration/229387-21kthreadcore20:55:452
259940,0migration/22649-21cpuspeed_turbos00:10:422
259940,0migration/224759-21fschecks_time20:30:422
259940,0migration/21152-21kthreadcore22:15:462
249940,0watchdog/24849-21aten2.4-expect00:30:402
249940,0watchdog/231459-21df20:35:392
249940,0watchdog/218008-21if_err_eth121:10:442
249940,0watchdog/213131-21cpuspeed_turbos22:05:402
198639943,0cyclictest7572-21awk22:20:442
198639943,0cyclictest3591-21awk21:00:422
198639943,0cyclictest3524-21snmpd21:26:172
198639943,0cyclictest3524-21snmpd20:24:462
198639943,0cyclictest3524-21snmpd20:09:012
198639943,0cyclictest14174-21awk20:00:442
198619944,0cyclictest0-21swapper/100:08:201
198619943,0cyclictest8367-21sadc22:40:281
198619943,0cyclictest5414-21awk22:00:451
198619943,0cyclictest3524-21snmpd23:40:481
198619943,0cyclictest3524-21snmpd23:31:481
198619943,0cyclictest3524-21snmpd23:12:331
198619943,0cyclictest29503-21awk00:25:461
198619943,0cyclictest28619-21awk20:10:441
198619943,0cyclictest21138-21awk19:20:431
198619943,0cyclictest20493-21awk21:50:431
198619943,0cyclictest14989-21sadc23:40:291
198609944,0cyclictest0-21swapper/023:38:130
198609944,0cyclictest0-21swapper/021:56:410
198609944,0cyclictest0-21swapper/021:39:010
198609944,0cyclictest0-21swapper/021:20:440
198609944,0cyclictest0-21swapper/000:24:240
198609943,0cyclictest9311-21sadc20:20:280
198609943,0cyclictest7660-21awk22:20:440
198609943,0cyclictest3524-21snmpd23:25:030
198609943,0cyclictest3524-21snmpd22:38:020
198609943,0cyclictest3059-21awk21:40:440
198609943,0cyclictest29535-21awk00:25:460
198609943,0cyclictest21503-21awk20:50:440
198609943,0cyclictest18019-21awk21:10:440
198609943,0cyclictest16447-21awk23:40:450
198609943,0cyclictest14527-21awk00:35:450
198609943,0cyclictest14073-21awk22:05:430
198609943,0cyclictest10094-21awk23:55:440
19140,0ktimersoftd/10-21swapper/123:51:561
179940,0migration/131185-21turbostat.cron21:20:241
179940,0migration/12466-21aten_r1power_en00:10:411
179940,0migration/124251-21cpuspeed_turbos20:30:411
179940,0migration/123244-21kthreadcore00:00:471
179940,0migration/122256-21kthreadcore19:40:461
179940,0migration/119336-21kthreadcore22:25:461
179940,0migration/118344-21kthreadcore21:30:461
179940,0migration/117374-21kthreadcore00:35:481
179940,0migration/111270-21kthreadcore23:55:461
179940,0migration/111062-21cpuspeed_turbos23:00:411
169940,0watchdog/19550-21cut20:20:391
169940,0watchdog/132577-21if_eth121:20:441
169940,0watchdog/12664-21ssh21:57:001
169940,0watchdog/125594-21cut22:10:441
169940,0watchdog/123073-21ssh00:40:441
169940,0watchdog/121067-21ssh23:24:441
169940,0watchdog/1204462sleep123:05:441
169940,0watchdog/110908-21ssh00:30:481
169940,0watchdog/10-21swapper/122:05:401
169940,0watchdog/10-21swapper/121:47:441
169940,0watchdog/10-21swapper/121:10:441
149940,0migration/08972-21taskset19:33:410
149940,0migration/06976-21kthreadcore23:15:470
149940,0migration/0687-21missed_timers19:25:470
149940,0migration/04716-21munin-node19:50:500
149940,0migration/028673-21kthreadcore00:05:470
149940,0migration/027402-21irqrtprio22:50:450
149940,0migration/026821-21kthreadcore23:25:460
149940,0migration/026356-21taskset23:06:330
149940,0migration/023010-21switchtime20:25:520
149940,0migration/021929-21kthreadcore21:50:450
149940,0migration/02154-21aten_r1power_en22:55:390
149940,0migration/015226-21kthreadcore21:45:470
149940,0migration/014643-21kthreadcore20:00:450
329930,0watchdog/30-21swapper/320:50:523
29815030,0irq/29-eth0-tx-0-21swapper/021:15:400
29805030,0irq/28-eth0-rx-0-21swapper/321:15:403
29805030,0irq/28-eth0-rx-0-21swapper/320:30:403
29805030,0irq/28-eth0-rx-0-21swapper/320:15:403
29805030,0irq/28-eth0-rx-0-21swapper/319:45:403
29805030,0irq/28-eth0-rx-0-21swapper/319:35:493
249930,0watchdog/20-21swapper/219:55:432
198639933,0cyclictest17646-21awk19:40:432
198639932,0cyclictest3365-21awk20:15:432
198639932,0cyclictest3125-21awk19:30:422
198639932,0cyclictest28392-21awk19:25:442
198639932,0cyclictest17916-21awk20:25:432
198639930,0cyclictest27338-21cut21:15:452
198619932,0cyclictest7188-21awk20:40:441
198619932,0cyclictest7160-21grep22:20:421
198619932,0cyclictest31226-21awk22:15:441
198619932,0cyclictest24857-21if_eth1.322:30:441
198619932,0cyclictest17892-21awk20:25:431
198619930,0cyclictest7813-21cut21:40:461
198619930,0cyclictest3190-21perl21:00:401
198619930,0cyclictest29699-21cut19:25:461
198619930,0cyclictest27283-21grep21:35:461
198619930,0cyclictest25533-21grep23:25:461
198619930,0cyclictest0-21swapper/123:15:461
198609933,0cyclictest5057-21kworker/0:021:05:400
198609933,0cyclictest3571-21lldpd22:04:400
198609933,0cyclictest31772-21kworker/0:219:45:400
198609932,0cyclictest9779-21awk22:40:440
198609932,0cyclictest8737-21sensors21:00:480
198609932,0cyclictest6096-21basename20:40:400
198609932,0cyclictest31845-21awk00:45:450
198609932,0cyclictest31486-21irqcore23:30:450
198609932,0cyclictest26301-21sensors19:20:500
198609932,0cyclictest26106-21cut22:10:440
198609932,0cyclictest20596-21df20:05:410
198609932,0cyclictest17714-21awk21:30:440
198609932,0cyclictest17486-21sensors00:15:510
198609932,0cyclictest1230-21sensors20:10:500
198609932,0cyclictest11519-21grep19:35:460
198609931,0cyclictest0-21swapper/020:35:440
198609930,0cyclictest6502-21perl19:55:410
198609930,0cyclictest27886-21grep20:30:460
198609930,0cyclictest27640-21munin-node20:55:500
198609930,0cyclictest13127-21grep20:20:460
179930,0migration/1825-21diskmemload22:52:451
179930,0migration/117408-21kthreadcore20:00:461
169930,0watchdog/10-21swapper/122:40:361
169930,0watchdog/10-21swapper/120:45:441
169930,0watchdog/10-21swapper/120:05:391
149930,0migration/03632-21kthreadcore23:50:470
149930,0migration/012741-21kthreadcore21:25:470
149930,0migration/012418-21sh00:33:220
249920,0watchdog/20-21swapper/219:45:312
198619921,0cyclictest0-21swapper/120:55:291
198619920,0cyclictest9712-21sed21:05:291
169920,0watchdog/10-21swapper/119:35:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional