You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 12:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Thu Dec 18, 2025 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2498223828,0sleep30-21swapper/319:09:033
2492123826,0sleep20-21swapper/219:08:182
2503023026,0sleep00-21swapper/019:09:360
2496923026,0sleep10-21swapper/119:08:531
8305070,0irq/26-0000:00:13243-21munin-run21:15:262
29805070,0irq/28-eth0-rx-32062-21perl23:45:403
29805070,0irq/28-eth0-rx-23357-21aten2.4-expect21:55:363
251769976,0cyclictest3571-21lldpd21:44:181
339960,0migration/37337-21sh21:26:493
339960,0migration/35567-21kthreadcore23:30:453
339960,0migration/332346-21missed_timers00:00:473
339960,0migration/330975-21sh22:33:433
339960,0migration/328348-21sh00:16:093
339960,0migration/327255-21sh22:50:333
339960,0migration/32564-21taskset23:28:453
339960,0migration/320869-21sh21:17:003
29805060,0irq/28-eth0-rx-31884-21sh00:35:493
29805060,0irq/28-eth0-rx-24597-21python19:50:493
29805060,0irq/28-eth0-rx-22680-21ssh23:05:393
29805060,0irq/28-eth0-rx-20144-21kthreadcore00:30:453
29805060,0irq/28-eth0-rx-15666-21python22:05:503
149960,0migration/07995-21sh22:39:000
8305050,0irq/26-0000:00:8686-21sadc22:40:272
8305050,0irq/26-0000:00:7770-21grep00:05:472
339950,0migration/36904-21diskmemload22:00:553
339950,0migration/36277-21munin-node20:00:463
339950,0migration/34559-21aten_r1power_en22:20:383
339950,0migration/332131-21aten2.4-expect22:35:393
339950,0migration/330598-21kernelversion19:35:443
339950,0migration/330212-21hddtemp_smartct20:20:413
339950,0migration/328172-21kthreadcore20:40:443
339950,0migration/324367-21kthreadcore19:30:443
339950,0migration/323416-21munin-node21:20:393
339950,0migration/321022-21diskmemload22:27:083
339950,0migration/318956-21kthreadcore19:25:443
339950,0migration/317865-21aten_r1power_vo23:20:413
339950,0migration/31401-21kthreadcore23:10:423
339950,0migration/313240-21kthreadcore23:50:443
339950,0migration/312027-21taskset22:58:123
339950,0migration/311375-21kthreadcore20:05:463
329950,0watchdog/37748-21kthreadcore20:25:453
329950,0watchdog/329649-21cut19:10:413
329950,0watchdog/322829-21grep22:45:463
329950,0watchdog/321269-21python20:55:493
329950,0watchdog/312326-21ssh21:13:453
329950,0watchdog/30-21swapper/323:35:423
329950,0watchdog/30-21swapper/319:15:453
29815050,0irq/29-eth0-tx-29545-21cat23:25:442
29815050,0irq/29-eth0-tx-23357-21expr22:30:392
29815050,0irq/29-eth0-tx-22984-21munin-node21:20:482
29815050,0irq/29-eth0-tx-0-21swapper/223:56:332
29815050,0irq/29-eth0-tx-0-21swapper/222:20:532
29815050,0irq/29-eth0-tx-0-21swapper/200:01:482
29815050,0irq/29-eth0-tx-0-21swapper/020:55:470
29805050,0irq/28-eth0-rx-628-21grep22:15:453
29805050,0irq/28-eth0-rx-4138-21grep00:20:453
29805050,0irq/28-eth0-rx-3377-21sh21:05:513
29805050,0irq/28-eth0-rx-22117-21aten_r1power_en23:40:373
29805050,0irq/28-eth0-rx-20705-21cat23:55:453
29805050,0irq/28-eth0-rx-16931-21ssh23:19:283
29805050,0irq/28-eth0-rx-14937-21ssh22:40:463
29805050,0irq/28-eth0-rx-14146-21perl23:00:413
29805050,0irq/28-eth0-rx-122862chrt00:10:283
29805050,0irq/28-eth0-rx-0-21swapper/322:11:313
29805050,0irq/28-eth0-rx-0-21swapper/321:50:273
29805050,0irq/28-eth0-rx-0-21swapper/321:49:293
29805050,0irq/28-eth0-rx-0-21swapper/321:40:443
29805050,0irq/28-eth0-rx-0-21swapper/321:33:583
29805050,0irq/28-eth0-rx-0-21swapper/319:45:443
251779955,0cyclictest0-21swapper/223:08:492
251779955,0cyclictest0-21swapper/221:31:042
251779950,0cyclictest0-21swapper/223:02:282
251779950,0cyclictest0-21swapper/222:58:252
251779950,0cyclictest0-21swapper/222:06:142
251779950,0cyclictest0-21swapper/221:17:122
251779950,0cyclictest0-21swapper/200:22:552
251779950,0cyclictest0-21swapper/200:11:152
251769955,0cyclictest0-21swapper/123:09:491
251769955,0cyclictest0-21swapper/122:42:231
251769955,0cyclictest0-21swapper/121:26:041
251769954,0cyclictest0-21swapper/123:38:491
251769950,0cyclictest0-21swapper/100:01:121
251759955,0cyclictest9049-21kworker/0:123:50:440
251759955,0cyclictest9049-21kworker/0:100:11:040
251759955,0cyclictest9049-21kworker/0:100:06:140
251759955,0cyclictest9049-21kworker/0:100:02:560
251759955,0cyclictest4905-21kworker/0:019:55:570
251759955,0cyclictest4905-21kworker/0:019:50:290
251759955,0cyclictest4905-21kworker/0:019:46:130
251759955,0cyclictest4065-21kworker/0:020:35:470
251759955,0cyclictest26286-21kworker/0:219:35:270
251759955,0cyclictest26286-21kworker/0:219:31:170
251759955,0cyclictest26286-21kworker/0:219:25:430
251759955,0cyclictest26286-21kworker/0:219:16:170
251759955,0cyclictest26286-21kworker/0:219:10:530
251759955,0cyclictest24730-21kworker/0:220:50:320
251759955,0cyclictest24730-21kworker/0:220:40:350
251759955,0cyclictest21398-21kworker/0:000:39:480
251759955,0cyclictest21398-21kworker/0:000:20:440
251759955,0cyclictest21398-21kworker/0:000:16:500
251759955,0cyclictest19867-21kworker/0:023:45:100
251759955,0cyclictest19867-21kworker/0:023:37:460
251759955,0cyclictest19867-21kworker/0:023:30:560
251759955,0cyclictest19867-21kworker/0:023:25:340
251759955,0cyclictest19867-21kworker/0:023:24:320
251759955,0cyclictest19867-21kworker/0:023:17:540
251759955,0cyclictest19867-21kworker/0:023:11:500
251759955,0cyclictest19867-21kworker/0:023:05:380
251759955,0cyclictest19867-21kworker/0:022:59:260
251759955,0cyclictest19867-21kworker/0:022:51:440
251759955,0cyclictest19867-21kworker/0:022:46:120
251759955,0cyclictest19867-21kworker/0:022:27:080
251759955,0cyclictest19867-21kworker/0:022:24:100
251759955,0cyclictest19867-21kworker/0:022:18:380
251759955,0cyclictest19867-21kworker/0:022:01:320
251759955,0cyclictest19867-21kworker/0:021:57:160
251759955,0cyclictest19867-21kworker/0:021:55:140
251759955,0cyclictest19867-21kworker/0:021:45:400
251759955,0cyclictest19867-21kworker/0:021:41:280
251759955,0cyclictest19867-21kworker/0:021:35:460
251759955,0cyclictest16029-21kworker/0:121:32:080
251759955,0cyclictest16029-21kworker/0:121:27:320
251759955,0cyclictest16029-21kworker/0:121:21:240
251759955,0cyclictest16029-21kworker/0:121:11:200
251759955,0cyclictest16029-21kworker/0:121:00:280
251759955,0cyclictest1321-21kworker/0:220:20:390
251759955,0cyclictest1321-21kworker/0:220:16:070
251759955,0cyclictest1321-21kworker/0:220:12:170
251759955,0cyclictest0-21swapper/000:30:480
259950,0migration/28611-21fschecks_count23:50:392
259950,0migration/2806-21kthreadcore22:15:452
259950,0migration/26774-21munin-node19:15:532
259950,0migration/24459-21fschecks_count19:40:402
259950,0migration/23887-21sh21:43:452
259950,0migration/228930-21sh23:41:052
259950,0migration/228417-21timerwakeupswit20:15:532
259950,0migration/226458-21fschecks_time20:40:402
259950,0migration/225774-21sh21:36:052
259950,0migration/215097-21munin-node22:40:482
259950,0migration/211330-21kthreadcore00:25:462
179950,0migration/14683-21sh22:35:461
179950,0migration/130428-21sh21:22:071
179950,0migration/128334-21munin-node23:40:481
179950,0migration/120941-21missed_timers20:55:451
179950,0migration/119350-21fschecks_time22:10:401
179950,0migration/114905-21munin-node23:15:511
179950,0migration/111456-21taskset23:32:561
169950,0watchdog/124957-21cat21:00:451
169950,0watchdog/118577-21kthreadcore22:25:461
169950,0watchdog/114434-21cpuspeed_turbos21:50:381
169950,0watchdog/113072-21ssh22:24:381
149950,0migration/09910-21latency20:25:460
149950,0migration/08490-21fschecks_time20:05:420
149950,0migration/07633-21kthreadcore19:40:440
149950,0migration/07121-21taskset20:01:530
149950,0migration/0427-21latency_hist20:45:260
149950,0migration/031121-21latency_hist23:45:270
149950,0migration/030068-21fschecks_count21:05:410
149950,0migration/025903-21taskset22:12:160
149950,0migration/018648-21munin-node23:55:440
149950,0migration/018102-21kthreadcore23:00:460
149950,0migration/017903-21taskset20:30:550
149950,0migration/015373-21sh00:28:290
149950,0migration/014125-21taskset19:22:180
149950,0migration/013482-21runrttasks21:15:290
149950,0migration/011491-21kthreadcore22:05:440
149950,0migration/011048-21kthreadcore22:40:440
8305040,0irq/26-0000:00:0-21swapper/219:10:372
339940,0migration/39457-21kthreadcore20:50:433
339940,0migration/324341-21kthreadcore20:15:443
329940,0watchdog/329003-40yum-updatesd-he21:02:253
329940,0watchdog/320504-21kthreadcore20:35:453
329940,0watchdog/316428-21ps20:10:413
29815040,0irq/29-eth0-tx-25755-21munin-node00:35:472
29815040,0irq/29-eth0-tx-19420-21expr23:35:542
29815040,0irq/29-eth0-tx-18475-21munin-node22:10:402
29815040,0irq/29-eth0-tx-0-21swapper/223:45:272
29815040,0irq/29-eth0-tx-0-21swapper/223:15:402
29815040,0irq/29-eth0-tx-0-21swapper/223:10:402
29815040,0irq/29-eth0-tx-0-21swapper/222:50:442
29815040,0irq/29-eth0-tx-0-21swapper/222:45:352
29815040,0irq/29-eth0-tx-0-21swapper/222:25:322
29815040,0irq/29-eth0-tx-0-21swapper/222:01:212
29815040,0irq/29-eth0-tx-0-21swapper/221:55:352
29815040,0irq/29-eth0-tx-0-21swapper/221:46:142
29815040,0irq/29-eth0-tx-0-21swapper/200:30:302
29805040,0irq/28-eth0-rx-6314-21runrttasks19:40:523
29805040,0irq/28-eth0-rx-0-21swapper/321:35:313
29805040,0irq/28-eth0-rx-0-21swapper/300:25:503
29805040,0irq/28-eth0-rx-0-21swapper/300:05:473
251779943,0cyclictest3524-21snmpd20:23:432
251779943,0cyclictest16161-21awk20:55:422
251779943,0cyclictest15670-21awk19:25:412
251779943,0cyclictest1047-21awk21:25:422
251769944,0cyclictest0-21swapper/122:49:471
251769944,0cyclictest0-21swapper/120:35:281
251769943,0cyclictest3571-21lldpd23:56:191
251769943,0cyclictest3571-21lldpd19:13:151
251769943,0cyclictest3571-21lldpd00:23:491
251769943,0cyclictest3571-21lldpd00:07:481
251769943,0cyclictest30305-21awk20:20:421
251769943,0cyclictest24402-21awk21:55:401
251769943,0cyclictest19420-21awk19:50:421
251769943,0cyclictest17635-21awk00:30:421
251769943,0cyclictest1577-21awk20:45:411
251769943,0cyclictest14621-21awk21:15:411
251769943,0cyclictest14548-21awk23:00:431
251769943,0cyclictest12226-21awk19:45:411
251759944,0cyclictest19867-21kworker/0:022:30:540
259940,0migration/27676-21cpuspeed_turbos19:20:392
259940,0migration/27203-21kthreadcore20:25:452
259940,0migration/23754-21sh23:30:392
259940,0migration/227897-21kthreadcore19:55:422
259940,0migration/219316-21hwlatdetect19:50:412
259940,0migration/218069-21df_abs23:20:422
259940,0migration/216920-21kthreadcore20:30:442
259940,0migration/214204-21kthreadcore19:45:442
249940,0watchdog/239352sleep221:07:532
249940,0watchdog/227268-21kthreadcore19:30:452
249940,0watchdog/225637-21kthreadcore00:15:462
249940,0watchdog/223076-21perl21:00:412
249940,0watchdog/216431-21sed20:10:412
249940,0watchdog/214401-21cpuspeed_turbos21:50:382
249940,0watchdog/20-21swapper/220:35:452
249940,0watchdog/20-21swapper/219:35:452
179940,0migration/17084-21kthreadcore21:10:441
179940,0migration/16661-21kthreadcore21:45:441
179940,0migration/16093-21kthreadcore19:40:441
179940,0migration/14931-21fschecks_time22:55:401
179940,0migration/14030-21kthreadcore23:10:431
179940,0migration/14011-21taskset21:08:461
179940,0migration/131080-21latency_hist23:45:271
179940,0migration/129596-21kthreadcore00:35:461
179940,0migration/127149-21cpuspeed_turbos23:25:391
179940,0migration/126753-21kthreadcore22:30:441
179940,0migration/125362-21kthreadcore20:15:451
179940,0migration/122873-21irqcore00:15:451
179940,0migration/112908-21kthreadcore21:30:441
179940,0migration/112724-21irqcore20:30:421
179940,0migration/11095-21idleruntime22:00:421
179940,0migration/110155-21kthreadcore00:25:451
169940,0watchdog/18149-21tune2fs20:05:411
169940,0watchdog/15669-21kthreadcore20:00:451
169940,0watchdog/130955-21cut20:40:451
169940,0watchdog/128775-21munin-node22:15:421
169940,0watchdog/127321-21ssh21:39:211
169940,0watchdog/121318-21chrt19:27:331
169940,0watchdog/119373-21ssh00:11:301
169940,0watchdog/116324-21sh22:06:301
169940,0watchdog/10-21swapper/122:51:301
169940,0watchdog/10-21swapper/120:25:451
169940,0watchdog/10-21swapper/119:15:451
329930,0watchdog/30-21swapper/320:31:453
329930,0watchdog/30-21swapper/319:55:453
29805030,0irq/28-eth0-rx-0-21swapper/320:45:383
251779933,0cyclictest1547-21awk20:45:412
251779932,0cyclictest14832-21munin-run20:55:262
251769932,0cyclictest22893-21awk19:30:421
251769932,0cyclictest22099-21kthreadcore23:20:471
251769932,0cyclictest15603-21tune2fs20:10:381
251769931,0cyclictest28956-21cut19:55:421
249930,0watchdog/20-21swapper/220:05:412
249930,0watchdog/20-21swapper/220:00:452
169930,0watchdog/10-21swapper/123:50:381
169930,0watchdog/10-21swapper/119:35:451
169930,0watchdog/10-21swapper/119:20:291
329920,0watchdog/30-21swapper/319:20:293
251769921,0cyclictest7768-21cat20:50:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional