You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-13 - 10:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot5s.osadl.org (updated Sun Jul 13, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
428399250,24cyclictest13951-21perf20:35:002
4277992522,2cyclictest9009-21cron19:20:000
4283992421,2cyclictest25823-21latency_hist00:20:002
428399240,23cyclictest30748-21ls21:10:012
427899240,23cyclictest0-21swapper/120:15:461
4277992420,3cyclictest0-21swapper/000:00:460
4283992321,1cyclictest26852-21turbostat23:15:002
4278992322,0cyclictest22381-21apt-get23:05:451
427899230,22cyclictest25935-21cron21:00:011
427899230,22cyclictest23699-21/usr/sbin/munin00:15:471
427899230,22cyclictest16871-21dump-pmu-power22:55:001
4277992321,1cyclictest30766-21awk21:10:000
4277992321,1cyclictest17061-21cron19:35:000
4277992319,4cyclictest0-21swapper/019:20:020
427799230,2cyclictest19507-21sendmail-msp19:40:000
427799230,23cyclictest0-21swapper/022:30:460
427799230,22cyclictest21885-21cron19:45:000
4288992222,0cyclictest0-21swapper/319:15:473
4288992221,1cyclictest0-21swapper/320:30:473
4288992220,1cyclictest32024-21sh22:20:013
4288992220,1cyclictest21030-21perf00:10:003
4288992220,1cyclictest0-21swapper/322:45:003
428899220,21cyclictest766-21snmpd00:40:003
428899220,21cyclictest4068-21munin-run23:35:003
428899220,21cyclictest28548-21apt-get00:25:503
428899220,21cyclictest27531-21apt-get22:10:483
428899220,21cyclictest15195-21cron21:45:003
428899220,21cyclictest0-21swapper/320:40:453
428899220,21cyclictest0-21swapper/320:10:463
4283992220,1cyclictest9635-21munin-run22:40:002
428399220,2cyclictest5566-21latency_hist21:25:002
428399220,21cyclictest29593-21apt-get23:20:462
428399220,21cyclictest24457-21apt23:10:012
428399220,21cyclictest0-21swapper/222:20:012
428399220,21cyclictest0-21swapper/221:59:592
428399220,1cyclictest12084-21perf22:45:002
4278992221,0cyclictest5126-21apt-get22:30:451
4278992220,1cyclictest28223-21turbostat00:24:591
427899220,21cyclictest10661-21apt-get21:35:441
427899220,21cyclictest0-21swapper/123:25:471
427899220,21cyclictest0-21swapper/122:10:481
427899220,21cyclictest0-21swapper/121:40:461
427899220,21cyclictest0-21swapper/121:05:451
427899220,1cyclictest583-21avahi-daemon00:40:001
427899220,1cyclictest24292-21turbostat19:50:011
427799220,21cyclictest1443-21cron20:10:000
427799220,21cyclictest0-21swapper/022:45:500
427799220,21cyclictest0-21swapper/022:35:490
427799220,21cyclictest0-21swapper/022:10:480
427799220,21cyclictest0-21swapper/019:45:440
427799220,1cyclictest7966-21awk21:30:000
427799220,1cyclictest32030-21sendmail-msp22:20:000
427799220,1cyclictest27176-21apt-get23:15:480
4288992121,0cyclictest0-21swapper/320:15:473
4288992120,1cyclictest0-21swapper/323:55:003
4288992120,0cyclictest0-21swapper/320:45:463
4288992120,0cyclictest0-21swapper/319:30:473
4288992119,1cyclictest26148-21apt-get00:20:453
428899210,20cyclictest9409-21apt-get20:25:473
428899210,20cyclictest29256-21ls23:20:013
428899210,20cyclictest12392-21apt-get22:45:503
428899210,20cyclictest0-21swapper/322:00:483
428899210,20cyclictest0-21swapper/321:20:473
428899210,1cyclictest25844-21munin-run00:20:003
4283992121,0cyclictest0-21swapper/223:15:482
4283992121,0cyclictest0-21swapper/219:40:472
4283992120,1cyclictest29623-21perf22:15:002
4283992120,1cyclictest19276-21dump-pmu-power23:00:002
4283992120,1cyclictest0-21swapper/200:15:002
428399210,21cyclictest0-21swapper/219:45:442
428399210,20cyclictest0-21swapper/222:20:002
428399210,0cyclictest27003-21apt-get19:55:482
4278992121,0cyclictest0-21swapper/119:55:471
4278992120,0cyclictest7015-21apt-get20:20:471
4278992119,1cyclictest30631-21latency_hist00:30:001
4278992119,1cyclictest11271-21grep23:50:011
427899210,0cyclictest0-21swapper/122:55:481
427899210,0cyclictest0-21swapper/121:55:461
427899210,0cyclictest0-21swapper/119:35:471
4277992120,0cyclictest0-21swapper/021:30:460
4277992119,2cyclictest1641-21cron22:20:010
427799210,20cyclictest0-21swapper/023:20:460
427799210,20cyclictest0-21swapper/023:05:010
427799210,20cyclictest0-21swapper/020:40:460
427799210,20cyclictest0-21swapper/020:10:460
427799210,1cyclictest6793-21apt-get23:40:450
427799210,0cyclictest0-21swapper/023:25:470
4288992020,0cyclictest24605-21apt-get19:50:453
4288992020,0cyclictest0-21swapper/323:35:453
4288992020,0cyclictest0-21swapper/323:05:013
4288992020,0cyclictest0-21swapper/321:45:453
4288992020,0cyclictest0-21swapper/321:35:443
4288992018,1cyclictest0-21swapper/319:40:003
428899200,20cyclictest20324-21apt-get21:55:463
4283992020,0cyclictest8265-21apt-get21:30:452
4283992020,0cyclictest0-21swapper/223:50:482
4283992020,0cyclictest0-21swapper/221:00:462
4283992020,0cyclictest0-21swapper/220:40:452
4283992020,0cyclictest0-21swapper/220:35:472
4283992019,1cyclictest29421-21apt-get20:00:482
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional