You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-29 - 12:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot5s.osadl.org (updated Fri Aug 29, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1529399240,23cyclictest25928-21apt-get20:39:463
15291992418,6cyclictest12558-21turbostat21:15:001
1529199240,1cyclictest22809-21perf23:50:001
1529099240,23cyclictest5955-21cron23:15:000
1529099240,23cyclictest28734-21apt-get00:04:470
1529099240,23cyclictest24371-21perf21:40:000
1529099240,23cyclictest0-21swapper/000:24:440
1529399230,2cyclictest24371-21perf21:39:593
1529299230,2cyclictest15584-21turbostat23:35:012
1529299230,22cyclictest25198-21apt-get23:55:012
1529299230,22cyclictest20396-21cron19:20:012
15291992321,1cyclictest419-21idleruntime-cro19:45:001
15291992321,1cyclictest11903-21cat22:20:001
15291992320,2cyclictest593-21dbus-daemon20:10:001
15291992319,3cyclictest22162-21apt-get22:44:511
1529199230,2cyclictest20498-21awk20:25:011
1529199230,2cyclictest10162-21grep21:10:001
1529099230,2cyclictest23665-21cron22:45:000
1529099230,2cyclictest13169-21idleruntime-cro23:30:000
1529099230,22cyclictest766-21snmpd21:20:010
1529099230,22cyclictest11886-21perf22:20:000
15293992222,0cyclictest5997-21apt-get21:04:473
15293992221,1cyclictest23532-21apt-get20:34:463
1529399221,1cyclictest1641-21cron23:25:003
1529399220,2cyclictest21509-21grep22:40:003
1529399220,21cyclictest2293-21munin-run22:00:013
1529399220,21cyclictest13817-21apt-get23:34:463
1529399220,21cyclictest0-21swapper/320:24:463
1529399220,1cyclictest4203-21apt-get23:14:473
1529399220,1cyclictest20398-21ls23:45:013
15292992220,1cyclictest612-21gdbus22:14:592
1529299220,21cyclictest5340-21turbostat.cron21:00:002
1529299220,21cyclictest28346-21apt-get20:44:462
1529299220,1cyclictest21498-21run-parts22:40:012
1529299220,1cyclictest20443-21sendmail-msp19:20:002
15291992220,1cyclictest10090-21ls00:30:001
1529199220,21cyclictest313-21systemd-journal22:05:001
1529199220,21cyclictest28700-21idleruntime-cro22:55:001
1529199220,21cyclictest14287-21sh22:25:001
1529199220,21cyclictest0-21swapper/123:04:451
1529199220,21cyclictest0-21swapper/122:39:481
1529199220,21cyclictest0-21swapper/119:59:461
1529199220,1cyclictest9086-21which22:15:001
15290992222,0cyclictest0-21swapper/000:19:450
15290992220,1cyclictest8077-21perf20:00:000
15290992220,1cyclictest0-21swapper/023:20:000
1529099220,2cyclictest7752-21turbostat.cron21:05:010
1529099220,2cyclictest2884-21perf19:49:590
1529099220,21cyclictest25217-21munin-run23:54:590
1529099220,21cyclictest0-21swapper/023:55:020
1529099220,21cyclictest0-21swapper/022:09:500
1529099220,0cyclictest0-21swapper/023:39:460
15293992121,0cyclictest0-21swapper/323:59:463
15293992121,0cyclictest0-21swapper/320:19:473
15293992119,1cyclictest22242-21idleruntime-cro21:34:593
1529399210,20cyclictest6603-21apt-get23:19:473
1529399210,20cyclictest10115-21apt-get22:19:463
1529399210,20cyclictest0-21swapper/321:49:463
1529399210,20cyclictest0-21swapper/319:44:473
1529399210,20cyclictest0-21swapper/300:09:463
1529399210,1cyclictest28654-21apt-get19:39:453
1529399210,1cyclictest0-21swapper/319:49:593
1529399210,1cyclictest0-21swapper/300:20:003
1529399210,0cyclictest16222-21apt-get23:39:473
1529399210,0cyclictest0-21swapper/320:54:473
15292992121,0cyclictest0-21swapper/222:29:502
15292992120,1cyclictest28041-21awk19:35:002
15292992120,0cyclictest0-21swapper/220:24:462
1529299210,21cyclictest0-21swapper/221:39:512
1529299210,20cyclictest0-21swapper/223:14:472
15291992121,0cyclictest0-21swapper/123:19:481
15291992121,0cyclictest0-21swapper/122:49:461
15291992119,1cyclictest456-21apt-get21:59:481
1529199210,0cyclictest0-21swapper/123:24:471
1529199210,0cyclictest0-21swapper/121:49:461
1529199210,0cyclictest0-21swapper/120:39:461
15290992121,0cyclictest0-21swapper/022:49:460
15290992121,0cyclictest0-21swapper/022:04:480
15290992121,0cyclictest0-21swapper/021:14:480
15290992120,0cyclictest0-21swapper/023:09:460
15290992120,0cyclictest0-21swapper/020:34:460
15290992119,1cyclictest28032-21wc19:35:010
15290992119,1cyclictest0-21swapper/022:00:010
1529099210,20cyclictest0-21swapper/019:14:490
1529099210,0cyclictest27671-21apt-get21:49:460
1529099210,0cyclictest0-21swapper/019:20:020
15293992020,0cyclictest10791-21apt-get21:14:473
15293992020,0cyclictest0-21swapper/322:34:453
15293992020,0cyclictest0-21swapper/321:29:483
15293992020,0cyclictest0-21swapper/319:50:023
15293992019,0cyclictest6304-21apt-get19:59:473
15293992018,1cyclictest5348-21dump-pmu-power21:00:013
1529399200,0cyclictest0-21swapper/323:49:483
1529399200,0cyclictest0-21swapper/300:14:473
15292992020,0cyclictest31074-21apt-get19:44:482
15292992020,0cyclictest0-21swapper/223:09:442
15292992020,0cyclictest0-21swapper/221:44:502
15292992020,0cyclictest0-21swapper/219:59:462
15292992020,0cyclictest0-21swapper/219:49:452
15292992020,0cyclictest0-21swapper/200:29:502
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional