You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 16:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack8slot4s.osadl.org (updated Sun Nov 23, 2025 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34083752230168,21sleep10-21swapper/107:07:151
34085042226187,25sleep50-21swapper/507:09:055
34084372219185,22sleep70-21swapper/707:08:107
34084302218186,20sleep00-21swapper/007:08:030
34085032216177,26sleep40-21swapper/407:09:044
34083302211176,22sleep30-21swapper/307:06:383
34082972210173,25sleep60-21swapper/607:06:086
34082932208176,20sleep20-21swapper/207:06:042
340878299260,25cyclictest0-21swapper/311:15:123
340877799260,25cyclictest0-21swapper/111:15:121
340878299250,24cyclictest0-21swapper/310:15:143
3408775992523,1cyclictest3464478-21apt-get08:45:140
3408775992519,5cyclictest3504346-21cron09:55:000
3408793992422,1cyclictest3453044-21apt-get08:25:127
340879199240,23cyclictest0-21swapper/607:20:126
3408788992422,1cyclictest3599207-21turbostat.cron12:40:005
340878699240,23cyclictest0-21swapper/411:35:134
3408782992422,1cyclictest3449735-21sh08:20:003
3408782992422,1cyclictest3425387-21ntpq07:35:173
340878099240,23cyclictest3556356-21perf11:24:592
340877799240,23cyclictest0-21swapper/112:10:141
340877799240,22cyclictest3539611-21apt-get10:55:141
340877599240,23cyclictest3435204-21munin-run07:55:010
340877599240,22cyclictest3519099-21apt-get10:20:130
3408793992321,1cyclictest3542487-21apt-get11:00:117
340879399230,22cyclictest0-21swapper/708:05:127
340879399230,21cyclictest0-21swapper/708:10:147
340879199230,22cyclictest3479064-21apt-get09:10:126
340879199230,22cyclictest3479064-21apt-get09:10:116
340879199230,22cyclictest0-21swapper/609:55:126
3408782992321,1cyclictest3521569-21apt-config10:25:003
3408782992321,1cyclictest3478375-21apt-get09:10:023
3408782992321,1cyclictest3478375-21apt-get09:10:013
340878299230,22cyclictest3510513-21apt-get10:05:113
340878299230,22cyclictest3478401-21awk09:10:003
340878299230,22cyclictest3478401-21awk09:10:003
3408780992321,1cyclictest3421265-21apt-get07:30:112
3408777992321,1cyclictest3533227-21idleruntime-cro10:45:011
340877799230,22cyclictest3527919-21apt-get10:35:141
340877799230,22cyclictest0-21swapper/111:05:131
3408775992321,1cyclictest3484794-21apt-get09:20:120
3408775992321,1cyclictest3484356-21munin-run09:20:000
3408775992321,1cyclictest3484356-21munin-run09:20:000
3408775992321,1cyclictest0-21swapper/008:50:170
340877599230,22cyclictest3513370-21apt-get10:10:140
340877599230,22cyclictest3492935-21awk09:35:000
340877599230,22cyclictest0-21swapper/009:05:130
340877599230,22cyclictest0-21swapper/009:05:130
340877599230,1cyclictest0-21swapper/007:30:010
3408793992220,1cyclictest3458750-21apt-get08:35:127
340879399220,21cyclictest0-21swapper/710:20:137
340879399220,21cyclictest0-21swapper/710:10:157
3408791992222,0cyclictest0-21swapper/610:20:156
3408791992221,1cyclictest3492923-21idleruntime-cro09:35:006
3408791992220,1cyclictest3553489-21systemctl11:20:006
340879199220,21cyclictest0-21swapper/607:45:136
340879199220,21cyclictest0-21swapper/607:25:126
340879199220,0cyclictest0-21swapper/607:55:156
3408788992221,1cyclictest3545338-21apt-get11:05:125
340878899220,21cyclictest0-21swapper/511:55:115
340878899220,21cyclictest0-21swapper/511:50:135
340878899220,21cyclictest0-21swapper/510:25:145
340878899220,21cyclictest0-21swapper/509:30:135
3408786992221,1cyclictest0-21swapper/411:45:004
3408786992221,1cyclictest0-21swapper/407:25:104
3408786992220,1cyclictest3449753-21munin-run08:20:004
340878699220,1cyclictest0-21swapper/410:15:144
3408782992220,1cyclictest3466916-21turbostat08:50:003
340878299220,21cyclictest0-21swapper/310:45:103
340878299220,21cyclictest0-21swapper/309:35:133
3408780992221,1cyclictest3504786-21apt-get09:55:122
340878099220,22cyclictest0-21swapper/210:40:012
340878099220,21cyclictest0-21swapper/212:15:132
340878099220,21cyclictest0-21swapper/211:45:112
340878099220,21cyclictest0-21swapper/211:35:132
340878099220,21cyclictest0-21swapper/209:05:132
340878099220,21cyclictest0-21swapper/209:05:122
340878099220,21cyclictest0-21swapper/208:55:132
340878099220,21cyclictest0-21swapper/207:25:112
340878099220,0cyclictest0-21swapper/212:35:132
3408777992222,0cyclictest0-21swapper/109:10:171
3408777992222,0cyclictest0-21swapper/109:10:171
3408777992221,1cyclictest33-21ksoftirqd/108:10:001
3408777992220,1cyclictest3521666-21apt-config10:25:001
340877799220,21cyclictest3591068-21apt-get12:25:091
340877799220,21cyclictest0-21swapper/112:35:121
340877799220,21cyclictest0-21swapper/108:55:121
340877799220,1cyclictest3587792-21systemctl12:20:001
340877799220,1cyclictest3525064-21apt-get10:30:131
340877799220,1cyclictest0-21swapper/110:10:011
340877799220,0cyclictest0-21swapper/109:35:121
3408775992222,0cyclictest0-21swapper/012:20:130
3408775992221,0cyclictest0-21swapper/007:45:140
340877599220,2cyclictest3579211-21latency_hist12:05:000
340877599220,21cyclictest0-21swapper/010:35:140
340877599220,21cyclictest0-21swapper/008:15:140
340877599220,0cyclictest0-21swapper/009:40:120
3408793992121,0cyclictest0-21swapper/711:05:137
3408793992121,0cyclictest0-21swapper/710:15:157
3408793992121,0cyclictest0-21swapper/707:10:127
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional