You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 11:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Dec 23, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4589992423,1cyclictest0-21swapper/220:05:042
4588992422,1cyclictest18842-21sendmail-msp00:00:011
4588992421,2cyclictest607-21in:imuxsock20:30:001
4587992423,1cyclictest10041-21apt-get19:20:050
458799240,23cyclictest9027-21ls20:25:000
4590992322,1cyclictest0-21swapper/322:15:023
4590992322,1cyclictest0-21swapper/322:15:023
4590992321,1cyclictest605-21avahi-daemon21:00:013
4590992321,1cyclictest11574-21wc23:45:003
459099230,22cyclictest605-21avahi-daemon00:05:013
4589992322,0cyclictest0-21swapper/220:55:042
4589992321,1cyclictest0-21swapper/223:10:012
4588992323,0cyclictest0-21swapper/121:20:041
458899230,2cyclictest28757-21dump-pmu-power23:15:011
458899230,22cyclictest23891-21sendmail22:00:001
458899230,1cyclictest0-21swapper/122:15:051
458899230,1cyclictest0-21swapper/122:15:051
4587992323,0cyclictest2115-21apt-get21:15:040
4587992323,0cyclictest0-21swapper/020:15:040
458799230,22cyclictest6934-21apt-get21:25:030
458799230,22cyclictest16412-21idleruntime-cro23:55:010
458799230,0cyclictest0-21swapper/019:10:040
4590992221,1cyclictest7022-21apt-get23:35:063
4590992220,1cyclictest0-21swapper/323:20:013
459099220,21cyclictest8980-21apt-get22:35:053
459099220,21cyclictest606-21dbus-daemon20:50:013
459099220,21cyclictest14145-21apt-get21:40:053
459099220,1cyclictest0-21swapper/323:00:013
459099220,1cyclictest0-21swapper/300:10:033
4589992221,1cyclictest0-21swapper/221:55:022
4589992220,1cyclictest24367-21apt-get00:10:062
4589992220,1cyclictest0-21swapper/220:20:002
458999220,21cyclictest9045-21grep20:25:002
458999220,21cyclictest29419-21apt-get23:15:052
458999220,21cyclictest12432-21apt-get19:25:022
4588992220,1cyclictest11412-21apt-get20:30:021
4588992220,1cyclictest0-21swapper/100:30:001
458899220,21cyclictest21804-21apt-get23:00:021
458899220,21cyclictest0-21swapper/121:25:021
458899220,21cyclictest0-21swapper/119:55:051
458899220,21cyclictest0-21swapper/100:10:061
458899220,1cyclictest24883-21apt-get19:50:051
458899220,1cyclictest0-21swapper/122:45:021
458899220,1cyclictest0-21swapper/120:50:041
458899220,1cyclictest0-21swapper/100:20:001
4587992220,1cyclictest13867-21turbostat.cron21:40:010
458799221,20cyclictest18988-21apt-get21:50:050
458799220,21cyclictest28935-21perf00:20:000
458799220,21cyclictest1779-21apt-get22:20:030
458799220,21cyclictest0-21swapper/000:30:060
458799220,1cyclictest31582-21apt-get00:25:050
4590992120,1cyclictest26593-21apt-get22:05:073
4590992119,1cyclictest16693-21munin-run20:40:013
459099210,20cyclictest20095-21apt-get19:40:063
459099210,1cyclictest19427-21latency_hist19:40:003
459099210,0cyclictest16678-21apt-get23:55:053
4589992121,0cyclictest0-21swapper/223:10:032
4589992121,0cyclictest0-21swapper/222:20:032
4589992119,1cyclictest18849-21perf00:00:012
4589992119,1cyclictest1825-21apt-get23:25:062
4589992119,1cyclictest12043-21apt-get20:30:022
4589992118,2cyclictest4538-21apt-get21:20:032
458999210,20cyclictest28986-21apt-get22:10:062
458999210,20cyclictest0-21swapper/222:25:052
458999210,20cyclictest0-21swapper/222:05:072
458999210,20cyclictest0-21swapper/220:50:042
458999210,20cyclictest0-21swapper/220:35:062
458999210,1cyclictest21324-21munin-run00:05:012
458999210,0cyclictest0-21swapper/221:15:042
458999210,0cyclictest0-21swapper/200:05:062
4588992120,1cyclictest29193-21apt-get00:20:081
4588992120,1cyclictest0-21swapper/121:45:061
4588992120,0cyclictest0-21swapper/120:40:061
4588992119,1cyclictest0-21swapper/122:35:051
458899210,21cyclictest0-21swapper/122:00:041
458899210,21cyclictest0-21swapper/119:20:051
458899210,20cyclictest0-21swapper/121:15:041
458899210,20cyclictest0-21swapper/119:35:041
458899210,1cyclictest29073-21turbostat21:05:001
458899210,0cyclictest0-21swapper/121:10:051
458899210,0cyclictest0-21swapper/121:05:031
4587992120,0cyclictest0-21swapper/022:30:090
4587992119,1cyclictest9182-21munin-run23:40:000
458799210,21cyclictest0-21swapper/021:00:040
458799210,20cyclictest29694-21apt-get20:00:040
458799210,0cyclictest31737-21apt-get22:15:020
458799210,0cyclictest31737-21apt-get22:15:020
458799210,0cyclictest0-21swapper/022:40:060
458799210,0cyclictest0-21swapper/019:30:030
4590992020,0cyclictest32129-21apt-get21:10:053
4590992020,0cyclictest24883-21apt-get19:50:053
4590992020,0cyclictest21733-21apt-get20:50:033
4590992020,0cyclictest11836-21apt-get23:45:073
4590992020,0cyclictest0-21swapper/323:50:053
4590992020,0cyclictest0-21swapper/323:30:043
4590992020,0cyclictest0-21swapper/322:10:063
4590992020,0cyclictest0-21swapper/320:15:043
4590992020,0cyclictest0-21swapper/300:05:063
4590992018,1cyclictest9044-21munin-run20:25:003
4590992018,1cyclictest12185-21munin-run19:25:003
459099200,20cyclictest0-21swapper/320:40:063
459099200,0cyclictest21777-21apt-get21:55:043
459099200,0cyclictest1559-21apt-get00:30:053
459099200,0cyclictest0-21swapper/323:00:023
4589992020,0cyclictest14228-21apt-get23:50:052
4589992020,0cyclictest0-21swapper/223:40:072
4589992020,0cyclictest0-21swapper/222:55:062
4589992020,0cyclictest0-21swapper/222:40:052
4589992020,0cyclictest0-21swapper/222:15:022
4589992020,0cyclictest0-21swapper/222:15:022
4589992020,0cyclictest0-21swapper/220:25:042
4589992020,0cyclictest0-21swapper/220:00:042
4589992020,0cyclictest0-21swapper/219:40:022
4589992018,1cyclictest0-21swapper/221:10:002
458999200,20cyclictest0-21swapper/219:45:052
458999200,19cyclictest6733-21cron23:35:002
458999200,0cyclictest0-21swapper/223:00:072
458999200,0cyclictest0-21swapper/219:30:032
4588992020,0cyclictest14145-21apt-get21:40:051
4588992020,0cyclictest0-21swapper/123:35:061
4588992020,0cyclictest0-21swapper/122:20:031
4588992020,0cyclictest0-21swapper/120:20:041
4588992020,0cyclictest0-21swapper/120:10:031
4588992020,0cyclictest0-21swapper/120:00:041
4588992019,0cyclictest0-21swapper/123:30:041
458899200,20cyclictest0-21swapper/100:30:061
458899200,0cyclictest0-21swapper/123:50:051
458899200,0cyclictest0-21swapper/122:55:061
458899200,0cyclictest0-21swapper/120:55:041
4587992020,0cyclictest0-21swapper/023:25:070
4587992020,0cyclictest0-21swapper/020:05:040
4587992020,0cyclictest0-21swapper/019:35:050
4587992020,0cyclictest0-21swapper/000:20:080
4587992020,0cyclictest0-21swapper/000:10:020
4587992019,1cyclictest31459-21apt-get21:10:000
458799200,20cyclictest0-21swapper/023:05:060
458799200,0cyclictest0-21swapper/020:40:060
458799200,0cyclictest0-21swapper/020:30:040
458799200,0cyclictest0-21swapper/020:25:040
4590991919,0cyclictest12077-21apt-get20:30:043
4590991919,0cyclictest0-21swapper/321:30:053
4590991919,0cyclictest0-21swapper/321:00:043
4590991918,1cyclictest31328-21idleruntime-cro00:25:003
4590991918,0cyclictest26629-21apt-get23:10:043
4590991917,1cyclictest13535-21apt-get22:45:023
4589991919,0cyclictest17283-21apt-get19:35:042
4589991919,0cyclictest14185-21apt-get22:45:052
4589991919,0cyclictest0-21swapper/219:15:022
4589991918,1cyclictest0-21swapper/200:15:052
4589991918,0cyclictest0-21swapper/220:40:062
4589991917,1cyclictest1310-21grep00:30:002
4589991917,1cyclictest11730-21apt-get21:35:062
4589991917,1cyclictest0-21swapper/222:05:002
4588991919,0cyclictest0-21swapper/122:50:061
4588991919,0cyclictest0-21swapper/122:25:051
4588991919,0cyclictest0-21swapper/121:35:061
4588991918,0cyclictest0-21swapper/123:40:071
4587991919,0cyclictest28756-21apt-get23:15:020
4587991919,0cyclictest19184-21apt-get00:00:060
4587991919,0cyclictest0-21swapper/023:40:070
4587991919,0cyclictest0-21swapper/023:10:040
4587991919,0cyclictest0-21swapper/022:45:060
4587991919,0cyclictest0-21swapper/022:35:050
4587991919,0cyclictest0-21swapper/021:30:040
4587991919,0cyclictest0-21swapper/019:40:020
4587991918,1cyclictest31838-21apt-get23:20:050
4587991917,1cyclictest313-21systemd-journal21:25:010
4587991917,1cyclictest28986-21apt-get22:10:060
4587991917,1cyclictest0-21swapper/019:30:000
4590991818,0cyclictest0-21swapper/323:05:073
4590991818,0cyclictest0-21swapper/321:15:043
4590991817,0cyclictest3964-21apt-get00:35:063
4589991817,1cyclictest31838-21apt-get23:20:052
4589991817,0cyclictest16635-21apt-get22:50:062
4589991816,1cyclictest8692-21cron22:35:012
458999180,0cyclictest0-21swapper/221:10:052
4588991818,0cyclictest0-21swapper/119:10:041
4588991817,0cyclictest0-21swapper/119:45:051
4588991816,1cyclictest21109-21dump-pmu-power21:55:001
4588991816,1cyclictest0-21swapper/120:05:031
458899180,0cyclictest0-21swapper/119:30:031
4587991818,0cyclictest0-21swapper/022:25:050
4587991818,0cyclictest0-21swapper/021:55:040
4587991818,0cyclictest0-21swapper/019:15:020
4587991816,1cyclictest23719-21grep00:10:010
4587991816,1cyclictest0-21swapper/000:40:010
458799180,17cyclictest14476-21apt-get20:35:060
4590991717,0cyclictest0-21swapper/322:50:063
4590991717,0cyclictest0-21swapper/322:20:033
4590991717,0cyclictest0-21swapper/319:55:053
4590991717,0cyclictest0-21swapper/319:10:033
4590991716,1cyclictest4180-21apt-get22:25:053
4590991715,1cyclictest0-21swapper/319:20:013
4589991717,0cyclictest0-21swapper/223:35:062
4589991717,0cyclictest0-21swapper/221:45:062
4589991717,0cyclictest0-21swapper/221:30:052
4589991717,0cyclictest0-21swapper/200:20:082
4589991715,1cyclictest18988-21apt-get21:50:052
4588991717,0cyclictest0-21swapper/120:35:061
4588991717,0cyclictest0-21swapper/119:15:051
458899170,0cyclictest4468-21apt-get20:15:041
4587991717,0cyclictest0-21swapper/023:45:070
4587991717,0cyclictest0-21swapper/021:10:050
4587991717,0cyclictest0-21swapper/019:50:050
4590991616,0cyclictest22488-21apt-get19:45:053
4590991616,0cyclictest0-21swapper/321:50:053
4590991616,0cyclictest0-21swapper/320:05:043
4590991616,0cyclictest0-21swapper/319:25:023
4590991615,0cyclictest0-21swapper/321:20:043
4589991616,0cyclictest0-21swapper/222:35:052
4589991616,0cyclictest0-21swapper/219:10:042
4589991615,1cyclictest6934-21apt-get21:25:022
4589991614,1cyclictest6128-21perf00:40:012
4589991614,1cyclictest2074-21apt-get20:10:032
4588991616,0cyclictest0-21swapper/123:20:051
458899160,15cyclictest0-21swapper/122:15:011
4587991616,0cyclictest24193-21apt-get22:00:030
4587991616,0cyclictest0-21swapper/023:55:050
4587991614,1cyclictest0-21swapper/020:00:010
458799160,15cyclictest0-21swapper/021:00:010
4590991515,0cyclictest0-21swapper/323:25:073
4590991515,0cyclictest0-21swapper/322:30:093
4590991515,0cyclictest0-21swapper/321:25:033
459099150,1cyclictest29695-21dpkg20:00:033
459099150,1cyclictest24717-21perl22:00:053
458999150,14cyclictest27280-21apt-get19:55:062
458999150,14cyclictest26942-21apt-get21:00:042
458999150,14cyclictest0-21swapper/219:20:062
4588991515,0cyclictest9333-21apt-get21:30:051
4588991515,0cyclictest0-21swapper/122:40:061
458899150,0cyclictest3964-21apt-get00:35:051
4587991515,0cyclictest0-21swapper/022:50:060
458799150,15cyclictest0-21swapper/021:49:230
4590991414,0cyclictest14883-21apt-get19:30:033
459099140,14cyclictest0-21swapper/322:40:463
459099140,14cyclictest0-21swapper/321:36:483
459099140,14cyclictest0-21swapper/320:25:413
459099140,14cyclictest0-21swapper/320:11:143
459099140,14cyclictest0-21swapper/300:25:293
459099140,14cyclictest0-21swapper/300:16:533
459099140,0cyclictest0-21swapper/323:21:093
4589991414,0cyclictest0-21swapper/221:40:502
4589991414,0cyclictest0-21swapper/220:45:042
4589991414,0cyclictest0-21swapper/200:30:052
4589991412,1cyclictest0-21swapper/223:45:082
458999140,0cyclictest0-21swapper/219:50:012
4588991414,0cyclictest0-21swapper/123:45:071
4588991414,0cyclictest0-21swapper/123:17:271
4588991414,0cyclictest0-21swapper/122:30:011
458899140,14cyclictest0-21swapper/119:25:221
458899140,0cyclictest0-21swapper/122:05:121
458899140,0cyclictest0-21swapper/100:05:141
4587991414,0cyclictest19340-21apt-get20:45:040
4587991414,0cyclictest0-21swapper/023:30:390
4587991414,0cyclictest0-21swapper/023:00:250
4587991414,0cyclictest0-21swapper/021:40:290
4587991414,0cyclictest0-21swapper/019:45:050
458799140,14cyclictest0-21swapper/020:50:260
458799140,14cyclictest0-21swapper/020:10:420
458799140,0cyclictest0-21swapper/022:55:170
458799140,0cyclictest0-21swapper/022:05:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional