You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 05:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot5s.osadl.org (updated Wed Dec 03, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1276199240,23cyclictest10985-21perf22:25:002
12757992422,1cyclictest27590-21latency_hist19:40:001
1275799240,24cyclictest0-21swapper/123:03:051
1275799240,23cyclictest0-21swapper/119:43:061
1276599230,2cyclictest2073-21grep21:00:003
1276599230,22cyclictest4502-21munin-run21:05:003
1276599230,22cyclictest31380-21sendmail-msp22:00:013
1276199230,22cyclictest24940-21sed23:59:592
1275799230,22cyclictest7205-21idleruntime-cro00:30:001
1275799230,22cyclictest14702-21basename23:40:011
1275599230,22cyclictest29668-21idleruntime-cro20:50:000
12765992221,1cyclictest17002-21apt-get21:33:053
12765992220,1cyclictest24874-21perf20:39:593
12765992220,1cyclictest2392-21apt19:55:003
1276599220,21cyclictest331rcuc/321:20:003
1276599220,21cyclictest24662-21apt-get21:48:053
1276599220,21cyclictest18697-21apt-get22:43:063
1276599220,1cyclictest3763-21dump-pmu-power22:10:003
1276599220,1cyclictest12906-21apt-get20:18:053
12761992222,0cyclictest25386-21apt-get20:43:072
12761992220,1cyclictest25453-21perf22:55:002
12761992220,1cyclictest0-21swapper/223:40:012
12761992220,1cyclictest0-21swapper/221:50:002
1276199220,21cyclictest22339-21apt-get19:30:012
1276199220,21cyclictest19398-21apt-get21:38:062
1276199220,21cyclictest17548-21latency_hist19:20:002
1276199220,21cyclictest17098-21munin-run23:45:002
1276199220,21cyclictest0-21swapper/222:18:052
12757992220,1cyclictest27853-21awk23:00:001
12757992220,1cyclictest11475-21apt-get22:28:061
12757992220,1cyclictest0-21swapper/122:45:011
1275799220,21cyclictest32399-21dump-pmu-power19:49:591
1275799220,21cyclictest2895-21apt-get19:58:061
1275799220,21cyclictest0-21swapper/122:18:061
1275799220,21cyclictest0-21swapper/120:28:051
1275799220,1cyclictest0-21swapper/120:20:011
12755992222,0cyclictest16279-21apt-get22:38:050
12755992221,1cyclictest24391-21apt-get21:45:020
12755992220,1cyclictest30272-21munin-plugin-st23:05:000
12755992220,1cyclictest0-21swapper/020:08:070
1275599220,21cyclictest6660-21apt-get22:18:060
1275599220,21cyclictest0-21swapper/021:43:060
1275599220,21cyclictest0-21swapper/021:13:050
1275599220,21cyclictest0-21swapper/020:33:060
1275599220,1cyclictest5438-21apt-get20:00:020
1275599220,1cyclictest15790-21apt22:35:000
1275599220,1cyclictest15790-21apt22:35:000
1275599220,1cyclictest15328-21apt-get20:23:070
1275599220,1cyclictest14837-21munin-run20:20:010
1275599220,1cyclictest0-21swapper/023:34:590
1275599220,1cyclictest0-21swapper/020:25:010
1275599220,0cyclictest12766-21apt-get23:38:070
12765992121,0cyclictest0-21swapper/323:03:053
12765992120,1cyclictest0-21swapper/319:30:023
12765992120,0cyclictest0-21swapper/323:18:053
12765992119,1cyclictest32427-21munin-run00:15:003
12765992119,1cyclictest27289-21basename20:45:003
12765992118,2cyclictest16511-21perf21:30:003
1276599210,20cyclictest17070-21ls23:45:003
1276599210,20cyclictest0-21swapper/322:18:063
1276599210,20cyclictest0-21swapper/321:43:063
1276599210,20cyclictest0-21swapper/319:58:063
12761992119,1cyclictest29685-21munin-run20:50:002
1276199210,20cyclictest0-21swapper/221:23:062
1276199210,20cyclictest0-21swapper/221:03:062
12757992121,0cyclictest0-21swapper/121:23:071
12757992121,0cyclictest0-21swapper/120:08:071
12757992120,0cyclictest0-21swapper/121:45:021
1275799210,20cyclictest12050-21awk00:40:001
1275799210,20cyclictest0-21swapper/121:13:051
1275799210,20cyclictest0-21swapper/120:43:071
1275799210,1cyclictest22339-21apt-get19:30:021
1275799210,0cyclictest15634-21apt-get19:18:041
1275799210,0cyclictest0-21swapper/120:53:071
1275799210,0cyclictest0-21swapper/119:13:051
12755992121,0cyclictest0-21swapper/019:43:060
12755992120,1cyclictest10119-21apt-get00:38:070
12755992118,2cyclictest4770-21cron20:00:000
1275599210,20cyclictest457-21apt-get00:18:050
1275599210,20cyclictest0-21swapper/019:18:040
1275599210,0cyclictest0-21swapper/021:03:060
1275599210,0cyclictest0-21swapper/000:08:080
12765992020,0cyclictest20450-21apt-get19:28:073
12765992020,0cyclictest0-21swapper/323:38:073
12765992020,0cyclictest0-21swapper/322:33:063
12765992020,0cyclictest0-21swapper/322:33:063
12765992020,0cyclictest0-21swapper/322:13:073
12765992020,0cyclictest0-21swapper/322:03:063
12765992020,0cyclictest0-21swapper/320:23:083
12765992020,0cyclictest0-21swapper/320:08:073
12765992020,0cyclictest0-21swapper/320:03:053
12765992020,0cyclictest0-21swapper/319:23:043
12765992020,0cyclictest0-21swapper/300:38:083
1276599200,0cyclictest30508-21apt-get19:48:063
1276599200,0cyclictest28126-21apt-get00:08:083
1276599200,0cyclictest0-21swapper/320:48:073
12761992020,0cyclictest21818-21apt-get21:43:062
12761992020,0cyclictest0-21swapper/222:58:052
12761992020,0cyclictest0-21swapper/222:48:072
12761992020,0cyclictest0-21swapper/222:38:052
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional