You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 17:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Tue Apr 28, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19748332980,3sleep10-21swapper/122:55:191
19645612950,3sleep23056-21PK-Backend22:25:202
139099910,77rtkit-daemon0-21swapper/319:05:313
189353528039,13sleep10-21swapper/119:05:301
189362927741,13sleep20-21swapper/219:06:272
189320426240,13sleep00-21swapper/019:05:250
189406299381,25cyclictest1934657-21munin-run21:05:013
19937472300,3chrt0-21swapper/123:50:161
139099300,21rtkit-daemon1939886-21munin-run21:20:002
19571872290,10sleep013-21ksoftirqd/022:05:210
189406299293,24cyclictest1989444-21munin-run23:40:003
189406299285,20cyclictest1949324-21grep21:45:133
189406299280,6cyclictest1991439-21apt23:45:133
1894062992610,14cyclictest1896881-21hddtemp_smartct19:15:173
139099260,19rtkit-daemon3056-21PK-Backend23:37:112
189406299259,14cyclictest1958724-21awk22:10:183
189406299256,17cyclictest1904648-21sed19:35:213
189406299251,22cyclictest883-21dbus-daemon19:55:003
1894062992512,11cyclictest2006375-21wc00:25:213
1894062992510,13cyclictest1920043-21awk20:20:183
1894062992510,13cyclictest1920043-21awk20:20:183
19278092240,3sleep30-21swapper/320:45:003
189406299248,14cyclictest1976425-21sed23:00:183
189406299247,15cyclictest1974082-21find22:55:113
189406299246,16cyclictest1969410-21latency22:40:183
189406299241,20cyclictest0-21swapper/321:10:123
189406299241,20cyclictest0-21swapper/319:10:123
1894062992410,12cyclictest2005392-21cat00:25:003
189406299240,22cyclictest1999247-21python300:05:213
189406299240,22cyclictest1911351-21/usr/sbin/munin19:55:193
1894060992416,6cyclictest883-21dbus-daemon00:29:372
189406099240,5cyclictest978-21snmpd23:50:482
189406099240,22cyclictest2003414-21gpgv00:20:012
189405099241,20cyclictest883-21dbus-daemon23:09:370
189406299238,13cyclictest2008074-21ntpq00:30:193
189406299238,13cyclictest2008074-21ntpq00:30:193
189406299238,13cyclictest1990494-21grep23:40:193
189406299238,13cyclictest1947812-21sed21:40:173
189406299236,15cyclictest1953771-21sed21:55:233
189406299234,17cyclictest436-20systemd-journal20:56:433
189406299234,17cyclictest1942444-21expr21:25:163
189406299233,18cyclictest1993321-21grep23:50:113
189406299233,18cyclictest1905766-21expr19:40:143
189406299231,9cyclictest1984642-21tr23:25:133
189406299231,3cyclictest1983476-21/usr/sbin/munin23:20:183
1894062992310,11cyclictest1954949-21if_enp2s022:00:163
189406299230,4cyclictest1978277-21ntp_kernel_pll_23:05:183
189406299230,21cyclictest2010131-21taskset00:35:223
189406299230,21cyclictest1962692-21awk22:20:183
189406299230,20cyclictest1965433-21apt22:30:123
1894050992320,2cyclictest3056-21PK-Backend19:45:480
1894050992313,7cyclictest1915541-21turbostat20:10:010
1894050992312,8cyclictest1903138-21apt-get19:35:000
19619642220,4sleep23056-21PK-Backend22:20:112
189406299226,14cyclictest2002023-21grep00:15:143
189406299226,14cyclictest1964750-21cat22:25:213
189406299226,14cyclictest1945624-21expr21:35:123
189406299225,15cyclictest1917658-21cpuspeed_turbos20:15:143
189406299224,16cyclictest1907502-21df19:45:143
189406299223,17cyclictest1987098-21seq23:30:193
189406299223,17cyclictest1987098-21seq23:30:183
1894062992211,9cyclictest1994874-21/usr/sbin/munin23:55:153
189406299221,19cyclictest1944569-21timerandwakeup21:30:233
1894062992211,9cyclictest1938474-21cpuspeed21:15:133
189406299221,16cyclictest1972365-21apt22:50:123
1894062992210,10cyclictest2000284-21tr00:10:133
1894062992210,10cyclictest1997014-21df00:00:143
189406299220,2cyclictest2156-21gnome-shell20:06:093
1894060992220,1cyclictest0-21swapper/220:34:522
1894060992220,1cyclictest0-21swapper/220:34:522
1894060992219,2cyclictest3056-21PK-Backend22:18:212
1894060992219,1cyclictest0-21swapper/221:34:202
1894060992215,5cyclictest978-21snmpd19:55:592
1894050992220,1cyclictest3056-21PK-Backend21:34:040
1894050992220,1cyclictest0-21swapper/022:12:430
1894050992220,1cyclictest0-21swapper/020:54:150
1894050992220,1cyclictest0-21swapper/020:32:460
1894050992220,1cyclictest0-21swapper/020:32:450
1894050992220,1cyclictest0-21swapper/000:31:340
1894050992220,1cyclictest0-21swapper/000:31:340
1894050992220,1cyclictest0-21swapper/000:24:240
1894050992219,2cyclictest3056-21PK-Backend19:40:210
189405099220,21cyclictest3056-21PK-Backend20:12:240
189405099220,20cyclictest3056-21PK-Backend23:00:350
139099220,15rtkit-daemon34-21ksoftirqd/221:26:532
139099220,14rtkit-daemon0-21swapper/200:01:292
18988272210,4sleep10-21swapper/119:20:171
189406299216,13cyclictest1982082-21timerwakeupswit23:15:233
189406299216,13cyclictest1940977-21gunzip21:20:193
189406299216,13cyclictest1928141-21tr20:45:133
189406299216,13cyclictest1920733-21latency_hist20:25:003
189406299215,14cyclictest1916811-21timerwakeupswit20:10:233
189406299215,14cyclictest1899174-21cat19:20:223
189406299215,13cyclictest1902471-21proc_pri19:30:193
189406299213,16cyclictest1970619-21find22:45:133
1894062992119,1cyclictest3056-21PK-Backend20:39:553
1894062992119,1cyclictest0-21swapper/322:39:253
1894062992119,1cyclictest0-21swapper/322:15:263
1894062992119,1cyclictest0-21swapper/321:51:063
1894062992119,1cyclictest0-21swapper/320:52:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional