You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 06:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed May 06, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21001922910,2chrt471rcuc/323:20:013
1849444997262,7cyclictest1901663-21latency_hist20:00:011
1849447996446,16cyclictest2099961-21gpgv23:20:012
1849447996241,18cyclictest280-21systemd-journal00:08:242
1849440995748,7cyclictest1916791-21apt-get20:15:570
1849440995545,7cyclictest2045217-21latency_hist22:25:010
1849444995445,7cyclictest2150108-21apt-get00:10:581
1849444995144,5cyclictest2075440-21apt-get22:55:581
1849444995143,6cyclictest1966127-21kworker/u8:2+flush-8:021:06:161
1849444995043,5cyclictest1911870-21apt-get20:10:581
1849444995040,7cyclictest1975113-21ntpq21:11:121
19403672490,1sleep01940369-21missed_timers20:36:100
1849444994944,4cyclictest1813032-21kworker/u8:0+flush-8:021:26:161
1849444994839,7cyclictest1955350-21ntpq20:51:111
1849440994840,6cyclictest280-21systemd-journal00:40:010
1849440994839,6cyclictest2035325-21latency_hist22:15:010
21230842470,4chrt371rcuc/223:41:072
1849444994742,4cyclictest1839772-21kworker/u8:1+flush-8:021:01:141
1849444994738,6cyclictest1980921-21latency_hist21:20:011
1849440994640,5cyclictest1839772-21kworker/u8:1+events_unbound19:15:030
1849440994639,5cyclictest2159383-21kworker/u8:0+events_unbound00:26:020
1849444994537,6cyclictest1856833-21apt-get19:15:581
1849440994535,7cyclictest1951262-21latency_hist20:50:010
1849440994535,7cyclictest1951262-21latency_hist20:50:010
1849440994534,8cyclictest1849292-21latency_hist19:10:000
1849444994434,8cyclictest1905735-21ntpq20:01:101
1849444994339,3cyclictest1813032-21kworker/u8:0+flush-8:020:46:031
1849444994339,3cyclictest1813032-21kworker/u8:0+flush-8:020:46:021
1849444994337,4cyclictest1871187-21apt-get19:26:521
1849444994336,5cyclictest1931849-21apt-get20:30:561
1849444994336,5cyclictest1813032-21kworker/u8:0+flush-8:021:21:151
1849444994335,6cyclictest1817955-21kworker/u8:3+flush-8:019:11:081
1849444994334,7cyclictest1886919-21/usr/sbin/munin19:46:061
20855732420,2sleep375-21kworker/3:1-events23:06:013
1849447994231,8cyclictest1854661-21cat19:15:002
1849444994233,7cyclictest1880795-21ntpq19:36:111
1849440994233,7cyclictest2099835-21latency_hist23:20:010
1849444994137,3cyclictest2055054-21kworker/u8:3+flush-8:022:41:191
1849444994134,5cyclictest2104228-21kworker/u8:3+events_unbound23:21:161
1849444994030,7cyclictest1941377-21latency_hist20:40:011
1849444993934,4cyclictest1813032-21kworker/u8:0+events_unbound20:41:001
1849444993933,4cyclictest1995770-21kworker/u8:3+flush-8:022:11:011
1849440993932,5cyclictest1839772-21kworker/u8:1+flush-8:019:21:160
1849440993931,6cyclictest2050148-21apt-get22:30:000
1849447993823,13cyclictest2119800-21unixbench_singl23:36:152
1849444993831,5cyclictest280-21systemd-journal23:49:241
1849444993831,5cyclictest280-21systemd-journal00:28:261
1849444993831,5cyclictest2135273-21apt-get23:55:561
1849444993732,4cyclictest1839772-21kworker/u8:1+flush-8:019:51:021
1849444993731,4cyclictest2015525-21kworker/u8:1+flush-8:022:51:101
1849440993729,7cyclictest1995770-21kworker/u8:3+flush-8:021:56:150
1849440993728,6cyclictest1995743-21latency_hist21:35:010
1849444993630,5cyclictest1995770-21kworker/u8:3+flush-8:021:56:121
1849444993627,7cyclictest2158798-21ntpq00:16:101
1849440993629,5cyclictest2094055-21ntpq23:11:120
1849440993627,7cyclictest280-21systemd-journal23:30:000
1849440993626,7cyclictest2065222-21latency_hist22:45:010
1849447993523,9cyclictest2080072-21awk23:00:012
1849447993522,11cyclictest1907945-21kthreadcore20:06:052
184944799352,14cyclictest2110301-21apt-get23:30:592
1849447993521,12cyclictest2080506-21aten2_r5power_v23:00:592
1849447993521,12cyclictest1990452-21unixbench_singl21:26:182
184944799351,13cyclictest2030661-21apt-get22:10:582
1849444993531,3cyclictest2055054-21kworker/u8:3+events_unbound22:45:581
1849444993530,3cyclictest2115471-21apt-get23:35:561
1849444993528,5cyclictest2089630-21grep23:06:181
1849447993429,3cyclictest2104228-21kworker/u8:3+events_unbound23:25:022
1849447993427,5cyclictest1871475-21apt-get19:29:592
184944799342,11cyclictest2060617-21apt-get22:41:002
1849447993415,17cyclictest2089575-21unixbench_multi23:06:182
1849444993431,2cyclictest1996780-21irqrtprio21:36:031
1849444993428,4cyclictest1839772-21kworker/u8:1+flush-8:019:21:161
1849444993425,7cyclictest280-21systemd-journal23:55:001
1849440993429,4cyclictest2055054-21kworker/u8:3+events_unbound22:56:000
1849440993428,4cyclictest2055054-21kworker/u8:3+flush-8:022:46:010
1849440993425,7cyclictest280-21systemd-journal20:30:000
1849447993316,15cyclictest2054987-21unixbench_singl22:31:182
1849447993314,16cyclictest1980391-21wc21:16:162
1849444993328,4cyclictest2159383-21kworker/u8:0+events_unbound00:21:141
1849444993328,4cyclictest1871958-21kworker/u8:3+flush-8:020:21:131
1849440993325,5cyclictest2040243-21latency_hist22:20:000
184944799321,12cyclictest2169913-21apt-get00:30:582
1849447993211,2cyclictest0-21swapper/219:15:032
1849444993228,3cyclictest2055054-21kworker/u8:3+flush-8:022:36:091
1849444993224,6cyclictest2044335-21ntpq22:21:101
1849444993224,6cyclictest2015525-21kworker/u8:1+events_unbound00:06:021
1849440993226,4cyclictest2060272-21latency_hist22:40:010
1849440993226,4cyclictest1871958-21kworker/u8:3+events_unbound20:21:010
1849440993225,5cyclictest1817955-21kworker/u8:3+events_unbound19:11:050
1849440993223,6cyclictest2149785-21latency_hist00:10:010
184944799312,11cyclictest2163741-21ntpq00:21:102
1849447993118,11cyclictest2055886-21cpuspeed_turbos22:36:002
1849447993118,11cyclictest0-21swapper/222:30:002
184944799311,12cyclictest2164958-21apt-get00:26:002
1849444993126,4cyclictest2159383-21kworker/u8:0+flush-8:000:31:161
1849444993126,3cyclictest2179085-21unixbench_multi00:36:171
1849444993125,5cyclictest2030062-21kworker/u8:2+events_unbound22:30:011
1849444993124,5cyclictest2015525-21kworker/u8:1+events_unbound23:01:101
1849444993121,8cyclictest280-21systemd-journal19:45:001
1849440993124,6cyclictest2045442-21kworker/u8:0+flush-8:000:01:010
184944799302,6cyclictest1911870-21apt-get20:10:592
1849447993015,13cyclictest1931129-21unixbench_multi20:26:172
184944799301,12cyclictest1886944-21apt-get19:45:552
1849444993025,4cyclictest2015525-21kworker/u8:1+flush-8:022:16:021
1849444993025,4cyclictest1871958-21kworker/u8:3+flush-8:020:16:051
1849444993025,3cyclictest2015525-21kworker/u8:1+events_unbound22:06:061
1849444993024,5cyclictest1995770-21kworker/u8:3+flush-8:021:51:101
1849444993024,4cyclictest2015525-21kworker/u8:1+events_unbound22:01:061
1849444993024,4cyclictest1995770-21kworker/u8:3+events_unbound21:41:121
1849444993022,6cyclictest2045442-21kworker/u8:0+flush-8:023:16:021
1849440993025,3cyclictest2174530-21idleruntime-cro00:35:000
1849440993024,4cyclictest2089071-21ntpq23:06:100
1849440993024,4cyclictest1980512-21grep21:16:160
1849440993024,4cyclictest1813032-21kworker/u8:0+events_unbound21:36:020
1849440993019,9cyclictest1907184-21diskstats20:06:010
19848132290,3sleep00-21swapper/021:21:080
184944799293,6cyclictest1872032-21apt-get19:30:592
184944799293,3cyclictest19403692missed_timers20:36:102
184944799292,4cyclictest2155064-21apt-get00:15:572
1849447992913,14cyclictest1936430-21cron20:35:002
1849447992913,14cyclictest0-21swapper/222:05:562
1849447992913,14cyclictest0-21swapper/221:11:102
1849447992912,15cyclictest280-21systemd-journal21:25:002
1849444992924,4cyclictest2045442-21kworker/u8:0+flush-8:023:31:151
1849444992922,5cyclictest2115380-21kworker/u8:4+flush-8:023:41:161
1849444992920,6cyclictest280-21systemd-journal21:34:211
1849444992919,7cyclictest2144851-21latency_hist00:05:011
1849440992923,4cyclictest1813032-21kworker/u8:0+flush-8:020:51:150
1849440992922,5cyclictest1882738-21irqrtprio19:41:050
184944799287,3cyclictest0-21swapper/222:21:122
184944799286,2cyclictest0-21swapper/219:50:582
184944799285,7cyclictest1999719-21grep21:36:082
184944799282,6cyclictest2039354-21ntpq22:16:112
184944799282,4cyclictest1956539-21apt-get20:55:582
1849447992817,9cyclictest0-21swapper/220:25:002
1849447992813,13cyclictest1941939-21cpuspeed_turbos20:41:002
1849444992822,5cyclictest1995770-21kworker/u8:3+flush-8:021:46:131
1849444992821,5cyclictest1871958-21kworker/u8:3+flush-8:019:31:121
1849440992823,4cyclictest1813032-21kworker/u8:0+events_unbound21:26:170
1849440992823,3cyclictest2115380-21kworker/u8:4+events_unbound23:46:000
1849440992823,3cyclictest2114911-21cron23:35:000
1849440992822,4cyclictest2015525-21kworker/u8:1+events_unbound22:01:130
1849440992822,4cyclictest1946000-21unixbench_singl20:41:170
1849440992821,5cyclictest2155121-21aten2_r5power_e00:15:590
184944799275,7cyclictest1920271-21tr20:16:072
184944799273,6cyclictest1897048-21apt-get19:55:582
184944799271,9cyclictest1991320-21/usr/sbin/munin21:31:002
184944799271,8cyclictest1902164-21/usr/sbin/munin20:00:592
184944799271,4cyclictest2019677-21ntpq21:56:132
1849447992712,13cyclictest2001076-21aten2_r5power_e21:41:012
1849447992712,13cyclictest0-21swapper/222:01:002
1849447992710,3cyclictest1877301-21fschecks_count19:36:022
1849447992710,1cyclictest0-21swapper/200:01:092
1849444992722,3cyclictest1930694-21ntpq20:26:121
1849440992723,3cyclictest2120149-21idleruntime-cro23:40:000
1849440992722,3cyclictest2045442-21kworker/u8:0+events_unbound23:21:010
1849440992722,3cyclictest1916468-21basename20:14:590
1849440992720,5cyclictest2139486-21unixbench_multi23:56:170
1849440992720,5cyclictest2025962-21cpuspeed_turbos22:06:010
184944799267,5cyclictest2013489-21cut21:51:072
184944799266,4cyclictest1964918-21cut21:01:072
184944799265,7cyclictest2070359-21sed22:50:012
184944799265,6cyclictest2175742-21cut00:36:052
184944799263,6cyclictest0-21swapper/219:25:012
184944799261,8cyclictest1951658-21cut20:51:002
184944799261,10cyclictest2101329-21ps23:21:062
1849447992610,2cyclictest0-21swapper/222:51:052
1849440992622,3cyclictest2010563-21awk21:49:590
1849440992622,3cyclictest1871958-21kworker/u8:3+flush-8:019:31:210
1849440992620,4cyclictest2134555-21unixbench_multi23:51:200
184944799256,6cyclictest2150155-21cut00:11:002
1849447992521,2cyclictest2135385-21aten2_r5power_v23:55:592
184944799251,9cyclictest1950385-21ntpq20:46:112
184944799251,9cyclictest1950385-21ntpq20:46:112
184944799251,8cyclictest2010220-21unixbench_singl21:46:192
184944799251,8cyclictest1882386-21/usr/sbin/munin19:41:022
1849447992511,12cyclictest0-21swapper/221:06:032
1849444992521,3cyclictest2030062-21kworker/u8:2+events_unbound22:26:021
1849444992520,3cyclictest2104228-21kworker/u8:3+events_unbound23:26:071
1849440992522,2cyclictest1895799-21needreboot19:51:090
1849440992521,2cyclictest0-21swapper/021:00:000
1849440992520,4cyclictest1966127-21kworker/u8:2+flush-8:021:06:020
1849440992520,4cyclictest1839772-21kworker/u8:1+flush-8:019:56:010
184944799241,9cyclictest2129221-21ntp_states23:46:112
1849444992419,4cyclictest1871958-21kworker/u8:3+events_unbound20:05:581
1849440992419,4cyclictest2045442-21kworker/u8:0+flush-8:022:31:030
1849440992419,3cyclictest1877326-21fschecks_count19:36:020
1849440992418,5cyclictest1839772-21kworker/u8:1+events_unbound20:31:110
1849440992414,2cyclictest161rcu_preempt00:11:150
184944799231,9cyclictest2131056-21ps23:51:072
1849447992310,11cyclictest0-21swapper/223:11:022
1849444992315,6cyclictest1813032-21kworker/u8:0+flush-8:020:56:121
1849440992319,3cyclictest2015525-21kworker/u8:1+events_unbound23:01:140
1849440992319,3cyclictest0-21swapper/000:25:000
1849440992319,2cyclictest0-21swapper/021:05:010
1849440992318,3cyclictest2074728-21unixbench_multi22:51:180
1849440992317,4cyclictest1975654-21unixbench_singl21:11:180
1849440992316,5cyclictest1866872-21aten2_r5power_e19:25:590
18585952220,2sleep3471rcuc/319:16:073
1849444992217,3cyclictest0-21swapper/123:11:011
1849440992113,6cyclictest2000992-21/usr/sbin/munin21:41:110
1849440992111,8cyclictest2124255-21ntpq23:41:110
18447112214,12sleep10-21swapper/119:05:391
184944099206,12cyclictest2011803-21kthreadcore21:51:070
1849440992016,3cyclictest1891176-21unixbench_multi19:46:150
216567821910,5sleep30-21swapper/300:26:073
1849440991913,5cyclictest407-21mta-sts-daemon20:03:200
18489962184,9sleep20-21swapper/219:06:242
18447032183,8sleep30-21swapper/319:05:333
20050262155,7sleep30-21swapper/321:41:193
19463382152,7sleep30-21swapper/320:45:013
21786072142,8sleep30-21swapper/300:36:103
20850412133,5sleep30-21swapper/323:05:013
20751872132,6sleep30-21swapper/322:55:023
21597252122,5sleep30-21swapper/300:20:013
21541462122,6sleep30-21swapper/300:11:193
21395282122,6sleep30-21swapper/323:56:183
21343592122,6sleep30-21swapper/323:51:203
21254422122,6sleep30-21swapper/323:45:573
21210172122,6sleep30-21swapper/323:41:053
21195532122,6sleep30-21swapper/323:36:153
21099952122,5sleep30-21swapper/323:30:013
21060522122,6sleep30-21swapper/323:26:043
21001922122,5sleep30-21swapper/323:20:023
20909982122,6sleep30-21swapper/323:11:073
20582942122,6sleep30-21swapper/322:36:083
20514242122,6sleep30-21swapper/322:31:073
20353472122,5sleep30-21swapper/322:15:013
20347022122,6sleep30-21swapper/322:11:163
20256312122,5sleep30-21swapper/322:05:023
20209792123,5sleep30-21swapper/322:01:013
20105822122,5sleep30-21swapper/321:50:013
20063282122,6sleep30-21swapper/321:46:043
19861662122,6sleep30-21swapper/321:25:583
19760992122,6sleep30-21swapper/321:15:023
19752872122,6sleep30-21swapper/321:11:173
19664322122,6sleep30-21swapper/321:05:593
19617202122,6sleep30-21swapper/321:01:023
19562042122,7sleep30-21swapper/320:55:003
19376462122,6sleep30-21swapper/320:36:053
19356272123,5sleep30-21swapper/320:31:123
19255622122,6sleep30-21swapper/320:21:133
19115722122,5sleep30-21swapper/320:10:013
19074072122,6sleep30-21swapper/320:06:043
18958542123,5sleep30-21swapper/319:51:113
18866422122,5sleep30-21swapper/319:45:003
18714612122,6sleep30-21swapper/319:30:013
18615312122,5sleep30-21swapper/319:20:013
18543322124,5sleep30-21swapper/319:14:443
21726512112,5sleep30-21swapper/300:31:093
21588442112,5sleep30-21swapper/300:16:123
21451792112,5sleep30-21swapper/300:06:013
21440152112,5sleep30-21swapper/300:01:103
20709662112,6sleep30-21swapper/322:51:053
20699292112,6sleep30-21swapper/322:47:123
20603822112,5sleep30-21swapper/322:40:003
20495622112,5sleep30-21swapper/322:26:163
20408872112,5sleep30-21swapper/322:21:033
20158222112,5sleep30-21swapper/321:55:593
19969462112,5sleep30-21swapper/321:36:053
19915222112,5sleep30-21swapper/321:31:033
19816952112,5sleep30-21swapper/321:21:033
19604812112,6sleep30-21swapper/320:56:163
19504122112,5sleep30-21swapper/320:46:133
19504122112,5sleep30-21swapper/320:46:123
19268372112,6sleep30-21swapper/320:25:343
19167952112,5sleep30-21swapper/320:15:593
19019032112,5sleep30-21swapper/320:00:023
19004792112,5sleep30-21swapper/319:56:093
18819542112,5sleep30-21swapper/319:40:323
18769292112,5sleep30-21swapper/319:35:023
18720042112,5sleep30-21swapper/319:30:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional