You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 08:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Thu Jul 23, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
194542999480,46cyclictest1-21systemd00:00:000
1945429994642,3cyclictest2044195-21kworker/u8:0+flush-259:022:40:000
1945433994540,4cyclictest2206302-21kworker/u8:2+flush-259:023:55:011
1945429994339,3cyclictest3062687-21kworker/u8:3+flush-259:020:05:130
1945440994236,4cyclictest2217147-21latency_hist23:40:013
1945429994136,4cyclictest2154474-21base6422:40:010
1945429994037,2cyclictest211rcuc/000:10:000
1945433993934,3cyclictest509-21rs:main1
1945433993934,3cyclictest509-21rs:main1
1945429993835,2cyclictest2159852-21kworker/u8:3+events_unbound23:00:000
1945433993730,5cyclictest2038995-21latency_hist20:40:001
1945429993633,2cyclictest2065258-21kworker/u8:1+events_unbound21:30:180
1945440993429,3cyclictest509-21rs:main3
1945436993430,3cyclictest2044195-21kworker/u8:0+flush-259:021:45:002
1945436993429,4cyclictest2274696-21latency_hist00:40:012
1945436993428,4cyclictest335557-21systemd-journal23:50:002
1945433993430,3cyclictest3062687-21kworker/u8:3+flush-259:020:45:001
1945433993430,3cyclictest1992125-21apt-get19:55:121
1945433993328,3cyclictest1950830-21/usr/sbin/munin19:15:151
1945429993330,2cyclictest2137785-21kworker/u8:3+events_unbound22:15:230
1945436993127,3cyclictest2096226-21latency_hist21:35:002
1945429993128,2cyclictest3062687-21kworker/u8:3+flush-259:019:40:010
1945429993128,2cyclictest3062687-21kworker/u8:3+events_unbound20:40:110
1945429993128,2cyclictest2044195-21kworker/u8:0+events_unbound23:50:220
1945429993127,3cyclictest1945395-21kworker/u8:4+events_unbound20:00:210
1945429993027,2cyclictest2044195-21kworker/u8:0+events_unbound21:40:120
1945440992924,3cyclictest2054513-21gpgv20:55:013
1945440992924,3cyclictest2054513-21gpgv20:55:003
1945436992926,2cyclictest2196060-21kworker/u8:1+events_unbound23:30:012
1945436992926,2cyclictest1945395-21kworker/u8:4+flush-259:019:40:222
1945429992926,2cyclictest2132084-21kworker/u8:2+flush-259:022:10:260
1945429992924,3cyclictest2111757-21kworker/u8:1+flush-259:022:25:400
1945440992821,3cyclictest2248172-21kworker/u8:0+flush-259:000:30:153
1945436992824,3cyclictest335557-21systemd-journal00:00:002
1945436992822,4cyclictest2153691-21latency_hist22:35:022
1945433992824,3cyclictest2096496-21apt-get21:35:131
1945429992825,2cyclictest2180189-21kworker/u8:4+flush-259:023:20:160
1945429992825,2cyclictest2065258-21kworker/u8:1+events_unbound21:10:220
1945429992825,2cyclictest2044195-21kworker/u8:0+flush-259:021:35:150
1945429992824,3cyclictest2248172-21kworker/u8:0+events_unbound00:30:200
1945429992824,3cyclictest2111757-21kworker/u8:1+flush-259:022:05:190
1945429992824,3cyclictest1913086-21kworker/u8:0+events_unbound19:50:160
1945440992718,8cyclictest335557-21systemd-journal19:31:263
1945436992723,3cyclictest2170510-21apt-get22:55:122
1945436992721,4cyclictest2179714-21ntpq23:00:232
1945433992723,3cyclictest2248172-21kworker/u8:0+flush-259:000:25:151
1945429992724,2cyclictest2044195-21kworker/u8:0+events_unbound20:55:230
1945429992721,5cyclictest335557-21systemd-journal19:19:260
1945440992622,3cyclictest1945395-21kworker/u8:4+events_unbound19:45:193
1945440992621,3cyclictest1945395-21kworker/u8:4+flush-259:019:20:163
1945433992623,2cyclictest2180189-21kworker/u8:4+flush-259:023:10:201
1945433992622,3cyclictest2111757-21kworker/u8:1+flush-259:022:35:001
1945429992623,2cyclictest2196060-21kworker/u8:1+events_unbound23:25:240
1945429992623,2cyclictest2101425-21kworker/u8:3+events_unbound21:55:180
1945429992622,3cyclictest2111757-21kworker/u8:1+events_unbound21:50:330
1945429992622,3cyclictest2044195-21kworker/u8:0+events_unbound22:20:210
1945440992520,4cyclictest2254196-21kworker/u8:1+flush-259:000:30:003
1945440992518,5cyclictest2033824-21latency_hist20:35:003
1945429992522,2cyclictest3062687-21kworker/u8:3+events_unbound19:46:280
1945429992522,2cyclictest2180189-21kworker/u8:4+events_unbound23:15:240
1945429992522,2cyclictest2180189-21kworker/u8:4+events_unbound23:10:170
1945429992522,2cyclictest1945395-21kworker/u8:4+flush-259:020:25:200
1945429992521,3cyclictest2196060-21kworker/u8:1+events_unbound23:35:150
1945429992520,4cyclictest1945395-21kworker/u8:4+flush-259:019:15:000
1945436992421,2cyclictest2137785-21kworker/u8:3+flush-259:022:15:202
1945429992421,2cyclictest2044195-21kworker/u8:0+flush-259:023:45:200
1945429992421,2cyclictest2044195-21kworker/u8:0+flush-259:020:45:220
1945429992421,2cyclictest2023428-21kworker/u8:2+events_unbound21:05:240
1945429992421,2cyclictest2023428-21kworker/u8:2+events_unbound21:05:230
1945436992320,2cyclictest2065258-21kworker/u8:1+flush-259:021:20:292
1945436992319,3cyclictest335557-21systemd-journal20:15:012
1945436992319,2cyclictest2028888-21apt-get20:30:122
1945433992320,2cyclictest1913086-21kworker/u8:0+flush-259:019:50:171
1945433992319,3cyclictest1945395-21kworker/u8:4+events_unbound20:20:001
1945433992318,3cyclictest1945346-21latency_hist19:10:011
1945429992321,1cyclictest2023428-21kworker/u8:2+flush-259:020:25:000
1945429992320,2cyclictest2044195-21kworker/u8:0+events_unbound21:25:150
1945429992320,2cyclictest1913086-21kworker/u8:0+events_unbound19:55:220
1945429992319,3cyclictest2101425-21kworker/u8:3+events_unbound21:48:260
1945440992216,4cyclictest1997029-21latency_hist20:00:023
1945440992215,5cyclictest335557-21systemd-journal23:02:203
1945433992217,4cyclictest1981778-21apt-get19:45:131
1945433992217,3cyclictest2086165-21apt-get21:25:121
1945429992219,2cyclictest3062687-21kworker/u8:3+events_unbound20:15:280
1945429992219,2cyclictest1945395-21kworker/u8:4+flush-259:019:20:240
1945433992117,3cyclictest335557-21systemd-journal19:25:001
1945429992118,2cyclictest2196060-21kworker/u8:1+events_unbound23:40:130
1945429992118,2cyclictest2023428-21kworker/u8:2+flush-259:020:35:250
1945429992118,2cyclictest1945395-21kworker/u8:4+events_unbound19:43:270
1945429992117,3cyclictest2065258-21kworker/u8:1+events_unbound21:20:200
1945440992016,3cyclictest509-21rs:main3
1945429992017,2cyclictest3062687-21kworker/u8:3+events_unbound20:53:280
1945429992017,2cyclictest3062687-21kworker/u8:3+events_unbound20:53:280
1945429992017,2cyclictest2180189-21kworker/u8:4+events_unbound23:05:470
1945429992017,2cyclictest1913086-21kworker/u8:0+flush-259:019:30:260
1945429992016,3cyclictest2023428-21kworker/u8:2+events_unbound20:30:300
1945436991915,3cyclictest2175393-21kworker/u8:2+flush-259:023:09:592
1945433991916,2cyclictest2065258-21kworker/u8:1+flush-259:021:30:291
1945433991915,3cyclictest2054598-21gpgv20:55:001
1945433991915,3cyclictest2054598-21gpgv20:55:001
1945433991913,4cyclictest2137817-21apt-get22:15:111
1945429991916,2cyclictest2206302-21kworker/u8:2+events_unbound00:18:440
1945429991916,2cyclictest2111757-21kworker/u8:1+flush-259:022:00:200
1945429991916,2cyclictest1945395-21kworker/u8:4+events_unbound20:14:270
1945429991915,3cyclictest2159852-21kworker/u8:3+events_unbound23:00:180
194544099189,7cyclictest2112044-21cpuspeed_turbos21:50:133
194544099187,9cyclictest0-21swapper/319:30:013
1945436991815,2cyclictest2023414-21idleruntime-cro20:25:002
1945436991814,3cyclictest2211762-21gpgv23:35:002
1945433991815,2cyclictest0-21swapper/122:55:001
1945433991814,2cyclictest0-21swapper/123:05:001
1945433991813,3cyclictest2111977-21apt-get21:50:111
1945433991812,4cyclictest1976381-21latency_hist19:40:011
194543399180,17cyclictest1-21systemd19:35:001
194544099178,8cyclictest2012553-21unixbench_singl20:10:253
194544099178,8cyclictest0-21swapper/320:45:003
194544099178,7cyclictest0-21swapper/319:45:013
194544099174,1cyclictest0-21swapper/300:05:193
194544099171,5cyclictest2237812-21latency_hist00:00:003
194544099171,4cyclictest2196046-21grep23:19:593
194544099171,3cyclictest2085885-21cron21:25:013
1945440991713,3cyclictest2137543-21idleruntime-cro22:15:003
194544099170,4cyclictest335557-21systemd-journal20:24:593
194544099170,4cyclictest2211541-21cron23:34:593
194544099170,3cyclictest2159903-21turbostat22:45:003
1945436991714,2cyclictest2111757-21kworker/u8:1+flush-259:022:25:182
1945436991714,2cyclictest2065258-21kworker/u8:1+flush-259:021:35:262
1945436991714,2cyclictest2054470-21idleruntime-cro20:55:002
1945436991714,2cyclictest2054470-21idleruntime-cro20:55:002
1945436991714,2cyclictest1945395-21kworker/u8:4+flush-259:019:45:222
1945436991714,2cyclictest0-21swapper/222:54:592
1945436991713,2cyclictest335557-21systemd-journal23:44:592
1945433991715,1cyclictest0-21swapper/122:10:001
1945433991714,2cyclictest2191152-21apt-get23:15:131
1945429991714,2cyclictest2196060-21kworker/u8:1+events_unbound23:30:170
1945429991714,2cyclictest2044195-21kworker/u8:0+events_unbound21:15:190
1945429991713,3cyclictest2111757-21kworker/u8:1+events_unbound22:50:480
194544099167,7cyclictest491ktimers/300:20:143
194544099165,2cyclictest2080732-21cron21:20:003
194544099164,4cyclictest335557-21systemd-journal22:50:443
194544099164,2cyclictest1987013-21cpuspeed_turbos19:50:123
194544099161,4cyclictest2185758-21systemd-run23:10:003
194544099161,4cyclictest2060066-21cron21:00:003
194544099161,3cyclictest2096230-21turbostat21:35:003
194544099161,3cyclictest2065387-21latency_hist21:05:013
1945440991613,2cyclictest0-21swapper/321:10:003
1945440991613,2cyclictest0-21swapper/321:10:003
1945440991612,3cyclictest2002644-21cron20:05:003
1945440991611,4cyclictest335557-21systemd-journal22:28:263
1945440991611,4cyclictest2201431-21/usr/sbin/munin23:25:163
194544099160,4cyclictest2249176-21tr00:15:113
194544099160,4cyclictest2127255-21apt22:05:003
1945433991610,5cyclictest2006917-21ntpq20:05:231
1945429991613,2cyclictest60350irq/132-enp0s29f1:rx-000:25:180
1945429991613,2cyclictest2254196-21kworker/u8:1+events_unbound00:20:200
1945429991613,2cyclictest2159852-21kworker/u8:3+flush-259:022:45:200
194544099153,3cyclictest2217659-21fschecks_time23:40:163
194544099152,4cyclictest513-21gdbus21:45:003
194544099152,3cyclictest513-21gdbus21:40:013
194544099151,4cyclictest513-21gdbus22:20:013
194544099151,4cyclictest2017351-21ldconfig20:15:223
194544099151,3cyclictest335557-21systemd-journal20:29:593
1945433991510,4cyclictest2269807-21apt-get00:35:121
1945429991512,2cyclictest60350irq/132-enp0s29f1:rx-019:27:290
1945429991512,2cyclictest60350irq/132-enp0s29f1:rx-000:15:010
1945429991511,3cyclictest2023428-21kworker/u8:2+events_unbound21:00:390
194544099143,3cyclictest2238385-21hddtemp_smartct00:00:133
194544099141,5cyclictest513-21gdbus22:35:013
1945440991411,2cyclictest2007813-21idleruntime-cro20:10:003
194544099140,5cyclictest2269811-21taskset00:35:143
194544099140,4cyclictest2049507-21latency_hist20:50:003
194544099140,4cyclictest1945798-21grep19:10:133
194543699141,12cyclictest490-21dbus-daemon00:15:002
1945436991410,3cyclictest3062687-21kworker/u8:3+flush-259:020:40:212
1945436991410,3cyclictest2075833-21apt-get21:15:122
194543399148,4cyclictest2080752-21latency_hist21:20:011
1945433991412,1cyclictest1981502-21idleruntime-cro19:45:001
1945433991412,1cyclictest0-21swapper/100:35:011
1945433991411,2cyclictest2071722-21kthreadcore21:10:171
1945433991410,3cyclictest500-21systemd-logind00:15:001
1945433991410,3cyclictest335557-21systemd-journal23:46:361
1945433991410,3cyclictest335557-21systemd-journal22:39:351
1945433991410,2cyclictest2103963-21tr21:40:181
1945429991413,1cyclictest60350irq/132-enp0s29f1:rx-000:35:200
194544099137,4cyclictest2189960-21ntpq23:10:213
194544099131,4cyclictest832-21runrttasks22:45:143
194544099130,5cyclictest2231761-21ntpq23:50:213
194544099130,5cyclictest2196303-21/usr/sbin/munin23:20:123
194544099130,4cyclictest2070986-21/usr/sbin/munin21:10:153
194544099130,3cyclictest2248775-21dump-pmu-power00:15:013
194543699139,2cyclictest2116870-21awk21:55:002
194543699138,4cyclictest335557-21systemd-journal23:40:002
194543699131,6cyclictest2242984-21idleruntime-cro00:05:012
1945436991310,2cyclictest2200702-21unixbench_multi23:20:272
194543399139,3cyclictest3062687-21kworker/u8:3+flush-259:019:10:241
194543399139,3cyclictest2111757-21kworker/u8:1+flush-259:021:56:311
194543399138,4cyclictest2002651-21latency_hist20:05:011
1945433991310,2cyclictest2221434-21ntp_kernel_pll_23:40:221
1945433991310,2cyclictest2033812-21idleruntime-cro20:34:591
1945433991310,2cyclictest2018513-21cpuspeed_turbos20:20:111
194542999139,3cyclictest2227214-21kworker/u8:1+flush-259:000:00:470
1945429991312,1cyclictest60350irq/132-enp0s29f1:rx-022:31:040
194544099129,2cyclictest2154310-21latency_hist22:40:003
194544099126,4cyclictest2039009-21basename20:39:593
194544099123,2cyclictest832-21runrttasks22:06:053
194544099120,4cyclictest2222873-21/usr/sbin/munin23:45:153
194543699129,2cyclictest2064749-21unixbench_multi21:00:242
194543699129,2cyclictest2013313-21cpuspeed_turbos20:15:132
194543699129,2cyclictest1950146-21unixbench_singl19:10:252
194543699128,3cyclictest2254196-21kworker/u8:1+flush-259:000:20:182
1945436991210,1cyclictest2028649-21systemd-run20:30:002
194543399129,2cyclictest2206676-21cpuspeed_turbos23:30:141
194543399129,2cyclictest2111757-21kworker/u8:1+events_unbound22:00:181
194543399129,1cyclictest0-21swapper/123:29:591
194543399127,4cyclictest2165055-21cron22:49:591
1945433991210,1cyclictest2257825-21kthreadcore00:20:191
1945433991210,1cyclictest2148554-21irqcore22:25:161
1945433991210,1cyclictest0-21swapper/120:45:181
1945433991210,1cyclictest0-21swapper/119:25:151
1945433991210,1cyclictest0-21swapper/100:05:191
194544099117,2cyclictest2122065-21awk22:00:003
194544099116,4cyclictest513-21gdbus23:00:003
194543699119,1cyclictest0-21swapper/220:00:012
194543699118,2cyclictest1954875-21ntp_kernel_pll_19:15:222
194543699118,1cyclictest0-21swapper/222:39:592
194543699117,3cyclictest335557-21systemd-journal21:10:222
194543699117,3cyclictest3062687-21kworker/u8:3+flush-259:020:05:182
194543699117,3cyclictest2101425-21kworker/u8:3+flush-259:021:45:172
194543699117,3cyclictest2065574-21cpuspeed_turbos21:05:202
194543699117,3cyclictest2065574-21cpuspeed_turbos21:05:192
194543699117,2cyclictest2044195-21kworker/u8:0+flush-259:021:25:162
194543699115,4cyclictest2269540-21latency_hist00:35:012
194543699111,8cyclictest1991850-21latency_hist19:55:012
194543699111,2cyclictest2190878-21awk23:15:002
194543399119,1cyclictest0-21swapper/123:35:191
194543399118,2cyclictest2238494-21sed00:00:151
194543399117,3cyclictest335557-21systemd-journal23:10:001
194544099107,1cyclictest0-21swapper/321:45:243
194543699108,1cyclictest0-21swapper/222:10:262
194543699101,6cyclictest2196038-21apt23:19:592
194543399108,1cyclictest0-21swapper/122:20:171
194543399108,1cyclictest0-21swapper/121:00:171
194543399107,2cyclictest2132815-21fschecks_count22:10:161
194543399106,3cyclictest335557-21systemd-journal23:24:551
19454369997,1cyclictest0-21swapper/222:00:142
19454369996,2cyclictest2243337-21cpuspeed_turbos00:05:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional