You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-21 - 12:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Fri Aug 21, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1812968995853,3cyclictest75-21kswapd020:55:020
1812968995248,3cyclictest2059155-21gpgv23:04:590
1812977995146,3cyclictest1906065-21latency_hist20:40:003
1812970994944,3cyclictest2143713-21apt-get00:25:121
1812975994843,3cyclictest1864611-21latency_hist20:00:012
1812975994842,4cyclictest2059225-21cp23:05:012
1812977994539,4cyclictest2132687-21latency_hist00:15:013
1812970994337,4cyclictest1911462-21apt-get20:45:121
1812968994338,3cyclictest2000168-21kworker/u8:3+flush-259:022:10:000
1812968994337,4cyclictest2048911-21cp22:55:020
1812977994237,4cyclictest1942935-21apt-get21:15:123
1812968994236,4cyclictest2005607-21latency_hist22:15:010
1812968994037,2cyclictest1922544-21kworker/u8:4+flush-259:021:30:260
1812968994036,2cyclictest2000168-21kworker/u8:3+events_unbound22:15:200
1812977993832,4cyclictest1880142-21latency_hist20:15:013
1812975993832,4cyclictest335557-21systemd-journal23:55:012
1812968993833,4cyclictest2153846-21apt-get00:35:010
1812977993730,5cyclictest1849063-21latency_hist19:45:003
1812970993730,5cyclictest2111764-21cp23:55:011
1812968993532,2cyclictest2085277-21kworker/u8:4+events_unbound23:45:230
1812968993531,3cyclictest1874967-21latency_hist20:10:010
1812968993528,4cyclictest1984275-21cp21:55:000
1812970993428,4cyclictest2122341-21latency_hist00:05:001
1812970993327,4cyclictest2138271-21latency_hist00:20:001
1812970993327,4cyclictest1849324-21apt-get19:45:111
1812968993329,2cyclictest2132889-21gpgv00:15:000
1812968993328,3cyclictest2064631-21kworker/u8:3+events_unbound23:25:140
1812968993327,4cyclictest2038042-21gpgv22:45:010
1812975993227,4cyclictest2048304-21gpgv22:55:002
1812975993227,4cyclictest1994949-21gpgv22:05:002
1812975993124,5cyclictest2016725-21cp22:25:012
1812970993125,4cyclictest2138532-21apt-get00:20:131
1812968993128,2cyclictest2005646-21kworker/u8:1+flush-259:022:40:000
1812968993128,2cyclictest1869806-21kworker/u8:1+events_unbound20:37:180
1812968993128,2cyclictest1823456-21kworker/u8:2+events_unbound19:50:120
1812968993128,2cyclictest1764850-21kworker/u8:1+events_unbound19:10:230
1812968993127,3cyclictest2064631-21kworker/u8:3+events_unbound23:17:560
1812968993127,3cyclictest2005646-21kworker/u8:1+events_unbound00:08:570
1812968993126,3cyclictest2143352-21kworker/u8:2+events_unbound00:35:190
1812977993026,3cyclictest2122601-21apt-get00:05:133
1812975993022,6cyclictest2037652-21cat22:45:012
1812968993027,2cyclictest1921584-21kworker/u8:0+events_unbound21:35:250
1812968993027,2cyclictest1890570-21kworker/u8:3+events_unbound20:27:110
1812968993026,2cyclictest1900936-21kworker/u8:0+flush-259:020:45:250
1812968993025,4cyclictest1910872-21kworker/u8:2+events_unbound21:18:560
1812975992924,4cyclictest1906330-21apt-get20:40:122
1812968992926,3cyclictest2064631-21kworker/u8:3+events_unbound23:55:140
1812968992926,2cyclictest2021683-21kworker/u8:2+events_unbound23:07:450
1812968992926,2cyclictest1955993-21kworker/u8:2+flush-259:021:25:260
1812968992926,2cyclictest1955993-21kworker/u8:2+flush-259:021:25:260
1812968992926,2cyclictest1955993-21kworker/u8:2+events_unbound21:42:190
1812968992926,2cyclictest1828633-21kworker/u8:3+flush-259:020:00:160
1812968992926,2cyclictest1823456-21kworker/u8:2+flush-259:019:50:000
1812970992822,4cyclictest1979176-21apt-get21:50:121
1812968992822,4cyclictest1879227-21ntpq20:10:200
1812977992722,3cyclictest2095808-21base6423:40:003
1812975992720,5cyclictest2000430-21latency_hist22:10:022
1812968992724,2cyclictest2021683-21kworker/u8:2+flush-259:022:50:220
1812968992723,3cyclictest1916240-21kworker/u8:1+events_unbound20:53:560
1812968992723,3cyclictest1823456-21kworker/u8:2+flush-259:019:55:160
1812968992723,3cyclictest1823456-21kworker/u8:2+events_unbound19:37:050
1812968992721,5cyclictest1911203-21latency_hist20:45:000
1812970992621,4cyclictest1818089-21kworker/u8:0+events_unbound19:40:001
1812970992619,5cyclictest335557-21systemd-journal00:05:561
1812968992623,2cyclictest1764850-21kworker/u8:1+flush-259:019:20:200
1812968992622,3cyclictest2085277-21kworker/u8:4+flush-259:023:30:150
1812968992622,3cyclictest2005646-21kworker/u8:1+flush-259:023:35:160
1812970992519,4cyclictest2016929-21gpgv22:25:011
1812968992522,2cyclictest2021683-21kworker/u8:2+events_unbound22:40:190
1812968992521,3cyclictest2117367-21kworker/u8:2+events_unbound00:00:140
1812975992419,4cyclictest2021683-21kworker/u8:2+flush-259:023:09:592
1812975992418,4cyclictest2106436-21latency_hist23:50:002
1812970992418,4cyclictest1921814-21store20:55:001
1812968992421,2cyclictest2085277-21kworker/u8:4+events_unbound23:40:230
1812968992421,2cyclictest2064631-21kworker/u8:3+flush-259:023:20:210
1812968992421,2cyclictest1973918-21kworker/u8:4+events_unbound21:55:010
1812968992421,2cyclictest1921584-21kworker/u8:0+flush-259:021:50:010
1812968992420,3cyclictest2064855-21apt-get23:10:120
181297799237,3cyclictest2021067-21ntpq22:25:223
1812968992319,3cyclictest2005646-21kworker/u8:1+events_unbound00:19:560
1812977992217,3cyclictest335557-21systemd-journal20:15:553
1812970992218,3cyclictest1921584-21kworker/u8:0+flush-259:021:25:191
1812970992218,3cyclictest1921584-21kworker/u8:0+flush-259:021:25:181
1812970992216,4cyclictest335557-21systemd-journal22:12:551
1812970992216,4cyclictest2132682-21apt-get00:15:001
1812968992219,2cyclictest2005646-21kworker/u8:1+flush-259:022:30:010
1812968992219,2cyclictest1869806-21kworker/u8:1+flush-259:020:30:210
1812968992219,2cyclictest1802857-21kworker/u8:4+flush-259:019:15:570
1812977992117,3cyclictest1921584-21kworker/u8:0+flush-259:022:15:003
1812975992117,3cyclictest2005646-21kworker/u8:1+flush-259:022:50:012
1812975992116,4cyclictest1828633-21kworker/u8:3+events_unbound20:00:222
1812975992114,5cyclictest2126631-21ntpq00:05:232
1812970992117,3cyclictest1828633-21kworker/u8:3+flush-259:020:15:001
1812968992118,2cyclictest1947875-21kworker/u8:1+events_unbound21:20:120
1812968992117,3cyclictest1963008-21kworker/u8:1+events_unbound22:02:230
1812977992017,2cyclictest0-21swapper/322:25:013
1812977992014,4cyclictest2064598-21latency_hist23:10:003
1812977992014,4cyclictest2006132-21cat22:15:013
1812975992012,6cyclictest1844330-21diskstats19:40:122
181297599201,18cyclictest1-21systemd00:40:012
1812970992015,3cyclictest2085277-21kworker/u8:4+flush-259:023:40:261
1812968992017,2cyclictest2143352-21kworker/u8:2+flush-259:000:25:190
1812968992017,2cyclictest1869806-21kworker/u8:1+flush-259:020:20:160
1812968992017,2cyclictest1828633-21kworker/u8:3+flush-259:020:15:210
181297799195,4cyclictest1812891-21latency_hist19:10:013
1812977991916,2cyclictest75-21kswapd020:55:023
1812975991914,4cyclictest1823488-21apt-get19:20:102
1812970991916,2cyclictest2005646-21kworker/u8:1+flush-259:022:50:161
1812970991915,3cyclictest1895979-21apt-get20:30:131
1812968991915,3cyclictest2005646-21kworker/u8:1+flush-259:000:20:210
1812977991815,2cyclictest1995034-21latency_hist22:05:003
1812977991812,4cyclictest335557-21systemd-journal23:40:013
1812975991815,2cyclictest2005646-21kworker/u8:1+flush-259:000:20:192
1812975991814,3cyclictest1910872-21kworker/u8:2+flush-259:020:50:002
1812975991811,5cyclictest1823223-21latency_hist19:20:012
1812970991814,3cyclictest1869806-21kworker/u8:1+flush-259:020:20:001
1812970991813,3cyclictest1864851-21/usr/sbin/munin20:00:141
181297799172,4cyclictest2048841-21gpgv22:55:013
1812977991715,1cyclictest0-21swapper/320:55:003
1812977991713,3cyclictest507-21in:imuxsock23:35:003
1812977991712,3cyclictest335557-21systemd-journal21:42:293
181297599179,5cyclictest1984089-21latency_hist21:55:012
181297599174,5cyclictest2080090-21basename23:24:592
1812975991713,3cyclictest1921584-21kworker/u8:0+flush-259:021:10:242
1812975991713,3cyclictest1869806-21kworker/u8:1+flush-259:020:20:262
1812975991712,3cyclictest2085277-21kworker/u8:4+events_unbound23:30:162
1812975991712,3cyclictest1-21systemd23:25:562
1812970991714,2cyclictest2005646-21kworker/u8:1+flush-259:023:05:111
1812970991714,2cyclictest0-21swapper/122:25:011
1812970991711,5cyclictest2037477-21apt-get22:45:011
1812968991714,2cyclictest1823456-21kworker/u8:2+events_unbound19:43:570
1812968991714,2cyclictest1823456-21kworker/u8:2+events_unbound19:32:030
1812977991612,3cyclictest2005646-21kworker/u8:1+flush-259:023:10:163
181297599169,5cyclictest1943095-21diskstats21:15:152
181297599166,2cyclictest1880150-21munin-run20:15:002
1812975991613,2cyclictest1933623-21kthreadcore21:05:172
1812975991613,2cyclictest1828633-21kworker/u8:3+flush-259:020:15:232
1812975991610,4cyclictest2132806-21gpgv00:15:012
1812975991610,4cyclictest2117367-21kworker/u8:2+flush-259:000:00:222
1812970991612,3cyclictest1869806-21kworker/u8:1+flush-259:020:20:241
1812970991611,3cyclictest2070007-21/usr/sbin/munin23:15:151
1812970991610,4cyclictest1932340-21latency_hist21:05:001
1812968991614,2cyclictest2005646-21kworker/u8:1+events_unbound22:30:130
1812968991614,1cyclictest60350irq/132-enp0s29f1:rx-022:21:220
1812968991612,3cyclictest1910872-21kworker/u8:2+events_unbound21:09:550
1812968991611,4cyclictest2085277-21kworker/u8:4+events_unbound23:55:010
1812977991512,2cyclictest2149944-21kthreadcore00:30:183
1812975991513,1cyclictest0-21swapper/219:50:002
1812975991513,1cyclictest0-21swapper/200:30:002
1812975991512,2cyclictest2005637-21apt-key22:15:002
1812975991511,2cyclictest0-21swapper/221:30:002
1812975991511,2cyclictest0-21swapper/221:30:002
181297599150,10cyclictest1895717-21apt20:30:002
181297099158,5cyclictest1822350-21ntpq19:15:221
1812970991512,2cyclictest1921584-21kworker/u8:0+flush-259:022:00:281
1812970991511,3cyclictest1823456-21kworker/u8:2+events_unbound19:30:161
181297799148,4cyclictest2037851-21cp22:45:013
1812977991411,2cyclictest1952126-21ntp_kernel_pll_21:20:203
1812977991410,2cyclictest2085264-21basename23:29:593
1812977991410,2cyclictest0-21swapper/319:50:173
1812975991411,2cyclictest1832685-21ntp_kernel_err19:25:202
1812975991411,2cyclictest0-21swapper/223:55:002
1812970991411,2cyclictest2021683-21kworker/u8:2+flush-259:022:35:051
1812970991411,2cyclictest1863683-21ntp_kernel_err19:55:201
1812970991411,2cyclictest0-21swapper/122:30:201
1812970991410,3cyclictest1869806-21kworker/u8:1+flush-259:020:40:171
1812970991410,3cyclictest1846462-21tr19:40:171
1812968991412,1cyclictest60350irq/132-enp0s29f1:rx-021:00:190
1812968991411,1cyclictest60350irq/132-enp0s29f1:rx-021:12:070
181297799138,3cyclictest335557-21systemd-journal21:07:143
181297799137,4cyclictest335557-21systemd-journal19:30:553
181297799137,4cyclictest2117149-21kworker/u8:0+flush-259:000:00:153
181297799136,4cyclictest1869794-21latency_hist20:05:013
181297799135,6cyclictest1823236-21awk19:20:003
181297799132,8cyclictest1916400-21latency_hist20:50:003
181297799132,2cyclictest1989560-21modprobe21:58:553
181297799132,2cyclictest1863688-21gcc19:55:203
181297799131,2cyclictest2047434-21ntpq22:50:213
181297799131,2cyclictest1813334-21diskstats19:10:133
1812977991310,2cyclictest2059051-21idleruntime-cro23:05:003
181297799130,3cyclictest1942269-21users21:10:253
181297599136,5cyclictest1922243-21seq20:55:122
1812975991311,1cyclictest0-21swapper/220:40:002
1812975991310,2cyclictest1988682-21needreboot21:55:192
1812975991310,2cyclictest0-21swapper/222:20:002
181297099138,3cyclictest1937954-21grep21:10:141
181297099137,5cyclictest1932578-21/usr/sbin/munin21:05:141
1812970991310,2cyclictest2095165-21unixbench_multi23:35:271
1812970991310,2cyclictest1978923-21idleruntime-cro21:50:001
1812970991310,1cyclictest0-21swapper/123:04:591
181297799129,2cyclictest507-21in:imuxsock21:05:003
181297799129,2cyclictest1974018-21cpuspeed_turbos21:45:133
181297799128,3cyclictest1890809-21apt-get20:25:113
181297799128,3cyclictest0-21swapper/323:24:593
181297799126,4cyclictest1984138-21dpkg21:55:013
181297799122,6cyclictest1833223-21runrttasks19:25:353
181297799122,2cyclictest1898856-21grep20:30:193
181297799121,6cyclictest2138833-21hddtemp_smartct00:20:153
181297799121,6cyclictest2101634-21diskstats23:45:163
181297799121,2cyclictest2042244-21ntpq22:45:233
181297799121,2cyclictest2022350-21diskstats22:30:133
181297799120,7cyclictest1995671-21df22:05:153
181297799120,3cyclictest2143873-21diskstats00:25:153
181297599129,2cyclictest2137839-21unixbench_singl00:15:262
181297599129,2cyclictest2005646-21kworker/u8:1+events_unbound23:10:142
181297599129,2cyclictest1953022-21cron21:25:002
181297599128,3cyclictest2070229-21fschecks_count23:15:152
181297599128,3cyclictest1823456-21kworker/u8:2+flush-259:019:30:232
181297099129,2cyclictest2085277-21kworker/u8:4+flush-259:023:30:171
181297099129,2cyclictest2080404-21cpuspeed_turbos23:25:121
181297099129,2cyclictest1968034-21unixbench_multi21:35:271
181297099129,2cyclictest1962905-21unixbench_singl21:30:261
181297099128,3cyclictest1921584-21kworker/u8:0+flush-259:021:55:241
181297099128,3cyclictest1828633-21kworker/u8:3+flush-259:019:26:121
181297099126,4cyclictest509-21rs:main1
181297099126,4cyclictest2154504-21/usr/sbin/munin00:35:161
181297099126,4cyclictest2117115-21cron00:00:001
181297099120,5cyclictest1874977-21munin-run20:10:001
181297799118,2cyclictest1958486-21cpuspeed_turbos21:30:143
181297799118,1cyclictest1874110-21ntpq20:05:223
181297799116,3cyclictest1844058-21cat19:40:013
181297799112,7cyclictest1909118-21grep20:40:183
181297799112,1cyclictest0-21swapper/321:35:173
181297799111,3cyclictest1853982-21runrttasks19:46:333
181297799111,2cyclictest50-21ksoftirqd/320:20:213
181297799110,7cyclictest50-21ksoftirqd/300:15:153
181297599119,1cyclictest0-21swapper/221:45:192
181297599118,2cyclictest0-21swapper/200:30:142
181297599118,1cyclictest1840401-21kthreadcore19:35:152
181297599117,3cyclictest1896176-21fschecks_count20:30:152
181297599117,3cyclictest1764850-21kworker/u8:1+events_unbound19:10:162
181297599117,2cyclictest2091546-21irqcore23:35:192
181297599114,4cyclictest2101212-21latency_hist23:45:012
181297599113,5cyclictest335557-21systemd-journal20:52:122
181297599111,2cyclictest2021939-21awk22:30:002
181297099118,2cyclictest1813240-21cpuspeed_turbos19:10:111
181297099117,3cyclictest2143352-21kworker/u8:2+flush-259:000:30:261
181297099117,3cyclictest1910872-21kworker/u8:2+flush-259:021:20:001
181297799104,5cyclictest1953398-21tr21:25:153
181297799104,5cyclictest1953398-21tr21:25:153
181297099107,2cyclictest0-21swapper/121:20:141
18129759997,1cyclictest0-21swapper/221:00:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional