You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-09 - 00:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Apr 08, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1757055997568,6cyclictest1912429-21dpkg09:37:243
1757045995047,2cyclictest75-21kswapd009:37:230
1757045993733,3cyclictest1996616-21apt-get11:00:110
1757045993629,5cyclictest2043058-21latency_hist11:45:000
1757055993531,3cyclictest1933577-21kworker/u8:0+flush-259:010:20:013
1757045993530,4cyclictest1782504-21kworker/u8:1+events_unbound07:40:000
1757045993530,4cyclictest1782504-21kworker/u8:1+events_unbound07:40:000
1757048993428,4cyclictest1949244-21apt-get10:15:101
1757045993430,3cyclictest1985648-21kworker/u8:2+events_unbound11:25:170
1757053993329,3cyclictest1980441-21gpgv10:45:012
1757045993229,2cyclictest1938705-21kworker/u8:1+events_unbound10:10:180
1757045993228,3cyclictest1839521-21kworker/u8:1+flush-259:009:15:170
1757053993125,4cyclictest1959544-21/usr/sbin/munin10:25:152
1757055993025,4cyclictest1990963-21gpgv10:55:003
1757055992923,4cyclictest1813803-21latency_hist08:05:013
1757048992926,2cyclictest75-21kswapd009:37:211
1757048992924,3cyclictest2079429-21apt-get12:20:101
1757048992924,3cyclictest2079429-21apt-get12:20:101
1757045992925,3cyclictest1923281-21kworker/u8:4+flush-259:010:20:150
1757045992923,4cyclictest252-21systemd-journal08:37:540
1757053992824,3cyclictest1933577-21kworker/u8:0+flush-259:010:30:182
1757045992724,2cyclictest1722914-21kworker/u8:0+flush-259:007:25:230
1757045992623,2cyclictest1918046-21kworker/u8:3+flush-259:009:45:210
1757045992622,3cyclictest1933577-21kworker/u8:0+flush-259:011:50:190
1757045992622,3cyclictest1912378-21kworker/u8:2+flush-259:009:40:200
1757045992622,3cyclictest1808650-21kworker/u8:2+flush-259:008:25:240
1757053992521,2cyclictest1788050-21kworker/u8:0+flush-259:007:45:202
1757053992520,4cyclictest1839521-21kworker/u8:1+flush-259:008:50:042
1757048992520,4cyclictest1985868-21apt-get10:50:101
1757053992420,3cyclictest2006679-21kworker/u8:1+events_unbound11:20:002
1757048992419,3cyclictest1923279-21kworker/u8:1+events_unbound09:49:591
1757045992421,2cyclictest2006679-21kworker/u8:1+flush-259:011:15:220
1757045992421,2cyclictest1933577-21kworker/u8:0+flush-259:011:30:180
1757045992421,2cyclictest1808650-21kworker/u8:2+flush-259:008:05:240
1757045992420,3cyclictest2063956-21kworker/u8:0+flush-259:012:20:170
1757045992420,3cyclictest2063956-21kworker/u8:0+flush-259:012:20:170
1757045992420,3cyclictest1933577-21kworker/u8:0+events_unbound10:58:240
1757045992420,2cyclictest1865575-21kworker/u8:0+flush-259:009:20:240
1757055992318,4cyclictest1937819-21ntpq10:00:213
1757053992319,3cyclictest2043082-21kworker/u8:3+flush-259:012:00:242
1757053992317,4cyclictest252-21systemd-journal07:45:002
1757045992320,2cyclictest2063956-21kworker/u8:0+events_unbound12:35:260
1757045992319,3cyclictest2063956-21kworker/u8:0+flush-259:012:15:180
1757045992319,3cyclictest2063956-21kworker/u8:0+flush-259:012:15:180
1757045992319,3cyclictest2043082-21kworker/u8:3+events_unbound12:03:280
1757045992319,3cyclictest1979621-21kworker/u8:3+events_unbound10:45:140
1757045992319,3cyclictest1839521-21kworker/u8:1+flush-259:008:55:190
1757055992218,3cyclictest1933577-21kworker/u8:0+flush-259:011:50:163
1757055992217,3cyclictest2022500-21latency_hist11:25:013
1757053992216,4cyclictest252-21systemd-journal09:37:132
1757053992216,4cyclictest1912378-21kworker/u8:2+flush-259:009:40:162
1757045992219,2cyclictest1938705-21kworker/u8:1+flush-259:010:15:130
1757045992219,2cyclictest1839521-21kworker/u8:1+flush-259:008:30:190
1757045992218,3cyclictest1923281-21kworker/u8:4+events_unbound09:55:230
1757045992218,3cyclictest1923281-21kworker/u8:4+events_unbound09:55:220
1757045992215,5cyclictest252-21systemd-journal10:01:260
1757055992118,2cyclictest1954432-21apt-get10:20:113
1757055992118,2cyclictest1762192-21kworker/u8:2+flush-259:007:30:003
1757055992117,3cyclictest252-21systemd-journal10:48:243
1757055992117,3cyclictest1855378-21apt-get08:45:103
1757053992117,3cyclictest1979621-21kworker/u8:3+flush-259:010:45:162
1757053992117,3cyclictest1865575-21kworker/u8:0+flush-259:009:25:232
1757053992114,5cyclictest2001892-21diskstats11:05:132
1757048992116,3cyclictest1969584-21latency_hist10:35:001
1757045992114,5cyclictest1860938-21/usr/sbin/munin08:50:140
1757053992015,3cyclictest252-21systemd-journal10:08:172
1757048992014,5cyclictest1928423-21awk09:55:001
1757045992017,2cyclictest1964443-21kworker/u8:1+flush-259:010:40:160
1757045992017,2cyclictest1964443-21kworker/u8:1+events_unbound10:38:210
1757045992016,3cyclictest1833652-21kworker/u8:3+events_unbound08:45:250
1757045992016,3cyclictest1722914-21kworker/u8:0+flush-259:007:15:190
1757055991916,2cyclictest2084266-21kworker/u8:2+flush-259:012:30:263
1757055991916,2cyclictest1991432-21apt-get10:55:103
1757055991915,3cyclictest1918046-21kworker/u8:3+flush-259:009:50:233
1757053991915,3cyclictest2043082-21kworker/u8:3+events_unbound11:55:132
1757048991915,3cyclictest2063956-21kworker/u8:0+flush-259:012:05:161
1757048991914,4cyclictest2032775-21latency_hist11:35:001
1757048991913,4cyclictest2016030-21ntpq11:15:201
1757045991916,2cyclictest1979621-21kworker/u8:3+events_unbound10:50:190
1757045991915,3cyclictest1985648-21kworker/u8:2+flush-259:011:05:110
1757045991915,3cyclictest1938943-21apt-get10:05:100
1757045991915,3cyclictest1933577-21kworker/u8:0+events_unbound11:20:110
1757045991915,3cyclictest1933577-21kworker/u8:0+events_unbound10:32:280
1757045991915,3cyclictest1933577-21kworker/u8:0+events_unbound10:28:290
1757045991915,3cyclictest1782504-21kworker/u8:1+events_unbound07:50:230
1757055991815,2cyclictest1866104-21apt-get08:55:113
1757055991814,3cyclictest1808650-21kworker/u8:2+flush-259:008:25:183
1757055991811,5cyclictest252-21systemd-journal10:40:003
1757053991815,2cyclictest1918046-21kworker/u8:3+events_unbound09:50:152
1757053991815,1cyclictest0-21swapper/209:05:002
1757053991814,3cyclictest1985648-21kworker/u8:2+events_unbound11:10:152
1757053991814,3cyclictest1933577-21kworker/u8:0+events_unbound11:20:232
1757053991814,3cyclictest1762192-21kworker/u8:2+events_unbound07:25:232
1757053991811,5cyclictest252-21systemd-journal12:29:592
1757048991813,3cyclictest252-21systemd-journal09:18:051
1757048991812,4cyclictest1839656-21latency_hist08:30:011
1757045991814,3cyclictest2084266-21kworker/u8:2+events_unbound12:32:280
1757045991811,5cyclictest1807764-21ntpq07:55:200
1757055991714,1cyclictest0-21swapper/311:10:013
1757055991713,3cyclictest509-21rs:main3
1757055991713,3cyclictest1933577-21kworker/u8:0+flush-259:011:40:163
1757053991714,2cyclictest1933577-21kworker/u8:0+events_unbound11:30:152
1757053991713,3cyclictest1985648-21kworker/u8:2+events_unbound11:45:212
1757048991714,2cyclictest1933577-21kworker/u8:0+flush-259:011:25:241
1757048991714,2cyclictest1819269-21apt-get08:10:121
1757045991714,2cyclictest60350irq/132-enp0s29f1:rx-012:12:010
1757045991714,2cyclictest1782504-21kworker/u8:1+flush-259:007:40:250
1757045991713,3cyclictest1918046-21kworker/u8:3+events_unbound09:52:290
1757045991713,2cyclictest0-21swapper/008:45:000
1757055991614,1cyclictest0-21swapper/309:49:593
1757055991613,2cyclictest1985648-21kworker/u8:2+flush-259:011:10:263
1757055991612,3cyclictest1782504-21kworker/u8:1+flush-259:007:50:013
1757053991613,2cyclictest2063956-21kworker/u8:0+flush-259:012:35:242
1757053991613,2cyclictest1979621-21kworker/u8:3+events_unbound10:50:202
1757053991612,3cyclictest1933577-21kworker/u8:0+flush-259:011:50:232
1757053991612,3cyclictest1782504-21kworker/u8:1+events_unbound08:00:192
1757053991612,2cyclictest0-21swapper/209:34:592
1757053991610,4cyclictest1854215-21ntpq08:40:212
1757048991613,2cyclictest500-21systemd-logind10:00:011
1757048991613,2cyclictest500-21systemd-logind10:00:001
1757048991613,2cyclictest1857680-21kthreadcore08:45:161
1757048991613,2cyclictest1813790-21cron08:05:001
1757048991612,3cyclictest252-21systemd-journal10:25:001
1757048991612,3cyclictest2043082-21kworker/u8:3+flush-259:011:55:151
175704899160,15cyclictest1-21systemd10:10:001
1757045991614,1cyclictest60350irq/132-enp0s29f1:rx-008:18:440
1757045991613,2cyclictest1865575-21kworker/u8:0+events_unbound09:05:230
1757045991613,2cyclictest1722914-21kworker/u8:0+events_unbound07:15:000
1757045991612,3cyclictest1865575-21kworker/u8:0+events_unbound09:27:290
1757045991611,3cyclictest252-21systemd-journal12:09:590
175705599158,5cyclictest2057654-21ntpq11:55:203
1757055991511,3cyclictest2099859-21true12:40:003
1757055991511,3cyclictest1923281-21kworker/u8:4+flush-259:009:55:243
1757055991511,3cyclictest1923281-21kworker/u8:4+flush-259:009:55:233
1757055991510,4cyclictest1771571-21ntpq07:20:193
1757053991512,2cyclictest1722914-21kworker/u8:0+events_unbound07:15:222
1757053991511,2cyclictest1844819-21cron08:35:002
1757053991510,4cyclictest1845097-21apt-get08:35:112
175704899159,5cyclictest252-21systemd-journal10:05:011
175704899159,4cyclictest1881734-21latency_hist09:10:011
1757048991512,2cyclictest1954398-21kworker/u8:2+flush-259:010:30:011
1757048991512,2cyclictest1839521-21kworker/u8:1+events_unbound09:10:171
1757048991512,2cyclictest1788050-21kworker/u8:0+flush-259:008:25:001
1757048991512,1cyclictest0-21swapper/111:55:001
1757048991511,3cyclictest509-21rs:main1
1757048991511,3cyclictest509-21rs:main1
1757048991511,2cyclictest1798602-21apt-get07:50:101
1757048991510,4cyclictest1969822-21/usr/sbin/munin10:35:221
1757048991510,4cyclictest1871230-21cat09:00:011
175704599158,5cyclictest1906557-21ntpq09:30:200
1757045991513,1cyclictest60350irq/132-enp0s29f1:rx-008:20:240
1757045991513,1cyclictest60350irq/132-enp0s29f1:rx-008:10:150
1757045991512,2cyclictest60350irq/132-enp0s29f1:rx-012:25:140
1757045991512,2cyclictest60350irq/132-enp0s29f1:rx-011:56:110
1757045991512,2cyclictest1839521-21kworker/u8:1+flush-259:009:00:160
1757045991511,3cyclictest1985648-21kworker/u8:2+events_unbound11:14:380
1757045991511,3cyclictest1839521-21kworker/u8:1+flush-259:009:10:200
1757055991411,2cyclictest509-21rs:main3
1757055991411,2cyclictest509-21rs:main3
175705399141,3cyclictest1891997-21awk09:19:592
1757053991412,1cyclictest0-21swapper/208:20:002
1757053991411,2cyclictest1933577-21kworker/u8:0+flush-259:011:25:232
1757053991411,2cyclictest1892674-21irqcore09:20:162
1757053991410,3cyclictest1762192-21kworker/u8:2+flush-259:007:39:592
1757053991410,3cyclictest1762192-21kworker/u8:2+flush-259:007:39:582
1757053991410,3cyclictest1741678-21kworker/u8:1+flush-259:007:10:162
1757048991412,1cyclictest1979987-21idleruntime-cro10:45:011
1757048991412,1cyclictest0-21swapper/108:20:001
1757048991411,2cyclictest1933577-21kworker/u8:0+flush-259:011:20:241
1757048991411,2cyclictest1793649-21fschecks_time07:45:131
1757045991412,1cyclictest60350irq/132-enp0s29f1:rx-008:03:290
1757045991412,1cyclictest60350irq/132-enp0s29f1:rx-007:30:170
1757045991412,1cyclictest60350irq/132-enp0s29f1:rx-007:20:220
1757045991411,2cyclictest1985648-21kworker/u8:2+events_unbound11:45:270
1757045991411,2cyclictest1985648-21kworker/u8:2+events_unbound11:35:120
175705599139,3cyclictest252-21systemd-journal09:34:593
175705599138,4cyclictest1861127-21diskstats08:50:123
175705599138,3cyclictest252-21systemd-journal08:45:013
1757055991311,1cyclictest2063726-21idleruntime-cro12:05:003
1757055991310,2cyclictest1881254-21unixbench_multi09:05:243
1757055991310,1cyclictest0-21swapper/308:10:003
175705399139,3cyclictest2063956-21kworker/u8:0+flush-259:012:10:202
175705399139,3cyclictest1933577-21kworker/u8:0+flush-259:011:01:312
175705399139,3cyclictest1933577-21kworker/u8:0+events_unbound10:55:192
175705399137,5cyclictest1855540-21diskstats08:45:122
175705399136,5cyclictest2093788-21ntpq12:30:202
1757053991310,2cyclictest1949309-21cpuspeed_turbos10:15:122
1757053991310,2cyclictest1933577-21kworker/u8:0+events_unbound10:35:132
1757053991310,2cyclictest1839521-21kworker/u8:1+flush-259:009:10:222
1757053991310,2cyclictest1768598-21sed07:20:172
175704899139,3cyclictest2063956-21kworker/u8:0+flush-259:012:36:311
175704899139,3cyclictest1839521-21kworker/u8:1+flush-259:008:35:171
1757048991311,1cyclictest0-21swapper/112:20:001
1757048991311,1cyclictest0-21swapper/112:19:591
1757048991311,1cyclictest0-21swapper/109:29:591
1757048991310,2cyclictest2069193-21cpuspeed_turbos12:10:131
1757048991310,2cyclictest1767321-21idleruntime-cro07:20:001
1757045991310,2cyclictest1788050-21kworker/u8:0+flush-259:007:45:230
175705599129,2cyclictest2068427-21unixbench_singl12:05:253
175705599129,2cyclictest1806033-21kthreadcore07:55:163
175705599129,2cyclictest0-21swapper/312:30:003
175705599128,3cyclictest252-21systemd-journal08:32:523
175705599128,3cyclictest1985648-21kworker/u8:2+flush-259:011:46:313
1757055991210,1cyclictest0-21swapper/307:15:003
175705399129,2cyclictest2079495-21cpuspeed_turbos12:20:122
175705399129,2cyclictest2079495-21cpuspeed_turbos12:20:122
175705399129,2cyclictest2033033-21apt-get11:35:112
175705399129,1cyclictest0-21swapper/212:15:202
175705399129,1cyclictest0-21swapper/212:15:202
175705399128,3cyclictest1918046-21kworker/u8:3+events_unbound09:55:182
175705399128,3cyclictest1918046-21kworker/u8:3+events_unbound09:55:182
175705399128,3cyclictest1788050-21kworker/u8:0+flush-259:008:05:202
175704899129,2cyclictest1840141-21fschecks_time08:30:131
175704899128,2cyclictest17450irq/129-nvme0q207:30:001
1757048991210,1cyclictest1861375-21irqcore08:50:161
175705599119,1cyclictest0-21swapper/312:20:153
175705599119,1cyclictest0-21swapper/312:20:143
175705599119,1cyclictest0-21swapper/311:30:153
175705599118,2cyclictest2000975-21unixbench_multi11:00:243
175705599118,2cyclictest1944169-21cpuspeed_turbos10:10:123
175705599118,2cyclictest1819337-21cpuspeed_turbos08:10:123
175705599111,8cyclictest1767522-21cat07:20:003
175705599111,2cyclictest1849978-21latency_hist08:40:003
175705399118,2cyclictest1923281-21kworker/u8:4+events_unbound10:00:192
175704899119,1cyclictest0-21swapper/111:45:241
175704899118,2cyclictest2043082-21kworker/u8:3+flush-259:012:05:001
175704899118,2cyclictest1991498-21cpuspeed_turbos10:55:121
175704899118,2cyclictest1814136-21cpuspeed_turbos08:05:121
175705599107,2cyclictest1887206-21cpuspeed_turbos09:15:113
175705599106,3cyclictest1933577-21kworker/u8:0+flush-259:010:05:083
175704899107,2cyclictest2011313-21unixbench_multi11:10:241
175704899105,3cyclictest1757840-21sed07:10:161
17570489997,1cyclictest1913195-21cpuspeed_turbos09:40:121
17570489997,1cyclictest0-21swapper/111:35:121
17570489997,1cyclictest0-21swapper/111:07:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional