You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 16:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Tue Jul 14, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1959535993629,5cyclictest2026579-21cat08:15:000
1959539993125,4cyclictest2052624-21latency_hist08:40:012
1959535993023,5cyclictest2011020-21latency_hist08:00:000
1959539992925,3cyclictest2161283-21latency_hist10:25:002
1959538992822,4cyclictest2281109-21latency_hist12:20:001
1959543992721,4cyclictest335557-21systemd-journal11:50:003
1959539992722,4cyclictest2037161-21latency_hist08:25:012
1959538992720,4cyclictest2239868-21latency_hist11:40:011
1959538992719,5cyclictest335557-21systemd-journal07:25:161
1959535992623,2cyclictest1949228-21kworker/u8:0+events_unbound07:50:180
1959543992519,4cyclictest2026403-21apt-get08:15:033
1959538992520,4cyclictest2285316-21kworker/u8:1+flush-259:012:35:011
1959543992417,5cyclictest2238952-21ntpq11:35:223
1959535992318,4cyclictest1970047-21apt-get07:20:130
1959535992316,5cyclictest335557-21systemd-journal09:11:160
1959535992316,5cyclictest2140656-21latency_hist10:05:000
1959543992218,3cyclictest1949228-21kworker/u8:0+flush-259:007:45:003
1959539992218,3cyclictest500-21systemd-logind11:15:002
1959539992218,3cyclictest2255323-21kworker/u8:0+flush-259:012:00:212
1959539992218,2cyclictest2037175-21kworker/u8:2+flush-259:009:15:162
1959539992218,2cyclictest0-21swapper/211:35:002
1959539992216,5cyclictest2172026-21latency_hist10:35:012
1959538992218,3cyclictest2208813-21apt-get11:10:111
1959538992216,4cyclictest335557-21systemd-journal09:34:161
1959535992216,4cyclictest2120204-21/usr/sbin/munin09:45:180
1959543992115,4cyclictest335557-21systemd-journal10:25:003
1959539992117,3cyclictest2026422-21kworker/u8:1+events_unbound08:33:172
1959539992117,3cyclictest1949228-21kworker/u8:0+events_unbound08:05:212
1959539992116,4cyclictest2285316-21kworker/u8:1+events_unbound12:35:112
1959539992114,5cyclictest2062911-21latency_hist08:50:012
1959538992116,3cyclictest2213951-21/usr/sbin/munin11:15:201
1959538992115,4cyclictest2056929-21ntpq08:40:221
1959535992118,2cyclictest2130325-21kworker/u8:4+flush-259:010:30:250
1959535992118,2cyclictest2130325-21kworker/u8:4+flush-259:010:30:250
1959535992118,2cyclictest2005896-21kworker/u8:3+flush-259:008:00:160
1959543992014,4cyclictest2151397-21diskstats10:15:153
1959539992017,2cyclictest2234931-21kworker/u8:1+flush-259:011:50:012
1959539992017,2cyclictest2016147-21basename08:04:592
1959539992016,3cyclictest2285316-21kworker/u8:1+events_unbound12:32:172
1959538992014,4cyclictest1949228-21kworker/u8:0+flush-259:007:35:171
1959535992017,2cyclictest2300780-21kworker/u8:2+flush-259:012:35:240
1959535992017,2cyclictest2114368-21cron09:40:010
1959535992014,4cyclictest509-21rs:main0
1959543991913,4cyclictest2135497-21latency_hist09:59:593
1959539991916,2cyclictest2177850-21irqcore10:40:172
1959539991916,2cyclictest2109263-21kworker/u8:1+events_unbound09:38:472
1959539991916,2cyclictest2037175-21kworker/u8:2+events_unbound08:50:162
1959539991916,2cyclictest1964636-21idleruntime-cro07:15:012
1959539991915,2cyclictest0-21swapper/210:30:002
1959539991914,4cyclictest2005896-21kworker/u8:3+events_unbound08:16:172
195953599192,16cyclictest509-21rs:main0
1959535991916,2cyclictest2098941-21idleruntime-cro09:25:000
1959543991815,2cyclictest2068761-21irqcore08:55:183
1959543991814,3cyclictest2130325-21kworker/u8:4+flush-259:010:00:163
1959543991814,3cyclictest2005896-21kworker/u8:3+flush-259:008:00:213
1959543991814,3cyclictest1995592-21kworker/u8:2+flush-259:007:45:263
1959543991812,4cyclictest2125376-21/usr/sbin/munin09:50:133
1959539991814,3cyclictest2229154-21kworker/u8:0+events_unbound11:39:102
1959539991814,3cyclictest1995592-21kworker/u8:2+events_unbound07:45:242
1959538991815,2cyclictest2096356-21kthreadcore09:20:181
1959538991815,1cyclictest0-21swapper/108:29:591
1959538991813,4cyclictest2037175-21kworker/u8:2+flush-259:008:40:001
1959538991811,5cyclictest335557-21systemd-journal12:10:001
1959538991810,6cyclictest2031123-21ntpq08:15:221
1959535991815,2cyclictest1949228-21kworker/u8:0+flush-259:008:20:150
1959535991814,3cyclictest2078399-21kworker/u8:3+events_unbound10:45:130
1959535991812,4cyclictest2047886-21diskstats08:35:120
1959535991811,5cyclictest2146220-21diskstats10:10:130
1959543991714,2cyclictest2084803-21kthreadcore09:10:163
195953999179,6cyclictest2281530-21diskstats12:20:152
1959539991714,2cyclictest2109263-21kworker/u8:1+flush-259:009:45:012
1959539991714,2cyclictest2078399-21kworker/u8:3+flush-259:009:50:152
1959539991714,2cyclictest1964858-21kworker/u8:2+flush-259:007:15:222
1959539991713,2cyclictest1949228-21kworker/u8:0+flush-259:007:55:212
1959539991710,4cyclictest2270827-21latency_hist12:10:012
1959538991713,3cyclictest2037175-21kworker/u8:2+flush-259:009:15:161
1959538991711,4cyclictest2063169-21apt-get08:50:121
1959538991710,5cyclictest335557-21systemd-journal08:00:151
1959535991714,2cyclictest60350irq/132-enp0s29f1:rx-008:51:180
1959535991714,2cyclictest60350irq/132-enp0s29f1:rx-007:29:590
1959535991713,3cyclictest2255323-21kworker/u8:0+events_unbound12:00:180
1959535991713,3cyclictest2245211-21kworker/u8:3+events_unbound12:25:180
1959535991713,3cyclictest2193290-21kworker/u8:4+events_unbound11:05:170
1959543991613,2cyclictest2026413-21cut08:15:013
1959543991613,1cyclictest0-21swapper/309:30:013
1959543991611,3cyclictest2193290-21kworker/u8:4+events_unbound11:15:153
1959539991613,2cyclictest2193290-21kworker/u8:4+flush-259:011:10:002
1959539991613,2cyclictest2193077-21kworker/u8:2+events_unbound10:55:232
1959539991612,3cyclictest2245211-21kworker/u8:3+events_unbound12:25:162
1959539991612,3cyclictest2078399-21kworker/u8:3+events_unbound09:10:132
1959539991612,3cyclictest1970012-21kworker/u8:3+events_unbound07:23:162
1959539991612,3cyclictest0-21swapper/210:50:002
1959539991612,2cyclictest0-21swapper/210:15:002
1959539991611,4cyclictest2037175-21kworker/u8:2+events_unbound08:26:192
1959538991614,1cyclictest2119544-21idleruntime-cro09:45:001
1959538991611,3cyclictest335557-21systemd-journal11:01:161
1959535991614,1cyclictest60350irq/132-enp0s29f1:rx-009:15:250
1959535991613,2cyclictest60350irq/132-enp0s29f1:rx-008:06:070
1959535991613,2cyclictest60350irq/132-enp0s29f1:rx-007:10:150
1959535991613,2cyclictest2193746-21irqcore10:55:180
1959535991613,2cyclictest2119541-21sh09:45:000
1959535991613,2cyclictest0-21swapper/010:55:000
1959535991612,3cyclictest60350irq/132-enp0s29f1:rx-010:15:130
1959535991612,3cyclictest2229154-21kworker/u8:0+events_unbound11:35:140
1959535991612,3cyclictest2130325-21kworker/u8:4+events_unbound10:20:230
1959535991612,2cyclictest2208566-21kworker/u8:0+events_unbound11:15:010
195954399159,4cyclictest2119541-21latency_hist09:44:593
195953999153,6cyclictest1995583-21munin-run07:45:002
1959539991512,2cyclictest4086606-21kworker/u8:1+events_unbound07:25:262
1959539991512,2cyclictest2078399-21kworker/u8:3+flush-259:009:09:372
1959539991512,2cyclictest2078399-21kworker/u8:3+events_unbound10:54:012
1959539991512,2cyclictest1949228-21kworker/u8:0+flush-259:007:35:202
1959539991511,3cyclictest2130325-21kworker/u8:4+events_unbound10:30:132
1959539991511,3cyclictest2078399-21kworker/u8:3+flush-259:009:20:242
1959539991511,3cyclictest1949228-21kworker/u8:0+events_unbound07:53:242
1959539991510,4cyclictest2255539-21kworker/u8:4+events_unbound12:10:132
1959538991512,1cyclictest0-21swapper/109:54:151
1959538991511,3cyclictest1949228-21kworker/u8:0+flush-259:008:10:311
1959535991514,1cyclictest60350irq/132-enp0s29f1:rx-007:49:240
1959535991513,2cyclictest60350irq/132-enp0s29f1:rx-008:30:490
1959535991513,2cyclictest2255539-21kworker/u8:4+events_unbound12:20:140
1959535991513,2cyclictest2120200-21kworker/u8:2+events_unbound09:50:000
1959535991513,1cyclictest60350irq/132-enp0s29f1:rx-011:00:250
1959535991513,1cyclictest60350irq/132-enp0s29f1:rx-010:40:250
1959535991513,1cyclictest60350irq/132-enp0s29f1:rx-009:30:240
1959535991512,2cyclictest60350irq/132-enp0s29f1:rx-011:25:150
1959535991512,2cyclictest60350irq/132-enp0s29f1:rx-011:20:230
1959535991512,2cyclictest60350irq/132-enp0s29f1:rx-011:15:110
1959535991512,2cyclictest60350irq/132-enp0s29f1:rx-008:15:130
1959535991512,2cyclictest60350irq/132-enp0s29f1:rx-007:38:130
1959535991512,2cyclictest60350irq/132-enp0s29f1:rx-007:17:470
1959535991512,2cyclictest2285316-21kworker/u8:1+flush-259:012:30:210
1959535991512,2cyclictest2234931-21kworker/u8:1+flush-259:011:45:160
1959535991512,2cyclictest2193077-21kworker/u8:2+events_unbound11:50:260
1959535991512,2cyclictest2193077-21kworker/u8:2+events_unbound11:45:010
1959535991512,2cyclictest2037175-21kworker/u8:2+flush-259:009:05:200
195954399148,4cyclictest335557-21systemd-journal08:25:003
195954399148,4cyclictest2250406-21/usr/sbin/munin11:50:153
1959543991411,2cyclictest2098457-21unixbench_multi09:20:253
1959543991411,2cyclictest2047460-21idleruntime-cro08:34:593
1959543991410,3cyclictest2260756-21apt-get12:00:123
1959543991410,3cyclictest2181385-21ntp_kernel_err10:40:213
1959543991410,3cyclictest2037175-21kworker/u8:2+flush-259:008:25:423
195953999148,1cyclictest2218888-21cron11:20:002
1959539991411,3cyclictest1970012-21kworker/u8:3+flush-259:007:30:112
1959539991411,2cyclictest2141039-21cpuspeed_turbos10:05:132
1959539991411,2cyclictest2073888-21irqcore09:00:172
1959539991410,3cyclictest2229154-21kworker/u8:0+events_unbound11:40:212
1959539991410,3cyclictest2037175-21kworker/u8:2+events_unbound08:40:192
195953899149,3cyclictest2193062-21latency_hist10:55:011
195953899149,3cyclictest2067145-21kworker/u8:0+flush-259:009:05:011
195953899148,4cyclictest2203694-21apt-get11:05:111
195953899148,4cyclictest2161701-21gpgv10:25:011
1959538991411,2cyclictest2167106-21apt-get10:30:121
1959538991411,2cyclictest2167106-21apt-get10:30:121
1959538991411,2cyclictest2046549-21ntp_kernel_err08:30:221
1959538991410,3cyclictest1949228-21kworker/u8:0+flush-259:007:49:591
1959535991413,1cyclictest60350irq/132-enp0s29f1:rx-010:08:590
1959535991412,1cyclictest60350irq/132-enp0s29f1:rx-010:25:140
1959535991412,1cyclictest60350irq/132-enp0s29f1:rx-009:55:250
1959535991412,1cyclictest60350irq/132-enp0s29f1:rx-009:00:240
1959535991412,1cyclictest60350irq/132-enp0s29f1:rx-008:45:210
1959535991411,2cyclictest2255539-21kworker/u8:4+events_unbound12:10:170
1959535991411,2cyclictest2245211-21kworker/u8:3+flush-259:012:15:160
1959535991411,2cyclictest1992988-21kthreadcore07:40:180
1959535991410,3cyclictest2229154-21kworker/u8:0+events_unbound11:30:220
1959535991410,3cyclictest2067145-21kworker/u8:0+flush-259:009:30:010
195954399139,3cyclictest2219143-21/usr/sbin/munin11:20:193
195954399137,4cyclictest335557-21systemd-journal12:20:163
1959543991310,1cyclictest0-21swapper/311:59:593
1959543991310,1cyclictest0-21swapper/310:50:003
195954399130,11cyclictest1-21systemd10:40:003
195953999139,3cyclictest2005896-21kworker/u8:3+events_unbound08:14:172
1959539991310,2cyclictest2200819-21tr11:00:192
1959539991310,1cyclictest0-21swapper/209:30:182
195953899139,2cyclictest2104086-21cron09:30:011
195953899138,4cyclictest1959772-21apt-get07:10:111
1959538991310,2cyclictest2144935-21ntp_kernel_pll_10:05:211
1959538991310,2cyclictest2004987-21ntp_kernel_pll_07:50:231
1959538991310,1cyclictest0-21swapper/112:35:221
1959535991312,1cyclictest60350irq/132-enp0s29f1:rx-011:55:170
1959535991311,1cyclictest60350irq/132-enp0s29f1:rx-007:30:230
1959535991310,2cyclictest335557-21systemd-journal09:00:000
195954399129,2cyclictest0-21swapper/309:10:013
195954399129,2cyclictest0-21swapper/308:40:003
195954399129,1cyclictest0-21swapper/311:30:013
195954399126,4cyclictest2109503-21apt-get09:35:123
195954399126,4cyclictest2016409-21apt-get08:05:113
195954399120,3cyclictest2148372-21ps10:10:173
195953999129,2cyclictest2275983-21kworker/u8:0+events_unbound12:17:002
195953999129,2cyclictest2151200-21kworker/u8:1+flush-259:010:15:102
195953999129,2cyclictest2136180-21sed10:00:162
195953999129,2cyclictest2078399-21kworker/u8:3+events_unbound09:40:162
195953999128,3cyclictest2193290-21kworker/u8:4+events_unbound11:20:252
195953999120,10cyclictest2172688-21/usr/sbin/munin10:35:152
195953899129,2cyclictest2088202-21unixbench_singl09:10:241
195953899128,3cyclictest2213952-21kworker/u8:1+flush-259:011:28:211
195953899126,4cyclictest335557-21systemd-journal09:10:011
195954399118,2cyclictest1980439-21cpuspeed_turbos07:30:133
195954399118,2cyclictest1975313-21cpuspeed_turbos07:25:153
195954399118,2cyclictest1959948-21fschecks_count07:10:123
195954399116,3cyclictest2244987-21awk11:45:003
195953999118,1cyclictest0-21swapper/209:55:142
195953999117,3cyclictest2067145-21kworker/u8:0+events_unbound09:25:182
195953899118,2cyclictest2260980-21fschecks_time12:00:151
195953899118,2cyclictest2162033-21cpuspeed_turbos10:25:131
195953899118,2cyclictest1992993-21kthreadcore07:40:181
195953899118,1cyclictest0-21swapper/111:30:171
195953899117,2cyclictest2011163-21latency_hist08:00:011
195953599118,1cyclictest0-21swapper/012:05:120
195954399108,1cyclictest0-21swapper/311:30:173
195954399106,3cyclictest2072974-21kworker/u8:1+flush-259:009:00:053
195954399106,3cyclictest2067145-21kworker/u8:0+flush-259:009:30:243
195954399101,2cyclictest2062911-21latency_hist08:50:003
195953999108,1cyclictest0-21swapper/211:50:272
195953899108,1cyclictest0-21swapper/109:45:111
195953899107,2cyclictest2037175-21kworker/u8:2+flush-259:008:55:201
195953899106,3cyclictest2172046-21kworker/u8:1+flush-259:010:40:251
195953899106,2cyclictest2155255-21ntpq10:15:231
195953899106,2cyclictest0-21swapper/110:45:161
195953899105,3cyclictest2177153-21cron10:40:001
19595439997,1cyclictest0-21swapper/310:05:253
19595439994,4cyclictest1985825-21fw_forwarded_lo07:35:153
19595399995,2cyclictest0-21swapper/211:55:162
19595389993,4cyclictest2137457-21cat10:00:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional