You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-25 - 06:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Aug 25, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2006129997064,4cyclictest2022178-21cat19:25:002
2006133995143,5cyclictest2075600-21cp20:15:013
2006126995046,3cyclictest2268323-21apt-get23:20:111
2006129994845,2cyclictest2262463-21kworker/u8:1+flush-259:023:25:242
2006129994744,2cyclictest2205888-21kworker/u8:3+flush-259:022:20:252
2006126994641,3cyclictest2143455-21apt-get21:20:121
2006129994542,2cyclictest2005790-21kworker/u8:2+flush-259:020:00:252
2006129994440,3cyclictest2142916-21kworker/u8:2+flush-259:021:55:252
2006126994439,3cyclictest2301118-21apt-get00:00:091
2006133994236,4cyclictest2247232-21/usr/sbin/munin23:00:163
2006133993932,4cyclictest2006548-21cp19:10:023
2006133993834,3cyclictest2289058-21kworker/u8:2+flush-259:000:05:283
2006129993835,2cyclictest2005790-21kworker/u8:2+flush-259:019:10:242
2006126993732,4cyclictest2016864-21latency_hist19:20:001
2006126993732,3cyclictest2257942-21/usr/sbin/munin23:10:241
2006126993731,4cyclictest2091029-21latency_hist20:30:011
2006129993632,3cyclictest2231530-21kworker/u8:3+flush-259:023:59:592
2006129993631,3cyclictest2148383-21latency_hist21:25:002
2006126993633,2cyclictest1990770-21kworker/u8:0+flush-259:020:05:001
2006129993532,2cyclictest2075704-21kworker/u8:0+flush-259:020:50:242
2006126993532,2cyclictest1990770-21kworker/u8:0+flush-259:019:50:251
2006123993530,3cyclictest335557-21systemd-journal21:44:100
2006123993530,3cyclictest335557-21systemd-journal21:44:090
2006133993429,4cyclictest2311505-21apt-get00:10:133
2006129993431,2cyclictest1990770-21kworker/u8:0+events_unbound19:35:212
2006126993431,2cyclictest2075704-21kworker/u8:0+flush-259:020:55:211
2006126993428,2cyclictest2075704-21kworker/u8:0+events_unbound20:50:211
2006123993428,4cyclictest2133299-21diskstats21:10:140
2006133993329,3cyclictest2200484-21kworker/u8:0+flush-259:023:05:173
2006129993329,3cyclictest335557-21systemd-journal22:15:092
2006129993329,3cyclictest2011949-21apt-get19:15:122
2006123993328,4cyclictest2138295-21apt-get21:15:140
2006123993327,4cyclictest2048518-21/usr/sbin/munin19:50:140
2006129993229,2cyclictest2005790-21kworker/u8:2+flush-259:020:10:162
2006129993227,3cyclictest2107298-21apt-get20:45:122
2006126993228,2cyclictest2142916-21kworker/u8:2+events_unbound21:30:181
2006129993128,2cyclictest2200484-21kworker/u8:0+flush-259:023:20:162
2006126993128,2cyclictest2200484-21kworker/u8:0+flush-259:022:45:111
2006126993128,2cyclictest2058683-21kworker/u8:4+events_unbound20:05:231
2006126993126,3cyclictest2101605-21base6420:40:011
2006133993024,4cyclictest2058441-21apt-get19:58:003
2006129993028,2cyclictest2080674-21kworker/u8:3+events_unbound21:05:012
2006129993027,2cyclictest2200484-21kworker/u8:0+flush-259:022:50:222
2006129993027,2cyclictest2142916-21kworker/u8:2+events_unbound21:35:192
2006129993027,2cyclictest2142916-21kworker/u8:2+events_unbound21:35:182
2006126993027,2cyclictest2005790-21kworker/u8:2+flush-259:019:30:201
2006123993025,3cyclictest2154232-21apt-get21:30:130
2006123993024,4cyclictest2289093-21apt-get23:40:120
2006133992925,2cyclictest2289058-21kworker/u8:2+events_unbound23:57:123
2006129992926,2cyclictest2153564-21gpgv21:30:012
2006129992926,2cyclictest1990770-21kworker/u8:0+events_unbound19:50:182
2006126992926,2cyclictest2205888-21kworker/u8:3+events_unbound22:20:231
2006126992926,2cyclictest2005790-21kworker/u8:2+flush-259:021:00:151
2006126992925,3cyclictest2043123-21kworker/u8:1+events_unbound19:46:551
200612399291,26cyclictest2241861-21unin-run22:55:010
2006129992825,2cyclictest2200484-21kworker/u8:0+events_unbound23:10:222
2006126992825,2cyclictest2005790-21kworker/u8:2+flush-259:019:20:261
2006123992824,3cyclictest2289058-21kworker/u8:2+flush-259:000:00:230
2006123992824,2cyclictest2242105-21apt-get22:55:120
2006133992721,4cyclictest2231530-21kworker/u8:3+flush-259:023:15:173
2006133992721,4cyclictest2117627-21/usr/sbin/munin20:55:133
2006129992724,2cyclictest2148401-21kworker/u8:3+flush-259:021:30:152
2006129992724,2cyclictest2142916-21kworker/u8:2+events_unbound21:50:112
2006129992724,2cyclictest2043123-21kworker/u8:1+events_unbound20:30:232
2006129992724,2cyclictest2043123-21kworker/u8:1+events_unbound19:55:172
2006126992724,2cyclictest2231530-21kworker/u8:3+events_unbound23:19:091
2006126992724,2cyclictest2148401-21kworker/u8:3+flush-259:021:50:231
2006126992724,2cyclictest2005790-21kworker/u8:2+flush-259:019:30:001
2006126992723,3cyclictest2300882-21kworker/u8:1+events_unbound00:37:421
2006126992722,4cyclictest2080922-21apt-get20:20:121
2006123992724,2cyclictest2327654-21kworker/u8:4+events_unbound00:40:000
2006129992623,2cyclictest2011703-21kworker/u8:3+events_unbound19:40:222
2006129992622,3cyclictest2205888-21kworker/u8:3+events_unbound22:25:292
2006129992622,3cyclictest2200484-21kworker/u8:0+events_unbound23:00:182
2006126992623,2cyclictest2200484-21kworker/u8:0+events_unbound23:35:301
2006126992622,3cyclictest2005790-21kworker/u8:2+events_unbound20:49:111
2006129992523,1cyclictest2122555-21kworker/u8:1+events_unbound21:40:202
2006129992523,1cyclictest2122555-21kworker/u8:1+events_unbound21:40:202
2006129992522,2cyclictest2289058-21kworker/u8:2+events_unbound23:40:222
2006129992519,4cyclictest335557-21systemd-journal21:50:012
2006126992522,2cyclictest2205888-21kworker/u8:3+flush-259:022:25:191
2006126992522,2cyclictest2122555-21kworker/u8:1+flush-259:021:15:271
2006126992521,3cyclictest2231530-21kworker/u8:3+events_unbound23:04:081
2006126992521,3cyclictest2231530-21kworker/u8:3+events_unbound22:55:111
2006126992521,3cyclictest2075704-21kworker/u8:0+events_unbound20:18:091
2006126992520,4cyclictest2273501-21apt-get23:25:111
2006133992420,3cyclictest2122555-21kworker/u8:1+flush-259:021:15:203
2006133992419,3cyclictest509-21rs:main3
2006133992419,3cyclictest509-21rs:main3
2006129992421,2cyclictest2200484-21kworker/u8:0+flush-259:022:30:112
2006129992420,3cyclictest2317090-21kworker/u8:0+events_unbound00:25:192
2006129992419,4cyclictest2252343-21/usr/sbin/munin23:05:152
2006126992421,2cyclictest2311262-21kworker/u8:3+events_unbound00:15:001
2006126992421,2cyclictest2289058-21kworker/u8:2+events_unbound23:58:501
2006126992421,2cyclictest2148401-21kworker/u8:3+events_unbound21:57:111
2006126992421,2cyclictest2148401-21kworker/u8:3+events_unbound21:47:111
2006126992421,2cyclictest2142916-21kworker/u8:2+events_unbound22:12:271
2006126992421,2cyclictest2075704-21kworker/u8:0+events_unbound20:42:091
2006126992420,3cyclictest2043123-21kworker/u8:1+events_unbound19:55:191
2006123992419,4cyclictest2216220-21/usr/sbin/munin22:30:140
2006123992419,4cyclictest2080674-21kworker/u8:3+events_unbound20:50:010
2006123992418,4cyclictest2101647-21cat20:40:010
2006123992417,4cyclictest2126815-21ntpq21:00:210
2006129992322,1cyclictest2043123-21kworker/u8:1+events_unbound20:35:242
2006129992320,2cyclictest2300882-21kworker/u8:1+events_unbound00:38:022
2006129992320,2cyclictest2142916-21kworker/u8:2+flush-259:022:10:212
2006129992320,2cyclictest2075704-21kworker/u8:0+flush-259:020:40:262
2006129992320,2cyclictest2075704-21kworker/u8:0+events_unbound20:55:232
2006129992320,2cyclictest1990770-21kworker/u8:0+events_unbound19:30:152
2006126992320,2cyclictest2317090-21kworker/u8:0+flush-259:000:20:111
2006126992320,2cyclictest2216207-21kworker/u8:2+events_unbound22:43:111
2006126992320,2cyclictest2080674-21kworker/u8:3+events_unbound21:13:111
2006126992319,2cyclictest2043123-21kworker/u8:1+events_unbound20:30:201
2006126992317,2cyclictest2311262-21kworker/u8:3+events_unbound00:30:221
2006123992320,2cyclictest2231530-21kworker/u8:3+flush-259:023:54:590
2006133992218,2cyclictest2148401-21kworker/u8:3+flush-259:021:45:263
2006129992219,2cyclictest2011703-21kworker/u8:3+flush-259:019:45:212
2006129992218,3cyclictest2200484-21kworker/u8:0+flush-259:023:35:252
2006129992218,2cyclictest2080674-21kworker/u8:3+events_unbound21:05:222
2006126992219,2cyclictest2142916-21kworker/u8:2+flush-259:021:35:161
2006126992219,2cyclictest2142916-21kworker/u8:2+flush-259:021:35:151
2006126992219,2cyclictest2122555-21kworker/u8:1+events_unbound21:40:301
2006126992219,2cyclictest2122555-21kworker/u8:1+events_unbound21:40:291
2006123992217,4cyclictest2252368-21apt-get23:05:130
2006133992115,4cyclictest335557-21systemd-journal19:38:093
2006129992118,2cyclictest2289058-21kworker/u8:2+flush-259:000:00:212
2006129992118,2cyclictest2058683-21kworker/u8:4+events_unbound20:08:122
2006123992116,4cyclictest2205916-21apt-get22:20:130
2006123992116,4cyclictest2086144-21apt-get20:25:120
2006126992018,2cyclictest2289058-21kworker/u8:2+flush-259:000:05:161
2006126992017,2cyclictest2174687-21kworker/u8:1+events_unbound22:15:271
2006126992017,2cyclictest1990770-21kworker/u8:0+flush-259:019:35:221
2006123992016,3cyclictest2322517-21apt-get00:25:130
2006123992016,3cyclictest2148401-21kworker/u8:3+events_unbound22:05:230
2006123992015,3cyclictest2006676-21base6419:10:010
2006123992014,4cyclictest2231530-21kworker/u8:3+flush-259:023:15:260
2006133991915,3cyclictest2311262-21kworker/u8:3+flush-259:000:30:013
2006133991912,5cyclictest2283605-21latency_hist23:35:003
2006129991916,2cyclictest2216207-21kworker/u8:2+flush-259:022:40:172
2006126991917,2cyclictest2148401-21kworker/u8:3+events_unbound22:05:001
2006123991913,4cyclictest335557-21systemd-journal21:22:150
2006133991815,2cyclictest2005790-21kworker/u8:2+flush-259:020:50:003
2006133991814,3cyclictest2153560-21systemd-run21:30:003
2006129991815,2cyclictest2311262-21kworker/u8:3+events_unbound00:30:142
2006129991815,2cyclictest2122555-21kworker/u8:1+flush-259:021:15:202
2006129991815,2cyclictest1990770-21kworker/u8:0+events_unbound19:25:292
2006126991815,2cyclictest2300882-21kworker/u8:1+events_unbound00:27:391
2006123991815,2cyclictest2117392-21munin-plugin-st20:54:590
2006123991814,3cyclictest2174687-21kworker/u8:1+events_unbound22:15:150
2006123991814,3cyclictest2148401-21kworker/u8:3+flush-259:021:45:270
2006133991711,4cyclictest2069636-21cp20:10:003
2006129991715,1cyclictest2135432-21kthreadcore21:10:172
2006129991712,2cyclictest2289058-21kworker/u8:2+events_unbound00:05:182
2006126991714,2cyclictest2216207-21kworker/u8:2+events_unbound22:30:061
2006126991714,2cyclictest2005790-21kworker/u8:2+flush-259:020:10:171
2006126991713,3cyclictest2148620-21/usr/sbin/munin21:25:121
2006126991711,4cyclictest2282723-21ntpq23:30:211
2006123991713,3cyclictest2216207-21kworker/u8:2+flush-259:022:35:150
2006123991713,3cyclictest2043123-21kworker/u8:1+flush-259:020:35:010
2006123991711,5cyclictest2231530-21kworker/u8:3+flush-259:023:10:190
2006123991710,5cyclictest335557-21systemd-journal19:50:000
2006133991614,1cyclictest2247003-21cut23:00:013
2006133991613,2cyclictest2226318-21idleruntime-cro22:40:003
2006133991613,2cyclictest2122555-21kworker/u8:1+flush-259:021:00:263
2006133991613,2cyclictest2091034-21turbostat.cron20:30:003
2006133991612,2cyclictest0-21swapper/323:55:003
2006133991611,4cyclictest2257273-21apt-get23:10:013
2006133991611,3cyclictest2200687-21/usr/sbin/munin22:15:213
2006133991610,4cyclictest2043094-21latency_hist19:45:013
2006129991614,2cyclictest2200484-21kworker/u8:0+events_unbound22:45:052
2006129991614,1cyclictest2231530-21kworker/u8:3+flush-259:023:30:182
2006123991614,1cyclictest60350irq/132-enp0s29f1:rx-020:40:230
2006123991613,2cyclictest60350irq/132-enp0s29f1:rx-022:25:150
2006123991613,2cyclictest60350irq/132-enp0s29f1:rx-019:30:240
2006123991613,2cyclictest60350irq/132-enp0s29f1:rx-019:27:510
2006123991612,2cyclictest2179833-21turbostat21:55:000
200613399158,5cyclictest335557-21systemd-journal22:30:003
2006133991512,2cyclictest2328110-21irqcore00:30:173
2006133991511,3cyclictest2147924-21unixbench_multi21:20:253
200612999152,6cyclictest2195317-21munin-run22:10:002
2006129991513,2cyclictest2289058-21kworker/u8:2+events_unbound00:10:502
2006129991513,2cyclictest2231530-21kworker/u8:3+events_unbound23:15:012
2006129991512,2cyclictest2317090-21kworker/u8:0+events_unbound00:20:132
2006126991513,2cyclictest2289058-21kworker/u8:2+events_unbound23:53:411
2006126991512,2cyclictest2289058-21kworker/u8:2+events_unbound00:17:381
2006126991512,2cyclictest2200484-21kworker/u8:0+events_unbound22:50:131
2006126991512,2cyclictest2011703-21kworker/u8:3+events_unbound19:40:201
2006123991513,2cyclictest60350irq/132-enp0s29f1:rx-023:38:140
2006123991513,1cyclictest60350irq/132-enp0s29f1:rx-023:25:130
2006123991513,1cyclictest60350irq/132-enp0s29f1:rx-023:20:130
2006123991513,1cyclictest60350irq/132-enp0s29f1:rx-022:00:150
2006123991513,1cyclictest60350irq/132-enp0s29f1:rx-019:21:520
2006123991513,1cyclictest60350irq/132-enp0s29f1:rx-019:15:120
2006123991513,1cyclictest60350irq/132-enp0s29f1:rx-000:20:130
2006123991513,1cyclictest60350irq/132-enp0s29f1:rx-000:05:180
2006123991512,2cyclictest60350irq/132-enp0s29f1:rx-020:10:160
2006123991512,2cyclictest60350irq/132-enp0s29f1:rx-019:36:540
2006123991512,2cyclictest2317068-21idleruntime-cro00:20:000
2006123991511,3cyclictest60350irq/132-enp0s29f1:rx-022:45:160
2006123991511,3cyclictest2142916-21kworker/u8:2+flush-259:022:10:170
2006123991511,3cyclictest2043123-21kworker/u8:1+flush-259:020:20:170
2006123991511,2cyclictest60350irq/132-enp0s29f1:rx-020:05:180
200613399149,3cyclictest2195305-21sh22:10:003
2006133991411,2cyclictest2971-21cron22:45:013
2006133991411,2cyclictest2262463-21kworker/u8:1+flush-259:023:25:253
2006133991411,2cyclictest2216659-21irqcore22:30:173
200613399141,12cyclictest2175021-21tr21:50:123
2006133991411,2cyclictest2070550-21irqcore20:10:173
2006133991411,2cyclictest0-21swapper/321:35:013
2006133991410,3cyclictest2200484-21kworker/u8:0+flush-259:022:45:163
200612999147,5cyclictest2295295-21latency_hist23:55:012
2006129991412,2cyclictest2289058-21kworker/u8:2+events_unbound00:17:022
2006126991412,1cyclictest2294005-21idleruntime-cro23:44:591
2006126991411,2cyclictest2221840-21irqcore22:35:151
2006126991411,2cyclictest2192718-21sed22:05:191
2006126991411,2cyclictest2128367-21irqcore21:05:151
2006123991412,2cyclictest60350irq/132-enp0s29f1:rx-021:26:590
2006123991412,1cyclictest60350irq/132-enp0s29f1:rx-021:55:170
2006123991412,1cyclictest60350irq/132-enp0s29f1:rx-019:55:160
2006123991411,2cyclictest61150irq/133-enp0s29f1:tx-023:30:150
2006123991410,3cyclictest60350irq/132-enp0s29f1:rx-020:55:120
2006133991310,2cyclictest2333900-21kthreadcore00:35:163
200612999139,3cyclictest2086119-21/usr/sbin/munin20:25:152
2006129991310,2cyclictest2200484-21kworker/u8:0+events_unbound22:57:102
2006129991310,2cyclictest2075704-21kworker/u8:0+events_unbound20:15:122
200612699139,3cyclictest2200484-21kworker/u8:0+events_unbound23:10:001
2006126991311,1cyclictest0-21swapper/119:15:001
200612399139,3cyclictest60350irq/132-enp0s29f1:rx-019:40:240
2006123991312,1cyclictest60350irq/132-enp0s29f1:rx-023:00:280
2006123991311,2cyclictest60350irq/132-enp0s29f1:rx-020:03:390
2006123991311,1cyclictest60350irq/132-enp0s29f1:rx-000:10:160
2006123991310,2cyclictest60350irq/132-enp0s29f1:rx-023:55:120
2006123991310,2cyclictest60350irq/132-enp0s29f1:rx-023:47:480
2006123991310,2cyclictest2076763-21tr20:15:190
200613399129,2cyclictest2317747-21sort00:20:133
200613399129,1cyclictest0-21swapper/321:35:173
200613399129,1cyclictest0-21swapper/321:35:173
200613399129,1cyclictest0-21swapper/300:01:193
200613399128,2cyclictest2148401-21kworker/u8:3+flush-259:022:00:203
200613399126,4cyclictest2081084-21diskstats20:20:143
2006133991210,1cyclictest2030773-21kthreadcore19:30:173
200612999129,2cyclictest2216207-21kworker/u8:2+events_unbound22:37:322
200612999129,2cyclictest2148401-21kworker/u8:3+events_unbound22:00:112
200612399126,4cyclictest2163377-21ntpq21:35:210
200612399126,4cyclictest2163377-21ntpq21:35:200
200612399121,2cyclictest2127959-21apt-get21:05:110
200613399118,2cyclictest2128979-21kthreadcore21:05:163
200613399118,2cyclictest2022808-21cpuspeed_turbos19:25:183
200613399118,2cyclictest0-21swapper/300:19:593
200612999117,3cyclictest2231530-21kworker/u8:3+events_unbound23:46:012
200612699117,3cyclictest2262463-21kworker/u8:1+flush-259:023:50:001
200613399107,2cyclictest0-21swapper/322:20:133
200612999106,3cyclictest2043123-21kworker/u8:1+events_unbound20:24:522
20061339997,1cyclictest0-21swapper/319:20:133
20061339994,4cyclictest2052665-21ntp_states19:50:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional