You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 16:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sat Apr 25, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1806840997672,3cyclictest1801436-21kworker/u8:2+events_unbound07:10:032
1806840995653,2cyclictest75-21kswapd007:10:012
1806837994540,3cyclictest2091492-21apt-get11:45:121
1806832994438,4cyclictest1957023-21latency_hist09:35:010
1806837994237,3cyclictest1879323-21kworker/u8:2+flush-259:011:05:191
1806832994138,2cyclictest2138375-21kworker/u8:3+events_unbound12:35:220
1806832994137,3cyclictest252-21systemd-journal10:19:590
1806840993933,4cyclictest2096392-21latency_hist11:50:012
1806832993730,5cyclictest1936914-21diskstats09:15:140
1806840993630,4cyclictest2060013-21latency_hist11:15:002
1806845993528,5cyclictest2096655-21apt-get11:50:133
1806845993324,6cyclictest1915446-21latency_hist08:55:013
1806840993329,3cyclictest2039603-21/usr/sbin/munin10:55:142
1806840993329,3cyclictest1998072-21kworker/u8:0+flush-259:011:45:002
1806840993329,3cyclictest1879323-21kworker/u8:2+events_unbound11:05:172
1806840993328,3cyclictest1962400-21/usr/sbin/munin09:40:152
1806832993329,3cyclictest1936108-21kworker/u8:4+flush-259:010:00:200
1806845993228,3cyclictest75-21kswapd007:10:013
1806840993229,2cyclictest1998072-21kworker/u8:0+events_unbound11:25:182
1806840993228,3cyclictest1879323-21kworker/u8:2+flush-259:010:15:002
1806840993128,2cyclictest2102511-21kworker/u8:1+events_unbound11:55:222
1806837993125,4cyclictest1895035-21kworker/u8:4+flush-259:008:50:161
1806837993124,5cyclictest1930043-21ntpq09:05:231
1806832993127,3cyclictest509-21rs:main0
1806832993125,5cyclictest1924871-21ntpq09:00:220
1806840993024,4cyclictest2024177-21/usr/sbin/munin10:40:152
1806837993026,3cyclictest1879323-21kworker/u8:2+events_unbound10:45:131
1806837993025,4cyclictest252-21systemd-journal12:05:011
1806837993025,4cyclictest2133608-21apt-get12:25:131
1806837993025,3cyclictest1983069-21apt-get10:00:111
1806832993027,2cyclictest1998072-21kworker/u8:0+flush-259:010:30:140
1806832993027,2cyclictest1812185-21kworker/u8:0+events_unbound08:05:330
1806832993026,3cyclictest1998072-21kworker/u8:0+flush-259:010:40:240
1806832993026,3cyclictest1925813-21kworker/u8:3+events_unbound09:10:140
1806832993025,3cyclictest252-21systemd-journal07:38:330
1806837992926,2cyclictest1936108-21kworker/u8:4+events_unbound09:20:021
1806837992925,3cyclictest2091272-21kworker/u8:3+flush-259:011:50:161
1806832992925,3cyclictest1925813-21kworker/u8:3+flush-259:009:06:320
1806832992925,3cyclictest1879323-21kworker/u8:2+flush-259:008:35:270
1806840992825,2cyclictest1998072-21kworker/u8:0+events_unbound10:55:012
1806840992825,2cyclictest1879323-21kworker/u8:2+flush-259:009:55:262
1806837992824,3cyclictest1998072-21kworker/u8:0+flush-259:011:15:191
1806837992822,4cyclictest1863833-21latency_hist08:05:001
180683299281,25cyclictest1-21systemd11:24:330
1806845992722,4cyclictest1998072-21kworker/u8:0+flush-259:011:00:213
1806840992725,2cyclictest1936108-21kworker/u8:4+flush-259:010:00:212
1806840992724,2cyclictest1936107-21kworker/u8:0+flush-259:009:25:202
1806840992724,2cyclictest1879323-21kworker/u8:2+flush-259:011:25:012
1806840992724,2cyclictest1879323-21kworker/u8:2+events_unbound09:45:222
1806840992723,3cyclictest1998072-21kworker/u8:0+events_unbound10:30:222
1806840992723,3cyclictest1936108-21kworker/u8:4+flush-259:009:35:142
1806840992721,4cyclictest252-21systemd-journal08:00:002
1806832992723,3cyclictest2091272-21kworker/u8:3+events_unbound11:50:220
1806832992723,3cyclictest1998072-21kworker/u8:0+events_unbound11:35:210
1806832992723,3cyclictest1998072-21kworker/u8:0+events_unbound10:50:200
1806832992722,4cyclictest1874147-21latency_hist08:15:010
1806832992722,4cyclictest1874147-21latency_hist08:15:000
1806840992622,3cyclictest1879323-21kworker/u8:2+events_unbound10:15:172
1806837992622,3cyclictest2091272-21kworker/u8:3+events_unbound11:55:211
1806837992622,3cyclictest1879323-21kworker/u8:2+flush-259:010:25:171
1806837992620,5cyclictest1972479-21latency_hist09:50:001
1806837992620,4cyclictest2086376-21apt-get11:40:111
1806832992622,3cyclictest2102511-21kworker/u8:1+events_unbound12:10:220
1806832992620,4cyclictest2102157-21base6411:55:020
1806845992514,10cyclictest1801436-21kworker/u8:2+flush-259:007:35:003
1806840992523,2cyclictest1795448-21kworker/u8:1+events_unbound07:15:232
1806840992522,2cyclictest1869005-21kworker/u8:1+flush-259:008:15:202
1806840992522,2cyclictest1812185-21kworker/u8:0+events_unbound07:36:332
1806840992521,3cyclictest2060275-21apt-get11:15:132
1806840992519,4cyclictest2013642-21latency_hist10:30:012
1806837992519,4cyclictest1935168-21ntpq09:10:211
1806837992519,4cyclictest1879516-21/usr/sbin/munin08:20:171
1806832992521,3cyclictest1936107-21kworker/u8:0+flush-259:009:40:170
1806832992521,3cyclictest1936107-21kworker/u8:0+events_unbound09:20:130
1806832992521,3cyclictest1879323-21kworker/u8:2+events_unbound10:05:130
1806832992521,3cyclictest1801436-21kworker/u8:2+events_unbound07:30:180
1806845992419,4cyclictest1879323-21kworker/u8:2+flush-259:010:50:003
1806845992419,3cyclictest1925813-21kworker/u8:3+flush-259:009:10:203
1806845992418,4cyclictest1894809-21latency_hist08:35:003
1806840992421,2cyclictest2102511-21kworker/u8:1+flush-259:012:05:212
1806840992421,2cyclictest1812185-21kworker/u8:0+events_unbound08:10:152
1806840992421,2cyclictest1812185-21kworker/u8:0+events_unbound08:10:152
1806840992420,3cyclictest1998072-21kworker/u8:0+flush-259:011:00:252
1806837992420,3cyclictest1936107-21kworker/u8:0+flush-259:009:30:001
1806837992420,3cyclictest1838015-21kworker/u8:3+events_unbound08:25:231
1806837992419,4cyclictest252-21systemd-journal07:20:011
1806832992420,3cyclictest1838015-21kworker/u8:3+events_unbound08:25:170
1806840992319,3cyclictest1998072-21kworker/u8:0+flush-259:010:20:542
1806840992317,4cyclictest252-21systemd-journal07:34:592
1806837992319,3cyclictest2128204-21kworker/u8:1+flush-259:012:30:201
1806837992318,3cyclictest1874380-21/usr/sbin/munin08:15:141
1806832992320,2cyclictest1998072-21kworker/u8:0+events_unbound11:15:240
1806832992319,3cyclictest1900267-21apt-get08:40:110
1806832992319,3cyclictest1879323-21kworker/u8:2+events_unbound10:25:150
1806832992318,4cyclictest2106726-21kworker/u8:4+events_unbound12:08:340
1806845992214,6cyclictest1895044-21/usr/sbin/munin08:35:143
1806845992214,5cyclictest1817341-21latency_hist07:20:013
1806840992219,2cyclictest2122656-21kworker/u8:2+flush-259:012:20:002
1806840992219,2cyclictest1838015-21kworker/u8:3+events_unbound08:30:212
1806840992218,3cyclictest2128204-21kworker/u8:1+events_unbound12:24:352
1806837992218,3cyclictest2102511-21kworker/u8:1+flush-259:012:10:181
1806837992218,3cyclictest1795448-21kworker/u8:1+events_unbound07:20:161
1806832992219,2cyclictest1936108-21kworker/u8:4+flush-259:009:35:210
1806832992219,2cyclictest1879323-21kworker/u8:2+flush-259:010:45:340
1806832992218,3cyclictest1998072-21kworker/u8:0+flush-259:011:25:240
1806832992218,3cyclictest1879323-21kworker/u8:2+events_unbound10:20:220
1806832992217,3cyclictest2123259-21/usr/sbin/munin12:15:210
1806845992117,3cyclictest1879323-21kworker/u8:2+flush-259:009:50:253
1806845992117,3cyclictest1838015-21kworker/u8:3+flush-259:008:05:013
1806845992117,2cyclictest252-21systemd-journal10:05:003
1806840992118,2cyclictest1879323-21kworker/u8:2+flush-259:010:05:212
1806840992118,2cyclictest1838015-21kworker/u8:3+events_unbound08:04:362
1806840992118,2cyclictest1838015-21kworker/u8:3+events_unbound07:50:202
1806840992117,3cyclictest1879323-21kworker/u8:2+flush-259:009:15:262
1806840992117,3cyclictest1879323-21kworker/u8:2+events_unbound08:35:342
1806837992115,4cyclictest1905374-21/usr/sbin/munin08:45:151
1806832992118,2cyclictest2102511-21kworker/u8:1+flush-259:012:00:210
1806832992118,2cyclictest1982807-21sh10:00:000
1806832992117,3cyclictest1879323-21kworker/u8:2+flush-259:011:07:140
1806832992117,3cyclictest1879323-21kworker/u8:2+flush-259:009:50:220
1806832992117,3cyclictest1812185-21kworker/u8:0+flush-259:007:55:270
1806840992018,2cyclictest2102511-21kworker/u8:1+events_unbound12:10:232
1806840992017,2cyclictest1879323-21kworker/u8:2+flush-259:009:00:242
1806840992016,2cyclictest1801436-21kworker/u8:2+flush-259:007:40:242
1806840992015,4cyclictest252-21systemd-journal09:54:592
1806840992013,5cyclictest252-21systemd-journal08:50:002
1806837992018,1cyclictest1936107-21kworker/u8:0+flush-259:009:40:201
1806837992016,3cyclictest1936107-21kworker/u8:0+flush-259:009:30:201
1806837992016,3cyclictest1879323-21kworker/u8:2+flush-259:008:44:071
1806832992017,3cyclictest1838015-21kworker/u8:3+events_unbound08:21:350
1806832992016,3cyclictest1998072-21kworker/u8:0+flush-259:011:47:340
1806832992016,3cyclictest1869005-21kworker/u8:1+events_unbound08:18:330
1806845991912,5cyclictest1951026-21ntpq09:25:213
1806845991912,5cyclictest1920615-21latency_hist09:00:003
1806840991917,2cyclictest1869005-21kworker/u8:1+flush-259:008:25:382
1806840991916,2cyclictest1795448-21kworker/u8:1+flush-259:007:28:432
1806840991915,3cyclictest1925813-21kworker/u8:3+flush-259:009:10:182
1806840991914,3cyclictest1900242-21/usr/sbin/munin08:40:202
1806837991915,3cyclictest2039387-21kworker/u8:1+flush-259:010:55:151
1806837991915,3cyclictest1812185-21kworker/u8:0+flush-259:007:40:271
1806837991913,4cyclictest252-21systemd-journal11:31:331
1806837991913,3cyclictest252-21systemd-journal09:50:491
1806832991916,2cyclictest1987964-21kworker/u8:1+flush-259:010:10:250
1806832991916,2cyclictest1795448-21kworker/u8:1+flush-259:007:20:200
1806832991913,4cyclictest2080967-21latency_hist11:35:010
1806845991813,3cyclictest0-21swapper/308:20:003
1806845991812,4cyclictest2123023-21latency_hist12:14:593
1806840991817,1cyclictest1838015-21kworker/u8:3+events_unbound07:45:172
1806840991816,2cyclictest1879323-21kworker/u8:2+flush-259:011:30:142
1806840991815,2cyclictest1936107-21kworker/u8:0+flush-259:009:25:002
1806840991814,3cyclictest1936107-21kworker/u8:0+events_unbound09:32:352
1806840991814,3cyclictest1879323-21kworker/u8:2+events_unbound09:05:212
1806837991815,2cyclictest1998072-21kworker/u8:0+flush-259:011:25:201
1806837991815,2cyclictest1936108-21kworker/u8:4+flush-259:009:35:161
1806837991815,2cyclictest1838015-21kworker/u8:3+events_unbound08:30:231
1806837991814,3cyclictest2138375-21kworker/u8:3+events_unbound12:35:231
1806837991814,3cyclictest1998072-21kworker/u8:0+flush-259:010:17:341
1806837991812,4cyclictest1868963-21latency_hist08:10:001
1806837991811,5cyclictest1981911-21ntpq09:55:231
1806832991815,2cyclictest1838015-21kworker/u8:3+flush-259:008:30:270
1806832991814,3cyclictest2039387-21kworker/u8:1+flush-259:010:55:190
1806832991814,3cyclictest1998072-21kworker/u8:0+flush-259:011:10:180
1806845991713,3cyclictest2039387-21kworker/u8:1+flush-259:010:55:393
1806845991711,4cyclictest2143934-21apt-get12:35:133
1806845991711,4cyclictest1967322-21latency_hist09:45:013
1806845991710,5cyclictest509-21rs:main3
1806840991714,2cyclictest2096619-21kworker/u8:2+flush-259:011:50:472
1806837991711,4cyclictest252-21systemd-journal10:44:331
1806832991714,2cyclictest1879323-21kworker/u8:2+events_unbound10:35:150
1806832991714,2cyclictest1812185-21kworker/u8:0+events_unbound07:29:340
1806832991713,3cyclictest1838015-21kworker/u8:3+flush-259:008:01:410
1806845991612,3cyclictest2002533-21ntp_offset10:15:233
1806840991614,2cyclictest1838015-21kworker/u8:3+flush-259:008:20:352
1806840991613,2cyclictest2138375-21kworker/u8:3+events_unbound12:37:342
1806840991613,2cyclictest2128204-21kworker/u8:1+flush-259:012:30:262
1806840991613,2cyclictest2122656-21kworker/u8:2+events_unbound12:25:172
1806837991613,2cyclictest2102511-21kworker/u8:1+events_unbound12:05:131
1806837991613,2cyclictest1812185-21kworker/u8:0+flush-259:008:10:241
1806837991613,2cyclictest1812185-21kworker/u8:0+flush-259:008:10:231
1806837991612,3cyclictest1801436-21kworker/u8:2+events_unbound07:10:351
1806837991612,2cyclictest2014311-21irqcore10:30:171
1806832991613,2cyclictest60350irq/132-enp0s29f1:rx-012:27:180
1806832991613,2cyclictest60350irq/132-enp0s29f1:rx-007:40:160
1806832991613,2cyclictest1998072-21kworker/u8:0+flush-259:011:00:150
1806832991613,2cyclictest1795448-21kworker/u8:1+flush-259:007:15:140
1806832991612,3cyclictest2128204-21kworker/u8:1+flush-259:012:24:140
1806832991612,3cyclictest2112744-21kworker/u8:0+events_unbound12:34:350
1806845991512,2cyclictest2038463-21ntp_kernel_pll_10:50:203
1806845991511,3cyclictest2016191-21kthreadcore10:30:193
1806845991511,3cyclictest1936108-21kworker/u8:4+flush-259:009:45:163
1806845991511,3cyclictest1853442-21cron07:55:003
1806845991510,3cyclictest1879323-21kworker/u8:2+flush-259:009:05:273
1806840991512,2cyclictest1998072-21kworker/u8:0+events_unbound11:35:262
1806837991512,2cyclictest1998072-21kworker/u8:0+events_unbound10:20:011
1806837991511,3cyclictest2122656-21kworker/u8:2+flush-259:012:15:201
1806837991511,3cyclictest1915464-21kworker/u8:0+events_unbound08:55:251
1806837991511,3cyclictest1812185-21kworker/u8:0+flush-259:007:35:141
1806832991513,1cyclictest60350irq/132-enp0s29f1:rx-009:25:130
1806832991513,1cyclictest60350irq/132-enp0s29f1:rx-008:50:150
1806832991513,1cyclictest60350irq/132-enp0s29f1:rx-007:50:240
1806832991511,3cyclictest2080439-21kworker/u8:1+events_unbound11:40:140
1806832991511,3cyclictest1879323-21kworker/u8:2+events_unbound09:45:490
180684599149,4cyclictest2128204-21kworker/u8:1+flush-259:012:29:593
180684599147,5cyclictest1817613-21apt-get07:20:133
1806845991411,2cyclictest2055546-21irqcore11:10:173
1806845991411,1cyclictest0-21swapper/311:50:003
1806845991410,3cyclictest1998072-21kworker/u8:0+flush-259:011:25:223
1806840991412,2cyclictest1795448-21kworker/u8:1+events_unbound07:20:282
1806837991411,2cyclictest1921291-21irqcore09:00:171
1806837991410,3cyclictest1998072-21kworker/u8:0+flush-259:011:35:161
1806832991413,1cyclictest60350irq/132-enp0s29f1:rx-007:13:510
1806832991411,2cyclictest60350irq/132-enp0s29f1:rx-008:55:220
180684599139,3cyclictest2128204-21kworker/u8:1+flush-259:012:30:243
180684599139,3cyclictest1888592-21needreboot08:25:213
180684599139,3cyclictest1879323-21kworker/u8:2+flush-259:011:30:153
1806845991311,1cyclictest0-21swapper/311:20:003
180684099139,3cyclictest1838015-21kworker/u8:3+flush-259:008:08:042
1806840991310,2cyclictest2106726-21kworker/u8:4+events_unbound12:00:052
1806840991310,2cyclictest1914966-21unixbench_multi08:50:262
1806840991310,2cyclictest1879323-21kworker/u8:2+events_unbound10:35:202
180683799139,3cyclictest2122656-21kworker/u8:2+flush-259:012:20:181
180683799139,3cyclictest1838015-21kworker/u8:3+events_unbound07:45:241
180683799138,3cyclictest1838015-21kworker/u8:3+events_unbound07:50:181
180684599129,2cyclictest507-21in:imuxsock12:20:003
180684599129,1cyclictest0-21swapper/308:40:203
180684599128,3cyclictest1879323-21kworker/u8:2+events_unbound10:25:183
180684599128,2cyclictest0-21swapper/310:14:593
180684599127,4cyclictest1998072-21kworker/u8:0+flush-259:011:20:263
180684099129,2cyclictest1998072-21kworker/u8:0+events_unbound10:48:352
180684599118,2cyclictest2112957-21/usr/sbin/munin12:05:193
180684599118,2cyclictest2053864-21needreboot11:05:203
180684599118,2cyclictest1961261-21ntp_kernel_pll_09:35:223
180684599118,2cyclictest1807347-21cpuspeed_turbos07:10:143
180684599117,3cyclictest2106726-21kworker/u8:4+flush-259:012:00:253
180684599117,3cyclictest1998072-21kworker/u8:0+flush-259:011:35:143
180684599117,3cyclictest1812185-21kworker/u8:0+flush-259:007:35:043
180684599117,2cyclictest1864764-21irqcore08:05:183
180684599111,8cyclictest1858611-21latency_hist08:00:003
180683799118,2cyclictest1946756-21idleruntime-cro09:25:001
180683799118,2cyclictest1812185-21kworker/u8:0+events_unbound07:55:241
180683799118,1cyclictest0-21swapper/110:35:201
180683299117,3cyclictest1879323-21kworker/u8:2+events_unbound08:50:010
180684599108,1cyclictest0-21swapper/310:20:243
180684599108,1cyclictest0-21swapper/309:30:193
180684599107,1cyclictest0-21swapper/312:20:163
18068459997,1cyclictest0-21swapper/309:00:173
18068459994,4cyclictest1998072-21kworker/u8:0+flush-259:011:40:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional