You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 20:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sun Mar 22, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2009838994543,1cyclictest2109348-21fwupd08:43:572
2009834993937,1cyclictest130-1kworker/0:1H+kblockd08:43:570
2009842993835,2cyclictest2271002-21kworker/u8:4+flush-259:012:00:143
2009842993835,2cyclictest2271002-21kworker/u8:4+flush-259:012:00:133
2009842993834,3cyclictest2271002-21kworker/u8:4+events_unbound11:25:183
2009837993833,4cyclictest2318741-21kworker/u8:1+flush-259:012:05:121
2009842993733,3cyclictest2009371-21kworker/u8:3+events_unbound07:10:223
2009842993732,3cyclictest2094281-21apt-get08:30:113
2009838993734,2cyclictest2062788-21kworker/u8:4+flush-259:008:10:262
2009837993730,5cyclictest2056538-21ntpq07:50:221
2009842993629,5cyclictest2228723-21latency_hist10:40:013
2009834993632,3cyclictest2271196-21diskstats11:20:130
2009842993430,3cyclictest2239672-21kworker/u8:4+events_unbound10:55:123
2009842993429,4cyclictest2297331-21kworker/u8:5+flush-259:011:50:183
2009838993431,2cyclictest2009371-21kworker/u8:3+flush-259:007:35:152
2009834993327,4cyclictest2318939-21diskstats12:05:140
2009837993226,4cyclictest2088522-21kworker/u8:0+flush-259:009:05:251
2009837993126,3cyclictest2103797-21kworker/u8:1+flush-259:009:20:161
2009837993125,4cyclictest2046918-21apt-get07:45:141
2009842993027,2cyclictest2140412-21kworker/u8:2+flush-259:009:55:253
2009842992925,3cyclictest2192135-21kworker/u8:3+events_unbound10:10:153
2009842992925,3cyclictest2155968-21kworker/u8:0+events_unbound10:05:153
2009838992925,3cyclictest2062788-21kworker/u8:4+events_unbound08:15:182
2009834992926,2cyclictest2192135-21kworker/u8:3+flush-259:010:55:160
2009834992925,3cyclictest2046668-21kworker/u8:1+flush-259:007:55:170
2009834992923,4cyclictest252-21systemd-journal11:10:020
2009834992922,5cyclictest2233450-21ntpq10:40:230
2009842992824,3cyclictest2307856-21kworker/u8:0+events_unbound12:30:183
2009842992824,3cyclictest2249766-21kworker/u8:2+events_unbound11:15:153
2009842992824,3cyclictest2155968-21kworker/u8:0+events_unbound10:30:123
2009842992823,3cyclictest2313067-21gpgv12:00:013
2009842992823,3cyclictest2313067-21gpgv12:00:003
2009842992823,3cyclictest2062788-21kworker/u8:4+flush-259:008:10:113
2009842992821,5cyclictest2031499-21apt-get07:30:113
2009842992820,6cyclictest252-21systemd-journal09:15:003
2009834992824,3cyclictest2271002-21kworker/u8:4+flush-259:011:40:170
2009834992823,4cyclictest2030813-21latency_hist07:30:010
2009842992724,2cyclictest2062788-21kworker/u8:4+flush-259:008:20:253
2009842992723,3cyclictest2103797-21kworker/u8:1+flush-259:009:45:223
2009842992723,3cyclictest2046668-21kworker/u8:1+events_unbound07:55:193
2009842992722,3cyclictest2036589-21/usr/sbin/munin07:35:183
2009842992621,3cyclictest2248901-21kworker/u8:1+flush-259:011:10:163
2009842992620,4cyclictest2156207-21apt-get09:30:113
2009838992621,4cyclictest2088522-21kworker/u8:0+flush-259:009:05:162
2009838992620,4cyclictest509-21rs:main2
2009837992622,3cyclictest2140412-21kworker/u8:2+flush-259:009:45:001
2009837992622,3cyclictest2140412-21kworker/u8:2+flush-259:009:45:001
2009834992623,2cyclictest2280843-21kworker/u8:0+flush-259:011:30:160
2009834992621,4cyclictest2045791-21ntpq07:40:220
2009842992522,2cyclictest2155968-21kworker/u8:0+events_unbound11:05:193
2009842992521,3cyclictest2155968-21kworker/u8:0+events_unbound10:50:183
2009842992519,4cyclictest2187193-21/usr/sbin/munin10:00:133
2009838992521,3cyclictest2103797-21kworker/u8:1+events_unbound09:45:152
2009838992521,2cyclictest2318741-21kworker/u8:1+flush-259:012:40:012
2009837992521,3cyclictest2318741-21kworker/u8:1+events_unbound12:20:181
2009834992521,3cyclictest2151018-21apt-get09:25:090
2009842992420,3cyclictest2318741-21kworker/u8:1+events_unbound12:15:253
2009842992420,3cyclictest2103797-21kworker/u8:1+events_unbound08:45:253
2009842992419,4cyclictest2103797-21kworker/u8:1+flush-259:009:20:153
2009842992418,4cyclictest2020098-21latency_hist07:20:013
2009838992421,2cyclictest2271002-21kworker/u8:4+events_unbound11:25:262
2009837992421,2cyclictest2155968-21kworker/u8:0+flush-259:010:20:011
2009837992420,3cyclictest2248901-21kworker/u8:1+flush-259:011:00:241
2009837992418,4cyclictest2166225-21latency_hist09:40:001
2009834992421,2cyclictest2318741-21kworker/u8:1+flush-259:012:25:170
2009834992420,3cyclictest2297331-21kworker/u8:5+flush-259:011:45:230
2009842992320,2cyclictest2318741-21kworker/u8:1+flush-259:012:20:123
2009842992319,3cyclictest2270784-21kworker/u8:1+events_unbound11:20:183
2009842992319,3cyclictest2103797-21kworker/u8:1+flush-259:008:40:243
2009837992320,2cyclictest2333953-21sh12:20:001
2009837992318,4cyclictest2020607-21base6407:20:001
2009837992317,4cyclictest2355028-21latency_hist12:40:011
2009837992316,5cyclictest2213409-21/usr/sbin/munin10:25:131
2009834992316,5cyclictest2019178-21ntpq07:15:220
2009842992219,2cyclictest2297331-21kworker/u8:5+events_unbound11:45:223
2009842992217,4cyclictest2140412-21kworker/u8:2+events_unbound09:35:143
2009842992217,4cyclictest2103797-21kworker/u8:1+events_unbound09:15:153
2009842992217,3cyclictest252-21systemd-journal12:10:553
2009842992216,4cyclictest2009785-21latency_hist07:10:013
2009838992218,3cyclictest2155968-21kworker/u8:0+flush-259:011:05:212
2009837992215,5cyclictest2270768-21latency_hist11:20:001
2009834992219,2cyclictest2140412-21kworker/u8:2+events_unbound09:40:150
2009834992219,2cyclictest2140412-21kworker/u8:2+events_unbound09:40:150
2009834992218,3cyclictest2248901-21kworker/u8:1+events_unbound11:00:230
2009834992216,4cyclictest2073063-21base6408:10:010
2009842992117,3cyclictest4140665-21kworker/u8:2+events_unbound08:15:283
2009842992117,3cyclictest2155968-21kworker/u8:0+events_unbound11:05:003
2009838992116,4cyclictest2271002-21kworker/u8:4+flush-259:012:00:222
2009838992116,4cyclictest2271002-21kworker/u8:4+flush-259:012:00:222
2009838992116,4cyclictest2124926-21latency_hist09:00:002
2009838992114,5cyclictest2031364-21cp07:30:012
2009837992115,4cyclictest2176843-21/usr/sbin/munin09:50:141
2009834992118,2cyclictest2130086-21idleruntime-cro09:05:000
2009834992117,3cyclictest4140665-21kworker/u8:2+events_unbound08:10:140
2009834992116,4cyclictest252-21systemd-journal11:10:010
2009842992017,2cyclictest2062788-21kworker/u8:4+events_unbound08:05:203
2009842992017,2cyclictest2046645-21awk07:45:003
2009842992017,2cyclictest2009371-21kworker/u8:3+events_unbound07:27:553
2009842992016,2cyclictest0-21swapper/309:05:013
2009842992015,3cyclictest4140665-21kworker/u8:2+flush-259:008:35:213
2009842992013,5cyclictest252-21systemd-journal09:30:003
2009838992016,3cyclictest2307856-21kworker/u8:0+flush-259:012:25:252
2009838992016,3cyclictest2249766-21kworker/u8:2+flush-259:011:15:162
2009837992016,3cyclictest2271002-21kworker/u8:4+flush-259:011:35:271
2009837992016,3cyclictest2046668-21kworker/u8:1+flush-259:007:55:251
2009837992013,5cyclictest252-21systemd-journal10:35:001
2009834992016,3cyclictest2088522-21kworker/u8:0+flush-259:008:55:210
2009842991916,2cyclictest2271002-21kworker/u8:4+flush-259:011:35:253
2009842991915,3cyclictest4140665-21kworker/u8:2+events_unbound08:00:273
2009842991915,3cyclictest2318741-21kworker/u8:1+events_unbound12:05:113
2009842991915,3cyclictest2103797-21kworker/u8:1+events_unbound10:25:203
2009842991914,4cyclictest2009371-21kworker/u8:3+events_unbound07:45:283
2009842991913,4cyclictest2296782-21gpgv11:45:013
2009842991913,4cyclictest2234731-21diskstats10:45:183
2009838991915,3cyclictest2307856-21kworker/u8:0+flush-259:012:20:202
2009838991913,4cyclictest2228773-21unin-run10:40:002
2009834991915,3cyclictest2239672-21kworker/u8:4+flush-259:010:55:000
2009834991915,3cyclictest2192135-21kworker/u8:3+flush-259:010:10:180
2009834991915,3cyclictest2046668-21kworker/u8:1+events_unbound07:45:180
2009834991914,4cyclictest252-21systemd-journal09:13:560
2009834991914,4cyclictest2062788-21kworker/u8:4+flush-259:008:20:210
2009834991913,4cyclictest252-21systemd-journal10:21:550
2009838991816,1cyclictest2021791-21kthreadcore07:20:162
2009838991815,2cyclictest0-21swapper/211:05:012
200983899180,9cyclictest2197270-21munin-run10:10:002
2009837991814,3cyclictest2344988-21apt-get12:30:111
2009837991812,4cyclictest252-21systemd-journal08:16:561
2009834991817,1cyclictest2192135-21kworker/u8:3+events_unbound10:15:150
2009834991815,2cyclictest2318741-21kworker/u8:1+events_unbound12:10:150
2009834991814,3cyclictest2140412-21kworker/u8:2+flush-259:009:40:000
2009834991813,4cyclictest2103797-21kworker/u8:1+events_unbound09:20:200
2009842991715,1cyclictest2318741-21kworker/u8:1+events_unbound12:35:163
2009842991714,2cyclictest2131378-21kthreadcore09:05:193
2009842991713,3cyclictest2103797-21kworker/u8:1+flush-259:010:20:173
2009842991713,3cyclictest2088522-21kworker/u8:0+flush-259:008:55:163
2009842991710,5cyclictest2343809-21ntpq12:25:213
2009838991713,3cyclictest2318741-21kworker/u8:1+events_unbound12:15:192
2009838991713,2cyclictest0-21swapper/210:15:002
2009838991710,1cyclictest0-21swapper/210:45:002
2009837991711,4cyclictest2130088-21latency_hist09:05:001
2009834991714,2cyclictest60350irq/132-enp0s29f1:rx-010:36:200
2009834991714,2cyclictest60350irq/132-enp0s29f1:rx-010:31:370
2009834991714,2cyclictest60350irq/132-enp0s29f1:rx-009:51:160
2009834991714,2cyclictest60350irq/132-enp0s29f1:rx-008:50:160
2009834991714,2cyclictest60350irq/132-enp0s29f1:rx-007:24:050
2009834991713,3cyclictest2140412-21kworker/u8:2+flush-259:009:55:150
2009834991712,4cyclictest2280843-21kworker/u8:0+events_unbound11:35:180
2009842991612,3cyclictest2140412-21kworker/u8:2+events_unbound09:50:593
2009842991611,4cyclictest2046668-21kworker/u8:1+events_unbound07:51:573
2009842991610,4cyclictest2089095-21/usr/sbin/munin08:25:143
2009838991614,1cyclictest0-21swapper/208:55:002
2009838991612,2cyclictest2031014-21gpgv07:30:002
200983899161,14cyclictest0-21swapper/210:35:012
2009838991610,5cyclictest2203041-21cat10:15:022
2009838991610,4cyclictest252-21systemd-journal11:00:002
2009837991613,2cyclictest2296663-21latency_hist11:45:011
2009837991612,3cyclictest2088522-21kworker/u8:0+flush-259:008:55:001
2009837991611,3cyclictest2239706-21apt-get10:50:111
2009834991614,1cyclictest60350irq/132-enp0s29f1:rx-009:48:580
2009834991613,2cyclictest60350irq/132-enp0s29f1:rx-012:40:010
2009834991613,2cyclictest60350irq/132-enp0s29f1:rx-012:20:280
2009834991613,2cyclictest60350irq/132-enp0s29f1:rx-012:15:140
2009834991613,2cyclictest60350irq/132-enp0s29f1:rx-010:45:230
2009834991613,2cyclictest60350irq/132-enp0s29f1:rx-008:01:000
2009834991612,3cyclictest4140665-21kworker/u8:2+events_unbound08:30:170
2009834991612,3cyclictest2009371-21kworker/u8:3+events_unbound07:10:240
2009834991612,2cyclictest0-21swapper/010:10:000
2009842991511,3cyclictest2280843-21kworker/u8:0+flush-259:011:30:163
2009842991511,3cyclictest2140412-21kworker/u8:2+flush-259:009:40:243
2009842991511,3cyclictest2140412-21kworker/u8:2+flush-259:009:40:233
2009838991512,2cyclictest2140412-21kworker/u8:2+flush-259:009:30:202
2009838991512,2cyclictest2089530-21irqcore08:25:162
2009838991511,3cyclictest2318741-21kworker/u8:1+flush-259:012:05:232
200983799159,4cyclictest2067936-21/usr/sbin/munin08:05:201
2009837991513,1cyclictest0-21swapper/110:15:001
2009837991512,2cyclictest509-21rs:main1
2009837991512,1cyclictest0-21swapper/112:00:001
2009837991512,1cyclictest0-21swapper/112:00:001
2009837991511,3cyclictest500-21systemd-logind10:40:001
2009837991511,3cyclictest2109733-21apt-get08:45:131
2009834991513,1cyclictest60350irq/132-enp0s29f1:rx-007:50:200
2009834991512,2cyclictest60350irq/132-enp0s29f1:rx-008:35:190
2009834991512,2cyclictest60350irq/132-enp0s29f1:rx-007:39:580
2009834991512,2cyclictest2062788-21kworker/u8:4+events_unbound08:15:220
2009834991511,3cyclictest507-21in:imuxsock09:35:000
2009834991511,3cyclictest2271002-21kworker/u8:4+flush-259:011:55:170
2009834991511,3cyclictest2271002-21kworker/u8:4+flush-259:011:55:160
2009834991511,3cyclictest2140412-21kworker/u8:2+flush-259:010:00:210
2009842991410,3cyclictest4140665-21kworker/u8:2+flush-259:007:25:003
200983799148,4cyclictest2244840-21/usr/sbin/munin10:55:201
2009837991411,2cyclictest2009371-21kworker/u8:3+flush-259:007:15:261
2009837991410,2cyclictest252-21systemd-journal08:04:061
2009834991412,1cyclictest60350irq/132-enp0s29f1:rx-011:25:200
2009834991412,1cyclictest60350irq/132-enp0s29f1:rx-011:19:320
2009834991411,2cyclictest60350irq/132-enp0s29f1:rx-011:50:060
2009834991411,2cyclictest60350irq/132-enp0s29f1:rx-010:29:470
2009834991410,3cyclictest2062788-21kworker/u8:4+flush-259:008:25:210
200984299139,3cyclictest2103797-21kworker/u8:1+flush-259:008:53:323
200984299139,2cyclictest0-21swapper/310:15:163
2009842991310,2cyclictest0-21swapper/310:40:253
2009838991310,3cyclictest2088522-21kworker/u8:0+flush-259:009:00:212
2009838991310,2cyclictest2971-21cron09:20:002
2009838991310,2cyclictest2135510-21apt-get09:10:112
2009838991310,2cyclictest0-21swapper/207:50:002
200983799138,3cyclictest2255140-21/usr/sbin/munin11:05:141
200983799137,4cyclictest2145601-21latency_hist09:20:001
200983799131,2cyclictest2036344-21awk07:35:001
2009837991310,2cyclictest2187284-21cpuspeed_turbos10:00:121
2009837991310,2cyclictest2171664-21/usr/sbin/munin09:45:231
200983499139,3cyclictest2009371-21kworker/u8:3+events_unbound07:30:170
2009834991311,2cyclictest60350irq/132-enp0s29f1:rx-008:49:140
2009834991310,2cyclictest60350irq/132-enp0s29f1:rx-009:05:270
2009834991310,2cyclictest2144634-21cut09:15:190
200983899129,2cyclictest2345053-21cpuspeed_turbos12:30:122
200983899129,2cyclictest2271002-21kworker/u8:4+flush-259:011:45:032
200983899129,2cyclictest2271002-21kworker/u8:4+flush-259:011:40:162
200983899129,2cyclictest2244590-21cron10:55:002
200983899129,2cyclictest2114620-21sh08:50:002
200983899129,2cyclictest0-21swapper/208:05:172
200983899128,3cyclictest2297331-21kworker/u8:5+events_unbound11:50:142
200983899128,3cyclictest2103797-21kworker/u8:1+events_unbound10:20:242
200983899128,3cyclictest2010049-21/usr/sbin/munin07:10:142
2009838991210,1cyclictest0-21swapper/208:35:012
200983799128,3cyclictest490-21dbus-daemon12:05:011
200983799128,3cyclictest490-21dbus-daemon12:05:001
200983799128,2cyclictest0-21swapper/112:15:011
2009834991210,1cyclictest60350irq/132-enp0s29f1:rx-012:30:230
200983899119,1cyclictest0-21swapper/208:00:252
200983899118,2cyclictest2286826-21fschecks_time11:35:142
200983899117,2cyclictest2104290-21awk08:40:002
200983899116,3cyclictest2088506-40mandb08:20:562
200983799117,3cyclictest2062788-21kworker/u8:4+flush-259:008:25:161
200983899108,1cyclictest0-21swapper/211:20:122
200983899108,1cyclictest0-21swapper/209:50:192
200983899104,4cyclictest2281735-21fw_forwarded_lo11:30:142
200983799108,1cyclictest2156627-21irqcore09:30:151
200983799107,2cyclictest0-21swapper/110:40:141
200983799107,1cyclictest0-21swapper/111:10:181
200983799107,1cyclictest0-21swapper/107:25:191
200983799104,4cyclictest252-21systemd-journal11:51:571
20098389991,1cyclictest0-21swapper/210:00:132
20098389984,3cyclictest2166612-21cut09:40:122
20098389984,3cyclictest2166612-21cut09:40:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional