You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 11:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Apr 15, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3774336994941,6cyclictest252-21systemd-journal23:05:012
3774333994034,4cyclictest4008538-21latency_hist22:55:011
3774333993833,3cyclictest3779660-21/usr/sbin/munin19:15:151
3774336993733,3cyclictest4008556-21kworker/u8:0+flush-259:000:02:162
3774336993629,5cyclictest3805171-21latency_hist19:40:002
3774333993630,4cyclictest3841213-21latency_hist20:15:011
3774331993632,3cyclictest3877270-21kworker/u8:0+events_unbound21:35:140
377433199360,35cyclictest1-21systemd21:25:000
3774336993529,4cyclictest509-21rs:main2
3774331993532,2cyclictest4008556-21kworker/u8:0+events_unbound00:20:150
3774331993532,2cyclictest3935107-21kworker/u8:3+flush-259:022:35:180
3774341993429,3cyclictest4055497-21apt-get23:40:113
3774341993427,4cyclictest3825703-21latency_hist20:00:013
3774341993423,9cyclictest4002947-21apt-get22:50:033
3774336993430,3cyclictest3805396-21kworker/u8:2+flush-259:020:25:202
3774336993430,3cyclictest3763727-21kworker/u8:0+flush-259:019:20:202
3774333993430,3cyclictest3794792-21kworker/u8:1+flush-259:019:30:161
3774331993428,4cyclictest3841451-21/usr/sbin/munin20:15:150
3774333993228,2cyclictest3909470-21apt-get21:20:111
3774333993226,4cyclictest4101583-21latency_hist00:25:011
3774331993229,2cyclictest3951187-21kworker/u8:2+events_unbound22:05:120
3774331993228,3cyclictest4008556-21kworker/u8:0+flush-259:000:10:250
3774331993226,4cyclictest3850697-21ntpq20:20:220
3774341993024,4cyclictest3872732-21latency_hist20:45:013
3774333993024,4cyclictest3966726-21apt-get22:15:121
3774336992925,3cyclictest3935107-21kworker/u8:3+events_unbound23:20:142
3774341992826,1cyclictest3851380-21fwupd20:23:123
3774341992822,4cyclictest3878276-21latency_hist20:50:013
3774336992823,3cyclictest252-21systemd-journal20:56:102
3774333992822,4cyclictest3951045-21base6422:00:001
3774331992825,2cyclictest3971679-21kworker/u8:0+flush-259:022:23:130
3774331992825,2cyclictest3935107-21kworker/u8:3+events_unbound22:30:220
3774331992825,2cyclictest3877270-21kworker/u8:0+events_unbound21:05:160
3774331992824,3cyclictest3982423-21kworker/u8:1+events_unbound23:02:110
3774331992823,4cyclictest3888897-21apt-get21:00:120
3774341992722,3cyclictest252-21systemd-journal20:16:103
3774341992721,4cyclictest252-21systemd-journal21:00:003
3774336992723,3cyclictest4045162-21kworker/u8:1+events_unbound23:45:142
3774336992723,3cyclictest3794792-21kworker/u8:1+flush-259:020:10:212
3774336992723,3cyclictest3794792-21kworker/u8:1+events_unbound20:05:132
3774333992720,4cyclictest252-21systemd-journal20:42:101
3774331992723,3cyclictest3763727-21kworker/u8:0+events_unbound19:20:140
3774341992623,2cyclictest4008556-21kworker/u8:0+flush-259:023:45:263
3774341992622,3cyclictest4101627-21kworker/u8:1+flush-259:000:30:173
3774341992620,4cyclictest4085837-40mandb00:06:273
3774341992620,4cyclictest3820563-21latency_hist19:55:003
3774336992622,3cyclictest4008556-21kworker/u8:0+events_unbound23:41:102
3774336992622,3cyclictest3935107-21kworker/u8:3+events_unbound23:25:202
3774333992621,3cyclictest3789570-21kworker/u8:3+flush-259:019:35:171
3774331992623,2cyclictest3800041-21kworker/u8:0+events_unbound19:45:140
3774331992623,2cyclictest3763727-21kworker/u8:0+events_unbound19:15:170
3774341992519,4cyclictest3919580-21latency_hist21:30:013
3774336992522,2cyclictest3794792-21kworker/u8:1+flush-259:020:00:202
3774336992521,3cyclictest3883492-21kworker/u8:1+events_unbound21:20:012
3774336992521,3cyclictest3825346-21kworker/u8:0+flush-259:020:00:002
3774336992519,4cyclictest4085224-21ntpq00:05:222
3774333992518,5cyclictest252-21systemd-journal21:10:001
3774333992517,6cyclictest252-21systemd-journal23:55:001
3774331992520,3cyclictest3794792-21kworker/u8:1+flush-259:019:45:000
3774331992519,4cyclictest3882590-21ntpq20:50:220
3774341992418,4cyclictest3893757-21latency_hist21:05:003
3774336992421,2cyclictest4008556-21kworker/u8:0+events_unbound00:30:132
3774336992421,2cyclictest3935107-21kworker/u8:3+events_unbound22:23:112
3774336992420,3cyclictest3877270-21kworker/u8:0+flush-259:020:50:162
3774336992420,3cyclictest3794792-21kworker/u8:1+events_unbound19:50:002
3774333992418,3cyclictest4086383-21/usr/sbin/munin00:10:221
3774333992416,5cyclictest3763727-21kworker/u8:0+flush-259:019:20:171
3774331992421,2cyclictest3935107-21kworker/u8:3+flush-259:022:45:000
3774331992421,2cyclictest3914448-21kworker/u8:2+events_unbound21:50:210
3774331992418,4cyclictest3903249-21ntpq21:10:230
3774341992321,1cyclictest3883492-21kworker/u8:1+flush-259:021:15:263
3774336992321,1cyclictest3935107-21kworker/u8:3+events_unbound22:30:122
3774336992320,2cyclictest3935107-21kworker/u8:3+events_unbound21:55:142
3774336992319,3cyclictest4018808-21kworker/u8:2+events_unbound23:06:052
3774336992319,3cyclictest3951187-21kworker/u8:2+events_unbound22:00:222
3774333992317,4cyclictest252-21systemd-journal22:26:111
3774331992320,2cyclictest4008556-21kworker/u8:0+events_unbound00:06:130
3774331992320,2cyclictest3971679-21kworker/u8:0+events_unbound22:30:000
3774341992216,4cyclictest252-21systemd-journal20:51:103
3774336992219,2cyclictest3877270-21kworker/u8:0+flush-259:021:40:162
3774336992218,3cyclictest4008556-21kworker/u8:0+flush-259:023:50:222
3774336992218,3cyclictest3951187-21kworker/u8:2+events_unbound22:07:112
3774336992218,3cyclictest3856724-21kworker/u8:3+flush-259:020:40:002
3774336992218,2cyclictest3794792-21kworker/u8:1+flush-259:020:20:182
3774333992218,3cyclictest3883492-21kworker/u8:1+flush-259:021:05:011
3774333992217,3cyclictest3805396-21kworker/u8:2+flush-259:020:05:161
3774333992216,4cyclictest3914669-21apt-get21:25:121
3774333992215,5cyclictest3851790-21/usr/sbin/munin20:25:151
3774331992219,2cyclictest4045162-21kworker/u8:1+flush-259:023:30:210
3774331992219,2cyclictest4008556-21kworker/u8:0+flush-259:022:55:230
3774331992219,2cyclictest3877270-21kworker/u8:0+flush-259:021:25:190
3774331992219,2cyclictest3877270-21kworker/u8:0+flush-259:020:50:010
3774331992219,2cyclictest3794792-21kworker/u8:1+events_unbound19:31:260
3774331992218,3cyclictest3805396-21kworker/u8:2+events_unbound20:30:210
3774331992218,3cyclictest3805396-21kworker/u8:2+events_unbound20:10:090
3774331992216,2cyclictest3982423-21kworker/u8:1+events_unbound22:50:240
3774341992116,4cyclictest4008807-21apt-get22:55:113
3774341992115,4cyclictest4091547-21apt-get00:15:113
3774336992118,2cyclictest4008542-21munin-plugin-st22:55:002
3774336992117,3cyclictest4091324-21kworker/u8:2+events_unbound00:18:112
3774336992117,3cyclictest3961515-21kworker/u8:4+events_unbound22:18:132
3774336992117,3cyclictest3935107-21kworker/u8:3+events_unbound22:27:132
3774333992117,3cyclictest4008556-21kworker/u8:0+flush-259:023:00:161
3774333992117,3cyclictest3935105-21kworker/u8:1+flush-259:021:50:001
3774331992117,3cyclictest4008556-21kworker/u8:0+events_unbound23:41:120
3774331992117,3cyclictest3815466-21kworker/u8:3+flush-259:019:50:440
3774341992017,2cyclictest3935107-21kworker/u8:3+flush-259:022:20:003
3774341992015,4cyclictest3862146-21apt-get20:35:133
3774336992017,2cyclictest4045162-21kworker/u8:1+events_unbound23:30:192
3774336992017,2cyclictest3794792-21kworker/u8:1+events_unbound20:45:152
3774336992016,3cyclictest4008556-21kworker/u8:0+events_unbound00:21:112
3774336992015,4cyclictest252-21systemd-journal19:32:092
3774331992017,2cyclictest4111500-21kworker/u8:3+flush-259:000:34:590
3774331992017,2cyclictest4008556-21kworker/u8:0+flush-259:023:35:180
3774331992017,2cyclictest3877270-21kworker/u8:0+events_unbound21:40:210
3774331992017,2cyclictest3856724-21kworker/u8:3+flush-259:020:55:450
3774331992017,2cyclictest3794792-21kworker/u8:1+events_unbound20:08:110
3774331992017,2cyclictest3763727-21kworker/u8:0+events_unbound19:10:210
3774331992016,3cyclictest3899123-21kworker/u8:3+events_unbound21:15:130
3774331992015,4cyclictest3774250-21latency_hist19:10:010
3774341991916,2cyclictest0-21swapper/322:25:003
3774336991916,2cyclictest4111500-21kworker/u8:3+flush-259:000:35:152
3774336991916,2cyclictest4045162-21kworker/u8:1+events_unbound23:35:152
3774336991916,2cyclictest4008556-21kworker/u8:0+events_unbound00:10:252
3774336991916,2cyclictest3883492-21kworker/u8:1+flush-259:021:05:152
3774336991916,2cyclictest3883492-21kworker/u8:1+events_unbound21:10:122
3774336991915,3cyclictest3914448-21kworker/u8:2+flush-259:021:45:202
3774336991915,3cyclictest3800041-21kworker/u8:0+events_unbound19:44:122
3774336991915,3cyclictest3763727-21kworker/u8:0+events_unbound19:12:102
3774331991916,2cyclictest4111500-21kworker/u8:3+events_unbound00:36:130
3774331991916,2cyclictest3789570-21kworker/u8:3+events_unbound19:35:190
3774331991915,3cyclictest4008556-21kworker/u8:0+flush-259:023:45:210
3774331991915,3cyclictest4008556-21kworker/u8:0+flush-259:023:10:200
3774331991913,2cyclictest60350irq/132-enp0s29f1:rx-023:50:120
3774341991815,2cyclictest4052648-21kthreadcore23:35:173
3774341991812,4cyclictest4117079-21latency_hist00:40:003
3774336991815,2cyclictest4045162-21kworker/u8:1+flush-259:023:55:262
3774336991815,2cyclictest3877270-21kworker/u8:0+flush-259:021:00:252
3774336991814,3cyclictest252-21systemd-journal19:20:002
3774336991813,4cyclictest3966452-21sh22:15:002
3774331991815,2cyclictest4008556-21kworker/u8:0+events_unbound23:19:110
3774331991814,3cyclictest3950528-21apt-get22:00:000
3774331991814,3cyclictest3805396-21kworker/u8:2+events_unbound20:26:370
3774331991813,4cyclictest4101848-21apt-get00:25:120
3774341991714,2cyclictest3841213-21latency_hist20:15:003
3774341991713,3cyclictest4008556-21kworker/u8:0+flush-259:023:11:093
3774341991713,3cyclictest3935107-21kworker/u8:3+flush-259:021:50:003
3774336991714,2cyclictest3971679-21kworker/u8:0+events_unbound22:35:252
3774336991714,2cyclictest3935107-21kworker/u8:3+flush-259:022:45:202
3774336991713,3cyclictest3883492-21kworker/u8:1+events_unbound21:25:122
3774336991713,3cyclictest3877270-21kworker/u8:0+events_unbound21:35:262
3774336991713,3cyclictest3877270-21kworker/u8:0+events_unbound21:30:282
377433399174,7cyclictest3904078-21munin-run21:15:001
3774333991713,3cyclictest4034522-21apt-get23:20:121
3774333991713,3cyclictest3935107-21kworker/u8:3+flush-259:023:15:261
3774333991713,3cyclictest3763727-21kworker/u8:0+flush-259:019:10:251
3774333991713,2cyclictest0-21swapper/122:15:001
3774331991714,3cyclictest3763727-21kworker/u8:0+events_unbound19:26:250
3774331991714,2cyclictest3961515-21kworker/u8:4+events_unbound22:10:130
3774331991714,2cyclictest3919604-21kworker/u8:4+events_unbound21:33:110
3774341991611,3cyclictest252-21systemd-journal00:25:003
3774336991613,2cyclictest3914448-21kworker/u8:2+events_unbound21:50:232
3774336991612,3cyclictest3794792-21kworker/u8:1+flush-259:020:33:452
377433399169,5cyclictest252-21systemd-journal00:29:541
3774333991613,2cyclictest4060389-21sh23:45:011
3774333991612,3cyclictest4008556-21kworker/u8:0+flush-259:023:12:111
3774333991612,3cyclictest3935107-21kworker/u8:3+flush-259:023:05:261
3774333991611,3cyclictest3877270-21kworker/u8:0+flush-259:021:40:241
3774333991610,4cyclictest3971679-21kworker/u8:0+flush-259:022:31:171
3774333991610,4cyclictest3888632-21latency_hist21:00:011
3774331991614,1cyclictest60350irq/132-enp0s29f1:rx-021:45:240
3774331991614,1cyclictest60350irq/132-enp0s29f1:rx-019:55:180
3774331991613,2cyclictest60350irq/132-enp0s29f1:rx-023:55:180
3774331991613,2cyclictest60350irq/132-enp0s29f1:rx-020:02:460
3774331991612,3cyclictest4018808-21kworker/u8:2+flush-259:023:05:240
3774341991510,4cyclictest509-21rs:main3
3774336991512,2cyclictest3935107-21kworker/u8:3+events_unbound23:15:232
3774336991511,3cyclictest3794792-21kworker/u8:1+flush-259:020:16:352
377433399159,4cyclictest3971928-21apt-get22:20:121
3774333991512,2cyclictest0-21swapper/122:00:001
3774333991511,2cyclictest3940949-21irqcore21:50:161
3774333991510,3cyclictest4050354-21apt-get23:35:101
3774331991513,1cyclictest3998492-21irqcore22:45:170
3774331991512,2cyclictest60350irq/132-enp0s29f1:rx-023:20:160
3774331991512,1cyclictest0-21swapper/020:45:000
3774331991510,4cyclictest3961515-21kworker/u8:4+events_unbound22:19:250
377434199149,4cyclictest3789570-21kworker/u8:3+flush-259:019:34:153
377434199148,5cyclictest3836026-21latency_hist20:10:003
3774341991411,2cyclictest3779457-21kworker/u8:1-events_unbound19:20:003
3774336991411,2cyclictest3883492-21kworker/u8:1+flush-259:021:21:162
3774336991410,3cyclictest4008556-21kworker/u8:0+flush-259:023:13:472
377433399149,3cyclictest4008556-21kworker/u8:0+flush-259:000:32:411
377433399147,5cyclictest4008780-21/usr/sbin/munin22:55:141
377433399147,5cyclictest3810528-21/usr/sbin/munin19:45:191
377433399147,4cyclictest3793961-21ntpq19:25:211
3774333991411,2cyclictest3845526-21ntp_offset20:15:231
3774333991411,2cyclictest3830849-21idleruntime-cro20:04:591
3774333991410,3cyclictest3809832-21unixbench_multi19:40:251
3774333991410,2cyclictest0-21swapper/120:30:171
3774331991412,2cyclictest61150irq/133-enp0s29f1:tx-020:35:260
3774331991412,1cyclictest60350irq/132-enp0s29f1:rx-023:26:310
3774331991412,1cyclictest60350irq/132-enp0s29f1:rx-022:00:170
3774331991411,2cyclictest60350irq/132-enp0s29f1:rx-000:17:220
3774331991411,2cyclictest60350irq/132-enp0s29f1:rx-000:00:000
377434199138,4cyclictest3861515-21journal-offline20:30:453
3774341991310,2cyclictest0-21swapper/322:50:003
3774336991310,2cyclictest4008556-21kworker/u8:0+flush-259:022:56:122
3774336991310,2cyclictest3805396-21kworker/u8:2+events_unbound19:50:142
377433399139,3cyclictest3877270-21kworker/u8:0+flush-259:020:50:261
377434199129,2cyclictest3898890-21sh21:10:003
3774341991210,1cyclictest0-21swapper/322:05:003
377433699129,2cyclictest3794792-21kworker/u8:1+events_unbound20:40:222
377433399129,2cyclictest4044455-21unixbench_multi23:25:241
377433399129,2cyclictest0-21swapper/100:15:161
377433399128,3cyclictest4070959-21apt-get23:55:141
377433399128,3cyclictest3877270-21kworker/u8:0+flush-259:021:35:251
377433399125,5cyclictest509-21rs:main1
377434199117,3cyclictest4018808-21kworker/u8:2+flush-259:023:28:423
377433699118,2cyclictest3935107-21kworker/u8:3+flush-259:022:40:262
377433399115,4cyclictest3996929-21ntpq22:40:211
377434199107,2cyclictest3945712-21cpuspeed_turbos21:55:133
377434199107,1cyclictest0-21swapper/319:10:133
377434199105,4cyclictest491ktimers/323:55:133
377434199100,2cyclictest3774250-21latency_hist19:10:013
377433399108,1cyclictest0-21swapper/120:20:131
377433399107,2cyclictest4002498-21unixbench_multi22:45:271
377433399106,3cyclictest4045162-21kworker/u8:1+flush-259:023:30:361
377433399106,3cyclictest3971679-21kworker/u8:0+flush-259:022:35:491
37743419997,1cyclictest0-21swapper/319:40:153
37743419981,5cyclictest3961550-21taskset22:10:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional