You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 07:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sat Sep 05, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3669480994641,3cyclictest3737612-21apt-get20:15:101
3669477994338,3cyclictest3856607-21base6422:10:000
3669480994035,4cyclictest3956234-21apt-get23:45:111
3669488993934,4cyclictest3877639-21kworker/u8:1+events_unbound22:40:173
3669477993934,3cyclictest3695526-21apt-get19:35:110
3669484993834,3cyclictest3903830-21kworker/u8:5+flush-259:000:15:252
3669477993832,4cyclictest3742794-21apt-get20:20:110
3669484993731,4cyclictest3747733-21latency_hist20:25:012
3669480993731,4cyclictest335557-21systemd-journal21:19:591
3669488993631,3cyclictest3742569-21kworker/u8:1+flush-259:021:05:103
3669477993531,3cyclictest3835499-21kworker/u8:3+flush-259:022:15:210
3669488993428,4cyclictest3909264-21/usr/sbin/munin23:00:133
3669488993329,3cyclictest3903830-21kworker/u8:5+flush-259:000:05:233
3669488993328,3cyclictest3690106-21kworker/u8:4+flush-259:020:10:263
3669488993327,4cyclictest3940077-21latency_hist23:30:003
3669484993228,3cyclictest3919665-21apt-get23:10:112
3669484993226,4cyclictest335557-21systemd-journal22:50:322
3669488993127,3cyclictest3966565-21apt-get23:55:113
3669488993124,4cyclictest3825100-21latency_hist21:40:003
3669480993126,4cyclictest3924805-21apt-get23:15:111
3669477993127,3cyclictest3887920-21kworker/u8:0+flush-259:022:50:160
3669477993126,4cyclictest3732187-21latency_hist20:10:000
3669488992924,3cyclictest3987074-21kworker/u8:1+flush-259:000:20:223
3669477992926,2cyclictest3877639-21kworker/u8:1+events_unbound22:45:000
3669488992822,4cyclictest3669628-21kworker/u8:2+events_unbound19:20:143
3669484992825,2cyclictest3669628-21kworker/u8:2+flush-259:020:00:222
3669480992824,3cyclictest3680040-21apt-get19:20:111
3669480992824,3cyclictest335557-21systemd-journal23:02:051
3669480992823,3cyclictest335557-21systemd-journal22:28:311
3669480992821,5cyclictest3689155-21ntpq19:25:201
3669488992723,3cyclictest1623209-21kworker/u8:3+flush-259:019:10:153
3669484992724,2cyclictest3819959-21kworker/u8:0+flush-259:022:10:012
3669484992723,3cyclictest3742569-21kworker/u8:1+flush-259:021:05:322
3669477992725,1cyclictest60350irq/132-enp0s29f1:rx-021:19:590
3669488992623,2cyclictest3809490-21kworker/u8:3+events_unbound21:25:253
3669480992623,2cyclictest3742569-21kworker/u8:1+events_unbound20:30:141
3669477992620,4cyclictest3940922-21diskstats23:30:110
3669477992620,4cyclictest3762259-21ntpq20:35:200
3669488992521,3cyclictest3987074-21kworker/u8:1+flush-259:000:30:133
3669488992521,3cyclictest3903830-21kworker/u8:5+flush-259:023:45:133
3669488992518,5cyclictest3992234-21latency_hist00:20:013
3669480992521,3cyclictest3725764-21ntpq20:00:201
3669484992418,4cyclictest3970573-21ntpq23:55:202
3669480992420,3cyclictest509-21rs:main1
3669477992420,3cyclictest3669628-21kworker/u8:2+flush-259:019:55:250
3669488992318,4cyclictest3742569-21kworker/u8:1+flush-259:021:45:153
3669484992319,3cyclictest3893046-21latency_hist22:45:002
3669484992318,4cyclictest3758319-21apt-get20:35:112
3669480992320,2cyclictest3778719-21kworker/u8:0+flush-259:021:20:161
3669480992319,3cyclictest1623209-21kworker/u8:3+flush-259:019:45:171
3669480992318,3cyclictest3794136-21latency_hist21:10:011
3669477992320,2cyclictest3742569-21kworker/u8:1+flush-259:020:50:220
3669488992218,3cyclictest3903830-21kworker/u8:5+flush-259:023:10:233
3669488992217,4cyclictest3819959-21kworker/u8:0+events_unbound22:10:123
3669488992216,4cyclictest3903830-21kworker/u8:5+flush-259:023:50:143
3669484992218,3cyclictest3971493-21kworker/u8:0+flush-259:000:25:262
3669484992218,3cyclictest3971493-21kworker/u8:0+flush-259:000:25:252
3669480992219,2cyclictest3987074-21kworker/u8:1+flush-259:000:35:001
3669480992217,4cyclictest335557-21systemd-journal22:01:311
3669477992220,1cyclictest3819918-21sh21:35:000
3669488992117,3cyclictest3987074-21kworker/u8:1+flush-259:000:25:283
3669488992117,3cyclictest3987074-21kworker/u8:1+flush-259:000:25:283
3669488992117,3cyclictest3903830-21kworker/u8:5+events_unbound00:00:173
3669484992118,2cyclictest3778719-21kworker/u8:0+flush-259:021:00:232
3669484992118,2cyclictest3669628-21kworker/u8:2+flush-259:019:10:232
3669484992117,3cyclictest3727347-21apt-get20:05:112
3669480992116,3cyclictest3945906-21apt-get23:35:101
3669477992119,1cyclictest3850936-21kworker/u8:2+flush-259:022:25:100
3669477992118,2cyclictest3903830-21kworker/u8:5+flush-259:023:40:000
3669477992115,4cyclictest3737351-21latency_hist20:15:010
3669477992114,5cyclictest4008171-21diskstats00:35:120
3669488992017,2cyclictest3835499-21kworker/u8:3+events_unbound22:30:233
3669488992017,2cyclictest3778719-21kworker/u8:0+flush-259:021:10:223
3669488992017,2cyclictest3742569-21kworker/u8:1+events_unbound21:30:153
3669488992016,3cyclictest3903830-21kworker/u8:5+flush-259:023:15:153
3669488992016,3cyclictest3850936-21kworker/u8:2+events_unbound22:25:143
3669488992016,3cyclictest3778719-21kworker/u8:0+events_unbound21:23:333
3669484992017,2cyclictest3945524-21kworker/u8:2+events_unbound23:50:212
366948099200,19cyclictest3732210-21true20:10:001
3669477992016,3cyclictest3914419-21/usr/sbin/munin23:05:130
3669488991916,2cyclictest3877639-21kworker/u8:1+flush-259:022:47:043
3669488991916,2cyclictest3819959-21kworker/u8:0+events_unbound21:50:223
3669488991915,3cyclictest3903830-21kworker/u8:5+flush-259:023:35:223
3669488991915,3cyclictest3903830-21kworker/u8:5+flush-259:023:05:273
3669488991915,3cyclictest3903830-21kworker/u8:5+events_unbound23:40:143
3669488991915,3cyclictest3669628-21kworker/u8:2+flush-259:020:40:193
3669484991916,2cyclictest3835499-21kworker/u8:3+flush-259:022:15:222
3669480991916,2cyclictest3669628-21kworker/u8:2+flush-259:019:40:001
3669477991915,3cyclictest3945524-21kworker/u8:2+flush-259:023:55:260
3669488991815,2cyclictest3773963-21diskstats20:50:133
3669488991815,2cyclictest3721529-21kworker/u8:0+events_unbound20:05:183
3669488991815,2cyclictest3669628-21kworker/u8:2+events_unbound19:15:173
3669488991815,2cyclictest1623209-21kworker/u8:3+events_unbound19:40:143
3669488991814,3cyclictest3903830-21kworker/u8:5+events_unbound23:30:203
3669488991814,3cyclictest3887920-21kworker/u8:0+events_unbound23:20:123
3669488991812,4cyclictest3742569-21kworker/u8:1+flush-259:022:00:243
3669484991815,2cyclictest3903830-21kworker/u8:5+flush-259:023:45:162
3669484991814,3cyclictest3904069-21apt-get22:55:102
3669477991815,2cyclictest3929706-21cron23:20:010
3669477991815,2cyclictest3903830-21kworker/u8:5+flush-259:023:25:000
3669477991814,3cyclictest3987074-21kworker/u8:1+flush-259:000:20:260
3669477991814,3cyclictest3742569-21kworker/u8:1+flush-259:021:05:290
3669477991813,4cyclictest3825359-21apt-get21:40:090
3669488991715,1cyclictest3669628-21kworker/u8:2+events_unbound19:55:243
3669488991714,2cyclictest3669628-21kworker/u8:2+events_unbound19:30:203
3669488991713,3cyclictest3903830-21kworker/u8:5+flush-259:022:55:223
3669488991713,3cyclictest3877639-21kworker/u8:1+events_unbound22:35:163
3669488991713,3cyclictest3835499-21kworker/u8:3+flush-259:022:15:203
3669488991713,3cyclictest1623209-21kworker/u8:3+events_unbound19:47:343
3669488991712,4cyclictest3778719-21kworker/u8:0+events_unbound21:00:193
3669488991712,4cyclictest3742569-21kworker/u8:1+flush-259:022:05:193
3669488991712,3cyclictest3669628-21kworker/u8:2+flush-259:020:25:253
3669488991710,5cyclictest3867087-21/usr/sbin/munin22:20:163
3669488991710,5cyclictest335557-21systemd-journal22:55:013
3669488991710,4cyclictest3772642-21ntpq20:45:213
3669484991714,2cyclictest3704615-21needreboot19:40:182
3669480991715,1cyclictest3903830-21kworker/u8:5+flush-259:000:05:131
3669477991715,1cyclictest0-21swapper/021:50:000
3669477991714,2cyclictest0-21swapper/023:15:010
3669477991713,3cyclictest3763450-21apt-get20:40:110
3669477991713,3cyclictest335557-21systemd-journal23:00:010
3669488991612,3cyclictest3690106-21kworker/u8:4+events_unbound20:00:023
3669488991612,3cyclictest3669628-21kworker/u8:2+events_unbound19:37:333
3669488991610,4cyclictest3840893-21/usr/sbin/munin21:55:223
3669484991613,2cyclictest3948210-21kthreadcore23:35:162
3669484991611,4cyclictest3872709-21apt-get22:25:102
3669480991614,1cyclictest3717639-21kthreadcore19:55:171
3669480991613,2cyclictest3887920-21kworker/u8:0+events_unbound23:30:021
3669480991613,2cyclictest3809490-21kworker/u8:3+flush-259:021:35:141
3669477991614,1cyclictest60350irq/132-enp0s29f1:rx-021:25:230
3669477991614,1cyclictest60350irq/132-enp0s29f1:rx-020:30:170
3669477991611,4cyclictest3779091-21diskstats20:55:130
3669488991511,3cyclictest3669628-21kworker/u8:2+events_unbound19:25:153
3669488991510,4cyclictest3669628-21kworker/u8:2+flush-259:019:52:373
3669488991510,4cyclictest335557-21systemd-journal20:31:333
366948499159,4cyclictest3856724-21cp22:10:002
3669484991512,2cyclictest3779153-21fschecks_time20:55:142
3669484991512,2cyclictest3696348-21irqcore19:35:172
3669484991510,4cyclictest3778667-21latency_hist20:55:012
3669480991512,2cyclictest509-21rs:main1
3669480991512,2cyclictest3903830-21kworker/u8:5+flush-259:000:10:251
3669480991512,2cyclictest3882769-21latency_hist22:35:011
3669480991512,2cyclictest3742569-21kworker/u8:1+events_unbound20:40:161
3669480991512,2cyclictest3669628-21kworker/u8:2+flush-259:019:50:161
3669480991511,3cyclictest3778719-21kworker/u8:0+events_unbound21:00:221
3669480991510,4cyclictest3814767-21latency_hist21:30:001
3669477991513,1cyclictest60350irq/132-enp0s29f1:rx-022:05:140
3669477991513,1cyclictest60350irq/132-enp0s29f1:rx-020:00:330
3669477991513,1cyclictest60350irq/132-enp0s29f1:rx-019:10:230
3669477991512,2cyclictest60350irq/132-enp0s29f1:rx-023:45:200
3669477991512,2cyclictest60350irq/132-enp0s29f1:rx-023:25:140
3669477991512,2cyclictest60350irq/132-enp0s29f1:rx-022:21:320
3669488991410,3cyclictest3987074-21kworker/u8:1+flush-259:000:35:113
366948499149,3cyclictest4012921-21latency_hist00:40:012
366948499148,4cyclictest3871210-21ntp_states22:20:242
3669484991411,2cyclictest3850936-21kworker/u8:2+flush-259:022:30:262
366948099149,3cyclictest3721529-21kworker/u8:0+flush-259:020:35:241
3669480991412,1cyclictest0-21swapper/100:30:001
3669480991412,1cyclictest0-21swapper/100:30:001
3669480991411,2cyclictest1623209-21kworker/u8:3+flush-259:019:30:161
3669480991411,1cyclictest0-21swapper/100:04:591
366948099140,12cyclictest3919410-21munin-run23:10:001
3669477991412,1cyclictest60350irq/132-enp0s29f1:rx-022:45:160
3669477991412,1cyclictest60350irq/132-enp0s29f1:rx-021:50:100
3669477991412,1cyclictest60350irq/132-enp0s29f1:rx-019:40:150
3669477991411,2cyclictest60350irq/132-enp0s29f1:rx-021:35:230
3669477991411,2cyclictest60350irq/132-enp0s29f1:rx-000:25:250
3669477991411,2cyclictest60350irq/132-enp0s29f1:rx-000:25:240
3669477991411,2cyclictest60350irq/132-enp0s29f1:rx-000:00:190
3669477991410,3cyclictest3903830-21kworker/u8:5+flush-259:000:15:000
366948899139,3cyclictest3721529-21kworker/u8:0+flush-259:020:20:193
366948899138,4cyclictest3825359-21apt-get21:40:113
366948899131,3cyclictest3763195-21munin-plugin-st20:40:003
366948499139,3cyclictest3705889-21apt-get19:45:122
366948499137,4cyclictest3996497-21ntpq00:20:232
366948499136,5cyclictest3986896-21sshd00:13:242
366948099139,3cyclictest3888134-21/usr/sbin/munin22:40:121
366948099139,2cyclictest1623209-21kworker/u8:3+flush-259:019:10:201
366948099138,4cyclictest3794392-21apt-get21:10:111
366948099138,4cyclictest335557-21systemd-journal23:56:331
366948099137,4cyclictest335557-21systemd-journal23:30:011
3669480991310,2cyclictest3934455-21unixbench_multi23:20:241
3669480991310,2cyclictest3830245-21idleruntime-cro21:44:591
3669480991310,2cyclictest0-21swapper/100:25:001
366947799139,3cyclictest3808716-21ntpq21:20:210
3669477991312,1cyclictest60350irq/132-enp0s29f1:rx-023:51:360
3669477991311,1cyclictest60350irq/132-enp0s29f1:rx-022:35:110
3669477991311,1cyclictest60350irq/132-enp0s29f1:rx-000:30:100
366948899128,3cyclictest3778719-21kworker/u8:0+events_unbound21:15:153
366948499129,2cyclictest3976665-21idleruntime-cro00:05:002
366948499129,2cyclictest3943054-21tr23:30:162
366948499129,2cyclictest3721529-21kworker/u8:0+flush-259:020:15:212
366948499128,3cyclictest3768363-21latency_hist20:45:022
366948499128,3cyclictest3753142-21apt-get20:30:102
3669484991210,1cyclictest3819916-21cron21:34:592
3669484991210,1cyclictest0-21swapper/220:15:002
366948499120,3cyclictest3695271-21awk19:35:002
366948099129,2cyclictest3923683-21ntp_kernel_pll_23:10:211
366948099129,2cyclictest17450irq/129-nvme0q220:15:001
366948099129,1cyclictest0-21swapper/100:19:591
366948099128,3cyclictest3877639-21kworker/u8:1+events_unbound22:35:221
366948099123,2cyclictest3679765-21idleruntime-cro19:20:001
3669480991210,1cyclictest0-21swapper/122:10:011
366948499118,2cyclictest3930052-21cpuspeed_turbos23:20:132
366948499118,2cyclictest3914511-21cpuspeed_turbos23:05:132
366948499118,1cyclictest0-21swapper/200:30:132
366948499117,3cyclictest3824882-21sshd21:37:322
366947799110,4cyclictest3849111-21grep22:00:190
366948899105,3cyclictest3738014-21/usr/sbin/munin20:15:153
366948499101,2cyclictest3835439-21cron21:49:592
36694849997,1cyclictest0-21swapper/221:50:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional