You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 19:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Thu Aug 06, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3836452994946,2cyclictest3846485-21kworker/u8:4+flush-259:008:20:003
3836442994640,4cyclictest335557-21systemd-journal10:30:280
3836446994440,3cyclictest3872316-21kworker/u8:2+flush-259:008:25:011
3836446994436,6cyclictest4069904-21latency_hist10:55:011
3836450994235,5cyclictest4054439-21latency_hist10:40:012
3836450994033,5cyclictest335557-21systemd-journal08:55:012
3836450993933,4cyclictest3934814-21kworker/u8:0+flush-259:008:45:212
3836446993834,3cyclictest4043451-21kworker/u8:0+flush-259:010:40:161
3836446993731,4cyclictest335557-21systemd-journal11:20:481
3836442993730,5cyclictest3876992-21ntpq07:45:210
3836450993631,4cyclictest4059618-21kworker/u8:1+flush-259:010:50:192
3836446993630,4cyclictest3872316-21kworker/u8:2+flush-259:008:30:161
3836446993628,6cyclictest4131803-21latency_hist11:55:011
3836442993628,5cyclictest335557-21systemd-journal10:45:340
3836452993532,2cyclictest4075309-21kworker/u8:3+events_unbound11:45:013
3836452993330,2cyclictest3826309-21kworker/u8:1+flush-259:007:30:233
3836442993328,3cyclictest3872316-21kworker/u8:2+flush-259:008:25:150
3836442993327,4cyclictest335557-21systemd-journal09:49:590
3836452993228,3cyclictest3996799-21kworker/u8:2+events_unbound09:57:503
3836452993228,3cyclictest3986426-21kworker/u8:1+events_unbound09:36:503
3836452993228,3cyclictest3939973-21kworker/u8:2+flush-259:009:20:253
3836452993227,4cyclictest335557-21systemd-journal10:13:483
3836452993226,4cyclictest3950616-21latency_hist09:00:003
3836446993229,2cyclictest3945170-21kworker/u8:3+events_unbound09:00:191
3836446993227,3cyclictest4085409-21kworker/u8:0+flush-259:012:25:171
3836442993215,4cyclictest4152672-21/usr/sbin/munin12:15:120
3836452993126,3cyclictest3846485-21kworker/u8:4+events_unbound07:19:483
3836450993024,4cyclictest3986426-21kworker/u8:1+flush-259:009:35:152
3836442993026,3cyclictest3945170-21kworker/u8:3+flush-259:008:55:000
3836452992925,3cyclictest4075309-21kworker/u8:3+events_unbound11:13:503
3836452992925,3cyclictest3872316-21kworker/u8:2+flush-259:008:10:143
3836446992924,3cyclictest3888390-21/usr/sbin/munin08:00:141
3836452992823,3cyclictest4173155-21apt-get12:35:023
3836446992822,4cyclictest4043637-21apt-get10:30:001
3836446992822,4cyclictest335557-21systemd-journal07:20:001
3836442992822,4cyclictest335557-21systemd-journal12:35:480
3836452992723,3cyclictest4043451-21kworker/u8:0+events_unbound10:43:503
3836452992723,3cyclictest3939973-21kworker/u8:2+events_unbound09:11:273
3836450992721,4cyclictest3919163-21apt-get08:30:002
3836442992722,4cyclictest335557-21systemd-journal12:02:480
3836442992722,3cyclictest3981903-21apt-get09:30:110
3836442992722,3cyclictest335557-21systemd-journal10:37:480
3836452992623,2cyclictest4147327-21kworker/u8:1+events_unbound12:30:023
3836452992622,2cyclictest3996799-21kworker/u8:2+events_unbound10:33:493
3836450992620,4cyclictest4090569-21latency_hist11:15:012
3836450992619,5cyclictest335557-21systemd-journal10:20:002
3836446992623,2cyclictest3939973-21kworker/u8:2+flush-259:009:00:001
3836446992622,3cyclictest3872316-21kworker/u8:2+flush-259:008:25:201
3836446992621,3cyclictest3872316-21kworker/u8:2+flush-259:008:40:161
3836442992622,3cyclictest3893270-21kworker/u8:0+events_unbound08:10:160
3836452992522,2cyclictest4126665-21kworker/u8:1+events_unbound11:53:493
3836452992522,2cyclictest4059618-21kworker/u8:1+events_unbound10:52:503
3836452992522,2cyclictest3996799-21kworker/u8:2+flush-259:010:15:243
3836452992522,2cyclictest3915030-21kworker/u8:1+events_unbound09:04:483
3836452992521,3cyclictest4075309-21kworker/u8:3+events_unbound11:05:183
3836452992521,3cyclictest3996799-21kworker/u8:2+events_unbound10:00:493
3836446992522,2cyclictest3846485-21kworker/u8:4+flush-259:008:35:291
3836446992521,3cyclictest4141801-21kworker/u8:2+flush-259:012:10:241
3836446992521,3cyclictest3939973-21kworker/u8:2+flush-259:009:25:001
3836446992519,4cyclictest335557-21systemd-journal07:47:491
3836442992522,2cyclictest3841820-21kworker/u8:2+events_unbound07:15:190
3836442992520,4cyclictest335557-21systemd-journal12:28:480
3836452992420,3cyclictest4085409-21kworker/u8:0+events_unbound12:25:503
3836452992420,3cyclictest4085409-21kworker/u8:0+events_unbound11:38:503
3836452992420,3cyclictest4085409-21kworker/u8:0+events_unbound11:27:483
3836452992420,3cyclictest3996799-21kworker/u8:2+events_unbound10:25:493
3836452992420,3cyclictest3872316-21kworker/u8:2+events_unbound08:24:503
3836446992420,3cyclictest3826309-21kworker/u8:1+events_unbound07:31:401
3836446992419,4cyclictest3939973-21kworker/u8:2+flush-259:009:15:151
3836446992419,3cyclictest509-21rs:main1
3836446992419,3cyclictest4121702-21/usr/sbin/munin11:45:131
3836452992320,2cyclictest4059618-21kworker/u8:1+events_unbound10:55:373
3836452992319,3cyclictest4147327-21kworker/u8:1+flush-259:012:15:203
3836452992319,3cyclictest3996799-21kworker/u8:2+events_unbound09:50:093
3836452992319,3cyclictest3872316-21kworker/u8:2+events_unbound08:25:143
3836452992317,4cyclictest4142096-21awk12:05:003
3836450992317,4cyclictest4044152-21base6410:30:002
3836450992317,4cyclictest4012876-21apt-get10:00:122
3836446992320,2cyclictest3939973-21kworker/u8:2+events_unbound09:30:191
3836446992319,3cyclictest4075309-21kworker/u8:3+flush-259:011:30:391
3836446992319,3cyclictest3826309-21kworker/u8:1+events_unbound07:24:401
3836442992319,3cyclictest3826309-21kworker/u8:1+flush-259:008:00:170
3836442992317,4cyclictest4002172-21kworker/u8:1+flush-259:009:50:150
3836452992218,3cyclictest4095574-21kworker/u8:2+events_unbound11:20:233
3836452992218,3cyclictest3939973-21kworker/u8:2+events_unbound09:15:203
3836452992218,3cyclictest3872316-21kworker/u8:2+events_unbound08:30:153
3836450992219,2cyclictest4126665-21kworker/u8:1+flush-259:011:50:212
3836450992218,3cyclictest3836631-21apt-get07:10:102
3836446992219,2cyclictest3872654-21cron07:45:001
3836446992217,3cyclictest509-21rs:main1
3836446992217,3cyclictest3981646-21munin-plugin-st09:30:011
3836442992216,4cyclictest335557-21systemd-journal09:23:470
3836452992118,2cyclictest4126665-21kworker/u8:1+events_unbound11:55:193
3836452992118,2cyclictest3996799-21kworker/u8:2+events_unbound10:20:153
3836452992117,3cyclictest3939973-21kworker/u8:2+flush-259:009:10:013
3836452992117,3cyclictest3826309-21kworker/u8:1+events_unbound08:02:483
3836450992118,2cyclictest4059618-21kworker/u8:1+flush-259:010:55:212
3836450992118,2cyclictest3950638-21kworker/u8:0+flush-259:009:55:252
3836450992114,5cyclictest4080239-21latency_hist11:05:002
3836446992118,2cyclictest3934814-21kworker/u8:0+events_unbound08:50:131
3836442992116,4cyclictest4146408-21ntpq12:05:220
3836442992114,5cyclictest4120556-21ntpq11:40:200
3836452992017,2cyclictest4106040-21kworker/u8:1+events_unbound11:32:493
3836452992017,2cyclictest3939973-21kworker/u8:2+flush-259:009:30:163
3836452992017,2cyclictest3846485-21kworker/u8:4+events_unbound08:35:153
3836452992016,3cyclictest3826309-21kworker/u8:1+flush-259:007:50:013
3836452992016,3cyclictest3826309-21kworker/u8:1+events_unbound07:35:503
3836450992016,3cyclictest4075309-21kworker/u8:3+flush-259:011:15:162
3836450992014,4cyclictest4111163-21latency_hist11:35:012
3836450992014,4cyclictest3872316-21kworker/u8:2+flush-259:008:05:182
3836446992016,3cyclictest4167853-21kworker/u8:3+events_unbound12:35:201
3836446992016,3cyclictest4085409-21kworker/u8:0+events_unbound12:20:541
3836446992016,3cyclictest3846485-21kworker/u8:4+events_unbound07:56:501
3836446992016,3cyclictest3846485-21kworker/u8:4+events_unbound07:56:491
3836446992016,3cyclictest3846485-21kworker/u8:4+events_unbound07:29:411
3836446992016,3cyclictest3836246-21kworker/u8:0+flush-259:007:10:111
3836446992015,3cyclictest3971282-21kworker/u8:3+flush-259:009:40:251
3836446992015,3cyclictest3971282-21kworker/u8:3+events_unbound09:45:181
3836442992016,3cyclictest4075309-21kworker/u8:3+flush-259:011:00:190
3836452991916,2cyclictest3950638-21kworker/u8:0+events_unbound10:05:143
3836452991915,3cyclictest4059618-21kworker/u8:1+events_unbound11:16:493
3836452991914,3cyclictest0-21swapper/307:14:593
3836450991916,2cyclictest3826309-21kworker/u8:1+flush-259:007:45:172
3836450991915,3cyclictest4147327-21kworker/u8:1+flush-259:012:20:242
3836446991917,1cyclictest4085409-21kworker/u8:0+events_unbound11:25:121
3836446991916,2cyclictest3996799-21kworker/u8:2+events_unbound09:55:491
3836446991916,2cyclictest3893270-21kworker/u8:0+events_unbound08:11:491
3836446991915,3cyclictest4106040-21kworker/u8:1+flush-259:011:40:241
3836446991915,3cyclictest3872316-21kworker/u8:2+events_unbound07:54:481
3836442991914,4cyclictest3950880-21apt-get09:00:120
3836442991913,4cyclictest335557-21systemd-journal10:10:000
3836452991815,2cyclictest3852670-21irqcore07:25:163
3836452991814,3cyclictest4141801-21kworker/u8:2+events_unbound12:05:163
3836452991814,3cyclictest4085409-21kworker/u8:0+events_unbound11:45:193
3836450991815,2cyclictest4043711-21apt-key10:30:002
3836450991815,2cyclictest3872316-21kworker/u8:2+flush-259:008:30:232
3836450991814,3cyclictest3846485-21kworker/u8:4+flush-259:008:35:262
3836446991815,2cyclictest4059618-21kworker/u8:1+events_unbound11:05:221
3836446991814,3cyclictest4059618-21kworker/u8:1+events_unbound11:00:501
3836446991814,3cyclictest3939973-21kworker/u8:2+events_unbound09:10:231
3836446991814,3cyclictest3934814-21kworker/u8:0+events_unbound08:45:171
3836442991813,4cyclictest3950638-21kworker/u8:0+flush-259:009:15:200
3836442991812,4cyclictest4110266-21ntpq11:30:210
3836442991811,5cyclictest335557-21systemd-journal08:00:000
3836442991811,5cyclictest335557-21systemd-journal07:59:590
3836452991715,2cyclictest3893270-21kworker/u8:0+events_unbound08:05:253
3836452991713,3cyclictest3934814-21kworker/u8:0+flush-259:008:45:233
3836452991713,3cyclictest3872316-21kworker/u8:2+flush-259:007:50:233
3836452991713,3cyclictest3826309-21kworker/u8:1+flush-259:007:20:183
3836450991713,3cyclictest4173199-21systemd-run12:35:002
3836450991711,4cyclictest509-21rs:main2
3836450991711,4cyclictest3986767-21latency_hist09:35:002
3836446991714,2cyclictest3996799-21kworker/u8:2+events_unbound10:11:481
3836446991713,3cyclictest490-21dbus-daemon12:35:001
3836446991713,3cyclictest4147327-21kworker/u8:1+events_unbound12:16:501
3836446991713,3cyclictest4126665-21kworker/u8:1+flush-259:011:55:241
3836446991713,3cyclictest4111420-21apt-get11:35:101
3836442991714,2cyclictest60350irq/132-enp0s29f1:rx-012:30:150
3836442991714,2cyclictest60350irq/132-enp0s29f1:rx-010:57:320
3836442991710,5cyclictest3949693-21ntpq08:55:200
3836452991612,3cyclictest4059618-21kworker/u8:1+events_unbound10:50:013
3836452991612,3cyclictest3971282-21kworker/u8:3+events_unbound09:41:473
3836452991611,4cyclictest3950638-21kworker/u8:0+events_unbound09:29:193
3836452991610,4cyclictest4162773-21latency_hist12:25:003
3836450991610,4cyclictest335557-21systemd-journal08:04:472
3836446991614,1cyclictest4090572-21idleruntime-cro11:15:001
3836446991613,2cyclictest4043451-21kworker/u8:0+flush-259:010:45:141
3836446991613,2cyclictest3996799-21kworker/u8:2+flush-259:010:15:151
3836446991612,3cyclictest4085409-21kworker/u8:0+events_unbound12:05:481
3836442991614,1cyclictest60350irq/132-enp0s29f1:rx-007:30:230
3836442991614,1cyclictest60350irq/132-enp0s29f1:rx-007:25:270
3836442991613,2cyclictest60350irq/132-enp0s29f1:rx-011:26:180
3836442991613,2cyclictest60350irq/132-enp0s29f1:rx-011:20:240
3836442991613,2cyclictest60350irq/132-enp0s29f1:rx-010:50:230
3836442991613,2cyclictest60350irq/132-enp0s29f1:rx-007:40:230
3836442991613,2cyclictest60350irq/132-enp0s29f1:rx-007:10:180
3836442991613,2cyclictest3898490-21cron08:10:010
3836442991611,3cyclictest60350irq/132-enp0s29f1:rx-009:35:120
3836442991610,4cyclictest4127045-21diskstats11:50:120
3836452991512,2cyclictest3934814-21kworker/u8:0+events_unbound08:50:183
383645099155,5cyclictest4167961-21grep12:30:002
3836450991512,2cyclictest0-21swapper/210:15:002
3836446991512,2cyclictest4085409-21kworker/u8:0+events_unbound12:04:501
3836446991511,3cyclictest3986426-21kworker/u8:1+flush-259:009:35:201
3836446991511,3cyclictest3950638-21kworker/u8:0+events_unbound09:06:491
3836442991513,1cyclictest60350irq/132-enp0s29f1:rx-012:20:180
3836442991513,1cyclictest60350irq/132-enp0s29f1:rx-010:40:540
3836442991513,1cyclictest60350irq/132-enp0s29f1:rx-010:15:160
3836442991513,1cyclictest60350irq/132-enp0s29f1:rx-009:55:250
3836442991512,2cyclictest3872316-21kworker/u8:2+events_unbound08:40:190
3836452991411,2cyclictest4075309-21kworker/u8:3+flush-259:011:00:143
383645099147,5cyclictest4147301-21latency_hist12:10:002
3836450991412,1cyclictest4043451-21kworker/u8:0+events_unbound10:40:182
3836450991412,1cyclictest0-21swapper/207:40:002
383644699149,3cyclictest335557-21systemd-journal08:10:011
383644699147,5cyclictest4038476-21awk10:25:001
3836446991411,2cyclictest3996799-21kworker/u8:2+flush-259:010:39:191
3836446991410,3cyclictest4002172-21kworker/u8:1+events_unbound09:50:111
383644299147,5cyclictest3907927-21ntpq08:15:210
3836442991412,2cyclictest60350irq/132-enp0s29f1:rx-012:11:360
3836442991412,2cyclictest60350irq/132-enp0s29f1:rx-009:27:580
3836442991412,1cyclictest60350irq/132-enp0s29f1:rx-011:18:380
3836442991412,1cyclictest60350irq/132-enp0s29f1:rx-007:20:250
3836442991411,2cyclictest60350irq/132-enp0s29f1:rx-010:25:130
3836442991411,2cyclictest60350irq/132-enp0s29f1:rx-007:50:120
3836442991411,2cyclictest4085409-21kworker/u8:0+flush-259:011:35:110
383645099139,3cyclictest3996799-21kworker/u8:2+flush-259:009:46:022
3836450991311,1cyclictest4178731-21idleruntime-cro12:40:002
383644699138,3cyclictest4090804-21/usr/sbin/munin11:15:211
3836442991310,2cyclictest60350irq/132-enp0s29f1:rx-010:00:160
3836442991310,2cyclictest60350irq/132-enp0s29f1:rx-008:30:220
3836442991310,2cyclictest60350irq/132-enp0s29f1:rx-007:35:130
383645299127,3cyclictest3888138-21sh08:00:003
383645299127,3cyclictest3888138-21sh07:59:593
383645099129,2cyclictest3966586-21fschecks_count09:15:112
383645099129,2cyclictest3965653-21unixbench_multi09:10:242
383645099128,2cyclictest3935092-21true08:45:002
3836450991210,1cyclictest3996799-21kworker/u8:2+flush-259:009:45:002
383644699129,2cyclictest3950638-21kworker/u8:0+events_unbound10:04:481
383645299119,1cyclictest4049669-21cpuspeed_turbos10:35:123
383645299118,2cyclictest3996799-21kworker/u8:2+events_unbound09:49:563
383645099118,2cyclictest4007060-21unixbench_singl09:50:232
383644699111,5cyclictest4075087-21grep11:00:001
383645099105,3cyclictest4111574-21df_inode11:35:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional