You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 16:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sat Jul 04, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3542613995145,4cyclictest3782431-21latency_hist11:00:002
3542618994741,4cyclictest3839323-21latency_hist11:55:013
3542613994741,4cyclictest3751473-21latency_hist10:30:012
3542610994743,3cyclictest3683128-21kworker/u8:4+flush-259:009:55:151
3542610994742,3cyclictest3542563-21kworker/u8:1+flush-259:008:44:591
3542613994440,3cyclictest3730444-21kworker/u8:3+flush-259:010:35:162
3542613994237,3cyclictest335557-21systemd-journal12:25:012
3542618994137,3cyclictest3542563-21kworker/u8:1+flush-259:007:20:003
3542613993834,3cyclictest3542563-21kworker/u8:1+flush-259:008:50:002
3542610993833,3cyclictest3829202-21kworker/u8:3+events_unbound12:20:001
3542608993831,5cyclictest3709832-21latency_hist09:50:010
3542618993730,4cyclictest3630632-21apt-get08:35:003
3542610993733,3cyclictest3651611-21kworker/u8:2+flush-259:009:00:161
3542610993733,3cyclictest3651611-21kworker/u8:2+flush-259:009:00:151
3542610993733,3cyclictest3542563-21kworker/u8:1+flush-259:008:55:001
3542610993730,5cyclictest3589006-21latency_hist07:55:021
3542610993632,3cyclictest3661951-21kworker/u8:5+flush-259:009:45:241
3542610993632,3cyclictest3542563-21kworker/u8:1+events_unbound08:05:241
3542613993531,3cyclictest3793038-21/usr/sbin/munin11:10:142
3542610993532,2cyclictest3672987-21kworker/u8:3+flush-259:009:15:221
3542610993529,4cyclictest335557-21systemd-journal11:45:001
3542618993430,3cyclictest3661951-21kworker/u8:5+flush-259:009:25:003
3542610993431,2cyclictest3699294-21kworker/u8:1+flush-259:010:10:231
3542610993427,5cyclictest3558072-21latency_hist07:25:011
3542618993328,3cyclictest3725523-21/usr/sbin/munin10:05:143
3542618993326,5cyclictest3677970-21latency_hist09:20:013
3542610993228,3cyclictest3777300-21kworker/u8:1+events_unbound11:05:241
3542610993228,3cyclictest3766983-21kworker/u8:0+flush-259:010:50:211
3542610993127,3cyclictest3724762-21kworker/u8:2+flush-259:010:05:251
3542613993025,4cyclictest335557-21systemd-journal10:35:002
3542613993022,7cyclictest3730444-21kworker/u8:3+flush-259:010:15:012
3542610993026,3cyclictest3871375-21kworker/u8:2+events_unbound12:25:251
3542610993026,3cyclictest3542563-21kworker/u8:1+flush-259:008:30:161
3542608993025,3cyclictest3704276-21latency_hist09:45:000
3542618992926,2cyclictest3745919-21gpgv10:25:013
3542610992925,3cyclictest3855918-21apt-get12:10:121
3542610992925,3cyclictest3604424-21kworker/u8:3+flush-259:008:10:131
3542610992925,3cyclictest3542563-21kworker/u8:1+flush-259:008:20:251
3542610992925,3cyclictest3542563-21kworker/u8:1+events_unbound07:59:461
3542610992924,3cyclictest3542563-21kworker/u8:1+flush-259:008:15:191
3542608992924,4cyclictest3547724-21latency_hist07:15:000
3542618992825,2cyclictest3683128-21kworker/u8:4+flush-259:009:50:143
3542608992824,2cyclictest3805717-21kworker/u8:1+flush-259:011:35:170
3542610992724,2cyclictest3871375-21kworker/u8:2+events_unbound12:30:161
3542610992723,3cyclictest3805717-21kworker/u8:1+events_unbound11:30:211
3542610992723,3cyclictest3756907-21apt-get10:35:141
3542610992718,7cyclictest335557-21systemd-journal12:10:001
3542608992721,5cyclictest3850489-21latency_hist12:05:000
3542613992622,3cyclictest3589028-21kworker/u8:2+flush-259:007:55:002
3542613992622,2cyclictest3542563-21kworker/u8:1+events_unbound08:45:002
3542610992622,3cyclictest3808554-21kworker/u8:2+events_unbound11:56:441
3542610992622,3cyclictest3766983-21kworker/u8:0+flush-259:011:25:201
3542610992621,3cyclictest3583497-21kworker/u8:0+flush-259:008:00:191
3542608992622,3cyclictest3672754-21latency_hist09:15:000
3542608992620,4cyclictest3625476-21latency_hist08:30:000
3542608992620,3cyclictest3646473-21unin-run08:50:000
354260899260,25cyclictest3563265-21unin-run07:30:000
3542618992520,4cyclictest3876332-21latency_hist12:30:013
3542613992522,2cyclictest3699294-21kworker/u8:1+flush-259:009:40:162
3542613992521,3cyclictest3871375-21kworker/u8:2+flush-259:012:35:262
3542613992521,3cyclictest3683128-21kworker/u8:4+flush-259:009:55:172
3542610992522,2cyclictest3871375-21kworker/u8:2+events_unbound12:35:141
3542610992522,2cyclictest3724762-21kworker/u8:2+flush-259:010:25:271
3542610992522,2cyclictest3499672-21kworker/u8:2+flush-259:007:45:181
3542618992420,3cyclictest3704384-21gpgv09:45:013
3542613992421,2cyclictest3767196-21kworker/u8:4+flush-259:011:15:182
3542613992418,5cyclictest3655835-21ntpq08:55:202
3542613992417,5cyclictest3609122-21ntpq08:10:192
3542610992420,3cyclictest3542563-21kworker/u8:1+events_unbound07:29:421
3542610992419,4cyclictest3542563-21kworker/u8:1+events_unbound07:42:441
3542610992419,3cyclictest3740971-21apt-get10:20:111
3542608992420,3cyclictest3805717-21kworker/u8:1+flush-259:011:30:170
3542613992319,3cyclictest3542563-21kworker/u8:1+flush-259:008:05:142
3542613992318,4cyclictest335557-21systemd-journal09:30:012
3542610992320,2cyclictest3760892-21kworker/u8:1+events_unbound10:40:231
3542610992319,3cyclictest3777300-21kworker/u8:1+events_unbound10:55:201
3542610992319,3cyclictest3509953-21kworker/u8:3+flush-259:007:10:171
3542610992318,4cyclictest3720441-21apt-get10:00:091
3542610992318,3cyclictest3805717-21kworker/u8:1+flush-259:011:39:591
3542618992218,3cyclictest3839984-21munin-node11:55:133
3542613992215,5cyclictest3792844-21cat11:10:002
3542610992219,2cyclictest3767196-21kworker/u8:4+events_unbound10:45:261
3542610992219,2cyclictest3499672-21kworker/u8:2+events_unbound07:15:131
3542610992218,3cyclictest3672987-21kworker/u8:3+events_unbound09:20:441
3542610992216,4cyclictest335557-21systemd-journal12:00:011
3542608992218,3cyclictest3542563-21kworker/u8:1+flush-259:008:15:000
3542618992117,3cyclictest3610066-21kworker/u8:0+flush-259:008:25:003
3542618992116,3cyclictest0-21swapper/308:15:013
3542618992114,5cyclictest335557-21systemd-journal09:40:003
3542610992118,2cyclictest3651611-21kworker/u8:2+flush-259:009:05:211
3542610992117,3cyclictest3793030-21kworker/u8:3+events_unbound11:10:201
3542610992117,3cyclictest3767196-21kworker/u8:4+events_unbound11:15:201
3542610992117,3cyclictest3661951-21kworker/u8:5+flush-259:009:30:241
3542608992118,2cyclictest3542563-21kworker/u8:1+flush-259:008:30:170
3542608992115,5cyclictest3766064-21ntpq10:40:210
3542618992015,4cyclictest3823630-40mandb11:38:213
3542613992016,3cyclictest3844934-21gpgv12:00:002
3542613992014,4cyclictest3620343-21latency_hist08:25:012
3542613992014,4cyclictest335557-21systemd-journal08:00:432
3542610992017,2cyclictest3766983-21kworker/u8:0+flush-259:011:20:251
3542610992016,3cyclictest3651611-21kworker/u8:2+events_unbound08:55:151
3542608992014,5cyclictest3594369-21/usr/sbin/munin08:00:200
3542618991915,3cyclictest3724762-21kworker/u8:2+events_unbound10:40:013
3542618991915,3cyclictest3693885-21idleruntime-cro09:35:013
3542613991916,2cyclictest3715041-21kworker/u8:0+events_unbound10:20:162
3542613991915,3cyclictest3829202-21kworker/u8:3+flush-259:011:45:222
3542613991915,3cyclictest3699294-21kworker/u8:1+flush-259:010:05:172
3542613991913,5cyclictest3849670-21ntpq12:00:222
3542613991912,5cyclictest3577833-21ntpq07:40:222
3542610991915,3cyclictest3766983-21kworker/u8:0+events_unbound11:48:441
3542610991915,3cyclictest3542563-21kworker/u8:1+events_unbound08:25:001
3542608991916,2cyclictest3677960-21awk09:19:590
3542608991915,3cyclictest3542563-21kworker/u8:1+flush-259:008:15:170
3542608991912,5cyclictest3656748-21latency_hist09:00:010
3542618991816,1cyclictest3760892-21kworker/u8:1+events_unbound10:40:193
3542618991814,3cyclictest3583497-21kworker/u8:0+flush-259:008:00:243
3542618991812,4cyclictest3803147-21latency_hist11:20:013
3542618991812,4cyclictest335557-21systemd-journal12:38:443
3542613991815,2cyclictest3851165-21irqcore12:05:152
3542613991814,2cyclictest0-21swapper/207:25:002
3542613991813,4cyclictest3672987-21kworker/u8:3+flush-259:009:20:162
3542613991813,4cyclictest3661951-21kworker/u8:5+flush-259:009:30:252
3542613991813,4cyclictest3558316-21/usr/sbin/munin07:25:162
3542610991814,3cyclictest3683128-21kworker/u8:4+flush-259:009:50:341
3542610991814,3cyclictest3542563-21kworker/u8:1+events_unbound09:10:111
3542610991814,3cyclictest3542563-21kworker/u8:1+events_unbound07:35:161
3542610991814,3cyclictest3499672-21kworker/u8:2+events_unbound07:30:161
3542608991815,2cyclictest3499672-21kworker/u8:2+flush-259:007:30:210
3542608991814,3cyclictest3850754-21apt-get12:05:110
3542608991811,5cyclictest3589243-21/usr/sbin/munin07:55:200
3542618991712,4cyclictest3766983-21kworker/u8:0+flush-259:011:25:163
3542613991714,2cyclictest3805717-21kworker/u8:1+events_unbound11:30:172
3542613991714,2cyclictest3629748-21ntp_kernel_pll_08:30:202
3542613991712,4cyclictest3767209-21/usr/sbin/munin10:45:162
3542613991712,4cyclictest3672987-21kworker/u8:3+flush-259:009:15:152
3542613991711,5cyclictest3819066-21diskstats11:35:152
3542613991711,4cyclictest3861238-21diskstats12:15:132
3542613991710,5cyclictest3646691-21/usr/sbin/munin08:50:192
3542610991713,3cyclictest3672987-21kworker/u8:3+events_unbound09:39:551
3542610991713,3cyclictest3542563-21kworker/u8:1+flush-259:008:45:041
3542608991714,2cyclictest60350irq/132-enp0s29f1:rx-012:18:370
3542608991714,2cyclictest60350irq/132-enp0s29f1:rx-009:30:110
3542608991713,3cyclictest3724762-21kworker/u8:2+flush-259:010:25:190
3542618991613,2cyclictest3779849-21kthreadcore10:55:193
3542618991610,4cyclictest3808329-21latency_hist11:25:013
3542618991610,4cyclictest3756637-21latency_hist10:35:003
354261399169,6cyclictest3777278-21latency_hist10:55:012
354261399161,4cyclictest3715026-21munin-run09:55:012
3542613991613,2cyclictest0-21swapper/207:15:012
3542613991612,2cyclictest3834365-21kworker/u8:4-flush-259:011:54:592
3542613991611,4cyclictest3855883-21kworker/u8:0+flush-259:012:10:262
3542613991611,4cyclictest3724762-21kworker/u8:2+flush-259:010:15:252
354261399161,14cyclictest3709840-21grep09:50:002
3542613991611,3cyclictest3542563-21kworker/u8:1+flush-259:008:25:042
3542610991612,3cyclictest3829202-21kworker/u8:3+events_unbound11:53:561
3542610991612,3cyclictest3704467-21gpgv09:45:011
3542610991612,3cyclictest3610066-21kworker/u8:0+events_unbound08:35:171
3542608991614,1cyclictest60350irq/132-enp0s29f1:rx-012:26:410
3542608991614,1cyclictest60350irq/132-enp0s29f1:rx-010:52:500
3542608991613,2cyclictest60350irq/132-enp0s29f1:rx-010:11:540
3542608991613,2cyclictest60350irq/132-enp0s29f1:rx-008:40:120
3542608991613,2cyclictest60350irq/132-enp0s29f1:rx-007:46:080
3542608991613,2cyclictest60350irq/132-enp0s29f1:rx-007:35:200
3542608991611,3cyclictest3760892-21kworker/u8:1+flush-259:010:40:010
3542608991610,4cyclictest3813471-21latency_hist11:30:010
3542618991513,1cyclictest3636882-21irqcore08:40:163
3542618991512,2cyclictest3747002-21irqcore10:25:203
3542618991512,2cyclictest3563924-21irqcore07:30:163
3542618991512,2cyclictest3542563-21kworker/u8:1+flush-259:009:27:493
3542618991511,3cyclictest3499672-21kworker/u8:2+flush-259:007:30:003
3542613991511,3cyclictest3724762-21kworker/u8:2+flush-259:010:45:002
3542613991510,4cyclictest3871375-21kworker/u8:2+flush-259:012:30:232
3542610991512,2cyclictest3767196-21kworker/u8:4+events_unbound11:00:171
3542610991511,3cyclictest3865730-21kworker/u8:1+events_unbound12:22:241
3542610991511,3cyclictest3730444-21kworker/u8:3+events_unbound10:32:121
3542610991511,3cyclictest3661951-21kworker/u8:5+events_unbound09:27:591
3542608991513,1cyclictest60350irq/132-enp0s29f1:rx-012:39:520
3542608991513,1cyclictest60350irq/132-enp0s29f1:rx-012:10:120
3542608991513,1cyclictest60350irq/132-enp0s29f1:rx-011:51:190
3542608991513,1cyclictest60350irq/132-enp0s29f1:rx-011:24:060
3542608991513,1cyclictest60350irq/132-enp0s29f1:rx-007:40:100
3542608991512,2cyclictest60350irq/132-enp0s29f1:rx-011:18:500
3542608991512,2cyclictest60350irq/132-enp0s29f1:rx-009:50:240
3542608991512,2cyclictest60350irq/132-enp0s29f1:rx-009:35:250
3542608991512,2cyclictest3558069-21idleruntime-cro07:25:010
3542608991512,2cyclictest3499672-21kworker/u8:2+flush-259:007:15:170
3542608991512,1cyclictest60350irq/132-enp0s29f1:rx-009:05:000
3542608991512,1cyclictest60350irq/132-enp0s29f1:rx-009:05:000
3542608991511,3cyclictest3866242-21apt-get12:20:110
3542608991511,3cyclictest3767196-21kworker/u8:4+flush-259:010:45:260
3542608991510,4cyclictest3651589-21latency_hist08:55:000
354261899149,3cyclictest335557-21systemd-journal12:05:293
3542618991412,1cyclictest0-21swapper/311:50:003
3542618991411,2cyclictest3787635-21idleruntime-cro11:05:003
3542618991410,3cyclictest509-21rs:main3
3542618991410,2cyclictest1-21systemd08:55:003
354261399149,3cyclictest3563761-21fschecks_time07:30:142
3542613991411,2cyclictest3724416-21ntp_kernel_pll_10:00:182
3542613991411,2cyclictest3660906-21needreboot09:00:202
3542613991411,2cyclictest3660906-21needreboot09:00:192
3542608991412,1cyclictest60350irq/132-enp0s29f1:rx-011:45:010
3542608991412,1cyclictest60350irq/132-enp0s29f1:rx-011:40:250
3542608991412,1cyclictest60350irq/132-enp0s29f1:rx-011:04:560
3542608991412,1cyclictest60350irq/132-enp0s29f1:rx-010:30:160
3542608991412,1cyclictest60350irq/132-enp0s29f1:rx-010:23:410
3542608991412,1cyclictest60350irq/132-enp0s29f1:rx-010:15:170
3542608991412,1cyclictest60350irq/132-enp0s29f1:rx-010:05:120
3542608991412,1cyclictest60350irq/132-enp0s29f1:rx-009:55:240
3542608991412,1cyclictest60350irq/132-enp0s29f1:rx-008:07:350
3542608991412,1cyclictest60350irq/132-enp0s29f1:rx-007:50:100
3542608991411,2cyclictest60350irq/132-enp0s29f1:rx-012:34:170
3542608991411,2cyclictest60350irq/132-enp0s29f1:rx-011:10:110
3542608991411,2cyclictest60350irq/132-enp0s29f1:rx-010:55:130
3542608991411,2cyclictest60350irq/132-enp0s29f1:rx-010:04:210
3542608991411,2cyclictest60350irq/132-enp0s29f1:rx-009:27:000
3542618991311,1cyclictest0-21swapper/310:50:163
3542618991310,2cyclictest0-21swapper/311:40:163
354261399139,3cyclictest3828454-21unixbench-2d11:40:252
354261399139,3cyclictest3614696-21unixbench_multi08:15:252
354261399139,3cyclictest0-21swapper/211:30:002
3542613991310,2cyclictest3548131-21cpuspeed_turbos07:15:142
3542608991311,1cyclictest60350irq/132-enp0s29f1:rx-011:05:230
3542608991311,1cyclictest60350irq/132-enp0s29f1:rx-009:05:160
3542608991310,2cyclictest60350irq/132-enp0s29f1:rx-011:55:130
3542608991310,2cyclictest60350irq/132-enp0s29f1:rx-008:20:000
354261899129,2cyclictest3740263-21unixbench_singl10:15:253
354261899129,2cyclictest3735544-21cron10:15:013
354261899129,2cyclictest3705099-21cpuspeed_turbos09:45:123
354261899128,3cyclictest3651611-21kworker/u8:2+flush-259:008:57:133
354261899128,3cyclictest3583497-21kworker/u8:0+flush-259:007:55:153
354261899127,3cyclictest3876567-21/usr/sbin/munin12:30:233
354261899126,5cyclictest3720182-21latency_hist10:00:013
354261399128,2cyclictest3568863-21fschecks_count07:35:132
354261399121,9cyclictest3667550-21latency_hist09:10:002
3542608991210,1cyclictest60350irq/132-enp0s29f1:rx-008:35:140
354261899119,1cyclictest0-21swapper/307:40:183
354261899118,2cyclictest3871126-21cron12:24:593
354261899118,2cyclictest3767346-21cpuspeed_turbos10:45:133
354261899118,2cyclictest3632354-21tr08:35:173
354261899118,2cyclictest0-21swapper/309:05:003
354261899118,2cyclictest0-21swapper/309:04:593
354261899117,3cyclictest3542563-21kworker/u8:1+flush-259:008:47:143
354261399116,3cyclictest3767196-21kworker/u8:4+flush-259:011:00:152
354261399115,4cyclictest3542563-21kworker/u8:1+flush-259:008:35:052
354260899118,2cyclictest60350irq/132-enp0s29f1:rx-009:20:240
354261899108,1cyclictest3663031-21irqcore09:05:163
354261899107,2cyclictest3855984-21cpuspeed_turbos12:10:133
354261899106,2cyclictest3572674-21ntpq07:35:203
35426189995,3cyclictest3499672-21kworker/u8:2+flush-259:007:45:163
35426189994,3cyclictest3610593-21fw_forwarded_lo08:15:153
35426189984,3cyclictest3815433-21cut11:30:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional