You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-07 - 11:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Aug 07, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3342480994539,4cyclictest3504470-21cat21:45:021
3342480994537,5cyclictest335557-21systemd-journal21:54:101
3342477994538,4cyclictest3525052-21latency_hist22:05:010
3342483994438,4cyclictest3394651-21latency_hist20:00:012
3342477994440,3cyclictest3613248-21kworker/u8:4+events_unbound00:30:010
3342480994237,4cyclictest3394265-21kworker/u8:0+events_unbound20:05:191
3342477994134,5cyclictest3435348-21kworker/u8:3+flush-259:020:45:170
3342477994034,4cyclictest3467657-21apt-get21:10:110
3342483993935,3cyclictest3633720-21http23:50:012
3342480993936,2cyclictest3571877-21kworker/u8:3+flush-259:000:10:161
3342480993831,5cyclictest335557-21systemd-journal00:01:101
3342486993731,4cyclictest3425673-21latency_hist20:30:013
3342483993732,3cyclictest335557-21systemd-journal21:42:102
3342480993731,4cyclictest3660375-21/usr/sbin/munin00:15:261
3342477993732,3cyclictest3368845-21base6419:35:010
3342486993630,4cyclictest3451905-21latency_hist20:55:003
3342483993632,3cyclictest3571877-21kworker/u8:3+flush-259:000:10:172
3342483993529,4cyclictest3426098-21diskstats20:30:142
3342486993428,4cyclictest335557-21systemd-journal19:51:103
3342480993429,4cyclictest3462783-21kworker/u8:1+flush-259:021:17:101
3342480993427,4cyclictest3379138-21kworker/u8:3+events_unbound19:55:181
3342477993430,3cyclictest3608109-21apt-get23:25:110
3342477993428,4cyclictest3497940-21ntpq21:35:210
3342480993329,3cyclictest3613248-21kworker/u8:4+events_unbound00:29:131
3342480993329,3cyclictest3550913-21kworker/u8:1+flush-259:023:00:151
3342480993327,4cyclictest3607846-21latency_hist23:25:011
3342480993326,5cyclictest509-21rs:main1
3342486993229,2cyclictest3504612-21kworker/u8:0+flush-259:022:35:173
3342483993227,4cyclictest3565478-21ntpq22:40:222
3342480993228,3cyclictest3525082-21kworker/u8:3+flush-259:022:30:151
3342480993224,5cyclictest3467394-21latency_hist21:10:011
3342477993227,3cyclictest3368337-21latency_hist19:35:010
3342480993127,3cyclictest3405071-21kworker/u8:2+events_unbound20:15:151
3342480993126,4cyclictest3342655-21kworker/u8:2+events_unbound19:53:111
3342477993125,4cyclictest3686127-21gpgv00:40:010
3342477993125,4cyclictest3472571-21apt-get21:15:000
3342486993026,3cyclictest3405071-21kworker/u8:2+flush-259:020:35:183
3342480993025,4cyclictest3405071-21kworker/u8:2+events_unbound20:12:181
3342480993024,4cyclictest3592334-21latency_hist23:10:011
3342480993024,4cyclictest3451928-21kworker/u8:2+flush-259:021:00:241
3342483992925,3cyclictest3379138-21kworker/u8:3+flush-259:019:50:182
3342480992926,2cyclictest3405071-21kworker/u8:2+events_unbound20:34:101
3342480992925,3cyclictest3571877-21kworker/u8:3+flush-259:023:25:251
3342480992925,2cyclictest3368333-21apt-get19:35:021
3342477992925,3cyclictest3530475-21kworker/u8:2+flush-259:022:25:000
3342477992923,4cyclictest3623371-21latency_hist23:40:010
3342486992824,3cyclictest3530475-21kworker/u8:2+flush-259:022:20:253
3342486992821,5cyclictest3378216-21ntpq19:40:203
3342483992823,4cyclictest335557-21systemd-journal20:50:102
3342480992824,3cyclictest3561313-21kworker/u8:2+flush-259:022:40:191
3342480992824,3cyclictest3435348-21kworker/u8:3+events_unbound20:45:121
3342480992819,5cyclictest3686013-21latency_hist00:40:001
3342486992723,3cyclictest3670458-21kworker/u8:1+flush-259:000:35:263
3342486992721,4cyclictest3430964-21gpgv20:35:013
3342486992721,4cyclictest335557-21systemd-journal00:22:113
3342480992723,3cyclictest3331297-21kworker/u8:1+events_unbound20:01:111
3342480992722,4cyclictest3331297-21kworker/u8:1+events_unbound19:45:091
3342477992724,2cyclictest3331297-21kworker/u8:1+flush-259:020:10:170
3342486992622,3cyclictest3613248-21kworker/u8:4+flush-259:023:45:163
3342486992622,3cyclictest3504612-21kworker/u8:0+events_unbound23:00:003
3342486992620,4cyclictest3514710-21latency_hist21:55:013
3342483992623,2cyclictest3571877-21kworker/u8:3+flush-259:023:20:252
3342480992623,2cyclictest3504612-21kworker/u8:0+flush-259:023:30:151
3342480992622,3cyclictest3331297-21kworker/u8:1+events_unbound19:32:091
3342480992622,3cyclictest3331297-21kworker/u8:1+events_unbound19:15:151
3342480992620,4cyclictest3420758-21apt-get20:25:101
3342477992621,4cyclictest3519818-21kworker/u8:1+flush-259:022:05:150
3342486992519,4cyclictest3503953-21latency_hist21:45:003
3342483992522,2cyclictest3618483-21apt-get23:35:102
3342483992522,2cyclictest3571877-21kworker/u8:3+flush-259:023:05:202
3342483992520,3cyclictest3519872-21awk22:00:002
3342483992520,3cyclictest3472574-21latency_hist21:15:002
3342480992521,3cyclictest3613248-21kworker/u8:4+events_unbound23:55:171
3342480992521,3cyclictest3613248-21kworker/u8:4+events_unbound23:35:131
3342480992521,3cyclictest3571877-21kworker/u8:3+events_unbound23:40:171
3342480992521,3cyclictest3571877-21kworker/u8:3+events_unbound23:40:171
3342480992521,3cyclictest3342655-21kworker/u8:2+events_unbound19:27:111
3342480992520,3cyclictest3478417-21/usr/sbin/munin21:20:191
3342480992519,5cyclictest3571877-21kworker/u8:3+events_unbound23:54:111
3342486992420,3cyclictest3138549-21kworker/u8:0+flush-259:019:25:263
3342483992419,3cyclictest3644570-21gzip00:00:002
3342480992421,2cyclictest3613248-21kworker/u8:4+flush-259:023:45:161
3342480992420,3cyclictest3550913-21kworker/u8:1+flush-259:022:35:261
3342480992420,3cyclictest3504612-21kworker/u8:0+events_unbound22:15:151
3342480992419,4cyclictest3374201-21apt-get19:40:111
3342477992420,3cyclictest3342655-21kworker/u8:2+flush-259:019:10:160
3342486992320,2cyclictest3342655-21kworker/u8:2+events_unbound19:15:253
3342486992318,3cyclictest335557-21systemd-journal20:20:013
3342483992320,2cyclictest3342655-21kworker/u8:2+events_unbound19:15:192
3342483992318,3cyclictest509-21rs:main2
3342483992317,4cyclictest3670446-21latency_hist00:25:002
3342483992316,5cyclictest3347629-21latency_hist19:15:012
3342480992320,2cyclictest3435348-21kworker/u8:3+events_unbound21:40:241
3342480992319,3cyclictest3514571-21kworker/u8:3+events_unbound21:55:171
3342480992319,3cyclictest3462783-21kworker/u8:1+flush-259:021:30:001
3342480992319,3cyclictest3435348-21kworker/u8:3+events_unbound21:10:181
3342480992319,3cyclictest3435348-21kworker/u8:3+events_unbound20:50:121
3342480992319,2cyclictest3670458-21kworker/u8:1+events_unbound00:25:001
3342480992318,4cyclictest3504612-21kworker/u8:0+events_unbound22:48:121
3342477992320,2cyclictest3597453-21idleruntime-cro23:14:590
3342477992317,4cyclictest3570812-21ntpq22:45:240
3342486992217,4cyclictest3582266-21apt-get23:00:123
3342486992217,3cyclictest3571877-21kworker/u8:3+flush-259:023:55:253
3342486992216,4cyclictest335557-21systemd-journal22:15:003
3342483992219,2cyclictest3435348-21kworker/u8:3+events_unbound21:05:212
3342483992218,3cyclictest3613248-21kworker/u8:4+events_unbound23:30:202
3342483992218,3cyclictest3394265-21kworker/u8:0+events_unbound20:05:232
3342483992217,4cyclictest3634368-21/usr/sbin/munin23:50:162
3342483992215,5cyclictest3513825-21ntpq21:50:232
3342480992219,2cyclictest3670458-21kworker/u8:1+flush-259:000:30:201
3342480992219,2cyclictest3504612-21kworker/u8:0+events_unbound22:25:241
3342480992218,3cyclictest3342655-21kworker/u8:2+flush-259:019:10:101
3342480992217,3cyclictest3353047-21/usr/sbin/munin19:20:231
3342480992216,4cyclictest3577042-21/usr/sbin/munin22:55:151
3342477992219,2cyclictest3415579-21apt-get20:20:110
3342477992217,3cyclictest3634124-21store23:50:010
3342477992216,4cyclictest3431700-21diskstats20:35:170
3342483992116,3cyclictest509-21rs:main2
3342483992116,3cyclictest335557-21systemd-journal21:50:002
3342480992116,4cyclictest3571877-21kworker/u8:3+flush-259:022:50:161
3342480992115,4cyclictest3592570-21/usr/sbin/munin23:10:201
3342477992118,2cyclictest3435348-21kworker/u8:3+flush-259:021:30:200
3342477992116,4cyclictest3634368-21/usr/sbin/munin23:50:150
3342477992116,3cyclictest3379138-21kworker/u8:3+flush-259:019:50:170
3342477992115,4cyclictest3440752-21ntpq20:40:200
3342477992115,4cyclictest3379388-21apt-get19:45:110
3342483992016,3cyclictest3504612-21kworker/u8:0+flush-259:022:25:162
3342483992016,3cyclictest3436093-21sshd20:36:102
3342483992016,3cyclictest3435348-21kworker/u8:3+flush-259:021:15:152
3342483992015,4cyclictest335557-21systemd-journal00:05:002
3342480992015,3cyclictest3530475-21kworker/u8:2+events_unbound22:20:231
3342477992016,3cyclictest3504612-21kworker/u8:0+flush-259:021:45:180
3342477992014,4cyclictest3591492-21ntpq23:05:230
3342486991915,3cyclictest3332158-21kworker/u8:3+flush-259:019:10:263
3342480991916,2cyclictest3331297-21kworker/u8:1+events_unbound20:35:291
3342480991915,3cyclictest3571877-21kworker/u8:3+events_unbound00:05:181
3342480991915,3cyclictest3435348-21kworker/u8:3+flush-259:020:40:231
3342477991917,1cyclictest0-21swapper/021:45:000
3342477991916,2cyclictest3597359-21kworker/u8:2+flush-259:023:15:190
3342486991815,2cyclictest3441592-21kworker/u8:0+flush-259:020:55:173
3342486991813,3cyclictest3504612-21kworker/u8:0+flush-259:022:45:193
3342486991811,5cyclictest335557-21systemd-journal20:23:103
3342483991815,2cyclictest3686350-21latency_hist00:40:002
3342483991815,2cyclictest3598755-21kthreadcore23:15:192
3342483991815,2cyclictest3435348-21kworker/u8:3+events_unbound20:45:242
3342483991814,3cyclictest0-21swapper/200:20:012
3342483991813,3cyclictest335557-21systemd-journal22:51:102
3342480991815,2cyclictest3519818-21kworker/u8:1+events_unbound22:05:261
3342480991813,3cyclictest3530477-21/usr/sbin/munin22:10:191
3342477991815,2cyclictest3561313-21kworker/u8:2+flush-259:022:40:270
3342486991713,3cyclictest3571877-21kworker/u8:3+flush-259:023:20:003
3342486991710,5cyclictest335557-21systemd-journal22:05:003
3342480991713,3cyclictest3504612-21kworker/u8:0+events_unbound22:03:121
3342477991714,2cyclictest60350irq/132-enp0s29f1:rx-022:15:150
3342477991714,2cyclictest3405071-21kworker/u8:2+flush-259:020:25:180
3342477991713,3cyclictest3441592-21kworker/u8:0+flush-259:020:55:150
3342477991712,4cyclictest3514972-21apt-get21:55:110
3342486991612,3cyclictest3613248-21kworker/u8:4+flush-259:000:00:273
334248699160,14cyclictest1-21systemd23:30:003
334248399169,5cyclictest3498806-21latency_hist21:40:012
3342483991612,3cyclictest3379487-21cpuspeed_turbos19:45:122
3342483991610,4cyclictest3379122-21latency_hist19:45:012
3342477991614,1cyclictest60350irq/132-enp0s29f1:rx-023:55:160
3342477991613,2cyclictest60350irq/132-enp0s29f1:rx-022:55:590
3342477991613,2cyclictest60350irq/132-enp0s29f1:rx-019:55:220
3342477991612,2cyclictest1-21systemd23:25:000
3342477991610,4cyclictest3488496-21latency_hist21:30:000
3342486991512,2cyclictest3508596-21needreboot21:45:213
3342486991511,3cyclictest3670458-21kworker/u8:1+flush-259:000:30:273
3342486991511,3cyclictest3561313-21kworker/u8:2+flush-259:022:40:153
3342486991510,3cyclictest3540573-21latency_hist22:20:013
334248399155,8cyclictest3535418-21munin-run22:15:002
3342483991512,2cyclictest3670458-21kworker/u8:1+flush-259:000:30:182
3342480991513,1cyclictest3332158-21kworker/u8:3+events_unbound19:10:011
3342480991513,1cyclictest3332158-21kworker/u8:3+events_unbound19:10:011
3342480991511,3cyclictest3597359-21kworker/u8:2+events_unbound23:19:111
3342480991511,3cyclictest3435348-21kworker/u8:3+flush-259:021:35:241
3342477991513,1cyclictest60350irq/132-enp0s29f1:rx-023:40:180
3342477991513,1cyclictest60350irq/132-enp0s29f1:rx-023:40:170
3342477991513,1cyclictest60350irq/132-enp0s29f1:rx-022:50:170
3342477991513,1cyclictest60350irq/132-enp0s29f1:rx-022:33:420
3342477991513,1cyclictest60350irq/132-enp0s29f1:rx-021:20:170
3342477991513,1cyclictest60350irq/132-enp0s29f1:rx-021:00:110
3342477991513,1cyclictest60350irq/132-enp0s29f1:rx-019:23:200
3342477991513,1cyclictest60350irq/132-enp0s29f1:rx-000:00:490
3342477991512,2cyclictest60350irq/132-enp0s29f1:rx-022:25:530
3342477991512,2cyclictest60350irq/132-enp0s29f1:rx-020:20:010
3342477991511,3cyclictest3451928-21kworker/u8:2+events_unbound21:05:170
334248699148,4cyclictest3525082-21kworker/u8:3+flush-259:022:30:173
3342486991412,1cyclictest0-21swapper/319:25:003
3342486991411,2cyclictest0-21swapper/321:10:003
3342486991410,3cyclictest3571877-21kworker/u8:3+flush-259:022:50:183
3342486991410,3cyclictest3504612-21kworker/u8:0+flush-259:021:55:243
3342486991410,3cyclictest3462783-21kworker/u8:1+flush-259:021:15:203
334248399149,4cyclictest3435348-21kworker/u8:3+flush-259:021:25:302
3342483991412,1cyclictest3504612-21kworker/u8:0+events_unbound22:00:212
3342483991411,2cyclictest3424781-21ntp_kernel_pll_20:25:202
3342483991411,2cyclictest2971-21cron19:35:002
3342483991410,3cyclictest3504612-21kworker/u8:0+events_unbound23:10:212
3342483991410,3cyclictest3405071-21kworker/u8:2+flush-259:020:15:232
3342483991410,3cyclictest3399817-21idleruntime-cro20:05:002
3342483991410,3cyclictest3138549-21kworker/u8:0+flush-259:019:25:242
3342483991410,2cyclictest3555613-21unixbench_multi22:30:262
3342480991410,3cyclictest3435348-21kworker/u8:3+flush-259:020:55:101
3342477991413,1cyclictest60350irq/132-enp0s29f1:rx-020:02:120
3342477991412,1cyclictest60350irq/132-enp0s29f1:rx-019:40:240
3342477991412,1cyclictest60350irq/132-enp0s29f1:rx-000:20:260
3342477991411,2cyclictest60350irq/132-enp0s29f1:rx-023:30:140
3342477991411,2cyclictest60350irq/132-enp0s29f1:rx-019:17:040
334248699139,3cyclictest3504612-21kworker/u8:0+flush-259:022:25:263
334248699138,4cyclictest509-21rs:main3
3342486991311,1cyclictest0-21swapper/321:30:003
3342486991310,2cyclictest3613248-21kworker/u8:4+flush-259:000:25:253
3342486991310,2cyclictest3593616-21tr23:10:183
334248399139,3cyclictest3504612-21kworker/u8:0+flush-259:023:45:002
334248399139,3cyclictest3504612-21kworker/u8:0+flush-259:023:44:592
334248399139,3cyclictest3462783-21kworker/u8:1+events_unbound21:20:262
3342483991310,2cyclictest3504612-21kworker/u8:0+flush-259:022:15:262
334247799139,3cyclictest3331297-21kworker/u8:1+flush-259:020:05:260
3342477991312,1cyclictest60350irq/132-enp0s29f1:rx-022:10:140
3342477991311,1cyclictest60350irq/132-enp0s29f1:rx-021:50:240
3342477991311,1cyclictest60350irq/132-enp0s29f1:rx-020:30:380
3342477991311,1cyclictest60350irq/132-enp0s29f1:rx-019:25:130
3342477991311,1cyclictest60350irq/132-enp0s29f1:rx-000:30:150
3342477991311,1cyclictest60350irq/132-enp0s29f1:rx-000:10:240
3342477991311,1cyclictest60350irq/132-enp0s29f1:rx-000:05:150
3342477991311,1cyclictest3665251-21cron00:20:000
3342477991310,2cyclictest60350irq/132-enp0s29f1:rx-022:35:130
334248699129,2cyclictest3472112-21unixbench_multi21:10:253
334248699129,2cyclictest3457729-21irqcore21:00:163
334248699129,2cyclictest3373445-21unixbench_multi19:35:243
334248699129,1cyclictest0-21swapper/320:15:003
334248699128,3cyclictest3435348-21kworker/u8:3+flush-259:021:30:163
334248399129,2cyclictest3570754-21ntp_kernel_pll_22:45:242
334248399129,2cyclictest3560827-21unixbench_singl22:35:242
334248399128,3cyclictest3519818-21kworker/u8:1+flush-259:022:05:212
334248399128,3cyclictest3405071-21kworker/u8:2+flush-259:020:10:162
334247799129,2cyclictest3582525-21fschecks_time23:00:140
334248699119,1cyclictest0-21swapper/323:35:163
334248699119,1cyclictest0-21swapper/300:20:013
334248399119,1cyclictest0-21swapper/219:35:172
334248399119,1cyclictest0-21swapper/219:20:222
334248099119,1cyclictest0-21swapper/121:30:141
334247799119,1cyclictest60350irq/132-enp0s29f1:rx-020:50:120
334248699108,1cyclictest0-21swapper/319:30:163
33424869997,1cyclictest0-21swapper/323:20:153
33424869990,1cyclictest0-21swapper/319:55:173
33424839997,1cyclictest0-21swapper/223:00:182
33424839996,2cyclictest3540898-21cpuspeed_turbos22:20:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional