You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 01:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sun Sep 13, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3573796994440,3cyclictest3594723-21apt-get07:30:101
3573799994137,3cyclictest3729862-21gpgv09:40:012
3573794994134,5cyclictest3848995-21ntpq11:30:210
3573804994034,4cyclictest3793241-21apt-get10:40:143
3573794993935,3cyclictest3641203-21kworker/u8:0+flush-259:009:40:240
3573794993834,3cyclictest3677187-21kworker/u8:1+flush-259:009:15:250
3573794993831,5cyclictest3792656-21cp10:40:000
3573796993633,2cyclictest3714529-21apt-get09:25:121
3573794993632,3cyclictest3641203-21kworker/u8:0+flush-259:010:20:250
3573794993630,4cyclictest3599613-21latency_hist07:35:000
3573799993529,4cyclictest335557-21systemd-journal08:40:002
3573796993531,3cyclictest3860421-21apt-get11:45:111
3573794993531,3cyclictest3735318-21kworker/u8:2+flush-259:009:55:260
3573794993526,7cyclictest335557-21systemd-journal09:50:010
3573794993427,5cyclictest3629719-21ntpq08:00:240
3573796993329,3cyclictest335557-21systemd-journal08:04:261
3573804993225,5cyclictest3896905-21latency_hist12:20:003
3573796993228,3cyclictest3735318-21kworker/u8:2+flush-259:011:15:211
3573796993129,2cyclictest3735318-21kworker/u8:2+flush-259:010:10:261
3573796993127,3cyclictest3692941-21apt-get09:05:141
3573794993125,4cyclictest3803331-21latency_hist10:50:010
3573796993027,2cyclictest3886521-21kworker/u8:3+flush-259:012:25:001
3573796993025,3cyclictest335557-21systemd-journal12:02:261
3573794993025,3cyclictest3729756-21apt-get09:40:000
3573804992925,3cyclictest3782264-21kworker/u8:3+flush-259:010:29:593
3573799992924,3cyclictest3698290-21gpgv09:10:012
3573796992925,2cyclictest3855226-21/usr/sbin/munin11:40:211
3573796992923,4cyclictest3667068-21apt-get08:40:121
3573794992925,3cyclictest519855-21kworker/u8:0+events_unbound07:10:240
3573804992824,3cyclictest3776505-21kworker/u8:1+flush-259:011:00:243
3573799992823,4cyclictest335557-21systemd-journal08:20:002
3573796992822,4cyclictest3854991-21latency_hist11:40:001
3573804992723,3cyclictest3615371-21apt-get07:50:123
3573804992721,4cyclictest3798581-21diskstats10:45:153
3573804992721,4cyclictest3798581-21diskstats10:45:143
3573796992723,3cyclictest3599660-21kworker/u8:1+flush-259:008:10:001
3573796992722,3cyclictest3645746-40mandb08:15:271
3573794992720,5cyclictest3839540-21latency_hist11:25:000
3573799992622,3cyclictest3584129-21kworker/u8:2+events_unbound07:30:232
3573799992621,4cyclictest509-21rs:main2
3573794992620,4cyclictest3735318-21kworker/u8:2+events_unbound11:15:220
3573804992520,3cyclictest3876112-21base6412:00:003
3573804992519,5cyclictest3583211-21ntpq07:15:203
3573799992520,3cyclictest3850116-21/usr/sbin/munin11:35:152
3573799992518,4cyclictest3594457-21latency_hist07:30:002
3573796992521,3cyclictest3776505-21kworker/u8:1+events_unbound11:10:211
3573796992521,3cyclictest3661649-21kworker/u8:2+flush-259:009:00:001
3573796992521,3cyclictest3641203-21kworker/u8:0+flush-259:009:45:241
3573804992419,3cyclictest335557-21systemd-journal11:10:253
3573804992418,4cyclictest3819112-21apt-get11:05:113
3573799992420,3cyclictest3797901-21apt-get10:42:262
3573799992419,3cyclictest3661620-21latency_hist08:35:002
3573794992420,3cyclictest3735318-21kworker/u8:2+flush-259:010:10:200
3573794992420,3cyclictest3641203-21kworker/u8:0+flush-259:008:45:100
3573804992318,3cyclictest519855-21kworker/u8:0+flush-259:007:40:163
3573804992317,4cyclictest3604793-21latency_hist07:40:003
3573799992318,3cyclictest3902327-21apt-get12:25:122
3573794992316,5cyclictest3828289-21ntpq11:10:250
3573804992217,4cyclictest3876452-21apt-get12:00:123
3573799992218,3cyclictest507-21in:imuxsock12:10:012
3573799992217,4cyclictest3870770-21kworker/u8:2+flush-259:012:10:282
3573794992218,3cyclictest519855-21kworker/u8:0+flush-259:007:45:170
3573794992218,3cyclictest3735318-21kworker/u8:2+events_unbound09:50:220
3573794992218,3cyclictest3641203-21kworker/u8:0+events_unbound08:30:190
3573794992217,4cyclictest3697884-21apt-get09:10:010
3573794992217,3cyclictest3860184-21kworker/u8:4+events_unbound11:50:240
3573794992216,4cyclictest335557-21systemd-journal11:05:000
3573794992215,5cyclictest3890795-21ntpq12:10:220
3573804992117,3cyclictest335557-21systemd-journal10:35:003
3573796992115,4cyclictest3728827-21ntpq09:35:211
3573794992117,3cyclictest3870770-21kworker/u8:2+events_unbound12:00:250
3573794992117,3cyclictest3776505-21kworker/u8:1+flush-259:011:44:270
3573794992117,3cyclictest3661649-21kworker/u8:2+events_unbound09:00:280
3573794992117,3cyclictest3620514-21kworker/u8:4+flush-259:008:15:170
3573794992117,3cyclictest3599660-21kworker/u8:1+events_unbound08:05:160
3573804992018,1cyclictest0-21swapper/309:40:013
3573804992015,3cyclictest335557-21systemd-journal11:36:263
3573799992015,3cyclictest3766544-21apt-get10:15:112
3573796992017,2cyclictest3735318-21kworker/u8:2+flush-259:011:20:181
3573794992016,3cyclictest3870770-21kworker/u8:2+events_unbound12:05:280
3573794992016,3cyclictest3620514-21kworker/u8:4+events_unbound08:20:270
3573804991915,3cyclictest3803761-21diskstats10:50:183
3573804991915,3cyclictest335557-21systemd-journal10:05:003
3573799991913,4cyclictest3735318-21kworker/u8:2+flush-259:011:20:172
3573796991916,2cyclictest3599660-21kworker/u8:1+flush-259:007:39:591
3573796991913,5cyclictest335557-21systemd-journal12:33:251
3573794991916,2cyclictest3907475-21kworker/u8:0+flush-259:012:30:200
3573794991916,2cyclictest0-21swapper/009:10:000
3573794991915,3cyclictest3891706-21kworker/u8:4+events_unbound12:20:230
3573794991915,3cyclictest3776505-21kworker/u8:1+events_unbound11:35:210
3573794991915,3cyclictest3661649-21kworker/u8:2+flush-259:008:40:240
3573794991914,4cyclictest3568201-21kworker/u8:3+events_unbound07:18:260
3573794991914,3cyclictest335557-21systemd-journal10:44:550
3573794991913,4cyclictest3870770-21kworker/u8:2+flush-259:012:35:170
3573794991913,4cyclictest3661865-21/usr/sbin/munin08:35:160
357379499190,17cyclictest335557-21systemd-journal09:31:270
3573804991814,3cyclictest3641203-21kworker/u8:0+flush-259:010:20:223
3573804991813,4cyclictest519855-21kworker/u8:0+flush-259:007:25:003
3573799991814,3cyclictest3776505-21kworker/u8:1+flush-259:010:25:172
3573796991815,2cyclictest3870770-21kworker/u8:2+flush-259:012:10:251
3573796991814,3cyclictest3870770-21kworker/u8:2+flush-259:012:35:241
3573796991812,4cyclictest3734447-21ntpq09:40:211
3573794991815,2cyclictest3615120-21kworker/u8:3+events_unbound07:50:220
3573794991814,3cyclictest3641203-21kworker/u8:0+flush-259:010:05:180
3573794991814,3cyclictest3568201-21kworker/u8:3+events_unbound07:21:200
3573794991811,5cyclictest335557-21systemd-journal10:49:590
3573804991714,2cyclictest3661611-21cron08:35:003
3573804991714,2cyclictest3641203-21kworker/u8:0+flush-259:009:30:293
3573804991713,3cyclictest519855-21kworker/u8:0+flush-259:007:15:003
3573804991712,4cyclictest3703500-21apt-get09:15:013
3573799991713,3cyclictest519855-21kworker/u8:0+flush-259:007:20:012
3573799991713,3cyclictest3870770-21kworker/u8:2+flush-259:012:35:482
3573799991711,4cyclictest3745887-21/usr/sbin/munin09:55:152
3573796991714,2cyclictest3641203-21kworker/u8:0+flush-259:009:30:231
3573796991714,2cyclictest3641203-21kworker/u8:0+flush-259:008:45:171
3573796991713,3cyclictest3641203-21kworker/u8:0+flush-259:010:20:161
357379499173,3cyclictest3808451-21cron10:54:590
3573794991714,2cyclictest60350irq/132-enp0s29f1:rx-011:45:330
3573794991713,3cyclictest3677187-21kworker/u8:1+events_unbound09:20:140
3573794991713,3cyclictest3641203-21kworker/u8:0+events_unbound09:25:230
3573794991713,3cyclictest3641203-21kworker/u8:0+events_unbound08:53:260
3573794991713,3cyclictest3599660-21kworker/u8:1+flush-259:008:10:150
3573794991712,4cyclictest3735318-21kworker/u8:2+events_unbound10:25:020
3573804991613,2cyclictest3792541-21idleruntime-cro10:39:593
3573804991613,2cyclictest3641203-21kworker/u8:0-events_unbound08:50:003
3573804991613,1cyclictest3677834-21irqcore08:50:163
3573804991612,3cyclictest3912689-21apt-get12:35:103
3573804991612,3cyclictest3891706-21kworker/u8:4+flush-259:012:20:243
3573804991612,3cyclictest3703702-21gpgv09:15:013
3573804991611,4cyclictest3912430-21latency_hist12:35:003
3573799991613,2cyclictest3584129-21kworker/u8:2+flush-259:007:35:192
3573799991611,4cyclictest3735318-21kworker/u8:2+flush-259:009:50:232
3573799991611,3cyclictest3776505-21kworker/u8:1+flush-259:010:50:002
3573799991611,3cyclictest3776505-21kworker/u8:1+flush-259:010:49:592
3573799991610,5cyclictest0-21swapper/211:55:012
3573799991610,4cyclictest3656443-21latency_hist08:30:012
3573796991613,2cyclictest3615545-21fschecks_count07:50:151
3573796991612,3cyclictest3776505-21kworker/u8:1+flush-259:010:25:231
3573796991610,5cyclictest3771466-21latency_hist10:20:011
3573794991613,2cyclictest60350irq/132-enp0s29f1:rx-010:55:150
3573794991613,2cyclictest3761149-21kworker/u8:3+events_unbound10:16:270
3573794991613,2cyclictest3584129-21kworker/u8:2+flush-259:007:25:170
3573794991612,3cyclictest3776505-21kworker/u8:1+events_unbound11:09:260
3573794991612,3cyclictest3584129-21kworker/u8:2+flush-259:007:40:250
3573794991612,2cyclictest3604808-21turbostat07:39:590
3573804991511,3cyclictest3860184-21kworker/u8:4+flush-259:011:50:283
3573804991511,3cyclictest3750827-21sh09:59:593
3573799991513,1cyclictest0-21swapper/209:35:012
3573799991513,1cyclictest0-21swapper/208:00:002
3573799991512,2cyclictest3672671-21irqcore08:45:152
3573799991512,2cyclictest3638376-21kthreadcore08:10:202
3573799991511,3cyclictest3776758-21gpgv10:24:592
3573799991511,3cyclictest3735318-21kworker/u8:2+flush-259:010:10:222
3573796991511,3cyclictest519855-21kworker/u8:0+flush-259:007:41:121
3573796991511,3cyclictest3776505-21kworker/u8:1+flush-259:011:30:261
3573796991510,4cyclictest3589550-21apt-get07:25:111
357379499159,4cyclictest3896028-21ntpq12:15:230
3573794991514,1cyclictest60350irq/132-enp0s29f1:rx-007:58:370
3573794991513,1cyclictest60350irq/132-enp0s29f1:rx-011:55:160
3573794991513,1cyclictest60350irq/132-enp0s29f1:rx-008:25:250
3573794991512,2cyclictest60350irq/132-enp0s29f1:rx-012:25:180
3573794991512,2cyclictest60350irq/132-enp0s29f1:rx-011:29:380
3573794991512,2cyclictest3735318-21kworker/u8:2+flush-259:010:00:240
357380499149,4cyclictest3891706-21kworker/u8:4+flush-259:012:30:003
3573804991412,1cyclictest3860155-21idleruntime-cro11:44:593
3573804991411,2cyclictest3735318-21kworker/u8:2+flush-259:011:25:203
3573804991411,2cyclictest3661649-21kworker/u8:2+flush-259:009:00:163
3573804991410,2cyclictest3647095-21irqcore08:20:163
3573799991412,1cyclictest0-21swapper/212:20:172
3573799991411,2cyclictest3860831-21irqcore11:45:152
3573799991411,2cyclictest3646660-21fschecks_time08:20:142
3573799991410,3cyclictest3661649-21kworker/u8:2+flush-259:009:00:242
3573799991410,3cyclictest3661649-21kworker/u8:2+flush-259:008:55:262
3573799991410,3cyclictest3661649-21kworker/u8:2+flush-259:008:40:032
3573799991410,3cyclictest3641203-21kworker/u8:0+flush-259:009:26:312
3573799991410,3cyclictest3584346-21/usr/sbin/munin07:20:162
357379699148,4cyclictest3589288-21latency_hist07:25:011
3573796991412,1cyclictest3866061-21irqcore11:50:181
3573796991411,2cyclictest3882016-21irqcore12:05:151
3573796991410,3cyclictest3687784-21apt-get09:00:111
3573794991410,3cyclictest3782264-21kworker/u8:3+events_unbound10:30:170
3573804991310,2cyclictest3682698-21cpuspeed_turbos08:55:143
357379699139,3cyclictest0-21swapper/110:35:001
357379699138,4cyclictest3735318-21kworker/u8:2+flush-259:010:55:141
357379699138,2cyclictest0-21swapper/109:15:001
3573796991310,2cyclictest3807996-21unixbench_multi10:50:291
3573796991310,2cyclictest3661617-21cron08:35:001
3573796991310,2cyclictest3651623-21cpuspeed_turbos08:25:141
3573796991310,2cyclictest0-21swapper/109:20:011
357380499129,2cyclictest3709538-21cpuspeed_turbos09:20:133
357380499129,2cyclictest3693141-21fschecks_count09:05:163
357379999129,2cyclictest500-21systemd-logind10:10:002
357379999129,2cyclictest3614643-21unixbench_multi07:45:272
357379999127,3cyclictest3573994-21/usr/sbin/munin07:10:212
3573799991210,1cyclictest0-21swapper/212:05:012
357379999120,11cyclictest1-21systemd12:33:262
357379699129,2cyclictest3896501-21unixbench_singl12:15:271
357379699129,2cyclictest3798594-21fschecks_count10:45:151
357379699129,2cyclictest3798594-21fschecks_count10:45:141
3573796991210,2cyclictest3808405-21kworker/u8:0+flush-259:011:29:321
357379499129,2cyclictest60350irq/132-enp0s29f1:rx-008:55:120
357380499119,1cyclictest0-21swapper/311:00:013
357380499119,1cyclictest0-21swapper/309:30:013
357380499117,3cyclictest3641203-21kworker/u8:0+flush-259:010:15:103
357380499116,4cyclictest3629773-21sshd08:00:263
357380499116,3cyclictest0-21swapper/308:15:013
357380499111,2cyclictest3735304-21latency_hist09:45:013
357379999119,1cyclictest0-21swapper/210:05:002
357379999118,2cyclictest3681881-21unixbench_multi08:50:252
357379999118,1cyclictest3860155-21awk11:45:012
357379999116,4cyclictest335557-21systemd-journal11:33:202
357379999110,9cyclictest3792545-21awk10:39:592
357379699118,2cyclictest3792559-21apt10:40:001
357379699118,2cyclictest3575017-21kernelversion07:10:181
357379699116,3cyclictest335557-21systemd-journal07:19:271
357379699115,5cyclictest3646399-21apt-get08:20:131
357380499107,2cyclictest3610305-21cpuspeed_turbos07:45:153
357380499106,2cyclictest0-21swapper/307:55:143
357379999107,2cyclictest3729756-21apt-get09:40:022
357379999106,2cyclictest832-21runrttasks07:50:132
357379999103,5cyclictest513-21gdbus10:35:002
357379999100,8cyclictest3703503-21latency_hist09:15:002
357379699106,3cyclictest3641203-21kworker/u8:0+flush-259:009:55:171
357379699103,5cyclictest3761107-21latency_hist10:10:001
35738049997,1cyclictest0-21swapper/307:25:133
35738049996,1cyclictest0-21swapper/307:30:123
35737999996,2cyclictest3817877-21needreboot11:00:202
35737999995,3cyclictest3625906-21fschecks_count08:00:182
35737969995,3cyclictest311ktimers/109:50:161
35737969984,3cyclictest3902589-21cut12:25:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional