You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 04:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Tue Aug 11, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3473312994642,3cyclictest3722694-21kworker/u8:1+events_unbound23:45:002
3473312994641,3cyclictest3572685-21kworker/u8:4+flush-259:021:05:012
3473309994441,2cyclictest75-21kswapd022:40:041
3473317994236,4cyclictest3473036-21latency_hist19:10:013
3473317994037,2cyclictest1429347-21kworker/u8:5+events_unbound19:10:503
3473312994034,4cyclictest3525145-21latency_hist20:00:012
3473309994036,3cyclictest3462857-21kworker/u8:2+flush-259:019:50:001
3473305994036,3cyclictest3582850-21kworker/u8:1+flush-259:021:30:000
3473305994033,5cyclictest3686133-21latency_hist22:35:000
3473317993936,2cyclictest3551621-21/usr/sbin/munin20:25:133
3473309993934,3cyclictest3691412-21gpgv22:40:011
3473305993833,3cyclictest3550964-21latency_hist20:25:010
3473305993832,4cyclictest3598268-21latency_hist21:09:590
3473317993734,2cyclictest3738229-21kworker/u8:3+flush-259:023:30:013
3473317993733,3cyclictest3660339-21kworker/u8:1+events_unbound22:25:223
3473317993731,4cyclictest3748800-21apt-get23:35:113
3473312993633,2cyclictest3462857-21kworker/u8:2+flush-259:019:45:002
3473317993532,2cyclictest3634615-21kworker/u8:0+events_unbound23:10:223
3473317993532,2cyclictest3499441-21kworker/u8:3+events_unbound20:05:193
3473312993533,2cyclictest3545786-21kworker/u8:2+events_unbound20:31:462
3473305993529,4cyclictest335557-21systemd-journal20:55:000
3473312993430,3cyclictest1429347-21kworker/u8:5+flush-259:019:10:462
3473309993428,4cyclictest335557-21systemd-journal23:25:011
3473317993331,2cyclictest3670651-21kworker/u8:2+flush-259:022:25:013
3473317993330,2cyclictest3525373-21kworker/u8:0+flush-259:020:45:453
3473317993229,2cyclictest3634615-21kworker/u8:0+events_unbound21:45:153
3473317993229,2cyclictest3462857-21kworker/u8:2+events_unbound19:45:213
3473317993229,2cyclictest1429347-21kworker/u8:5+events_unbound19:15:193
3473312993229,2cyclictest3525373-21kworker/u8:0+flush-259:020:40:222
3473317993129,1cyclictest3650197-21kworker/u8:5+events_unbound22:00:253
3473317993128,2cyclictest3779534-21kworker/u8:1+flush-259:000:05:273
3473317993128,2cyclictest3722694-21kworker/u8:1+flush-259:023:20:163
3473317993128,2cyclictest3691506-21kworker/u8:3+events_unbound22:43:453
3473312993128,3cyclictest3499441-21kworker/u8:3+events_unbound20:17:472
3473312993127,3cyclictest335557-21systemd-journal19:38:462
3473312993127,3cyclictest335557-21systemd-journal19:38:452
3473309993126,3cyclictest3790136-21apt-get00:15:131
3473309993124,5cyclictest3556492-21latency_hist20:30:001
3473305993125,4cyclictest335557-21systemd-journal20:59:450
3473317993028,2cyclictest3748188-21kworker/u8:0+events_unbound23:55:133
3473317993027,3cyclictest3572685-21kworker/u8:4+flush-259:021:32:113
3473317993027,2cyclictest3722694-21kworker/u8:1+flush-259:023:40:153
3473317993027,2cyclictest3722694-21kworker/u8:1+flush-259:023:15:213
3473317993027,2cyclictest3670651-21kworker/u8:2+flush-259:022:55:253
3473317993027,2cyclictest3545786-21kworker/u8:2+events_unbound20:35:143
3473312993027,2cyclictest3753921-21kworker/u8:4+events_unbound00:35:222
3473317992927,1cyclictest3634615-21kworker/u8:0+flush-259:022:15:153
3473317992926,2cyclictest3732764-21kworker/u8:2+events_unbound23:25:213
3473317992926,2cyclictest3525373-21kworker/u8:0+events_unbound20:00:193
3473312992926,2cyclictest3572685-21kworker/u8:4+flush-259:021:20:272
3473305992924,3cyclictest335557-21systemd-journal21:55:450
347330599290,27cyclictest509-21rs:main0
3473317992824,3cyclictest3753921-21kworker/u8:4+events_unbound23:45:143
3473312992825,2cyclictest3618964-21kworker/u8:2+flush-259:021:40:212
3473312992825,2cyclictest3525373-21kworker/u8:0+flush-259:020:30:012
3473312992824,3cyclictest3572685-21kworker/u8:4+events_unbound21:18:472
3473309992823,3cyclictest3619187-21apt-get21:30:141
3473305992825,2cyclictest3779534-21kworker/u8:1+events_unbound00:35:000
3473312992723,3cyclictest3722694-21kworker/u8:1+events_unbound23:32:502
3473305992724,2cyclictest3738229-21kworker/u8:3+events_unbound23:32:280
3473305992723,3cyclictest3484046-21kworker/u8:1+events_unbound19:26:560
3473305992723,3cyclictest3462857-21kworker/u8:2+flush-259:019:52:010
3473305992721,5cyclictest3624502-21diskstats21:35:140
3473317992625,1cyclictest3462857-21kworker/u8:2+flush-259:019:20:163
3473317992623,2cyclictest3634615-21kworker/u8:0+events_unbound22:55:003
3473317992623,2cyclictest3582850-21kworker/u8:1+flush-259:021:25:223
3473317992623,2cyclictest3499441-21kworker/u8:3+flush-259:020:20:193
3473317992622,3cyclictest3634615-21kworker/u8:0+flush-259:023:00:243
3473312992623,2cyclictest3572685-21kworker/u8:4+events_unbound20:45:182
3473312992622,3cyclictest3670651-21kworker/u8:2+events_unbound22:57:502
3473309992621,3cyclictest3650197-21kworker/u8:5+events_unbound22:15:181
3473309992621,3cyclictest3494136-21apt-get19:29:191
3473305992623,2cyclictest3733294-21apt-get23:20:130
347330599260,24cyclictest1-21systemd00:19:320
3473317992522,2cyclictest3748188-21kworker/u8:0+events_unbound23:50:233
3473317992522,2cyclictest3670651-21kworker/u8:2+events_unbound22:45:243
3473317992519,4cyclictest3535877-21diskstats20:10:143
3473312992522,2cyclictest3670651-21kworker/u8:2+events_unbound22:30:012
3473312992520,2cyclictest3712406-21kworker/u8:3+flush-259:023:15:242
3473312992519,4cyclictest3629250-21latency_hist21:40:012
3473309992520,4cyclictest335557-21systemd-journal20:15:001
3473309992519,4cyclictest3598513-21/usr/sbin/munin21:10:141
3473305992522,2cyclictest3660339-21kworker/u8:1+events_unbound22:25:240
3473305992522,2cyclictest3551646-21apt-get20:25:090
3473305992522,2cyclictest3499441-21kworker/u8:3+events_unbound20:12:020
3473305992521,3cyclictest3712406-21kworker/u8:3+events_unbound23:06:520
3473317992421,2cyclictest3650197-21kworker/u8:5+flush-259:022:05:213
3473317992421,2cyclictest3634615-21kworker/u8:0+events_unbound21:50:223
3473317992421,2cyclictest3572685-21kworker/u8:4+events_unbound20:50:133
3473317992420,3cyclictest3753921-21kworker/u8:4+events_unbound00:22:363
3473317992420,3cyclictest3618964-21kworker/u8:2+flush-259:021:35:213
3473317992420,3cyclictest3582850-21kworker/u8:1+events_unbound21:15:143
3473312992422,2cyclictest3462857-21kworker/u8:2+events_unbound19:52:452
3473312992421,2cyclictest3779534-21kworker/u8:1+flush-259:000:05:292
3473312992421,2cyclictest3670651-21kworker/u8:2+events_unbound22:45:182
3473312992421,2cyclictest3499441-21kworker/u8:3+flush-259:020:10:202
3473312992420,2cyclictest3618964-21kworker/u8:2+events_unbound21:35:012
3473309992418,4cyclictest3795293-21/usr/sbin/munin00:20:171
3473305992421,2cyclictest3462857-21kworker/u8:2+events_unbound19:14:450
3473305992420,3cyclictest3774632-21apt-get00:00:150
3473317992320,2cyclictest3634615-21kworker/u8:0+events_unbound22:10:163
3473317992320,2cyclictest3545786-21kworker/u8:2+events_unbound20:33:453
3473317992320,2cyclictest3462857-21kworker/u8:2+flush-259:019:50:153
3473317992319,3cyclictest3499441-21kworker/u8:3+events_unbound20:19:463
3473312992320,2cyclictest3753921-21kworker/u8:4+events_unbound23:45:262
3473312992320,2cyclictest3634615-21kworker/u8:0+events_unbound23:20:232
3473312992320,2cyclictest3582850-21kworker/u8:1+events_unbound21:25:232
3473312992320,2cyclictest3484057-21/usr/sbin/munin19:20:212
3473312992320,2cyclictest3462857-21kworker/u8:2+events_unbound19:30:462
3473312992319,3cyclictest3748188-21kworker/u8:0+events_unbound00:03:392
3473309992320,2cyclictest3649981-21systemd-run22:00:001
3473309992317,4cyclictest335557-21systemd-journal21:45:451
3473309992316,5cyclictest3763137-21ntpq23:45:231
3473305992320,2cyclictest3753921-21kworker/u8:4+flush-259:000:29:420
3473305992319,3cyclictest3670651-21kworker/u8:2+events_unbound22:56:490
3473305992319,3cyclictest3572685-21kworker/u8:4+events_unbound21:10:230
3473305992319,3cyclictest3499441-21kworker/u8:3+events_unbound19:47:470
3473305992318,4cyclictest3473457-21gpgv19:10:000
3473317992219,2cyclictest3779534-21kworker/u8:1+events_unbound00:26:343
3473317992219,2cyclictest3618964-21kworker/u8:2+events_unbound21:40:223
3473317992219,2cyclictest3525373-21kworker/u8:0+events_unbound20:40:233
3473317992219,2cyclictest3462857-21kworker/u8:2+flush-259:019:30:253
3473317992218,3cyclictest3582850-21kworker/u8:1+events_unbound21:06:413
3473312992220,2cyclictest3779534-21kworker/u8:1+events_unbound00:24:332
3473312992220,2cyclictest3525373-21kworker/u8:0+events_unbound20:00:212
3473312992219,2cyclictest3634615-21kworker/u8:0+events_unbound23:00:272
3473305992219,2cyclictest3712406-21kworker/u8:3+events_unbound23:02:500
3473305992219,2cyclictest3634615-21kworker/u8:0+events_unbound21:50:130
3473305992218,3cyclictest3753921-21kworker/u8:4+events_unbound00:37:340
3473305992218,3cyclictest3722694-21kworker/u8:1+events_unbound23:27:270
3473305992218,3cyclictest3572685-21kworker/u8:4+events_unbound21:22:460
3473305992218,3cyclictest3499441-21kworker/u8:3+events_unbound20:16:480
3473305992218,3cyclictest3499441-21kworker/u8:3+events_unbound19:35:460
3473305992218,3cyclictest3499441-21kworker/u8:3+events_unbound19:35:450
3473305992218,3cyclictest3462857-21kworker/u8:2+events_unbound19:30:190
3473317992118,2cyclictest3790100-21kworker/u8:3+events_unbound00:15:273
3473317992118,2cyclictest3779534-21kworker/u8:1+events_unbound00:30:143
3473317992118,2cyclictest3670651-21kworker/u8:2+events_unbound22:35:133
3473312992118,2cyclictest3779534-21kworker/u8:1+flush-259:000:10:152
3473312992117,3cyclictest3732764-21kworker/u8:2+events_unbound23:25:152
3473312992117,3cyclictest3634615-21kworker/u8:0+flush-259:023:10:402
3473312992117,3cyclictest3634615-21kworker/u8:0+events_unbound21:55:092
3473312992117,3cyclictest3556545-21kworker/u8:1+events_unbound20:37:032
3473305992118,2cyclictest3738229-21kworker/u8:3+events_unbound23:40:000
3473305992118,2cyclictest3572685-21kworker/u8:4+flush-259:020:45:160
3473317992015,4cyclictest335557-21systemd-journal22:35:003
3473312992017,3cyclictest3650197-21kworker/u8:5+events_unbound22:15:042
3473312992017,2cyclictest3670651-21kworker/u8:2+events_unbound22:42:232
3473312992017,2cyclictest3670651-21kworker/u8:2+events_unbound22:35:102
3473312992017,2cyclictest3634615-21kworker/u8:0+flush-259:023:05:182
3473312992017,2cyclictest3634615-21kworker/u8:0+events_unbound22:05:152
3473312992017,2cyclictest3582850-21kworker/u8:1+events_unbound21:45:212
3473312992017,2cyclictest3582850-21kworker/u8:1+events_unbound21:13:462
3473312992017,2cyclictest3484046-21kworker/u8:1+flush-259:019:29:202
3473309992017,2cyclictest3753921-21kworker/u8:4+flush-259:000:10:001
3473309992016,3cyclictest3764047-21kworker/u8:2+flush-259:000:00:271
3473309992016,3cyclictest3462857-21kworker/u8:2+flush-259:019:39:591
3473309992016,3cyclictest3462857-21kworker/u8:2+flush-259:019:39:591
3473305992018,1cyclictest3670894-21apt-get22:20:120
3473305992017,2cyclictest3748188-21kworker/u8:0+flush-259:023:45:000
3473305992017,2cyclictest3618964-21kworker/u8:2+flush-259:021:40:210
3473305992016,3cyclictest3779534-21kworker/u8:1+events_unbound00:06:140
3473305992016,3cyclictest3634615-21kworker/u8:0+events_unbound21:47:470
3473305992016,3cyclictest3582850-21kworker/u8:1+flush-259:021:17:110
3473317991917,2cyclictest3764047-21kworker/u8:2+events_unbound00:04:113
3473317991916,2cyclictest3644761-21kworker/u8:2+events_unbound21:58:453
3473317991916,2cyclictest3588649-21grep21:00:153
3473317991916,2cyclictest3582850-21kworker/u8:1+flush-259:021:20:203
3473317991916,2cyclictest3499441-21kworker/u8:3+events_unbound19:35:223
3473317991916,2cyclictest3499441-21kworker/u8:3+events_unbound19:35:213
3473312991916,2cyclictest3660339-21kworker/u8:1+events_unbound22:30:112
3473312991916,2cyclictest3572685-21kworker/u8:4+events_unbound20:50:152
3473312991916,2cyclictest3499441-21kworker/u8:3+events_unbound20:09:462
3473309991916,2cyclictest3567279-21latency_hist20:40:011
3473309991915,3cyclictest3618964-21kworker/u8:2+flush-259:021:39:591
3473309991914,3cyclictest3681200-21apt-get22:30:111
3473309991914,3cyclictest3525373-21kworker/u8:0+flush-259:020:50:211
3473309991914,3cyclictest3473244-21apt-key19:10:011
3473309991913,4cyclictest3753931-21/usr/sbin/munin23:40:151
3473309991911,5cyclictest3643857-21ntpq21:50:211
3473305991916,2cyclictest3634615-21kworker/u8:0+events_unbound22:12:180
3473305991915,3cyclictest3697142-21apt-get22:45:130
3473305991914,4cyclictest3702458-21diskstats22:50:160
3473305991914,3cyclictest3759110-21/usr/sbin/munin23:45:240
3473317991815,2cyclictest3499441-21kworker/u8:3+flush-259:019:40:163
3473312991815,2cyclictest3572685-21kworker/u8:4+flush-259:021:07:112
3473312991815,2cyclictest3572685-21kworker/u8:4+flush-259:020:55:232
3473312991814,3cyclictest3499441-21kworker/u8:3+flush-259:020:20:262
3473312991812,4cyclictest3752773-21ntpq23:35:192
3473309991814,3cyclictest3748188-21kworker/u8:0+flush-259:023:55:231
3473309991812,4cyclictest335557-21systemd-journal00:29:411
3473305991815,2cyclictest3779534-21kworker/u8:1+events_unbound00:20:250
3473305991815,2cyclictest3748188-21kworker/u8:0+flush-259:023:50:200
3473305991815,2cyclictest3691506-21kworker/u8:3+flush-259:022:45:000
3473305991815,2cyclictest3462857-21kworker/u8:2+events_unbound19:20:200
3473305991814,3cyclictest3650197-21kworker/u8:5+events_unbound22:15:230
3473305991812,4cyclictest3571538-21ntpq20:40:210
3473317991713,3cyclictest3525373-21kworker/u8:0+events_unbound20:55:123
3473312991715,2cyclictest3790100-21kworker/u8:3+events_unbound00:17:012
3473312991713,3cyclictest3582850-21kworker/u8:1+events_unbound21:50:202
3473309991713,3cyclictest3779534-21kworker/u8:1+events_unbound00:40:001
3473309991711,4cyclictest3618964-21kworker/u8:2+flush-259:021:40:311
3473305991714,2cyclictest60350irq/132-enp0s29f1:rx-022:06:410
3473305991713,3cyclictest1429347-21kworker/u8:5+events_unbound19:15:140
3473305991711,4cyclictest3690363-21ntpq22:35:180
3473317991613,3cyclictest3484046-21kworker/u8:1+events_unbound19:26:573
3473317991613,2cyclictest3514894-21kworker/u8:1+events_unbound19:55:173
3473317991612,3cyclictest3753921-21kworker/u8:4+events_unbound00:10:043
3473317991612,3cyclictest3634615-21kworker/u8:0+events_unbound23:07:533
3473312991613,2cyclictest3634615-21kworker/u8:0+flush-259:022:50:192
3473312991613,2cyclictest3634615-21kworker/u8:0+flush-259:022:10:192
3473312991612,3cyclictest3753921-21kworker/u8:4+events_unbound23:53:122
3473305991614,1cyclictest60350irq/132-enp0s29f1:rx-023:59:410
3473305991613,2cyclictest3779534-21kworker/u8:1+events_unbound00:10:180
3473305991613,2cyclictest3545786-21kworker/u8:2+flush-259:020:30:270
3473305991612,3cyclictest3712406-21kworker/u8:3+flush-259:023:12:370
3473305991612,3cyclictest3618964-21kworker/u8:2+events_unbound21:30:180
3473305991612,3cyclictest3582850-21kworker/u8:1+flush-259:021:00:180
3473305991612,3cyclictest3525383-21/usr/sbin/munin20:00:210
3473305991612,3cyclictest3514894-21kworker/u8:1+events_unbound19:55:140
347330999159,4cyclictest3732139-21ntpq23:15:231
3473309991512,2cyclictest3557773-21kthreadcore20:30:171
3473309991511,3cyclictest3634615-21kworker/u8:0+flush-259:022:10:121
3473309991511,3cyclictest1429347-21kworker/u8:5+events_unbound19:10:511
3473309991510,4cyclictest3712626-21apt-get23:00:101
3473309991510,4cyclictest3582850-21kworker/u8:1+flush-259:021:05:161
3473309991510,3cyclictest3670651-21kworker/u8:2+flush-259:022:55:201
3473309991510,1cyclictest0-21swapper/123:40:001
3473305991512,2cyclictest3733033-21turbostat23:20:010
3473305991511,3cyclictest3499441-21kworker/u8:3+events_unbound20:05:140
347331799148,3cyclictest3753921-21kworker/u8:4+events_unbound00:39:343
3473317991411,2cyclictest3582850-21kworker/u8:1+events_unbound21:13:203
3473312991412,2cyclictest3779534-21kworker/u8:1+events_unbound00:34:402
3473312991411,3cyclictest3764047-21kworker/u8:2+events_unbound23:58:492
3473312991411,2cyclictest3650197-21kworker/u8:5+flush-259:022:00:212
3473312991411,2cyclictest3462857-21kworker/u8:2+events_unbound19:40:302
347330999149,3cyclictest3572685-21kworker/u8:4+flush-259:021:02:101
347330999148,4cyclictest3504859-21apt-get19:40:131
3473309991412,1cyclictest0-21swapper/121:25:001
3473309991411,2cyclictest3699436-21kthreadcore22:45:211
3473312991310,2cyclictest3753921-21kworker/u8:4+events_unbound00:25:262
3473312991310,2cyclictest3660339-21kworker/u8:1+events_unbound22:22:342
347330999139,3cyclictest3650197-21kworker/u8:5+flush-259:022:05:241
347330999138,3cyclictest3572685-21kworker/u8:4+flush-259:020:55:221
347330999137,4cyclictest335557-21systemd-journal20:22:451
3473305991311,1cyclictest60350irq/132-enp0s29f1:rx-022:04:530
3473305991310,2cyclictest3499441-21kworker/u8:3+events_unbound19:40:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional