You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 09:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Thu Jun 18, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3231214995652,3cyclictest3268241-21kworker/u8:2+events_unbound20:15:021
3231210994441,2cyclictest75-21kswapd022:41:040
3231210994441,2cyclictest3367648-21kworker/u8:2+flush-259:021:55:000
3231216994340,2cyclictest3268241-21kworker/u8:2+events_unbound20:15:162
3231216994339,3cyclictest3221187-21kworker/u8:1+events_unbound19:15:192
3231216994139,1cyclictest3455547-21fwupd22:41:012
3231216994138,2cyclictest3221187-21kworker/u8:1+flush-259:019:50:162
3231216994037,2cyclictest3367648-21kworker/u8:2+flush-259:021:40:242
3231216994037,2cyclictest3320766-21kworker/u8:0+events_unbound20:40:222
3231216994036,3cyclictest3221187-21kworker/u8:1+flush-259:019:25:232
3231216994034,4cyclictest3263065-21latency_hist19:40:012
3231210994037,2cyclictest3221187-21kworker/u8:1+flush-259:019:10:200
3231210993936,2cyclictest3377993-21kworker/u8:0+flush-259:022:00:210
3231216993834,3cyclictest3278570-21kworker/u8:3+flush-259:020:50:152
3231210993834,3cyclictest3247159-21apt-get19:20:560
3231216993633,2cyclictest3377993-21kworker/u8:0+events_unbound21:35:202
3231216993631,4cyclictest3362130-21gpgv21:15:002
3231210993633,2cyclictest3377993-21kworker/u8:0+flush-259:022:30:210
3231216993532,2cyclictest3289078-21kworker/u8:4+flush-259:020:45:472
3231216993532,2cyclictest3289078-21kworker/u8:4+events_unbound21:05:192
3231220993428,4cyclictest3502450-21latency_hist23:30:003
3231216993431,2cyclictest3559452-21kworker/u8:2+events_unbound00:35:192
3231216993431,2cyclictest3221187-21kworker/u8:1+flush-259:019:10:152
3231210993431,2cyclictest3247192-21kworker/u8:0+flush-259:019:25:200
3231210993430,3cyclictest3263328-21apt-get19:40:120
3231210993428,4cyclictest3305653-21diskstats20:20:130
3231216993330,2cyclictest3470539-21kworker/u8:2+events_unbound23:00:222
3231216993330,2cyclictest3221187-21kworker/u8:1+flush-259:019:55:152
3231210993330,2cyclictest3247192-21kworker/u8:0+flush-259:019:45:170
3231220993228,3cyclictest3527992-21kworker/u8:1+flush-259:000:15:003
3231216993229,2cyclictest3527992-21kworker/u8:1+events_unbound00:00:272
3231216993229,2cyclictest3367648-21kworker/u8:2+events_unbound22:05:202
3231216993229,2cyclictest3268241-21kworker/u8:2+flush-259:020:10:222
3231210993229,2cyclictest3289078-21kworker/u8:4+flush-259:020:45:220
3231210993229,2cyclictest3289078-21kworker/u8:4+flush-259:020:45:000
3231210993227,4cyclictest3304811-21apt-get20:20:010
3231220993124,5cyclictest3336252-21latency_hist20:50:013
3231216993126,2cyclictest3278570-21kworker/u8:3+events_unbound20:55:172
3231214993128,2cyclictest3377993-21kworker/u8:0+flush-259:021:45:001
3231210993128,2cyclictest3476583-21kworker/u8:3+events_unbound23:08:160
3231220993027,2cyclictest3221187-21kworker/u8:1+flush-259:019:45:013
3231220993025,4cyclictest335557-21systemd-journal22:50:153
3231216993026,3cyclictest3289078-21kworker/u8:4+flush-259:020:25:232
3231214993026,3cyclictest3289078-21kworker/u8:4+flush-259:021:00:211
3231216992926,2cyclictest3289078-21kworker/u8:4+events_unbound20:20:252
3231216992926,2cyclictest3247192-21kworker/u8:0+flush-259:019:40:202
3231214992925,3cyclictest3326189-21apt-get20:40:121
3231210992926,2cyclictest3470539-21kworker/u8:2+events_unbound23:20:240
3231210992926,2cyclictest3377993-21kworker/u8:0+flush-259:021:45:180
3231210992926,2cyclictest3278570-21kworker/u8:3+events_unbound20:50:230
3231216992825,2cyclictest3393729-21kworker/u8:1+events_unbound23:10:212
3231216992825,2cyclictest3289078-21kworker/u8:4+events_unbound21:25:152
3231216992825,2cyclictest3278570-21kworker/u8:3+events_unbound20:05:132
3231216992824,3cyclictest3502470-21kworker/u8:0+events_unbound00:20:182
3231214992823,3cyclictest3377993-21kworker/u8:0+flush-259:021:35:211
3231214992821,5cyclictest3481717-21latency_hist23:10:001
3231210992825,2cyclictest3289078-21kworker/u8:4+events_unbound21:20:170
3231220992722,3cyclictest3236826-21base6419:15:003
3231220992721,4cyclictest3487097-21kworker/u8:4+flush-259:023:50:173
3231220992721,4cyclictest3304910-21cp20:20:013
3231216992724,2cyclictest3367648-21kworker/u8:2+flush-259:021:30:252
3231216992723,3cyclictest3527992-21kworker/u8:1+events_unbound00:20:002
3231216992722,4cyclictest335557-21systemd-journal00:10:002
3231210992724,2cyclictest3419325-21kworker/u8:3+events_unbound22:10:180
3231210992721,4cyclictest3548007-21ntpq00:10:210
3231216992623,2cyclictest3502470-21kworker/u8:0+events_unbound00:10:162
3231216992623,2cyclictest3289078-21kworker/u8:4+events_unbound21:16:172
3231216992621,2cyclictest3268241-21kworker/u8:2+events_unbound20:35:242
3231214992623,3cyclictest3289078-21kworker/u8:4+events_unbound20:29:171
3231214992620,4cyclictest3528214-21latency_hist23:55:011
3231214992620,4cyclictest3236930-21cat19:15:001
3231210992624,2cyclictest3487097-21kworker/u8:4+events_unbound23:50:240
3231210992623,3cyclictest3278570-21kworker/u8:3+events_unbound20:05:220
3231210992623,2cyclictest3393729-21kworker/u8:1+flush-259:023:10:190
3231210992618,2cyclictest3419325-21kworker/u8:3+events_unbound22:25:120
3231220992518,5cyclictest335557-21systemd-journal23:20:003
3231216992522,2cyclictest3476583-21kworker/u8:3+events_unbound23:06:432
3231216992522,2cyclictest3470539-21kworker/u8:2+events_unbound23:20:162
3231216992522,2cyclictest3377993-21kworker/u8:0+events_unbound22:30:182
3231214992522,2cyclictest3221187-21kworker/u8:1+flush-259:019:55:011
3231210992522,2cyclictest3445794-21kworker/u8:4+flush-259:022:35:180
3231210992522,2cyclictest3247762-21kworker/u8:2+events_unbound19:30:230
3231210992521,3cyclictest3221187-21kworker/u8:1+events_unbound20:01:160
323121099250,23cyclictest3575178-21unin-run00:40:000
3231216992422,1cyclictest3377993-21kworker/u8:0+flush-259:021:55:272
3231216992421,2cyclictest3502470-21kworker/u8:0+flush-259:023:36:202
3231216992421,2cyclictest3419325-21kworker/u8:3+flush-259:022:25:232
3231216992421,2cyclictest3419325-21kworker/u8:3+events_unbound22:20:252
3231216992421,2cyclictest3377993-21kworker/u8:0+events_unbound22:15:202
3231216992421,2cyclictest3172143-21kworker/u8:3+flush-259:019:20:262
3231214992421,2cyclictest3487097-21kworker/u8:4+flush-259:023:46:311
3231214992421,2cyclictest3289078-21kworker/u8:4+flush-259:021:20:241
3231214992420,3cyclictest3461071-21kworker/u8:0+events_unbound22:51:101
3231214992419,4cyclictest3516990-21ntpq23:40:191
3231210992421,2cyclictest3487097-21kworker/u8:4+events_unbound23:49:260
3231210992421,2cyclictest3419325-21kworker/u8:3+events_unbound22:20:280
3231210992421,2cyclictest3393729-21kworker/u8:1+flush-259:021:55:170
3231220992317,4cyclictest3570116-21gpgv00:35:013
3231220992316,5cyclictest335557-21systemd-journal22:59:163
3231216992321,2cyclictest3247762-21kworker/u8:2+events_unbound19:30:122
3231216992320,2cyclictest3470539-21kworker/u8:2+events_unbound23:55:122
3231216992320,2cyclictest3393729-21kworker/u8:1+events_unbound22:10:252
3231216992320,2cyclictest3393729-21kworker/u8:1+events_unbound21:52:162
3231216992320,2cyclictest335557-21systemd-journal21:50:002
3231216992320,2cyclictest3289078-21kworker/u8:4+events_unbound21:20:182
3231216992320,2cyclictest3268241-21kworker/u8:2+events_unbound20:34:172
3231216992319,3cyclictest3569420-21kworker/u8:0+flush-259:000:33:462
3231214992320,2cyclictest3470539-21kworker/u8:2+events_unbound23:55:141
3231214992319,3cyclictest3527992-21kworker/u8:1+flush-259:000:20:161
3231214992319,3cyclictest3377993-21kworker/u8:0+events_unbound22:00:201
3231214992318,4cyclictest3393729-21kworker/u8:1+events_unbound21:55:161
3231210992320,2cyclictest3461071-21kworker/u8:0+events_unbound22:51:420
3231210992320,2cyclictest3377993-21kworker/u8:0+flush-259:022:05:210
3231210992320,2cyclictest3367648-21kworker/u8:2+events_unbound21:30:230
3231210992318,4cyclictest3355993-21ntpq21:05:210
3231220992214,5cyclictest3403874-21latency_hist21:55:003
3231220992214,5cyclictest335557-21systemd-journal20:10:013
3231216992219,2cyclictest3461071-21kworker/u8:0+events_unbound22:51:162
3231216992219,2cyclictest3221187-21kworker/u8:1+events_unbound20:00:212
3231214992220,1cyclictest75-21kswapd022:41:031
3231214992220,1cyclictest3268241-21kworker/u8:2+events_unbound20:30:111
3231214992219,2cyclictest3419325-21kworker/u8:3+flush-259:022:15:181
3231214992219,2cyclictest3289078-21kworker/u8:4+events_unbound20:20:181
3231214992219,2cyclictest3278570-21kworker/u8:3+events_unbound21:17:161
3231214992218,3cyclictest3289078-21kworker/u8:4+events_unbound20:07:151
3231214992218,3cyclictest3247192-21kworker/u8:0+events_unbound19:25:151
3231210992219,2cyclictest3278570-21kworker/u8:3+flush-259:020:10:160
3231220992114,5cyclictest3252740-21latency_hist19:30:013
3231216992118,2cyclictest3487097-21kworker/u8:4+events_unbound23:25:142
3231216992118,2cyclictest3445794-21kworker/u8:4+events_unbound22:37:152
3231214992118,2cyclictest3289078-21kworker/u8:4+events_unbound21:25:131
3231214992117,3cyclictest3289078-21kworker/u8:4+flush-259:020:45:261
3231214992117,3cyclictest3221187-21kworker/u8:1+events_unbound19:42:161
3231214992115,4cyclictest3402953-21ntpq21:50:181
3231210992118,2cyclictest3502470-21kworker/u8:0+flush-259:000:15:160
3231210992118,2cyclictest3268241-21kworker/u8:2+flush-259:020:30:220
3231210992118,2cyclictest3268241-21kworker/u8:2+flush-259:019:50:230
3231210992117,3cyclictest3393729-21kworker/u8:1+events_unbound22:45:210
3231210992117,3cyclictest3247192-21kworker/u8:0+events_unbound19:35:120
3231220992016,2cyclictest3477250-21irqcore23:05:173
3231216992017,2cyclictest3393729-21kworker/u8:1+events_unbound22:00:112
3231216992017,2cyclictest3268241-21kworker/u8:2+events_unbound19:49:182
3231214992017,2cyclictest3487097-21kworker/u8:4+flush-259:023:29:201
3231214992017,2cyclictest3419325-21kworker/u8:3+events_unbound22:26:061
3231214992017,2cyclictest3221187-21kworker/u8:1+flush-259:019:55:201
3231214992016,3cyclictest3393729-21kworker/u8:1+flush-259:022:49:201
3231214992016,3cyclictest3367648-21kworker/u8:2+flush-259:021:30:161
3231214992015,4cyclictest3258188-21apt-get19:35:121
3231210992017,2cyclictest3278570-21kworker/u8:3+flush-259:021:25:310
3231210992016,3cyclictest3221187-21kworker/u8:1+events_unbound19:55:230
323121099201,17cyclictest3362054-21munin-run21:15:000
3231216991916,2cyclictest3502470-21kworker/u8:0+events_unbound23:45:272
3231216991916,2cyclictest3289078-21kworker/u8:4+events_unbound21:00:132
3231214991915,3cyclictest3419325-21kworker/u8:3+flush-259:022:13:201
3231214991915,3cyclictest3289078-21kworker/u8:4+flush-259:021:10:241
3231214991914,3cyclictest3231409-21/usr/sbin/munin19:10:141
3231210991916,2cyclictest3527992-21kworker/u8:1+flush-259:000:20:210
3231210991916,2cyclictest3470539-21kworker/u8:2+events_unbound23:55:180
3231210991916,2cyclictest3289078-21kworker/u8:4+flush-259:021:00:180
3231210991915,3cyclictest3377993-21kworker/u8:0+events_unbound21:37:170
323122099185,2cyclictest3377074-21ntpq21:25:213
3231220991813,3cyclictest3305467-21munin-node20:20:123
3231220991812,4cyclictest335557-21systemd-journal22:00:003
3231220991811,5cyclictest3549108-21/usr/sbin/munin00:15:153
3231216991815,2cyclictest3487097-21kworker/u8:4+events_unbound23:40:352
3231216991814,3cyclictest3527992-21kworker/u8:1+events_unbound23:54:262
3231214991815,2cyclictest3419325-21kworker/u8:3+events_unbound22:20:231
3231214991814,3cyclictest3221187-21kworker/u8:1+flush-259:020:00:231
3231214991813,4cyclictest3564658-21apt-get00:30:101
3231210991815,2cyclictest3502470-21kworker/u8:0+events_unbound23:35:130
3231210991815,2cyclictest3367648-21kworker/u8:2+events_unbound21:45:010
3231210991815,2cyclictest3289078-21kworker/u8:4+flush-259:020:55:160
3231210991814,3cyclictest3470539-21kworker/u8:2+events_unbound23:42:160
3231210991814,3cyclictest3377993-21kworker/u8:0+events_unbound22:15:250
3231210991813,3cyclictest3487097-21kworker/u8:4+flush-259:023:25:150
323122099179,5cyclictest3278551-21latency_hist19:55:013
3231220991714,2cyclictest3315602-21turbostat.cron20:29:593
3231220991712,4cyclictest335557-21systemd-journal22:19:153
3231220991712,3cyclictest3352389-21irqcore21:05:163
3231216991714,2cyclictest3445794-21kworker/u8:4+events_unbound22:45:192
3231216991713,3cyclictest3393729-21kworker/u8:1+events_unbound23:16:442
3231214991714,2cyclictest3554050-21kworker/u8:4+events_unbound00:38:271
3231214991714,2cyclictest3487097-21kworker/u8:4+events_unbound23:38:161
3231214991714,2cyclictest3440634-21kworker/u8:2+events_unbound22:33:161
3231214991714,2cyclictest3393729-21kworker/u8:1+events_unbound23:00:001
3231214991714,2cyclictest0-21swapper/120:39:591
3231214991713,3cyclictest507-21in:imuxsock00:15:001
3231214991713,3cyclictest3470539-21kworker/u8:2+events_unbound23:00:201
3231210991714,2cyclictest3268241-21kworker/u8:2+events_unbound20:35:250
3231210991713,3cyclictest3393729-21kworker/u8:1+events_unbound22:55:180
3231210991713,3cyclictest3278570-21kworker/u8:3+events_unbound20:26:170
3231210991713,3cyclictest2971-21cron00:10:000
323122099166,8cyclictest0-21swapper/322:30:013
323122099165,7cyclictest3362999-21hddtemp_smartct21:15:153
323122099164,3cyclictest3558285-21ntpq00:20:203
323122099163,9cyclictest3231409-21/usr/sbin/munin19:10:243
323122099163,8cyclictest3268427-21taskset19:45:023
323122099163,5cyclictest3522346-21sensors23:45:223
3231216991613,2cyclictest3461071-21kworker/u8:0+events_unbound22:55:212
3231214991613,2cyclictest3502470-21kworker/u8:0+events_unbound00:08:211
3231214991613,2cyclictest3278570-21kworker/u8:3+events_unbound20:55:191
3231214991613,2cyclictest3268241-21kworker/u8:2+flush-259:020:10:241
3231214991612,3cyclictest3527992-21kworker/u8:1+events_unbound00:02:261
3231214991612,3cyclictest3502470-21kworker/u8:0+events_unbound00:17:471
3231214991612,3cyclictest3377993-21kworker/u8:0+events_unbound22:09:161
3231214991612,3cyclictest3278570-21kworker/u8:3+events_unbound20:50:141
3231210991613,2cyclictest60350irq/132-enp0s29f1:rx-023:15:160
3231210991613,2cyclictest3559452-21kworker/u8:2+events_unbound00:27:340
3231210991613,2cyclictest3470539-21kworker/u8:2+events_unbound23:30:230
3231210991613,2cyclictest3470539-21kworker/u8:2+events_unbound23:30:230
3231210991612,3cyclictest3470539-21kworker/u8:2+events_unbound23:03:320
3231210991612,3cyclictest335557-21systemd-journal19:19:160
323122099159,4cyclictest3316266-21irqcore20:30:143
323122099157,6cyclictest3569106-21head00:30:243
323122099157,5cyclictest3486865-21latency_hist23:14:593
323122099155,8cyclictest3456116-21cat22:45:003
323122099155,7cyclictest3543832-21latency_hist00:10:013
323122099154,2cyclictest3446112-21fw_forwarded_lo22:35:143
323122099154,2cyclictest3258497-21hddtemp_smartct19:35:163
3231220991513,1cyclictest0-21swapper/320:35:163
3231220991512,2cyclictest500-21systemd-logind21:05:003
3231220991511,3cyclictest3507927-21cpuspeed_turbos23:35:123
3231214991512,2cyclictest3559452-21kworker/u8:2+flush-259:000:28:321
3231214991512,2cyclictest3483002-21kthreadcore23:10:181
3231214991511,3cyclictest509-21rs:main1
3231214991511,3cyclictest3253003-21apt-get19:30:101
3231214991511,3cyclictest3247192-21kworker/u8:0+flush-259:019:45:381
3231210991514,1cyclictest60350irq/132-enp0s29f1:rx-000:34:040
323122099149,3cyclictest3517027-21ntpq23:40:203
323122099149,3cyclictest3278570-21kworker/u8:3+flush-259:020:11:093
323122099149,3cyclictest3242717-21tr19:20:143
323122099148,4cyclictest3430390-21irqcore22:20:163
323122099148,4cyclictest3278910-21cpuspeed_turbos19:55:143
323122099147,5cyclictest3419293-21cron22:10:003
323122099147,5cyclictest3287879-21needreboot20:00:183
3231216991410,3cyclictest3502470-21kworker/u8:0+flush-259:023:34:202
3231216991410,3cyclictest3502470-21kworker/u8:0+flush-259:023:34:202
3231214991411,2cyclictest3377993-21kworker/u8:0+events_unbound21:45:141
3231210991413,1cyclictest60350irq/132-enp0s29f1:rx-021:15:260
3231210991410,3cyclictest3527992-21kworker/u8:1+events_unbound00:02:580
323122099139,2cyclictest3383153-21cron21:35:003
323122099138,3cyclictest3440744-21tr22:30:123
323122099137,5cyclictest3414174-21turbostat.cron22:05:003
323122099137,4cyclictest3331089-21turbostat.cron20:44:593
323122099136,5cyclictest3529271-21irqcore23:55:163
323122099136,5cyclictest3506588-21/usr/sbin/munin23:30:183
323122099136,5cyclictest3506588-21/usr/sbin/munin23:30:183
323122099136,5cyclictest3424502-21cron22:15:003
323122099136,5cyclictest335557-21systemd-journal22:50:003
323121499139,3cyclictest3335898-21kworker/u8:1+events_unbound21:05:501
3231214991310,3cyclictest3445794-21kworker/u8:4+events_unbound22:35:131
3231214991210,1cyclictest0-21swapper/123:20:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional