You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-28 - 04:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun Jun 28, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
362035321760,2sleep1281rcuc/120:55:211
36768862890,5chrt0-21swapper/321:50:253
3511883997165,4cyclictest3777219-21kworker/u8:1+events_unbound23:50:351
3511883996961,6cyclictest3491366-21kworker/u8:0+flush-8:019:15:031
3511883996357,4cyclictest3752517-21kworker/u8:3+events_unbound23:15:331
3511883995955,3cyclictest3568473-21kworker/u8:1+events_unbound20:40:011
3511883995952,5cyclictest3653408-21kworker/u8:2+events_unbound23:40:281
3511883995850,6cyclictest3506812-21kworker/u8:1+events_unbound19:40:281
37459492570,1sleep03745955-21kthreadcore23:00:250
3511883995752,4cyclictest3568473-21kworker/u8:1+events_unbound20:25:271
3511883995750,5cyclictest3653408-21kworker/u8:2+events_unbound22:50:291
3511880995738,16cyclictest3627507-21ntpq21:00:260
35326222560,2chrt0-21swapper/019:25:260
3511883995648,6cyclictest3653408-21kworker/u8:2+flush-8:022:35:271
3511880995623,21cyclictest0-21swapper/019:42:250
3511885995443,9cyclictest3707039-21ntpq22:20:282
3511883995449,4cyclictest3653408-21kworker/u8:2+events_unbound00:30:301
3511883995449,4cyclictest3653408-21kworker/u8:2+events_unbound00:30:301
3511883995449,4cyclictest3577545-21kworker/u8:0+flush-8:020:20:261
3511883995343,7cyclictest1704890-21systemd-journal20:35:011
3511880995346,5cyclictest3653408-21kworker/u8:2+flush-8:023:45:310
3511883995147,3cyclictest3766627-21kworker/u8:0+flush-8:000:15:281
3511883995145,4cyclictest3752517-21kworker/u8:3+flush-8:023:20:281
3511883995045,4cyclictest3597890-21kworker/u8:3+events_unbound21:55:291
3511883995044,5cyclictest3766627-21kworker/u8:0+flush-8:000:20:301
3511883994944,3cyclictest3506812-21kworker/u8:1+events_unbound19:10:301
3511883994943,5cyclictest3603699-21kworker/u8:0+flush-8:021:35:251
3511883994943,4cyclictest3528687-21kworker/u8:3+flush-8:020:00:231
3511885994819,15cyclictest3554163-21fschecks_count19:50:182
3511883994844,3cyclictest3648240-21kworker/u8:1+flush-8:021:25:301
3511883994843,4cyclictest3668069-21kworker/u8:1+flush-8:021:45:301
3511883994843,4cyclictest3528687-21kworker/u8:3+flush-8:019:45:291
3511883994843,3cyclictest3826151-21kworker/u8:3+flush-8:000:35:351
3511883994843,3cyclictest3826151-21kworker/u8:3+flush-8:000:35:341
3511883994841,5cyclictest3597890-21kworker/u8:3+events_unbound21:05:291
3511883994741,4cyclictest3777219-21kworker/u8:1+flush-8:023:45:171
3511883994741,4cyclictest3766627-21kworker/u8:0+flush-8:000:00:271
3511883994741,4cyclictest3506812-21kworker/u8:1+flush-8:019:25:181
3511880994736,9cyclictest3682919-21apt-get22:00:010
3511883994642,3cyclictest3597890-21kworker/u8:3+flush-8:021:20:351
3511883994642,3cyclictest3577545-21kworker/u8:0+events_unbound20:15:011
3511883994642,3cyclictest3568473-21kworker/u8:1+events_unbound20:45:321
3511883994641,4cyclictest3653408-21kworker/u8:2+flush-8:000:10:301
3511883994641,4cyclictest3653408-21kworker/u8:2+events_unbound22:15:291
3511883994640,5cyclictest3623722-21kworker/u8:2+flush-8:021:10:211
3511883994640,4cyclictest3459664-21kworker/u8:2+events_unbound19:30:291
3511883994541,3cyclictest3732691-21kworker/u8:1+events_unbound22:55:321
3511883994539,5cyclictest3623722-21kworker/u8:2+flush-8:021:15:271
3511883994539,4cyclictest3653408-21kworker/u8:2+events_unbound22:00:301
3511883994539,4cyclictest3597890-21kworker/u8:3+flush-8:022:05:291
3511880994540,4cyclictest3826151-21kworker/u8:3+events_unbound00:25:320
3511880994537,5cyclictest1704890-21systemd-journal19:45:250
3511880994535,7cyclictest3797070-21true23:55:000
3511880994518,16cyclictest3757445-21cron23:15:010
3511883994440,3cyclictest3698203-21kworker/u8:0+events_unbound22:45:331
3511883994440,3cyclictest3568473-21kworker/u8:1+events_unbound20:40:281
3511883994438,4cyclictest3653408-21kworker/u8:2+events_unbound23:55:281
3511880994426,16cyclictest3519299-21fschecks_time19:15:210
351188099442,20cyclictest0-21swapper/020:00:290
351188099441,32cyclictest3523950-21/usr/sbin/munin19:20:140
351188099441,29cyclictest589-21runrttasks20:30:150
3511883994338,3cyclictest3766627-21kworker/u8:0+flush-8:023:30:341
3511883994335,6cyclictest3528687-21kworker/u8:3+events_unbound19:50:291
3511880994326,15cyclictest3666347-21kthreadcore21:40:250
3511880994235,5cyclictest3653408-21kworker/u8:2+events_unbound22:00:280
3511880994219,18cyclictest0-21swapper/019:30:030
3511885994136,4cyclictest3653408-21kworker/u8:2+flush-8:021:50:292
3511880994123,15cyclictest1704890-21systemd-journal21:45:240
3511885994024,14cyclictest3693362-21aten2_r5power_e22:10:162
351188099403,23cyclictest0-21swapper/023:59:460
3511883993936,2cyclictest3578609-21apt-get20:15:131
3511883993935,3cyclictest3698203-21kworker/u8:0+events_unbound22:25:271
3511883993935,3cyclictest3698203-21kworker/u8:0+events_unbound22:25:261
3511883993932,6cyclictest3732691-21kworker/u8:1+events_unbound23:05:291
3511880993931,6cyclictest3712401-21grep22:25:340
3511880993931,6cyclictest3712401-21grep22:25:340
351188099392,24cyclictest0-21swapper/022:55:180
351188099392,23cyclictest0-21swapper/023:30:580
3511880993918,18cyclictest3608184-21latency_hist20:45:000
351188099391,21cyclictest589-21runrttasks20:15:140
351188099390,38cyclictest3717721-21sshd22:34:240
3511883993834,3cyclictest3653408-21kworker/u8:2+flush-8:023:35:161
3511883993832,4cyclictest3807475-21apt-get00:05:141
3511883993832,4cyclictest3597890-21kworker/u8:3+events_unbound21:00:291
351188099387,23cyclictest589-21runrttasks19:51:460
351188099382,28cyclictest583-21snmpd00:35:160
351188099382,28cyclictest583-21snmpd00:35:150
351188099382,23cyclictest0-21swapper/020:08:420
3511880993819,17cyclictest0-21swapper/021:54:590
3511880993811,18cyclictest0-21swapper/019:10:300
3511885993722,13cyclictest3588601-21aten2_r5power_c20:25:162
3511885993721,14cyclictest3752984-21cpuspeed_turbos23:10:162
3511883993733,3cyclictest3766627-21kworker/u8:0+flush-8:023:25:321
3511883993733,3cyclictest3653408-21kworker/u8:2+flush-8:022:20:321
3511883993733,3cyclictest3653408-21kworker/u8:2+events_unbound22:40:181
3511883993732,4cyclictest3506812-21kworker/u8:1+events_unbound19:40:001
3511883993731,5cyclictest3653408-21kworker/u8:2+events_unbound21:40:281
3511883993726,4cyclictest3506812-21kworker/u8:1+events_unbound19:20:291
351188099379,20cyclictest589-21runrttasks23:07:050
351188099379,20cyclictest589-21runrttasks22:51:040
351188099377,22cyclictest589-21runrttasks23:24:120
351188099376,24cyclictest589-21runrttasks21:28:300
3511880993728,7cyclictest3559080-21diskstats19:55:170
3511880993728,7cyclictest3559080-21diskstats19:55:160
351188099372,27cyclictest0-21swapper/022:05:130
351188099372,24cyclictest0-21swapper/021:10:030
351188099372,22cyclictest0-21swapper/000:20:100
351188099372,22cyclictest0-21swapper/000:02:390
351188099372,21cyclictest0-21swapper/020:26:210
3511880993718,17cyclictest1704890-21systemd-journal20:52:380
3511880993711,20cyclictest0-21swapper/023:15:150
3511885993628,5cyclictest3802004-40logrotate00:00:002
3511885993622,12cyclictest3657757-21unixbench_singl21:30:372
3511883993631,4cyclictest3653408-21kworker/u8:2+events_unbound21:30:161
3511883993630,4cyclictest3693304-21apt-get22:10:151
351188099362,24cyclictest0-21swapper/019:37:560
351188099362,23cyclictest0-21swapper/023:40:120
351188099362,23cyclictest0-21swapper/022:43:380
3511880993620,14cyclictest3822150-21latency_hist00:20:000
3511880993618,15cyclictest0-21swapper/000:10:310
3511880993614,19cyclictest0-21swapper/020:35:290
3511880993613,21cyclictest0-21swapper/020:45:160
351188099360,18cyclictest589-21runrttasks20:13:490
3511883993531,3cyclictest3698203-21kworker/u8:0+events_unbound22:30:321
3511883993525,7cyclictest1704890-21systemd-journal23:11:241
351188099357,20cyclictest589-21runrttasks23:36:040
351188099353,23cyclictest0-21swapper/020:58:510
351188099352,24cyclictest0-21swapper/022:35:550
351188099352,24cyclictest0-21swapper/022:17:140
351188099352,23cyclictest0-21swapper/021:37:290
351188099352,22cyclictest0-21swapper/021:31:460
351188099352,22cyclictest0-21swapper/021:23:160
351188099352,22cyclictest0-21swapper/020:23:270
3511880993520,12cyclictest0-21swapper/000:35:000
3511880993520,12cyclictest0-21swapper/000:34:590
351188099351,23cyclictest589-21runrttasks21:16:240
351188099350,23cyclictest589-21runrttasks22:12:120
351188599342,14cyclictest36167762cut20:50:242
3511885993420,11cyclictest1704890-21systemd-journal20:10:012
3511885993417,15cyclictest3578354-21munin-run20:15:002
3511885993417,15cyclictest3528661-21idleruntime-cro19:25:002
3511883993429,4cyclictest3653408-21kworker/u8:2+flush-8:000:25:211
351188099342,22cyclictest0-21swapper/022:45:590
3511880993414,17cyclictest0-21swapper/023:25:260
351188099341,20cyclictest589-21runrttasks22:24:270
351188099340,20cyclictest589-21runrttasks00:06:050
351188599333,24cyclictest3807475-21apt-get00:05:152
351188599333,23cyclictest3822341-21apt-get00:20:152
351188599332,25cyclictest3767633-21apt-get23:25:152
351188599332,24cyclictest3558831-21apt-get19:55:142
351188599332,24cyclictest3558831-21apt-get19:55:132
351188599331,25cyclictest3528931-21apt-get19:25:152
3511883993326,6cyclictest3528687-21kworker/u8:3+events_unbound20:05:241
351188099330,20cyclictest589-21runrttasks21:08:150
35116392333,9sleep10-21swapper/119:09:301
3511885993221,9cyclictest3653408-21kworker/u8:2+flush-8:023:00:312
351188599321,26cyclictest3683437-21apt-get22:00:152
351188599321,25cyclictest3618537-21apt-get20:55:132
351188599321,24cyclictest3723045-21apt-get22:40:142
3511885993210,19cyclictest3717789-21awk22:35:002
3511883993228,3cyclictest3653408-21kworker/u8:2+events_unbound23:00:201
351188599319,19cyclictest3662161-21sshd21:35:252
351188599313,21cyclictest3737873-21apt-get22:55:162
3511885993122,7cyclictest3777242-21turbostat.cron23:34:592
351188599312,26cyclictest0-21swapper/219:15:022
351188599312,25cyclictest3582351-21ntpq20:15:252
351188599312,22cyclictest3832210-21apt-get00:30:162
351188599312,22cyclictest3832210-21apt-get00:30:152
351188599312,22cyclictest3718043-21apt-get22:35:122
351188599311,9cyclictest3567751-21/usr/sbin/munin20:00:322
3511885993113,15cyclictest0-21swapper/223:15:172
351188599311,26cyclictest3791240-21ntpq23:45:272
3511883993125,4cyclictest3653408-21kworker/u8:2+flush-8:021:50:151
3511885993016,12cyclictest3663437-21aten2_r5power_e21:40:162
3511883993026,3cyclictest3548382-21kworker/u8:0+events_unbound19:55:221
3511883993026,3cyclictest3548382-21kworker/u8:0+events_unbound19:55:211
3511883993026,2cyclictest0-21swapper/120:55:011
351188599292,21cyclictest3817388-21apt-get00:15:182
351188599291,8cyclictest3598865-21/usr/sbin/munin20:35:202
351188599291,5cyclictest3552768-21ntpq19:45:292
351188599282,20cyclictest3747806-21apt-get23:05:162
351188599281,8cyclictest3786466-21/usr/sbin/munin23:40:322
3511885992816,10cyclictest0-21swapper/221:25:242
3511885992812,14cyclictest0-21swapper/223:25:002
351188599273,18cyclictest3708153-21apt-get22:25:152
351188599273,18cyclictest3708153-21apt-get22:25:142
3511885992723,2cyclictest3544073-21aten2_r5power_p19:40:162
351188599271,9cyclictest3840918-21ntpq00:35:302
351188599271,9cyclictest3840918-21ntpq00:35:302
351188599271,9cyclictest3642331-21ntpq21:15:272
351188599271,9cyclictest3612132-21/usr/sbin/munin20:45:252
351188599271,8cyclictest3831325-21/usr/sbin/munin00:25:352
351188599271,8cyclictest3637370-21/usr/sbin/munin21:10:282
351188599271,8cyclictest3593788-21/usr/sbin/munin20:30:172
3511885992716,9cyclictest3673055-21cat21:50:012
3511885992714,11cyclictest0-21swapper/223:35:242
3511885992713,12cyclictest0-21swapper/219:35:232
3511885992712,13cyclictest0-21swapper/219:15:002
351188599271,10cyclictest3538108-21/usr/sbin/munin19:30:332
351188599270,8cyclictest3698244-21/usr/sbin/munin22:15:152
351188099271,22cyclictest3511698-21latency_hist19:10:000
351188599262,20cyclictest3816199-21ntpq00:10:282
351188599261,9cyclictest3643810-21/usr/sbin/munin21:20:192
351188599261,21cyclictest3682023-21ntpq21:55:282
3511885992611,12cyclictest0-21swapper/221:00:152
351188599260,8cyclictest3802768-21/usr/sbin/munin00:00:202
351188599260,8cyclictest3728353-21/usr/sbin/munin22:45:192
351188599260,8cyclictest3688588-21/usr/sbin/munin22:05:182
351188599260,8cyclictest3628819-21/usr/sbin/munin21:05:162
351188599258,13cyclictest0-21swapper/220:40:182
351188599251,7cyclictest3733129-21/usr/sbin/munin22:50:172
3511885992512,11cyclictest0-21swapper/223:50:202
351188599240,10cyclictest3588298-21cron20:25:012
36179862230,2sleep3471rcuc/320:51:253
36187672210,5sleep30-21swapper/320:55:153
351188599200,6cyclictest3511978-21date19:10:012
35109922204,9sleep30-21swapper/319:05:353
35344082155,6sleep30-21swapper/319:30:193
37425502142,8sleep30-21swapper/323:00:013
37180442142,8sleep30-21swapper/322:35:133
37116552140,2sleep375-21kworker/3:1-events22:25:243
37116552140,2sleep375-21kworker/3:1-events22:25:233
36936192140,3sleep3481ktimers/322:10:183
35277282142,8sleep30-21swapper/319:20:293
36930252132,7sleep30-21swapper/322:10:003
36829162130,7sleep30-21swapper/322:00:003
35390352132,7sleep30-21swapper/319:35:133
38380272122,6sleep30-21swapper/300:35:243
38380272122,6sleep30-21swapper/300:35:233
38327042122,6sleep30-21swapper/300:30:223
38327042122,6sleep30-21swapper/300:30:213
38269742122,6sleep30-21swapper/300:25:003
38133352123,6sleep30-21swapper/300:10:243
38113252122,6sleep30-21swapper/300:05:293
38027032122,6sleep30-21swapper/300:00:213
38018942122,6sleep30-21swapper/323:59:003
37921162122,5sleep30-21swapper/323:50:003
37822912122,6sleep30-21swapper/323:40:023
37775082122,6sleep30-21swapper/323:35:153
37725262122,5sleep30-21swapper/323:30:023
37716402122,6sleep30-21swapper/323:25:333
37544582122,6sleep30-21swapper/323:10:243
37518732121,7sleep30-21swapper/323:05:353
37329692122,6sleep30-21swapper/322:50:183
37318902122,6sleep30-21swapper/322:45:323
37232922122,6sleep30-21swapper/322:40:173
36991212122,6sleep30-21swapper/322:15:213
36633532122,6sleep30-21swapper/321:40:143
36629592122,6sleep30-21swapper/321:38:263
36536382122,6sleep30-21swapper/321:30:193
36482362122,5sleep30-21swapper/321:25:023
36345792122,6sleep30-21swapper/321:10:253
36333762122,6sleep30-21swapper/321:10:003
36088222122,6sleep30-21swapper/320:45:203
36048382122,6sleep30-21swapper/320:40:233
35784742122,5sleep30-21swapper/320:15:023
35687452122,6sleep30-21swapper/320:05:153
35639052122,6sleep30-21swapper/320:00:173
35589012122,6sleep30-21swapper/319:55:163
35589012122,6sleep30-21swapper/319:55:153
35577352122,6sleep30-21swapper/319:50:313
35481932122,6sleep30-21swapper/319:40:353
35137522122,6sleep30-21swapper/319:10:253
38272582112,6sleep30-21swapper/300:25:173
38171462112,5sleep30-21swapper/300:15:013
37874642112,6sleep30-21swapper/323:45:163
37627012112,5sleep30-21swapper/323:20:153
37574712112,4sleep30-21swapper/323:15:013
37467432112,5sleep30-21swapper/323:00:323
37176932112,5sleep30-21swapper/322:34:043
37037442112,5sleep30-21swapper/322:20:203
36838772112,5sleep30-21swapper/322:00:213
36686892112,5sleep30-21swapper/321:45:203
36435492112,5sleep30-21swapper/321:20:153
36389022112,6sleep30-21swapper/321:15:183
36238532112,5sleep30-21swapper/321:00:173
35989192112,5sleep30-21swapper/320:35:213
35935312112,5sleep30-21swapper/320:30:153
35883222112,5sleep30-21swapper/320:25:023
35840132112,6sleep30-21swapper/320:20:203
35736802112,5sleep30-21swapper/320:10:173
35493032112,5sleep30-21swapper/319:45:203
35288892112,5sleep30-21swapper/319:25:023
35189542112,5sleep30-21swapper/319:15:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional