You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 05:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Mon May 18, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
376676421910,3sleep375-21kworker/3:1+mm_percpu_wq20:50:533
3664831996150,8cyclictest3731077-21apt-get20:15:000
3664834995651,3cyclictest3690503-21kworker/u8:1+flush-8:020:51:081
37187142520,3chrt3718712-21ps20:00:570
3664831995247,3cyclictest3690503-21kworker/u8:1+events_unbound22:55:530
3664831995241,8cyclictest3785069-21ntpq21:06:030
3664834995146,4cyclictest3890423-21kworker/u8:0+flush-8:023:30:521
3664834995044,4cyclictest3756583-21kworker/u8:0+flush-8:022:00:531
39551392490,3sleep375-21kworker/3:1+events00:00:503
37040312490,2sleep1281rcuc/119:45:571
3664834994944,4cyclictest3839989-21kworker/u8:3+flush-8:022:21:071
3664834994944,4cyclictest3690503-21kworker/u8:1+flush-8:019:35:521
3664831994941,6cyclictest3988509-21ntpq00:31:000
3664834994843,4cyclictest3701594-21kworker/u8:3+flush-8:020:16:051
3664834994843,4cyclictest3664697-21kworker/u8:0+flush-8:019:21:091
3664834994736,8cyclictest280-21systemd-journal22:31:341
3664831994736,9cyclictest3675657-21ntpq19:16:000
3664834994641,4cyclictest3839989-21kworker/u8:3+flush-8:022:15:531
3664834994640,4cyclictest3622989-21kworker/u8:2+flush-8:019:11:031
3664834994638,6cyclictest280-21systemd-journal21:31:351
38669432450,5sleep3481ktimers/322:30:573
3664837994537,6cyclictest3810942-21apt-get21:35:482
3664834994541,3cyclictest3776316-21kworker/u8:2+flush-8:023:01:041
3664834994540,4cyclictest3690503-21kworker/u8:1+flush-8:020:35:521
3664834994540,4cyclictest3690503-21kworker/u8:1+events_unbound22:36:041
3664834994536,6cyclictest3664659-21latency_hist19:10:011
3664834994440,3cyclictest3776316-21kworker/u8:2+events_unbound23:05:531
3664834994440,3cyclictest3776316-21kworker/u8:2+events_unbound23:05:531
3664834994439,3cyclictest3954944-21kworker/u8:4+events_unbound00:11:041
3664834994438,4cyclictest3954944-21kworker/u8:4+events_unbound00:00:531
3664834994436,6cyclictest3690503-21kworker/u8:1+flush-8:022:56:021
3664834994430,11cyclictest280-21systemd-journal21:11:351
3664831994437,5cyclictest3690503-21kworker/u8:1+flush-8:023:15:540
3664834994338,3cyclictest3794912-21ntpq21:16:021
3664834994337,4cyclictest3741558-21apt-get20:25:501
3664834994336,5cyclictest3756583-21kworker/u8:0+flush-8:021:21:071
3664834994237,3cyclictest3690503-21kworker/u8:1+events_unbound23:15:591
3664834994236,3cyclictest3924730-21kworker/u8:3+flush-8:023:35:491
3664834994236,3cyclictest3756583-21kworker/u8:0+flush-8:021:50:571
3664834994235,5cyclictest3924730-21kworker/u8:3+flush-8:023:56:041
3664831994234,6cyclictest280-21systemd-journal19:55:350
3664837994135,4cyclictest3870172-21apt-get22:34:592
3664837994123,16cyclictest3725735-21unixbench_multi20:06:072
3664837994119,7cyclictest280-21systemd-journal22:40:352
3664834994135,5cyclictest3701594-21kworker/u8:3+flush-8:019:51:031
3664834994135,4cyclictest3890423-21kworker/u8:0+flush-8:000:16:061
3664834994135,4cyclictest3622989-21kworker/u8:2+flush-8:019:31:051
3664831994131,8cyclictest3806238-21diskstats21:30:510
3664837994025,13cyclictest3905617-21aten2_r5power_p23:10:512
3664834994034,4cyclictest3776316-21kworker/u8:2+events_unbound21:06:021
3664834994034,4cyclictest3690503-21kworker/u8:1+flush-8:020:40:541
3664837993933,4cyclictest3756583-21kworker/u8:0+flush-8:021:45:532
3664834993935,3cyclictest3776316-21kworker/u8:2+flush-8:021:41:051
3664834993932,5cyclictest3690503-21kworker/u8:1+flush-8:023:41:061
3664831993929,7cyclictest3800748-21latency_hist21:25:010
3664834993833,3cyclictest3711578-21apt-get19:55:491
3664834993831,4cyclictest3701594-21kworker/u8:3+flush-8:020:56:081
3664831993830,6cyclictest3854438-21ntpq22:16:020
3664834993732,4cyclictest3690503-21kworker/u8:1+flush-8:022:51:061
3664834993731,4cyclictest3954733-21kworker/u8:2+events_unbound00:30:531
3664834993730,4cyclictest3989685-21apt-get00:35:491
3664834993730,4cyclictest3690503-21kworker/u8:1+events_unbound21:26:031
3664831993727,8cyclictest3958829-21ntpq00:01:000
3664831993726,8cyclictest3885228-21latency_hist22:50:010
3664837993620,2cyclictest3886063-21fschecks_count22:50:532
3664834993630,4cyclictest3756583-21kworker/u8:0+flush-8:021:36:061
3664831993631,4cyclictest3690503-21kworker/u8:1+flush-8:022:30:530
3664831993630,4cyclictest3701662-21apt-get19:45:480
3664831993629,5cyclictest3687016-21diskstats19:30:520
3664831993628,5cyclictest3681499-21latency_hist19:25:010
37018212350,2sleep20-21swapper/219:45:512
3664837993521,2cyclictest3910689-21cpuspeed_turbos23:15:512
3664834993529,4cyclictest3884825-21grep22:46:071
3664834993526,7cyclictest3864416-21ntpq22:26:041
3664834993526,6cyclictest3690503-21kworker/u8:1+flush-8:019:41:031
3664831993530,4cyclictest3839989-21kworker/u8:3+flush-8:022:06:060
3664837993424,7cyclictest280-21systemd-journal19:45:012
3664837993418,2cyclictest3890736-21aten2_r5power_c22:55:502
3664834993428,4cyclictest3756583-21kworker/u8:0+flush-8:021:46:011
3664834993428,4cyclictest3701594-21kworker/u8:3+events_unbound20:05:501
3664831993430,3cyclictest3756583-21kworker/u8:0+events_unbound20:41:070
36600452334,9sleep20-21swapper/219:05:342
3664837993223,7cyclictest3751121-21apt-get20:35:002
3664834993228,3cyclictest3756583-21kworker/u8:0+flush-8:020:45:531
3664834993226,5cyclictest3664697-21kworker/u8:0+flush-8:019:16:021
3664834993222,7cyclictest3850177-21latency_hist22:15:001
3664831993227,4cyclictest3839989-21kworker/u8:3+flush-8:022:11:040
3664831993227,4cyclictest3776316-21kworker/u8:2+flush-8:023:26:050
3664831993227,4cyclictest3776316-21kworker/u8:2+flush-8:021:35:530
3664831993224,6cyclictest3690503-21kworker/u8:1+flush-8:021:11:050
3664837993114,3cyclictest0-21swapper/219:24:592
3664834993125,4cyclictest3690503-21kworker/u8:1+flush-8:020:01:081
3664834993125,4cyclictest3690503-21kworker/u8:1+events_unbound22:41:031
3664831993126,4cyclictest3607413-21kworker/u8:3+flush-8:019:10:530
3664831993121,7cyclictest3726142-21latency_hist20:10:010
3664834993025,3cyclictest3944817-21latency_hist23:49:591
3664834993025,3cyclictest3920044-21cron23:25:011
3664834993024,4cyclictest3839989-21kworker/u8:3+events_unbound22:05:481
3664831993025,4cyclictest3701594-21kworker/u8:3+flush-8:020:31:050
3664831993025,4cyclictest3690503-21kworker/u8:1+flush-8:023:20:530
3664831993024,4cyclictest3924730-21kworker/u8:3+flush-8:023:45:520
3664831993023,5cyclictest3934017-21ntpq23:36:000
3664831993020,7cyclictest3771109-21latency_hist20:55:010
3664834992925,3cyclictest3776316-21kworker/u8:2+flush-8:023:11:031
3664834992922,5cyclictest3756583-21kworker/u8:0+flush-8:021:56:031
3664834992922,5cyclictest3701594-21kworker/u8:3+flush-8:020:31:011
3664831992925,3cyclictest3690503-21kworker/u8:1+flush-8:022:27:270
3664831992924,4cyclictest3924730-21kworker/u8:3+flush-8:023:56:060
3664831992924,4cyclictest3690503-21kworker/u8:1+flush-8:022:36:060
3664831992923,4cyclictest3890423-21kworker/u8:0+flush-8:000:35:540
3664834992824,3cyclictest3954944-21kworker/u8:4+flush-8:000:06:031
3664834992823,4cyclictest3924730-21kworker/u8:3+flush-8:023:29:051
3664834992823,3cyclictest3954733-21kworker/u8:2+flush-8:000:20:571
3664834992822,3cyclictest0-21swapper/119:25:541
3664834992822,3cyclictest0-21swapper/119:25:541
3664831992824,3cyclictest3701594-21kworker/u8:3+events_unbound20:26:010
3664831992823,4cyclictest3756583-21kworker/u8:0+flush-8:021:55:540
3664837992723,3cyclictest3890423-21kworker/u8:0+flush-8:000:00:572
3664837992718,7cyclictest280-21systemd-journal23:40:002
3664837992718,6cyclictest280-21systemd-journal23:50:352
3664834992721,4cyclictest3701594-21kworker/u8:3+events_unbound20:20:511
3664831992724,2cyclictest3755371-21needreboot20:36:010
3664831992723,3cyclictest3839343-21needreboot22:01:000
3664831992723,3cyclictest3780657-21unixbench_singl21:01:070
3664831992722,4cyclictest3765836-21unixbench_singl20:46:090
3664831992722,4cyclictest3690503-21kworker/u8:1+flush-8:021:16:050
3664831992720,6cyclictest3690503-21kworker/u8:1+flush-8:019:36:020
3664837992621,3cyclictest3950143-21aten2_r5power_p23:55:512
3664834992622,3cyclictest3701594-21kworker/u8:3+flush-8:020:10:061
3664834992621,3cyclictest3954733-21kworker/u8:2+flush-8:000:25:551
3664834992617,7cyclictest3690503-21kworker/u8:1+flush-8:023:51:051
3664834992613,9cyclictest280-21systemd-journal21:04:341
3664831992620,4cyclictest3776316-21kworker/u8:2+flush-8:023:06:040
3664831992620,4cyclictest3776316-21kworker/u8:2+flush-8:023:06:040
3664831992617,6cyclictest3974833-21/usr/sbin/munin00:21:010
366483199260,12cyclictest37340062grep20:15:560
3664837992521,2cyclictest3846452-21kthreadcore22:10:562
3664831992520,4cyclictest3690503-21kworker/u8:1+flush-8:023:50:550
3664831992520,4cyclictest3690503-21kworker/u8:1+flush-8:019:40:530
3664831992520,3cyclictest0-21swapper/000:30:010
3664831992518,5cyclictest280-21systemd-journal23:02:300
3664837992420,3cyclictest3965164-21cpuspeed_turbos00:10:512
3664837992420,2cyclictest3736733-21aten2_r5power_v20:20:512
3664837992420,2cyclictest3691068-21grep19:31:072
3664837992415,6cyclictest280-21systemd-journal19:40:012
3664831992420,3cyclictest3690503-21kworker/u8:1+flush-8:022:51:050
3664831992420,2cyclictest3910179-21systemd-run23:14:590
3664831992417,5cyclictest280-21systemd-journal22:25:000
3664831992416,5cyclictest280-21systemd-journal23:30:350
3664837992319,2cyclictest3924640-21unixbench_singl23:26:102
3664837992319,2cyclictest3900710-21aten2_r5power_v23:05:522
3664837992319,2cyclictest3900710-21aten2_r5power_v23:05:522
3664837992319,2cyclictest3735889-21unixbench_singl20:16:072
3664837992318,3cyclictest3816099-21cpuspeed_turbos21:40:522
3664837992315,6cyclictest3929967-21cron23:35:002
3664837992311,8cyclictest3711578-21apt-get19:55:492
366483799230,8cyclictest38013352grep21:25:532
3664831992319,3cyclictest3690503-21kworker/u8:1+flush-8:022:41:020
3664831992314,6cyclictest3820506-21latency_hist21:45:010
3664837992218,2cyclictest3870935-21cpuspeed_turbos22:35:522
3664837992218,2cyclictest3716619-21aten2_r5power_p20:00:502
3664837992216,4cyclictest3895879-21cpuspeed_turbos23:00:502
366483199229,11cyclictest3771732-21fschecks_time20:55:530
3664831992219,2cyclictest3741241-21cron20:25:000
3664831992219,2cyclictest0-21swapper/019:26:100
3664831992219,2cyclictest0-21swapper/019:26:090
3664831992217,4cyclictest3707414-21irqrtprio19:50:570
366483199220,5cyclictest3821104-21fschecks_count21:45:530
36645772222,3sleep00-21swapper/019:09:100
39041002210,3chrt75-21kworker/3:1-events23:06:003
39041002210,3chrt75-21kworker/3:1-events23:05:593
3664837992118,2cyclictest3989950-21fschecks_count00:35:532
3664837992117,2cyclictest3880658-21aten2_r5power_c22:45:502
3664837992117,2cyclictest3840705-21aten2_r5power_v22:05:502
3664837992116,4cyclictest20977-21cron19:15:002
3664837992116,3cyclictest3785549-21unixbench_multi21:06:102
3664837992115,5cyclictest0-21swapper/200:06:082
3664837992113,6cyclictest280-21systemd-journal19:30:002
3664837992113,6cyclictest280-21systemd-journal19:30:002
3664831992119,1cyclictest0-21swapper/021:51:090
3664831992117,3cyclictest0-21swapper/000:10:000
3664831992116,4cyclictest3756583-21kworker/u8:0+flush-8:021:25:540
3664831992113,6cyclictest3973818-21ps00:16:060
366483799209,4cyclictest0-21swapper/222:16:072
3664837992017,2cyclictest3790546-21unixbench_singl21:11:092
3664837992015,3cyclictest3795454-21unixbench_singl21:16:092
3664837992015,3cyclictest3676184-21unixbench_singl19:16:082
3664837992013,5cyclictest280-21systemd-journal20:50:002
3664837992011,7cyclictest3760943-21head20:41:092
3664831992017,2cyclictest0-21swapper/023:41:060
366483799192,12cyclictest3938999-21ntpq23:41:022
3664837991916,2cyclictest3975174-21fschecks_time00:20:522
3664831991915,2cyclictest0-21swapper/000:10:570
38405952188,6sleep30-21swapper/322:05:503
3664837991814,3cyclictest0-21swapper/220:15:012
3664837991814,2cyclictest0-21swapper/223:20:552
3664837991814,2cyclictest0-21swapper/221:25:012
3664837991814,2cyclictest0-21swapper/220:26:112
3664837991813,3cyclictest0-21swapper/220:36:092
36600162183,8sleep30-21swapper/319:05:113
366483799179,6cyclictest3779855-21tr21:00:582
366483799178,7cyclictest3974516-21cron00:20:002
366483799176,8cyclictest3830559-21grep21:55:012
366483799172,13cyclictest0-21swapper/221:57:382
3664837991714,2cyclictest3835925-21fschecks_count22:00:532
3664837991713,2cyclictest0-21swapper/200:26:092
3664837991712,4cyclictest3690503-21kworker/u8:1+flush-8:023:46:042
3664837991712,3cyclictest0-21swapper/200:30:572
3664837991711,4cyclictest0-21swapper/221:30:592
366483799169,5cyclictest3774901-21tr20:55:592
366483799167,7cyclictest3707232-21sed19:50:572
3664837991613,2cyclictest0-21swapper/220:52:382
3664837991612,2cyclictest0-21swapper/222:20:542
366483799161,11cyclictest3860587-21apt-get22:25:492
38109162152,8sleep30-21swapper/321:35:483
39855842143,7sleep30-21swapper/300:30:563
37299762143,8sleep30-21swapper/320:11:013
39462302132,6sleep30-21swapper/323:50:583
39398652132,6sleep30-21swapper/323:45:013
39300942132,6sleep30-21swapper/323:35:023
39092602132,7sleep30-21swapper/323:11:033
38862782132,6sleep30-21swapper/322:50:553
37511032131,7sleep30-21swapper/320:35:013
37412712132,6sleep30-21swapper/320:25:013
37367502134,6sleep30-21swapper/320:20:523
37162462132,6sleep30-21swapper/320:00:023
37151032132,7sleep30-21swapper/319:56:003
37007352132,7sleep30-21swapper/319:41:083
36955132132,7sleep30-21swapper/319:36:013
39937012122,6sleep30-21swapper/300:36:103
39837342122,6sleep30-21swapper/300:26:073
39649432122,6sleep30-21swapper/300:10:503
39620472123,6sleep30-21swapper/300:05:593
39536482122,6sleep30-21swapper/323:56:013
39352012122,6sleep30-21swapper/323:40:483
39249892122,6sleep30-21swapper/323:30:013
39168662122,6sleep30-21swapper/323:20:583
38910792122,6sleep30-21swapper/322:55:543
38724722122,6sleep30-21swapper/322:35:583
38512362122,6sleep30-21swapper/322:15:573
38397032122,6sleep30-21swapper/322:01:073
38209612123,5sleep30-21swapper/321:45:503
38155802122,5sleep30-21swapper/321:40:023
37900192122,6sleep30-21swapper/321:11:043
37822532122,6sleep30-21swapper/321:05:593
37760542122,5sleep30-21swapper/321:00:013
37655792122,6sleep30-21swapper/320:46:083
37565522122,5sleep30-21swapper/320:40:023
37321152122,6sleep30-21swapper/320:15:553
37220382122,6sleep30-21swapper/320:05:563
37019092122,6sleep30-21swapper/319:45:533
36874872122,7sleep30-21swapper/319:30:563
36826942122,6sleep30-21swapper/319:25:593
36826942122,6sleep30-21swapper/319:25:593
36755022122,6sleep30-21swapper/319:16:003
39794702112,6sleep30-21swapper/300:24:253
39698422112,5sleep30-21swapper/300:15:433
39262732111,6sleep30-21swapper/323:30:573
39105112112,5sleep30-21swapper/323:15:513
38956332112,5sleep30-21swapper/323:00:473
38805812112,5sleep30-21swapper/322:45:353
38756952112,5sleep30-21swapper/322:40:493
38605272112,6sleep30-21swapper/322:25:243
38555872112,5sleep30-21swapper/322:20:023
38499362112,6sleep30-21swapper/322:12:083
38305932112,5sleep30-21swapper/321:55:023
38294942112,5sleep30-21swapper/321:51:053
38058412112,6sleep30-21swapper/321:30:013
38011422112,5sleep30-21swapper/321:25:533
37961512112,5sleep30-21swapper/321:20:563
37911442112,6sleep30-21swapper/321:15:383
37757902112,6sleep30-21swapper/320:56:353
37519072112,5sleep30-21swapper/320:35:533
37065102112,5sleep30-21swapper/319:50:023
36765742112,5sleep30-21swapper/319:20:013
36648942112,5sleep30-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional