You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 15:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu May 07, 2026 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
388519921910,4sleep375-21kworker/3:1-events11:16:033
388519921910,4sleep375-21kworker/3:1-events11:16:033
3638272996758,6cyclictest3798795-21latency_hist09:50:011
3638275996454,8cyclictest3942899-21cp12:15:012
3638270996454,7cyclictest3867227-21ntpq10:56:080
3638275996254,6cyclictest3669859-21apt-get07:40:002
3638275996254,6cyclictest3669859-21apt-get07:40:002
3638270996251,7cyclictest3828656-21apt-key10:20:010
3638270996154,4cyclictest3887877-21latency_hist11:20:010
3638270996154,4cyclictest3887877-21latency_hist11:20:010
3638275996053,5cyclictest280-21systemd-journal08:01:022
3638270996052,5cyclictest3769492-21apt-get09:20:550
3638270996048,9cyclictest3659041-21ntpq07:26:090
3638275995949,7cyclictest280-21systemd-journal08:45:002
3638272995940,8cyclictest3843775-21apt-get10:35:551
3638270995931,10cyclictest280-21systemd-journal07:55:010
3638272995847,8cyclictest3718645-21ntpq08:26:091
36845612570,3chrt451irq_work/307:51:133
3638272995648,6cyclictest280-21systemd-journal10:50:001
3638272995545,7cyclictest3729430-21latency_hist08:40:001
3638270995532,6cyclictest3808666-21latency_hist10:00:010
38382632540,1sleep03838261-21sshd10:26:480
3638275995448,4cyclictest2277928-21kworker/u8:0+flush-8:008:51:162
3638272995448,4cyclictest3809004-21apt-get10:00:561
3638272995447,5cyclictest3744799-21apt-get08:55:551
3638270995445,6cyclictest3754368-21latency_hist09:05:010
3638270995427,12cyclictest3669864-21latency_hist07:40:000
3638270995427,12cyclictest3669864-21latency_hist07:40:000
3638272995347,4cyclictest3912903-21apt-get11:45:551
3638270995015,26cyclictest3638108-21kworker/0:3+events07:30:570
3638275994839,7cyclictest280-21systemd-journal11:31:472
3638272994832,5cyclictest280-21systemd-journal09:33:501
3638272994832,5cyclictest280-21systemd-journal09:33:501
3638270994838,9cyclictest3595366-21kworker/u8:2+flush-8:007:46:130
3638272994737,8cyclictest280-21systemd-journal07:11:451
3638270994740,4cyclictest3779067-21latency_hist09:30:010
3638270994737,6cyclictest280-21systemd-journal11:15:000
3638270994737,6cyclictest280-21systemd-journal11:14:590
38146982450,3sleep375-21kworker/3:1+events10:06:013
3638270994536,6cyclictest3853663-21apt-get10:45:560
37288052440,1sleep03728806-21sensors_fan08:36:140
3638275994436,6cyclictest280-21systemd-journal12:32:502
3638270994331,9cyclictest3926557-21kworker/u8:2+flush-8:012:31:150
3638272994118,12cyclictest0-21swapper/108:05:011
3638270994131,8cyclictest3946735-21ntpq12:16:080
3638275994035,3cyclictest3926557-21kworker/u8:2+flush-8:012:21:092
3638272994029,8cyclictest3838841-21apt-get10:30:551
3638270994018,20cyclictest3699776-21kworker/0:1+events08:56:050
3638272993933,4cyclictest3695139-21apt-get08:05:551
3638272993930,7cyclictest3962213-21apt-get12:31:491
363827299388,17cyclictest3654147-21ntpq07:21:091
3638272993829,6cyclictest3903020-21apt-get11:35:551
3638272993812,15cyclictest3877990-21runrttasks11:09:541
3638272993810,14cyclictest3966676-21ntpq12:36:111
3638272993731,4cyclictest3645429-21apt-get07:15:561
3638272993710,16cyclictest3872284-21ntp_states11:01:121
3638272993710,15cyclictest3788200-21ps09:36:121
3638272993710,14cyclictest1-21systemd09:43:491
3638272993710,11cyclictest3882212-21ps11:11:131
3638272993710,11cyclictest3882212-21ps11:11:131
36378882374,11sleep10-21swapper/107:07:431
3638275993631,4cyclictest2277928-21kworker/u8:0+flush-8:007:16:002
363827299369,15cyclictest3947973-21apt-get12:20:561
363827299369,15cyclictest3665054-21latency_hist07:35:011
363827299368,18cyclictest3921595-21ld11:51:081
363827299368,17cyclictest3751049-21cut09:01:051
3638272993619,5cyclictest280-21systemd-journal12:16:481
3638272993610,15cyclictest3743754-21ps08:51:131
3638272993610,15cyclictest3733544-21ntpq08:41:101
3638272993610,14cyclictest3774432-21aten2_r5power_c09:25:551
3638270993626,7cyclictest2277928-21kworker/u8:0+flush-8:010:01:090
3638270993625,8cyclictest3595366-21kworker/u8:2+flush-8:007:19:590
3638275993529,4cyclictest3862901-21kworker/u8:3+events_unbound11:26:142
363827299359,16cyclictest3912325-21sshd11:41:481
363827299359,16cyclictest3705478-21if_enp4s0.208:16:021
363827299359,16cyclictest3674258-21ntpq07:41:111
363827299359,15cyclictest3804059-21aten2_r5power_c09:55:581
363827299359,14cyclictest3758413-21ntpq09:06:081
363827299359,11cyclictest3837745-21ntpq10:26:121
363827299359,10cyclictest3953523-21irqcore12:26:021
363827299358,12cyclictest3936522-21ntpq12:06:121
3638272993525,7cyclictest3858820-21diskstats10:50:581
3638272993515,7cyclictest3942228-21runrttasks12:12:061
3638272993513,9cyclictest589-21runrttasks07:36:561
3638272993513,9cyclictest589-21runrttasks07:36:551
3638272993512,10cyclictest3724250-21runrttasks08:32:401
3638272993511,12cyclictest3679146-21ntpq07:46:081
3638272993510,5cyclictest3774116-21munin-run09:25:001
3638272993510,14cyclictest3888458-21df_inode11:20:591
3638272993510,13cyclictest3822602-21ntpq10:11:091
3638272993510,12cyclictest3713806-21ntpq08:21:101
3638272993510,11cyclictest3768314-21ntpq09:16:091
3638270993528,5cyclictest3719851-21apt-get08:30:560
363827299349,15cyclictest3901810-21ld11:31:081
363827299349,15cyclictest3684069-21ntpq07:51:071
363827299349,14cyclictest3738495-21ntpq08:46:111
363827299349,10cyclictest3764119-21runrttasks09:13:361
363827299348,16cyclictest3926491-21ntpq11:56:081
3638272993411,11cyclictest3659075-21ntpq07:26:101
3638272993410,9cyclictest3887070-21ntpq11:16:091
3638272993410,9cyclictest3887070-21ntpq11:16:091
3638272993410,13cyclictest3817683-21ntpq10:06:081
3638272993410,11cyclictest3830202-21cut10:21:041
3638272993410,10cyclictest3853152-21runrttasks10:42:411
3638270993428,4cyclictest3862901-21kworker/u8:3+flush-8:011:21:040
3638270993425,7cyclictest3768254-21ntpq09:16:080
3638270993424,8cyclictest3822619-21ntpq10:11:110
3638270993424,7cyclictest3873078-21latency_hist11:05:010
3638270993424,7cyclictest3739315-21apt-get08:50:010
3638270993424,7cyclictest280-21systemd-journal07:55:590
363827099342,27cyclictest3699776-21kworker/0:1+events09:05:540
3638270993411,21cyclictest3828435-21kworker/0:0+events10:30:570
3638275993329,3cyclictest3862901-21kworker/u8:3+events_unbound12:36:132
363827299338,15cyclictest3827510-21ntpq10:16:091
363827299338,14cyclictest3867261-21ntpq10:56:091
363827299337,16cyclictest3799090-21/usr/sbin/munin09:50:571
3638272993326,5cyclictest3685274-21apt-get07:55:551
3638272993311,11cyclictest3703924-21ntpq08:11:131
3638272993310,6cyclictest3929309-21kthreadcore12:01:061
3638272993310,14cyclictest3894267-21kthreadcore11:26:041
363827099332,26cyclictest3868165-21kworker/0:2+events11:10:010
3638270993227,3cyclictest3952612-21systemd-run12:25:000
3638270993223,7cyclictest280-21systemd-journal11:50:000
363827099322,28cyclictest3769195-21kworker/0:0+events09:36:140
3638270993220,9cyclictest3942471-21apt-get12:15:000
3638270993220,9cyclictest280-21systemd-journal08:44:450
363827099320,30cyclictest3927407-21kworker/0:0+events12:06:350
36378542324,8sleep20-21swapper/207:07:152
3638270993125,4cyclictest3659951-21kworker/u8:1+flush-8:008:11:050
363827099312,28cyclictest3878047-21kworker/0:1+events12:01:070
363827099311,28cyclictest3878047-21kworker/0:1+events11:56:000
363827099302,27cyclictest3828435-21kworker/0:0+events10:51:210
3638270993022,6cyclictest3848704-21/usr/sbin/munin10:41:060
363827099302,26cyclictest3638108-21kworker/0:3+events08:06:050
3638270993019,9cyclictest0-21swapper/011:30:010
363827099301,27cyclictest3878047-21kworker/0:1+events11:51:110
363827099300,28cyclictest3769195-21kworker/0:0+events09:50:010
3638275992922,5cyclictest280-21systemd-journal07:50:582
363827099299,16cyclictest3638108-21kworker/0:3+events07:15:010
3638270992925,3cyclictest401-21dbus-daemon09:45:010
3638270992923,4cyclictest3595366-21kworker/u8:2+flush-8:007:21:000
363827099292,26cyclictest3952611-21kworker/0:1+events12:26:030
3638270992918,9cyclictest3595366-21kworker/u8:2+flush-8:007:45:000
363827099291,26cyclictest3828435-21kworker/0:0+events10:36:130
363827099291,26cyclictest3638108-21kworker/0:3+events08:01:120
3638270992911,16cyclictest3699776-21kworker/0:1+events08:51:130
3638270992911,16cyclictest3699776-21kworker/0:1+events08:21:150
363827099290,27cyclictest3803755-21kworker/0:2+events10:10:010
3638275992823,4cyclictest3803330-21unixbench_multi09:51:152
363827099288,15cyclictest3699776-21kworker/0:1+events08:15:040
363827099287,19cyclictest3962246-21kworker/0:0+events12:36:090
3638270992820,5cyclictest3833231-21grep10:21:160
363827099280,26cyclictest3878047-21kworker/0:1+events11:41:010
363827099280,26cyclictest3699776-21kworker/0:1+events08:26:070
383333222720,4sleep30-21swapper/310:21:513
3638275992723,3cyclictest3659951-21kworker/u8:1+flush-8:008:06:092
3638275992723,3cyclictest3595366-21kworker/u8:2+flush-8:011:46:152
3638275992722,3cyclictest3855804-21kthreadcore10:46:042
3638275992720,5cyclictest3724435-21cron08:35:002
3638270992722,3cyclictest3907656-21systemd-run11:40:010
3638270992721,4cyclictest3595366-21kworker/u8:2+flush-8:009:31:130
3638270992721,4cyclictest3595366-21kworker/u8:2+flush-8:009:31:130
3638275992622,2cyclictest3932900-21cpuspeed_turbos12:05:582
3638275992622,2cyclictest3868755-21fschecks_count11:01:012
3638275992621,4cyclictest2277928-21kworker/u8:0+flush-8:007:41:012
363719422616,5sleep30-21swapper/307:06:083
3638275992521,2cyclictest3809293-21fschecks_count10:01:002
3638275992520,3cyclictest3724319-21kworker/u8:3+events_unbound09:41:022
363827099259,14cyclictest3769195-21kworker/0:0+events09:51:030
363827099259,14cyclictest3699776-21kworker/0:1+events09:10:590
363827099256,17cyclictest3878047-21kworker/0:1+events11:31:090
3638275992421,2cyclictest3927022-21unixbench_singl11:56:152
3638275992421,2cyclictest3863725-21cpuspeed_turbos10:55:582
3638275992421,2cyclictest3829006-21aten2_r5power_e10:20:582
3638275992420,2cyclictest3705247-21cpuspeed_turbos08:15:592
3638275992419,4cyclictest2277928-21kworker/u8:0+flush-8:010:31:042
3638275992419,3cyclictest3773760-21unixbench_singl09:21:152
3638270992419,2cyclictest0-21swapper/007:10:010
3638275992320,2cyclictest3883527-21fschecks_count11:15:592
3638275992320,2cyclictest3883527-21fschecks_count11:15:582
3638275992317,4cyclictest3739315-21apt-get08:50:002
3638275992316,5cyclictest280-21systemd-journal09:14:592
3638275992219,2cyclictest3764670-21aten2_r5power_v09:15:582
3638275992217,4cyclictest0-21swapper/210:00:012
3638275992217,3cyclictest3824508-21cut10:16:022
3638275992216,4cyclictest3947296-21sed12:16:172
3638275992214,6cyclictest280-21systemd-journal09:36:252
37169492210,2sleep375-21kworker/3:1-events08:26:053
363827599217,10cyclictest3700075-21apt-get08:10:592
363827599216,4cyclictest37169502kthreadcore08:26:052
3638275992117,3cyclictest280-21systemd-journal12:30:002
3638275992117,2cyclictest3888435-21cpuspeed_turbos11:20:582
3638275992114,5cyclictest280-21systemd-journal10:40:002
37859052200,2chrt75-21kworker/3:1-events09:36:043
363827599202,12cyclictest3907952-21apt-get11:40:582
3638275992016,2cyclictest3873686-21fschecks_count11:06:002
3638275992016,2cyclictest3685492-21cpuspeed_turbos07:55:582
3638275992014,4cyclictest3750017-21cut09:01:002
3638275992013,5cyclictest280-21systemd-journal12:01:572
3638275992010,7cyclictest3759304-21sh09:10:002
39231442190,2chrt75-21kworker/3:1-events11:56:003
3638275991915,2cyclictest0-21swapper/211:11:102
3638275991915,2cyclictest0-21swapper/211:11:102
3638275991914,3cyclictest0-21swapper/209:26:022
363827599182,11cyclictest3833905-21apt-get10:25:572
3638275991815,2cyclictest3660568-21fschecks_time07:31:002
3638275991814,2cyclictest0-21swapper/207:46:092
36562682170,3sleep2371rcuc/207:26:052
363827599178,7cyclictest3726811-21tr08:36:052
3638275991714,2cyclictest3907628-21idleruntime-cro11:40:012
3638275991712,3cyclictest0-21swapper/210:15:002
3638275991711,4cyclictest0-21swapper/209:31:052
3638275991711,4cyclictest0-21swapper/209:31:052
37494482167,6sleep30-21swapper/309:00:013
36507472160,2sleep3481ktimers/307:21:013
363827599169,5cyclictest3797912-21grep09:46:082
363827599169,5cyclictest280-21systemd-journal07:15:002
363827599167,7cyclictest3861532-21tr10:51:042
363827599167,7cyclictest3710878-21cut08:21:022
363827599162,13cyclictest0-21swapper/207:20:172
3638275991611,3cyclictest0-21swapper/210:10:012
3638275991511,3cyclictest2277928-21kworker/u8:0+flush-8:008:55:042
3638275991511,2cyclictest0-21swapper/210:41:062
3638275991510,3cyclictest0-21swapper/211:51:042
38483772144,5sleep30-21swapper/310:40:013
39575072131,8sleep30-21swapper/312:30:003
39224392132,7sleep30-21swapper/311:55:013
38541162134,5sleep30-21swapper/310:46:033
39666262122,6sleep30-21swapper/312:36:093
39614962122,6sleep30-21swapper/312:31:083
39415852122,6sleep30-21swapper/312:11:103
39158572122,6sleep30-21swapper/311:46:063
39079262122,6sleep30-21swapper/311:40:563
38882402122,6sleep30-21swapper/311:20:583
38722312122,6sleep30-21swapper/311:01:123
38388452122,6sleep30-21swapper/310:30:583
38376122122,6sleep30-21swapper/310:26:093
38098872122,6sleep30-21swapper/310:01:043
37947062123,5sleep30-21swapper/309:46:033
37736352122,6sleep30-21swapper/309:21:163
37450452122,6sleep30-21swapper/308:56:003
37397942122,6sleep30-21swapper/308:50:223
37244332122,5sleep30-21swapper/308:35:013
37118972123,5sleep30-21swapper/308:21:053
37006672122,6sleep30-21swapper/308:11:063
36993972122,6sleep30-21swapper/308:06:163
36945062122,6sleep30-21swapper/308:01:183
36557002122,6sleep30-21swapper/307:26:033
36459652122,6sleep30-21swapper/307:16:043
36422242122,6sleep30-21swapper/307:11:103
39493952112,5sleep30-21swapper/312:21:043
39435112112,5sleep30-21swapper/312:16:043
39335692112,5sleep30-21swapper/312:06:043
39277092112,5sleep30-21swapper/312:00:593
39031812112,5sleep30-21swapper/311:35:593
39024392112,5sleep30-21swapper/311:31:493
38977522112,5sleep30-21swapper/311:30:013
38787512112,5sleep30-21swapper/311:11:033
38787512112,5sleep30-21swapper/311:11:033
38737702113,5sleep30-21swapper/311:06:003
38634332112,6sleep30-21swapper/310:55:183
38585752111,6sleep30-21swapper/310:50:553
38491072112,5sleep30-21swapper/310:41:013
38241522112,5sleep30-21swapper/310:16:013
38189192110,6sleep30-21swapper/310:11:003
38040562112,5sleep30-21swapper/309:55:593
38015312112,5sleep30-21swapper/309:51:053
37793562112,5sleep30-21swapper/309:30:553
37793562112,5sleep30-21swapper/309:30:543
37741312112,5sleep30-21swapper/309:25:013
37672092112,5sleep30-21swapper/309:16:053
37595372112,6sleep30-21swapper/309:10:083
37591282112,6sleep30-21swapper/309:07:563
37391982112,5sleep30-21swapper/308:48:413
37302542112,5sleep30-21swapper/308:41:023
37285572111,6sleep30-21swapper/308:36:093
37055022112,5sleep30-21swapper/308:16:033
36852332112,5sleep30-21swapper/307:55:453
36791272112,5sleep30-21swapper/307:46:103
36703332112,5sleep30-21swapper/307:40:043
36685542112,5sleep30-21swapper/307:36:063
36685542112,5sleep30-21swapper/307:36:053
36611392112,5sleep30-21swapper/307:31:053
37891812102,5sleep30-21swapper/309:40:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional