You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 08:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun May 17, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
418274222360,2sleep3471rcuc/300:15:523
1075621840,3sleep375-21kworker/3:1-events00:35:593
1075621840,3sleep375-21kworker/3:1-events00:35:593
64282770,2chrt75-21kworker/3:1-events00:31:023
3877057996457,5cyclictest4123123-21kworker/u8:2+flush-8:023:46:060
3877059996251,9cyclictest4171438-21ntpq00:01:051
3877057996049,8cyclictest3938777-21diskstats20:10:530
3877059995950,6cyclictest4127402-21latency_hist23:20:011
3877057995947,9cyclictest3952113-21ntpq20:21:000
3877057995947,9cyclictest3952113-21ntpq20:21:000
3877063995854,3cyclictest4117241-21kworker/u8:1+flush-8:023:16:042
3877063995853,4cyclictest4137286-21kworker/u8:3+flush-8:023:31:082
41866002560,6sleep20-21swapper/200:16:072
3877063995650,4cyclictest3995729-21kworker/u8:3+events_unbound21:26:012
3877057995446,6cyclictest8209-21apt-get00:35:500
3877057995446,6cyclictest8209-21apt-get00:35:490
3877057995441,9cyclictest280-21systemd-journal20:39:590
3877059995342,8cyclictest3967247-21ntpq20:36:031
3877057995348,4cyclictest3849866-21kworker/u8:2+flush-8:019:21:050
3877057995346,5cyclictest3996901-21ntpq21:06:030
3877057995342,8cyclictest3986966-21ntpq20:56:000
3877057995246,4cyclictest3898337-21kworker/u8:1+flush-8:020:30:530
3877059995141,7cyclictest4123123-21kworker/u8:2+flush-8:023:21:051
3877059995134,14cyclictest280-21systemd-journal22:51:351
3877057995043,5cyclictest4122214-21apt-get23:15:010
3877063994944,4cyclictest4022580-21kworker/u8:1+flush-8:022:01:092
3877063994943,4cyclictest4167500-21kworker/u8:0+events_unbound00:01:042
3877057994841,5cyclictest3922482-21ntpq19:51:000
40890512470,2sleep1281rcuc/122:40:571
3877063994741,4cyclictest3903427-21kworker/u8:0+flush-8:019:51:032
3877059994728,8cyclictest4157643-21apt-get23:50:491
3877057994743,3cyclictest4137286-21kworker/u8:3+events_unbound00:31:080
3877057994737,8cyclictest280-21systemd-journal20:30:000
3877057994737,8cyclictest280-21systemd-journal20:29:590
3877063994636,8cyclictest4067332-21apt-get22:20:002
3877057994639,5cyclictest4112623-21apt-get23:05:490
3877057994634,9cyclictest280-21systemd-journal23:25:000
3877057994539,4cyclictest3849866-21kworker/u8:2+flush-8:019:25:520
3877063994332,8cyclictest3963202-21cat20:35:012
3877057994336,5cyclictest3928351-21latency_hist20:00:010
41891432420,3sleep375-21kworker/3:1+events00:20:593
3877063994231,9cyclictest3953579-21diskstats20:25:532
3877063994231,9cyclictest3953579-21diskstats20:25:522
3877059994235,5cyclictest280-21systemd-journal19:43:351
3877059994233,7cyclictest280-21systemd-journal21:25:011
3877057994237,3cyclictest3839362-21kworker/u8:0+events_unbound19:16:090
3877057994230,9cyclictest4011942-21ntpq21:21:030
3877063994137,3cyclictest4137286-21kworker/u8:3+events_unbound23:36:072
3877059994134,5cyclictest4061535-21ntpq22:11:051
3877059994126,7cyclictest4092840-21apt-get22:45:491
3877059994126,7cyclictest4092840-21apt-get22:45:491
3877057994135,4cyclictest280-21systemd-journal22:03:080
3877057994134,5cyclictest4046639-21kworker/u8:2+flush-8:022:36:020
3877057994134,5cyclictest280-21systemd-journal21:18:030
3877057994132,7cyclictest4098024-21diskstats22:50:510
3877059994032,6cyclictest3903427-21kworker/u8:0+flush-8:020:16:061
3877059994031,7cyclictest280-21systemd-journal22:25:351
3877057994036,3cyclictest4123123-21kworker/u8:2+flush-8:023:26:050
3877057994034,4cyclictest3903427-21kworker/u8:0+events_unbound19:36:180
3877057994032,6cyclictest4137286-21kworker/u8:3+flush-8:023:56:020
3877063993931,6cyclictest280-21systemd-journal19:38:352
3877059993929,8cyclictest3887904-21ntpq19:16:031
3877059993911,14cyclictest4001907-21ntpq21:11:051
3877057993933,4cyclictest4022580-21kworker/u8:1+events_unbound22:41:030
3877057993932,4cyclictest4137286-21kworker/u8:3+events_unbound00:10:510
3877057993928,9cyclictest3947162-21ntpq20:15:580
38767572393,10sleep10-21swapper/119:08:181
3877063993834,3cyclictest3903427-21kworker/u8:0+events_unbound20:11:082
3877059993831,5cyclictest3987018-21ntpq20:56:011
3877059993830,5cyclictest4142529-21apt-key23:35:011
3877059993820,7cyclictest0-21swapper/122:05:531
3877059993811,15cyclictest4041753-21ntpq21:51:061
3877059993811,11cyclictest4021895-21ntpq21:31:031
3877059993810,16cyclictest4176360-21ntpq00:06:031
3877057993832,4cyclictest3849866-21kworker/u8:2+flush-8:020:05:530
387705999379,17cyclictest3922559-21ntpq19:51:031
3877059993711,15cyclictest7005-21ntpq00:31:041
3877059993711,15cyclictest3957110-21ntpq20:26:031
3877059993711,15cyclictest3957110-21ntpq20:26:021
3877059993711,15cyclictest2100-21ntpq00:26:021
3877059993711,13cyclictest3992009-21ntpq21:01:051
3877059993710,14cyclictest3902805-21ntpq19:31:061
3877059993710,12cyclictest4103073-21fschecks_time22:55:541
3877059993710,12cyclictest3958501-21apt-get20:30:501
3877057993732,3cyclictest4022580-21kworker/u8:1+flush-8:022:20:500
387705999369,13cyclictest280-21systemd-journal21:15:351
387705999368,17cyclictest4151515-21ld23:41:021
387705999368,16cyclictest3952165-21ntpq20:21:021
387705999368,16cyclictest3952165-21ntpq20:21:021
387705999368,11cyclictest4187079-21taskset00:20:001
387705999367,17cyclictest3889110-21apt-get19:20:501
3877059993629,5cyclictest4067891-21apt-get22:20:471
3877059993628,6cyclictest3968688-21diskstats20:40:511
3877059993611,14cyclictest3928606-21runrttasks20:00:151
3877059993611,12cyclictest4121299-21ntpq23:11:001
3877057993631,4cyclictest4123123-21kworker/u8:2+flush-8:000:16:060
3877057993630,4cyclictest4046639-21kworker/u8:2+flush-8:023:01:020
3877057993630,4cyclictest3849866-21kworker/u8:2+flush-8:020:46:090
3877063993530,4cyclictest3903427-21kworker/u8:0+events_unbound19:56:072
387705999359,15cyclictest3942261-21ntpq20:11:021
387705999359,15cyclictest3881065-21ntpq19:11:001
387705999359,12cyclictest3915626-21kthreadcore19:45:581
387705999358,15cyclictest4156557-21ntpq23:46:061
387705999357,17cyclictest3923699-21apt-get19:55:501
3877059993529,4cyclictest4032296-21unixbench_multi21:41:091
3877059993526,6cyclictest280-21systemd-journal21:49:591
3877059993525,8cyclictest280-21systemd-journal22:17:351
3877059993511,11cyclictest4166445-21ntpq23:56:041
3877059993510,14cyclictest3897807-21ntpq19:26:031
3877059993510,13cyclictest4026934-21ntpq21:36:031
3877057993531,3cyclictest4022580-21kworker/u8:1+events_unbound21:46:080
3877057993529,4cyclictest4137286-21kworker/u8:3+flush-8:023:50:530
3877057993529,4cyclictest4137286-21kworker/u8:3+events_unbound00:05:500
3877057993529,4cyclictest4022580-21kworker/u8:1+flush-8:021:40:540
3877057993528,5cyclictest4123123-21kworker/u8:2+flush-8:023:30:530
3877057993528,5cyclictest4018118-21apt-get21:30:500
3877057993527,6cyclictest4137286-21kworker/u8:3+flush-8:023:41:040
3877057993527,5cyclictest3903427-21kworker/u8:0+flush-8:020:51:070
3877057993524,9cyclictest4043095-21diskstats21:55:510
387229823525,7sleep20-21swapper/219:05:382
387705999349,9cyclictest4052500-21munin-run22:05:011
387705999349,14cyclictest4046606-21ntpq21:56:011
387705999349,14cyclictest11997-21ntpq00:36:041
387705999349,14cyclictest11997-21ntpq00:36:041
387705999349,11cyclictest3983061-21latency_hist20:55:011
387705999348,15cyclictest4181227-21ntpq00:11:011
3877059993427,4cyclictest280-21systemd-journal20:45:351
3877059993413,5cyclictest3935841-21kthreadcore20:05:581
3877059993411,11cyclictest4086677-21ntpq22:36:011
3877059993410,14cyclictest4112542-21runrttasks23:05:051
3877059993410,11cyclictest4191208-21ntpq00:21:061
3877057993430,3cyclictest4137286-21kworker/u8:3+flush-8:000:26:050
3877057993429,4cyclictest3849866-21kworker/u8:2+flush-8:019:31:080
387705999339,12cyclictest4141633-21python323:31:071
3877059993311,11cyclictest4081749-21ntpq22:31:041
3877059993310,11cyclictest4111443-21ntpq23:01:031
3877059993310,11cyclictest3907751-21ntpq19:36:161
3877059993310,10cyclictest1-21systemd21:10:011
3877057993327,4cyclictest4046639-21kworker/u8:2+flush-8:022:46:040
3877057993327,4cyclictest4046639-21kworker/u8:2+flush-8:022:46:030
3877057993326,5cyclictest3995729-21kworker/u8:3+flush-8:021:26:060
387705999329,11cyclictest4136464-21ntpq23:26:041
3877057993228,3cyclictest4022580-21kworker/u8:1+flush-8:022:11:040
3877057993227,4cyclictest4022580-21kworker/u8:1+flush-8:022:18:050
3877057993226,4cyclictest4082671-21kworker/u8:0+events_unbound22:56:050
39921102310,3sleep375-21kworker/3:1-events21:01:063
3877063993127,3cyclictest4062273-21kworker/u8:3+events_unbound22:15:002
387705999319,12cyclictest4013748-21irqcore21:25:561
3877057993127,3cyclictest4022580-21kworker/u8:1+flush-8:021:36:030
3877057993127,3cyclictest3849866-21kworker/u8:2+flush-8:021:11:090
3877057993125,5cyclictest3898337-21kworker/u8:1+events_unbound21:01:080
3877057993026,3cyclictest3849866-21kworker/u8:2+events_unbound20:01:060
3877057993025,3cyclictest4127388-21cron23:20:010
3877057993024,3cyclictest4137286-21kworker/u8:3+events_unbound00:21:050
3877063992824,3cyclictest3995729-21kworker/u8:3+flush-8:021:33:112
3877063992823,3cyclictest3952655-21unixbench_singl20:21:082
3877063992823,3cyclictest3952655-21unixbench_singl20:21:072
3877057992719,5cyclictest3876910-21latency_hist19:10:010
39202252260,2sleep3481ktimers/319:50:563
3877063992622,2cyclictest4073171-21aten2_r5power_v22:25:512
3877063992620,2cyclictest161rcu_preempt22:51:062
3877063992617,6cyclictest4046669-21ntpq21:56:032
3877057992622,3cyclictest4046639-21kworker/u8:2+events_unbound22:31:100
3877063992522,2cyclictest4107979-21fschecks_count23:00:542
3877063992522,2cyclictest4082636-21cron22:35:002
3877063992522,2cyclictest3992817-21cron21:05:002
3877063992521,2cyclictest3932883-21unixbench_multi20:01:082
3877063992521,2cyclictest0-21swapper/220:40:002
387706399250,8cyclictest129081latency_hist00:40:002
387706399250,8cyclictest129081latency_hist00:40:002
3877057992519,4cyclictest4017435-21kworker/u8:0+flush-8:021:50:560
3877063992421,2cyclictest4112738-21aten2_r5power_v23:05:522
3877063992420,3cyclictest3876928-21kworker/u8:3+flush-8:019:26:242
3877063992420,2cyclictest3983297-21aten2_r5power_e20:55:502
3877057992420,2cyclictest4143028-21cpuspeed_turbos23:35:510
3877063992320,2cyclictest4132750-21aten2_r5power_p23:25:502
3877063992319,2cyclictest3973665-21fschecks_count20:45:532
3877063992319,2cyclictest3943682-21cpuspeed_turbos20:15:502
387705799232,17cyclictest0-21swapper/000:00:500
3877057992318,4cyclictest3898337-21kworker/u8:1+flush-8:020:44:060
3877057992318,3cyclictest4022580-21kworker/u8:1+events_unbound22:25:540
3877057992313,8cyclictest280-21systemd-journal19:12:360
3877063992219,2cyclictest4053051-21fschecks_count22:05:522
3877063992219,2cyclictest3543-21fschecks_count00:30:552
3877063992218,3cyclictest4137286-21kworker/u8:3+flush-8:023:58:362
3877063992218,2cyclictest3877592-21fschecks_time19:10:532
41680762210,2sleep3481ktimers/300:00:553
3877063992117,2cyclictest4068114-21cpuspeed_turbos22:20:522
3877063992117,2cyclictest4023107-21aten2_r5power_c21:35:502
3877063992114,5cyclictest3898958-21apt-get19:30:492
3877057992118,2cyclictest0-21swapper/019:41:080
3877057992111,8cyclictest4056505-21ntpq22:06:010
3877057992110,9cyclictest280-21systemd-journal19:50:000
387706399202,13cyclictest4036844-21ntpq21:46:052
3877063992016,3cyclictest3998156-21aten2_r5power_e21:10:522
387706399200,8cyclictest40890532kthreadcore22:40:562
387706399200,10cyclictest3918468-21kworker/2:0+events00:25:572
387706399192,12cyclictest4176272-21ntpq00:06:002
387706399192,12cyclictest3978308-21apt-get20:50:502
3877063991916,2cyclictest0-21swapper/221:20:002
3877063991915,3cyclictest4117241-21kworker/u8:1+events_unbound23:20:032
3877063991915,2cyclictest4117767-21tr23:10:512
3877063991915,2cyclictest0-21swapper/221:10:012
3877063991915,2cyclictest0-21swapper/200:25:012
3877063991912,5cyclictest3934493-21sed20:05:572
3877063991910,6cyclictest0-21swapper/219:45:522
41213222180,2sleep3481ktimers/323:10:593
3877063991815,2cyclictest4148042-21fschecks_time23:40:532
3877063991815,2cyclictest4028343-21fschecks_count21:40:532
3877063991814,3cyclictest0-21swapper/200:11:082
3877063991814,2cyclictest0-21swapper/221:51:062
3877063991812,4cyclictest0-21swapper/222:45:492
3877063991812,4cyclictest0-21swapper/222:45:492
387706399180,3cyclictest40835592sed22:35:552
38767292183,8sleep30-21swapper/319:07:563
38989612172,10sleep30-21swapper/319:30:513
387706399172,1cyclictest0-21swapper/220:41:062
3877063991713,3cyclictest3888366-21unixbench_multi19:16:092
3877063991713,2cyclictest4102846-21aten2_r5power_v22:55:522
3877063991712,3cyclictest0-21swapper/219:45:012
41465902168,5sleep30-21swapper/323:36:053
387706399162,13cyclictest0-21swapper/223:51:392
3877063991613,2cyclictest0-21swapper/219:21:252
3877063991611,3cyclictest0-21swapper/223:45:592
387706399151,10cyclictest4008244-21apt-get21:20:512
41365082145,5sleep30-21swapper/323:26:063
41298382143,7sleep30-21swapper/323:21:013
40084382145,5sleep30-21swapper/321:20:543
41812932131,8sleep30-21swapper/300:11:043
41084952132,7sleep30-21swapper/323:00:583
40968862132,7sleep30-21swapper/322:46:093
40968862132,7sleep30-21swapper/322:46:093
40673662132,5sleep30-21swapper/322:20:013
40177912133,5sleep30-21swapper/321:30:013
39821252132,7sleep30-21swapper/320:51:053
39779852132,6sleep30-21swapper/320:50:003
39705012132,7sleep30-21swapper/320:40:583
39335952133,7sleep30-21swapper/320:05:503
39106852133,6sleep30-21swapper/319:40:593
38949612133,6sleep30-21swapper/319:25:583
41770402122,6sleep30-21swapper/300:08:363
41579042122,6sleep30-21swapper/323:50:543
41375332122,6sleep30-21swapper/323:30:363
40782522123,6sleep30-21swapper/322:30:573
40425282122,5sleep30-21swapper/321:55:013
40329132122,6sleep30-21swapper/321:45:103
40326612122,6sleep30-21swapper/321:44:583
40277332122,6sleep30-21swapper/321:39:593
40220772122,6sleep30-21swapper/321:31:103
39829562122,5sleep30-21swapper/320:55:023
39585052122,6sleep30-21swapper/320:30:493
39434902122,6sleep30-21swapper/320:15:503
39424642122,6sleep30-21swapper/320:11:083
39166052122,6sleep30-21swapper/319:46:003
39085222123,5sleep30-21swapper/319:39:383
38821392122,5sleep30-21swapper/319:15:013
38815502122,6sleep30-21swapper/319:11:093
41925512112,5sleep30-21swapper/300:25:533
41625962110,7sleep30-21swapper/323:55:523
41531472112,5sleep30-21swapper/323:45:563
41476402112,5sleep30-21swapper/323:40:033
41252212112,5sleep30-21swapper/323:15:593
41126272112,5sleep30-21swapper/323:05:523
41067412112,6sleep30-21swapper/322:56:083
40982852112,5sleep30-21swapper/322:50:553
40911862112,5sleep30-21swapper/322:41:003
40828672112,5sleep30-21swapper/322:35:023
40730642112,5sleep30-21swapper/322:25:503
40626322112,5sleep30-21swapper/322:15:363
40576172112,5sleep30-21swapper/322:10:013
40527582112,5sleep30-21swapper/322:05:493
40478082112,6sleep30-21swapper/322:00:513
40379632112,5sleep30-21swapper/321:50:513
40032372113,5sleep30-21swapper/321:15:333
40019572112,5sleep30-21swapper/321:11:073
39931052112,5sleep30-21swapper/321:05:503
39634672112,6sleep30-21swapper/320:35:523
39483482112,5sleep30-21swapper/320:20:353
39483482112,5sleep30-21swapper/320:20:353
39289182112,5sleep30-21swapper/320:00:533
39237032112,6sleep30-21swapper/319:55:513
38890812112,6sleep30-21swapper/319:20:483
39532462102,5sleep30-21swapper/320:25:053
39532462102,5sleep30-21swapper/320:25:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional