You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-20 - 12:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun Sep 20, 2026 00:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40843532910,2chrt0-21swapper/223:24:072
39160892800,6chrt0-21swapper/320:34:073
38476812660,5sleep20-21swapper/219:25:002
3830550995850,6cyclictest4101292-21latency_hist23:40:000
3830550995242,7cyclictest278-21systemd-journal19:10:010
3830555995146,4cyclictest3916782-21kworker/u8:0+flush-8:020:44:161
3830550995141,8cyclictest4012267-21diskstats22:14:020
40833462490,1sleep14083351-21cut23:24:061
3830555994936,10cyclictest278-21systemd-journal21:44:101
3830555994842,4cyclictest3922243-21kworker/u8:3+flush-8:022:04:021
3830555994742,4cyclictest4121145-21kworker/u8:0+flush-8:000:09:201
3830555994741,5cyclictest3887395-21kworker/u8:1+events_unbound20:29:161
39424022460,3sleep375-21kworker/3:1-events21:04:003
3830559994540,3cyclictest3810908-21kworker/u8:1+events_unbound19:45:002
3830555994338,4cyclictest4016629-21kworker/u8:1+flush-8:022:34:021
3830555994337,4cyclictest3916782-21kworker/u8:0+flush-8:022:09:001
39956812420,2chrt451irq_work/321:54:083
3830555994237,4cyclictest3916782-21kworker/u8:0+flush-8:020:54:021
3830555994237,4cyclictest3916782-21kworker/u8:0+flush-8:020:54:021
3830555994237,4cyclictest3830767-21kworker/u8:0+flush-8:019:54:051
3830555994236,4cyclictest4116067-21kworker/u8:4+flush-8:000:24:081
3830559994137,3cyclictest4016629-21kworker/u8:1+flush-8:022:39:112
3830555994137,3cyclictest3830767-21kworker/u8:0+flush-8:019:49:041
3830550994133,6cyclictest4106241-21latency_hist23:45:000
3830550994131,8cyclictest4021383-21apt-get22:20:000
3830555994036,3cyclictest3916782-21kworker/u8:0+flush-8:021:14:151
3830555994035,4cyclictest3887395-21kworker/u8:1+flush-8:020:59:011
3830555994034,4cyclictest4056334-21kworker/u8:3+events_unbound23:14:101
3830555994034,4cyclictest3867601-21kworker/u8:3+events_unbound19:59:091
3830555993930,6cyclictest3897027-21latency_hist20:15:011
3830550993931,6cyclictest4131302-21latency_hist00:10:010
3830550993930,6cyclictest278-21systemd-journal23:20:000
3830555993833,4cyclictest3951677-21kworker/u8:2+flush-8:022:24:031
3830555993833,4cyclictest3916782-21kworker/u8:0+flush-8:020:39:031
3830555993833,4cyclictest3887395-21kworker/u8:1+flush-8:020:24:141
3830555993832,4cyclictest3916782-21kworker/u8:0+events_unbound21:29:121
3830555993832,4cyclictest3887395-21kworker/u8:1+events_unbound20:48:581
3830555993831,5cyclictest3887133-21latency_hist20:05:011
3830555993830,5cyclictest4036488-21kworker/u8:0+flush-8:022:39:101
383055099382,27cyclictest4026631-21kworker/0:2+events23:45:170
3830555993730,5cyclictest3810908-21kworker/u8:1+flush-8:019:20:001
3830555993728,5cyclictest4036488-21kworker/u8:0+events_unbound22:44:111
3830555993724,10cyclictest4066436-21apt-key23:05:001
3830555993628,6cyclictest4091256-21kworker/u8:0+events_unbound23:39:051
3830550993626,8cyclictest4025988-21ntpq22:24:110
3830550993625,9cyclictest4045798-21ntpq22:44:110
3830550993625,2cyclictest0-21swapper/022:00:000
38855262350,6sleep3451irq_work/320:04:103
3830559993531,3cyclictest4130737-21kworker/u8:2+flush-8:000:09:202
3830555993528,5cyclictest4016629-21kworker/u8:1+events_unbound22:19:131
3830550993531,3cyclictest3872312-21apt19:50:000
3830550993528,5cyclictest3962415-21grep21:24:030
383055099352,28cyclictest4026631-21kworker/0:2+events23:33:410
383055099352,27cyclictest3810713-21kworker/0:0+events20:08:170
3830559993429,3cyclictest3922243-21kworker/u8:3+flush-8:022:10:102
3830555993429,3cyclictest3943060-21irqrtprio21:04:051
3830555993428,4cyclictest3887686-21apt-get20:08:581
3830555993423,7cyclictest278-21systemd-journal00:20:001
3830555993422,9cyclictest278-21systemd-journal23:29:101
383055099342,27cyclictest3810713-21kworker/0:0+events20:22:490
3830559993325,6cyclictest3921872-21gpgv20:40:002
3830555993326,5cyclictest4121145-21kworker/u8:0+events_unbound00:29:011
3830555993326,5cyclictest3810908-21kworker/u8:1+flush-8:019:24:141
383055099331,27cyclictest4026631-21kworker/0:2+events23:20:410
39943402320,4sleep1281rcuc/121:54:061
3830559993227,4cyclictest4096310-21kworker/u8:3+events_unbound00:00:012
3830559993226,4cyclictest3901865-21unixbench_singl20:19:172
3830555993228,3cyclictest3830767-21kworker/u8:0+flush-8:019:34:041
3830555993228,2cyclictest3863228-21cpuspeed_turbos19:44:011
3830555993226,4cyclictest4091256-21kworker/u8:0+flush-8:023:49:071
3830555993226,3cyclictest4036488-21kworker/u8:0+flush-8:022:59:081
3830550993225,5cyclictest278-21systemd-journal22:56:170
3830550993223,7cyclictest4155335-21ntpq00:34:110
383055099322,29cyclictest3810713-21kworker/0:0+events20:04:530
383055099322,26cyclictest3810713-21kworker/0:0+events22:02:410
383055099322,25cyclictest3810713-21kworker/0:0+events21:13:050
383055099321,25cyclictest3810713-21kworker/0:0+events20:25:570
3830555993126,4cyclictest4130737-21kworker/u8:2+flush-8:000:39:081
3830555993125,4cyclictest4116067-21kworker/u8:4+flush-8:000:14:081
3830555993123,6cyclictest3922243-21kworker/u8:3+flush-8:021:39:121
3830555993119,8cyclictest3835486-21latency_hist19:15:001
383055099313,24cyclictest3810713-21kworker/0:0+events21:17:140
3830550993123,6cyclictest4072407-21diskstats23:14:020
3830550993123,6cyclictest3877767-21/usr/sbin/munin19:59:150
383055099312,26cyclictest4026631-21kworker/0:2+events23:58:290
383055099312,25cyclictest3810713-21kworker/0:0+events21:00:050
383055099312,24cyclictest4026631-21kworker/0:2+events00:25:330
383055099311,25cyclictest4026631-21kworker/0:2+events00:36:450
383055099311,25cyclictest4026631-21kworker/0:2+events00:00:130
38255482313,9sleep20-21swapper/219:05:032
38968602300,2sleep3471rcuc/320:14:293
3830559993025,4cyclictest3922243-21kworker/u8:3+events_unbound22:24:152
3830559993022,6cyclictest278-21systemd-journal21:05:002
3830555993026,3cyclictest3922243-21kworker/u8:3+flush-8:021:49:151
3830555993025,4cyclictest4064718-21kworker/u8:1+flush-8:023:16:411
3830555993024,5cyclictest4036488-21kworker/u8:0+events_unbound22:49:021
3830555993022,6cyclictest4056299-21latency_hist22:55:011
3830555993022,6cyclictest3922243-21kworker/u8:3+flush-8:021:34:171
3830550993023,5cyclictest4065753-21ntpq23:04:100
383055099302,24cyclictest4026631-21kworker/0:2+events23:50:570
383055099302,23cyclictest4026631-21kworker/0:2+events22:45:530
383055099302,23cyclictest3810713-21kworker/0:0+events21:30:180
383055099302,23cyclictest3810713-21kworker/0:0+events21:06:410
383055099302,22cyclictest3810713-21kworker/0:0+events21:35:210
3830550993020,8cyclictest4136265-21latency_hist00:15:010
3830550993019,9cyclictest3921749-21apt-get20:40:000
3830559992925,3cyclictest3978117-21kthreadcore21:39:072
3830555992925,3cyclictest4096310-21kworker/u8:3+events_unbound23:54:011
3830555992925,3cyclictest2631917-21kworker/u8:2+flush-8:020:30:311
3830555992924,4cyclictest3951677-21kworker/u8:2+flush-8:021:24:151
3830555992923,4cyclictest4001548-21apt-key22:00:001
3830555992921,6cyclictest3916782-21kworker/u8:0+flush-8:021:19:121
383055099293,25cyclictest4026631-21kworker/0:2+events00:24:450
383055099292,26cyclictest4026631-21kworker/0:2+events23:05:300
383055099292,26cyclictest4026631-21kworker/0:2+events22:29:250
383055099292,26cyclictest3810713-21kworker/0:0+events20:45:330
383055099292,26cyclictest3810713-21kworker/0:0+events19:30:490
383055099292,25cyclictest3810713-21kworker/0:0+events20:32:410
383055099292,22cyclictest3810713-21kworker/0:0+events21:45:050
383055099292,22cyclictest3810713-21kworker/0:0+events20:12:370
383055099292,22cyclictest3810713-21kworker/0:0+events19:51:170
3830559992824,2cyclictest4081320-21unixbench_multi23:19:182
3830559992823,3cyclictest4017313-21fschecks_time22:19:052
3830559992822,4cyclictest4031424-21unixbench_singl22:29:182
3830559992821,5cyclictest3966532-21apt-get21:25:012
3830559992820,6cyclictest278-21systemd-journal20:35:002
3830555992823,3cyclictest3850284-21kthreadcore19:29:071
3830550992823,4cyclictest3810908-21kworker/u8:1+flush-8:019:29:020
383055099282,25cyclictest3810713-21kworker/0:0+events21:25:170
383055099282,25cyclictest3810713-21kworker/0:0+events20:58:410
383055099282,25cyclictest3810713-21kworker/0:0+events19:42:010
383055099282,25cyclictest3810713-21kworker/0:0+events19:15:450
383055099282,21cyclictest4026631-21kworker/0:2+events22:35:010
383055099281,26cyclictest4026631-21kworker/0:2+events22:54:450
383055099281,22cyclictest3810713-21kworker/0:0+events20:40:170
383055099281,22cyclictest3810713-21kworker/0:0+events20:15:010
383055099280,23cyclictest3810713-21kworker/0:0+events22:05:290
3830559992723,3cyclictest3931818-21unixbench_singl20:49:172
3830559992723,2cyclictest4007311-21cpuspeed_turbos22:08:582
3830559992722,3cyclictest4072269-21aten2_r5power_v23:14:012
3830559992722,3cyclictest3868026-21aten2_r5power_v19:49:012
3830559992722,3cyclictest3858219-21cpuspeed_turbos19:39:012
3830555992721,4cyclictest4121145-21kworker/u8:0+events_unbound00:34:011
3830555992720,5cyclictest4016629-21kworker/u8:1+events_unbound22:29:101
383055099272,24cyclictest3810713-21kworker/0:0+events21:50:490
383055099272,24cyclictest3810713-21kworker/0:0+events20:51:410
383055099272,24cyclictest3810713-21kworker/0:0+events20:51:410
3830550992720,5cyclictest3847574-21latency_hist19:25:010
383055099271,25cyclictest4026631-21kworker/0:2+events23:25:210
383055099271,21cyclictest4026631-21kworker/0:2+events22:30:090
3830559992622,2cyclictest3902565-21aten2_r5power_c20:23:592
3830559992619,5cyclictest278-21systemd-journal23:30:002
3830555992622,3cyclictest3830767-21kworker/u8:0+flush-8:019:38:401
3830555992621,3cyclictest0-21swapper/123:34:051
383055099262,23cyclictest4026631-21kworker/0:2+events00:16:410
383055099262,23cyclictest3810713-21kworker/0:0+events21:42:490
3830559992522,2cyclictest4001317-21apt-get22:00:002
3830559992520,3cyclictest0-21swapper/221:55:002
3830555992521,3cyclictest4096310-21kworker/u8:3+flush-8:000:00:311
3830555992520,3cyclictest4016403-21idleruntime-cro22:15:001
3830555992519,4cyclictest3951677-21kworker/u8:2+events_unbound23:44:051
3830555992514,8cyclictest278-21systemd-journal20:18:091
383055099252,22cyclictest3810713-21kworker/0:0+events19:37:410
38255682252,6sleep00-21swapper/019:05:170
3830559992419,4cyclictest4130737-21kworker/u8:2+flush-8:000:10:112
3830559992419,3cyclictest0-21swapper/221:30:002
3830555992420,2cyclictest0-21swapper/121:09:061
3830555992418,4cyclictest4064718-21kworker/u8:1+events_unbound23:09:011
3830559992319,3cyclictest4032144-21aten2_r5power_e22:33:592
3830559992319,2cyclictest3883016-21fschecks_count20:04:042
3830559992319,2cyclictest0-21swapper/200:05:012
3830559992318,4cyclictest4130737-21kworker/u8:2+flush-8:000:29:262
3830559992314,7cyclictest3835485-21apt-get19:15:002
3830555992318,3cyclictest3830640-21apt-config19:10:011
3830555992317,5cyclictest4116067-21kworker/u8:4+flush-8:023:59:101
3830559992218,3cyclictest3916782-21kworker/u8:0+flush-8:021:40:062
3830559992216,4cyclictest4141099-21unixbench_singl00:19:182
3830559992216,4cyclictest4112321-21irqcore23:54:062
3830559992214,6cyclictest0-21swapper/221:20:002
3830559992210,2cyclictest40926522sendmail-mta23:34:052
3830559992118,2cyclictest3907824-21fschecks_time20:29:052
3830559992116,3cyclictest4141895-21aten2_r5power_v00:24:022
3830559992116,3cyclictest0-21swapper/219:59:042
383055999209,8cyclictest3890397-21tr20:09:092
383055999207,9cyclictest4096906-21apt-get23:38:592
383055999202,3cyclictest38535172awk19:34:052
383055999202,13cyclictest4050759-21ntpq22:49:122
3830559992016,3cyclictest3872903-21aten2_r5power_c19:54:022
3830559992015,3cyclictest4052536-21irqcore22:54:052
3830559992014,4cyclictest3836130-21kthreadcore19:15:012
3830559991916,2cyclictest3987393-21fschecks_count21:49:022
3830559991915,2cyclictest0-21swapper/220:44:062
3830559991915,2cyclictest0-21swapper/200:34:102
3830559991913,4cyclictest0-21swapper/223:09:072
3830559991910,6cyclictest3935729-21tr20:54:092
3830559991910,6cyclictest3935729-21tr20:54:082
38258832193,9sleep30-21swapper/319:09:013
383055999182,11cyclictest4105672-21ntpq23:44:112
3830559991814,3cyclictest3947329-21aten2_r5power_c21:09:012
3830559991814,3cyclictest3892981-21fschecks_time20:14:052
3830559991812,4cyclictest0-21swapper/219:29:062
3830559991811,5cyclictest4066419-21apt-get23:05:002
40323312177,6sleep30-21swapper/322:34:013
3830559991713,2cyclictest0-21swapper/222:59:162
3830559991713,2cyclictest0-21swapper/200:39:002
38588862167,5sleep30-21swapper/319:39:073
383055999167,7cyclictest4005351-21cut22:04:082
383055999166,8cyclictest3974218-21tr21:34:072
383055999162,2cyclictest0-21swapper/222:43:562
383055999162,2cyclictest0-21swapper/220:55:462
3830559991611,3cyclictest3956477-21unixbench_multi21:14:172
3830559991611,3cyclictest0-21swapper/223:49:062
41507222132,7sleep30-21swapper/300:29:173
40779822132,7sleep30-21swapper/323:19:073
39759112132,7sleep30-21swapper/321:34:113
41511092122,6sleep30-21swapper/300:30:013
41415602122,6sleep30-21swapper/300:21:273
41256972122,6sleep30-21swapper/300:04:173
41103762122,6sleep30-21swapper/323:49:093
41018632122,6sleep30-21swapper/323:44:003
40941092122,6sleep30-21swapper/323:34:083
40864562122,6sleep30-21swapper/323:25:013
40822062122,6sleep30-21swapper/323:24:013
40614962122,6sleep30-21swapper/323:00:013
40370272122,6sleep30-21swapper/322:38:593
40214682121,6sleep30-21swapper/322:20:013
40169352122,6sleep30-21swapper/322:19:013
40157372122,6sleep30-21swapper/322:14:123
40069852122,6sleep30-21swapper/322:08:013
39964312122,5sleep30-21swapper/321:55:013
39815562123,6sleep30-21swapper/321:40:003
39711842122,6sleep30-21swapper/321:29:173
39618772122,6sleep30-21swapper/321:21:073
39472702122,6sleep30-21swapper/321:08:593
39319382122,6sleep30-21swapper/320:50:013
39319382122,6sleep30-21swapper/320:50:013
39208042123,6sleep30-21swapper/320:39:093
39069312122,6sleep30-21swapper/320:25:013
39030342122,6sleep30-21swapper/320:24:053
38975832122,6sleep30-21swapper/320:18:593
38777662122,6sleep30-21swapper/319:58:573
38673722122,6sleep30-21swapper/319:45:013
38669032123,6sleep30-21swapper/319:44:163
38569382122,6sleep30-21swapper/319:34:173
38426752122,6sleep30-21swapper/319:20:013
38385952122,6sleep30-21swapper/319:19:093
38347942122,6sleep30-21swapper/319:14:113
41562942112,6sleep30-21swapper/300:36:033
41404152112,5sleep30-21swapper/300:19:103
41322362112,5sleep30-21swapper/300:14:053
41268552112,6sleep30-21swapper/300:08:473
41163462112,5sleep30-21swapper/323:55:123
41114132112,6sleep30-21swapper/323:50:133
40967142112,5sleep30-21swapper/323:36:493
40719852112,6sleep30-21swapper/323:12:053
40669072112,6sleep30-21swapper/323:05:313
40574712112,6sleep30-21swapper/322:59:053
40516962112,6sleep30-21swapper/322:51:433
40466752112,6sleep30-21swapper/322:45:373
40459882112,5sleep30-21swapper/322:44:163
40308822112,5sleep30-21swapper/322:29:123
40021292112,5sleep30-21swapper/322:04:003
39869382112,6sleep30-21swapper/321:47:113
39819632112,6sleep30-21swapper/321:41:573
39569242112,6sleep30-21swapper/321:15:493
39518842112,5sleep30-21swapper/321:10:033
39272022112,6sleep30-21swapper/320:45:153
39223802112,6sleep30-21swapper/320:42:023
38874532112,6sleep30-21swapper/320:06:153
38726282112,5sleep30-21swapper/319:51:113
38478012112,6sleep30-21swapper/319:25:063
39370522102,5sleep30-21swapper/320:55:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional