You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 04:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue Apr 28, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
389534921500,5sleep30-21swapper/300:16:143
3588306995955,3cyclictest2117976-21kworker/u8:2+events_unbound19:36:211
3588306995854,3cyclictest3709269-21kworker/u8:1+events_unbound22:11:201
3588303995644,9cyclictest3788954-21diskstats22:31:060
3588306995552,2cyclictest3853120-21kworker/u8:3+events_unbound23:46:201
3588306995552,2cyclictest3777688-21kworker/u8:0+events_unbound23:06:101
3588306995551,3cyclictest3614944-21kworker/u8:3+events_unbound21:06:201
3588306995550,4cyclictest3768644-21kworker/u8:2+events_unbound22:16:201
3588303995445,6cyclictest3887807-21latency_hist00:10:010
3588306995248,3cyclictest2739554-21kworker/u8:0+events_unbound19:11:121
3588306995246,4cyclictest3877877-40logrotate00:00:011
3588303995243,7cyclictest3734280-21/usr/sbin/munin21:36:160
3588306995143,6cyclictest3629773-21latency_hist19:50:011
3588306995046,3cyclictest3777688-21kworker/u8:0+events_unbound23:26:211
3588306995046,3cyclictest3777688-21kworker/u8:0+events_unbound23:26:211
3588306995046,3cyclictest3614944-21kworker/u8:3+events_unbound22:06:161
3588306995040,7cyclictest3901860-21ntpq00:21:201
3588306994940,6cyclictest3757865-21ntpq21:56:171
3588306994845,2cyclictest3614944-21kworker/u8:3+events_unbound20:11:261
3588306994844,3cyclictest2739554-21kworker/u8:0+events_unbound19:26:231
3588303994842,5cyclictest3689255-21kworker/u8:0+flush-8:021:56:220
3588306994744,2cyclictest3614944-21kworker/u8:3+events_unbound20:56:051
3588306994743,3cyclictest3853120-21kworker/u8:3+events_unbound23:51:071
3588306994743,3cyclictest3843247-21kworker/u8:1+events_unbound00:06:261
3588306994743,3cyclictest3812675-21kworker/u8:3+events_unbound22:56:191
3588306994743,3cyclictest3709269-21kworker/u8:1+events_unbound21:20:391
3588306994743,3cyclictest3709269-21kworker/u8:1+events_unbound21:16:231
3588306994743,3cyclictest3614944-21kworker/u8:3+events_unbound20:26:101
3588306994740,5cyclictest3857871-21latency_hist23:40:001
3588303994738,6cyclictest3684279-21latency_hist20:45:010
3588306994643,2cyclictest3614944-21kworker/u8:3+events_unbound21:01:091
3588306994642,3cyclictest3878121-21kworker/u8:3+events_unbound00:36:161
3588306994642,3cyclictest3777688-21kworker/u8:0+events_unbound23:16:061
3588306994642,3cyclictest3709269-21kworker/u8:1+events_unbound21:31:221
3588306994642,3cyclictest3709269-21kworker/u8:1+events_unbound21:11:111
3588306994642,3cyclictest3614944-21kworker/u8:3+events_unbound20:21:131
3588306994642,3cyclictest2739554-21kworker/u8:0+events_unbound19:21:101
3588306994635,9cyclictest3743007-21ntpq21:41:161
3588303994641,4cyclictest3853120-21kworker/u8:3+flush-8:023:46:120
3588303994640,4cyclictest3798842-21diskstats22:41:040
3588303994638,5cyclictest3743894-21latency_hist21:45:000
3588303994636,8cyclictest280-21systemd-journal21:20:000
3588309994535,7cyclictest3887809-21awk00:10:002
3588306994541,3cyclictest3843247-21kworker/u8:1+events_unbound23:31:061
3588306994541,3cyclictest3777688-21kworker/u8:0+events_unbound22:41:071
3588303994537,6cyclictest280-21systemd-journal22:20:010
3588306994440,3cyclictest3812675-21kworker/u8:3+events_unbound23:01:191
3588306994440,3cyclictest3614944-21kworker/u8:3+events_unbound20:31:211
3588306994339,3cyclictest3614944-21kworker/u8:3+events_unbound21:51:071
3588306994339,3cyclictest3614944-21kworker/u8:3+events_unbound21:26:101
3588306994339,3cyclictest3614944-21kworker/u8:3+events_unbound19:51:071
3588306994339,3cyclictest3614944-21kworker/u8:3+events_unbound19:51:061
3588306994339,3cyclictest2117976-21kworker/u8:2+events_unbound20:06:201
3588306994334,7cyclictest3888110-21/usr/sbin/munin00:11:161
3588303994333,8cyclictest3853465-21diskstats23:36:050
3588306994239,2cyclictest3822955-21kworker/u8:2+events_unbound23:11:251
3588306994239,2cyclictest3614944-21kworker/u8:3+events_unbound19:56:081
3588306994238,3cyclictest3768644-21kworker/u8:2+events_unbound22:51:251
3588306994238,3cyclictest3614944-21kworker/u8:3+events_unbound22:01:101
3588306994238,3cyclictest3614944-21kworker/u8:3+events_unbound21:46:061
3588306994238,3cyclictest3614944-21kworker/u8:3+events_unbound21:46:061
3588306994234,6cyclictest280-21systemd-journal21:40:001
3588306994232,8cyclictest3623982-21ntpq19:41:161
3588303994235,6cyclictest3843247-21kworker/u8:1+flush-8:023:56:170
3588306994137,3cyclictest3878121-21kworker/u8:3+events_unbound00:31:211
3588303994137,3cyclictest3614944-21kworker/u8:3+flush-8:020:01:130
3588303994135,4cyclictest3614944-21kworker/u8:3+flush-8:021:01:080
3588303994131,8cyclictest3907589-21apt-get00:30:000
3588309994029,8cyclictest3659350-21awk20:20:012
3588306994036,3cyclictest3822955-21kworker/u8:2+events_unbound00:01:171
3588306994036,3cyclictest3674389-21kworker/u8:1+events_unbound20:36:071
3588306994036,3cyclictest3614944-21kworker/u8:3+events_unbound20:52:381
3588303994035,3cyclictest3614944-21kworker/u8:3+flush-8:022:06:130
3588303994030,8cyclictest3713086-21ntpq21:11:170
3588306993935,3cyclictest3614944-21kworker/u8:3+events_unbound20:00:391
3588303993935,3cyclictest3614944-21kworker/u8:3+flush-8:020:21:070
3588303993929,8cyclictest3843596-21diskstats23:26:070
3588303993929,8cyclictest3843596-21diskstats23:26:060
3588306993832,4cyclictest280-21systemd-journal22:25:001
3588306993828,3cyclictest3838390-21apt-get23:21:041
3588309993731,4cyclictest2739554-21kworker/u8:0+events_unbound19:15:032
3588306993733,3cyclictest3777688-21kworker/u8:0+events_unbound22:46:101
3588306993733,3cyclictest2117976-21kworker/u8:2+events_unbound19:17:021
3588306993727,8cyclictest280-21systemd-journal22:33:271
3588303993732,4cyclictest3812675-21kworker/u8:3+flush-8:023:01:070
3588303993729,6cyclictest280-21systemd-journal19:30:000
3588303993722,4cyclictest0-21swapper/021:21:060
3588309993630,4cyclictest3907801-21base6400:30:012
3588306993632,3cyclictest3887520-21kworker/u8:0+events_unbound00:16:091
3588306993632,3cyclictest3822955-21kworker/u8:2+events_unbound23:43:391
3588306993632,3cyclictest3614944-21kworker/u8:3+events_unbound20:15:381
3588303993632,3cyclictest3614944-21kworker/u8:3+flush-8:020:11:070
3588303993631,4cyclictest2117976-21kworker/u8:2+flush-8:020:51:220
3588303993630,4cyclictest2117976-21kworker/u8:2+flush-8:020:36:120
3588303993627,6cyclictest3818290-21latency_hist23:00:010
3588309993530,3cyclictest2117976-21kworker/u8:2+flush-8:019:21:262
3588306993531,3cyclictest3822955-21kworker/u8:2+events_unbound00:28:391
3588306993531,3cyclictest3768644-21kworker/u8:2+events_unbound22:35:371
3588306993531,3cyclictest2117976-21kworker/u8:2+events_unbound20:46:381
3588303993530,4cyclictest2117976-21kworker/u8:2+flush-8:020:06:080
3588303993530,3cyclictest3699173-21systemd-run21:00:000
3588306993430,3cyclictest3614944-21kworker/u8:3+events_unbound20:40:391
35879482344,10sleep10-21swapper/119:07:451
3588303993328,4cyclictest3822955-21kworker/u8:2+flush-8:000:11:220
3588303993328,3cyclictest3659422-21apt-config20:20:010
3588303993328,3cyclictest3614944-21kworker/u8:3+flush-8:019:46:120
3588303993327,4cyclictest3777688-21kworker/u8:0+events_unbound23:31:100
3588309993228,3cyclictest3867985-21sh23:50:002
3588309993223,6cyclictest3724150-21cat21:25:012
3588306993228,3cyclictest2117976-21kworker/u8:2+events_unbound19:31:251
3588303993228,3cyclictest3614944-21kworker/u8:3+events_unbound19:51:230
3588303993228,3cyclictest3614944-21kworker/u8:3+events_unbound19:51:230
3588303993227,3cyclictest3768644-21kworker/u8:2+events_unbound22:51:230
3588303993226,4cyclictest3614944-21kworker/u8:3+events_unbound19:56:060
3588303993126,3cyclictest3833103-21idleruntime-cro23:15:000
3588303993125,5cyclictest3614944-21kworker/u8:3+flush-8:022:01:170
3588303993123,5cyclictest2117976-21kworker/u8:2+events_unbound19:16:050
3588306993026,3cyclictest3709269-21kworker/u8:1+events_unbound22:27:521
3588303993025,4cyclictest3777688-21kworker/u8:0+flush-8:022:46:120
3588303993025,3cyclictest3605049-21cron19:25:000
3588303993023,5cyclictest280-21systemd-journal00:33:450
3588303993021,7cyclictest3749148-21/usr/sbin/munin21:51:170
3588309992924,4cyclictest3614944-21kworker/u8:3+flush-8:020:21:102
3588303992925,2cyclictest3858435-21tr23:41:060
3588303992922,5cyclictest3614944-21kworker/u8:3+flush-8:021:26:190
3588303992918,8cyclictest280-21systemd-journal00:25:010
3588309992824,3cyclictest1-21systemd22:55:002
3588303992824,2cyclictest3843025-21idleruntime-cro23:25:000
3588303992822,4cyclictest2117976-21kworker/u8:2+flush-8:019:31:180
3588303992821,5cyclictest280-21systemd-journal22:15:010
3588309992723,2cyclictest3828557-21aten2_r5power_e23:11:062
3588309992722,3cyclictest3822910-21unixbench_singl23:01:232
3588309992721,4cyclictest3729367-21apt-get21:31:012
3588303992722,3cyclictest3878121-21kworker/u8:3+flush-8:000:36:130
3588309992623,2cyclictest3743554-21unixbench_singl21:41:232
3588309992622,2cyclictest3853301-21aten2_r5power_p23:36:032
3588309992622,2cyclictest3788030-21unixbench_singl22:26:232
3588309992622,2cyclictest3640209-21cpuspeed_turbos20:01:062
3588309992621,3cyclictest3802838-21unixbench_multi22:41:212
3588303992622,3cyclictest3822955-21kworker/u8:2+events_unbound00:01:060
3588303992621,4cyclictest3843247-21kworker/u8:1+flush-8:023:55:010
3588303992620,4cyclictest3670046-21cut20:31:080
3588303992620,4cyclictest2117976-21kworker/u8:2+flush-8:020:46:270
3588309992522,2cyclictest3823677-21aten2_r5power_v23:06:062
3588309992522,2cyclictest3744434-21cpuspeed_turbos21:46:072
3588309992522,2cyclictest3744434-21cpuspeed_turbos21:46:072
3588309992521,2cyclictest3769162-21cpuspeed_turbos22:11:052
3588309992521,2cyclictest3605495-21aten2_r5power_v19:26:052
3588309992520,4cyclictest3614944-21kworker/u8:3+flush-8:020:56:212
3588309992520,3cyclictest3753395-21unixbench_multi21:51:252
3588303992522,2cyclictest3795800-21kthreadcore22:36:130
3588303992521,3cyclictest1-21systemd19:15:010
3588303992520,4cyclictest3614944-21kworker/u8:3+flush-8:021:31:110
3588303992518,5cyclictest3828175-21latency_hist23:10:010
3588303992517,6cyclictest280-21systemd-journal22:29:590
3588303992516,7cyclictest3708169-21ntpq21:06:140
3588309992420,3cyclictest3778148-21unixbench_singl22:16:222
3588309992419,4cyclictest3847608-21unixbench_singl23:26:242
3588309992419,4cyclictest3847608-21unixbench_singl23:26:242
3588309992418,4cyclictest3897707-21sendmail00:20:002
3588309992417,5cyclictest280-21systemd-journal19:15:002
3588303992420,3cyclictest2117976-21kworker/u8:2+events_unbound19:41:160
3588303992419,3cyclictest3619888-21systemctl19:39:590
3588303992418,4cyclictest3777688-21kworker/u8:0+flush-8:022:21:140
3588303992418,4cyclictest3666995-21tr20:26:120
358830999237,2cyclictest0-21swapper/221:06:092
3588309992320,2cyclictest3714372-21aten2_r5power_p21:16:062
3588309992316,5cyclictest3822955-21kworker/u8:2+flush-8:023:16:232
3588309992316,5cyclictest3620232-21apt-get19:41:022
3588309992314,7cyclictest280-21systemd-journal19:50:002
3588309992312,2cyclictest421rcuog/223:56:042
3588303992318,3cyclictest3897333-21unixbench_multi00:16:240
3588303992317,4cyclictest3777688-21kworker/u8:0+flush-8:023:16:130
3588303992316,5cyclictest3614944-21kworker/u8:3+flush-8:021:49:520
3588303992316,5cyclictest3614944-21kworker/u8:3+flush-8:021:49:520
39177002220,3sleep2371rcuc/200:39:592
358830999222,14cyclictest3689568-21apt-get20:51:062
3588309992219,2cyclictest3634710-21munin-plugin-st19:55:002
3588309992219,2cyclictest3634710-21munin-plugin-st19:55:002
3588309992218,2cyclictest3843013-21turbostat.cron23:24:592
3588309992218,2cyclictest0-21swapper/222:36:152
3588309992117,3cyclictest3614944-21kworker/u8:3-ext4-rsv-conversion20:00:002
3588309992117,2cyclictest3754456-21fschecks_time21:56:092
3588309992117,2cyclictest0-21swapper/221:01:102
3588309992116,3cyclictest0-21swapper/220:40:002
3588309992114,5cyclictest3680028-21grep20:41:072
3588309992017,2cyclictest3728654-21unixbench_multi21:26:222
3588309992016,2cyclictest3858569-21fschecks_time23:41:092
3588309992016,2cyclictest0-21swapper/220:26:192
3588309992013,5cyclictest280-21systemd-journal21:38:252
3588309991915,2cyclictest0-21swapper/222:21:172
3588309991915,2cyclictest0-21swapper/219:40:002
3588309991914,3cyclictest0-21swapper/222:46:232
3588309991911,6cyclictest3764876-21sed22:06:112
35834642193,8sleep30-21swapper/319:05:023
358830999189,7cyclictest3900129-21tr00:21:152
358830999187,9cyclictest3882857-21seq00:04:592
358830999182,6cyclictest0-21swapper/220:11:202
3588309991815,2cyclictest0-21swapper/223:31:212
3588309991814,2cyclictest0-21swapper/222:31:152
3588309991814,2cyclictest0-21swapper/220:31:112
3588309991814,2cyclictest0-21swapper/219:31:152
358830999180,16cyclictest3688165-21grep20:46:152
35832652183,9sleep20-21swapper/219:05:012
358830999179,6cyclictest3890990-21tr00:11:142
358830999178,6cyclictest3813815-21cpuspeed22:56:072
3588309991713,2cyclictest0-21swapper/222:01:062
358830999167,7cyclictest3646377-21cut20:06:122
3588309991611,3cyclictest0-21swapper/221:11:132
358830999161,11cyclictest3908150-21apt-get00:31:052
358830999152,4cyclictest0-21swapper/223:52:262
35835332152,7sleep00-21swapper/019:05:560
38434072130,2sleep3481ktimers/323:26:063
38434072130,2sleep3481ktimers/323:26:063
38380262132,6sleep30-21swapper/323:20:013
38024082134,5sleep30-21swapper/322:41:163
37290642132,6sleep30-21swapper/321:30:013
37131482132,7sleep30-21swapper/321:11:193
37082552132,7sleep30-21swapper/321:06:183
36944162132,6sleep30-21swapper/320:55:023
36850802134,5sleep30-21swapper/320:46:113
36695112132,6sleep30-21swapper/320:30:023
36396232132,6sleep30-21swapper/319:59:593
36093482132,7sleep30-21swapper/319:26:223
39086442120,8sleep30-21swapper/300:31:113
39026932122,5sleep30-21swapper/300:25:013
38980562122,6sleep30-21swapper/300:21:073
38818532122,6sleep30-21swapper/300:01:143
38732322122,6sleep30-21swapper/323:56:043
38680342122,6sleep30-21swapper/323:50:023
38615392122,6sleep30-21swapper/323:41:153
38574542122,6sleep30-21swapper/323:36:223
38485212122,6sleep30-21swapper/323:31:083
38393402122,6sleep30-21swapper/323:21:133
38281942122,5sleep30-21swapper/323:10:013
38272522122,6sleep30-21swapper/323:06:153
38032402122,5sleep30-21swapper/322:45:013
37941102122,6sleep30-21swapper/322:36:113
37825662122,6sleep30-21swapper/322:21:183
37784762122,5sleep30-21swapper/322:20:013
37680972122,6sleep30-21swapper/322:06:253
37630552122,6sleep30-21swapper/322:01:223
37554472122,6sleep30-21swapper/321:56:143
37531742122,6sleep30-21swapper/321:51:243
37442312122,6sleep30-21swapper/321:46:063
37442312122,6sleep30-21swapper/321:46:053
37437472122,6sleep30-21swapper/321:43:263
37348042122,6sleep30-21swapper/321:36:113
37196122122,6sleep30-21swapper/321:21:103
37037792122,6sleep30-21swapper/321:01:233
36898122122,6sleep30-21swapper/320:51:093
36822802122,6sleep30-21swapper/320:41:143
36603052122,6sleep30-21swapper/320:21:113
36547662122,6sleep30-21swapper/320:16:063
36446182122,6sleep30-21swapper/320:05:023
36304682122,6sleep30-21swapper/319:51:103
36304682122,6sleep30-21swapper/319:51:103
36257572122,6sleep30-21swapper/319:46:123
36206852122,6sleep30-21swapper/319:41:103
36028372122,6sleep30-21swapper/319:21:163
35934252122,5sleep30-21swapper/319:15:023
39169342112,5sleep30-21swapper/300:36:213
38883852112,5sleep30-21swapper/300:11:093
38869162112,5sleep30-21swapper/300:06:183
38633662112,5sleep30-21swapper/323:46:053
38185252112,5sleep30-21swapper/323:00:023
38173652112,5sleep30-21swapper/322:56:173
38087642112,5sleep30-21swapper/322:51:103
37887092112,5sleep30-21swapper/322:31:053
37844622112,5sleep30-21swapper/322:26:113
37689032113,5sleep30-21swapper/322:10:503
37281672112,5sleep30-21swapper/321:26:163
37142892114,4sleep30-21swapper/321:16:053
36746362112,5sleep30-21swapper/320:35:363
36685882112,5sleep30-21swapper/320:26:173
36503752112,5sleep30-21swapper/320:11:123
36173632112,5sleep30-21swapper/319:36:133
36139382112,5sleep30-21swapper/319:31:153
35919192112,5sleep30-21swapper/319:11:163
36398832102,5sleep30-21swapper/320:00:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional