You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 07:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Fri May 01, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
301625123510,6sleep3451irq_work/321:21:143
301625123510,6sleep3451irq_work/321:21:143
31265862730,3chrt201rcuc/023:11:140
31265862730,3chrt201rcuc/023:11:140
30147722600,1sleep03014774-21cat21:21:110
30147722600,1sleep03014774-21cat21:21:110
2882579995749,6cyclictest280-21systemd-journal22:00:010
2882579995651,3cyclictest2908916-21kworker/u8:3+flush-8:023:00:000
2882579995346,5cyclictest2908916-21kworker/u8:3+flush-8:000:06:170
2882579995346,5cyclictest2908916-21kworker/u8:3+events_unbound20:01:180
2882584995245,5cyclictest2908916-21kworker/u8:3+flush-8:020:26:051
2882579995247,4cyclictest2908916-21kworker/u8:3+events_unbound21:01:180
2882579995246,4cyclictest2894995-21kworker/u8:0+events_unbound19:35:000
2882579995246,4cyclictest2894995-21kworker/u8:0+events_unbound19:35:000
2882584995145,5cyclictest2894995-21kworker/u8:0+flush-8:020:46:051
2882584995144,5cyclictest2894995-21kworker/u8:0+flush-8:020:16:171
2882584995045,3cyclictest2894995-21kworker/u8:0+flush-8:021:11:061
2882579995045,3cyclictest3183365-21kworker/u8:2+flush-8:000:16:180
2882579994944,4cyclictest3147496-21kworker/u8:0+flush-8:000:01:160
2882579994844,3cyclictest3083607-21kworker/u8:2+events_unbound22:46:180
2882579994842,4cyclictest3032904-21kworker/u8:0+flush-8:021:51:130
2882579994841,5cyclictest3157435-21kworker/u8:1+flush-8:023:46:170
2882584994740,5cyclictest2908916-21kworker/u8:3+flush-8:020:11:041
2882584994739,5cyclictest280-21systemd-journal22:03:271
2882584994736,8cyclictest3132137-21ntpq23:16:171
2882579994741,4cyclictest2908916-21kworker/u8:3+flush-8:023:10:010
2882584994634,9cyclictest280-21systemd-journal00:35:001
2882579994642,3cyclictest2894995-21kworker/u8:0+flush-8:020:46:170
2882579994640,4cyclictest3122546-21kworker/u8:1+flush-8:023:21:190
2882579994639,5cyclictest2908916-21kworker/u8:3+flush-8:023:51:160
2882584994539,5cyclictest3058375-21kworker/u8:2+flush-8:022:11:071
2882584994533,9cyclictest280-21systemd-journal19:30:001
2882584994533,9cyclictest280-21systemd-journal19:30:001
2882579994540,4cyclictest2908916-21kworker/u8:3+flush-8:023:16:150
2882579994540,3cyclictest3122546-21kworker/u8:1+flush-8:023:31:120
2882579994539,4cyclictest3013632-21kworker/u8:2+flush-8:021:41:200
2882579994538,5cyclictest3058375-21kworker/u8:2+flush-8:022:11:170
2882579994532,10cyclictest2999429-21diskstats21:06:060
2882588994432,9cyclictest2914300-21awk19:40:002
2882584994440,3cyclictest2894995-21kworker/u8:0+flush-8:019:51:191
2882584994439,4cyclictest3147496-21kworker/u8:0+flush-8:000:36:071
2882584994436,6cyclictest3137895-21latency_hist23:25:011
2882584994433,9cyclictest3188394-21/usr/sbin/munin00:21:141
2882584994432,9cyclictest3042755-21ntpq21:46:131
2882584994431,10cyclictest2973217-21ntpq20:36:151
2882579994339,3cyclictest3083607-21kworker/u8:2+events_unbound22:41:190
2882579994338,4cyclictest3083607-21kworker/u8:2+flush-8:022:51:120
2882579994338,4cyclictest2780337-21kworker/u8:2+flush-8:019:26:140
2882579994338,4cyclictest2780337-21kworker/u8:2+flush-8:019:26:140
2882579994338,3cyclictest3137624-21kworker/u8:2+flush-8:023:41:150
2882579994336,5cyclictest2889489-21kworker/u8:3+flush-8:019:16:150
2882579994335,5cyclictest2974103-21latency_hist20:40:010
2882584994234,6cyclictest3032904-21kworker/u8:0+events_unbound21:51:171
2882579994237,4cyclictest2908916-21kworker/u8:3+flush-8:020:21:160
2882579994236,4cyclictest2964465-21kworker/u8:1+events_unbound20:51:130
2882579994235,5cyclictest2894995-21kworker/u8:0+flush-8:019:41:140
2882579994137,3cyclictest3013632-21kworker/u8:2+events_unbound21:26:170
2882579994136,3cyclictest2894995-21kworker/u8:0+events_unbound19:36:140
2882579994136,3cyclictest2041271-21kworker/u8:1+events_unbound19:21:210
2882579994135,4cyclictest3032904-21kworker/u8:0+events_unbound22:16:160
2882579994033,5cyclictest3157435-21kworker/u8:1+flush-8:000:31:170
2882588993930,7cyclictest280-21systemd-journal19:15:002
2882584993934,4cyclictest3147496-21kworker/u8:0+flush-8:023:36:201
2882584993932,5cyclictest3083607-21kworker/u8:2+flush-8:022:36:151
2882579993933,4cyclictest2908916-21kworker/u8:3+events_unbound23:01:090
2882579993930,7cyclictest3062615-21ntpq22:06:140
288257999391,36cyclictest1-21systemd20:00:010
29667272380,6sleep3451irq_work/320:31:103
2882584993832,5cyclictest3058375-21kworker/u8:2+flush-8:022:06:161
2882584993828,7cyclictest280-21systemd-journal23:54:591
2882579993832,4cyclictest2894995-21kworker/u8:0+flush-8:021:11:160
2882579993832,4cyclictest2894995-21kworker/u8:0+events_unbound19:46:060
2882579993830,5cyclictest2908916-21kworker/u8:3+flush-8:021:36:150
2882584993733,3cyclictest2964465-21kworker/u8:1+flush-8:020:41:041
2882584993733,3cyclictest2894995-21kworker/u8:0+flush-8:019:36:051
2882584993732,3cyclictest2894995-21kworker/u8:0+flush-8:019:45:001
2882584993731,4cyclictest3032904-21kworker/u8:0+flush-8:022:31:071
2882579993733,2cyclictest2908916-21kworker/u8:3+events_unbound20:26:140
2882579993731,4cyclictest2908916-21kworker/u8:3+events_unbound20:11:150
2882579993725,9cyclictest3082433-21ntpq22:26:130
2882579993724,10cyclictest280-21systemd-journal23:30:010
2882584993631,3cyclictest3032904-21kworker/u8:0+events_unbound22:16:071
2882579993631,4cyclictest3032904-21kworker/u8:0+events_unbound22:21:160
2882579993628,6cyclictest2894995-21kworker/u8:0+events_unbound21:16:000
2882579993531,3cyclictest3032904-21kworker/u8:0+events_unbound22:01:180
2882579993531,3cyclictest2908916-21kworker/u8:3+flush-8:020:31:070
2882584993430,3cyclictest3122546-21kworker/u8:1+events_unbound23:31:171
2882584993430,3cyclictest2908916-21kworker/u8:3+flush-8:021:06:211
2882584993428,4cyclictest2908916-21kworker/u8:3+flush-8:021:31:111
2882584993428,4cyclictest2041271-21kworker/u8:1+flush-8:019:21:061
2882584993424,7cyclictest2954635-21/usr/sbin/munin20:21:131
2882579993425,7cyclictest2928489-21ntpq19:51:150
2882579993424,8cyclictest3151849-21ntpq23:36:140
2882588993327,4cyclictest3013632-21kworker/u8:2+flush-8:021:31:172
2882584993327,4cyclictest2994221-21apt-get21:01:011
2882584993326,5cyclictest3083607-21kworker/u8:2+events_unbound22:46:081
2882584993325,6cyclictest3183457-21apt-get00:15:571
2882584993325,6cyclictest3147496-21kworker/u8:0+events_unbound00:01:191
2882579993329,3cyclictest2863033-21kworker/u8:0+flush-8:019:11:200
2882579993326,5cyclictest3157435-21kworker/u8:1+flush-8:000:26:140
2882579993326,5cyclictest2894995-21kworker/u8:0+events_unbound20:16:070
2882579993325,6cyclictest3013632-21kworker/u8:2+flush-8:021:46:140
2882584993227,3cyclictest3168175-21cpuspeed_turbos23:56:061
2882584993226,4cyclictest3013632-21kworker/u8:2+flush-8:021:26:151
2882579993227,3cyclictest3083607-21kworker/u8:2+events_unbound22:36:160
2882588993127,3cyclictest2863033-21kworker/u8:0+flush-8:019:15:052
2882588993123,5cyclictest2949177-21cat20:15:002
2882588993121,8cyclictest280-21systemd-journal20:04:592
2882584993126,4cyclictest2041271-21kworker/u8:1+events_unbound19:16:031
2882584993122,6cyclictest2882416-21latency_hist19:10:011
2882584993120,8cyclictest280-21systemd-journal21:59:351
2882579993127,3cyclictest2894995-21kworker/u8:0+flush-8:020:41:190
2882579993125,4cyclictest3157435-21kworker/u8:1+flush-8:023:56:070
2882584993026,2cyclictest3140383-21kthreadcore23:26:101
2882584993025,4cyclictest2894995-21kworker/u8:0+flush-8:020:06:451
2882584993021,6cyclictest2988899-21latency_hist20:55:011
2882584992925,3cyclictest2780337-21kworker/u8:2+events_unbound19:31:081
2882584992925,3cyclictest2780337-21kworker/u8:2+events_unbound19:31:071
2882584992924,4cyclictest2964465-21kworker/u8:1+flush-8:020:56:221
2882584992924,4cyclictest2894995-21kworker/u8:0+flush-8:019:56:051
2882584992922,5cyclictest3157435-21kworker/u8:1+events_unbound23:46:071
2882584992922,5cyclictest280-21systemd-journal23:05:341
2882584992920,7cyclictest280-21systemd-journal23:10:041
2882584992920,7cyclictest280-21systemd-journal23:10:041
2882584992916,10cyclictest3113278-21apt-get23:01:031
2882579992926,2cyclictest2894995-21kworker/u8:0+events_unbound20:56:010
2882579992924,3cyclictest3193074-21systemd-run00:25:000
2882579992924,3cyclictest2908916-21kworker/u8:3+events_unbound00:15:010
2882579992923,4cyclictest2908916-21kworker/u8:3+flush-8:020:06:110
2882579992919,7cyclictest3027879-21ntpq21:31:150
2882588992824,2cyclictest2898859-21unixbench_multi19:21:192
2882588992823,3cyclictest2978631-21unixbench_multi20:41:192
2882584992824,3cyclictest3157435-21kworker/u8:1+flush-8:000:26:201
2882584992824,3cyclictest3083331-21systemd-run22:30:001
2882584992823,4cyclictest2908916-21kworker/u8:3+flush-8:020:31:161
2882584992821,5cyclictest2908916-21kworker/u8:3+flush-8:021:21:191
2882584992821,5cyclictest2908916-21kworker/u8:3+flush-8:021:21:191
2882584992821,5cyclictest2894995-21kworker/u8:0+flush-8:021:16:201
2882584992723,3cyclictest401-21dbus-daemon21:45:011
2882584992722,3cyclictest2908916-21kworker/u8:3+events_unbound22:45:001
2882588992623,2cyclictest3059141-21fschecks_time22:06:052
2882588992623,2cyclictest2989334-21aten2_r5power_v20:56:042
2882588992622,2cyclictest2899810-21tr19:26:042
2882588992622,2cyclictest2899810-21tr19:26:042
2882588992619,5cyclictest3112928-21cat23:00:002
2882584992621,4cyclictest2894995-21kworker/u8:0+events_unbound19:46:161
2882588992521,3cyclictest3122427-21unixbench_multi23:06:222
2882588992521,2cyclictest3019308-21aten2_r5power_p21:26:032
2882588992521,2cyclictest2949810-21fschecks_time20:16:062
2882588992515,8cyclictest3088276-21awk22:35:002
2882584992521,2cyclictest3156792-21strings23:41:131
2882584992520,4cyclictest3083607-21kworker/u8:2+flush-8:022:51:161
2882579992521,3cyclictest2908916-21kworker/u8:3+events_unbound22:30:520
2882588992421,2cyclictest2904547-21aten2_r5power_e19:31:032
2882588992421,2cyclictest2904547-21aten2_r5power_e19:31:032
2882588992420,2cyclictest2939639-21aten2_r5power_e20:06:032
2882588992420,2cyclictest0-21swapper/221:15:002
2882584992421,2cyclictest3068480-21kworker/u8:1+events_unbound22:21:041
2882584992420,3cyclictest2887456-21systemd-run19:15:001
2882584992419,3cyclictest2908916-21kworker/u8:3+events_unbound21:36:171
288258899233,14cyclictest3133271-21apt-get23:21:022
2882579992317,4cyclictest3147496-21kworker/u8:0+flush-8:000:36:110
2882588992219,2cyclictest3093600-21aten2_r5power_c22:41:032
2882588992219,2cyclictest2979573-21cpuspeed_turbos20:46:022
2882588992218,3cyclictest3103082-21turbostat.cron22:50:002
2882588992218,2cyclictest3158264-21cpuspeed_turbos23:46:072
2882588992218,2cyclictest0-21swapper/222:21:132
2882588992217,4cyclictest20977-21cron20:25:002
2882584992218,3cyclictest2908916-21kworker/u8:3+events_unbound20:01:161
288258899219,4cyclictest0-21swapper/200:36:162
2882588992118,2cyclictest3029407-21fschecks_time21:36:062
2882588992115,2cyclictest0-21swapper/223:01:152
2882584992114,6cyclictest3083607-21kworker/u8:2+flush-8:022:56:151
28823832212,13sleep00-21swapper/019:09:490
288258899202,17cyclictest0-21swapper/222:51:212
2882588992017,2cyclictest3009392-21aten2_r5power_p21:16:022
2882588992014,2cyclictest0-21swapper/221:46:012
2882588992011,7cyclictest2988895-21turbostat.cron20:55:002
2882584992012,6cyclictest3177885-21apt-get00:06:011
28816912204,9sleep20-21swapper/219:06:182
31228082198,5sleep30-21swapper/323:10:023
288258899192,16cyclictest0-21swapper/220:26:192
2882588991916,2cyclictest3188638-21cpuspeed_turbos00:21:042
2882588991916,2cyclictest2924977-21fschecks_count19:51:062
2882588991915,3cyclictest2908916-21kworker/u8:3+flush-8:019:56:192
2882588991915,2cyclictest0-21swapper/222:01:192
2882588991914,4cyclictest3142827-21cron23:30:012
2882588991914,3cyclictest0-21swapper/219:50:012
2882588991911,6cyclictest3162917-21sshd23:50:352
2882588991911,6cyclictest3080416-21tr22:26:092
2882588991911,6cyclictest2973565-21sed20:36:212
2882588991910,7cyclictest2995290-21tr21:01:092
28777612193,8sleep30-21swapper/319:05:023
288258899188,8cyclictest3052193-21tr21:56:122
2882588991815,2cyclictest3069005-21cpuspeed_turbos22:16:042
2882588991815,2cyclictest0-21swapper/200:06:222
2882588991814,2cyclictest3088680-21aten2_r5power_p22:36:032
2882588991814,2cyclictest0-21swapper/220:31:182
2882588991814,2cyclictest0-21swapper/200:01:152
2882588991713,2cyclictest0-21swapper/223:31:142
2882588991713,2cyclictest0-21swapper/200:16:102
2882588991712,3cyclictest0-21swapper/223:16:122
2882588991710,5cyclictest3014770-21seq21:21:112
2882588991710,5cyclictest3014770-21seq21:21:102
288258899167,7cyclictest3064583-21sed22:11:082
288258899162,13cyclictest0-21swapper/221:51:112
288258899162,13cyclictest0-21swapper/221:06:282
288258899162,13cyclictest0-21swapper/219:41:042
288258899162,13cyclictest0-21swapper/200:12:322
2882588991613,2cyclictest0-21swapper/223:56:222
2882588991613,2cyclictest0-21swapper/223:10:492
2882588991613,2cyclictest0-21swapper/223:10:492
2882588991613,2cyclictest0-21swapper/200:33:162
2882588991612,2cyclictest0-21swapper/223:41:212
2882588991612,2cyclictest0-21swapper/223:36:152
2882588991612,2cyclictest0-21swapper/200:26:112
2882584991613,2cyclictest0-21swapper/100:11:121
31083442152,8sleep30-21swapper/322:56:003
29173932150,5sleep30-21swapper/319:41:093
30087352142,7sleep30-21swapper/321:15:013
2882588991410,2cyclictest0-21swapper/221:41:092
31930872132,6sleep30-21swapper/300:25:023
31726032132,6sleep30-21swapper/300:00:023
31380312132,6sleep30-21swapper/323:25:023
31302852132,6sleep30-21swapper/323:16:123
31072552132,7sleep30-21swapper/322:51:203
30328222132,7sleep30-21swapper/321:36:143
29993362133,7sleep30-21swapper/321:06:063
29793242132,7sleep30-21swapper/320:45:593
29393262132,6sleep30-21swapper/320:05:023
32029262122,5sleep30-21swapper/300:35:013
31822352122,6sleep30-21swapper/300:06:363
31717872122,6sleep30-21swapper/323:56:193
31530902123,5sleep30-21swapper/323:41:043
31518182122,6sleep30-21swapper/323:36:143
31178712122,6sleep30-21swapper/323:05:003
30982212122,5sleep30-21swapper/322:45:023
30940652122,6sleep30-21swapper/322:41:073
30927252120,3sleep375-21kworker/3:1+events22:36:223
30845222123,6sleep30-21swapper/322:31:093
30817272123,5sleep30-21swapper/322:26:113
30740152122,6sleep30-21swapper/322:21:063
30485752122,5sleep30-21swapper/321:55:013
30477572122,6sleep30-21swapper/321:51:153
30387852122,5sleep30-21swapper/321:45:023
30196732122,6sleep30-21swapper/321:26:083
29901182122,6sleep30-21swapper/320:56:113
29767552122,6sleep30-21swapper/320:41:103
29714052122,6sleep30-21swapper/320:36:113
29585832123,5sleep30-21swapper/320:21:193
29491562122,5sleep30-21swapper/320:15:013
29301392122,6sleep30-21swapper/319:56:073
29249572122,6sleep30-21swapper/319:51:063
29235432122,6sleep30-21swapper/319:46:193
29033942122,6sleep30-21swapper/319:26:183
29033942122,6sleep30-21swapper/319:26:183
28945932122,6sleep30-21swapper/319:21:003
28904982122,6sleep30-21swapper/319:16:103
31985202112,5sleep30-21swapper/300:31:083
31884512112,5sleep30-21swapper/300:21:043
31837062112,5sleep30-21swapper/300:16:033
31830322112,6sleep30-21swapper/300:13:493
31628742112,5sleep30-21swapper/323:50:023
31583312112,5sleep30-21swapper/323:46:093
31431332112,6sleep30-21swapper/323:31:003
31373352112,5sleep30-21swapper/323:21:213
31233882112,5sleep30-21swapper/323:11:063
31233882112,5sleep30-21swapper/323:11:063
30687282112,6sleep30-21swapper/322:15:363
30637252112,5sleep30-21swapper/322:10:023
30590672112,5sleep30-21swapper/322:06:053
30542002112,5sleep30-21swapper/322:01:073
30239582112,5sleep30-21swapper/321:30:013
30095562112,5sleep30-21swapper/321:16:053
29982412112,6sleep30-21swapper/321:01:203
29845292112,5sleep30-21swapper/320:51:043
29598432112,5sleep30-21swapper/320:26:053
29444542112,5sleep30-21swapper/320:10:363
29382392112,5sleep30-21swapper/320:01:133
29082442112,5sleep30-21swapper/319:31:153
29082442112,5sleep30-21swapper/319:31:143
28830482112,5sleep30-21swapper/319:11:053
30343012102,5sleep30-21swapper/321:41:053
29095602102,5sleep30-21swapper/319:35:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional