You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 05:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue Jun 30, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33648082620,2sleep3481ktimers/323:50:223
33299422620,5chrt0-21swapper/223:15:212
3080559995951,6cyclictest1704890-21systemd-journal23:40:010
33553962520,2sleep20-21swapper/223:40:262
3080559995042,6cyclictest3221927-21kworker/u8:0+flush-8:021:30:310
3080561994840,6cyclictest3186818-21apt-get20:55:011
3080559994842,4cyclictest3059901-21kworker/u8:3+flush-8:020:35:280
3080559994742,4cyclictest3246710-21kworker/u8:1+events_unbound22:35:180
3080565994534,8cyclictest3245780-21ntpq21:50:272
3080561994537,5cyclictest3116099-21ntpq19:40:251
3080559994535,8cyclictest1704890-21systemd-journal21:50:000
3080559994515,18cyclictest3084500-21ntpq19:10:240
31392472440,2sleep10-21swapper/120:05:221
3080559994413,20cyclictest3280700-21ntpq22:25:240
3080561994332,8cyclictest3151014-21ntpq20:15:261
3080559994337,4cyclictest3365211-21ntpq23:50:250
3080559994316,16cyclictest589-21runrttasks23:05:120
3080559994213,18cyclictest3370202-21ntpq23:55:260
3080559994210,10cyclictest589-21runrttasks00:12:150
3080561994127,11cyclictest1704890-21systemd-journal19:59:411
3080559994114,15cyclictest3386740-21/usr/sbin/munin00:15:180
3080559994114,14cyclictest3096392-21ntpq19:20:300
3080559994111,16cyclictest3335565-21ntp_states23:20:290
3080559994111,15cyclictest589-21runrttasks19:15:300
3080561994033,5cyclictest3191982-21apt-get20:59:591
3080561994030,8cyclictest1704890-21systemd-journal22:29:591
3080559994035,3cyclictest1-21systemd20:00:010
3080559994021,9cyclictest3407057-21/usr/sbin/munin00:35:190
3080559994016,9cyclictest3221166-21grep21:25:290
3080559994014,14cyclictest3212375-21aten2_r5power_e21:20:140
3080559994014,14cyclictest3185932-21ntpq20:50:250
3080559994012,17cyclictest3126009-21ntpq19:50:250
3080559994011,21cyclictest3356487-21/usr/sbin/munin23:45:140
3080559994011,17cyclictest3375205-21ntpq00:00:240
308055999399,20cyclictest3147287-21tr20:15:120
3080559993931,6cyclictest3242018-21apt-get21:50:120
3080559993920,10cyclictest3206418-21python321:10:310
3080559993917,4cyclictest3111123-21ntpq19:35:250
3080559993915,9cyclictest589-21runrttasks20:45:140
3080559993914,15cyclictest3340506-21ntp_states23:25:270
3080559993914,14cyclictest3275860-21/usr/sbin/munin22:20:280
3080559993912,18cyclictest3251449-21sshd21:57:350
3080559993911,19cyclictest3141587-21sshd20:07:220
3080559993911,16cyclictest3391594-21grep00:20:110
3080559993910,16cyclictest3342404-21cut23:30:190
3080561993825,10cyclictest1704890-21systemd-journal20:35:401
308055999389,16cyclictest3188574-21cut20:55:230
3080559993817,4cyclictest3266965-21apt-get22:15:120
3080559993817,4cyclictest3266965-21apt-get22:15:120
3080559993817,10cyclictest3136158-21python320:00:300
3080559993815,10cyclictest3376361-21apt-get00:05:120
3080559993813,15cyclictest3406099-21munin-run00:35:010
3080559993813,13cyclictest3232117-21/usr/sbin/munin21:40:130
3080559993812,14cyclictest3255666-21ntpq22:00:260
3080559993812,11cyclictest3142042-21find20:10:120
3080559993811,17cyclictest3261337-21sshd22:07:360
3080559993811,17cyclictest3261337-21sshd22:07:350
3080559993811,16cyclictest3228105-21kthreadcore21:35:200
3080559993810,19cyclictest3315356-21/usr/sbin/munin23:00:240
3080559993810,19cyclictest3265511-21/usr/sbin/munin22:10:240
3080559993810,15cyclictest3296731-21apt22:45:130
3080561993733,2cyclictest3401139-21idleruntime-cro00:30:001
3080561993729,6cyclictest3410985-21latency_hist00:40:001
3080559993716,10cyclictest3305492-21ntpq22:50:240
3080559993715,13cyclictest3152290-21cut20:20:110
3080559993713,14cyclictest3330493-21/usr/sbin/munin23:15:260
3080559993713,13cyclictest589-21runrttasks20:27:080
3080559993713,13cyclictest3107136-21munin-run19:35:000
3080559993712,15cyclictest3325579-21ntpq23:10:260
3080559993712,12cyclictest3101352-21ntpq19:25:300
3080559993712,11cyclictest3112722-21hddtemp_smartct19:40:180
3080559993711,14cyclictest3175775-21/usr/sbin/munin20:40:220
3080559993710,16cyclictest3396795-21perl00:25:190
3080559993710,15cyclictest3196313-21ntp_states21:00:280
3080559993710,12cyclictest3292065-21fschecks_count22:40:170
3080559993710,12cyclictest3166185-21timerandwakeup20:30:320
3080561993629,5cyclictest1704890-21systemd-journal22:55:011
3080561993624,9cyclictest1704890-21systemd-journal21:20:411
3080559993614,10cyclictest3211157-21ntpq21:15:270
3080559993613,11cyclictest3281861-21find22:30:130
3080559993611,13cyclictest3351519-21runrttasks23:40:030
3080565993529,4cyclictest1704890-21systemd-journal22:07:362
3080565993529,4cyclictest1704890-21systemd-journal22:07:352
3080565993527,5cyclictest1704890-21systemd-journal20:24:592
3080565993526,7cyclictest1704890-21systemd-journal23:55:002
3080561993526,6cyclictest1704890-21systemd-journal19:45:391
3080561993524,1cyclictest161rcu_preempt00:00:241
3080559993514,9cyclictest3201213-21ntpq21:05:260
3080559993513,12cyclictest3117312-21aten2_r5power_c19:45:130
3080559993513,10cyclictest3310516-21ntpq22:55:300
3080565993429,3cyclictest3146910-21latency_hist20:15:012
30795792343,3sleep10-21swapper/119:05:281
3080561993329,3cyclictest3147222-21kworker/u8:2+flush-8:021:45:111
308055999338,10cyclictest3080636-21sed19:10:020
3080561993228,2cyclictest3085422-21turbostat.cron19:15:001
3080561993224,6cyclictest3192578-21aten2_r5power_p21:00:151
3080561993224,6cyclictest1704890-21systemd-journal00:32:411
3080561993220,6cyclictest161rcu_preempt22:30:231
3080561993219,8cyclictest3385995-21latency_hist00:15:011
3080561993127,2cyclictest3261533-21turbostat.cron22:10:001
3080561993127,2cyclictest3261533-21turbostat.cron22:10:001
3080561993125,5cyclictest3341408-21idleruntime-cro23:30:011
3080561993125,5cyclictest3251219-21unixbench_multi21:55:331
3080561993125,5cyclictest3222203-21aten2_r5power_c21:30:151
3080561993124,5cyclictest3147222-21kworker/u8:2+flush-8:022:10:351
3080561993124,5cyclictest1704890-21systemd-journal23:17:001
3080561993121,8cyclictest3320595-21ntpq23:05:261
3080561993026,3cyclictest3386548-21aten2_r5power_e00:15:171
3080561993025,3cyclictest3197460-21aten2_r5power_c21:05:151
3080561993022,6cyclictest1704890-21systemd-journal20:35:011
3080561993021,6cyclictest3276669-21latency_hist22:25:001
3080561993020,8cyclictest3146756-21apt-get20:15:001
3080561993015,9cyclictest3357105-21irqcore23:45:171
3080561993014,4cyclictest0-21swapper/122:05:001
3080565992926,2cyclictest3331795-21aten2_r5power_v23:20:152
3080565992925,2cyclictest3316895-21aten2_r5power_p23:05:142
3080565992918,8cyclictest1704890-21systemd-journal23:58:412
3080561992922,5cyclictest3177184-21apt-get20:45:131
3080561992916,4cyclictest3287578-21irqrtprio22:35:191
3080565992822,4cyclictest3166761-21apt-get20:35:002
308056199283,6cyclictest3217436-21tr21:25:141
3080561992822,4cyclictest1704890-21systemd-journal00:20:391
3080561992820,6cyclictest1704890-21systemd-journal19:40:011
3080561992819,7cyclictest1704890-21systemd-journal00:07:391
3080561992818,8cyclictest3351529-21/usr/sbin/munin23:40:231
3080561992817,3cyclictest161rcu_preempt22:45:001
3080565992724,2cyclictest3410583-21unixbench_singl00:35:342
3080565992724,2cyclictest3305920-21unixbench_multi22:50:312
3080565992723,2cyclictest3261828-21aten2_r5power_c22:10:152
3080565992722,3cyclictest3232397-21fschecks_time21:40:172
3080565992716,9cyclictest1704890-21systemd-journal22:00:402
308056199278,9cyclictest3209463-21cat21:15:221
3080561992723,3cyclictest3361693-21sh23:50:161
3080561992723,2cyclictest3159318-21kthreadcore20:25:241
3080561992723,2cyclictest3092279-21cron19:20:001
308056199272,15cyclictest3312401-21irqrtprio23:00:191
3080561992721,4cyclictest3092833-21fschecks_count19:20:171
308056199272,12cyclictest3325432-21needreboot23:10:231
3080561992719,6cyclictest3172225-21apt-get20:40:111
3080561992719,2cyclictest161rcu_preempt20:20:261
31022922260,3sleep375-21kworker/3:1+mm_percpu_wq19:30:013
3080565992623,2cyclictest3297020-21fschecks_count22:45:162
3080565992622,3cyclictest3111055-21tail19:35:232
3080565992622,2cyclictest3325995-21unixbench_multi23:10:332
3080565992622,2cyclictest3112639-21fschecks_count19:40:172
3080565992621,3cyclictest3122456-21cpuspeed_turbos19:50:132
3080565992620,4cyclictest3106653-21unixbench_multi19:30:322
3080565992619,5cyclictest3351501-21cat23:40:002
308056199264,5cyclictest3105850-21kthreadcore19:30:231
308056199263,12cyclictest3297471-21irqrtprio22:45:201
3080561992623,2cyclictest3126937-21systemd-run19:55:011
3080561992622,3cyclictest3231404-21unixbench_singl21:35:331
3080561992621,3cyclictest3370683-21unixbench_singl23:55:321
3080561992621,3cyclictest3101784-21unixbench_singl19:25:351
3080561992620,5cyclictest3206639-21unixbench_multi21:10:311
3080561992610,3cyclictest0-21swapper/120:00:191
308056599259,2cyclictest32405522cut21:45:222
3080565992522,2cyclictest3396457-21aten2_r5power_c00:25:152
3080565992522,2cyclictest3201712-21unixbench_singl21:05:332
3080565992521,2cyclictest3376445-21aten2_r5power_p00:05:112
3080565992520,4cyclictest3280627-21needreboot22:25:212
3080565992520,3cyclictest3202418-21aten2_r5power_c21:10:132
3080565992517,6cyclictest3182400-21cut20:50:152
308056199253,5cyclictest3336619-21latency_hist23:25:021
308056199252,8cyclictest3232299-21cpuspeed_turbos21:40:141
308056199251,8cyclictest3349013-21kthreadcore23:35:201
308056199251,14cyclictest3308450-21runrttasks22:55:231
3080561992511,3cyclictest0-21swapper/123:31:581
3080565992420,3cyclictest3211640-21unixbench_singl21:15:322
3080565992420,2cyclictest3401691-21fschecks_count00:30:162
3080565992420,2cyclictest3172515-21fschecks_count20:40:152
308056199246,4cyclictest3244281-21cut21:50:221
308056199242,12cyclictest30-21ksoftirqd/122:15:221
308056199242,12cyclictest30-21ksoftirqd/122:15:221
3080565992320,2cyclictest3137200-21aten2_r5power_v20:05:152
3080565992319,2cyclictest3391552-21aten2_r5power_v00:20:122
3080565992319,2cyclictest3381548-21cpuspeed_turbos00:10:212
3080565992319,2cyclictest0-21swapper/223:05:012
3080565992219,2cyclictest3080983-21fschecks_count19:10:162
3080565992218,2cyclictest0-21swapper/223:30:012
3080565992218,2cyclictest0-21swapper/219:20:002
3080565992213,6cyclictest3290408-21memory22:35:232
308056599212,13cyclictest3281883-21apt-get22:30:152
308056599206,2cyclictest31343882kthreadcore20:00:212
308056599202,13cyclictest3386490-21apt-get00:15:172
3080565992017,2cyclictest3102165-21cron19:30:012
3080565992016,3cyclictest3227191-21aten2_r5power_p21:35:142
3080565992016,2cyclictest3177297-21aten2_r5power_v20:45:152
3080565992012,3cyclictest3309224-21grep22:55:242
30761392204,9sleep20-21swapper/219:05:172
308056599199,8cyclictest3213527-21tr21:20:222
308056599192,12cyclictest3345394-21ntpq23:30:252
308056599192,11cyclictest3291772-21apt-get22:40:132
3080565991915,2cyclictest0-21swapper/221:00:002
3080565991914,3cyclictest0-21swapper/220:20:002
3080565991912,5cyclictest3197156-21cron21:05:002
30755122193,8sleep30-21swapper/319:05:023
308056599182,12cyclictest3246956-21apt-get21:55:152
308056599182,12cyclictest3217236-21apt-get21:25:142
3080565991713,2cyclictest0-21swapper/200:00:132
3080565991712,2cyclictest0-21swapper/222:20:172
308056599171,11cyclictest3167250-21apt-get20:35:142
308056599166,7cyclictest3222998-21sed21:30:202
3080565991613,2cyclictest0-21swapper/223:45:302
3080565991613,2cyclictest0-21swapper/219:45:072
3080565991612,2cyclictest0-21swapper/219:55:192
3080565991611,3cyclictest0-21swapper/219:20:212
308056599161,11cyclictest3266965-21apt-get22:15:142
308056599161,11cyclictest3266965-21apt-get22:15:132
33205032153,9sleep30-21swapper/323:05:243
3080565991512,2cyclictest0-21swapper/220:25:212
33465732143,7sleep30-21swapper/323:35:103
33063672142,7sleep30-21swapper/322:55:023
31075582142,8sleep30-21swapper/319:35:153
33811902132,6sleep30-21swapper/300:10:013
33562772132,6sleep30-21swapper/323:45:023
33406692132,7sleep30-21swapper/323:25:323
33216422132,6sleep30-21swapper/323:10:023
32924832132,7sleep30-21swapper/322:40:213
32664552132,7sleep30-21swapper/322:15:003
32417432131,8sleep30-21swapper/321:50:003
31909002132,7sleep30-21swapper/320:55:263
31619012132,6sleep30-21swapper/320:30:023
30854072133,6sleep30-21swapper/319:15:013
34063402122,6sleep30-21swapper/300:35:143
34003122123,5sleep30-21swapper/300:25:303
33905672122,6sleep30-21swapper/300:15:363
33783432122,6sleep30-21swapper/300:05:213
33707142122,6sleep30-21swapper/323:55:323
33457112122,6sleep30-21swapper/323:30:333
33325692122,6sleep30-21swapper/323:20:213
33269432122,6sleep30-21swapper/323:15:163
33156102122,7sleep30-21swapper/323:00:303
33066182122,6sleep30-21swapper/322:55:143
32964932122,5sleep30-21swapper/322:45:013
32812022122,6sleep30-21swapper/322:25:313
32742662122,6sleep30-21swapper/322:20:223
32705812123,6sleep30-21swapper/322:15:253
32705812123,6sleep30-21swapper/322:15:243
32468362122,6sleep30-21swapper/321:55:023
32425082122,6sleep30-21swapper/321:50:193
32276012122,6sleep30-21swapper/321:35:193
32219342122,5sleep30-21swapper/321:30:013
32133912122,6sleep30-21swapper/321:20:233
32075862122,6sleep30-21swapper/321:15:163
31824822122,6sleep30-21swapper/320:50:173
31818362122,6sleep30-21swapper/320:49:393
31719302122,5sleep30-21swapper/320:40:013
31608942122,6sleep30-21swapper/320:25:283
31509322122,6sleep30-21swapper/320:15:253
31368482122,5sleep30-21swapper/320:05:023
31329512122,6sleep30-21swapper/320:00:203
31298192122,6sleep30-21swapper/319:55:223
31121012122,5sleep30-21swapper/319:40:023
30929422122,6sleep30-21swapper/319:20:183
34016502112,5sleep30-21swapper/300:30:173
33911762112,5sleep30-21swapper/300:20:013
33760862112,5sleep30-21swapper/300:05:013
33552892112,6sleep30-21swapper/323:40:243
32872902112,5sleep30-21swapper/322:35:193
32854762112,5sleep30-21swapper/322:30:243
32566182112,5sleep30-21swapper/322:05:013
32566182112,5sleep30-21swapper/322:05:003
32519362112,5sleep30-21swapper/322:00:163
32323292112,5sleep30-21swapper/321:40:173
32178202112,5sleep30-21swapper/321:25:203
32024662113,5sleep30-21swapper/321:10:153
31971802112,5sleep30-21swapper/321:05:013
31929302112,5sleep30-21swapper/321:00:193
31722292112,6sleep30-21swapper/320:40:123
31531152112,5sleep30-21swapper/320:20:193
31421512112,5sleep30-21swapper/320:10:153
31226082112,5sleep30-21swapper/319:50:163
31173232112,5sleep30-21swapper/319:45:153
31022922112,5sleep30-21swapper/319:30:023
30867302112,5sleep30-21swapper/319:15:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional