You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 00:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Wed Jul 01, 2026 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3235377997460,7cyclictest231ktimers/109:45:011
3235377997460,7cyclictest231ktimers/109:45:011
3235375996962,5cyclictest0-21swapper/010:25:010
3235380996517,21cyclictest3247045-21/usr/sbin/munin08:15:162
3235375995950,6cyclictest0-21swapper/010:40:100
323537599547,17cyclictest14-21rcu_preempt12:10:010
323537599547,17cyclictest14-21rcu_preempt12:10:010
3235377995329,14cyclictest0-21swapper/108:35:001
3235377995313,10cyclictest22-21rcuc/110:50:011
323537799513,32cyclictest24-21ksoftirqd/112:05:131
323537599519,19cyclictest3245916-21apt-get08:10:020
3235380995038,9cyclictest3261307-21http09:40:002
323537799509,17cyclictest24-21ksoftirqd/109:25:011
3235380994941,5cyclictest3258679-21munin-run09:25:002
3235377994939,5cyclictest14-21rcu_preempt12:35:291
323537599498,5cyclictest3237380-21apt-get07:20:010
323537599491,45cyclictest3279869-21grep11:25:270
3235380994730,11cyclictest0-21swapper/212:25:012
3235377994735,7cyclictest3239915-21grep07:30:281
3235377994730,11cyclictest0-21swapper/111:25:261
3235377994726,14cyclictest0-21swapper/111:15:291
3235377994724,20cyclictest3280172-21/usr/sbin/munin11:30:181
3235377994724,20cyclictest3280172-21/usr/sbin/munin11:30:181
323537599473,4cyclictest0-21swapper/008:00:200
3235380994631,8cyclictest311ktimers/211:10:112
3235380994630,10cyclictest0-21swapper/211:50:202
323537799462,6cyclictest0-21swapper/108:10:021
3235377994537,5cyclictest231ktimers/109:30:291
3235377994530,9cyclictest0-21swapper/109:15:291
3235377994528,9cyclictest0-21swapper/107:50:301
3235377994528,11cyclictest0-21swapper/112:00:011
3235377994528,11cyclictest0-21swapper/112:00:011
3235375994538,4cyclictest0-21swapper/007:15:010
323537599451,5cyclictest3277635-21/usr/sbin/munin11:15:150
3235377994435,6cyclictest3284275-21cron11:55:001
3235377994432,9cyclictest231ktimers/109:10:111
3235377994424,11cyclictest0-21swapper/108:40:301
323537799441,4cyclictest0-21swapper/108:25:011
323537599445,31cyclictest3236347-21munin-setwarn07:15:000
3235375994437,4cyclictest0-21swapper/008:45:230
3235375994437,4cyclictest0-21swapper/008:45:220
3235375994432,8cyclictest3276590-21munin-plugin-st11:10:010
3235375994432,8cyclictest3276590-21munin-plugin-st11:10:010
323537599442,6cyclictest3273671-21irqstats10:50:240
323537599441,37cyclictest3255411-21latency_hist09:05:020
3235380994330,6cyclictest0-21swapper/207:55:292
3235380994329,10cyclictest0-21swapper/209:30:312
3235377994327,11cyclictest3236180-21grep07:10:281
3235377994313,16cyclictest3274250-21/usr/sbin/munin10:55:181
3235375994337,3cyclictest167350irq/118-8000000.ethernet-tx012:30:150
323537599431,37cyclictest0-21swapper/009:15:010
323537599431,36cyclictest3290453-21latency_hist12:30:010
3235380994230,7cyclictest0-21swapper/209:25:312
3235377994234,5cyclictest3247684-21cron08:19:591
3235377994232,6cyclictest3277430-21munin-plugin-st11:15:001
3235377994231,6cyclictest0-21swapper/109:55:211
3235377994231,6cyclictest0-21swapper/107:20:301
3235377994231,5cyclictest0-21swapper/109:25:201
3235377994212,24cyclictest0-21swapper/110:35:231
3235377994210,19cyclictest22-21rcuc/111:25:021
323537599423,5cyclictest3261425-21latency_hist09:40:020
3235375994233,6cyclictest0-21swapper/011:40:280
3235375994233,6cyclictest0-21swapper/011:40:280
3235375994228,8cyclictest3270583-21unixbench_multi10:30:290
3235375994222,15cyclictest3235369-21cyclictest08:30:010
323537599421,39cyclictest0-21swapper/012:15:170
323538099414,20cyclictest3261595-21/usr/sbin/munin09:40:192
3235380994132,5cyclictest3257770-21head09:15:302
3235380994127,8cyclictest0-21swapper/207:10:292
323537799417,8cyclictest231ktimers/107:30:021
3235377994133,5cyclictest0-21swapper/107:10:001
3235377994131,5cyclictest0-21swapper/109:05:281
3235377994128,7cyclictest3290093-21grep12:25:331
3235377994128,7cyclictest3241614-21grep07:40:281
3235377994124,9cyclictest0-21swapper/108:35:221
3235377994123,8cyclictest3282610-21cat11:45:001
3235377994123,8cyclictest3282610-21cat11:45:001
3235375994124,14cyclictest3259536-21apt-key09:30:000
323537599411,37cyclictest3278792-21meminfo11:20:230
323537599411,37cyclictest3261933-21phc2sys-jitter09:40:270
323538099409,14cyclictest3252966-21/usr/sbin/munin08:50:192
3235380994031,4cyclictest3278276-21latency_hist11:20:002
3235380994026,9cyclictest0-21swapper/210:20:282
3235380994026,9cyclictest0-21swapper/207:45:302
323537799406,2cyclictest0-21swapper/109:55:001
323537799405,9cyclictest24-21ksoftirqd/108:50:021
323537799405,9cyclictest24-21ksoftirqd/108:50:021
3235377994033,4cyclictest24-21ksoftirqd/112:15:181
323537799403,12cyclictest22-21rcuc/110:15:011
3235377994028,6cyclictest0-21swapper/108:10:291
3235377994025,6cyclictest0-21swapper/110:30:011
3235377994025,6cyclictest0-21swapper/110:30:011
323537799402,31cyclictest0-21swapper/110:15:241
3235375994034,4cyclictest0-21swapper/012:05:160
3235375994029,6cyclictest3251829-21grep08:40:290
323537599401,4cyclictest3267793-21memory10:15:250
323537599401,3cyclictest3284485-21apt-get11:55:120
323537599401,3cyclictest3284485-21apt-get11:55:110
3235380993929,6cyclictest0-21swapper/210:35:292
3235380993923,8cyclictest0-21swapper/208:25:292
323538099391,34cyclictest3288388-21unixbench_multi12:15:292
3235377993924,8cyclictest3253490-21grep08:50:301
3235375993933,4cyclictest3248512-21unixbench_singl08:20:300
3235375993933,3cyclictest3289479-21latency_hist12:25:010
3235375993932,5cyclictest0-21swapper/008:10:220
3235375993932,4cyclictest20850irq/208-8000000.ethernet11:50:010
3235375993931,5cyclictest131ktimers/011:05:010
3235375993930,5cyclictest0-21swapper/008:50:310
3235375993930,4cyclictest0-21swapper/009:15:280
323537599392,35cyclictest0-21swapper/010:55:240
323537599391,4cyclictest0-21swapper/009:05:200
323537599391,3cyclictest3280239-21df11:30:160
323537599391,3cyclictest3280239-21df11:30:160
323537599391,36cyclictest0-21swapper/011:10:180
323537599391,36cyclictest0-21swapper/008:35:170
323537599391,2cyclictest0-21swapper/010:00:000
3235380993830,4cyclictest167550irq/134-8000000.ethernet-tx207:40:252
3235380993829,5cyclictest3263913-21munin-plugin-st09:55:002
3235380993825,9cyclictest0-21swapper/212:10:202
3235380993825,9cyclictest0-21swapper/212:10:192
3235380993814,15cyclictest3252126-21/usr/sbin/munin08:45:192
3235380993814,15cyclictest3252126-21/usr/sbin/munin08:45:182
323537799384,2cyclictest0-21swapper/111:40:011
3235377993826,8cyclictest231ktimers/110:30:151
3235377993823,8cyclictest0-21swapper/110:50:291
3235377993820,10cyclictest0-21swapper/110:20:261
3235377993816,14cyclictest231ktimers/108:00:011
3235375993828,5cyclictest0-21swapper/008:55:240
323537599381,35cyclictest0-21swapper/009:30:270
323538099376,29cyclictest0-21swapper/212:00:172
323538099373,3cyclictest3255242-21unixbench_singl09:00:282
3235380993727,7cyclictest0-21swapper/209:05:292
3235380993723,11cyclictest0-21swapper/211:20:232
3235380993720,11cyclictest0-21swapper/210:45:292
3235377993729,5cyclictest3237382-21munin-plugin-st07:20:001
3235377993728,5cyclictest231ktimers/112:00:231
3235377993726,7cyclictest3255251-21grep09:00:281
3235377993721,6cyclictest231ktimers/110:00:231
3235375993731,3cyclictest3272656-21fschecks_count10:45:200
3235375993730,4cyclictest0-21swapper/007:25:180
3235375993725,8cyclictest0-21swapper/010:00:160
3235375993720,15cyclictest0-21swapper/007:35:240
3235375993720,15cyclictest0-21swapper/007:35:240
323537599371,34cyclictest0-21swapper/010:35:140
323537599371,2cyclictest0-21swapper/007:50:000
323537599370,35cyclictest200-21pr/ttyS207:45:000
3235380993629,4cyclictest3266453-21cut10:10:002
3235380993628,4cyclictest0-21swapper/212:40:012
3235380993625,7cyclictest0-21swapper/210:10:282
3235377993629,4cyclictest3244581-21fschecks_time08:00:211
3235377993625,7cyclictest231ktimers/111:08:101
3235377993625,7cyclictest231ktimers/111:08:101
3235377993624,7cyclictest231ktimers/112:35:001
3235377993622,6cyclictest0-21swapper/108:55:241
3235375993626,6cyclictest3247646-21unixbench_singl08:15:290
3235375993624,9cyclictest0-21swapper/010:25:300
3235375993624,9cyclictest0-21swapper/010:25:300
323537599361,3cyclictest0-21swapper/009:45:140
323537599361,3cyclictest0-21swapper/009:45:140
323537599361,33cyclictest0-21swapper/010:10:120
323537599361,33cyclictest0-21swapper/008:32:020
3235380993529,4cyclictest167550irq/134-8000000.ethernet-tx207:25:292
3235380993528,4cyclictest0-21swapper/211:55:292
3235380993528,4cyclictest0-21swapper/211:55:292
3235380993525,6cyclictest0-21swapper/211:05:302
3235380993525,6cyclictest0-21swapper/211:05:302
3235380993519,12cyclictest0-21swapper/212:25:322
3235380993513,15cyclictest3242743-21/usr/sbin/munin07:50:202
3235377993523,7cyclictest231ktimers/110:05:251
323537799350,29cyclictest22-21rcuc/111:45:181
3235375993529,4cyclictest0-21swapper/009:20:240
3235375993528,5cyclictest131ktimers/007:55:220
3235375993528,4cyclictest23850irq/422-mmc107:10:020
3235375993528,4cyclictest20850irq/208-8000000.ethernet12:00:150
3235375993528,4cyclictest0-21swapper/010:09:120
3235375993526,5cyclictest131ktimers/011:50:230
323537599351,32cyclictest0-21swapper/007:52:490
323537599351,32cyclictest0-21swapper/007:30:160
3235380993426,4cyclictest167550irq/134-8000000.ethernet-tx211:00:212
3235380993426,4cyclictest0-21swapper/208:30:302
3235380993424,6cyclictest0-21swapper/210:00:292
3235380993422,8cyclictest0-21swapper/208:55:332
3235380993421,8cyclictest0-21swapper/210:50:282
3235377993427,5cyclictest231ktimers/107:35:231
3235377993427,5cyclictest231ktimers/107:35:231
3235377993420,6cyclictest231ktimers/108:25:121
323537799341,26cyclictest3287019-21/usr/sbin/munin12:10:111
323537799341,26cyclictest3287019-21/usr/sbin/munin12:10:101
3235375993428,3cyclictest167350irq/118-8000000.ethernet-tx011:35:200
3235375993427,4cyclictest0-21swapper/009:50:180
323537599341,31cyclictest0-21swapper/012:38:350
323538099332,7cyclictest3282521-21gpgv11:45:012
323538099332,7cyclictest3282521-21gpgv11:45:012
3235380993325,5cyclictest3267778-21kernelversion10:15:232
3235380993325,4cyclictest0-21swapper/208:20:292
3235380993324,6cyclictest3271730-21/usr/sbin/munin10:40:252
3235380993322,8cyclictest0-21swapper/208:05:312
3235380993318,10cyclictest0-21swapper/209:55:202
3235380993317,13cyclictest0-21swapper/210:30:302
3235377993323,5cyclictest0-21swapper/107:45:241
323538099321,29cyclictest0-21swapper/208:00:262
3235377993223,5cyclictest231ktimers/109:40:111
3235380993123,5cyclictest0-21swapper/207:15:292
3235380993123,4cyclictest0-21swapper/207:40:002
3235380993123,4cyclictest0-21swapper/207:40:002
3235380993120,7cyclictest0-21swapper/212:05:192
3235380993118,9cyclictest0-21swapper/210:25:302
3235380993118,9cyclictest0-21swapper/210:25:302
3235377993122,5cyclictest0-21swapper/111:00:181
3235377993116,10cyclictest231ktimers/110:40:171
3235380993024,3cyclictest3263039-21head09:45:292
3235380993024,3cyclictest3263039-21head09:45:292
3235380993020,6cyclictest0-21swapper/208:35:272
3235380993019,7cyclictest0-21swapper/209:10:292
323538099301,26cyclictest0-21swapper/211:30:172
323538099301,26cyclictest0-21swapper/211:30:172
323538099301,25cyclictest0-21swapper/207:30:092
3235377993020,6cyclictest0-21swapper/109:35:261
3235380992921,4cyclictest0-21swapper/212:30:292
3235380992920,5cyclictest0-21swapper/207:20:202
3235380992918,8cyclictest0-21swapper/208:10:282
3235380992917,6cyclictest0-21swapper/207:10:022
323538099281,25cyclictest0-21swapper/211:35:172
3235380992616,7cyclictest0-21swapper/210:55:252
3235380992614,8cyclictest0-21swapper/211:25:272
323537799262,10cyclictest3288720-21/usr/sbin/munin12:20:201
3235380992520,4cyclictest0-21swapper/211:46:352
3235380992518,5cyclictest311ktimers/208:40:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional