You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-10 - 22:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Fri Jul 10, 2026 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2966882995326,23cyclictest0-21swapper/110:15:251
2966882995126,22cyclictest0-21swapper/112:05:251
2966878995144,5cyclictest3072661-21kworker/u8:3+events_unbound12:19:120
2966882994726,16cyclictest0-21swapper/108:00:161
2966882994638,5cyclictest3060816-21sendmail11:40:001
2966882994638,5cyclictest3060816-21sendmail11:40:001
296688299453,12cyclictest3016989-21/usr/sbin/munin09:30:201
2966882994529,13cyclictest2981278-21munin-plugin-st07:50:011
2966882994529,13cyclictest2981278-21munin-plugin-st07:50:011
296687899454,4cyclictest131rcu_preempt07:45:150
296687899454,4cyclictest131rcu_preempt07:45:140
2966878994538,4cyclictest3012603-21cron09:20:010
296687899451,4cyclictest131rcu_preempt10:05:110
2966891994438,4cyclictest3062431-21kworker/u8:2+events_unbound11:49:053
296688299441,10cyclictest3035243-21apt-get10:25:121
2966887994336,4cyclictest3033298-21munin-plugin-st10:20:012
2966882994333,5cyclictest0-21swapper/111:08:571
296688299431,39cyclictest2989740-21cron08:12:011
296688299431,38cyclictest3001749-21head08:45:281
2966878994334,6cyclictest2972537-21cron07:25:000
296688299422,34cyclictest3015808-21grep09:25:281
296688299421,7cyclictest3066247-21/usr/sbin/munin11:55:131
2966882994217,21cyclictest231ktimers/111:30:101
296688299411,8cyclictest3064537-21/usr/sbin/munin11:50:131
296688299411,8cyclictest3053307-21switchtime11:15:251
296688299411,8cyclictest3007890-21/usr/sbin/munin09:05:181
296688299411,8cyclictest2967582-21/usr/sbin/munin07:10:211
296688299411,8cyclictest2967582-21/usr/sbin/munin07:10:201
296688299411,36cyclictest3012127-21sed09:15:261
296688299410,3cyclictest0-21swapper/108:30:141
296688299403,34cyclictest3042120-21/usr/sbin/munin10:45:131
296688299403,34cyclictest3042120-21/usr/sbin/munin10:45:131
296688299401,5cyclictest2982270-21/usr/sbin/munin07:50:251
296688299401,5cyclictest2982270-21/usr/sbin/munin07:50:251
2966882994014,23cyclictest3028564-21fschecks_count10:05:141
296688299401,3cyclictest0-21swapper/112:30:101
296688299401,3cyclictest0-21swapper/111:10:131
296688299401,35cyclictest2987049-21grep08:05:181
296688299401,34cyclictest3044803-21head10:50:261
296688299401,34cyclictest3033703-21cut10:20:151
296688299401,34cyclictest3026851-21grep10:00:141
296687899408,5cyclictest131rcu_preempt10:25:110
2966878994034,4cyclictest2982586-21kworker/u8:1+events_unbound07:58:230
2966878994029,6cyclictest0-21swapper/011:00:000
2966891993933,4cyclictest2966601-21kworker/u8:0+events_unbound07:33:203
2966891993932,4cyclictest3052283-21idleruntime-cro11:15:003
2966891993929,6cyclictest3019645-21sh09:40:003
2966887993931,5cyclictest3003872-21idleruntime-cro08:55:002
2966887993929,6cyclictest3050569-21cron11:10:002
296688299392,3cyclictest3047184-21/usr/sbin/munin11:00:241
296688299392,33cyclictest3041361-21tail10:40:241
296688299392,33cyclictest3038406-21cron10:35:001
296688299391,8cyclictest3056050-21/usr/sbin/munin11:25:151
296688299391,8cyclictest2972977-21fschecks_time07:25:191
296688299391,6cyclictest3055304-21users11:20:261
296688299391,6cyclictest3012608-21apt-get09:20:061
296688299391,6cyclictest3012608-21apt-get09:20:051
296688299391,4cyclictest2976174-21/usr/sbin/munin07:35:141
296688299391,3cyclictest0-21swapper/112:00:101
296688299391,3cyclictest0-21swapper/108:40:131
296688299391,3cyclictest0-21swapper/108:40:131
296688299391,3cyclictest0-21swapper/108:25:141
296688299391,3cyclictest0-21swapper/107:15:141
296688299391,35cyclictest2983965-21/usr/sbin/munin07:55:211
296688299391,34cyclictest3046461-21sed10:55:271
296688299391,33cyclictest3071380-21df_inode12:10:131
296688299391,32cyclictest2997487-21fschecks_time08:35:171
296688299391,11cyclictest2991960-21apt-get08:20:131
296688299390,9cyclictest3076401-21/usr/sbin/munin12:25:151
296688799381,5cyclictest131rcu_preempt08:55:132
296688299382,32cyclictest2991705-21cron08:20:011
296688299382,31cyclictest3063787-21head11:45:241
296688299381,8cyclictest3030556-21/usr/sbin/munin10:10:191
296688299381,8cyclictest3020932-21awk09:40:251
2966882993817,17cyclictest3074903-21fschecks_time12:20:141
296688299381,4cyclictest3008986-21apt-get09:10:061
296688299381,4cyclictest3006437-21/usr/sbin/munin09:00:241
296688299381,3cyclictest3004093-21/usr/sbin/munin08:55:281
296688299381,3cyclictest0-21swapper/112:35:111
296688299381,3cyclictest0-21swapper/109:50:141
296687899386,3cyclictest131rcu_preempt10:35:110
2966878993829,6cyclictest0-21swapper/007:19:590
2966878993822,5cyclictest3048503-21kworker/u8:0+events_unbound11:05:050
2966891993729,6cyclictest3077479-21kworker/u8:2+events_unbound12:34:143
2966891993718,6cyclictest3043439-21kworker/u8:0+events_unbound10:57:133
2966891993717,4cyclictest131rcu_preempt11:55:013
2966891993715,5cyclictest131rcu_preempt12:20:153
2966887993727,6cyclictest0-21swapper/211:10:262
2966887993724,8cyclictest0-21swapper/212:19:592
296688299373,31cyclictest2974583-21df_inode07:30:171
296688299373,30cyclictest3073089-21diskstats12:15:151
296688299371,9cyclictest3038983-21/usr/sbin/munin10:35:171
296688299371,3cyclictest0-21swapper/109:45:121
296688299371,31cyclictest3002530-21grep08:50:151
296688299370,3cyclictest0-21swapper/107:20:131
296688299370,33cyclictest3018311-21grep09:35:161
2966878993729,4cyclictest0-21swapper/008:50:000
296687899371,4cyclictest131rcu_preempt11:00:110
2966891993629,4cyclictest2977642-21latency_hist07:40:013
2966891993617,3cyclictest131rcu_preempt10:40:013
2966891993617,3cyclictest131rcu_preempt08:00:113
2966887993628,4cyclictest3031587-21debian-sa110:15:012
2966887993626,6cyclictest0-21swapper/209:20:012
2966887993625,6cyclictest0-21swapper/208:35:272
2966887993617,4cyclictest3061891-21timerandwakeup11:40:242
296688299364,26cyclictest0-21swapper/109:55:111
296688299362,5cyclictest2977638-21apt-get07:40:051
296688299360,3cyclictest0-21swapper/111:40:121
296687899369,7cyclictest2988168-21kworker/0:0+events11:19:590
2966878993629,4cyclictest2986602-21kthreadd08:05:000
296687899362,8cyclictest11-21ksoftirqd/008:20:130
2966878993626,6cyclictest0-21swapper/008:05:260
2966878993625,7cyclictest0-21swapper/007:40:010
296687899361,16cyclictest0-21swapper/010:00:100
2966891993529,4cyclictest3024775-21idleruntime-cro09:55:003
2966891993517,5cyclictest131rcu_preempt09:00:013
2966887993525,6cyclictest0-21swapper/210:20:242
2966887993525,6cyclictest0-21swapper/210:05:252
2966887993524,6cyclictest0-21swapper/208:25:292
296688799351,19cyclictest0-21swapper/209:30:112
2966878993528,3cyclictest0-21swapper/008:50:270
2966878993527,5cyclictest0-21swapper/008:35:010
2966891993424,6cyclictest0-21swapper/308:55:003
296689199341,7cyclictest0-21swapper/311:20:123
2966891993414,3cyclictest131rcu_preempt08:40:013
2966887993428,4cyclictest3000267-21kworker/u8:2+events_unbound08:48:342
2966887993428,3cyclictest0-21swapper/207:45:192
2966887993428,3cyclictest0-21swapper/207:45:192
296687899345,13cyclictest0-21swapper/011:10:230
2966878993427,3cyclictest0-21swapper/011:40:000
2966878993427,3cyclictest0-21swapper/011:39:590
296687899341,7cyclictest11-21ksoftirqd/012:35:110
296689199338,12cyclictest131rcu_preempt07:40:173
2966891993323,6cyclictest0-21swapper/311:55:263
2966891993316,3cyclictest131rcu_preempt10:00:183
2966891993312,12cyclictest131rcu_preempt08:00:013
296689199331,16cyclictest0-21swapper/309:15:123
2966887993324,6cyclictest0-21swapper/209:00:172
2966887993323,6cyclictest0-21swapper/211:05:002
2966887993323,6cyclictest0-21swapper/209:15:002
2966878993326,5cyclictest3005397-21kworker/u8:0+events_unbound09:03:360
2966878993325,4cyclictest0-21swapper/010:50:260
2966878993322,7cyclictest0-21swapper/011:25:250
2966878993316,11cyclictest3065775-21kworker/u8:0+events_unbound11:58:350
296687899331,15cyclictest11-21ksoftirqd/012:25:130
2966891993225,5cyclictest3003640-21kworker/u8:1+events_unbound09:08:393
2966891993225,4cyclictest3053978-21kthreadd11:19:593
2966891993224,6cyclictest2977282-21kworker/u8:2+events_unbound07:53:233
2966891993224,6cyclictest2977282-21kworker/u8:2+events_unbound07:53:233
2966891993224,4cyclictest0-21swapper/312:25:273
2966891993215,3cyclictest131rcu_preempt08:30:273
296688799322,5cyclictest131rcu_preempt09:25:142
2966887993221,7cyclictest3065461-21grep11:50:252
2966887993221,7cyclictest0-21swapper/211:25:142
2966887993221,6cyclictest0-21swapper/209:05:252
2966878993225,5cyclictest3031342-21kworker/u8:0+events_unbound10:18:530
2966878993224,4cyclictest0-21swapper/009:55:000
2966878993222,6cyclictest0-21swapper/011:50:000
2966891993124,4cyclictest2991713-21cron08:20:013
2966891993122,5cyclictest0-21swapper/309:30:253
296689199312,13cyclictest0-21swapper/308:20:133
2966891993115,5cyclictest131rcu_preempt07:25:143
2966891993115,3cyclictest131rcu_preempt11:25:133
2966891993114,5cyclictest131rcu_preempt11:05:003
2966891993113,5cyclictest131rcu_preempt11:45:003
2966887993125,3cyclictest0-21swapper/212:40:002
2966887993123,4cyclictest0-21swapper/208:30:292
2966887993122,6cyclictest0-21swapper/207:20:002
2966887993121,6cyclictest0-21swapper/208:10:002
2966887993121,6cyclictest0-21swapper/207:35:162
2966878993122,5cyclictest0-21swapper/007:15:000
2966878993122,5cyclictest0-21swapper/007:15:000
296689199309,12cyclictest40-21ksoftirqd/309:10:213
296689199309,12cyclictest131rcu_preempt12:00:233
296689199309,10cyclictest131rcu_preempt08:30:023
2966891993022,4cyclictest0-21swapper/311:30:243
2966891993022,4cyclictest0-21swapper/309:25:273
2966891993021,6cyclictest0-21swapper/307:50:013
2966891993021,6cyclictest0-21swapper/307:50:003
2966891993011,5cyclictest131rcu_preempt08:45:173
2966887993023,5cyclictest3017696-21kworker/u8:0+events_unbound10:00:422
2966887993019,7cyclictest0-21swapper/210:35:252
2966887993015,8cyclictest131rcu_preempt11:15:212
2966887993015,5cyclictest3039942-21kworker/u8:0+events_unbound10:43:332
2966878993024,3cyclictest0-21swapper/008:30:010
2966878993021,6cyclictest0-21swapper/012:34:590
2966878993021,6cyclictest0-21swapper/008:39:590
2966878993021,5cyclictest0-21swapper/007:25:280
2966878993020,7cyclictest3055698-21idleruntime-cro11:25:000
2966878993020,6cyclictest0-21swapper/011:50:250
296689199296,12cyclictest40-21ksoftirqd/308:40:273
296689199296,12cyclictest40-21ksoftirqd/308:40:263
2966891992923,4cyclictest3012229-21kworker/u8:1+events_unbound09:20:423
2966891992923,4cyclictest3012229-21kworker/u8:1+events_unbound09:20:423
2966891992923,3cyclictest3072751-21idleruntime-cro12:15:013
2966891992923,3cyclictest0-21swapper/310:00:013
2966891992920,5cyclictest391ktimers/309:00:133
2966891992915,3cyclictest131rcu_preempt10:17:013
2966887992922,4cyclictest0-21swapper/212:25:172
2966887992920,6cyclictest0-21swapper/211:45:232
2966887992920,6cyclictest0-21swapper/208:00:262
2966887992920,5cyclictest0-21swapper/209:45:252
2966887992920,5cyclictest0-21swapper/208:20:282
2966887992920,5cyclictest0-21swapper/208:00:002
2966887992919,6cyclictest0-21swapper/211:55:262
2966887992919,6cyclictest0-21swapper/210:30:242
2966887992912,5cyclictest131rcu_preempt12:30:102
2966878992923,3cyclictest0-21swapper/007:45:010
2966878992910,12cyclictest151rcuc/009:00:010
296689199288,13cyclictest40-21ksoftirqd/310:40:243
2966891992822,4cyclictest3060657-21kworker/u8:0+events_unbound11:39:413
2966891992822,4cyclictest3060657-21kworker/u8:0+events_unbound11:39:413
2966891992820,4cyclictest0-21swapper/309:45:253
2966891992820,4cyclictest0-21swapper/307:15:263
2966891992819,5cyclictest0-21swapper/310:10:263
2966887992821,4cyclictest2979560-21cron07:45:012
2966887992821,3cyclictest0-21swapper/207:10:262
2966887992821,3cyclictest0-21swapper/207:10:262
296687899287,5cyclictest0-21swapper/009:40:230
296687899282,8cyclictest204-21dbus-daemon10:13:520
2966878992821,5cyclictest3000267-21kworker/u8:2+events_unbound08:43:350
2966878992821,5cyclictest3000267-21kworker/u8:2+events_unbound08:43:350
2966878992819,5cyclictest0-21swapper/012:20:150
2966878992813,8cyclictest131rcu_preempt10:00:010
2966878992813,6cyclictest3034705-21kworker/u8:1+events_unbound10:45:000
296689199279,12cyclictest131rcu_preempt07:25:003
2966891992721,4cyclictest2964844-21kworker/u8:2+events_unbound07:13:163
2966891992721,4cyclictest2964844-21kworker/u8:2+events_unbound07:13:163
2966891992721,3cyclictest0-21swapper/312:15:163
2966891992716,3cyclictest131rcu_preempt10:30:203
296689199271,12cyclictest0-21swapper/310:25:253
296688799278,12cyclictest32-21ksoftirqd/209:39:592
2966887992720,4cyclictest0-21swapper/211:20:152
2966887992720,3cyclictest0-21swapper/209:55:012
2966887992719,5cyclictest0-21swapper/212:00:242
2966887992719,4cyclictest0-21swapper/212:10:242
2966887992714,9cyclictest131rcu_preempt07:55:012
2966887992714,9cyclictest131rcu_preempt07:55:002
2966887992712,3cyclictest0-21swapper/207:25:012
2966878992710,4cyclictest131rcu_preempt09:25:280
296689199269,7cyclictest40-21ksoftirqd/308:05:223
296689199267,11cyclictest131rcu_preempt10:50:233
296689199265,12cyclictest2989526-21tail08:10:283
2966891992619,5cyclictest3069437-21kworker/u8:0+events_unbound12:08:523
2966891992618,5cyclictest53-21kcompactd009:43:443
2966891992615,5cyclictest131rcu_preempt10:20:233
296688799269,9cyclictest3059960-21cut11:35:222
296688799269,9cyclictest3059960-21cut11:35:222
296688799265,11cyclictest3000018-21tail08:40:272
296688799265,11cyclictest3000018-21tail08:40:262
2966887992620,4cyclictest3034705-21kworker/u8:1+events_unbound10:30:002
2966887992617,6cyclictest0-21swapper/210:50:162
2966887992617,5cyclictest0-21swapper/209:25:002
2966887992617,5cyclictest0-21swapper/209:25:002
2966887992616,7cyclictest3076162-21auditctl12:25:002
296687899269,9cyclictest131rcu_preempt08:10:280
2966878992620,4cyclictest3061228-21fschecks_time11:40:160
2966878992618,5cyclictest0-21swapper/009:35:000
2966878992617,6cyclictest2982998-21cat07:55:010
2966878992617,6cyclictest2982998-21cat07:55:010
2966878992614,4cyclictest131rcu_preempt12:00:220
2966878992612,6cyclictest3027800-21kworker/u8:2+events_unbound10:20:190
2966878992612,3cyclictest131rcu_preempt12:15:010
296687899261,17cyclictest0-21swapper/009:06:410
2966878992611,2cyclictest0-21swapper/010:50:010
2966878992611,2cyclictest0-21swapper/010:50:000
296689199258,11cyclictest40-21ksoftirqd/310:45:173
296689199258,11cyclictest40-21ksoftirqd/310:45:173
296689199256,3cyclictest131rcu_preempt12:35:223
296688799254,4cyclictest131rcu_preempt11:30:112
2966887992517,5cyclictest0-21swapper/209:55:162
2966887992511,10cyclictest311ktimers/212:05:122
2966887992510,7cyclictest131rcu_preempt08:10:292
296687899259,8cyclictest131rcu_preempt10:30:250
296687899254,15cyclictest0-21swapper/007:30:150
2966878992517,5cyclictest0-21swapper/009:20:160
2966878992517,5cyclictest0-21swapper/009:20:150
2966878992516,6cyclictest3021772-21grep09:45:150
2966878992512,7cyclictest131rcu_preempt11:30:180
2966878992510,9cyclictest131rcu_preempt12:05:230
296689199244,7cyclictest40-21ksoftirqd/310:05:153
2966887992416,5cyclictest0-21swapper/210:45:252
2966887992416,5cyclictest0-21swapper/210:45:252
296687899244,12cyclictest0-21swapper/009:35:250
2966878992420,2cyclictest13550irq/42-30be0000.ethernet09:10:140
296688799235,7cyclictest131rcu_preempt08:20:012
296688799231,14cyclictest0-21swapper/207:30:272
296687899231,18cyclictest0-21swapper/008:17:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional