You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 04:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Fri Nov 28, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3078390997324,40cyclictest3112981-21/usr/sbin/munin22:30:202
307838899688,22cyclictest0-21swapper/121:50:221
307838899663,20cyclictest3084753-21/usr/sbin/munin19:45:171
307838599652,27cyclictest21250irq/208-8000000.ethernet22:05:000
3078385996521,20cyclictest15-21rcuc/020:15:010
3078390996453,7cyclictest3111946-21munin-plugin-st22:24:592
307838899641,34cyclictest0-21swapper/119:10:001
3078390996210,46cyclictest3123119-21/usr/sbin/munin23:30:192
3078390995914,39cyclictest3089701-21apt-key20:15:012
307839099590,21cyclictest0-21swapper/200:40:002
307838599592,43cyclictest0-21swapper/022:50:120
307838899578,19cyclictest0-21swapper/119:50:211
3078388995541,10cyclictest3130597-21cron00:15:001
3078390995436,9cyclictest3094019-21munin-plugin-st20:40:002
307838599537,17cyclictest0-21swapper/023:35:010
3078385995342,6cyclictest3134000-21munin-plugin-st00:35:000
3078385995342,6cyclictest3134000-21munin-plugin-st00:35:000
3078385995239,9cyclictest0-21swapper/021:50:000
3078385995218,21cyclictest131ktimers/023:40:160
307839099516,25cyclictest0-21swapper/220:55:022
3078390995039,7cyclictest0-21swapper/200:05:012
307839099502,17cyclictest3131665-21/usr/sbin/munin00:20:202
3078388995012,10cyclictest0-21swapper/120:20:021
3078388995010,18cyclictest3078382-21cyclictest00:20:021
307838599505,15cyclictest15-21rcuc/022:10:010
3078390994933,11cyclictest0-21swapper/220:45:132
3078390994930,12cyclictest0-21swapper/221:30:122
3078385994942,5cyclictest3087932-21grep20:05:000
3078385994933,11cyclictest0-21swapper/019:35:300
3078390994730,11cyclictest0-21swapper/223:20:142
3078390994727,13cyclictest3114231-21/usr/sbin/munin22:35:282
3078390994721,16cyclictest3109094-21/usr/sbin/munin22:05:292
307839099471,25cyclictest0-21swapper/219:55:012
307839099471,16cyclictest0-21swapper/221:25:012
3078385994740,4cyclictest0-21swapper/022:25:130
3078385994740,4cyclictest0-21swapper/022:25:130
3078385994715,25cyclictest3090853-21/usr/sbin/munin20:20:210
3078390994623,14cyclictest3079094-21grep19:10:302
307838899468,32cyclictest0-21swapper/121:30:011
3078388994632,9cyclictest0-21swapper/122:05:321
3078388994626,14cyclictest0-21swapper/121:20:211
3078385994634,7cyclictest3131460-21sendmail00:20:000
3078385994633,8cyclictest0-21swapper/023:00:290
3078385994632,10cyclictest0-21swapper/022:20:290
3078390994537,4cyclictest3091496-21munin-plugin-st20:25:002
3078390994533,6cyclictest0-21swapper/222:45:132
3078390994528,9cyclictest3130037-21/usr/sbin/munin00:10:192
3078390994524,13cyclictest3104049-21/usr/sbin/munin21:35:302
3078390994523,15cyclictest3087463-21cut20:00:202
3078390994523,12cyclictest0-21swapper/222:40:122
3078390994523,12cyclictest0-21swapper/222:40:122
3078390994522,13cyclictest3127631-21/usr/sbin/munin23:55:232
3078390994522,10cyclictest0-21swapper/219:20:152
307838899459,4cyclictest0-21swapper/123:15:011
307838899459,4cyclictest0-21swapper/123:15:001
3078388994528,11cyclictest0-21swapper/120:40:231
3078388994526,14cyclictest3111845-21grep22:20:281
3078388994526,14cyclictest0-21swapper/123:50:301
3078385994532,8cyclictest0-21swapper/022:15:290
3078390994427,9cyclictest0-21swapper/220:20:012
3078390994427,12cyclictest3125655-21munin-node23:45:122
3078390994424,12cyclictest3118403-21/usr/sbin/munin23:00:252
3078390994424,11cyclictest0-21swapper/219:45:182
3078390994422,12cyclictest3117504-21/usr/sbin/munin22:55:242
307838899446,3cyclictest0-21swapper/120:35:011
307838899444,4cyclictest0-21swapper/123:45:011
3078388994430,10cyclictest0-21swapper/100:35:271
3078388994428,10cyclictest0-21swapper/100:00:301
3078385994435,5cyclictest3079373-21wc19:15:010
3078385994430,10cyclictest0-21swapper/021:45:010
3078390994337,3cyclictest3109595-21/usr/sbin/munin22:10:192
3078390994337,3cyclictest3109595-21/usr/sbin/munin22:10:182
3078390994330,9cyclictest3093121-21grep20:30:282
3078390994327,11cyclictest0-21swapper/220:25:302
3078390994326,12cyclictest0-21swapper/219:30:132
3078390994325,12cyclictest0-21swapper/220:55:152
3078390994323,10cyclictest3081440-21dropbear19:25:172
3078390994320,15cyclictest1265-21rs:main2
3078390994320,15cyclictest1265-21rs:main2
3078390994318,17cyclictest3080279-21grep19:15:292
3078388994335,5cyclictest3083700-21cut19:40:001
3078388994317,17cyclictest0-21swapper/120:00:241
3078385994327,12cyclictest0-21swapper/020:40:290
307839099427,22cyclictest20991ptp019:35:162
3078390994226,12cyclictest3101180-21/usr/sbin/munin21:20:192
3078390994226,12cyclictest0-21swapper/220:05:132
3078390994226,11cyclictest3121067-21/usr/sbin/munin23:15:282
3078390994226,11cyclictest3110439-21apt-get22:15:152
3078390994224,9cyclictest3086761-21phc2sys19:55:262
3078390994224,9cyclictest0-21swapper/222:25:292
3078390994224,9cyclictest0-21swapper/222:25:292
3078390994223,11cyclictest3119063-21cut23:05:202
3078390994223,10cyclictest3122633-21phc2sys-jitter23:25:272
3078390994223,10cyclictest3122633-21phc2sys-jitter23:25:272
3078390994213,23cyclictest2-21kthreadd21:09:262
3078388994229,8cyclictest0-21swapper/121:40:281
3078388994228,10cyclictest0-21swapper/100:05:271
3078388994223,10cyclictest0-21swapper/122:00:291
3078388994216,15cyclictest0-21swapper/121:05:231
3078385994234,4cyclictest21050irq/252-8000000.ethernet21:40:000
3078385994229,9cyclictest0-21swapper/000:25:310
307838599421,9cyclictest0-21swapper/020:35:010
307838599420,29cyclictest3090535-21kworker/u8:2+events_power_efficient23:25:010
3078390994132,4cyclictest0-21swapper/221:10:122
3078390994128,9cyclictest0-21swapper/222:55:002
3078390994123,9cyclictest3124314-21/usr/sbin/munin23:35:262
3078390994119,16cyclictest3100380-21grep21:15:202
3078388994122,11cyclictest0-21swapper/119:15:291
3078388994117,16cyclictest0-21swapper/123:15:261
307838599417,6cyclictest0-21swapper/023:55:010
3078385994136,3cyclictest3094010-21sh20:40:010
3078385994134,4cyclictest0-21swapper/022:00:000
3078385994129,8cyclictest0-21swapper/021:00:330
3078385994125,12cyclictest0-21swapper/000:05:010
307838599412,14cyclictest0-21swapper/023:20:010
3078385994120,18cyclictest0-21swapper/022:50:010
3078390994028,8cyclictest3084141-21/usr/sbin/munin19:40:212
3078390994025,11cyclictest0-21swapper/223:50:132
3078390994025,10cyclictest3104452-21apt-get21:40:162
3078390994024,8cyclictest3107536-21grep21:55:292
3078390994024,11cyclictest0-21swapper/222:00:142
3078390994024,11cyclictest0-21swapper/221:00:182
3078390994023,9cyclictest0-21swapper/223:10:152
3078390994023,9cyclictest0-21swapper/223:10:152
3078390994019,14cyclictest3129577-21sendmail_mailqu00:05:272
3078390994018,15cyclictest3105432-21lsblk21:45:212
307838899402,2cyclictest0-21swapper/120:30:011
3078385994033,4cyclictest0-21swapper/021:05:290
3078385994028,9cyclictest0-21swapper/023:35:280
3078385994027,8cyclictest0-21swapper/022:10:200
3078385994027,8cyclictest0-21swapper/022:10:200
307838599401,4cyclictest0-21swapper/022:45:000
307838599401,4cyclictest0-21swapper/022:45:000
307838599401,3cyclictest0-21swapper/021:00:010
307838599401,33cyclictest0-21swapper/019:55:130
3078390993925,9cyclictest3130852-21/usr/sbin/munin00:15:192
3078390993925,7cyclictest3132989-21/usr/sbin/munin00:25:302
3078390993924,11cyclictest0-21swapper/223:40:142
3078390993923,8cyclictest3106662-21grep21:50:322
3078388993932,4cyclictest3089513-21unixbench_multi20:10:291
3078388993927,8cyclictest3104239-21sendmail21:39:591
3078388993925,10cyclictest0-21swapper/123:55:291
3078388993924,10cyclictest0-21swapper/123:45:291
3078388993922,13cyclictest0-21swapper/122:10:251
3078388993922,13cyclictest0-21swapper/122:10:251
3078388993916,15cyclictest0-21swapper/122:35:291
3078385993927,8cyclictest0-21swapper/021:25:320
3078385993926,8cyclictest0-21swapper/019:40:280
3078388993831,4cyclictest168350irq/126-8000000.ethernet-tx119:30:151
3078388993830,4cyclictest3113551-21unixbench_singl22:30:281
3078388993818,14cyclictest0-21swapper/123:35:191
3078388993816,15cyclictest0-21swapper/120:50:001
3078388993816,13cyclictest0-21swapper/120:10:011
307838599388,27cyclictest0-21swapper/019:45:220
307838599383,27cyclictest3088971-21/usr/sbin/munin20:10:190
3078385993828,7cyclictest0-21swapper/000:05:280
3078385993827,8cyclictest0-21swapper/020:55:010
3078385993826,7cyclictest0-21swapper/020:45:300
3078388993728,6cyclictest3118064-21/usr/sbin/munin23:00:161
3078388993728,5cyclictest3084555-21munin-plugin-st19:45:011
3078388993726,8cyclictest0-21swapper/122:55:171
3078388993726,6cyclictest3122049-21grep23:20:301
3078388993723,8cyclictest0-21swapper/122:00:011
3078388993720,10cyclictest0-21swapper/119:30:011
3078388993717,13cyclictest0-21swapper/122:15:211
3078388993715,14cyclictest0-21swapper/120:00:001
307838899371,28cyclictest3116804-21/usr/sbin/munin22:50:281
3078385993728,5cyclictest21250irq/208-8000000.ethernet00:10:280
3078385993726,8cyclictest0-21swapper/000:35:270
3078385993726,5cyclictest3114446-21kworker/u8:5+events_power_efficient22:55:120
3078385993725,8cyclictest0-21swapper/020:05:290
3078385993725,8cyclictest0-21swapper/019:50:310
307838599371,7cyclictest3106703-21grep21:50:310
3078388993627,6cyclictest3112142-21/usr/sbin/munin22:25:311
3078388993627,6cyclictest3112142-21/usr/sbin/munin22:25:301
3078388993623,9cyclictest0-21swapper/121:45:171
3078388993622,8cyclictest0-21swapper/122:40:281
3078388993622,8cyclictest0-21swapper/122:40:281
307838899361,6cyclictest0-21swapper/119:15:011
3078385993631,3cyclictest14-21rcu_preempt21:20:210
3078385993629,4cyclictest21250irq/208-8000000.ethernet22:35:170
3078385993622,8cyclictest0-21swapper/019:30:260
3078390993524,8cyclictest3094527-21/usr/sbin/munin20:40:242
3078388993526,6cyclictest3096835-21/usr/sbin/munin20:55:211
3078388993523,6cyclictest0-21swapper/120:20:231
3078388993521,9cyclictest0-21swapper/122:45:281
3078388993521,9cyclictest0-21swapper/120:55:011
3078388993520,9cyclictest0-21swapper/100:30:251
3078388993520,9cyclictest0-21swapper/100:30:251
3078388993515,13cyclictest0-21swapper/100:25:241
3078388993514,15cyclictest0-21swapper/123:30:201
307838899351,27cyclictest3130954-21sshd00:15:231
3078385993523,8cyclictest0-21swapper/023:25:290
3078385993523,8cyclictest0-21swapper/023:25:290
307838599351,9cyclictest0-21swapper/023:15:010
307838599351,9cyclictest0-21swapper/023:15:010
3078385993515,16cyclictest0-21swapper/019:24:590
307838599351,32cyclictest0-21swapper/021:15:240
3078388993424,8cyclictest0-21swapper/121:15:211
3078388993416,13cyclictest0-21swapper/123:05:211
3078388993416,13cyclictest0-21swapper/119:20:241
3078388993415,13cyclictest0-21swapper/121:10:221
307838599347,5cyclictest0-21swapper/023:50:020
3078385993428,4cyclictest21250irq/208-8000000.ethernet19:15:120
3078385993427,5cyclictest1652-21sshd21:30:210
3078385993425,5cyclictest3099904-21grep21:10:290
3078385993425,4cyclictest0-21swapper/019:25:260
3078390993317,11cyclictest3078532-21latency_hist19:10:012
307838599335,8cyclictest15-21rcuc/019:10:000
3078385993327,2cyclictest0-21swapper/020:30:010
3078385993326,4cyclictest0-21swapper/023:55:230
307838599331,31cyclictest0-21swapper/022:34:430
3078388993224,4cyclictest168350irq/126-8000000.ethernet-tx121:30:231
3078388993220,7cyclictest0-21swapper/121:00:271
307838899321,26cyclictest0-21swapper/123:25:251
307838899321,26cyclictest0-21swapper/123:25:251
3078385993121,5cyclictest0-21swapper/000:20:210
307838599311,5cyclictest3119065-21ssh23:05:210
3078388993016,9cyclictest0-21swapper/120:40:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional