You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 20:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Tue Nov 25, 2025 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
86783699818,37cyclictest892961-21/usr/sbin/munin09:35:191
867834996833,4cyclictest877381-21cron08:05:000
867839996623,35cyclictest0-21swapper/208:15:292
867834996530,7cyclictest0-21swapper/009:05:280
867834996436,4cyclictest21250irq/208-8000000.ethernet09:20:010
867834996336,4cyclictest0-21swapper/009:54:590
867839996120,32cyclictest0-21swapper/212:30:282
867839996117,35cyclictest0-21swapper/210:30:302
867834996131,4cyclictest21250irq/208-8000000.ethernet10:15:310
867839996034,21cyclictest0-21swapper/211:00:302
867834996048,4cyclictest0-21swapper/012:25:130
86783999573,5cyclictest910034-21apt-get11:15:162
867839995710,38cyclictest0-21swapper/208:00:342
86783699578,22cyclictest887532-21gpgv09:05:021
867834995734,4cyclictest0-21swapper/011:05:180
86783999564,43cyclictest0-21swapper/209:20:012
86783999564,43cyclictest0-21swapper/208:55:292
867836995626,13cyclictest22-21rcuc/107:50:171
867834995649,4cyclictest0-21swapper/008:15:110
86783999556,41cyclictest0-21swapper/208:50:282
867839995526,24cyclictest0-21swapper/212:35:292
867839995429,20cyclictest0-21swapper/210:45:262
867839995426,23cyclictest0-21swapper/208:05:282
86783999542,15cyclictest921878-21apt-get12:25:182
86783999542,11cyclictest919386-21/usr/sbin/munin12:10:162
86783999541,2cyclictest0-21swapper/210:15:012
86783999541,2cyclictest0-21swapper/207:20:252
86783999533,43cyclictest0-21swapper/209:05:282
86783999533,39cyclictest0-21swapper/208:20:222
867839995330,19cyclictest915717-21grep11:45:292
867839995327,21cyclictest0-21swapper/208:10:262
867839995327,20cyclictest0-21swapper/207:10:282
867839995315,31cyclictest0-21swapper/212:00:302
867839995314,30cyclictest0-21swapper/211:35:192
86783999531,13cyclictest915956-21apt-get11:50:162
86783699535,14cyclictest14-21rcu_preempt10:35:001
867836995331,15cyclictest231ktimers/111:55:161
86783999527,37cyclictest0-21swapper/209:40:292
86783999525,39cyclictest0-21swapper/208:25:292
86783999522,5cyclictest921035-21/usr/sbin/munin12:20:332
86783999521,8cyclictest911983-21/usr/sbin/munin11:25:242
867839995216,26cyclictest0-21swapper/207:45:182
867834995243,5cyclictest883291-21munin-plugin-st08:40:000
86783499521,40cyclictest0-21swapper/012:15:010
86783999516,37cyclictest0-21swapper/209:35:282
86783999512,8cyclictest905814-21/usr/sbin/munin10:50:302
86783999512,8cyclictest888791-21ssh09:10:212
86783999512,10cyclictest918633-21fschecks_time12:05:182
86783999511,9cyclictest876401-21/usr/sbin/munin07:55:302
867839995114,28cyclictest0-21swapper/211:55:292
867836995143,5cyclictest868644-21munin-plugin-st07:15:011
867834995123,21cyclictest21050irq/252-8000000.ethernet12:35:250
86783999507,35cyclictest0-21swapper/210:00:222
86783999507,35cyclictest0-21swapper/210:00:222
86783999504,36cyclictest0-21swapper/210:35:282
86783999501,9cyclictest882646-21/usr/sbin/munin08:35:302
867839995019,23cyclictest892669-21latency_hist09:35:002
86783999501,8cyclictest920852-21latency_hist12:20:002
867839995013,30cyclictest0-21swapper/207:50:222
86783999501,12cyclictest896344-21apt-get09:55:152
86783999501,10cyclictest912833-21/usr/sbin/munin11:30:222
867836995029,14cyclictest231ktimers/112:30:111
86783999493,36cyclictest908944-21unixbench_singl11:05:292
867839994931,11cyclictest896032-21grep09:50:302
86783999492,5cyclictest904207-21ssh10:40:222
86783999492,5cyclictest882106-21meminfo08:30:242
86783999492,3cyclictest906655-21apt-get10:55:142
86783999491,6cyclictest872766-21/usr/sbin/munin07:35:232
86783999491,5cyclictest899116-21/usr/sbin/munin10:10:222
86783999491,4cyclictest884015-21/usr/sbin/munin08:40:292
867839994913,28cyclictest901507-21/usr/sbin/munin10:25:182
867836994936,8cyclictest0-21swapper/107:20:001
867836994931,12cyclictest231ktimers/111:15:151
86783999489,30cyclictest0-21swapper/207:40:172
86783999488,33cyclictest900838-21fschecks_time10:20:202
86783999484,35cyclictest0-21swapper/209:25:292
86783999482,37cyclictest872238-21grep07:30:292
86783999482,10cyclictest871360-21tail07:25:282
86783999481,8cyclictest898394-21/usr/sbin/munin10:05:262
86783999481,5cyclictest911108-21/usr/sbin/munin11:20:232
86783999481,5cyclictest894664-21/usr/sbin/munin09:45:132
86783999481,5cyclictest894664-21/usr/sbin/munin09:45:132
86783999481,4cyclictest887144-21/usr/sbin/munin09:00:262
86783999481,10cyclictest890516-21grep09:20:202
867836994828,13cyclictest231ktimers/111:05:131
867834994841,3cyclictest0-21swapper/010:30:170
867834994837,9cyclictest0-21swapper/007:24:590
86783999475,32cyclictest0-21swapper/211:10:262
86783999472,5cyclictest869280-21tune2fs07:15:242
86783999472,4cyclictest884418-21/usr/sbin/munin08:45:192
867836994740,4cyclictest14-21rcu_preempt08:30:201
867836994736,7cyclictest873163-21sendmail07:39:591
867836994726,13cyclictest231ktimers/112:00:151
867834994734,9cyclictest893604-21run-parts09:40:000
86783499471,39cyclictest0-21swapper/009:00:010
86783999462,6cyclictest914875-21grep11:40:292
86783699464,12cyclictest1668-21snmpd12:40:001
86783699461,11cyclictest0-21swapper/108:00:011
867834994639,4cyclictest0-21swapper/007:30:150
867834994638,4cyclictest899504-21kworker/u8:5-events_power_efficient10:49:590
867834994638,4cyclictest21050irq/252-8000000.ethernet07:25:270
867834994637,6cyclictest0-21swapper/009:05:000
867836994534,5cyclictest0-21swapper/109:20:181
86783699447,3cyclictest0-21swapper/109:20:021
867836994433,7cyclictest898618-21grep10:05:301
867836994433,4cyclictest0-21swapper/111:10:291
867836994429,8cyclictest0-21swapper/107:30:011
867836994428,11cyclictest231ktimers/112:15:151
867836994426,13cyclictest0-21swapper/109:55:251
86783699442,13cyclictest24-21ksoftirqd/108:05:011
867834994434,6cyclictest0-21swapper/010:55:300
867834994433,6cyclictest0-21swapper/012:10:300
86783499441,4cyclictest0-21swapper/008:25:010
86783699437,4cyclictest0-21swapper/109:45:001
86783699436,13cyclictest24-21ksoftirqd/110:40:011
867836994326,12cyclictest231ktimers/109:05:061
867834994335,4cyclictest21050irq/252-8000000.ethernet10:10:200
86783499431,4cyclictest0-21swapper/008:05:160
867836994227,9cyclictest0-21swapper/108:35:221
867836994225,11cyclictest231ktimers/107:20:141
867836994224,11cyclictest231ktimers/107:30:131
867834994233,5cyclictest0-21swapper/007:40:000
867834994134,4cyclictest21050irq/252-8000000.ethernet11:45:220
867834994133,4cyclictest21250irq/208-8000000.ethernet10:40:000
867834994129,8cyclictest0-21swapper/007:50:270
86783999402,11cyclictest867927-21wc07:10:012
86783699406,17cyclictest912572-21/usr/sbin/munin11:30:171
867836994029,5cyclictest0-21swapper/111:00:301
867836994020,10cyclictest231ktimers/110:45:051
867834994031,5cyclictest0-21swapper/008:45:290
867834994028,8cyclictest0-21swapper/008:10:280
867834994025,11cyclictest0-21swapper/010:10:000
867834994025,10cyclictest0-21swapper/009:10:200
867834994024,10cyclictest0-21swapper/009:40:200
86783499402,3cyclictest0-21swapper/012:25:010
867836993926,9cyclictest0-21swapper/108:05:281
867836993923,10cyclictest0-21swapper/109:50:281
867834993927,8cyclictest0-21swapper/008:45:010
86783499391,4cyclictest0-21swapper/012:00:010
86783499391,4cyclictest0-21swapper/011:50:130
867836993831,4cyclictest168350irq/126-8000000.ethernet-tx108:20:271
867836993821,8cyclictest22-21rcuc/111:20:271
86783699381,2cyclictest0-21swapper/111:55:021
86783699381,2cyclictest0-21swapper/111:00:011
867834993830,4cyclictest0-21swapper/007:15:020
867834993830,4cyclictest0-21swapper/007:10:280
867834993827,8cyclictest0-21swapper/012:30:290
867834993827,6cyclictest914795-21grep11:40:280
867836993727,5cyclictest0-21swapper/111:40:261
867836993724,9cyclictest22-21rcuc/110:15:021
86783699372,29cyclictest879266-21/usr/sbin/munin08:15:221
867836993714,19cyclictest24-21ksoftirqd/107:45:001
86783699371,29cyclictest884343-21/usr/sbin/munin08:45:171
867834993731,4cyclictest21250irq/208-8000000.ethernet12:03:520
867834993729,4cyclictest21050irq/252-8000000.ethernet09:30:160
867834993727,6cyclictest0-21swapper/009:45:300
867834993727,6cyclictest0-21swapper/009:45:290
867834993727,4cyclictest0-21swapper/012:05:250
867834993726,8cyclictest0-21swapper/008:54:590
867834993726,7cyclictest0-21swapper/010:00:290
867834993726,7cyclictest0-21swapper/010:00:280
867834993723,9cyclictest0-21swapper/007:40:230
867836993628,4cyclictest0-21swapper/110:45:011
867836993624,8cyclictest0-21swapper/109:45:261
867836993624,8cyclictest0-21swapper/109:45:261
867836993622,6cyclictest0-21swapper/110:15:011
86783699361,28cyclictest885184-21/usr/sbin/munin08:50:261
867834993629,4cyclictest21250irq/208-8000000.ethernet09:25:200
867834993629,4cyclictest21250irq/208-8000000.ethernet07:45:230
867834993629,4cyclictest21050irq/252-8000000.ethernet10:25:280
867834993628,5cyclictest882338-21grep08:30:290
86783499362,6cyclictest890447-21tune2fs09:20:200
867834993625,7cyclictest909742-21grep11:10:280
86783499361,33cyclictest0-21swapper/011:30:280
86783699353,27cyclictest24-21ksoftirqd/112:10:201
86783699351,27cyclictest0-21swapper/112:05:161
867834993530,3cyclictest0-21swapper/009:55:100
867834993528,4cyclictest21050irq/252-8000000.ethernet11:25:240
867834993528,4cyclictest21050irq/252-8000000.ethernet11:20:190
867834993528,4cyclictest21050irq/252-8000000.ethernet11:15:190
867834993528,4cyclictest21050irq/252-8000000.ethernet11:00:250
867834993520,4cyclictest528801-1kworker/0:2H+kblockd08:00:010
86783499351,29cyclictest0-21swapper/010:40:070
867836993427,4cyclictest14-21rcu_preempt11:45:261
867836993426,6cyclictest22-21rcuc/111:25:191
867836993425,5cyclictest884075-21grep08:40:301
867834993427,4cyclictest21050irq/252-8000000.ethernet11:35:210
867836993325,4cyclictest901309-21munin-plugin-st10:25:001
867836993325,4cyclictest0-21swapper/112:20:311
867836993324,4cyclictest0-21swapper/108:30:021
867836993322,7cyclictest22-21rcuc/110:00:231
867836993322,7cyclictest22-21rcuc/110:00:231
867836993322,6cyclictest886024-21/usr/sbin/munin08:55:251
867836993322,5cyclictest0-21swapper/109:35:021
867836993321,7cyclictest231ktimers/109:25:251
86783499335,2cyclictest0-21swapper/010:55:000
86783499333,4cyclictest881413-21sendmail_mailqu08:25:290
867834993327,3cyclictest21050irq/252-8000000.ethernet10:20:120
867836993225,4cyclictest168350irq/126-8000000.ethernet-tx111:35:191
867836993223,6cyclictest231ktimers/112:25:271
867836993222,6cyclictest22-21rcuc/110:50:231
867836993122,7cyclictest22-21rcuc/110:25:261
867836993021,6cyclictest22-21rcuc/108:10:231
867836993021,6cyclictest22-21rcuc/107:45:221
867836993021,4cyclictest0-21swapper/109:10:221
867834992616,3cyclictest0-21swapper/007:10:000
867836992114,4cyclictest231ktimers/107:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional