You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-01 - 01:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Thu Nov 30, 2023 12:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
200566799822,12cyclictest2028004-21df09:45:280
200566799761,12cyclictest2013194-21/usr/sbin/munin08:10:350
200566799752,13cyclictest2038570-21df_inode10:50:260
200566799752,13cyclictest2038570-21df_inode10:50:250
200566799732,10cyclictest2011208-21meminfo07:55:340
200566799712,4cyclictest2006425-21diskstats07:15:250
200566799712,4cyclictest2006425-21diskstats07:15:240
200566799697,6cyclictest2007651-21ssh07:25:230
2005667996846,18cyclictest0-21swapper/011:05:150
2005667996729,33cyclictest14850irq/28-2000000008:35:370
200566799672,61cyclictest2033767-21/usr/sbin/munin10:20:400
200566799668,6cyclictest12-21ksoftirqd/011:15:000
2005667996416,24cyclictest2018316-21/usr/sbin/munin08:45:270
200566799633,15cyclictest2054620-21apt-get12:30:230
2005667996323,23cyclictest2020880-21/usr/sbin/munin09:00:250
200566799631,10cyclictest2042539-21/usr/sbin/munin11:15:380
200566799623,4cyclictest2035161-21df_inode10:30:280
2005667996231,27cyclictest2026225-21/usr/sbin/munin09:35:380
200566799622,55cyclictest2040494-21latency_hist11:05:020
200566799621,57cyclictest0-21swapper/011:30:390
200566799621,57cyclictest0-21swapper/011:30:380
200566799621,12cyclictest2043511-21/usr/sbin/munin11:20:350
2005667996127,28cyclictest156150irq/134-800000011:35:210
200566799612,15cyclictest2037112-21meminfo10:40:340
200566799612,15cyclictest2020012-21apt-get08:55:230
200566799612,12cyclictest2016014-21irqstats08:30:260
200566799612,12cyclictest2016014-21irqstats08:30:260
2005667996118,40cyclictest16950irq/224-800000012:00:000
2005667996114,43cyclictest2007328-21sshd07:22:240
200566799611,2cyclictest0-21swapper/009:45:000
2005667996022,34cyclictest2012785-21latency_hist08:10:020
200566799602,19cyclictest2053753-21df_inode12:25:310
200566799602,13cyclictest2044360-21memory11:25:360
2005667996020,36cyclictest14850irq/28-2000000012:00:350
200566799601,55cyclictest2052835-21/usr/sbin/munin12:20:240
200566799592,53cyclictest2019698-21unixbench_multi08:50:360
2005667995924,31cyclictest0-21swapper/009:15:250
200566799592,14cyclictest2013766-21df08:15:260
200566799592,11cyclictest2051162-21df12:10:190
2005667995912,4cyclictest2025464-21/usr/sbin/munin09:30:280
200567099582,3cyclictest131rcu_preempt08:30:281
200567099582,3cyclictest131rcu_preempt08:30:281
200566799586,4cyclictest2047024-21ps11:40:350
200566799582,7cyclictest2028813-21munin-run09:55:010
200566799582,5cyclictest2008520-21munin-run07:35:010
200566799582,14cyclictest2032640-21/usr/sbin/munin10:15:290
200566799582,11cyclictest2048390-21/usr/sbin/munin11:50:240
200566799581,5cyclictest2014744-21df_inode08:20:280
200566799581,12cyclictest1549-21snmpd10:35:400
200566799573,16cyclictest2017544-21diskstats08:40:290
200566799572,12cyclictest2024835-21meminfo09:25:270
200566799572,11cyclictest2010030-21perl07:45:310
200566799571,11cyclictest2034566-21/usr/sbin/munin10:25:330
200566799571,10cyclictest2031794-21/usr/sbin/munin10:10:330
200567099564,3cyclictest131rcu_preempt07:25:231
200566799562,17cyclictest2006074-21meminfo07:15:020
200566799562,13cyclictest2031040-21memory10:05:350
200566799562,13cyclictest2021989-21irqstats09:05:320
200566799562,12cyclictest2055519-21df12:35:270
2005667995619,33cyclictest2050913-21cat12:10:010
2005667995619,33cyclictest2047772-21/usr/sbin/munin11:45:390
200566799561,5cyclictest2038180-21/usr/sbin/munin10:45:440
200566799561,5cyclictest2038180-21/usr/sbin/munin10:45:430
200566799561,11cyclictest2008726-21/usr/sbin/munin07:35:130
200566799552,13cyclictest2022836-21irqstats09:10:320
200566799551,13cyclictest2030187-21/usr/sbin/munin10:00:310
200566799542,12cyclictest2039706-21irqstats10:55:300
200566799541,14cyclictest2029222-21/usr/sbin/munin09:55:250
200566799541,12cyclictest2052258-21/usr/sbin/munin12:15:350
200567099533,30cyclictest131rcu_preempt10:45:401
200567099533,30cyclictest131rcu_preempt10:45:401
200566799529,4cyclictest0-21swapper/008:00:320
2005667995215,33cyclictest2024324-21latency_hist09:25:020
200566799511,11cyclictest2015529-21sshd08:29:250
200567099502,3cyclictest131rcu_preempt10:40:341
2005670994922,3cyclictest131rcu_preempt07:45:201
2005667994913,31cyclictest1020645-1kworker/0:0H07:55:020
2005667994913,31cyclictest1020645-1kworker/0:0H07:55:010
2005670994824,3cyclictest131rcu_preempt09:40:431
200566799481,43cyclictest2005743-21sed07:10:000
2005670994737,7cyclictest23-21ksoftirqd/107:55:301
200566799471,9cyclictest2009673-21cat07:45:000
2005670994628,14cyclictest1549-21snmpd12:00:371
2005670994623,3cyclictest131rcu_preempt09:30:291
2005670994621,3cyclictest131rcu_preempt11:55:351
200567099455,3cyclictest131rcu_preempt10:10:001
2005670994520,3cyclictest131rcu_preempt12:15:371
2005670994519,3cyclictest131rcu_preempt08:05:371
2005670994425,15cyclictest2017524-21sshd08:40:261
2005670994421,3cyclictest131rcu_preempt09:25:251
2005670994416,3cyclictest131rcu_preempt09:45:411
200567099441,3cyclictest131rcu_preempt11:30:301
200567099441,3cyclictest131rcu_preempt11:30:291
200567099434,28cyclictest131rcu_preempt07:35:211
200567099433,3cyclictest131rcu_preempt12:30:321
2005670994330,4cyclictest131rcu_preempt08:35:361
200567099432,38cyclictest2031779-21dropbear10:10:341
200567099432,37cyclictest2029956-21dropbear10:00:251
2005670994316,3cyclictest131rcu_preempt10:20:351
2005670994231,8cyclictest23-21ksoftirqd/110:39:591
200567099422,4cyclictest131rcu_preempt12:25:421
200567099422,37cyclictest928-21dropbear08:20:261
200567099422,35cyclictest928-21dropbear09:00:271
200567099421,37cyclictest928-21dropbear11:25:051
200567099416,3cyclictest131rcu_preempt10:25:221
2005670994124,13cyclictest1549-21snmpd09:53:191
200567099412,3cyclictest131rcu_preempt11:10:301
200567099411,4cyclictest131rcu_preempt11:40:321
2005670994114,3cyclictest131rcu_preempt09:05:371
200567099411,3cyclictest131rcu_preempt07:45:001
200567099411,35cyclictest928-21dropbear12:10:241
200567099408,3cyclictest131rcu_preempt07:15:341
200567099408,3cyclictest131rcu_preempt07:15:331
200567099404,5cyclictest131rcu_preempt11:20:021
200567099402,3cyclictest131rcu_preempt11:20:261
200567099402,3cyclictest131rcu_preempt10:35:011
200567099402,34cyclictest928-21dropbear09:19:521
2005670994011,3cyclictest131rcu_preempt11:35:411
200567099394,3cyclictest131rcu_preempt11:05:311
200567099393,8cyclictest23-21ksoftirqd/109:10:271
2005670993926,10cyclictest2013704-21/usr/sbin/munin08:15:291
200567099392,5cyclictest131rcu_preempt08:10:331
200567099392,3cyclictest131rcu_preempt09:55:271
200567099392,33cyclictest2039442-21/usr/sbin/munin10:55:341
2005670993923,12cyclictest1549-21snmpd12:23:481
200567099391,3cyclictest131rcu_preempt10:15:341
200567099391,35cyclictest928-21dropbear12:35:341
2005670993912,5cyclictest131rcu_preempt11:45:301
200567499382,3cyclictest0-21swapper/212:03:442
200567499381,34cyclictest0-21swapper/210:25:282
200567099389,6cyclictest131rcu_preempt08:45:321
200567099387,4cyclictest131rcu_preempt07:15:001
2005670993824,8cyclictest0-21swapper/107:20:061
200567099382,3cyclictest131rcu_preempt08:05:021
200567099381,3cyclictest131rcu_preempt10:50:341
200567099381,3cyclictest131rcu_preempt10:50:331
200567499371,4cyclictest0-21swapper/212:15:262
200567499371,4cyclictest0-21swapper/209:30:202
200567499371,2cyclictest0-21swapper/208:15:402
200567099378,6cyclictest131rcu_preempt09:35:151
200567099377,3cyclictest131rcu_preempt07:30:021
200567099374,3cyclictest131rcu_preempt08:55:361
200567499361,5cyclictest0-21swapper/211:10:362
200567499361,4cyclictest0-21swapper/212:30:392
200567499361,4cyclictest0-21swapper/212:10:212
200567499361,4cyclictest0-21swapper/211:25:392
200567499361,4cyclictest0-21swapper/210:35:382
200567499361,4cyclictest0-21swapper/210:10:072
200567499361,4cyclictest0-21swapper/209:45:422
200567499361,4cyclictest0-21swapper/209:10:252
200567499361,4cyclictest0-21swapper/208:55:362
200567499361,4cyclictest0-21swapper/207:45:212
200567099363,5cyclictest2015544-21latency_hist08:30:011
2005670993621,11cyclictest23-21ksoftirqd/108:50:181
200567099361,3cyclictest131rcu_preempt11:50:151
200567499351,4cyclictest0-21swapper/212:25:402
200567499351,4cyclictest0-21swapper/211:55:362
200567499351,4cyclictest0-21swapper/211:50:152
200567499351,4cyclictest0-21swapper/211:45:382
200567499351,4cyclictest0-21swapper/211:35:282
200567499351,4cyclictest0-21swapper/211:05:202
200567499351,4cyclictest0-21swapper/210:55:352
200567499351,4cyclictest0-21swapper/210:45:392
200567499351,4cyclictest0-21swapper/210:45:382
200567499351,4cyclictest0-21swapper/210:15:292
200567499351,4cyclictest0-21swapper/210:00:282
200567499351,4cyclictest0-21swapper/209:55:202
200567499351,4cyclictest0-21swapper/209:40:362
200567499351,4cyclictest0-21swapper/209:25:142
200567499351,4cyclictest0-21swapper/208:45:412
200567499351,4cyclictest0-21swapper/208:40:372
200567499351,4cyclictest0-21swapper/208:20:282
200567499351,4cyclictest0-21swapper/208:10:352
200567499351,4cyclictest0-21swapper/207:15:312
200567499351,4cyclictest0-21swapper/207:15:312
200567099353,4cyclictest131rcu_preempt09:25:011
200567099351,30cyclictest0-21swapper/111:01:271
200567499341,4cyclictest0-21swapper/212:35:292
200567499341,4cyclictest0-21swapper/212:20:272
200567499341,4cyclictest0-21swapper/211:40:192
200567499341,4cyclictest0-21swapper/211:30:242
200567499341,4cyclictest0-21swapper/211:30:242
200567499341,4cyclictest0-21swapper/211:20:302
200567499341,4cyclictest0-21swapper/211:19:262
200567499341,4cyclictest0-21swapper/210:50:362
200567499341,4cyclictest0-21swapper/210:50:352
200567499341,4cyclictest0-21swapper/210:30:372
200567499341,4cyclictest0-21swapper/210:05:252
200567499341,4cyclictest0-21swapper/209:35:352
200567499341,4cyclictest0-21swapper/209:15:242
200567499341,4cyclictest0-21swapper/209:05:352
200567499341,4cyclictest0-21swapper/209:00:262
200567499341,4cyclictest0-21swapper/208:50:172
200567499341,4cyclictest0-21swapper/208:30:212
200567499341,4cyclictest0-21swapper/208:30:202
200567499341,4cyclictest0-21swapper/207:55:262
200567499341,4cyclictest0-21swapper/207:55:002
200567499341,4cyclictest0-21swapper/207:55:002
200567499341,4cyclictest0-21swapper/207:35:272
200567499341,4cyclictest0-21swapper/207:25:212
200567499331,4cyclictest0-21swapper/210:40:342
200567499331,4cyclictest0-21swapper/210:20:232
200567499331,4cyclictest0-21swapper/208:35:292
200567499331,4cyclictest0-21swapper/208:05:372
200567499331,4cyclictest0-21swapper/208:01:252
200567099336,3cyclictest131rcu_preempt07:10:001
200567099331,4cyclictest131rcu_preempt07:55:021
200567099331,4cyclictest131rcu_preempt07:55:011
200567499322,4cyclictest0-21swapper/209:52:272
200567499321,4cyclictest0-21swapper/207:30:052
200567499321,4cyclictest0-21swapper/207:14:232
2005670993224,5cyclictest2051045-21latency_hist12:10:011
200567499311,4cyclictest0-21swapper/212:05:272
200567499311,4cyclictest0-21swapper/209:20:272
200567499311,4cyclictest0-21swapper/208:30:012
200567499311,3cyclictest0-21swapper/207:44:262
200567499311,26cyclictest0-21swapper/207:22:272
200567499301,4cyclictest0-21swapper/211:00:272
200567499271,4cyclictest0-21swapper/207:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional