You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-20 - 04:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Wed Jun 19, 2024 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26851749912335,81cyclictest0-21swapper/007:11:070
268518099122115,5cyclictest391ktimers/307:11:043
26851759910193,5cyclictest231ktimers/107:11:041
268517899977,50cyclictest2708718-21apt-get09:20:102
2685178998779,5cyclictest311ktimers/207:11:042
2685175997716,13cyclictest2714618-21/usr/sbin/munin09:55:221
268517899719,23cyclictest30-21rcuc/207:10:012
268517599681,8cyclictest0-21swapper/109:35:011
268517899675,20cyclictest2712938-21/usr/sbin/munin09:45:192
2685175996719,39cyclictest0-21swapper/108:45:331
2685174996638,17cyclictest15-21rcuc/011:55:020
268517899631,23cyclictest32-21ksoftirqd/210:50:012
268517899631,23cyclictest32-21ksoftirqd/210:50:012
2685175996334,25cyclictest2716902-21unixbench_singl10:05:361
268517599611,2cyclictest0-21swapper/111:10:011
268517599591,53cyclictest0-21swapper/108:20:021
268517599588,40cyclictest0-21swapper/110:20:331
268517499576,30cyclictest25050irq/422-mmc109:35:000
2685175995635,17cyclictest2717882-21cron10:15:001
268517599552,28cyclictest2741097-21/usr/sbin/munin12:30:181
268517599541,47cyclictest0-21swapper/108:00:181
268517599536,37cyclictest0-21swapper/111:55:011
268517599531,8cyclictest2696771-21fschecks_count08:10:191
268517599531,11cyclictest2695834-21/usr/sbin/munin08:05:371
268517599524,39cyclictest0-21swapper/109:45:341
268517599524,37cyclictest0-21swapper/112:10:351
268517599524,37cyclictest0-21swapper/112:10:351
2685175995230,16cyclictest0-21swapper/109:05:361
268517599521,9cyclictest2739418-21/usr/sbin/munin12:20:131
268517599521,8cyclictest2724315-21/usr/sbin/munin10:50:271
2685175995210,34cyclictest2688841-21latency_hist07:25:011
268517899518,10cyclictest2730573-21apt-get11:30:022
2685178995136,10cyclictest1247-21cron08:05:002
2685178995128,16cyclictest311ktimers/210:05:162
2685178995117,8cyclictest862-21systemd-network10:10:052
268517599519,34cyclictest0-21swapper/110:15:361
268517599515,36cyclictest0-21swapper/109:45:011
268517599512,9cyclictest2690343-21tail07:30:351
268517599512,8cyclictest2721557-21/usr/sbin/munin10:35:201
268517599512,39cyclictest2730480-21grep11:25:381
268517599511,8cyclictest2729618-21/usr/sbin/munin11:20:361
268517599511,8cyclictest2720198-21/usr/sbin/munin10:25:361
268517599511,8cyclictest2691938-21/usr/sbin/munin07:40:331
2685175995114,28cyclictest0-21swapper/110:40:231
2685178995031,14cyclictest311ktimers/208:05:112
268517599507,37cyclictest2699625-21/usr/sbin/munin08:25:271
268517599504,37cyclictest0-21swapper/111:00:211
268517599504,36cyclictest2708414-21apt-get09:20:081
268517599503,39cyclictest2739192-21cron12:20:001
268517599502,9cyclictest2687318-21lsblk07:15:231
268517599502,8cyclictest2690800-21cut07:35:201
2685175995027,18cyclictest0-21swapper/110:00:341
268517599501,9cyclictest2709725-21grep09:25:241
268517599501,8cyclictest2742231-21/usr/sbin/munin12:35:261
268517599501,10cyclictest2724858-21apt-get10:55:181
268517599498,32cyclictest2728778-21unixbench_multi11:15:311
268517599497,33cyclictest0-21swapper/111:45:341
268517599496,36cyclictest0-21swapper/107:30:011
268517599492,5cyclictest2731042-21/usr/sbin/munin11:30:251
268517599491,9cyclictest2735260-21/usr/sbin/munin11:55:181
268517599491,8cyclictest2701960-21grep08:40:211
2685175994916,26cyclictest0-21swapper/111:40:311
268517599491,11cyclictest2707968-21cut09:15:221
268517599491,10cyclictest2700358-21fschecks_time08:30:251
268517899488,14cyclictest30-21rcuc/210:35:012
2685178994831,13cyclictest311ktimers/212:30:102
268517599488,32cyclictest2711398-21dropbear09:35:221
268517599488,31cyclictest0-21swapper/107:45:401
2685175994822,20cyclictest2706927-21/usr/sbin/munin09:10:231
268517599482,12cyclictest2704950-21tail08:55:451
268517599482,10cyclictest2727398-21apt-get11:10:171
268517599481,9cyclictest2703550-21apt-get08:50:191
268517599481,9cyclictest2703550-21apt-get08:50:191
2685174994839,6cyclictest2712740-21munin-run09:45:010
268517599474,34cyclictest2721156-21grep10:30:331
268517599472,4cyclictest2736352-21/usr/sbin/munin12:00:271
268517599471,8cyclictest2714037-21/usr/sbin/munin09:50:231
268517599471,8cyclictest2714037-21/usr/sbin/munin09:50:231
268517599471,36cyclictest2732253-21grep11:35:371
2685178994638,4cyclictest2732346-21latency_hist11:40:002
2685178994628,12cyclictest0-21swapper/208:10:312
2685178994627,12cyclictest311ktimers/209:05:132
268517599466,32cyclictest0-21swapper/107:55:261
268517599462,12cyclictest2701009-21/usr/sbin/munin08:35:381
268517599462,12cyclictest2701009-21/usr/sbin/munin08:35:371
2685175994620,23cyclictest0-21swapper/108:20:371
268517599461,9cyclictest2736873-21munin-node12:05:101
268517599461,4cyclictest2740425-21fschecks_time12:25:231
268517599454,3cyclictest0-21swapper/109:00:221
268517599452,34cyclictest2693832-21latency_hist07:55:011
2685174994533,9cyclictest0-21swapper/009:10:010
2685178994427,9cyclictest0-21swapper/207:35:322
2685178994425,14cyclictest311ktimers/210:50:102
2685178994424,13cyclictest311ktimers/210:25:152
2685178994416,13cyclictest311ktimers/208:50:162
2685178994416,13cyclictest311ktimers/208:50:162
268517599443,7cyclictest2723331-21cut10:45:241
268517599443,7cyclictest2723331-21cut10:45:241
2685178994334,6cyclictest0-21swapper/209:00:002
2685178994333,6cyclictest0-21swapper/208:20:332
2685174994336,5cyclictest2714421-21munin-plugin-st09:55:000
2685174994336,5cyclictest2714421-21munin-plugin-st09:55:000
2685174994336,4cyclictest0-21swapper/012:05:110
2685174994335,5cyclictest2723818-21munin-plugin-st10:50:000
2685174994335,5cyclictest2723818-21munin-plugin-st10:50:000
2685174994331,8cyclictest2742468-21grep12:35:330
268517499432,39cyclictest0-21swapper/012:25:310
268517499432,11cyclictest2685169-21cyclictest10:35:010
268517499431,35cyclictest2701940-21diskstats08:40:200
268517499431,13cyclictest0-21swapper/010:30:010
2685178994224,12cyclictest311ktimers/207:30:142
2685174994234,5cyclictest2733961-21grep11:45:350
2685174994228,8cyclictest0-21swapper/008:10:310
268517499421,35cyclictest0-21swapper/009:25:150
2685178994132,5cyclictest0-21swapper/212:20:352
2685178994127,8cyclictest0-21swapper/208:25:372
2685178994125,7cyclictest0-21swapper/207:25:442
2685178994125,12cyclictest311ktimers/207:50:112
2685174994135,3cyclictest0-21swapper/008:30:240
2685174994130,7cyclictest2688558-21grep07:20:480
2685174994129,9cyclictest0-21swapper/007:50:320
2685174994122,4cyclictest26850irq/343-wl18xx10:15:150
2685178994030,5cyclictest0-21swapper/207:15:392
2685178994018,15cyclictest311ktimers/212:00:102
268517899401,10cyclictest2694690-21munin-run08:00:002
268517499405,14cyclictest15-21rcuc/007:50:010
2685174994030,7cyclictest2719524-21grep10:20:370
268517499402,4cyclictest2691666-21cut07:40:230
2685174994023,2cyclictest0-21swapper/010:45:010
268517499401,3cyclictest0-21swapper/011:25:010
2685178993928,5cyclictest0-21swapper/211:40:202
2685178993927,8cyclictest0-21swapper/211:50:252
2685178993926,8cyclictest0-21swapper/211:30:362
2685178993919,13cyclictest30-21rcuc/210:00:012
268517599391,3cyclictest2685265-21latency_hist07:10:011
2685174993932,4cyclictest20950irq/251-8000000.ethernet10:05:000
2685174993931,4cyclictest2717043-21apt-key10:10:010
2685174993929,4cyclictest21150irq/209-8000000.ethernet10:10:030
268517499391,4cyclictest2726620-21df_inode11:05:180
268517499391,12cyclictest0-21swapper/007:20:010
2685178993827,7cyclictest2712689-21grep09:40:402
2685178993821,8cyclictest0-21swapper/210:30:322
268517499383,6cyclictest2739079-21unixbench_multi12:15:330
268517499382,29cyclictest0-21swapper/009:20:100
268517499382,11cyclictest2732164-21awk11:35:360
2685174993817,19cyclictest0-21swapper/010:40:010
268517499381,6cyclictest0-21swapper/012:05:010
268517499381,2cyclictest0-21swapper/012:15:020
268517499381,2cyclictest0-21swapper/012:15:010
2685178993728,6cyclictest311ktimers/211:05:122
2685178993726,7cyclictest0-21swapper/208:45:332
2685178993713,7cyclictest2735819-21cat12:00:002
268517899371,31cyclictest0-21swapper/207:45:352
2685174993724,9cyclictest0-21swapper/011:55:310
268517499372,32cyclictest2713464-21grep09:45:340
268517499371,4cyclictest0-21swapper/009:35:010
268517499371,30cyclictest0-21swapper/010:55:150
268517499371,2cyclictest0-21swapper/008:05:010
268517499371,29cyclictest2728204-21sort11:15:010
268517499371,21cyclictest0-21swapper/008:55:160
2685178993625,5cyclictest0-21swapper/210:17:052
268517499368,26cyclictest131ktimers/010:50:350
268517499362,4cyclictest2699742-21ptp4l08:25:330
2685174993622,10cyclictest0-21swapper/011:30:330
268517499361,33cyclictest0-21swapper/008:50:150
268517499361,33cyclictest0-21swapper/008:50:150
268517499361,2cyclictest0-21swapper/011:45:010
268517499361,21cyclictest0-21swapper/007:55:270
2685178993526,5cyclictest0-21swapper/212:35:342
2685178993524,5cyclictest0-21swapper/208:15:212
2685178993519,11cyclictest0-21swapper/210:20:342
2685178993518,10cyclictest0-21swapper/209:25:242
2685178993517,10cyclictest0-21swapper/209:15:212
268517899351,2cyclictest0-21swapper/209:40:012
268517899351,28cyclictest0-21swapper/211:20:182
268517499354,28cyclictest0-21swapper/012:30:280
2685174993529,4cyclictest21150irq/209-8000000.ethernet08:05:310
2685174993527,5cyclictest0-21swapper/011:25:200
2685174993515,6cyclictest2344151-1kworker/0:1H+mmc_complete08:25:010
268517499351,32cyclictest0-21swapper/008:15:110
2685178993424,5cyclictest0-21swapper/212:05:212
2685178993423,6cyclictest0-21swapper/210:55:332
268517899341,27cyclictest0-21swapper/209:30:352
2685174993428,4cyclictest21150irq/209-8000000.ethernet11:00:260
2685174993427,5cyclictest0-21swapper/008:40:010
2685174993427,5cyclictest0-21swapper/008:40:010
2685174993425,4cyclictest0-21swapper/008:50:010
2685178993323,6cyclictest2701009-21/usr/sbin/munin08:35:342
2685178993323,6cyclictest2701009-21/usr/sbin/munin08:35:342
2685178993322,6cyclictest0-21swapper/211:45:232
2685174993328,3cyclictest0-21swapper/007:25:110
2685174993327,3cyclictest0-21swapper/009:55:160
2685174993324,6cyclictest20950irq/251-8000000.ethernet09:15:120
2685174993319,10cyclictest0-21swapper/009:15:010
268517899328,18cyclictest30-21rcuc/209:00:212
268517899323,6cyclictest2726326-21users11:00:352
2685178993223,5cyclictest0-21swapper/208:40:222
268517899321,26cyclictest0-21swapper/212:15:302
2685174993225,3cyclictest2706006-21latency_hist09:05:010
2685174993222,7cyclictest0-21swapper/011:15:310
2685174993218,10cyclictest0-21swapper/012:20:320
268517499321,3cyclictest0-21swapper/007:10:010
2685178993125,4cyclictest0-21swapper/211:15:212
2685178993122,6cyclictest2722908-21grep10:40:352
2685174993125,4cyclictest21150irq/209-8000000.ethernet07:35:150
268517499311,2cyclictest0-21swapper/007:30:310
268517899309,4cyclictest26950irq/343-s-wl18xx11:11:142
2685178993020,7cyclictest2713776-21/usr/sbin/munin09:50:102
2685178993020,7cyclictest2713776-21/usr/sbin/munin09:50:092
2685178993020,6cyclictest0-21swapper/207:45:012
2685178992921,5cyclictest2688674-21munin-plugin-st07:25:012
2685178992914,10cyclictest32-21ksoftirqd/212:30:012
2685178992817,8cyclictest2706927-21/usr/sbin/munin09:10:142
268517899281,3cyclictest2700172-21apt-get08:30:132
2685178992715,9cyclictest30-21rcuc/210:00:222
268517899271,3cyclictest0-21swapper/212:10:142
268517899271,3cyclictest0-21swapper/212:10:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional