You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-20 - 07:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Celeron G3900 @2800 MHz, Linux 5.4.59-rt36 (Profile)

Latency plot of shadow in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackcslot5s.osadl.org (updated Fri May 20, 2022 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1047328366,2sleep00-21swapper/019:05:110
1184427358,11sleep10-21swapper/119:05:261
103992340,0sleep00-21swapper/000:30:180
1245499240,23cyclictest2089-21meminfo21:25:150
1245599230,1cyclictest13966-21latency_hist20:35:001
1245499230,23cyclictest6921-21meminfo20:15:150
1245499220,21cyclictest17847-21meminfo22:05:160
12455992020,0cyclictest0-21swapper/122:14:211
1245599200,13cyclictest15212-21apt-get22:00:111
1245499200,19cyclictest24820-21meminfo23:45:160
1245499200,18cyclictest0-21swapper/023:50:140
1245499191,17cyclictest24670-21missed_timers21:00:170
1245599189,4cyclictest25126-21ls21:00:211
1245599180,17cyclictest27685-21meminfo22:30:171
1245599180,17cyclictest2256-21meminfo00:10:141
1245599180,17cyclictest15014-21meminfo19:15:021
1245599180,0cyclictest0-21swapper/123:04:181
1245499183,11cyclictest22012-21munin-run23:39:590
1245499180,17cyclictest31447-21meminfo19:55:170
1245499180,17cyclictest10869-21meminfo20:25:160
1245599171,8cyclictest32019-21apt-get00:05:121
12455991717,0cyclictest0-21swapper/123:31:231
1245599171,6cyclictest9293-21apt-get21:45:111
1245599171,6cyclictest5349-21apt-get21:35:121
12455991710,2cyclictest0-21swapper/120:50:001
1245599170,6cyclictest15165-21/usr/sbin/munin23:20:171
12454991717,0cyclictest0-21swapper/022:40:320
1245499170,6cyclictest0-21swapper/000:20:120
1245499170,16cyclictest13901-21meminfo21:55:150
1245599165,8cyclictest4449-21apt-get22:55:121
1245599162,7cyclictest10356-21apt-get23:10:111
12454991616,0cyclictest0-21swapper/020:34:330
1245499160,9cyclictest0-21swapper/020:50:110
1245499160,15cyclictest32521-21meminfo21:20:150
1245499160,15cyclictest27526-21meminfo19:45:190
1245499160,15cyclictest16948-21meminfo23:25:150
1245599157,5cyclictest62050irq/129-eth0-rx22:29:271
1245599155,4cyclictest22744-21munin-run19:35:001
1245599154,9cyclictest3776-21/usr/sbin/munin00:15:121
1245599154,8cyclictest7341-21apt-get21:40:171
1245599154,4cyclictest14550-21cut20:35:141
1245599153,9cyclictest28299-21diskstats23:55:121
1245599153,10cyclictest13229-21apt-get21:55:111
1245599151,8cyclictest27904-21apt-get21:10:121
12455991515,0cyclictest0-21swapper/120:21:061
12455991513,1cyclictest0-21swapper/120:00:171
1245599150,6cyclictest23982-21munin-run23:45:001
1245599150,15cyclictest22664-21meminfo20:55:161
1245599150,14cyclictest4056-21meminfo21:30:171
1245499156,4cyclictest23746-21ls22:20:160
1245499155,9cyclictest22794-21/usr/sbin/munin20:55:170
1245499154,5cyclictest0-21swapper/020:05:120
1245499153,10cyclictest0-21swapper/000:10:100
12454991515,0cyclictest0-21swapper/022:25:200
12454991511,1cyclictest1945-21runrttasks00:03:430
1245499150,6cyclictest0-21swapper/021:05:120
1245499150,3cyclictest0-21swapper/022:00:110
1245499150,14cyclictest8015-21meminfo21:40:230
1245499150,14cyclictest21773-21meminfo22:15:160
1245499150,14cyclictest14805-21meminfo20:35:170
1245499150,13cyclictest0-21swapper/021:15:120
1245499150,12cyclictest19375-21/usr/sbin/munin22:10:140
1245599147,6cyclictest9473-21apt-get00:30:111
1245599146,4cyclictest2319-21/usr/sbin/munin20:05:191
1245599145,5cyclictest30054-21apt-get00:00:101
1245599145,2cyclictest25738-21/usr/sbin/munin19:40:171
1245599144,6cyclictest32185-21unixbench-2d22:40:221
1245599142,8cyclictest26110-21apt-get23:50:111
12455991412,1cyclictest8394-21apt-get23:05:101
1245599140,8cyclictest12323-21apt-get23:15:111
1245599140,14cyclictest23755-21meminfo22:20:171
1245599140,13cyclictest13147-21meminfo19:10:161
1245599140,13cyclictest12112-21meminfo00:35:171
1245499142,6cyclictest0-21swapper/019:20:130
1245499141,7cyclictest20943-21apt-get19:30:110
1245499141,7cyclictest0-21swapper/000:35:110
1245499141,5cyclictest0-21swapper/023:40:100
1245499141,3cyclictest2483-21apt-get22:50:110
12454991412,1cyclictest9-21ksoftirqd/021:45:290
1245499141,1cyclictest0-21swapper/023:15:110
1245499140,5cyclictest0-21swapper/023:10:100
1245499140,13cyclictest16783-21meminfo20:40:160
81812130,2sleep00-21swapper/023:04:350
1245599137,5cyclictest10195-21apt-get20:25:121
1245599137,2cyclictest29862-21/usr/sbin/munin21:15:191
1245599136,6cyclictest19653-21memory19:25:161
1245599136,2cyclictest7299-21sensors_temp20:15:191
1245599135,5cyclictest0-21swapper/119:55:211
1245599135,2cyclictest17589-21unixbench_singl23:25:201
1245599134,8cyclictest31850-21apt-get21:20:111
1245599134,2cyclictest1945-21runrttasks20:13:061
1245599133,6cyclictest20027-21/usr/sbin/munin20:50:191
1245599132,5cyclictest0-21swapper/119:35:131
1245599130,5cyclictest18986-21awk22:10:011
1245599130,12cyclictest3154-21meminfo22:50:151
1245599130,12cyclictest20873-21meminfo23:35:151
1245499138,3cyclictest28468-21gltestperf23:55:130
1245499137,5cyclictest24945-21/usr/sbin/munin19:40:110
1245499137,3cyclictest1585-21switchtime22:45:200
1245499136,3cyclictest9011-21awk20:20:160
1245499135,4cyclictest11477-21df_inode21:50:130
1245499134,4cyclictest14312-21apt-get23:20:110
1245499133,6cyclictest5354-21munin-run00:20:000
1245499133,6cyclictest4867-21/usr/sbin/munin20:10:150
1245499133,6cyclictest18976-21/usr/sbin/munin19:25:130
1245499132,7cyclictest24102-21wc19:35:210
1245499131,8cyclictest7169-21munin-run21:40:010
1245499131,6cyclictest0-21swapper/020:00:100
1245499131,3cyclictest27008-21apt-get22:30:100
12454991312,1cyclictest0-21swapper/023:05:160
1245599127,3cyclictest8560-21sensors_temp00:25:261
1245599126,2cyclictest29664-21/usr/sbin/munin19:50:191
1245599124,4cyclictest25938-21apt-get21:05:111
1245599124,4cyclictest1378-21apt-get21:25:101
1245599124,4cyclictest0-21swapper/122:45:121
1245599124,3cyclictest16908-21tr20:40:181
1245599123,8cyclictest17019-21apt-get19:20:121
1245599123,3cyclictest28973-21apt-get22:35:101
1245599123,3cyclictest0-21swapper/122:15:191
1245599122,1cyclictest11259-21apt-get21:50:121
1245599121,3cyclictest24148-21apt-get23:45:131
1245499122,4cyclictest0-21swapper/022:55:100
1245499120,6cyclictest18892-21ntp_states20:45:190
1245499120,6cyclictest15035-21apt-get19:15:120
1245499120,2cyclictest0-21swapper/021:10:120
1245499114,6cyclictest0-21swapper/000:05:120
1245499113,7cyclictest0-21swapper/019:10:200
1245499112,7cyclictest29535-21ls19:50:180
1245499112,5cyclictest0-21swapper/021:30:120
1245599104,4cyclictest5536-21apt-get00:20:121
1245599101,6cyclictest26850-21apt-get19:45:121
1245499102,5cyclictest0-21swapper/022:35:100
1245499102,3cyclictest0-21swapper/023:30:100
1245499100,5cyclictest0-21swapper/000:25:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional