You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-29 - 19:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Celeron G3900 @2800 MHz, Linux 5.4.59-rt36 (Profile)

Latency plot of shadow in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackcslot5s.osadl.org (updated Sun Jan 29, 2023 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
263129073,2sleep00-21swapper/007:05:170
349427460,10sleep10-21swapper/107:06:501
143782310,0sleep00-21swapper/011:40:170
236942270,0sleep023695-21/usr/sbin/munin07:55:280
397599230,23cyclictest29361-21kworker/0:011:00:210
397599230,22cyclictest20782-21meminfo11:55:240
397599221,20cyclictest29361-21kworker/0:011:20:130
397699211,12cyclictest9098-21apt-get10:05:161
397699211,12cyclictest5147-21apt-get09:55:191
397699210,20cyclictest7803-21meminfo10:00:191
397699210,20cyclictest27521-21meminfo10:50:191
397599211,18cyclictest29361-21kworker/0:012:21:390
397599210,21cyclictest29361-21kworker/0:008:23:090
397599210,20cyclictest29361-21kworker/0:007:14:570
397599210,20cyclictest29361-21kworker/0:007:14:570
397699200,1cyclictest23092-21users09:15:251
397699200,19cyclictest0-21swapper/108:55:191
397599202,18cyclictest29361-21kworker/0:007:24:490
397699190,18cyclictest0-21swapper/108:10:191
397699190,10cyclictest0-21swapper/112:30:151
397599194,15cyclictest29361-21kworker/0:007:34:570
397599194,15cyclictest29361-21kworker/0:007:29:350
397599191,18cyclictest29361-21kworker/0:012:29:080
397599190,18cyclictest7237-21meminfo07:15:180
397599190,18cyclictest29361-21kworker/0:010:51:410
3976991814,4cyclictest17857-21kworker/1:107:41:481
397699180,9cyclictest0-21swapper/112:05:171
397699180,17cyclictest25226-21meminfo08:00:221
397699180,16cyclictest14602-21kworker/1:110:31:401
397599187,11cyclictest29361-21kworker/0:009:50:090
397599186,12cyclictest29361-21kworker/0:009:55:170
397599184,14cyclictest29361-21kworker/0:011:47:070
397599182,3cyclictest0-21swapper/011:50:150
397599180,17cyclictest3017-21meminfo11:10:190
397599180,17cyclictest19633-21meminfo10:30:220
3976991715,1cyclictest27991-21/usr/sbin/munin12:15:251
397699170,5cyclictest7949-21apt-get08:40:161
397699170,17cyclictest0-21swapper/111:58:111
397699170,16cyclictest4179-21meminfo12:35:221
397699170,16cyclictest21597-21meminfo10:35:191
397699170,10cyclictest19774-21apt-get09:10:151
397599172,15cyclictest29361-21kworker/0:009:43:210
397599170,17cyclictest29361-21kworker/0:011:15:030
397599170,17cyclictest29361-21kworker/0:009:36:030
397599170,17cyclictest29361-21kworker/0:008:25:060
397599170,16cyclictest31127-21meminfo08:15:210
397599170,16cyclictest22768-21meminfo12:00:210
397599170,11cyclictest0-21swapper/009:05:160
397699166,9cyclictest8212-21kworker/1:207:25:521
397699163,6cyclictest10356-21munin-run07:25:011
397699162,7cyclictest30454-21apt-get08:15:161
397699161,9cyclictest22567-21apt-get07:55:191
3976991611,4cyclictest13733-21latency_hist08:55:011
397699161,12cyclictest22910-21apt-get10:40:161
397699161,10cyclictest27669-21apt-get09:30:181
397699160,9cyclictest0-21swapper/108:45:161
397699160,15cyclictest1015-21meminfo11:05:221
397599169,4cyclictest23315-21gltestperf10:40:190
397599167,9cyclictest29361-21kworker/0:008:03:210
397599165,10cyclictest15837-21apt-get09:00:170
3975991616,0cyclictest9-21ksoftirqd/011:30:560
397599161,1cyclictest15230-21cstates10:20:160
397599160,15cyclictest21267-21meminfo07:50:180
397599160,15cyclictest14530-21meminfo08:55:250
397699156,8cyclictest12183-21ls10:10:241
397699156,3cyclictest1945-21runrttasks11:15:231
397699153,11cyclictest22092-21apt-get12:00:171
397699152,9cyclictest3999-21apt-get07:10:151
397699152,9cyclictest3999-21apt-get07:10:151
397699152,9cyclictest15023-21apt-get10:20:161
397699151,8cyclictest14307-21apt-get07:34:591
397699151,1cyclictest26025-21apt-get12:10:141
397699150,15cyclictest13706-21meminfo10:15:201
397699150,14cyclictest27191-21meminfo08:05:191
397699150,14cyclictest25550-21meminfo10:45:201
397599153,7cyclictest16995-21apt-get10:25:200
397599153,6cyclictest305-21apt-get11:05:170
397599151,14cyclictest29361-21kworker/0:010:35:060
397599151,13cyclictest29361-21kworker/0:009:48:280
397599150,8cyclictest18672-21df07:45:140
397599150,15cyclictest29361-21kworker/0:012:09:550
397699147,5cyclictest0-21swapper/107:15:221
397699145,5cyclictest62250irq/131-eth0-tx11:50:191
397699143,6cyclictest0-21swapper/111:05:001
397699142,7cyclictest2344-21apt-get11:10:151
397699142,6cyclictest3165-21apt-get09:50:151
397699142,4cyclictest0-21swapper/112:25:201
397699142,11cyclictest31624-21apt-get09:40:151
397699141,5cyclictest12219-21apt-get11:35:191
397699140,7cyclictest0-21swapper/110:55:221
397599144,9cyclictest1945-21runrttasks12:34:320
397599144,2cyclictest16494-21apt-get07:40:160
397599142,12cyclictest29361-21kworker/0:012:35:000
397599141,7cyclictest13032-21apt-get10:15:160
397599141,7cyclictest11735-21meminfo10:10:200
3975991414,0cyclictest28892-21ls09:30:260
397599141,12cyclictest0-21swapper/010:00:150
397599140,7cyclictest0-21swapper/009:10:160
397699139,3cyclictest8407-21/usr/sbin/munin11:25:201
397699137,4cyclictest30187-21/usr/sbin/munin09:35:191
397699136,3cyclictest10247-21apt-get11:30:161
397699135,6cyclictest0-21swapper/109:20:291
397699133,7cyclictest20595-21apt-get07:50:141
3976991311,1cyclictest0-21swapper/111:20:211
397699130,7cyclictest1716-21/usr/sbin/munin09:45:201
397699130,6cyclictest3821-21munin-run08:30:011
397699130,5cyclictest0-21swapper/111:45:161
397699130,13cyclictest16243-21kworker/1:008:39:241
397699130,12cyclictest19130-21meminfo07:45:171
397599138,3cyclictest1945-21runrttasks08:45:570
397599135,1cyclictest0-21swapper/009:15:150
397599133,5cyclictest26513-21/usr/sbin/munin08:05:220
397599133,4cyclictest0-21swapper/011:25:300
397599132,7cyclictest28824-21apt-get10:55:220
397599132,6cyclictest9095-21/usr/sbin/munin10:05:240
397599132,11cyclictest29361-21kworker/0:008:35:330
3975991310,2cyclictest27151-21timerandwakeup12:10:240
397599130,12cyclictest26383-21meminfo09:25:290
288272130,0sleep00-21swapper/008:10:190
397699126,5cyclictest1973-21latency_hist08:25:001
397699124,5cyclictest0-21swapper/110:25:201
397699123,5cyclictest29986-21apt-get12:20:171
397699122,7cyclictest5174-21ls08:30:311
397699122,7cyclictest0-21swapper/111:41:181
397699122,5cyclictest0-21swapper/109:25:241
397699120,6cyclictest0-21swapper/109:05:251
397599125,4cyclictest25691-21grep10:45:220
397599123,6cyclictest5352-21/usr/sbin/munin08:30:310
397599123,4cyclictest7945-21/usr/sbin/munin08:40:250
397599120,6cyclictest0-21swapper/009:20:160
397599120,6cyclictest0-21swapper/007:34:590
397599120,12cyclictest29361-21kworker/0:012:15:040
397699112,4cyclictest0-21swapper/107:35:181
397699110,11cyclictest16511-21meminfo09:00:221
397599112,5cyclictest0-21swapper/011:35:190
397599111,10cyclictest29361-21kworker/0:008:54:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional