You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-06-16 - 21:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

Intel(R) Celeron(R) CPU G3900 @ 2.80GHz, Linux 5.4.59-rt36 (Profile)

Latency plot of shadow in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackcslot5s.osadl.org (updated Thu Jun 10, 2021 12:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1620727860,2sleep00-21swapper/007:05:170
1723327360,9sleep10-21swapper/107:07:461
1762899332,30cyclictest20888-21meminfo07:15:281
1762899230,22cyclictest31841-21meminfo11:50:231
1762899230,22cyclictest28785-21meminfo07:35:291
1762899221,10cyclictest10567-21apt-get12:20:241
1762899220,21cyclictest30754-21meminfo07:40:221
1762899201,9cyclictest684-21apt-get11:55:151
1762899200,19cyclictest7286-21meminfo12:10:171
1762899200,19cyclictest10284-21meminfo08:10:211
1762899200,0cyclictest0-21swapper/108:37:091
1762799200,19cyclictest9287-21meminfo09:30:210
1762899196,12cyclictest0-21swapper/109:37:451
1762899191,8cyclictest23353-21apt-get08:45:151
1762899191,10cyclictest1721-21apt-get10:35:211
1762899190,9cyclictest0-21swapper/111:40:131
1762899190,8cyclictest24899-21netstat07:25:221
1762899190,18cyclictest25947-21meminfo11:35:211
1762799191,9cyclictest2717-21apt-get09:15:140
1762799190,18cyclictest11244-21meminfo12:20:310
1762899181,8cyclictest26095-21apt-get07:30:111
1762899180,17cyclictest23039-21meminfo10:05:291
1762799180,17cyclictest9242-21meminfo12:15:170
1762799180,17cyclictest3377-21meminfo12:00:180
1762899179,8cyclictest0-21swapper/109:14:211
1762899173,8cyclictest31197-21apt-get09:05:151
1762899170,5cyclictest6449-21munin-run12:10:001
1762899170,17cyclictest18091-21meminfo11:15:181
1762799176,7cyclictest497-21avahi-daemon08:18:050
1762799171,10cyclictest5655-21apt-get10:45:140
1762799170,16cyclictest24025-21meminfo08:45:190
1762799170,16cyclictest15135-21meminfo12:30:160
1762799170,16cyclictest11247-21meminfo09:35:220
165152170,0sleep00-21swapper/009:50:190
1762899164,7cyclictest28053-21cron10:20:001
1762899162,6cyclictest0-21swapper/108:15:261
1762899162,5cyclictest1565-21apt-get07:50:171
1762899160,16cyclictest13217-21meminfo09:40:201
1762899160,15cyclictest8332-21meminfo08:05:231
1762899160,15cyclictest22037-21meminfo11:25:241
1762799165,8cyclictest32033-21apt-get07:45:140
1762799164,5cyclictest1945-21runrttasks10:09:510
1762799163,6cyclictest0-21swapper/010:20:260
1762799162,10cyclictest30203-21apt-get10:25:150
1762799161,8cyclictest17457-21/usr/sbin/munin08:30:160
1762799160,15cyclictest31874-21meminfo09:05:220
1762799160,11cyclictest9443-21munin-run08:10:000
1762899157,4cyclictest27934-21ls08:55:241
1762899155,3cyclictest21051-21ls10:00:151
1762899154,8cyclictest0-21swapper/111:45:141
1762899153,8cyclictest16430-21apt-get12:35:201
1762899153,5cyclictest0-21swapper/107:20:151
1762899152,9cyclictest0-21swapper/112:00:151
1762899152,6cyclictest0-21swapper/111:05:181
1762899151,8cyclictest3720-21apt-get07:55:131
17628991513,1cyclictest5616-21/usr/sbin/munin09:20:311
1762899150,4cyclictest0-21swapper/110:30:141
1762899150,4cyclictest0-21swapper/108:30:161
1762899150,14cyclictest24981-21meminfo10:10:181
1762899150,14cyclictest19085-21meminfo09:55:161
1762899150,0cyclictest0-21swapper/108:54:161
1762799155,3cyclictest1945-21runrttasks07:39:450
1762799153,5cyclictest23992-21/usr/sbin/munin11:30:210
1762799153,3cyclictest0-21swapper/007:30:120
1762799153,10cyclictest13506-21apt-get11:05:180
1762799152,9cyclictest3720-21apt-get07:55:130
1762799152,8cyclictest16292-21munin-run09:50:000
1762799150,8cyclictest25270-21apt-get11:35:140
1762799150,14cyclictest368-21meminfo10:30:190
1762799150,14cyclictest26939-21meminfo10:15:200
1762799150,14cyclictest13181-21meminfo12:25:180
1762899146,5cyclictest15503-21/usr/sbin/munin09:45:301
1762899144,5cyclictest19404-21apt-get11:20:171
1762899144,5cyclictest15723-21/usr/sbin/munin08:25:161
1762899141,7cyclictest0-21swapper/110:45:151
1762899141,6cyclictest23316-21apt-get11:30:151
1762899141,4cyclictest22179-21/usr/sbin/munin08:40:221
17628991413,0cyclictest14462-21apt-get12:30:111
17628991412,1cyclictest7612-21apt-get10:50:141
17628991412,1cyclictest28264-21apt-get10:20:261
1762899141,10cyclictest31637-21taskset10:26:161
1762899140,6cyclictest0-21swapper/110:40:251
1762799144,9cyclictest3702-21apt-get10:40:150
1762799142,4cyclictest11546-21apt-get11:00:160
1762799142,4cyclictest10680-21ls10:55:250
1762799142,2cyclictest0-21swapper/008:10:170
1762799140,7cyclictest0-21swapper/012:35:190
1762799140,13cyclictest8292-21meminfo10:50:230
1762799140,12cyclictest0-21swapper/009:41:000
1762899133,5cyclictest0-21swapper/110:55:131
1762899132,7cyclictest29299-21/usr/sbin/munin09:00:141
1762899132,2cyclictest0-21swapper/111:10:151
1762899132,10cyclictest12504-21/usr/sbin/munin12:25:211
17628991311,1cyclictest6653-21apt-get09:25:141
1762899130,6cyclictest0-21swapper/107:10:121
1762899130,4cyclictest0-21swapper/108:00:121
1762899130,3cyclictest4058-21users09:15:221
1762799138,1cyclictest27243-21/usr/sbin/munin11:40:160
1762799137,5cyclictest17412-21apt-get11:15:130
1762799136,4cyclictest31031-21munin-run09:05:000
1762799135,4cyclictest3366-21sshd10:38:300
1762799135,1cyclictest1945-21runrttasks07:28:080
1762799135,1cyclictest0-21swapper/007:50:290
1762799134,5cyclictest1945-21runrttasks10:10:430
1762799134,4cyclictest20388-21apt-get10:00:110
1762799132,6cyclictest0-21swapper/011:50:200
1762799132,4cyclictest21210-21munin-run08:40:010
1762799132,4cyclictest15498-21apt-get08:25:150
17627991312,1cyclictest21007-21awk07:15:290
1762799130,7cyclictest0-21swapper/008:20:180
1762899125,5cyclictest8571-21apt-get12:15:111
1762899122,6cyclictest1945-21runrttasks08:20:001
1762899120,8cyclictest13286-21chrt11:04:351
1762899120,11cyclictest32708-21meminfo07:45:221
1762799126,4cyclictest8564-21wc09:30:000
1762799125,5cyclictest5693-21apt-get08:00:120
1762799123,4cyclictest30080-21apt-get07:40:160
1762799122,5cyclictest0-21swapper/011:20:200
1762799121,7cyclictest969-21grep09:10:160
1762799121,7cyclictest29203-21apt-get11:45:130
1762799120,4cyclictest15455-21apt-get11:10:130
23762110,0sleep00-21swapper/011:58:340
1762899113,3cyclictest8613-21apt-get09:30:161
1762899113,3cyclictest16460-21apt-get09:50:181
1762799116,1cyclictest17647-21apt-get07:10:120
1762799114,4cyclictest28086-21ntp_offset08:55:260
1762799113,2cyclictest0-21swapper/009:55:120
1762799112,6cyclictest6614-21apt-get12:10:120
1762799112,5cyclictest0-21swapper/008:50:170
1762799112,2cyclictest0-21swapper/011:25:210
1762799111,6cyclictest0-21swapper/008:40:140
1762799111,3cyclictest0-21swapper/012:05:150
1762799110,1cyclictest22184-21apt-get07:20:150
1762799104,5cyclictest0-21swapper/009:20:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional