You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-17 - 02:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

Intel(R) Celeron(R) CPU G3900 @ 2.80GHz, Linux 5.4.59-rt36 (Profile)

Latency plot of shadow in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot5s.osadl.org (updated Fri Oct 15, 2021 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2218928683,1sleep10-21swapper/107:05:261
2166526965,2sleep00-21swapper/007:05:210
211892680,0sleep10-21swapper/111:09:361
89482370,1sleep18951-21fschecks_time09:15:171
15772350,0sleep11576-21ntpdc08:55:201
80332340,1sleep18032-21unixbench_singl09:10:351
2356299240,23cyclictest15186-21meminfo12:15:181
2356299230,22cyclictest8384-21meminfo07:50:221
2356299220,21cyclictest18180-21meminfo08:15:191
2356199220,21cyclictest31897-21meminfo11:35:240
2356199210,20cyclictest31248-21/usr/sbin/munin08:50:230
2356299192,6cyclictest581-21sendmail11:40:001
2356299191,12cyclictest22365-21apt-get12:35:151
2356299190,18cyclictest21124-21meminfo09:45:251
2356299190,18cyclictest17180-21meminfo09:35:171
2356199190,18cyclictest28798-21meminfo07:20:230
23562991817,0cyclictest0-21swapper/110:40:201
2356299181,6cyclictest26337-21apt-get10:00:131
2356299181,5cyclictest4740-21apt-get09:05:121
2356299181,5cyclictest15554-21apt-get08:10:161
2356299180,7cyclictest6664-21apt-get11:55:121
2356299180,15cyclictest19030-21/usr/sbin/munin12:25:171
2356299174,10cyclictest24380-21apt-get09:55:251
2356299172,7cyclictest0-21swapper/109:50:161
2356299172,10cyclictest27300-21apt-get11:25:141
2356299171,3cyclictest780-21apt-get11:40:311
2356299171,10cyclictest11595-21apt-get10:45:111
2356299170,16cyclictest24040-21meminfo11:15:201
2356299170,16cyclictest12315-21meminfo08:00:211
2356299170,10cyclictest0-21swapper/111:10:131
2356199170,16cyclictest27009-21meminfo10:00:180
2356199170,16cyclictest13270-21meminfo09:25:200
23562991610,4cyclictest26230-21pmu-power11:20:191
23562991610,0cyclictest0-21swapper/109:24:591
2356299160,15cyclictest9321-21meminfo12:00:231
2356299160,15cyclictest29968-21meminfo08:45:211
2356299160,15cyclictest17176-21meminfo12:20:251
2356299160,15cyclictest13233-21meminfo12:10:191
2356299160,15cyclictest10335-21meminfo07:55:191
2356299160,10cyclictest13085-21/usr/sbin/munin09:25:181
2356199169,5cyclictest0-21swapper/010:50:230
23561991614,1cyclictest27040-21sshd08:38:560
2356199160,15cyclictest32709-21meminfo07:30:210
2356199160,15cyclictest28973-21meminfo10:05:230
2356199160,15cyclictest24041-21meminfo11:15:200
2356299155,3cyclictest29909-21munin-run07:25:001
2356299154,5cyclictest4706-21apt-get11:50:101
2356299154,3cyclictest3625-21apt-get07:40:181
2356299152,9cyclictest32205-21apt-get10:15:111
2356299151,7cyclictest26142-21apt-get07:15:161
2356299151,11cyclictest7676-21apt-get10:35:191
2356299151,10cyclictest20406-21apt-get12:30:131
2356299150,15cyclictest15226-21meminfo09:30:181
2356299150,14cyclictest3472-21meminfo09:00:261
2356299150,14cyclictest31924-21meminfo08:50:211
2356299150,14cyclictest30757-21meminfo07:25:281
2356299150,14cyclictest22119-21meminfo08:25:211
2356199157,3cyclictest0-21swapper/009:35:250
2356199155,5cyclictest5707-21apt-get10:30:140
2356199155,5cyclictest5707-21apt-get10:30:130
2356199153,5cyclictest25340-21apt-get11:20:110
2356199152,3cyclictest27472-21cstates08:40:170
23561991515,0cyclictest0-21swapper/009:58:590
2356199150,14cyclictest7389-21meminfo09:10:290
2356199150,14cyclictest5413-21meminfo09:05:160
2356199150,14cyclictest4423-21meminfo10:25:180
2356299145,8cyclictest25361-21apt-get08:35:151
2356299144,4cyclictest0-21swapper/107:45:281
2356299143,6cyclictest32035-21apt-get07:30:151
2356299143,6cyclictest2754-21apt-get11:45:131
2356299143,6cyclictest12315-21taskset12:09:171
2356299140,5cyclictest0-21swapper/108:30:131
2356299140,14cyclictest28013-21meminfo08:40:201
2356199147,4cyclictest19175-21ls12:25:190
2356199146,5cyclictest6240-21ls07:45:200
2356199146,2cyclictest1945-21runrttasks07:56:170
2356199144,6cyclictest0-21swapper/012:20:200
2356199144,2cyclictest1945-21runrttasks08:59:320
2356199143,4cyclictest3142-21users10:20:290
2356199143,2cyclictest16362-21tr08:10:230
2356199142,5cyclictest0-21swapper/010:55:150
2356199141,6cyclictest0-21swapper/012:31:360
23561991412,1cyclictest20447-21apt-get09:45:170
23561991411,3cyclictest9-21ksoftirqd/008:45:250
2356199140,13cyclictest24073-21meminfo08:30:180
2356299135,6cyclictest28302-21apt-get10:05:171
2356299134,9cyclictest0-21swapper/111:00:201
2356299131,7cyclictest4475-21ls10:25:191
2356299131,6cyclictest13598-21apt-get08:05:151
2356299131,5cyclictest0-21swapper/110:30:171
2356299131,5cyclictest0-21swapper/110:30:161
2356299130,8cyclictest0-21swapper/110:50:161
2356299130,8cyclictest0-21swapper/108:20:141
2356299130,7cyclictest0-21swapper/110:20:281
2356199135,5cyclictest1945-21runrttasks07:37:150
2356199135,3cyclictest15908-21taskset09:30:240
2356199134,5cyclictest1945-21runrttasks07:29:040
2356199134,3cyclictest7857-21timerwakeupswit11:55:200
2356199133,9cyclictest9139-21/usr/sbin/munin09:15:180
2356199133,8cyclictest0-21swapper/010:15:100
2356199133,7cyclictest22365-21apt-get12:35:150
2356199133,7cyclictest19481-21/usr/sbin/munin09:40:310
2356199133,5cyclictest1945-21runrttasks08:15:150
2356199133,4cyclictest8647-21apt-get12:00:170
2356199133,4cyclictest5426-21/usr/sbin/munin07:45:000
2356199132,7cyclictest0-21swapper/011:10:140
2356199131,3cyclictest23591-21apt-get07:10:180
2356199131,1cyclictest0-21swapper/008:25:260
2356199130,11cyclictest0-21swapper/011:30:010
2356299125,6cyclictest18497-21apt-get09:40:221
2356299124,7cyclictest1618-21apt-get07:35:141
2356299122,8cyclictest31047-21munin-run11:35:001
2356299121,5cyclictest0-21swapper/107:10:181
2356299120,2cyclictest0-21swapper/110:10:221
2356299120,11cyclictest0-21swapper/110:55:031
2356199127,5cyclictest10038-21kworker/0:007:19:150
2356199125,6cyclictest453-21in:imuxsock08:07:340
2356199125,6cyclictest19484-21apt-get08:20:140
2356199125,1cyclictest12210-21latency10:45:140
2356199124,3cyclictest0-21swapper/007:50:270
2356199123,4cyclictest0-21swapper/012:15:230
2356199123,4cyclictest0-21swapper/011:25:140
2356199122,7cyclictest30260-21apt-get10:10:180
2356199122,4cyclictest0-21swapper/009:50:180
2356199122,3cyclictest0-21swapper/012:10:150
2356199121,5cyclictest0-21swapper/011:50:110
2356199121,3cyclictest3463-21ls09:00:260
2356199120,8cyclictest8264-21/usr/sbin/munin10:35:300
2356199117,2cyclictest19439-21/usr/sbin/munin11:05:160
2356199111,6cyclictest1126-21fw_packets11:40:340
23561991110,1cyclictest17943-21sort11:00:160
2356199110,7cyclictest9641-21apt-get10:40:120
2356199110,3cyclictest11964-21/usr/sbin/munin12:05:310
2356199106,2cyclictest11640-21apt-get08:00:150
2356199103,3cyclictest0-21swapper/011:45:140
2356199103,1cyclictest11225-21uname09:20:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional