You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-09 - 10:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron

x86 Intel Core i7 7828EQ @3000 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of shadow in rack #9, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot3s.osadl.org (updated Tue Apr 18, 2023 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
544026556,7sleep20-21swapper/207:06:012
113391650,58ptp4l0-21swapper/007:08:300
113391630,31ptp4l0-21swapper/107:06:321
560525147,2sleep30-21swapper/307:08:103
160692440,0sleep316072-21grep10:35:353
113391230,0ptp4l0-21swapper/110:55:191
113391200,0ptp4l0-21swapper/010:25:300
113391190,0ptp4l0-21swapper/011:35:230
113391170,1ptp4l31951-21apt-get11:10:171
113391170,0ptp4l0-21swapper/112:05:031
113391170,0ptp4l0-21swapper/110:40:211
113391170,0ptp4l0-21swapper/109:40:201
113391170,0ptp4l0-21swapper/012:15:220
113391160,1ptp4l22290-21apt-get11:55:231
113391160,1ptp4l20389-21apt-get09:40:570
113391160,1ptp4l17272-21apt-get08:35:011
113391160,1ptp4l1405-21apt-get10:10:150
113391160,0ptp4l0-21swapper/109:20:201
113391160,0ptp4l0-21swapper/012:20:200
113391160,0ptp4l0-21swapper/008:35:190
113391150,2ptp4l0-21swapper/208:30:172
113391150,1ptp4l9638-21df_inode07:15:201
113391150,1ptp4l8972-21snmp_o5powerctl08:15:280
113391150,1ptp4l8402-21ntp_states11:25:280
113391150,1ptp4l7911-21netstat10:20:251
113391150,1ptp4l6167-21snmp_o5powerctl11:20:271
113391150,1ptp4l4083-21snmp_o5powerctl12:20:311
113391150,1ptp4l31049-21snmp_o5powerctl07:55:291
113391150,1ptp4l21824-21snmp_o5powerctl08:40:270
113391150,1ptp4l21818-21/usr/sbin/munin10:50:190
113391150,1ptp4l20111-21diskstats11:50:190
113391150,1ptp4l13379-21snmp_o5powerctl07:20:270
113391150,1ptp4l11567-21ntp_states12:35:220
113391150,1ptp4l10323-21memory10:25:291
113391150,0ptp4l0-21swapper/112:10:181
113391150,0ptp4l0-21swapper/112:00:361
113391150,0ptp4l0-21swapper/110:30:161
113391150,0ptp4l0-21swapper/109:45:181
113391150,0ptp4l0-21swapper/011:20:220
113391150,0ptp4l0-21swapper/011:15:280
113391150,0ptp4l0-21swapper/010:40:320
113391150,0ptp4l0-21swapper/009:05:270
113391150,0ptp4l0-21swapper/009:00:180
113391150,0ptp4l0-21swapper/007:30:140
113391140,1ptp4l8684-21python11:25:301
113391140,1ptp4l5693-21/usr/sbin/munin08:10:201
113391140,1ptp4l32389-21/usr/sbin/munin10:05:261
113391140,1ptp4l29185-21fschecks_count10:00:201
113391140,1ptp4l25622-21grep10:55:270
113391140,1ptp4l25445-21uname07:45:240
113391140,1ptp4l24674-21expr07:45:181
113391140,1ptp4l24133-21/usr/sbin/munin08:45:271
113391140,1ptp4l20880-21swap10:45:291
113391140,1ptp4l20872-21snmp_o5powerctl10:45:290
113391140,1ptp4l17988-21/usr/sbin/munin11:45:230
113391140,1ptp4l17241-21apt-get11:45:191
113391140,1ptp4l14824-21fw_packets07:25:221
113391140,1ptp4l14470-21cstates10:35:211
113391140,0ptp4l7956-21ntpq10:20:260
113391140,0ptp4l0-21swapper/207:40:282
113391140,0ptp4l0-21swapper/112:25:321
113391140,0ptp4l0-21swapper/111:50:271
113391140,0ptp4l0-21swapper/111:40:181
113391140,0ptp4l0-21swapper/111:30:231
113391140,0ptp4l0-21swapper/111:15:181
113391140,0ptp4l0-21swapper/111:00:211
113391140,0ptp4l0-21swapper/110:50:241
113391140,0ptp4l0-21swapper/110:10:281
113391140,0ptp4l0-21swapper/109:55:341
113391140,0ptp4l0-21swapper/109:30:311
113391140,0ptp4l0-21swapper/109:15:281
113391140,0ptp4l0-21swapper/109:10:311
113391140,0ptp4l0-21swapper/109:05:281
113391140,0ptp4l0-21swapper/109:00:211
113391140,0ptp4l0-21swapper/108:20:321
113391140,0ptp4l0-21swapper/108:15:291
113391140,0ptp4l0-21swapper/108:00:261
113391140,0ptp4l0-21swapper/107:10:281
113391140,0ptp4l0-21swapper/012:30:200
113391140,0ptp4l0-21swapper/011:40:180
113391140,0ptp4l0-21swapper/011:05:210
113391140,0ptp4l0-21swapper/011:00:180
113391140,0ptp4l0-21swapper/010:35:260
113391140,0ptp4l0-21swapper/010:00:250
113391140,0ptp4l0-21swapper/009:50:240
113391140,0ptp4l0-21swapper/009:30:220
113391140,0ptp4l0-21swapper/009:25:340
113391140,0ptp4l0-21swapper/009:20:390
113391140,0ptp4l0-21swapper/009:15:350
113391140,0ptp4l0-21swapper/008:05:340
113391140,0ptp4l0-21swapper/008:00:160
113391140,0ptp4l0-21swapper/007:40:270
113391140,0ptp4l0-21swapper/007:35:150
113391140,0ptp4l0-21swapper/007:15:010
113391140,0ptp4l0-21swapper/007:10:150
113391130,1ptp4l25662-21df08:50:180
113391130,1ptp4l24263-21grep09:50:242
113391130,0ptp4l0-21swapper/210:15:192
113391130,0ptp4l0-21swapper/210:00:352
113391130,0ptp4l0-21swapper/209:25:352
113391130,0ptp4l0-21swapper/209:10:312
113391130,0ptp4l0-21swapper/207:50:332
113391130,0ptp4l0-21swapper/207:20:282
113391130,0ptp4l0-21swapper/112:35:221
113391130,0ptp4l0-21swapper/112:30:191
113391130,0ptp4l0-21swapper/112:15:191
113391130,0ptp4l0-21swapper/111:35:241
113391130,0ptp4l0-21swapper/111:05:181
113391130,0ptp4l0-21swapper/110:15:241
113391130,0ptp4l0-21swapper/109:50:211
113391130,0ptp4l0-21swapper/109:35:191
113391130,0ptp4l0-21swapper/109:25:291
113391130,0ptp4l0-21swapper/108:55:241
113391130,0ptp4l0-21swapper/108:50:171
113391130,0ptp4l0-21swapper/108:40:171
113391130,0ptp4l0-21swapper/108:30:221
113391130,0ptp4l0-21swapper/108:25:201
113391130,0ptp4l0-21swapper/108:05:001
113391130,0ptp4l0-21swapper/107:50:201
113391130,0ptp4l0-21swapper/107:40:191
113391130,0ptp4l0-21swapper/107:35:291
113391130,0ptp4l0-21swapper/107:30:191
113391130,0ptp4l0-21swapper/107:20:181
113391130,0ptp4l0-21swapper/012:25:010
113391130,0ptp4l0-21swapper/012:10:190
113391130,0ptp4l0-21swapper/012:05:170
113391130,0ptp4l0-21swapper/012:00:240
113391130,0ptp4l0-21swapper/011:55:240
113391130,0ptp4l0-21swapper/011:30:190
113391130,0ptp4l0-21swapper/011:10:170
113391130,0ptp4l0-21swapper/010:30:170
113391130,0ptp4l0-21swapper/010:15:250
113391130,0ptp4l0-21swapper/010:05:240
113391130,0ptp4l0-21swapper/009:55:330
113391130,0ptp4l0-21swapper/009:45:170
113391130,0ptp4l0-21swapper/009:35:200
113391130,0ptp4l0-21swapper/009:10:170
113391130,0ptp4l0-21swapper/008:55:320
113391130,0ptp4l0-21swapper/008:45:190
113391130,0ptp4l0-21swapper/008:30:150
113391130,0ptp4l0-21swapper/008:25:270
113391130,0ptp4l0-21swapper/008:20:220
113391130,0ptp4l0-21swapper/008:10:150
113391130,0ptp4l0-21swapper/007:55:190
113391130,0ptp4l0-21swapper/007:50:190
113391130,0ptp4l0-21swapper/007:25:220
305602120,0sleep20-21swapper/211:05:222
113391120,0ptp4l0-21swapper/212:14:282
113391120,0ptp4l0-21swapper/209:35:332
113391110,0ptp4l0-21swapper/212:24:562
600999108,1cyclictest18722-21irqstats08:35:212
600999102,4cyclictest0-21swapper/211:30:172
113391100,1ptp4l33-21ksoftirqd/208:06:022
113391100,0ptp4l0-21swapper/211:35:342
113391100,0ptp4l0-21swapper/210:05:292
60109997,1cyclictest4401-21head12:20:313
60109997,1cyclictest32547-21chrt09:03:513
60109997,1cyclictest19390-21sed08:35:303
60109997,1cyclictest188262sleep310:42:013
60109997,1cyclictest1653-21expr10:10:153
60109997,1cyclictest12287-21tail10:30:183
60109996,2cyclictest24888-21head10:55:213
60109996,2cyclictest12386-21snmp_o5powerctl09:25:333
60109990,8cyclictest11288-21chrt07:16:423
60099997,1cyclictest6292-21cat09:15:212
60099997,1cyclictest6065-21tr08:10:252
60099997,1cyclictest32000-21egrep11:10:162
60099997,1cyclictest31562-21grep09:00:272
60099997,1cyclictest26230-21head10:55:342
60099997,1cyclictest25509-21expr08:50:172
60099997,1cyclictest22699-21cut10:50:232
60099997,1cyclictest12076-21taskset08:23:092
11339190,1ptp4l0-21swapper/210:40:502
11339190,0ptp4l0-21swapper/212:37:032
11339190,0ptp4l0-21swapper/212:30:122
11339190,0ptp4l0-21swapper/212:26:222
11339190,0ptp4l0-21swapper/212:16:452
11339190,0ptp4l0-21swapper/212:06:232
11339190,0ptp4l0-21swapper/212:01:432
11339190,0ptp4l0-21swapper/211:50:142
11339190,0ptp4l0-21swapper/211:47:362
11339190,0ptp4l0-21swapper/211:40:372
11339190,0ptp4l0-21swapper/211:25:172
11339190,0ptp4l0-21swapper/211:20:582
11339190,0ptp4l0-21swapper/211:15:102
11339190,0ptp4l0-21swapper/211:00:392
11339190,0ptp4l0-21swapper/210:45:202
11339190,0ptp4l0-21swapper/210:35:132
11339190,0ptp4l0-21swapper/210:31:362
11339190,0ptp4l0-21swapper/210:26:452
11339190,0ptp4l0-21swapper/210:24:152
11339190,0ptp4l0-21swapper/210:11:002
11339190,0ptp4l0-21swapper/209:56:062
11339190,0ptp4l0-21swapper/209:47:572
11339190,0ptp4l0-21swapper/209:42:432
11339190,0ptp4l0-21swapper/209:32:552
11339190,0ptp4l0-21swapper/209:06:052
11339190,0ptp4l0-21swapper/208:55:012
11339190,0ptp4l0-21swapper/208:45:402
11339190,0ptp4l0-21swapper/208:41:122
11339190,0ptp4l0-21swapper/208:25:042
11339190,0ptp4l0-21swapper/208:15:132
11339190,0ptp4l0-21swapper/208:01:352
11339190,0ptp4l0-21swapper/207:56:252
11339190,0ptp4l0-21swapper/207:46:232
11339190,0ptp4l0-21swapper/207:35:162
11339190,0ptp4l0-21swapper/207:31:112
11339190,0ptp4l0-21swapper/207:26:552
11339190,0ptp4l0-21swapper/207:15:172
11339190,0ptp4l0-21swapper/207:13:032
60109986,1cyclictest93892sleep311:29:563
60109986,1cyclictest8556-21expr09:20:173
60109986,1cyclictest8297-21tr08:15:223
60109986,1cyclictest8272-21grep12:30:223
60109986,1cyclictest7377-21ethtool10:20:223
60109986,1cyclictest6359-21cat07:10:153
60109986,1cyclictest6204-21cut12:25:293
60109986,1cyclictest6149-21cut11:20:253
60109986,1cyclictest5324-21head10:15:293
60109986,1cyclictest4868-21expr08:10:163
60109986,1cyclictest32668-21expr12:15:193
60109986,1cyclictest32590-21sed08:00:183
60109986,1cyclictest32472-21tr10:05:273
60109986,1cyclictest30842-21cut12:10:233
60109986,1cyclictest2996-21cat09:10:163
60109986,1cyclictest29848-21cut11:05:173
60109986,1cyclictest28971-21expr10:00:183
60109986,1cyclictest27999-21cstates08:55:243
60109986,1cyclictest27349-21apt-get12:05:163
60109986,1cyclictest27255-21expr07:50:193
60109986,1cyclictest27046-21cut11:00:173
60109986,1cyclictest2684-21if_enp2s011:15:203
60109986,1cyclictest26380-21snmp_o5powerctl12:00:343
60109986,1cyclictest26196-21taskset09:55:093
60109986,1cyclictest25677-21entropy08:50:183
60109986,1cyclictest25672-21netstat07:45:263
60109986,1cyclictest24731-21taskset08:45:493
60109986,1cyclictest24595-21cut09:50:303
60109986,1cyclictest2291-21tr08:05:163
60109986,1cyclictest22654-21if_err_enp3s007:40:233
60109986,1cyclictest22378-21expr11:55:233
60109986,1cyclictest21984-21tr10:50:193
60109986,1cyclictest21187-21basename09:45:163
60109986,1cyclictest202392sleep308:40:093
60109986,1cyclictest19940-21cat11:50:183
60109986,1cyclictest19665-21ntp_states09:40:243
60109986,1cyclictest19508-21tr07:35:183
60109986,1cyclictest19462-21tr10:45:193
60109986,1cyclictest1907-21processes09:05:243
60109986,1cyclictest17329-21cut07:30:173
60109986,1cyclictest17296-21wc11:45:183
60109986,1cyclictest16282sleep311:12:503
60109986,1cyclictest15880-21wc09:35:193
60109986,1cyclictest15403-21latency07:25:253
60109986,1cyclictest15262-21grep11:40:233
60109986,1cyclictest145912sleep308:28:043
60109986,1cyclictest14246-21tr09:30:243
60109986,1cyclictest12229-21grep11:35:203
60109986,1cyclictest11956-21grep07:20:173
60109986,1cyclictest11079-21tr12:35:193
60109986,1cyclictest10496-21expr08:20:233
60109986,1cyclictest10466-21ntp_kernel_pll_10:25:313
60109982,3cyclictest0-21swapper/309:15:183
60099986,1cyclictest10024-21cat09:20:312
11339180,0ptp4l0-21swapper/211:58:172
60109975,1cyclictest29733-21expr07:55:193
60109975,1cyclictest15225-21expr08:30:163
60109975,1cyclictest10293-21cat11:30:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional