You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-13 - 02:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron

x86 Intel Core i7 7828EQ @3000 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of shadow in rack #9, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot3s.osadl.org (updated Sat Aug 13, 2022 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
134291690,42ptp4l0-21swapper/019:05:170
134291670,40ptp4l0-21swapper/119:09:571
647125147,2sleep20-21swapper/219:09:042
633925046,2sleep30-21swapper/319:07:203
99672450,0sleep30-21swapper/320:15:213
134291300,0ptp4l0-21swapper/122:45:201
134291280,0ptp4l0-21swapper/123:30:271
680499190,0cyclictest2919-21apt-get20:05:020
134291190,0ptp4l0-21swapper/123:35:171
134291170,0ptp4l0-21swapper/123:15:151
134291170,0ptp4l0-21swapper/121:55:201
134291170,0ptp4l0-21swapper/119:25:201
134291170,0ptp4l0-21swapper/023:55:010
134291170,0ptp4l0-21swapper/022:55:190
134291170,0ptp4l0-21swapper/000:00:280
134291160,1ptp4l9975-21snmp_o5powerctl20:15:210
134291160,1ptp4l5653-21snmp_o5powerctl00:20:231
134291160,1ptp4l26280-21apt-get00:00:171
134291160,1ptp4l24612-21snmp_o5powerctl22:50:220
134291160,1ptp4l18515-21apt-get20:35:010
134291160,1ptp4l12067-21ls20:20:180
134291160,0ptp4l0-21swapper/100:30:231
134291160,0ptp4l0-21swapper/000:30:200
134291150,1ptp4l4238-21http21:10:001
134291150,1ptp4l32726-21apt-get22:05:172
134291150,1ptp4l24600-21sensors_temp22:50:201
134291150,1ptp4l23065-21snmp_o5powerctl20:40:230
134291150,1ptp4l22091-21snmp_o5powerctl22:45:230
134291150,1ptp4l2193-21snmp_o5powerctl20:00:271
134291150,1ptp4l16163-21apt-get23:40:130
134291150,1ptp4l11419-21irqstats22:25:171
134291150,0ptp4l0-21swapper/122:35:241
134291150,0ptp4l0-21swapper/122:05:181
134291150,0ptp4l0-21swapper/121:45:561
134291150,0ptp4l0-21swapper/120:30:181
134291150,0ptp4l0-21swapper/120:10:131
134291150,0ptp4l0-21swapper/119:50:131
134291150,0ptp4l0-21swapper/023:35:140
134291150,0ptp4l0-21swapper/021:45:190
134291150,0ptp4l0-21swapper/021:00:180
134291140,2ptp4l0-21swapper/222:15:542
134291140,1ptp4l32203-21snmp_o5powerctl23:05:251
134291140,1ptp4l28483-21diskstats23:00:191
134291140,1ptp4l25816-21df19:45:131
134291140,1ptp4l2191-21if_enp3s000:15:180
134291140,1ptp4l19617-21if_enp2s020:35:181
134291140,1ptp4l18676-21kernelversion19:30:221
134291140,1ptp4l16699-21snmp_o5powerctl19:25:220
134291140,1ptp4l15207-21fschecks_count21:30:180
134291140,1ptp4l13244-21cut21:25:171
134291140,0ptp4l4376-21snmp_o5powerctl22:10:231
134291140,0ptp4l13506-21apt-get20:25:131
134291140,0ptp4l0-21swapper/123:50:221
134291140,0ptp4l0-21swapper/123:25:181
134291140,0ptp4l0-21swapper/123:20:161
134291140,0ptp4l0-21swapper/123:10:151
134291140,0ptp4l0-21swapper/122:55:141
134291140,0ptp4l0-21swapper/122:30:161
134291140,0ptp4l0-21swapper/122:20:241
134291140,0ptp4l0-21swapper/121:50:261
134291140,0ptp4l0-21swapper/121:40:131
134291140,0ptp4l0-21swapper/121:10:151
134291140,0ptp4l0-21swapper/121:00:281
134291140,0ptp4l0-21swapper/120:55:241
134291140,0ptp4l0-21swapper/120:50:231
134291140,0ptp4l0-21swapper/120:45:231
134291140,0ptp4l0-21swapper/120:18:321
134291140,0ptp4l0-21swapper/120:09:241
134291140,0ptp4l0-21swapper/119:55:131
134291140,0ptp4l0-21swapper/119:35:201
134291140,0ptp4l0-21swapper/119:20:231
134291140,0ptp4l0-21swapper/119:15:011
134291140,0ptp4l0-21swapper/119:10:141
134291140,0ptp4l0-21swapper/100:35:241
134291140,0ptp4l0-21swapper/100:25:521
134291140,0ptp4l0-21swapper/100:15:151
134291140,0ptp4l0-21swapper/100:10:221
134291140,0ptp4l0-21swapper/100:05:291
134291140,0ptp4l0-21swapper/023:30:250
134291140,0ptp4l0-21swapper/023:20:150
134291140,0ptp4l0-21swapper/023:10:230
134291140,0ptp4l0-21swapper/022:40:140
134291140,0ptp4l0-21swapper/022:15:210
134291140,0ptp4l0-21swapper/022:10:250
134291140,0ptp4l0-21swapper/022:05:280
134291140,0ptp4l0-21swapper/022:00:260
134291140,0ptp4l0-21swapper/021:20:230
134291140,0ptp4l0-21swapper/021:05:150
134291140,0ptp4l0-21swapper/020:55:230
134291140,0ptp4l0-21swapper/020:30:010
134291140,0ptp4l0-21swapper/019:55:220
134291140,0ptp4l0-21swapper/019:50:240
134291140,0ptp4l0-21swapper/019:40:180
134291140,0ptp4l0-21swapper/019:35:020
134291140,0ptp4l0-21swapper/019:15:250
134291140,0ptp4l0-21swapper/000:35:190
134291140,0ptp4l0-21swapper/000:25:220
134291140,0ptp4l0-21swapper/000:20:170
134291140,0ptp4l0-21swapper/000:05:160
680499133,7cyclictest6952-21tr19:10:130
134291130,0ptp4l0-21swapper/223:35:222
134291130,0ptp4l0-21swapper/223:15:232
134291130,0ptp4l0-21swapper/223:05:212
134291130,0ptp4l0-21swapper/221:45:022
134291130,0ptp4l0-21swapper/221:35:132
134291130,0ptp4l0-21swapper/221:25:242
134291130,0ptp4l0-21swapper/200:20:152
134291130,0ptp4l0-21swapper/200:00:182
134291130,0ptp4l0-21swapper/123:55:161
134291130,0ptp4l0-21swapper/123:45:151
134291130,0ptp4l0-21swapper/123:40:151
134291130,0ptp4l0-21swapper/122:40:161
134291130,0ptp4l0-21swapper/122:15:151
134291130,0ptp4l0-21swapper/122:00:071
134291130,0ptp4l0-21swapper/121:35:181
134291130,0ptp4l0-21swapper/121:30:221
134291130,0ptp4l0-21swapper/121:20:211
134291130,0ptp4l0-21swapper/121:15:181
134291130,0ptp4l0-21swapper/120:40:161
134291130,0ptp4l0-21swapper/120:20:171
134291130,0ptp4l0-21swapper/119:40:151
134291130,0ptp4l0-21swapper/023:50:120
134291130,0ptp4l0-21swapper/023:45:230
134291130,0ptp4l0-21swapper/023:25:020
134291130,0ptp4l0-21swapper/023:15:130
134291130,0ptp4l0-21swapper/023:05:230
134291130,0ptp4l0-21swapper/023:00:180
134291130,0ptp4l0-21swapper/022:35:140
134291130,0ptp4l0-21swapper/022:30:180
134291130,0ptp4l0-21swapper/022:25:160
134291130,0ptp4l0-21swapper/022:20:170
134291130,0ptp4l0-21swapper/021:55:010
134291130,0ptp4l0-21swapper/021:50:230
134291130,0ptp4l0-21swapper/021:40:160
134291130,0ptp4l0-21swapper/021:35:170
134291130,0ptp4l0-21swapper/021:25:150
134291130,0ptp4l0-21swapper/021:15:150
134291130,0ptp4l0-21swapper/021:10:170
134291130,0ptp4l0-21swapper/020:50:130
134291130,0ptp4l0-21swapper/020:45:020
134291130,0ptp4l0-21swapper/020:25:150
134291130,0ptp4l0-21swapper/020:10:150
134291130,0ptp4l0-21swapper/020:00:010
134291130,0ptp4l0-21swapper/019:45:130
134291130,0ptp4l0-21swapper/019:30:210
134291130,0ptp4l0-21swapper/019:20:170
134291130,0ptp4l0-21swapper/000:10:210
680699127,5cyclictest0-21swapper/219:20:182
134291120,0ptp4l0-21swapper/219:26:202
6806991111,0cyclictest33-21ksoftirqd/222:30:242
680799106,1cyclictest5648-21/usr/sbin/munin00:20:243
134291100,1ptp4l4222-21diskmemload22:56:132
134291100,1ptp4l41-21ksoftirqd/321:19:523
134291100,0ptp4l0-21swapper/222:52:162
134291100,0ptp4l0-21swapper/219:35:242
68079997,1cyclictest99682sleep322:22:243
68079997,1cyclictest3794-21expr23:15:143
68079997,1cyclictest32643-21chrt23:06:323
68079997,1cyclictest3133-21ls22:10:163
68079997,1cyclictest30073-21taskset19:52:353
68079997,1cyclictest28620-21cat00:05:013
68079997,1cyclictest27676-21seq22:57:483
68079997,1cyclictest25103-21tr23:55:213
68079997,1cyclictest18099-21chrt23:40:473
68079997,1cyclictest17628-21tr20:30:263
68079997,1cyclictest172452sleep322:35:253
68079997,1cyclictest11481-21sort21:20:253
68079990,8cyclictest7815-21date22:20:023
68079990,8cyclictest6913-21sed23:20:193
68069997,1cyclictest25963-21grep19:45:132
68069997,1cyclictest23442-21taskset20:40:362
68069997,1cyclictest12389-21cut00:35:172
68069990,8cyclictest11750-21sed20:20:162
13429190,1ptp4l41-21ksoftirqd/300:06:363
13429190,0ptp4l4222-21diskmemload21:42:302
13429190,0ptp4l0-21swapper/223:55:242
13429190,0ptp4l0-21swapper/223:51:282
13429190,0ptp4l0-21swapper/223:45:362
13429190,0ptp4l0-21swapper/223:40:272
13429190,0ptp4l0-21swapper/223:30:152
13429190,0ptp4l0-21swapper/223:25:552
13429190,0ptp4l0-21swapper/223:21:562
13429190,0ptp4l0-21swapper/223:10:032
13429190,0ptp4l0-21swapper/223:02:162
13429190,0ptp4l0-21swapper/222:45:262
13429190,0ptp4l0-21swapper/222:41:132
13429190,0ptp4l0-21swapper/222:36:022
13429190,0ptp4l0-21swapper/222:25:062
13429190,0ptp4l0-21swapper/222:20:332
13429190,0ptp4l0-21swapper/222:10:132
13429190,0ptp4l0-21swapper/222:00:332
13429190,0ptp4l0-21swapper/221:55:502
13429190,0ptp4l0-21swapper/221:50:172
13429190,0ptp4l0-21swapper/221:33:152
13429190,0ptp4l0-21swapper/221:22:382
13429190,0ptp4l0-21swapper/221:15:102
13429190,0ptp4l0-21swapper/221:12:182
13429190,0ptp4l0-21swapper/221:08:182
13429190,0ptp4l0-21swapper/221:00:522
13429190,0ptp4l0-21swapper/220:57:152
13429190,0ptp4l0-21swapper/220:51:192
13429190,0ptp4l0-21swapper/220:48:112
13429190,0ptp4l0-21swapper/220:35:122
13429190,0ptp4l0-21swapper/220:32:092
13429190,0ptp4l0-21swapper/220:15:302
13429190,0ptp4l0-21swapper/220:10:572
13429190,0ptp4l0-21swapper/219:55:062
13429190,0ptp4l0-21swapper/219:50:562
13429190,0ptp4l0-21swapper/219:42:022
13429190,0ptp4l0-21swapper/219:33:142
13429190,0ptp4l0-21swapper/219:16:232
13429190,0ptp4l0-21swapper/219:10:512
13429190,0ptp4l0-21swapper/200:31:082
13429190,0ptp4l0-21swapper/200:25:462
13429190,0ptp4l0-21swapper/200:15:422
13429190,0ptp4l0-21swapper/200:11:042
13429190,0ptp4l0-21swapper/200:05:412
68079986,1cyclictest9746-21ls00:30:213
68079986,1cyclictest885-21expr20:00:183
68079986,1cyclictest8834-21expr23:25:133
68079986,1cyclictest8077-21cut00:25:183
68079986,1cyclictest7090-21grep20:10:193
68079986,1cyclictest6976-21tr19:10:133
68079986,1cyclictest66632sleep321:11:173
68079986,1cyclictest4930-21snmp_o5powerctl20:05:263
68079986,1cyclictest3881-21chrt21:05:463
68079986,1cyclictest32681-21taskset22:05:063
68079986,1cyclictest32632-21tr21:00:223
68079986,1cyclictest32197-21cat00:10:203
68079986,1cyclictest30908-21chrt19:55:163
68079986,1cyclictest30530-21ntp_kernel_pll_20:55:183
68079986,1cyclictest3049-21taskset23:12:353
68079986,1cyclictest30282-21tr22:00:183
68079986,1cyclictest30181-21chrt23:02:203
68079986,1cyclictest2930-21awk00:15:223
68079986,1cyclictest27196-21taskset21:52:253
68079986,1cyclictest26830-21cut19:45:203
68079986,1cyclictest26545-21bc20:50:123
68079986,1cyclictest252942sleep322:54:353
68079986,1cyclictest24521-21head20:45:163
68079986,1cyclictest22939-21basename19:40:123
68079986,1cyclictest22911-21expr21:45:123
68079986,1cyclictest22731-21chrt22:49:033
68079986,1cyclictest22560-21taskset19:38:293
68079986,1cyclictest21913-21chrt20:40:163
68079986,1cyclictest21822-21taskset21:40:543
68079986,1cyclictest19716-21grep23:45:183
68079986,1cyclictest19614-21switchtime22:40:243
68079986,1cyclictest19068-21grep20:35:143
68079986,1cyclictest17669-21basename19:30:173
68079986,1cyclictest17335-21dpkg21:35:143
68079986,1cyclictest15678-21sed21:30:203
68079986,1cyclictest15308-21cut22:35:023
68079986,1cyclictest14041-21tail20:25:163
68079986,1cyclictest13820-21cut19:20:213
68079986,1cyclictest12561-21cat21:25:133
68079986,1cyclictest123562sleep322:25:373
68079986,1cyclictest11590-21head23:30:183
68079986,1cyclictest11401-21fschecks_time20:20:153
68079986,1cyclictest10666-21cat19:15:213
68069986,1cyclictest3350-21chrt20:05:112
68069986,1cyclictest13968-21grep20:25:152
13429180,0ptp4l0-21swapper/220:02:052
68079975,1cyclictest28567-21tr21:55:213
68079975,1cyclictest21806-21basename23:50:153
68079975,1cyclictest16862-21grep19:25:243
68079975,1cyclictest14402-21cut23:35:183
68079965,1cyclictest12730-21sed00:35:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional