You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-29 - 20:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron

x86 Intel Core i7 7828EQ @3000 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of shadow in rack #9, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack9slot3s.osadl.org (updated Sun Jan 29, 2023 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
134291700,49ptp4l0-21swapper/007:07:000
134291600,37ptp4l0-21swapper/107:05:121
1716025551,2sleep20-21swapper/207:05:292
1725325349,2sleep30-21swapper/307:06:423
25922450,0sleep02597-21unixbench_singl09:45:280
134291280,0ptp4l0-21swapper/010:05:270
134291210,1ptp4l4401-21df07:45:141
134291210,0ptp4l0-21swapper/111:50:011
134291190,0ptp4l0-21swapper/111:45:271
134291190,0ptp4l0-21swapper/008:35:250
134291180,0ptp4l0-21swapper/110:25:221
134291180,0ptp4l0-21swapper/109:10:181
134291180,0ptp4l0-21swapper/108:31:061
134291180,0ptp4l0-21swapper/008:45:280
134291170,0ptp4l0-21swapper/110:20:171
134291160,1ptp4l23816-21apt-get07:20:140
134291160,1ptp4l16378-21apt-get08:08:481
134291160,1ptp4l15918-21apt-get10:15:181
134291150,1ptp4l30274-21/usr/sbin/munin07:30:270
134291150,1ptp4l23150-21ls11:30:280
134291150,1ptp4l18983-21ls07:10:221
134291150,1ptp4l18464-21ntpq12:25:280
134291150,1ptp4l13989-21snmp_o5powerctl09:05:270
134291150,0ptp4l0-21swapper/112:15:161
134291150,0ptp4l0-21swapper/109:00:181
134291150,0ptp4l0-21swapper/108:55:201
134291150,0ptp4l0-21swapper/108:20:151
134291150,0ptp4l0-21swapper/108:00:001
134291150,0ptp4l0-21swapper/009:30:190
134291150,0ptp4l0-21swapper/008:15:160
134291150,0ptp4l0-21swapper/008:10:160
134291150,0ptp4l0-21swapper/007:15:140
1776899148,2cyclictest9-21ksoftirqd/012:05:230
134291140,1ptp4l8071-21perf10:00:010
134291140,1ptp4l7786-21netstat07:50:211
134291140,1ptp4l30699-21cat11:45:280
134291140,1ptp4l30427-21sed08:35:201
134291140,1ptp4l29413-21cut07:30:201
134291140,1ptp4l28822-21cstates10:40:190
134291140,1ptp4l27292-21cstates08:30:210
134291140,1ptp4l26421-21memory09:30:241
134291140,1ptp4l2530-21hddtemp_smartct11:55:231
134291140,1ptp4l24610-21hddtemp_smartct11:35:220
134291140,1ptp4l23792-21irqstats09:25:301
134291140,1ptp4l22403-21df08:20:160
134291140,1ptp4l20778-21ntp_states08:15:231
134291140,1ptp4l17360-21cstates12:25:231
134291140,1ptp4l14959-21cat09:10:160
134291140,1ptp4l13359-21/usr/sbin/munin10:10:251
134291140,1ptp4l11025-21sed09:00:230
134291140,0ptp4l13742-21ls12:15:280
134291140,0ptp4l0-21swapper/207:30:272
134291140,0ptp4l0-21swapper/112:30:231
134291140,0ptp4l0-21swapper/112:10:171
134291140,0ptp4l0-21swapper/112:05:181
134291140,0ptp4l0-21swapper/112:00:221
134291140,0ptp4l0-21swapper/111:24:441
134291140,0ptp4l0-21swapper/111:15:281
134291140,0ptp4l0-21swapper/110:50:261
134291140,0ptp4l0-21swapper/110:40:181
134291140,0ptp4l0-21swapper/110:35:191
134291140,0ptp4l0-21swapper/110:05:181
134291140,0ptp4l0-21swapper/109:40:221
134291140,0ptp4l0-21swapper/109:35:021
134291140,0ptp4l0-21swapper/109:20:201
134291140,0ptp4l0-21swapper/108:54:561
134291140,0ptp4l0-21swapper/108:40:251
134291140,0ptp4l0-21swapper/108:25:271
134291140,0ptp4l0-21swapper/108:10:251
134291140,0ptp4l0-21swapper/108:00:291
134291140,0ptp4l0-21swapper/012:30:290
134291140,0ptp4l0-21swapper/012:20:250
134291140,0ptp4l0-21swapper/011:40:280
134291140,0ptp4l0-21swapper/011:25:360
134291140,0ptp4l0-21swapper/011:15:180
134291140,0ptp4l0-21swapper/011:10:220
134291140,0ptp4l0-21swapper/011:05:240
134291140,0ptp4l0-21swapper/010:55:320
134291140,0ptp4l0-21swapper/010:50:170
134291140,0ptp4l0-21swapper/010:25:330
134291140,0ptp4l0-21swapper/010:10:180
134291140,0ptp4l0-21swapper/009:25:310
134291140,0ptp4l0-21swapper/008:55:270
134291140,0ptp4l0-21swapper/008:40:160
134291140,0ptp4l0-21swapper/008:05:230
1777099132,2cyclictest134291ptp4l08:45:242
134291130,2ptp4l31797-21fschecks_count07:35:200
134291130,0ptp4l16611-21/usr/sbin/munin11:20:200
134291130,0ptp4l0-21swapper/211:15:202
134291130,0ptp4l0-21swapper/210:20:262
134291130,0ptp4l0-21swapper/210:05:202
134291130,0ptp4l0-21swapper/208:15:212
134291130,0ptp4l0-21swapper/207:35:232
134291130,0ptp4l0-21swapper/112:35:201
134291130,0ptp4l0-21swapper/112:20:181
134291130,0ptp4l0-21swapper/111:40:191
134291130,0ptp4l0-21swapper/111:35:211
134291130,0ptp4l0-21swapper/111:30:241
134291130,0ptp4l0-21swapper/111:25:281
134291130,0ptp4l0-21swapper/111:10:201
134291130,0ptp4l0-21swapper/111:05:181
134291130,0ptp4l0-21swapper/111:00:251
134291130,0ptp4l0-21swapper/110:55:241
134291130,0ptp4l0-21swapper/110:45:181
134291130,0ptp4l0-21swapper/110:30:261
134291130,0ptp4l0-21swapper/110:00:161
134291130,0ptp4l0-21swapper/109:55:211
134291130,0ptp4l0-21swapper/109:50:181
134291130,0ptp4l0-21swapper/109:45:021
134291130,0ptp4l0-21swapper/109:15:181
134291130,0ptp4l0-21swapper/109:05:181
134291130,0ptp4l0-21swapper/108:45:261
134291130,0ptp4l0-21swapper/107:40:181
134291130,0ptp4l0-21swapper/107:35:201
134291130,0ptp4l0-21swapper/107:25:241
134291130,0ptp4l0-21swapper/107:20:151
134291130,0ptp4l0-21swapper/107:15:161
134291130,0ptp4l0-21swapper/012:35:180
134291130,0ptp4l0-21swapper/012:10:160
134291130,0ptp4l0-21swapper/012:00:200
134291130,0ptp4l0-21swapper/011:55:220
134291130,0ptp4l0-21swapper/011:50:180
134291130,0ptp4l0-21swapper/011:00:220
134291130,0ptp4l0-21swapper/010:45:180
134291130,0ptp4l0-21swapper/010:35:180
134291130,0ptp4l0-21swapper/010:30:210
134291130,0ptp4l0-21swapper/010:20:190
134291130,0ptp4l0-21swapper/010:15:190
134291130,0ptp4l0-21swapper/010:00:180
134291130,0ptp4l0-21swapper/009:50:170
134291130,0ptp4l0-21swapper/009:40:200
134291130,0ptp4l0-21swapper/009:35:090
134291130,0ptp4l0-21swapper/009:20:190
134291130,0ptp4l0-21swapper/009:15:250
134291130,0ptp4l0-21swapper/008:50:250
134291130,0ptp4l0-21swapper/008:25:220
134291130,0ptp4l0-21swapper/008:00:200
134291130,0ptp4l0-21swapper/007:55:200
134291130,0ptp4l0-21swapper/007:50:180
134291130,0ptp4l0-21swapper/007:45:150
134291130,0ptp4l0-21swapper/007:40:190
134291130,0ptp4l0-21swapper/007:25:200
134291130,0ptp4l0-21swapper/007:10:190
134291120,0ptp4l0-21swapper/212:35:302
134291120,0ptp4l0-21swapper/210:30:292
134291120,0ptp4l0-21swapper/209:00:002
134291110,2ptp4l33-21ksoftirqd/211:54:502
134291110,0ptp4l0-21swapper/311:26:253
1777099101,4cyclictest0-21swapper/210:15:182
134291100,1ptp4l0-21swapper/207:29:442
134291100,0ptp4l0-21swapper/211:23:022
177719997,1cyclictest29531-21cat07:30:213
177719997,1cyclictest2900-21sort08:45:203
177719997,1cyclictest27250-21cut08:30:213
177719997,1cyclictest22000-21timerwakeupswit09:20:283
177719997,1cyclictest20453-21seq10:21:203
177719997,1cyclictest18215-21sort07:10:193
177719997,1cyclictest14464-21expr11:15:213
177719997,1cyclictest12136-21gltestperf08:00:203
177719997,1cyclictest1106-21cat11:50:283
177719990,8cyclictest7713-21taskset09:55:453
177719990,8cyclictest23511-21taskset07:19:413
13429190,0ptp4l0-21swapper/212:34:022
13429190,0ptp4l0-21swapper/212:26:252
13429190,0ptp4l0-21swapper/212:21:132
13429190,0ptp4l0-21swapper/212:15:042
13429190,0ptp4l0-21swapper/212:10:492
13429190,0ptp4l0-21swapper/212:06:162
13429190,0ptp4l0-21swapper/212:03:442
13429190,0ptp4l0-21swapper/211:55:352
13429190,0ptp4l0-21swapper/211:46:552
13429190,0ptp4l0-21swapper/211:42:572
13429190,0ptp4l0-21swapper/211:36:162
13429190,0ptp4l0-21swapper/211:32:252
13429190,0ptp4l0-21swapper/211:25:142
13429190,0ptp4l0-21swapper/211:10:442
13429190,0ptp4l0-21swapper/211:06:022
13429190,0ptp4l0-21swapper/211:05:012
13429190,0ptp4l0-21swapper/210:57:422
13429190,0ptp4l0-21swapper/210:51:122
13429190,0ptp4l0-21swapper/210:46:482
13429190,0ptp4l0-21swapper/210:44:352
13429190,0ptp4l0-21swapper/210:37:242
13429190,0ptp4l0-21swapper/210:25:142
13429190,0ptp4l0-21swapper/210:11:542
13429190,0ptp4l0-21swapper/210:01:452
13429190,0ptp4l0-21swapper/209:55:382
13429190,0ptp4l0-21swapper/209:52:122
13429190,0ptp4l0-21swapper/209:45:452
13429190,0ptp4l0-21swapper/209:42:582
13429190,0ptp4l0-21swapper/209:37:462
13429190,0ptp4l0-21swapper/209:31:482
13429190,0ptp4l0-21swapper/209:26:352
13429190,0ptp4l0-21swapper/209:20:522
13429190,0ptp4l0-21swapper/209:10:102
13429190,0ptp4l0-21swapper/209:00:142
13429190,0ptp4l0-21swapper/208:40:112
13429190,0ptp4l0-21swapper/208:35:112
13429190,0ptp4l0-21swapper/208:31:012
13429190,0ptp4l0-21swapper/208:26:082
13429190,0ptp4l0-21swapper/208:20:052
13429190,0ptp4l0-21swapper/208:11:542
13429190,0ptp4l0-21swapper/208:02:492
13429190,0ptp4l0-21swapper/207:57:372
13429190,0ptp4l0-21swapper/207:52:042
13429190,0ptp4l0-21swapper/207:45:542
13429190,0ptp4l0-21swapper/207:43:212
13429190,0ptp4l0-21swapper/207:20:562
13429190,0ptp4l0-21swapper/207:16:422
13429190,0ptp4l0-21swapper/207:11:262
177719986,1cyclictest9878-21tr07:55:243
177719986,1cyclictest9528-21chrt12:10:043
177719986,1cyclictest8446-21chrt11:03:183
177719986,1cyclictest7216-21cat12:05:183
177719986,1cyclictest6172-21cat12:00:293
177719986,1cyclictest546-21cp09:45:013
177719986,1cyclictest5043-21ntpq10:55:333
177719986,1cyclictest4942-21grep08:50:173
177719986,1cyclictest4215-21wc07:45:143
177719986,1cyclictest40972sleep311:58:153
177719986,1cyclictest4012-21cut09:50:203
177719986,1cyclictest32690-21head08:40:193
177719986,1cyclictest32392-21ntp_states10:45:253
177719986,1cyclictest313692sleep307:35:123
177719986,1cyclictest31004-21cut08:35:243
177719986,1cyclictest30571-21taskset10:41:133
177719986,1cyclictest29454-21cat11:45:173
177719986,1cyclictest29004-21cat09:35:223
177719986,1cyclictest27302-21cut07:25:243
177719986,1cyclictest26615-21taskset10:35:193
177719986,1cyclictest26439-21cat09:30:253
177719986,1cyclictest26250-21taskset11:39:163
177719986,1cyclictest25857-21ntpq08:25:283
177719986,1cyclictest24149-21expr07:20:153
177719986,1cyclictest23943-21cut10:30:203
177719986,1cyclictest23056-21sed12:35:223
177719986,1cyclictest22978-21ls09:25:243
177719986,1cyclictest22816-21tail10:25:333
177719986,1cyclictest22476-21tune2fs08:20:183
177719986,1cyclictest21483-21taskset11:30:143
177719986,1cyclictest2112-21cat07:40:203
177719986,1cyclictest21103-21tr12:30:263
177719986,1cyclictest2045-21cut10:50:213
177719986,1cyclictest20336-21cut08:15:223
177719986,1cyclictest18011-21gltestperf09:15:183
177719986,1cyclictest17722-21sh11:20:263
177719986,1cyclictest17384-21expr12:25:223
177719986,1cyclictest17103-21grep08:10:173
177719986,1cyclictest16723-21tr10:15:223
177719986,1cyclictest15789-21cat12:20:233
177719986,1cyclictest15487-21cut09:10:203
177719986,1cyclictest14979-21cat10:10:283
177719986,1cyclictest144332sleep309:06:323
177719986,1cyclictest14007-21awk12:15:293
177719986,1cyclictest12904-21chrt10:07:093
177719986,1cyclictest11841-21tune2fs11:10:183
177719986,1cyclictest11706-21grep09:00:303
177719986,1cyclictest10393-21taskset10:02:283
177719986,1cyclictest10164-21cut11:05:263
177709986,1cyclictest5630-21sed08:50:232
177709986,1cyclictest17457-21taskset09:15:112
177709986,1cyclictest14496-21cat08:05:172
177709986,1cyclictest13507-21cat09:05:222
177719976,1cyclictest7360-21apt08:55:203
177719975,1cyclictest6589-21egrep07:50:153
177719975,1cyclictest31034-21if_enp3s009:40:193
177719975,1cyclictest28637-21seq11:42:113
177719964,1cyclictest15384-21cut08:05:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional