You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-14 - 20:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron

x86 Intel Core i7 7828EQ @3000 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of shadow in rack #9, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack9slot3s.osadl.org (updated Sun Aug 14, 2022 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30922850,1sleep00-21swapper/007:05:260
134291560,39ptp4l0-21swapper/107:05:231
134291530,30ptp4l0-21swapper/207:05:172
329925147,2sleep30-21swapper/307:05:303
134291220,0ptp4l0-21swapper/009:05:180
134291210,0ptp4l0-21swapper/109:05:161
134291190,0ptp4l0-21swapper/111:05:171
134291180,0ptp4l0-21swapper/010:20:270
134291170,0ptp4l0-21swapper/009:35:310
134291170,0ptp4l0-21swapper/008:30:260
134291160,1ptp4l9154-21apt-get10:30:020
134291160,1ptp4l7922-21ls09:20:330
134291160,1ptp4l7077-21snmp_o5powerctl08:15:241
134291160,1ptp4l3766-21apt-get12:30:180
134291160,1ptp4l3445-21ls10:15:351
134291160,1ptp4l31997-21snmp_o5powerctl11:15:291
134291160,1ptp4l23552-21apt-get12:05:201
134291160,1ptp4l23084-21apt-get12:05:010
134291160,0ptp4l0-21swapper/009:55:180
134291160,0ptp4l0-21swapper/008:25:150
134291160,0ptp4l0-21swapper/008:05:220
134291160,0ptp4l0-21swapper/007:15:260
134291150,1ptp4l9900-21ls09:25:230
134291150,1ptp4l5572-21cat11:30:020
134291150,1ptp4l5220-21snmp_o5powerctl09:15:301
134291150,1ptp4l3661-21hddtemp_smartct11:25:201
134291150,1ptp4l31913-21snmp_o5powerctl08:00:241
134291150,1ptp4l30798-21cat10:05:360
134291150,1ptp4l29106-21cut09:00:191
134291150,1ptp4l28941-21df_inode12:15:220
134291150,1ptp4l22634-21ntp_states09:50:261
134291150,1ptp4l21884-21snmp_o5powerctl10:55:240
134291150,1ptp4l2116-21snmp_o5powerctl11:20:260
134291150,1ptp4l18071-21diskstats07:35:151
134291150,1ptp4l17588-21sed07:35:011
134291150,1ptp4l17472-21ls10:45:271
134291150,1ptp4l17287-21snmp_o5powerctl11:50:230
134291150,1ptp4l16850-21gltestperf09:40:211
134291150,1ptp4l13835-21ls07:25:200
134291150,1ptp4l13570-21diskstats11:45:150
134291150,1ptp4l12249-21snmp_o5powerctl11:40:281
134291150,0ptp4l8741-21apt-get09:25:191
134291150,0ptp4l0-21swapper/111:30:161
134291150,0ptp4l0-21swapper/111:20:201
134291150,0ptp4l0-21swapper/109:55:221
134291150,0ptp4l0-21swapper/109:21:371
134291150,0ptp4l0-21swapper/109:10:021
134291150,0ptp4l0-21swapper/108:45:211
134291150,0ptp4l0-21swapper/107:10:011
134291150,0ptp4l0-21swapper/012:10:200
134291150,0ptp4l0-21swapper/011:55:200
134291150,0ptp4l0-21swapper/011:35:180
134291150,0ptp4l0-21swapper/011:13:350
134291150,0ptp4l0-21swapper/010:45:260
134291150,0ptp4l0-21swapper/010:15:360
134291150,0ptp4l0-21swapper/009:30:210
134291150,0ptp4l0-21swapper/008:15:140
4174991412,1cyclictest0-21swapper/107:55:221
134291140,1ptp4l9616-21smartctl08:20:241
134291140,1ptp4l30336-21/usr/sbin/munin08:00:190
134291140,1ptp4l28565-21cstates09:00:170
134291140,1ptp4l28308-21fschecks_count11:10:211
134291140,1ptp4l27916-21ntp_states10:00:301
134291140,1ptp4l26647-21awk11:05:240
134291140,1ptp4l21851-21grep09:50:202
134291140,1ptp4l18599-21df11:55:161
134291140,1ptp4l16090-21diskstats11:50:151
134291140,1ptp4l14679-21snmp_o5powerctl08:30:321
134291140,1ptp4l10754-21/usr/sbin/munin07:20:180
134291140,0ptp4l13775-21hddtemp_smartct11:45:161
134291140,0ptp4l0-21swapper/212:20:252
134291140,0ptp4l0-21swapper/212:15:242
134291140,0ptp4l0-21swapper/210:25:182
134291140,0ptp4l0-21swapper/209:15:192
134291140,0ptp4l0-21swapper/208:40:142
134291140,0ptp4l0-21swapper/208:35:262
134291140,0ptp4l0-21swapper/208:25:222
134291140,0ptp4l0-21swapper/207:38:042
134291140,0ptp4l0-21swapper/112:30:281
134291140,0ptp4l0-21swapper/112:25:191
134291140,0ptp4l0-21swapper/112:15:321
134291140,0ptp4l0-21swapper/112:10:351
134291140,0ptp4l0-21swapper/112:03:001
134291140,0ptp4l0-21swapper/111:35:201
134291140,0ptp4l0-21swapper/110:52:341
134291140,0ptp4l0-21swapper/110:40:221
134291140,0ptp4l0-21swapper/110:35:361
134291140,0ptp4l0-21swapper/110:30:341
134291140,0ptp4l0-21swapper/110:25:251
134291140,0ptp4l0-21swapper/110:20:261
134291140,0ptp4l0-21swapper/110:10:371
134291140,0ptp4l0-21swapper/110:05:281
134291140,0ptp4l0-21swapper/109:47:311
134291140,0ptp4l0-21swapper/109:35:231
134291140,0ptp4l0-21swapper/108:55:271
134291140,0ptp4l0-21swapper/108:54:101
134291140,0ptp4l0-21swapper/108:40:181
134291140,0ptp4l0-21swapper/108:35:331
134291140,0ptp4l0-21swapper/108:10:171
134291140,0ptp4l0-21swapper/108:05:281
134291140,0ptp4l0-21swapper/107:45:181
134291140,0ptp4l0-21swapper/107:25:251
134291140,0ptp4l0-21swapper/107:20:261
134291140,0ptp4l0-21swapper/012:37:170
134291140,0ptp4l0-21swapper/012:25:170
134291140,0ptp4l0-21swapper/012:20:220
134291140,0ptp4l0-21swapper/011:30:280
134291140,0ptp4l0-21swapper/011:15:280
134291140,0ptp4l0-21swapper/011:00:210
134291140,0ptp4l0-21swapper/010:54:560
134291140,0ptp4l0-21swapper/010:28:460
134291140,0ptp4l0-21swapper/010:10:270
134291140,0ptp4l0-21swapper/010:00:330
134291140,0ptp4l0-21swapper/009:50:240
134291140,0ptp4l0-21swapper/009:45:200
134291140,0ptp4l0-21swapper/009:15:300
134291140,0ptp4l0-21swapper/009:10:200
134291140,0ptp4l0-21swapper/008:55:220
134291140,0ptp4l0-21swapper/008:50:230
134291140,0ptp4l0-21swapper/008:45:320
134291140,0ptp4l0-21swapper/008:40:200
134291140,0ptp4l0-21swapper/008:35:400
134291140,0ptp4l0-21swapper/008:20:250
134291140,0ptp4l0-21swapper/007:45:250
134291140,0ptp4l0-21swapper/007:40:190
134291140,0ptp4l0-21swapper/007:35:160
134291140,0ptp4l0-21swapper/007:30:160
134291140,0ptp4l0-21swapper/007:10:250
134291130,1ptp4l6610-21expr12:35:201
134291130,0ptp4l26241-21cstates12:10:202
134291130,0ptp4l0-21swapper/212:35:282
134291130,0ptp4l0-21swapper/212:30:192
134291130,0ptp4l0-21swapper/211:50:162
134291130,0ptp4l0-21swapper/211:40:242
134291130,0ptp4l0-21swapper/211:35:272
134291130,0ptp4l0-21swapper/211:30:322
134291130,0ptp4l0-21swapper/211:20:282
134291130,0ptp4l0-21swapper/211:05:292
134291130,0ptp4l0-21swapper/211:00:232
134291130,0ptp4l0-21swapper/210:40:262
134291130,0ptp4l0-21swapper/209:55:212
134291130,0ptp4l0-21swapper/209:33:152
134291130,0ptp4l0-21swapper/209:20:322
134291130,0ptp4l0-21swapper/207:45:202
134291130,0ptp4l0-21swapper/207:10:192
134291130,0ptp4l0-21swapper/112:20:151
134291130,0ptp4l0-21swapper/111:00:021
134291130,0ptp4l0-21swapper/110:55:151
134291130,0ptp4l0-21swapper/109:30:221
134291130,0ptp4l0-21swapper/108:25:151
134291130,0ptp4l0-21swapper/107:50:111
134291130,0ptp4l0-21swapper/107:40:161
134291130,0ptp4l0-21swapper/107:15:131
134291130,0ptp4l0-21swapper/012:00:190
134291130,0ptp4l0-21swapper/011:40:180
134291130,0ptp4l0-21swapper/010:40:170
134291130,0ptp4l0-21swapper/010:35:210
134291130,0ptp4l0-21swapper/009:40:180
134291130,0ptp4l0-21swapper/008:10:160
134291130,0ptp4l0-21swapper/007:55:170
134291130,0ptp4l0-21swapper/007:50:130
134291120,0ptp4l0-21swapper/211:45:252
134291120,0ptp4l0-21swapper/207:30:262
134291120,0ptp4l0-21swapper/207:20:162
134291110,2ptp4l0-21swapper/210:57:342
134291110,0ptp4l0-21swapper/209:45:242
134291100,1ptp4l0-21swapper/210:21:342
134291100,0ptp4l0-21swapper/210:15:202
134291100,0ptp4l0-21swapper/209:43:442
134291100,0ptp4l0-21swapper/208:18:282
134291100,0ptp4l0-21swapper/208:07:162
134291100,0ptp4l0-21swapper/207:40:182
134291100,0ptp4l0-21swapper/207:17:062
41799997,1cyclictest9853-21taskset07:19:503
41799997,1cyclictest9477-21proc_pri08:20:243
41799997,1cyclictest32592-21gzip12:20:233
41799997,1cyclictest2966-21taskset08:10:123
41799997,1cyclictest24762-21chrt07:46:213
41799997,1cyclictest19541-21cut08:40:223
41799997,1cyclictest17411-21sed09:40:243
41799997,1cyclictest15430-21chrt11:49:223
41799997,1cyclictest128132sleep311:43:093
41799997,1cyclictest10106-21taskset11:36:073
41799996,2cyclictest32123-21tail09:05:233
41799996,2cyclictest27243-21tr08:55:253
41799990,8cyclictest7759-21taskset08:19:343
41799990,8cyclictest12927-21grep08:30:013
41789997,1cyclictest27582-21grep08:55:272
41789997,1cyclictest25187-21taskset08:51:072
41789997,1cyclictest10348-21cat09:25:302
41789990,5cyclictest0-21swapper/209:10:152
13429190,0ptp4l0-21swapper/308:07:123
13429190,0ptp4l0-21swapper/212:29:442
13429190,0ptp4l0-21swapper/212:05:542
13429190,0ptp4l0-21swapper/212:01:032
13429190,0ptp4l0-21swapper/211:56:572
13429190,0ptp4l0-21swapper/211:25:562
13429190,0ptp4l0-21swapper/211:16:042
13429190,0ptp4l0-21swapper/211:10:462
13429190,0ptp4l0-21swapper/210:52:252
13429190,0ptp4l0-21swapper/210:45:222
13429190,0ptp4l0-21swapper/210:38:082
13429190,0ptp4l0-21swapper/210:31:502
13429190,0ptp4l0-21swapper/210:13:082
13429190,0ptp4l0-21swapper/210:09:272
13429190,0ptp4l0-21swapper/210:03:182
13429190,0ptp4l0-21swapper/209:35:402
13429190,0ptp4l0-21swapper/209:05:482
13429190,0ptp4l0-21swapper/209:01:222
13429190,0ptp4l0-21swapper/208:46:042
13429190,0ptp4l0-21swapper/208:31:222
13429190,0ptp4l0-21swapper/208:22:212
13429190,0ptp4l0-21swapper/208:13:102
13429190,0ptp4l0-21swapper/208:01:132
13429190,0ptp4l0-21swapper/207:55:102
13429190,0ptp4l0-21swapper/207:51:332
13429190,0ptp4l0-21swapper/207:25:572
41799986,1cyclictest6932-21egrep10:25:173
41799986,1cyclictest6509-21taskset07:13:193
41799986,1cyclictest642-21tr10:10:323
41799986,1cyclictest6387-21tr12:35:203
41799986,1cyclictest6332-21cat11:30:263
41799986,1cyclictest3997-21cat09:15:193
41799986,1cyclictest3737-21chrt12:30:173
41799986,1cyclictest3281-21cat11:25:193
41799986,1cyclictest31107-21taskset10:05:483
41799986,1cyclictest31052-21grep12:20:023
41799986,1cyclictest30506-21grep11:15:183
41799986,1cyclictest30484-21taskset09:04:063
41799986,1cyclictest30330-21chrt08:00:103
41799986,1cyclictest299092sleep311:11:313
41799986,1cyclictest284302sleep307:55:183
41799986,1cyclictest27438-21cut10:00:263
41799986,1cyclictest27302-21chrt07:51:373
41799986,1cyclictest26182-21expr12:10:203
41799986,1cyclictest25377-21acpi11:05:183
41799986,1cyclictest24785-21tr12:05:263
41799986,1cyclictest24621-21wc11:00:343
41799986,1cyclictest24256-21diskstats09:55:213
41799986,1cyclictest24054-21cut08:50:163
41799986,1cyclictest23430-21taskset09:52:233
41799986,1cyclictest22615-21tail12:00:303
41799986,1cyclictest224202sleep310:57:453
41799986,1cyclictest22396-21chrt07:43:213
41799986,1cyclictest20839-21tr08:45:213
41799986,1cyclictest2062-21cat10:15:203
41799986,1cyclictest19185-21expr09:45:193
41799986,1cyclictest18478-21cat11:55:163
41799986,1cyclictest17719-21chrt08:37:373
41799986,1cyclictest17688-21cut10:45:293
41799986,1cyclictest16093-21sed07:30:193
41799986,1cyclictest15936-21expr11:50:133
41799986,1cyclictest15463-21ls09:35:303
41799986,1cyclictest15240-21sed10:40:183
41799986,1cyclictest1456-21ls12:25:153
41799986,1cyclictest13597-21perl08:30:233
41799986,1cyclictest13568-21wc10:35:323
41799986,1cyclictest12904-21grep09:30:323
41799986,1cyclictest12637-21chrt07:25:073
41799986,1cyclictest1228-21grep09:10:163
41799986,1cyclictest10350-21expr07:20:163
41799986,1cyclictest10186-21chrt10:30:233
41799986,1cyclictest10051-21tail09:25:253
41799982,3cyclictest17719-21apt-get07:35:143
41799975,1cyclictest746-21expr11:20:173
41799975,1cyclictest6347-21chrt10:21:303
41799975,1cyclictest6201-21basename09:20:193
41799975,1cyclictest200182sleep310:54:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional