You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-24 - 06:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron

x86 Intel Core i7 7828EQ @3000 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of shadow in rack #9, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot3s.osadl.org (updated Fri Mar 24, 2023 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114091630,44ptp4l0-21swapper/019:08:450
114091580,40ptp4l0-21swapper/119:05:031
1544425046,2sleep30-21swapper/319:05:113
1546224944,2sleep20-21swapper/219:05:182
61672450,0sleep10-21swapper/123:00:011
114091230,0ptp4l0-21swapper/020:10:130
114091190,0ptp4l0-21swapper/119:15:271
114091180,2ptp4l0-21swapper/123:10:271
114091180,1ptp4l23819-21apt-get19:20:161
114091180,0ptp4l0-21swapper/122:05:211
114091180,0ptp4l0-21swapper/023:25:220
114091170,0ptp4l0-21swapper/023:45:210
114091170,0ptp4l0-21swapper/022:25:220
114091160,1ptp4l7077-21apt-get00:05:020
114091160,1ptp4l4035-21apt-get19:45:170
114091160,1ptp4l24740-21ntp_states22:30:231
114091160,1ptp4l16870-21apt-get20:10:131
114091160,1ptp4l14350-21apt-get20:05:120
114091160,0ptp4l0-21swapper/121:45:231
114091160,0ptp4l0-21swapper/022:45:220
114091160,0ptp4l0-21swapper/020:35:270
114091150,2ptp4l6739-21ps21:55:211
114091150,1ptp4l23495-21snmp_o5powerctl20:20:281
114091150,1ptp4l21924-21ls00:30:290
114091150,1ptp4l19979-21snmp_o5powerctl22:20:241
114091150,1ptp4l1914-21apt-get20:45:011
114091150,1ptp4l14183-21ntpq22:10:230
114091150,1ptp4l13958-21ntp_states00:15:231
114091150,0ptp4l9956-21apt-get21:00:140
114091150,0ptp4l0-21swapper/123:55:171
114091150,0ptp4l0-21swapper/121:35:131
114091150,0ptp4l0-21swapper/120:50:241
114091150,0ptp4l0-21swapper/120:25:161
114091150,0ptp4l0-21swapper/023:20:120
114091150,0ptp4l0-21swapper/021:20:140
114091150,0ptp4l0-21swapper/021:16:570
114091150,0ptp4l0-21swapper/021:05:130
114091140,1ptp4l7855-21cstates00:05:151
114091140,1ptp4l4166-21gltestperf22:55:210
114091140,1ptp4l32385-21cstates23:50:231
114091140,1ptp4l31502-21grep23:45:311
114091140,1ptp4l30936-21latency_hist22:45:011
114091140,1ptp4l29385-21perf23:45:010
114091140,1ptp4l29279-21fschecks_count19:30:250
114091140,1ptp4l29272-21perf20:35:010
114091140,1ptp4l29272-21perf20:35:010
114091140,1ptp4l28292-21perf22:40:011
114091140,1ptp4l27407-21perf21:35:010
114091140,1ptp4l24560-21apt-get23:35:150
114091140,1ptp4l20605-21ls19:15:010
114091140,1ptp4l19415-21irqstats22:20:190
114091140,1ptp4l14984-21expr23:15:220
114091140,1ptp4l11918-21cut20:00:140
114091140,1ptp4l1099-21snmpd22:40:220
114091140,0ptp4l1780-21cstates19:40:130
114091140,0ptp4l0-21swapper/123:35:241
114091140,0ptp4l0-21swapper/123:15:021
114091140,0ptp4l0-21swapper/123:00:201
114091140,0ptp4l0-21swapper/122:50:011
114091140,0ptp4l0-21swapper/122:25:281
114091140,0ptp4l0-21swapper/122:10:281
114091140,0ptp4l0-21swapper/121:50:271
114091140,0ptp4l0-21swapper/121:40:261
114091140,0ptp4l0-21swapper/121:25:211
114091140,0ptp4l0-21swapper/121:20:201
114091140,0ptp4l0-21swapper/120:35:221
114091140,0ptp4l0-21swapper/120:15:241
114091140,0ptp4l0-21swapper/120:00:151
114091140,0ptp4l0-21swapper/119:55:291
114091140,0ptp4l0-21swapper/119:40:231
114091140,0ptp4l0-21swapper/100:37:321
114091140,0ptp4l0-21swapper/100:30:151
114091140,0ptp4l0-21swapper/100:00:161
114091140,0ptp4l0-21swapper/023:05:010
114091140,0ptp4l0-21swapper/022:50:190
114091140,0ptp4l0-21swapper/022:15:010
114091140,0ptp4l0-21swapper/021:40:290
114091140,0ptp4l0-21swapper/019:25:010
114091140,0ptp4l0-21swapper/019:10:120
114091140,0ptp4l0-21swapper/000:35:590
114091140,0ptp4l0-21swapper/000:25:280
114091140,0ptp4l0-21swapper/000:10:330
114091140,0ptp4l0-21swapper/000:00:250
114091130,1ptp4l8185-21irqrtprio20:55:192
114091130,1ptp4l6738-21cstates23:00:210
114091130,0ptp4l0-21swapper/321:00:193
114091130,0ptp4l0-21swapper/223:50:012
114091130,0ptp4l0-21swapper/223:35:162
114091130,0ptp4l0-21swapper/223:25:212
114091130,0ptp4l0-21swapper/222:55:192
114091130,0ptp4l0-21swapper/222:05:292
114091130,0ptp4l0-21swapper/222:00:152
114091130,0ptp4l0-21swapper/221:50:342
114091130,0ptp4l0-21swapper/221:25:172
114091130,0ptp4l0-21swapper/221:00:232
114091130,0ptp4l0-21swapper/220:20:302
114091130,0ptp4l0-21swapper/219:16:212
114091130,0ptp4l0-21swapper/219:10:132
114091130,0ptp4l0-21swapper/200:25:192
114091130,0ptp4l0-21swapper/200:20:192
114091130,0ptp4l0-21swapper/123:40:211
114091130,0ptp4l0-21swapper/123:30:251
114091130,0ptp4l0-21swapper/123:25:201
114091130,0ptp4l0-21swapper/123:20:131
114091130,0ptp4l0-21swapper/123:05:241
114091130,0ptp4l0-21swapper/122:50:151
114091130,0ptp4l0-21swapper/122:15:151
114091130,0ptp4l0-21swapper/122:00:191
114091130,0ptp4l0-21swapper/121:30:141
114091130,0ptp4l0-21swapper/121:15:151
114091130,0ptp4l0-21swapper/121:10:221
114091130,0ptp4l0-21swapper/121:05:161
114091130,0ptp4l0-21swapper/121:03:121
114091130,0ptp4l0-21swapper/120:55:241
114091130,0ptp4l0-21swapper/120:40:151
114091130,0ptp4l0-21swapper/120:30:151
114091130,0ptp4l0-21swapper/120:30:151
114091130,0ptp4l0-21swapper/120:05:171
114091130,0ptp4l0-21swapper/119:50:161
114091130,0ptp4l0-21swapper/119:45:221
114091130,0ptp4l0-21swapper/119:35:161
114091130,0ptp4l0-21swapper/119:30:241
114091130,0ptp4l0-21swapper/119:25:231
114091130,0ptp4l0-21swapper/119:10:211
114091130,0ptp4l0-21swapper/100:25:211
114091130,0ptp4l0-21swapper/100:20:251
114091130,0ptp4l0-21swapper/100:10:251
114091130,0ptp4l0-21swapper/023:55:170
114091130,0ptp4l0-21swapper/023:50:260
114091130,0ptp4l0-21swapper/023:30:220
114091130,0ptp4l0-21swapper/023:10:210
114091130,0ptp4l0-21swapper/022:35:190
114091130,0ptp4l0-21swapper/022:30:170
114091130,0ptp4l0-21swapper/022:05:180
114091130,0ptp4l0-21swapper/022:00:180
114091130,0ptp4l0-21swapper/021:55:180
114091130,0ptp4l0-21swapper/021:50:200
114091130,0ptp4l0-21swapper/021:45:200
114091130,0ptp4l0-21swapper/021:35:150
114091130,0ptp4l0-21swapper/021:25:180
114091130,0ptp4l0-21swapper/021:10:240
114091130,0ptp4l0-21swapper/020:55:140
114091130,0ptp4l0-21swapper/020:50:280
114091130,0ptp4l0-21swapper/020:45:140
114091130,0ptp4l0-21swapper/020:40:270
114091130,0ptp4l0-21swapper/020:25:260
114091130,0ptp4l0-21swapper/020:20:190
114091130,0ptp4l0-21swapper/020:15:170
114091130,0ptp4l0-21swapper/019:55:240
114091130,0ptp4l0-21swapper/019:50:150
114091130,0ptp4l0-21swapper/019:35:170
114091130,0ptp4l0-21swapper/019:25:140
114091130,0ptp4l0-21swapper/000:15:180
114091120,0ptp4l612-21rs:main2
114091120,0ptp4l0-21swapper/219:50:012
114091120,0ptp4l0-21swapper/000:20:220
1799899112,4cyclictest0-21swapper/319:50:133
114091110,0ptp4l0-21swapper/221:55:162
114091110,0ptp4l0-21swapper/220:25:202
114091100,0ptp4l0-21swapper/223:30:272
114091100,0ptp4l0-21swapper/223:10:442
114091100,0ptp4l0-21swapper/222:32:392
114091100,0ptp4l0-21swapper/219:36:442
179989997,1cyclictest9862-21chrt22:01:263
179989997,1cyclictest9492-21taskset20:57:393
179989997,1cyclictest7416-21cut23:00:263
179989997,1cyclictest5715-21chrt22:56:583
179989997,1cyclictest4176-21taskset23:55:393
179989997,1cyclictest32674-21sed23:50:263
179989997,1cyclictest30685-21taskset22:43:293
179989997,1cyclictest29835-21chrt21:39:043
179989997,1cyclictest29766-21expr20:35:183
179989997,1cyclictest28322-21nfs4_client23:40:243
179989997,1cyclictest241002sleep320:23:373
179989997,1cyclictest23974-21chrt23:30:493
179989997,1cyclictest23522-21seq19:19:493
179989997,1cyclictest22044-21date22:25:273
179989997,1cyclictest19749-21phc2sys-jitter22:20:223
179989997,1cyclictest15345-21cut20:05:173
179989997,1cyclictest14471-21snmp_o5powerctl22:10:263
179989996,2cyclictest10015-21cut19:55:233
179989995,4cyclictest579-21irqbalance19:26:523
179989991,3cyclictest0-21swapper/320:45:013
179989990,8cyclictest21805-21wc23:30:013
179979997,1cyclictest9242-21cat19:55:202
179979997,1cyclictest628-21taskset22:46:442
179979997,1cyclictest3416-21taskset19:40:262
179979997,1cyclictest30902sleep222:50:372
179979997,1cyclictest29084-21expr19:30:242
179979997,1cyclictest26770-21sort21:30:242
179979997,1cyclictest222952sleep200:31:432
179979997,1cyclictest204542sleep222:21:542
179979990,8cyclictest31822-21threads21:40:292
11409190,0ptp4l41-21ksoftirqd/319:44:293
11409190,0ptp4l14760-21diskmemload21:22:352
11409190,0ptp4l0-21swapper/223:40:402
11409190,0ptp4l0-21swapper/223:21:092
11409190,0ptp4l0-21swapper/223:15:062
11409190,0ptp4l0-21swapper/222:38:422
11409190,0ptp4l0-21swapper/222:15:552
11409190,0ptp4l0-21swapper/222:14:172
11409190,0ptp4l0-21swapper/221:45:302
11409190,0ptp4l0-21swapper/221:39:372
11409190,0ptp4l0-21swapper/221:15:212
11409190,0ptp4l0-21swapper/221:10:092
11409190,0ptp4l0-21swapper/221:05:292
11409190,0ptp4l0-21swapper/220:50:202
11409190,0ptp4l0-21swapper/220:47:082
11409190,0ptp4l0-21swapper/220:37:012
11409190,0ptp4l0-21swapper/220:32:292
11409190,0ptp4l0-21swapper/220:32:292
11409190,0ptp4l0-21swapper/220:18:152
11409190,0ptp4l0-21swapper/220:10:072
11409190,0ptp4l0-21swapper/220:06:482
11409190,0ptp4l0-21swapper/220:00:492
11409190,0ptp4l0-21swapper/219:46:262
11409190,0ptp4l0-21swapper/219:24:112
11409190,0ptp4l0-21swapper/200:16:272
11409190,0ptp4l0-21swapper/200:13:272
11409190,0ptp4l0-21swapper/200:05:192
179989986,1cyclictest6535-21cat00:00:273
179989986,1cyclictest617-21cut20:40:203
179989986,1cyclictest6150-21ntpq20:50:353
179989986,1cyclictest5426-21tr21:55:143
179989986,1cyclictest4122-21expr19:45:183
179989986,1cyclictest4062-21ntp_kernel_pll_21:50:303
179989986,1cyclictest31476-21grep19:35:153
179989986,1cyclictest31171-21snmp_o5powerctl23:45:293
179989986,1cyclictest30400-21expr21:40:173
179989986,1cyclictest30114-21awk19:30:303
179989986,1cyclictest27381-21head22:35:283
179989986,1cyclictest25852-21taskset23:35:233
179989986,1cyclictest2569-21latency_hist21:50:003
179989986,1cyclictest25609-21tail21:30:163
179989986,1cyclictest24471-21dpkg20:25:163
179989986,1cyclictest24175-21cat22:30:203
179989986,1cyclictest24144-21expr19:20:173
179989986,1cyclictest23380-21grep00:35:273
179989986,1cyclictest22693-21grep21:25:163
179989986,1cyclictest20654-21cat00:30:163
179989986,1cyclictest20413-21expr21:20:153
179989986,1cyclictest19544-21unixbench-2d00:25:313
179989986,1cyclictest19448-21cpu20:15:153
179989986,1cyclictest18537-21head19:10:143
179989986,1cyclictest174982sleep321:15:153
179989986,1cyclictest17126-21tr23:20:133
179989986,1cyclictest1675-21head22:50:173
179989986,1cyclictest16403-21cat22:15:193
179989986,1cyclictest15547-21expr00:20:163
179989986,1cyclictest14983-21seq21:10:183
179989986,1cyclictest14403-21chrt23:15:083
179989986,1cyclictest12882-21expr00:15:173
179989986,1cyclictest12647-21cut23:10:243
179989986,1cyclictest124362sleep321:05:013
179989986,1cyclictest11887-21grep20:00:143
179989986,1cyclictest11409-21ntpq00:10:303
179989986,1cyclictest10901-21expr23:05:333
179989986,1cyclictest10603-21cat22:05:173
179989984,0cyclictest0-21swapper/320:30:143
179989984,0cyclictest0-21swapper/320:30:143
179979986,1cyclictest8152-21cat23:00:342
179979986,1cyclictest488-21tr20:40:192
179979986,1cyclictest3309-21grep23:55:212
179979986,1cyclictest29053-21expr22:40:232
179979986,1cyclictest21383-21sort22:25:242
179979986,1cyclictest10302-21cat23:05:262
11409180,0ptp4l0-21swapper/223:50:062
11409180,0ptp4l0-21swapper/200:35:082
11409180,0ptp4l0-21swapper/200:00:152
179989975,1cyclictest9635-21chrt00:06:243
179989975,1cyclictest31270-21cat22:45:153
179989975,1cyclictest17869-21uname20:10:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional