You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-31 - 05:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Xeon E3-1230 v2 @3300 MHz, Linux 4.19.1-rt3 (Profile)

Latency plot of shadow in rack #c, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Tue Jan 31, 2023 00:46:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
125391720,28ptp4l0-21swapper/119:06:061
92732650,1sleep6641ktimersoftd/622:10:006
273102630,0sleep40-21swapper/421:50:184
301352620,0sleep20-21swapper/221:54:572
125391620,31ptp4l0-21swapper/319:06:373
125391620,31ptp4l0-21swapper/219:05:032
97382610,0sleep40-21swapper/419:20:174
125391610,6ptp4l0-21swapper/719:09:257
281152600,0sleep10-21swapper/121:50:231
253762600,0sleep70-21swapper/700:36:287
353925847,6sleep40-21swapper/419:06:554
373325745,7sleep60-21swapper/619:09:236
366325332,7sleep00-21swapper/019:08:280
125391530,5ptp4l0-21swapper/519:06:365
4068993327,5cyclictest5787-21ssh21:22:024
125391320,0ptp4l0-21swapper/023:20:210
125391320,0ptp4l0-21swapper/023:20:200
4068993125,5cyclictest14860-21ssh00:23:464
125391310,0ptp4l0-21swapper/120:55:261
125391310,0ptp4l0-21swapper/120:55:261
4068993028,1cyclictest21723-21sh23:07:244
125391300,0ptp4l0-21swapper/521:34:155
125391300,0ptp4l0-21swapper/222:29:242
125391300,0ptp4l0-21swapper/122:56:161
125391300,0ptp4l0-21swapper/020:10:290
125391300,0ptp4l0-21swapper/000:15:250
125391290,3ptp4l0-21swapper/022:05:400
125391290,1ptp4l20690-21cat20:55:015
125391290,1ptp4l20690-21cat20:55:005
125391290,0ptp4l0-21swapper/521:16:465
125391290,0ptp4l0-21swapper/423:40:324
125391290,0ptp4l0-21swapper/421:25:074
125391290,0ptp4l0-21swapper/420:30:224
125391290,0ptp4l0-21swapper/100:15:191
125391280,0ptp4l0-21swapper/622:58:396
125391280,0ptp4l0-21swapper/423:46:044
125391280,0ptp4l0-21swapper/422:07:324
125391280,0ptp4l0-21swapper/421:40:524
125391280,0ptp4l0-21swapper/123:13:211
125391280,0ptp4l0-21swapper/122:07:111
125391280,0ptp4l0-21swapper/022:44:570
125391280,0ptp4l0-21swapper/022:33:250
125391280,0ptp4l0-21swapper/022:21:510
125391280,0ptp4l0-21swapper/021:11:270
125391280,0ptp4l0-21swapper/020:02:130
125391270,3ptp4l0-21swapper/000:01:330
125391270,1ptp4l0-21swapper/321:35:203
125391270,0ptp4l0-21swapper/523:44:455
125391270,0ptp4l0-21swapper/500:36:475
125391270,0ptp4l0-21swapper/423:58:304
125391270,0ptp4l0-21swapper/423:54:504
125391270,0ptp4l0-21swapper/423:36:204
125391270,0ptp4l0-21swapper/423:17:024
125391270,0ptp4l0-21swapper/423:10:574
125391270,0ptp4l0-21swapper/422:11:164
125391270,0ptp4l0-21swapper/422:02:004
125391270,0ptp4l0-21swapper/421:10:444
125391270,0ptp4l0-21swapper/400:13:344
125391270,0ptp4l0-21swapper/321:00:253
125391270,0ptp4l0-21swapper/300:02:323
125391270,0ptp4l0-21swapper/122:16:141
125391270,0ptp4l0-21swapper/121:20:511
125391270,0ptp4l0-21swapper/100:14:521
125391270,0ptp4l0-21swapper/100:09:021
125391260,2ptp4l0-21swapper/500:13:575
125391260,1ptp4l0-21swapper/421:32:364
125391260,0ptp4l0-21swapper/523:39:275
125391260,0ptp4l0-21swapper/522:42:135
125391260,0ptp4l0-21swapper/500:19:245
125391260,0ptp4l0-21swapper/423:03:524
125391260,0ptp4l0-21swapper/422:36:154
125391260,0ptp4l0-21swapper/421:39:304
125391260,0ptp4l0-21swapper/400:15:444
125391260,0ptp4l0-21swapper/321:15:173
125391260,0ptp4l0-21swapper/122:02:151
125391260,0ptp4l0-21swapper/023:55:350
125391260,0ptp4l0-21swapper/023:35:240
125391260,0ptp4l0-21swapper/023:03:280
125391260,0ptp4l0-21swapper/022:58:040
125391260,0ptp4l0-21swapper/022:49:520
125391260,0ptp4l0-21swapper/022:11:320
125391260,0ptp4l0-21swapper/022:02:000
125391260,0ptp4l0-21swapper/020:35:230
125391260,0ptp4l0-21swapper/020:30:500
125391260,0ptp4l0-21swapper/020:20:310
125391260,0ptp4l0-21swapper/019:31:120
125391260,0ptp4l0-21swapper/000:13:480
125391260,0ptp4l0-21swapper/000:08:190
125391250,4ptp4l0-21swapper/423:27:534
125391250,4ptp4l0-21swapper/423:27:524
125391250,1ptp4l2402-21fw_forwarded_lo22:00:197
125391250,0ptp4l0-21swapper/621:58:036
125391250,0ptp4l0-21swapper/523:31:445
125391250,0ptp4l0-21swapper/523:13:215
125391250,0ptp4l0-21swapper/422:46:234
125391250,0ptp4l0-21swapper/422:41:554
125391250,0ptp4l0-21swapper/422:16:324
125391250,0ptp4l0-21swapper/400:06:164
125391250,0ptp4l0-21swapper/322:50:543
125391250,0ptp4l0-21swapper/122:10:301
125391250,0ptp4l0-21swapper/121:55:581
125391250,0ptp4l0-21swapper/121:32:211
125391250,0ptp4l0-21swapper/121:10:241
125391250,0ptp4l0-21swapper/023:06:170
125391250,0ptp4l0-21swapper/022:28:150
125391250,0ptp4l0-21swapper/021:50:590
125391250,0ptp4l0-21swapper/021:15:410
125391250,0ptp4l0-21swapper/000:20:370
125391240,3ptp4l0-21swapper/522:00:285
125391240,3ptp4l0-21swapper/500:09:245
125391240,1ptp4l23564-21hddtemp_smartct21:00:184
125391240,1ptp4l17612-21hddtemp_smartct22:20:184
125391240,0ptp4l0-21swapper/722:55:237
125391240,0ptp4l0-21swapper/623:57:416
125391240,0ptp4l0-21swapper/622:50:216
125391240,0ptp4l0-21swapper/621:35:016
125391240,0ptp4l0-21swapper/521:56:305
125391240,0ptp4l0-21swapper/500:21:495
125391240,0ptp4l0-21swapper/422:25:014
125391240,0ptp4l0-21swapper/420:35:334
125391240,0ptp4l0-21swapper/420:05:264
125391240,0ptp4l0-21swapper/222:30:212
125391240,0ptp4l0-21swapper/123:19:441
125391240,0ptp4l0-21swapper/122:24:071
125391240,0ptp4l0-21swapper/121:46:381
125391240,0ptp4l0-21swapper/121:39:001
125391240,0ptp4l0-21swapper/121:29:501
125391240,0ptp4l0-21swapper/100:40:001
125391240,0ptp4l0-21swapper/023:30:200
125391240,0ptp4l0-21swapper/021:56:490
125391240,0ptp4l0-21swapper/021:45:170
125391240,0ptp4l0-21swapper/021:39:150
125391240,0ptp4l0-21swapper/021:20:300
125391240,0ptp4l0-21swapper/000:27:070
125391230,1ptp4l7190-21ssh22:49:111
125391230,1ptp4l6176-21latency_hist19:15:010
125391230,1ptp4l49-21ksoftirqd/423:24:054
125391230,1ptp4l49-21ksoftirqd/423:24:044
125391230,1ptp4l49-21ksoftirqd/421:55:194
125391230,1ptp4l2603-21/usr/sbin/munin23:25:170
125391230,1ptp4l2603-21/usr/sbin/munin23:25:170
125391230,0ptp4l27497-21diskmemload22:05:006
125391230,0ptp4l27497-21diskmemload21:45:214
125391230,0ptp4l0-21swapper/721:35:217
125391230,0ptp4l0-21swapper/721:30:267
125391230,0ptp4l0-21swapper/719:10:247
125391230,0ptp4l0-21swapper/700:25:287
125391230,0ptp4l0-21swapper/700:02:217
125391230,0ptp4l0-21swapper/623:35:236
125391230,0ptp4l0-21swapper/621:16:596
125391230,0ptp4l0-21swapper/619:50:016
125391230,0ptp4l0-21swapper/523:55:015
125391230,0ptp4l0-21swapper/523:45:205
125391230,0ptp4l0-21swapper/523:27:175
125391230,0ptp4l0-21swapper/523:27:165
125391230,0ptp4l0-21swapper/523:24:115
125391230,0ptp4l0-21swapper/523:24:105
125391230,0ptp4l0-21swapper/522:34:205
125391230,0ptp4l0-21swapper/521:26:505
125391230,0ptp4l0-21swapper/521:12:145
125391230,0ptp4l0-21swapper/500:30:225
125391230,0ptp4l0-21swapper/423:30:294
125391230,0ptp4l0-21swapper/422:35:004
125391230,0ptp4l0-21swapper/420:49:224
125391230,0ptp4l0-21swapper/420:26:234
125391230,0ptp4l0-21swapper/420:21:394
125391230,0ptp4l0-21swapper/420:00:224
125391230,0ptp4l0-21swapper/419:59:594
125391230,0ptp4l0-21swapper/419:45:464
125391230,0ptp4l0-21swapper/419:40:064
125391230,0ptp4l0-21swapper/419:30:254
125391230,0ptp4l0-21swapper/419:25:154
125391230,0ptp4l0-21swapper/323:45:363
125391230,0ptp4l0-21swapper/322:55:203
125391230,0ptp4l0-21swapper/223:35:232
125391230,0ptp4l0-21swapper/222:50:202
125391230,0ptp4l0-21swapper/220:57:482
125391230,0ptp4l0-21swapper/220:57:472
125391230,0ptp4l0-21swapper/123:43:451
125391230,0ptp4l0-21swapper/123:32:071
125391230,0ptp4l0-21swapper/121:16:021
125391230,0ptp4l0-21swapper/120:50:261
125391230,0ptp4l0-21swapper/120:50:251
125391230,0ptp4l0-21swapper/120:25:181
125391230,0ptp4l0-21swapper/120:00:241
125391230,0ptp4l0-21swapper/119:55:171
125391230,0ptp4l0-21swapper/119:40:261
125391230,0ptp4l0-21swapper/100:04:211
125391230,0ptp4l0-21swapper/023:50:540
125391230,0ptp4l0-21swapper/023:47:350
125391230,0ptp4l0-21swapper/023:40:360
125391230,0ptp4l0-21swapper/023:10:220
125391230,0ptp4l0-21swapper/022:35:210
125391230,0ptp4l0-21swapper/021:40:220
125391230,0ptp4l0-21swapper/021:29:140
125391230,0ptp4l0-21swapper/021:06:440
125391230,0ptp4l0-21swapper/020:50:190
125391230,0ptp4l0-21swapper/020:50:180
125391230,0ptp4l0-21swapper/020:40:260
125391230,0ptp4l0-21swapper/020:19:310
125391230,0ptp4l0-21swapper/019:43:290
125391230,0ptp4l0-21swapper/019:20:260
125391230,0ptp4l0-21swapper/019:15:170
125391230,0ptp4l0-21swapper/000:35:210
125391220,0ptp4l27497-21diskmemload21:13:337
125391220,0ptp4l0-21swapper/723:45:237
125391220,0ptp4l0-21swapper/722:51:097
125391220,0ptp4l0-21swapper/722:37:057
125391220,0ptp4l0-21swapper/721:15:197
125391220,0ptp4l0-21swapper/721:00:267
125391220,0ptp4l0-21swapper/622:30:266
125391220,0ptp4l0-21swapper/622:29:346
125391220,0ptp4l0-21swapper/523:55:185
125391220,0ptp4l0-21swapper/523:19:205
125391220,0ptp4l0-21swapper/523:09:275
125391220,0ptp4l0-21swapper/522:56:005
125391220,0ptp4l0-21swapper/522:10:305
125391220,0ptp4l0-21swapper/521:20:235
125391220,0ptp4l0-21swapper/520:45:275
125391220,0ptp4l0-21swapper/520:25:165
125391220,0ptp4l0-21swapper/519:55:185
125391220,0ptp4l0-21swapper/519:40:305
125391220,0ptp4l0-21swapper/519:30:195
125391220,0ptp4l0-21swapper/422:57:524
125391220,0ptp4l0-21swapper/421:17:474
125391220,0ptp4l0-21swapper/421:05:154
125391220,0ptp4l0-21swapper/420:55:234
125391220,0ptp4l0-21swapper/420:55:224
125391220,0ptp4l0-21swapper/420:50:224
125391220,0ptp4l0-21swapper/420:50:214
125391220,0ptp4l0-21swapper/420:15:174
125391220,0ptp4l0-21swapper/420:10:254
125391220,0ptp4l0-21swapper/419:35:194
125391220,0ptp4l0-21swapper/419:15:254
125391220,0ptp4l0-21swapper/400:35:284
125391220,0ptp4l0-21swapper/400:32:474
125391220,0ptp4l0-21swapper/400:26:214
125391220,0ptp4l0-21swapper/400:00:224
125391220,0ptp4l0-21swapper/321:30:213
125391220,0ptp4l0-21swapper/319:10:173
125391220,0ptp4l0-21swapper/300:25:213
125391220,0ptp4l0-21swapper/300:23:093
125391220,0ptp4l0-21swapper/222:05:152
125391220,0ptp4l0-21swapper/222:04:532
125391220,0ptp4l0-21swapper/221:37:402
125391220,0ptp4l0-21swapper/221:35:012
125391220,0ptp4l0-21swapper/219:50:172
125391220,0ptp4l0-21swapper/123:55:291
125391220,0ptp4l0-21swapper/123:50:211
125391220,0ptp4l0-21swapper/123:45:191
125391220,0ptp4l0-21swapper/123:39:331
125391220,0ptp4l0-21swapper/123:25:141
125391220,0ptp4l0-21swapper/123:25:131
125391220,0ptp4l0-21swapper/123:22:571
125391220,0ptp4l0-21swapper/123:22:561
125391220,0ptp4l0-21swapper/123:07:331
125391220,0ptp4l0-21swapper/122:34:521
125391220,0ptp4l0-21swapper/121:40:331
125391220,0ptp4l0-21swapper/120:20:221
125391220,0ptp4l0-21swapper/119:15:171
125391220,0ptp4l0-21swapper/100:30:241
125391220,0ptp4l0-21swapper/100:28:191
125391220,0ptp4l0-21swapper/100:20:211
125391220,0ptp4l0-21swapper/022:16:090
125391220,0ptp4l0-21swapper/021:33:100
125391220,0ptp4l0-21swapper/020:55:180
125391220,0ptp4l0-21swapper/020:55:170
125391220,0ptp4l0-21swapper/020:25:380
125391220,0ptp4l0-21swapper/020:05:170
125391220,0ptp4l0-21swapper/019:58:530
125391220,0ptp4l0-21swapper/019:54:000
125391220,0ptp4l0-21swapper/019:45:210
125391220,0ptp4l0-21swapper/019:35:190
125391220,0ptp4l0-21swapper/000:30:320
125391210,1ptp4l641ktimersoftd/623:16:186
125391210,1ptp4l57-21ksoftirqd/522:21:405
125391210,1ptp4l10874-21ssh22:53:574
125391210,0ptp4l0-21swapper/722:16:057
125391210,0ptp4l0-21swapper/623:44:086
125391210,0ptp4l0-21swapper/623:34:406
125391210,0ptp4l0-21swapper/621:21:146
125391210,0ptp4l0-21swapper/600:31:266
125391210,0ptp4l0-21swapper/523:04:495
125391210,0ptp4l0-21swapper/522:45:255
125391210,0ptp4l0-21swapper/522:09:315
125391210,0ptp4l0-21swapper/521:51:505
125391210,0ptp4l0-21swapper/521:40:415
125391210,0ptp4l0-21swapper/521:37:285
125391210,0ptp4l0-21swapper/520:15:015
125391210,0ptp4l0-21swapper/519:15:195
125391210,0ptp4l0-21swapper/500:28:245
125391210,0ptp4l0-21swapper/500:03:545
125391210,0ptp4l0-21swapper/420:40:334
125391210,0ptp4l0-21swapper/419:51:584
125391210,0ptp4l0-21swapper/419:12:334
125391210,0ptp4l0-21swapper/323:19:093
125391210,0ptp4l0-21swapper/322:16:013
125391210,0ptp4l0-21swapper/321:13:083
125391210,0ptp4l0-21swapper/223:30:312
125391210,0ptp4l0-21swapper/222:58:232
125391210,0ptp4l0-21swapper/221:57:572
125391210,0ptp4l0-21swapper/122:42:251
125391210,0ptp4l0-21swapper/122:36:521
125391210,0ptp4l0-21swapper/120:45:091
125391210,0ptp4l0-21swapper/120:31:121
125391210,0ptp4l0-21swapper/120:15:001
125391210,0ptp4l0-21swapper/120:08:091
125391210,0ptp4l0-21swapper/023:15:240
125391210,0ptp4l0-21swapper/022:54:090
125391210,0ptp4l0-21swapper/020:48:130
125391210,0ptp4l0-21swapper/019:25:240
125391200,0ptp4l0-21swapper/700:23:167
125391200,0ptp4l0-21swapper/622:38:116
125391200,0ptp4l0-21swapper/621:41:416
125391200,0ptp4l0-21swapper/522:15:085
125391200,0ptp4l0-21swapper/521:45:345
125391200,0ptp4l0-21swapper/521:03:325
125391200,0ptp4l0-21swapper/322:37:003
125391200,0ptp4l0-21swapper/322:00:173
125391200,0ptp4l0-21swapper/223:44:052
125391200,0ptp4l0-21swapper/222:38:102
125391200,0ptp4l0-21swapper/219:49:542
125391200,0ptp4l0-21swapper/200:31:262
125391200,0ptp4l0-21swapper/123:00:571
125391200,0ptp4l0-21swapper/119:35:441
125391200,0ptp4l0-21swapper/119:26:391
125391200,0ptp4l0-21swapper/119:20:341
125391190,0ptp4l0-21swapper/620:56:276
125391190,0ptp4l0-21swapper/620:56:266
125391190,0ptp4l0-21swapper/522:54:025
125391190,0ptp4l0-21swapper/522:35:355
125391190,0ptp4l0-21swapper/522:25:435
125391190,0ptp4l0-21swapper/519:38:445
125391190,0ptp4l0-21swapper/322:13:113
125391190,0ptp4l0-21swapper/221:21:412
125391190,0ptp4l0-21swapper/221:16:522
125391190,0ptp4l0-21swapper/122:52:531
125391190,0ptp4l0-21swapper/120:37:581
125391190,0ptp4l0-21swapper/021:00:190
125391180,1ptp4l0-21swapper/520:19:075
125391180,0ptp4l0-21swapper/723:19:107
125391180,0ptp4l0-21swapper/722:13:117
125391180,0ptp4l0-21swapper/622:50:006
125391180,0ptp4l0-21swapper/621:35:036
125391180,0ptp4l0-21swapper/223:57:392
125391180,0ptp4l0-21swapper/221:41:402
125391180,0ptp4l0-21swapper/122:28:271
125391180,0ptp4l0-21swapper/119:30:201
125391180,0ptp4l0-21swapper/119:13:281
125391170,2ptp4l0-21swapper/120:13:311
125391170,0ptp4l0-21swapper/520:00:255
125391170,0ptp4l0-21swapper/223:16:212
125391170,0ptp4l0-21swapper/222:49:542
125391170,0ptp4l0-21swapper/121:02:141
125391160,0ptp4l0-21swapper/520:43:255
125391160,0ptp4l0-21swapper/520:31:165
125391160,0ptp4l0-21swapper/520:24:365
125391160,0ptp4l0-21swapper/119:54:531
125391160,0ptp4l0-21swapper/119:47:211
125391150,0ptp4l0-21swapper/621:01:056
125391150,0ptp4l0-21swapper/620:33:016
125391150,0ptp4l0-21swapper/619:49:456
125391150,0ptp4l0-21swapper/521:08:085
125391150,0ptp4l0-21swapper/520:55:485
125391150,0ptp4l0-21swapper/520:55:475
125391150,0ptp4l0-21swapper/520:36:025
125391150,0ptp4l0-21swapper/520:07:035
125391150,0ptp4l0-21swapper/519:51:005
125391150,0ptp4l0-21swapper/519:46:015
125391150,0ptp4l0-21swapper/519:25:115
125391150,0ptp4l0-21swapper/519:20:065
125391150,0ptp4l0-21swapper/519:13:505
125391150,0ptp4l0-21swapper/221:01:062
125391150,0ptp4l0-21swapper/121:08:051
125391150,0ptp4l0-21swapper/120:42:221
405699140,1cyclictest0-21swapper/220:45:272
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional