You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-03 - 20:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Xeon E3-1230 v2 @3300 MHz, Linux 4.19.1-rt3 (Profile)

Latency plot of shadow in rack #c, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Sat Jun 03, 2023 12:46:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1253911150,12ptp4l0-21swapper/107:07:431
125391990,1ptp4l0-21swapper/407:06:214
125391920,6ptp4l0-21swapper/507:08:365
125391820,31ptp4l0-21swapper/007:05:520
125391710,2ptp4l0-21swapper/207:05:082
125391700,0ptp4l0-21swapper/607:06:276
1241825734,7sleep30-21swapper/307:09:523
12695995521,11cyclictest0-21swapper/008:05:560
1207825342,6sleep70-21swapper/707:05:317
1270699461,34cyclictest0-21swapper/109:28:581
12740994511,11cyclictest0-21swapper/609:58:366
12695994522,11cyclictest0-21swapper/011:35:150
12695994522,11cyclictest0-21swapper/007:10:140
1271899449,22cyclictest0-21swapper/312:31:293
12718994410,22cyclictest0-21swapper/312:37:003
12718994410,22cyclictest0-21swapper/308:49:133
12706994410,22cyclictest0-21swapper/110:42:561
12706994410,11cyclictest0-21swapper/109:21:191
1270699440,10cyclictest0-21swapper/110:53:531
12695994422,11cyclictest0-21swapper/009:47:100
12695994419,11cyclictest0-21swapper/009:59:190
12695994410,23cyclictest0-21swapper/008:16:090
12695994410,11cyclictest0-21swapper/011:59:140
1274099439,23cyclictest0-21swapper/609:34:136
12726994318,24cyclictest0-21swapper/409:56:244
12726994310,22cyclictest0-21swapper/410:02:424
12726994310,22cyclictest0-21swapper/409:06:404
1271899439,23cyclictest0-21swapper/310:08:053
1271899439,23cyclictest0-21swapper/310:08:043
1271899439,23cyclictest0-21swapper/309:01:233
1271899439,11cyclictest0-21swapper/310:21:573
1271899439,11cyclictest0-21swapper/309:07:573
12718994320,11cyclictest0-21swapper/309:15:163
12718994310,22cyclictest0-21swapper/307:23:123
1270699439,22cyclictest0-21swapper/108:07:531
1270699439,12cyclictest0-21swapper/112:01:341
12706994310,11cyclictest22043-21timerwakeupswit10:55:301
12706994310,10cyclictest0-21swapper/107:19:131
12695994321,11cyclictest0-21swapper/008:22:430
12695994320,11cyclictest0-21swapper/009:52:430
12695994320,11cyclictest0-21swapper/008:51:560
12695994320,11cyclictest0-21swapper/008:37:580
12695994310,22cyclictest0-21swapper/010:44:230
12695994310,22cyclictest0-21swapper/010:15:180
12695994310,11cyclictest0-21swapper/008:59:160
1272699429,22cyclictest0-21swapper/411:46:114
1271899428,11cyclictest0-21swapper/309:59:133
1270699428,11cyclictest0-21swapper/107:40:311
12706994219,22cyclictest0-21swapper/108:28:521
12695994220,11cyclictest0-21swapper/010:05:200
12695994220,11cyclictest0-21swapper/010:05:190
1273499417,23cyclictest0-21swapper/512:31:425
1273499417,23cyclictest0-21swapper/512:23:375
1273499417,23cyclictest0-21swapper/507:48:395
12734994118,22cyclictest0-21swapper/507:55:405
12734994118,13cyclictest0-21swapper/510:02:065
12734994118,11cyclictest0-21swapper/512:04:405
12734994118,11cyclictest0-21swapper/511:25:285
12734994118,11cyclictest0-21swapper/509:08:315
12734994118,11cyclictest0-21swapper/508:48:545
1271899418,22cyclictest0-21swapper/312:04:063
1270699419,12cyclictest0-21swapper/112:14:401
1270699418,22cyclictest0-21swapper/110:29:031
1270699418,0cyclictest0-21swapper/107:55:591
12706994110,11cyclictest0-21swapper/108:57:001
1269599418,22cyclictest0-21swapper/009:44:280
1273499407,22cyclictest0-21swapper/508:13:365
1273499406,23cyclictest0-21swapper/508:38:185
1273499406,11cyclictest0-21swapper/509:45:185
1273499406,11cyclictest0-21swapper/509:03:565
12734994018,11cyclictest0-21swapper/507:15:555
12734994013,26cyclictest0-21swapper/509:20:265
1272699407,22cyclictest0-21swapper/412:38:334
1271899407,11cyclictest0-21swapper/311:36:173
1270699405,23cyclictest0-21swapper/109:13:011
1270699405,12cyclictest0-21swapper/110:45:411
1270699405,12cyclictest0-21swapper/109:42:051
1269599407,22cyclictest0-21swapper/007:39:070
1269599404,11cyclictest0-21swapper/012:38:110
1273499396,22cyclictest0-21swapper/511:02:395
1273499396,22cyclictest0-21swapper/509:52:145
1273499395,23cyclictest0-21swapper/510:47:275
1273499395,11cyclictest0-21swapper/510:43:185
12734993916,22cyclictest0-21swapper/512:13:575
12734993916,11cyclictest0-21swapper/511:13:465
12734993916,11cyclictest0-21swapper/509:43:365
12734993916,11cyclictest0-21swapper/507:20:295
1272699396,22cyclictest0-21swapper/411:11:154
1270699394,34cyclictest0-21swapper/109:09:491
1270699394,12cyclictest0-21swapper/112:19:551
1273499385,22cyclictest0-21swapper/512:28:435
1273499384,23cyclictest0-21swapper/508:56:535
1273499383,34cyclictest0-21swapper/509:35:475
12734993815,22cyclictest0-21swapper/508:16:445
1270699380,23cyclictest0-21swapper/111:21:371
12695993819,11cyclictest0-21swapper/010:32:060
12695993810,27cyclictest0-21swapper/009:34:190
12695993810,22cyclictest0-21swapper/011:54:020
1273499374,22cyclictest0-21swapper/511:52:005
12734993714,22cyclictest0-21swapper/510:21:135
12726993714,22cyclictest0-21swapper/409:44:564
12726993712,24cyclictest0-21swapper/411:37:134
1270699374,22cyclictest0-21swapper/110:30:221
1270699373,23cyclictest0-21swapper/107:49:531
1269599374,22cyclictest0-21swapper/009:01:450
12695993715,11cyclictest0-21swapper/011:06:390
1272699368,0cyclictest0-21swapper/411:18:144
1272699360,12cyclictest0-21swapper/407:45:194
1270699362,23cyclictest0-21swapper/110:07:291
1270699362,23cyclictest0-21swapper/110:07:291
1270699362,11cyclictest0-21swapper/108:21:041
12706993621,14cyclictest0-21swapper/112:07:181
1270699361,34cyclictest0-21swapper/108:54:191
1270699361,23cyclictest0-21swapper/111:13:261
12706993610,11cyclictest0-21swapper/109:31:051
1270699360,11cyclictest0-21swapper/108:01:261
1269599363,22cyclictest0-21swapper/010:20:120
1269599362,23cyclictest0-21swapper/010:36:470
12726993512,11cyclictest0-21swapper/412:22:294
12726993512,0cyclictest0-21swapper/408:45:034
1272699351,11cyclictest0-21swapper/408:00:214
1272699350,23cyclictest0-21swapper/411:26:014
12718993522,0cyclictest0-21swapper/311:02:193
1271899350,12cyclictest0-21swapper/311:07:433
1270699359,23cyclictest0-21swapper/111:41:181
1270699357,23cyclictest0-21swapper/108:39:171
1270699352,11cyclictest0-21swapper/110:20:321
12706993520,14cyclictest0-21swapper/111:05:521
12706993518,11cyclictest0-21swapper/111:47:081
12706993513,11cyclictest0-21swapper/108:33:371
1270699351,12cyclictest0-21swapper/107:12:411
1270699351,11cyclictest0-21swapper/109:58:361
12706993510,24cyclictest0-21swapper/111:31:571
12695993512,11cyclictest0-21swapper/009:16:190
12740993410,23cyclictest0-21swapper/611:18:396
12734993422,11cyclictest0-21swapper/510:28:565
1273499341,22cyclictest0-21swapper/508:44:345
1273499340,23cyclictest0-21swapper/510:13:145
1273499340,23cyclictest0-21swapper/510:13:135
12726993422,11cyclictest0-21swapper/407:50:144
12726993411,22cyclictest0-21swapper/412:08:004
12726993410,23cyclictest0-21swapper/408:41:364
12718993411,11cyclictest0-21swapper/311:26:433
12718993410,23cyclictest0-21swapper/310:03:323
12718993410,12cyclictest0-21swapper/308:32:153
1271899340,23cyclictest0-21swapper/308:26:223
1271899340,23cyclictest0-21swapper/307:41:063
1271899340,22cyclictest0-21swapper/309:30:063
1271899340,22cyclictest0-21swapper/308:20:573
1271899340,11cyclictest0-21swapper/311:42:473
1271899340,11cyclictest0-21swapper/309:23:173
1271899340,11cyclictest0-21swapper/308:56:043
1270699346,22cyclictest0-21swapper/107:28:511
12706993410,23cyclictest0-21swapper/110:16:401
12706993410,23cyclictest0-21swapper/109:37:531
12706993410,12cyclictest0-21swapper/110:01:301
12706993410,11cyclictest0-21swapper/110:37:221
1270699340,11cyclictest0-21swapper/109:00:481
12695993421,12cyclictest0-21swapper/010:55:580
12695993411,11cyclictest0-21swapper/012:31:360
12695993411,11cyclictest0-21swapper/011:16:100
12695993411,11cyclictest0-21swapper/011:14:260
12695993411,11cyclictest0-21swapper/007:22:090
12695993410,23cyclictest0-21swapper/011:03:510
1269599340,23cyclictest0-21swapper/011:40:020
1269599340,23cyclictest0-21swapper/011:27:320
1269599340,23cyclictest0-21swapper/008:27:430
1269599340,23cyclictest0-21swapper/007:30:200
1269599340,23cyclictest0-21swapper/007:30:190
1269599340,11cyclictest0-21swapper/010:27:420
12734993310,22cyclictest0-21swapper/511:48:335
12734993310,22cyclictest0-21swapper/510:16:475
1273499330,22cyclictest0-21swapper/510:32:125
1273499330,22cyclictest0-21swapper/509:28:495
1273499330,22cyclictest0-21swapper/507:36:255
1272699338,0cyclictest0-21swapper/407:14:124
12726993310,22cyclictest0-21swapper/410:18:334
12726993310,11cyclictest0-21swapper/411:51:484
12718993320,0cyclictest0-21swapper/308:43:123
12718993310,22cyclictest0-21swapper/312:21:253
12718993310,22cyclictest0-21swapper/310:46:253
12718993310,22cyclictest0-21swapper/307:46:073
12718993310,22cyclictest0-21swapper/307:13:573
12718993310,11cyclictest0-21swapper/310:41:153
1270699339,22cyclictest0-21swapper/108:17:101
12706993310,22cyclictest0-21swapper/111:57:311
12706993310,12cyclictest0-21swapper/108:10:411
12706993310,11cyclictest0-21swapper/107:30:201
12706993310,11cyclictest0-21swapper/107:30:191
12695993310,22cyclictest0-21swapper/011:22:460
12695993310,22cyclictest0-21swapper/008:13:220
12695993310,11cyclictest0-21swapper/008:44:010
12695993310,11cyclictest0-21swapper/007:59:250
12695993310,11cyclictest0-21swapper/007:16:490
1269599330,22cyclictest0-21swapper/012:10:040
1269599330,22cyclictest0-21swapper/010:49:210
1269599330,22cyclictest0-21swapper/009:36:430
1273499329,11cyclictest0-21swapper/507:26:445
12734993221,0cyclictest0-21swapper/512:16:055
12734993221,0cyclictest0-21swapper/509:31:185
1272699329,11cyclictest0-21swapper/411:34:064
1272699327,0cyclictest0-21swapper/407:44:094
12726993211,0cyclictest0-21swapper/408:38:414
12726993210,0cyclictest0-21swapper/408:11:234
1272699320,10cyclictest0-21swapper/411:59:354
1271899329,22cyclictest0-21swapper/312:26:033
1271899329,22cyclictest0-21swapper/312:17:433
1271899329,22cyclictest0-21swapper/311:47:423
1271899329,0cyclictest0-21swapper/309:10:563
12718993210,11cyclictest0-21swapper/310:12:533
12718993210,11cyclictest0-21swapper/310:12:523
12718993210,11cyclictest0-21swapper/308:04:033
12718993210,10cyclictest0-21swapper/310:31:243
12718993210,0cyclictest0-21swapper/312:12:533
12718993210,0cyclictest0-21swapper/308:35:093
1270699329,12cyclictest0-21swapper/112:23:241
1270699329,11cyclictest0-21swapper/109:45:341
1270699327,22cyclictest0-21swapper/108:41:501
12706993210,0cyclictest0-21swapper/111:27:051
1269599329,22cyclictest0-21swapper/008:45:280
1269599329,11cyclictest0-21swapper/007:49:440
1269599328,0cyclictest0-21swapper/011:34:000
12695993210,0cyclictest0-21swapper/012:26:310
12695993210,0cyclictest0-21swapper/010:11:080
12695993210,0cyclictest0-21swapper/010:11:070
12695993210,0cyclictest0-21swapper/008:00:280
125391320,0ptp4l0-21swapper/409:00:274
125391320,0ptp4l0-21swapper/111:20:001
1273499318,22cyclictest0-21swapper/508:24:585
1273499317,23cyclictest0-21swapper/508:25:485
12734993119,11cyclictest0-21swapper/508:08:475
1272699319,1cyclictest0-21swapper/411:00:304
1272699319,0cyclictest0-21swapper/410:32:204
1272699317,12cyclictest0-21swapper/409:20:064
12726993110,10cyclictest0-21swapper/409:36:234
1271899319,11cyclictest0-21swapper/310:36:183
1271899319,0cyclictest0-21swapper/311:50:173
1271899319,0cyclictest0-21swapper/307:37:123
12718993110,10cyclictest0-21swapper/309:51:313
12718993110,10cyclictest0-21swapper/307:59:473
12718993110,10cyclictest0-21swapper/307:17:533
1270699319,11cyclictest0-21swapper/109:17:431
1270699319,11cyclictest0-21swapper/107:20:161
1270699318,22cyclictest0-21swapper/107:36:121
1269599319,11cyclictest0-21swapper/012:06:480
1269599319,0cyclictest0-21swapper/012:16:190
1269599319,0cyclictest0-21swapper/009:13:060
1269599318,22cyclictest0-21swapper/009:20:110
12695993110,10cyclictest0-21swapper/011:46:180
1274099308,11cyclictest0-21swapper/607:45:536
1274099308,11cyclictest0-21swapper/607:34:006
1274099308,11cyclictest0-21swapper/607:33:596
1274099306,23cyclictest0-21swapper/609:36:506
1273499307,22cyclictest0-21swapper/511:40:365
1273499307,12cyclictest0-21swapper/510:35:235
1273499307,12cyclictest0-21swapper/507:41:395
1273499307,0cyclictest0-21swapper/508:01:455
12734993018,11cyclictest0-21swapper/511:34:365
1272699308,0cyclictest0-21swapper/408:27:184
1272699308,0cyclictest0-21swapper/408:08:404
1271899309,20cyclictest0-21swapper/308:18:303
1271899308,11cyclictest0-21swapper/309:38:573
12718993010,19cyclictest0-21swapper/311:17:253
1270699309,10cyclictest0-21swapper/112:33:541
1270699307,22cyclictest0-21swapper/110:12:031
1270699307,22cyclictest0-21swapper/110:12:021
1270699307,12cyclictest0-21swapper/111:02:041
1270699306,0cyclictest0-21swapper/111:35:031
1270699306,0cyclictest0-21swapper/109:53:101
125391300,1ptp4l33-21ksoftirqd/211:47:152
125391300,0ptp4l0-21swapper/711:15:237
125391300,0ptp4l0-21swapper/709:10:297
1273499298,10cyclictest0-21swapper/511:09:415
1273499297,11cyclictest0-21swapper/511:19:245
1273499297,11cyclictest0-21swapper/509:13:155
1273499297,11cyclictest0-21swapper/507:10:275
1273499297,0cyclictest0-21swapper/510:51:075
1273499297,0cyclictest0-21swapper/508:30:095
1273499296,11cyclictest0-21swapper/511:21:305
1273499296,11cyclictest0-21swapper/510:06:085
1273499296,11cyclictest0-21swapper/510:06:075
1273499296,11cyclictest0-21swapper/509:16:185
12734992918,0cyclictest0-21swapper/512:39:095
12734992917,0cyclictest0-21swapper/511:56:565
12734992910,11cyclictest0-21swapper/508:52:015
1272699297,11cyclictest0-21swapper/410:50:294
1272699296,1cyclictest0-21swapper/410:25:404
1272699296,11cyclictest0-21swapper/411:44:444
1272699296,11cyclictest0-21swapper/410:43:184
1272699296,11cyclictest0-21swapper/408:55:214
1272699295,12cyclictest0-21swapper/410:45:554
1271899299,19cyclictest0-21swapper/311:30:143
1271899299,19cyclictest0-21swapper/309:48:063
1271899299,19cyclictest0-21swapper/308:14:443
1270699296,22cyclictest0-21swapper/107:50:361
1270699296,11cyclictest0-21swapper/112:29:251
1270699295,0cyclictest0-21swapper/108:49:221
125391290,3ptp4l0-21swapper/311:24:023
125391290,1ptp4l73-21ksoftirqd/710:10:247
125391290,1ptp4l73-21ksoftirqd/710:10:237
1273499287,20cyclictest0-21swapper/512:08:075
1273499286,11cyclictest0-21swapper/507:30:435
1273499286,11cyclictest0-21swapper/507:30:425
1273499285,11cyclictest0-21swapper/510:56:125
1272699286,0cyclictest0-21swapper/408:20:284
1272699286,0cyclictest0-21swapper/407:20:234
12718992821,0cyclictest0-21swapper/311:58:323
1270699286,0cyclictest0-21swapper/112:36:041
125391280,1ptp4l23951-21timerandwakeup09:50:304
125391280,0ptp4l73-21ksoftirqd/709:43:557
125391280,0ptp4l0-21swapper/712:30:277
125391280,0ptp4l0-21swapper/412:32:524
125391280,0ptp4l0-21swapper/412:13:444
125391280,0ptp4l0-21swapper/410:05:084
125391280,0ptp4l0-21swapper/410:05:074
125391280,0ptp4l0-21swapper/010:00:030
1273499275,0cyclictest0-21swapper/509:58:585
1273499274,11cyclictest0-21swapper/507:53:145
1272699275,0cyclictest0-21swapper/409:34:334
1272699275,0cyclictest0-21swapper/408:30:214
1272699274,22cyclictest0-21swapper/409:15:574
12726992717,0cyclictest0-21swapper/408:19:034
1269599275,0cyclictest0-21swapper/009:25:230
125391270,1ptp4l73-21ksoftirqd/711:53:337
125391270,1ptp4l73-21ksoftirqd/711:10:137
125391270,1ptp4l73-21ksoftirqd/710:44:437
125391270,1ptp4l73-21ksoftirqd/710:29:447
125391270,1ptp4l73-21ksoftirqd/709:30:147
125391270,1ptp4l73-21ksoftirqd/709:21:247
125391270,1ptp4l73-21ksoftirqd/709:18:057
125391270,1ptp4l73-21ksoftirqd/708:11:437
125391270,1ptp4l73-21ksoftirqd/707:44:447
125391270,1ptp4l57-21ksoftirqd/511:35:565
125391270,1ptp4l49-21ksoftirqd/409:12:544
125391270,1ptp4l49-21ksoftirqd/407:19:404
125391270,1ptp4l41-21ksoftirqd/308:05:133
125391270,1ptp4l33-21ksoftirqd/211:36:242
125391270,1ptp4l33-21ksoftirqd/207:57:382
125391270,0ptp4l73-21ksoftirqd/710:05:557
125391270,0ptp4l73-21ksoftirqd/710:05:547
125391270,0ptp4l65-21ksoftirqd/608:12:476
125391270,0ptp4l33-21ksoftirqd/212:17:212
125391270,0ptp4l0-21swapper/712:29:597
125391270,0ptp4l0-21swapper/710:53:457
125391270,0ptp4l0-21swapper/709:53:537
125391270,0ptp4l0-21swapper/709:46:567
125391270,0ptp4l0-21swapper/709:00:557
125391270,0ptp4l0-21swapper/707:15:267
125391270,0ptp4l0-21swapper/612:17:576
125391270,0ptp4l0-21swapper/609:26:276
125391270,0ptp4l0-21swapper/412:27:154
125391270,0ptp4l0-21swapper/411:21:574
125391270,0ptp4l0-21swapper/409:27:544
1269599263,11cyclictest0-21swapper/007:44:180
1269599260,0cyclictest0-21swapper/009:09:020
125391260,1ptp4l73-21ksoftirqd/712:39:027
125391260,1ptp4l73-21ksoftirqd/711:40:437
125391260,1ptp4l73-21ksoftirqd/711:34:067
125391260,1ptp4l73-21ksoftirqd/711:22:247
125391260,1ptp4l73-21ksoftirqd/707:37:437
125391260,1ptp4l65-21ksoftirqd/612:36:116
125391260,1ptp4l65-21ksoftirqd/611:08:536
125391260,1ptp4l49-21ksoftirqd/412:15:574
125391260,1ptp4l49-21ksoftirqd/410:56:194
125391260,1ptp4l41-21ksoftirqd/312:08:563
125391260,1ptp4l33-21ksoftirqd/211:43:512
125391260,1ptp4l33-21ksoftirqd/208:47:582
125391260,1ptp4l33-21ksoftirqd/208:01:312
125391260,0ptp4l73-21ksoftirqd/710:18:547
125391260,0ptp4l73-21ksoftirqd/708:24:437
125391260,0ptp4l73-21ksoftirqd/708:02:427
125391260,0ptp4l73-21ksoftirqd/707:50:427
125391260,0ptp4l33-21ksoftirqd/212:38:382
125391260,0ptp4l0-21swapper/712:18:467
125391260,0ptp4l0-21swapper/712:05:187
125391260,0ptp4l0-21swapper/711:46:547
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional