You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-14 - 21:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel

x86 Intel Atom D510 @1667 MHz, Linux 3.12.61-rt81 (Profile)

Latency plot of shadow in rack #1, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack1slot6s.osadl.org (updated Sun Aug 14, 2022 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2419991130,9rtkit-daemon0-21swapper/207:46:432
2419991110,8rtkit-daemon0-21swapper/210:06:372
2419991110,8rtkit-daemon0-21swapper/210:06:372
2419991110,6rtkit-daemon0-21swapper/207:33:362
2419991090,9rtkit-daemon0-21swapper/209:05:542
2419991080,9rtkit-daemon0-21swapper/208:31:562
2419991080,7rtkit-daemon0-21swapper/207:26:582
2419991080,5rtkit-daemon29-21ksoftirqd/208:02:342
2419991080,5rtkit-daemon29-21ksoftirqd/208:02:342
2419991060,7rtkit-daemon0-21swapper/210:01:452
2419991060,7rtkit-daemon0-21swapper/207:41:352
2419991060,6rtkit-daemon29-21ksoftirqd/207:16:062
2419991030,8rtkit-daemon0-21swapper/208:16:412
2419991020,6rtkit-daemon0-21swapper/208:46:482
2419991010,6rtkit-daemon0-21swapper/209:42:532
2419991010,6rtkit-daemon0-21swapper/209:26:462
2419991010,6rtkit-daemon0-21swapper/207:18:442
2419991010,6rtkit-daemon0-21swapper/207:18:442
2419991000,6rtkit-daemon0-21swapper/208:12:572
2419991000,6rtkit-daemon0-21swapper/208:09:492
2419991000,6rtkit-daemon0-21swapper/207:25:212
2419991000,5rtkit-daemon0-21swapper/208:26:482
241999990,6rtkit-daemon0-21swapper/210:16:142
241999990,6rtkit-daemon0-21swapper/208:53:172
241999990,6rtkit-daemon0-21swapper/208:43:182
241999990,6rtkit-daemon0-21swapper/208:43:182
241999990,6rtkit-daemon0-21swapper/208:37:332
241999990,6rtkit-daemon0-21swapper/207:37:052
241999990,5rtkit-daemon21963-21cpu08:56:322
241999980,6rtkit-daemon0-21swapper/209:31:382
241999980,6rtkit-daemon0-21swapper/209:21:312
241999980,6rtkit-daemon0-21swapper/209:21:312
241999980,6rtkit-daemon0-21swapper/209:07:322
241999980,6rtkit-daemon0-21swapper/208:23:342
241999970,6rtkit-daemon0-21swapper/210:00:222
241999970,6rtkit-daemon0-21swapper/209:18:012
241999970,5rtkit-daemon2220-21cpuspeed07:06:372
241999960,6rtkit-daemon0-21swapper/209:46:302
1846999631,10cyclictest7098-21cpuspeed_turbos07:16:383
1846999631,10cyclictest7098-21cpuspeed_turbos07:16:383
183899934,36cyclictest0-21swapper/010:56:450
1846999030,10cyclictest3086-21hwlatdetect07:06:463
1838999013,13cyclictest0-21swapper/008:01:210
1846998911,29cyclictest0-21swapper/311:11:413
183899894,13cyclictest0-21swapper/010:16:390
1838998925,10cyclictest5563-21grep11:46:450
241999880,6rtkit-daemon0-21swapper/208:24:193
1846998833,10cyclictest18911-21tr07:41:363
183899884,34cyclictest0-21swapper/011:41:310
183899884,34cyclictest0-21swapper/008:56:490
183899883,39cyclictest0-21swapper/009:31:150
241999870,11rtkit-daemon0-21swapper/207:56:573
183899864,33cyclictest0-21swapper/012:21:230
241999850,10rtkit-daemon29-21ksoftirqd/209:11:393
183899855,31cyclictest0-21swapper/010:21:310
241999840,8rtkit-daemon0-21swapper/208:26:563
183899844,13cyclictest0-21swapper/008:06:210
183899844,13cyclictest0-21swapper/008:06:210
183899835,34cyclictest0-21swapper/008:15:540
183899834,34cyclictest0-21swapper/010:51:150
183899834,34cyclictest0-21swapper/010:51:150
183899834,32cyclictest0-21swapper/008:54:160
241999820,7rtkit-daemon0-21swapper/207:36:353
183899824,33cyclictest0-21swapper/011:51:330
183899814,40cyclictest0-21swapper/010:30:440
1838998125,11cyclictest3656-21crond09:26:180
1838998125,11cyclictest3656-21crond09:26:180
1838998030,10cyclictest25526-21strings09:01:460
241999780,7rtkit-daemon24528-21grep10:07:003
241999780,7rtkit-daemon24528-21grep10:07:003
241999780,7rtkit-daemon0-21swapper/209:46:383
1846997819,16cyclictest0-21swapper/311:46:143
183899784,13cyclictest0-21swapper/007:53:200
183899763,37cyclictest0-21swapper/009:41:560
241999750,5rtkit-daemon0-21swapper/209:21:393
241999750,5rtkit-daemon0-21swapper/209:21:393
241999720,5rtkit-daemon0-21swapper/207:14:513
183899694,13cyclictest0-21swapper/009:36:180
1845996533,15cyclictest0-21swapper/212:00:412
241999610,7rtkit-daemon0-21swapper/209:19:243
241999610,6rtkit-daemon0-21swapper/210:15:523
241999610,6rtkit-daemon0-21swapper/209:57:303
241999600,6rtkit-daemon0-21swapper/209:08:023
241999600,6rtkit-daemon0-21swapper/208:57:473
241999600,6rtkit-daemon0-21swapper/208:09:273
241999600,6rtkit-daemon0-21swapper/207:29:433
241999600,5rtkit-daemon0-21swapper/208:13:493
241999600,5rtkit-daemon0-21swapper/207:32:433
184599605,49cyclictest0-21swapper/210:56:402
184599603,51cyclictest0-21swapper/210:51:422
241999590,6rtkit-daemon0-21swapper/208:55:403
241999590,5rtkit-daemon0-21swapper/210:02:153
241999590,5rtkit-daemon0-21swapper/208:17:413
184599595,48cyclictest0-21swapper/211:16:322
184599594,49cyclictest0-21swapper/211:01:482
184599594,47cyclictest0-21swapper/210:42:542
1845995917,13cyclictest0-21swapper/209:51:372
183899595,13cyclictest0-21swapper/008:46:510
241999580,6rtkit-daemon0-21swapper/208:02:423
241999580,6rtkit-daemon0-21swapper/208:02:423
241999580,5rtkit-daemon0-21swapper/209:05:473
184699584,47cyclictest0-21swapper/312:16:123
184599585,47cyclictest0-21swapper/212:05:422
184599584,49cyclictest0-21swapper/207:56:462
184599584,49cyclictest0-21swapper/207:54:442
184599583,50cyclictest0-21swapper/210:16:502
1845995819,13cyclictest0-21swapper/211:31:542
184299589,41cyclictest0-21swapper/110:36:161
1842995839,13cyclictest0-21swapper/109:11:451
184599574,28cyclictest0-21swapper/210:26:442
184599574,27cyclictest0-21swapper/211:15:352
184599574,27cyclictest0-21swapper/209:15:162
1845995737,10cyclictest1526-21grep11:41:252
1845995720,13cyclictest0-21swapper/210:21:492
1845995720,10cyclictest1240-21snmpd11:06:512
1842995738,13cyclictest0-21swapper/111:01:351
183899574,45cyclictest0-21swapper/007:16:550
183899574,45cyclictest0-21swapper/007:16:550
184599564,28cyclictest0-21swapper/210:41:152
184599564,27cyclictest0-21swapper/210:31:402
184599564,26cyclictest0-21swapper/212:16:322
184599563,28cyclictest0-21swapper/212:06:432
184599563,28cyclictest0-21swapper/212:06:432
1842995638,12cyclictest0-21swapper/111:35:371
184599555,25cyclictest0-21swapper/212:30:302
184599554,27cyclictest0-21swapper/211:46:232
184299555,32cyclictest0-21swapper/109:56:401
176272553,45sleep31240-21snmpd09:53:243
261712544,43sleep20-21swapper/212:31:402
184599544,27cyclictest25206-21wc11:21:382
184599544,27cyclictest0-21swapper/212:11:302
184299546,26cyclictest2586-21runrttasks08:13:411
184299545,29cyclictest0-21swapper/108:36:521
184299545,28cyclictest0-21swapper/110:16:461
184299544,27cyclictest27014-21needreboot07:56:481
1842995436,9cyclictest3852-21sort09:26:191
1842995436,9cyclictest3852-21sort09:26:191
1842995432,13cyclictest0-21swapper/108:16:441
97042534,11sleep10-21swapper/108:28:571
311722536,41sleep00-21swapper/009:16:000
241999530,5rtkit-daemon2418-21rtkit-daemon07:01:442
184699534,29cyclictest0-21swapper/312:06:343
184699534,29cyclictest0-21swapper/312:06:343
184299535,38cyclictest0-21swapper/109:51:431
1842995334,12cyclictest0-21swapper/109:36:391
1842995320,15cyclictest0-21swapper/109:06:421
183899533,30cyclictest0-21swapper/007:46:370
14632534,6sleep00-21swapper/007:01:590
137312533,10sleep10-21swapper/107:30:571
256572524,9sleep125829-21fschecks_time10:11:401
184699523,25cyclictest0-21swapper/308:36:323
184299524,29cyclictest0-21swapper/109:00:141
184299524,29cyclictest0-21swapper/107:51:351
184299524,26cyclictest0-21swapper/110:05:241
1842995233,13cyclictest0-21swapper/111:06:501
1842995230,13cyclictest0-21swapper/112:21:381
1842995218,12cyclictest0-21swapper/112:20:441
1842995216,12cyclictest0-21swapper/109:21:181
184599515,30cyclictest0-21swapper/211:36:462
184599514,29cyclictest0-21swapper/211:26:532
184599514,29cyclictest0-21swapper/211:26:532
1845995134,10cyclictest20579-21cpuspeed_turbos12:21:232
1845995120,12cyclictest0-21swapper/210:46:252
1845995120,12cyclictest0-21swapper/210:46:252
184299519,21cyclictest0-21swapper/110:26:161
184299518,20cyclictest0-21swapper/110:41:161
184299516,25cyclictest0-21swapper/108:25:081
184299516,21cyclictest0-21swapper/112:16:121
184299515,26cyclictest0-21swapper/108:55:131
184299514,28cyclictest0-21swapper/111:26:531
184299514,28cyclictest0-21swapper/111:26:531
1842995135,10cyclictest11573-21cut09:41:401
184299513,28cyclictest0-21swapper/111:16:461
1842995128,15cyclictest0-21swapper/107:31:521
1842995121,12cyclictest0-21swapper/110:51:241
1842995118,13cyclictest0-21swapper/107:16:551
1842995118,13cyclictest0-21swapper/107:16:551
183899514,39cyclictest0-21swapper/009:36:320
183899514,39cyclictest0-21swapper/008:32:030
134812512,43sleep00-21swapper/007:27:450
115902513,42sleep311710-21timerandwakeup08:32:063
285452503,40sleep00-21swapper/009:07:340
184699504,24cyclictest0-21swapper/311:51:573
184699503,27cyclictest0-21swapper/311:06:393
184699503,13cyclictest0-21swapper/310:36:453
1846995024,20cyclictest1334-21runrttasks12:34:433
184299505,37cyclictest0-21swapper/108:41:531
184299505,37cyclictest0-21swapper/108:41:531
184299504,37cyclictest0-21swapper/110:21:371
184299504,28cyclictest0-21swapper/108:46:351
184299504,27cyclictest0-21swapper/108:01:451
184299504,27cyclictest0-21swapper/108:01:451
184299504,26cyclictest32603-21chrt08:10:061
184299504,25cyclictest0-21swapper/110:56:371
1842995031,13cyclictest0-21swapper/107:24:411
184299503,40cyclictest0-21swapper/107:11:541
184299503,39cyclictest0-21swapper/107:06:441
184299503,27cyclictest0-21swapper/111:56:321
1842995019,11cyclictest0-21swapper/108:32:011
183899504,39cyclictest0-21swapper/012:01:380
183899504,37cyclictest0-21swapper/007:06:500
1838995032,12cyclictest0-21swapper/012:26:390
183899503,40cyclictest0-21swapper/011:56:450
183899503,39cyclictest0-21swapper/008:16:370
154032505,10sleep10-21swapper/112:10:271
154032505,10sleep10-21swapper/112:10:271
124662502,9sleep30-21swapper/310:56:283
82232493,40sleep10-21swapper/111:54:391
219432493,39sleep321978-21cpu11:16:283
205772493,40sleep10-21swapper/107:42:421
195752492,40sleep00-21swapper/011:11:250
1845994917,14cyclictest0-21swapper/209:36:332
184299498,14cyclictest7250irq/45-ahci11:16:141
184299495,27cyclictest0-21swapper/111:41:441
1842994935,8cyclictest4288-21diskstats11:46:271
184299493,38cyclictest0-21swapper/109:01:511
184299493,26cyclictest0-21swapper/109:36:181
183899493,39cyclictest0-21swapper/010:01:540
183899493,38cyclictest0-21swapper/011:21:360
1838994920,24cyclictest2369-21munin-node10:31:520
180612492,40sleep00-21swapper/012:16:180
96462483,9sleep10-21swapper/110:48:281
96462483,9sleep10-21swapper/110:48:281
262752484,11sleep10-21swapper/111:24:191
231112485,10sleep10-21swapper/110:06:361
231112485,10sleep10-21swapper/110:06:361
222182483,38sleep30-21swapper/312:21:493
184699484,28cyclictest0-21swapper/311:21:393
184699483,36cyclictest0-21swapper/310:21:463
184699483,27cyclictest0-21swapper/311:51:123
184699483,26cyclictest0-21swapper/311:56:523
184299485,34cyclictest0-21swapper/112:01:371
184299484,36cyclictest0-21swapper/112:31:321
1842994833,8cyclictest5539-21cat09:26:581
184299483,28cyclictest0-21swapper/110:36:371
183899483,39cyclictest0-21swapper/012:08:120
183899483,39cyclictest0-21swapper/012:08:120
183899483,38cyclictest0-21swapper/011:06:580
183899483,38cyclictest0-21swapper/010:51:350
183899483,38cyclictest0-21swapper/008:21:420
67332475,36sleep00-21swapper/010:39:200
325382472,39sleep00-21swapper/008:09:170
205532474,37sleep00-21swapper/007:42:250
184699474,37cyclictest8279-21wc10:41:513
184699474,27cyclictest0-21swapper/312:20:443
184699473,38cyclictest0-21swapper/312:02:223
184699473,36cyclictest10823-21grep10:51:323
184699473,34cyclictest0-21swapper/310:31:163
184699473,13cyclictest0-21swapper/309:31:183
1845994729,10cyclictest6399-21cpuspeed_turbos11:51:252
184299474,37cyclictest0-21swapper/109:46:491
184299474,35cyclictest0-21swapper/107:06:241
184299473,27cyclictest0-21swapper/112:26:311
1842994728,12cyclictest17551-21needreboot07:36:481
183899474,26cyclictest0-21swapper/012:35:470
183899473,37cyclictest0-21swapper/007:11:410
8282463,37sleep10-21swapper/111:38:021
8202462,38sleep30-21swapper/311:37:563
246382464,36sleep00-21swapper/010:07:040
246382464,36sleep00-21swapper/010:07:040
184699464,35cyclictest0-21swapper/308:41:463
184699464,35cyclictest0-21swapper/308:41:463
184699464,24cyclictest0-21swapper/311:30:363
184699464,24cyclictest0-21swapper/311:30:363
184699463,25cyclictest0-21swapper/310:21:173
1846994623,8cyclictest14852-21munin-node11:01:393
184299464,15cyclictest0-21swapper/107:46:541
183899464,36cyclictest0-21swapper/010:46:140
183899464,35cyclictest0-21swapper/009:56:480
183899464,34cyclictest0-21swapper/008:36:330
183899463,39cyclictest0-21swapper/011:39:420
1838994621,7cyclictest1240-21snmpd11:30:360
1838994621,7cyclictest1240-21snmpd11:30:360
177602463,37sleep00-21swapper/009:55:060
160972463,37sleep00-21swapper/007:36:000
75672452,37sleep30-21swapper/309:31:513
303662452,9sleep30-21swapper/311:31:473
184699453,26cyclictest0-21swapper/308:46:373
183899454,34cyclictest0-21swapper/010:11:320
183899453,36cyclictest0-21swapper/007:21:390
183899453,25cyclictest0-21swapper/011:01:490
1838994522,11cyclictest0-21swapper/012:11:340
182992454,35sleep00-21swapper/007:38:500
96432442,36sleep30-21swapper/310:48:263
96432442,36sleep30-21swapper/310:48:263
183899443,19cyclictest0-21swapper/011:16:490
184699434,33cyclictest0-21swapper/307:25:343
184699433,33cyclictest3224-21gltestperf10:31:433
184699433,32cyclictest21278-21tr07:46:333
183899433,12cyclictest0-21swapper/008:41:450
183899433,12cyclictest0-21swapper/008:41:450
1838994322,10cyclictest0-21swapper/009:46:420
95532422,35sleep00-21swapper/008:27:030
226352422,33sleep30-21swapper/312:26:133
184699423,32cyclictest0-21swapper/309:46:173
8092412,35sleep00-21swapper/009:17:250
184699413,32cyclictest0-21swapper/309:36:553
184699413,13cyclictest0-21swapper/307:51:423
183899414,13cyclictest0-21swapper/011:31:380
184699363,12cyclictest0-21swapper/307:06:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional