You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-05-12 - 14:07

ARMv7 Processor rev 4 (v7l), Linux 4.6.5-rt10-v7 (Profile)

Latency plot of system in rack #b, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot3.osadl.org (updated Wed Mar 31, 2021 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40309914754,28cyclictest42-21ksoftirqd/312:17:333
40289914762,24cyclictest24-21ksoftirqd/110:57:221
4027991443,119cyclictest0-21swapper/011:18:080
40279914152,61cyclictest3-21ksoftirqd/009:05:020
40279914152,61cyclictest3-21ksoftirqd/009:05:020
40279913757,62cyclictest3-21ksoftirqd/010:56:450
40279913654,49cyclictest3-21ksoftirqd/011:55:030
40279913654,49cyclictest3-21ksoftirqd/011:55:030
4030991357,31cyclictest0-21swapper/309:25:033
40289913437,35cyclictest24-21ksoftirqd/109:33:251
40309913350,29cyclictest42-21ksoftirqd/308:23:353
40309913350,29cyclictest42-21ksoftirqd/308:23:353
40279913355,49cyclictest3-21ksoftirqd/010:34:400
1526991330,11rtkit-daemon1525-21rtkit-daemon09:36:481
40309913210,36cyclictest20330-21seq11:49:413
40279913264,38cyclictest3-21ksoftirqd/012:17:390
40289913115,9cyclictest10650irq/39-dwc_otg10:22:421
40279913171,41cyclictest3-21ksoftirqd/007:27:070
40279913163,63cyclictest3-21ksoftirqd/009:43:380
4027991312,82cyclictest81rcu_preempt11:50:020
4030991305,28cyclictest10750irq/39-dwc_otg_09:12:543
40279913058,32cyclictest3-21ksoftirqd/008:35:030
40279913054,54cyclictest3-21ksoftirqd/011:55:110
40309912942,25cyclictest42-21ksoftirqd/312:31:533
4030991292,37cyclictest765-21runrttasks11:32:423
4030991292,37cyclictest765-21runrttasks11:32:423
40279912967,39cyclictest3-21ksoftirqd/012:30:030
40279912864,40cyclictest3-21ksoftirqd/008:50:030
4027991283,25cyclictest0-21swapper/012:05:030
40309912746,24cyclictest42-21ksoftirqd/311:12:073
40309912746,24cyclictest42-21ksoftirqd/311:12:073
4029991273,10cyclictest0-21swapper/210:01:222
40289912737,27cyclictest24-21ksoftirqd/108:24:181
40289912737,27cyclictest24-21ksoftirqd/108:24:181
40279912751,60cyclictest3-21ksoftirqd/010:30:030
40279912751,60cyclictest3-21ksoftirqd/010:30:030
40279912743,70cyclictest3-21ksoftirqd/012:33:330
40279912725,5cyclictest10650irq/39-dwc_otg11:36:430
1526991270,8rtkit-daemon1525-21rtkit-daemon08:11:552
4030991261,8cyclictest0-21swapper/312:25:233
4027991267,43cyclictest3-21ksoftirqd/009:30:020
40279912663,6cyclictest3-21ksoftirqd/009:00:010
40279912654,58cyclictest3-21ksoftirqd/012:15:020
40309912543,26cyclictest42-21ksoftirqd/307:46:013
4030991252,8cyclictest0-21swapper/309:20:033
4030991252,47cyclictest6930-21runrttasks07:35:023
4030991252,47cyclictest6930-21runrttasks07:35:023
4030991251,32cyclictest0-21swapper/310:47:383
4030991251,32cyclictest0-21swapper/310:47:383
40279912560,44cyclictest3-21ksoftirqd/010:45:040
40279912552,8cyclictest3-21ksoftirqd/009:55:120
40279912549,52cyclictest3-21ksoftirqd/007:40:000
40279912525,48cyclictest3-21ksoftirqd/009:20:020
4030991242,33cyclictest0-21swapper/308:58:123
40289912450,28cyclictest24-21ksoftirqd/111:04:051
40279912458,40cyclictest3-21ksoftirqd/007:56:270
40279912454,54cyclictest3-21ksoftirqd/009:37:210
40279912449,59cyclictest3-21ksoftirqd/007:42:350
4027991243,35cyclictest0-21swapper/010:19:510
40289912346,27cyclictest24-21ksoftirqd/110:45:541
40289912346,27cyclictest24-21ksoftirqd/110:45:541
40279912352,44cyclictest3-21ksoftirqd/009:25:040
40309912240,33cyclictest42-21ksoftirqd/307:16:063
4030991223,30cyclictest0-21swapper/311:37:403
40279912263,35cyclictest3-21ksoftirqd/008:37:050
40309912141,38cyclictest42-21ksoftirqd/311:15:453
40309912137,25cyclictest42-21ksoftirqd/312:36:243
40309912137,25cyclictest42-21ksoftirqd/312:36:243
4030991212,46cyclictest29398-21ssh12:11:013
4030991211,42cyclictest29879-21sh10:55:023
4028991216,16cyclictest10650irq/39-dwc_otg10:40:241
40289912144,24cyclictest24-21ksoftirqd/112:14:231
4028991213,13cyclictest0-21swapper/112:07:141
40279912167,35cyclictest3-21ksoftirqd/011:35:020
40279912167,35cyclictest3-21ksoftirqd/011:35:020
40279912163,30cyclictest3-21ksoftirqd/011:11:250
40279912163,30cyclictest3-21ksoftirqd/011:11:250
40279912154,62cyclictest3-21ksoftirqd/007:53:320
4030991203,7cyclictest0-21swapper/310:37:183
4030991201,29cyclictest0-21swapper/309:53:003
40299912051,5cyclictest33-21ksoftirqd/209:23:462
40289912010,44cyclictest4974-21latency_hist12:30:031
40279912052,35cyclictest3-21ksoftirqd/012:25:010
40279912052,35cyclictest3-21ksoftirqd/012:25:010
4030991199,28cyclictest10850irq/39-dwc_otg_10:09:433
4030991199,28cyclictest10850irq/39-dwc_otg_10:09:433
40309911936,28cyclictest42-21ksoftirqd/310:30:503
4030991192,42cyclictest30405-21ssh09:38:393
40299911992,8cyclictest10750irq/39-dwc_otg_10:15:232
40299911954,8cyclictest33-21ksoftirqd/211:55:022
40299911954,8cyclictest33-21ksoftirqd/211:55:022
40279911952,45cyclictest3-21ksoftirqd/011:42:230
40279911952,45cyclictest3-21ksoftirqd/011:42:230
4030991182,9cyclictest0-21swapper/309:33:123
40289911833,28cyclictest24-21ksoftirqd/109:48:471
40289911833,28cyclictest24-21ksoftirqd/109:48:471
40289911831,11cyclictest24-21ksoftirqd/111:14:181
40289911831,11cyclictest24-21ksoftirqd/111:14:181
40279911854,46cyclictest3-21ksoftirqd/012:38:180
40279911854,46cyclictest3-21ksoftirqd/012:38:180
40279911852,48cyclictest3-21ksoftirqd/009:51:030
40279911844,55cyclictest3-21ksoftirqd/010:45:320
40279911844,55cyclictest3-21ksoftirqd/010:45:320
40309911734,24cyclictest42-21ksoftirqd/311:02:413
4030991172,32cyclictest0-21swapper/309:40:123
4029991171,7cyclictest33-21ksoftirqd/211:59:542
40289911749,23cyclictest24-21ksoftirqd/111:16:491
40279911756,42cyclictest3-21ksoftirqd/007:25:030
40279911748,44cyclictest3-21ksoftirqd/011:07:460
40309911649,5cyclictest10750irq/39-dwc_otg_12:23:473
40309911649,5cyclictest10750irq/39-dwc_otg_12:23:473
4030991163,42cyclictest4026-21cyclictest10:29:063
4030991163,42cyclictest4026-21cyclictest10:29:063
40289911644,23cyclictest24-21ksoftirqd/111:55:381
40279911663,49cyclictest3-21ksoftirqd/007:30:230
40279911663,49cyclictest3-21ksoftirqd/007:30:230
40309911542,28cyclictest42-21ksoftirqd/311:53:353
40309911542,28cyclictest42-21ksoftirqd/311:53:353
4030991152,35cyclictest765-21runrttasks09:59:323
40289911537,34cyclictest24-21ksoftirqd/108:53:071
40279911563,35cyclictest3-21ksoftirqd/009:15:030
40279911562,30cyclictest3-21ksoftirqd/008:55:020
40279911556,37cyclictest3-21ksoftirqd/011:25:380
4030991141,31cyclictest18325-21diskmemload09:25:413
40289911415,10cyclictest18325-21diskmemload11:27:551
40279911453,35cyclictest3-21ksoftirqd/010:24:280
4027991142,21cyclictest0-21swapper/010:51:000
1526991140,5rtkit-daemon1525-21rtkit-daemon12:00:591
1526991140,53rtkit-daemon1525-21rtkit-daemon10:02:181
4030991132,45cyclictest31799-21diskmemload10:59:443
4030991132,28cyclictest0-21swapper/311:59:403
4030991131,5cyclictest0-21swapper/310:02:243
40289911332,23cyclictest24-21ksoftirqd/109:56:481
40279911364,30cyclictest3-21ksoftirqd/008:00:570
40279911353,32cyclictest3-21ksoftirqd/009:06:110
4030991121,43cyclictest10850irq/39-dwc_otg_11:22:353
40289911241,28cyclictest24-21ksoftirqd/108:19:221
40279911262,28cyclictest3-21ksoftirqd/008:45:020
4030991113,5cyclictest10850irq/39-dwc_otg_11:05:363
4030991112,35cyclictest0-21swapper/308:20:033
40289911149,22cyclictest24-21ksoftirqd/109:11:001
40289911123,26cyclictest24-21ksoftirqd/109:16:551
40279911163,35cyclictest3-21ksoftirqd/010:06:140
40279911163,35cyclictest3-21ksoftirqd/010:06:140
40279911157,27cyclictest3-21ksoftirqd/007:12:240
40279911157,27cyclictest3-21ksoftirqd/007:12:240
40279911155,37cyclictest3-21ksoftirqd/010:01:540
40279911152,43cyclictest3-21ksoftirqd/008:29:480
40279911150,40cyclictest3-21ksoftirqd/009:35:040
40279911147,39cyclictest3-21ksoftirqd/010:12:010
4030991106,34cyclictest10850irq/39-dwc_otg_12:06:413
40309911033,30cyclictest42-21ksoftirqd/307:28:593
40299911047,6cyclictest33-21ksoftirqd/211:07:532
4028991107,15cyclictest10650irq/39-dwc_otg09:30:041
40289911043,30cyclictest24-21ksoftirqd/112:19:291
4028991104,17cyclictest0-21swapper/109:43:211
40289911020,7cyclictest24-21ksoftirqd/108:12:141
40279911073,24cyclictest3-21ksoftirqd/010:39:390
40279911057,23cyclictest3-21ksoftirqd/009:46:420
40279911057,23cyclictest3-21ksoftirqd/009:46:420
40279911051,29cyclictest3-21ksoftirqd/007:50:030
40279911051,27cyclictest3-21ksoftirqd/012:07:230
4030991092,38cyclictest18325-21diskmemload09:49:183
4030991092,38cyclictest18325-21diskmemload09:49:183
4030991092,10cyclictest18048-21runrttasks11:44:103
4030991092,10cyclictest18048-21runrttasks11:44:103
40289910954,25cyclictest24-21ksoftirqd/111:36:161
40279910952,8cyclictest3-21ksoftirqd/007:20:020
4030991082,33cyclictest0-21swapper/310:11:303
40309910821,30cyclictest42-21ksoftirqd/311:26:173
40299910848,10cyclictest33-21ksoftirqd/211:14:242
40299910848,10cyclictest33-21ksoftirqd/211:14:242
4029991082,4cyclictest0-21swapper/207:20:142
40289910852,24cyclictest24-21ksoftirqd/108:30:531
40279910889,4cyclictest10650irq/39-dwc_otg11:05:030
40279910836,57cyclictest3-21ksoftirqd/011:23:330
1526991080,59rtkit-daemon1525-21rtkit-daemon11:50:511
1526991080,59rtkit-daemon1525-21rtkit-daemon11:50:511
40309910740,28cyclictest42-21ksoftirqd/307:14:553
40309910740,28cyclictest42-21ksoftirqd/307:14:553
4030991072,36cyclictest13501-21runrttasks08:30:013
40289910740,12cyclictest24-21ksoftirqd/109:24:291
40289910732,12cyclictest24-21ksoftirqd/110:18:231
40279910731,62cyclictest3-21ksoftirqd/008:22:280
40279910731,62cyclictest3-21ksoftirqd/008:22:280
4030991062,34cyclictest8096-21latency_hist07:45:023
40309910623,26cyclictest42-21ksoftirqd/308:37:583
4030991062,29cyclictest0-21swapper/310:42:073
4030991061,42cyclictest14515-21rm10:18:063
40299910646,5cyclictest10650irq/39-dwc_otg08:04:332
40289910639,28cyclictest24-21ksoftirqd/107:11:121
40289910639,28cyclictest24-21ksoftirqd/107:11:121
4030991053,39cyclictest16798-21ssh10:23:353
40289910547,21cyclictest24-21ksoftirqd/109:50:151
1526991050,49rtkit-daemon1525-21rtkit-daemon11:20:261
4030991045,25cyclictest0-21swapper/312:02:043
4030991043,5cyclictest10650irq/39-dwc_otg08:44:113
40299910440,9cyclictest33-21ksoftirqd/208:51:572
40279910451,9cyclictest3-21ksoftirqd/008:15:020
4030991031,6cyclictest0-21swapper/308:34:073
4029991038,6cyclictest33-21ksoftirqd/210:30:032
4029991038,6cyclictest33-21ksoftirqd/210:30:032
4028991033,18cyclictest0-21swapper/111:47:591
4028991031,11cyclictest81rcu_preempt10:10:431
4030991022,28cyclictest0-21swapper/308:05:023
40309910219,28cyclictest42-21ksoftirqd/308:53:573
40289910224,6cyclictest24-21ksoftirqd/107:21:421
40309910153,30cyclictest42-21ksoftirqd/307:21:083
4030991013,29cyclictest0-21swapper/309:09:143
40299910135,11cyclictest33-21ksoftirqd/212:15:142
40289910160,24cyclictest24-21ksoftirqd/108:29:201
40299910035,8cyclictest33-21ksoftirqd/210:50:362
40299910027,13cyclictest33-21ksoftirqd/212:40:012
40299910027,13cyclictest33-21ksoftirqd/212:40:012
40289910052,23cyclictest24-21ksoftirqd/112:23:161
40289910052,23cyclictest24-21ksoftirqd/112:23:161
4028991003,12cyclictest0-21swapper/111:34:431
4028991003,12cyclictest0-21swapper/111:34:431
40289910011,7cyclictest19546-21latency_hist10:30:031
40289910011,7cyclictest19546-21latency_hist10:30:031
40279910046,29cyclictest3-21ksoftirqd/008:18:100
403099995,28cyclictest10750irq/39-dwc_otg_08:45:513
403099992,33cyclictest0-21swapper/308:14:253
4029999982,5cyclictest10750irq/39-dwc_otg_08:31:472
4028999933,7cyclictest24-21ksoftirqd/110:38:351
4029999865,9cyclictest33-21ksoftirqd/212:13:482
4029999852,5cyclictest33-21ksoftirqd/209:00:142
4029999852,5cyclictest33-21ksoftirqd/209:00:142
4028999650,33cyclictest24-21ksoftirqd/110:52:561
402899963,10cyclictest0-21swapper/107:19:181
4028999630,25cyclictest24-21ksoftirqd/107:59:511
4029999562,8cyclictest33-21ksoftirqd/211:50:022
4029999526,8cyclictest33-21ksoftirqd/210:35:032
4029999454,6cyclictest33-21ksoftirqd/210:12:112
402999942,18cyclictest765-21runrttasks12:02:242
4029999412,11cyclictest33-21ksoftirqd/210:22:022
4029999411,8cyclictest33-21ksoftirqd/207:55:032
403099934,5cyclictest10650irq/39-dwc_otg07:58:313
4029999374,6cyclictest10650irq/39-dwc_otg11:32:532
4029999374,6cyclictest10650irq/39-dwc_otg11:32:532
4029999359,6cyclictest33-21ksoftirqd/210:59:132
4029999358,8cyclictest33-21ksoftirqd/211:38:042
4029999330,9cyclictest33-21ksoftirqd/208:50:022
4029999232,5cyclictest10850irq/39-dwc_otg_10:44:452
4028999262,25cyclictest24-21ksoftirqd/110:07:571
4028999262,25cyclictest24-21ksoftirqd/110:07:571
403099913,32cyclictest0-21swapper/308:08:593
402999912,6cyclictest7933-21munin-run11:20:012
4028999153,27cyclictest24-21ksoftirqd/108:35:291
4028999152,29cyclictest24-21ksoftirqd/108:56:301
4030999052,22cyclictest42-21ksoftirqd/307:54:553
4029999066,9cyclictest33-21ksoftirqd/212:31:282
402899905,15cyclictest0-21swapper/107:51:121
4028999042,27cyclictest24-21ksoftirqd/112:31:501
4029998950,10cyclictest33-21ksoftirqd/211:25:042
402999893,19cyclictest0-21swapper/209:56:462
402899897,19cyclictest10650irq/39-dwc_otg07:50:011
402899886,4cyclictest0-21swapper/111:44:001
402899886,4cyclictest0-21swapper/111:44:001
4028998841,24cyclictest24-21ksoftirqd/107:27:441
402799881,26cyclictest10979-21runrttasks08:08:510
4029998735,5cyclictest10750irq/39-dwc_otg_09:25:082
4029998714,6cyclictest10750irq/39-dwc_otg_11:41:582
4029998714,6cyclictest10750irq/39-dwc_otg_11:41:582
402899872,5cyclictest0-21swapper/111:05:341
402899871,4cyclictest10650irq/39-dwc_otg08:42:171
4028998630,35cyclictest24-21ksoftirqd/107:44:221
4028998622,55cyclictest10650irq/39-dwc_otg09:03:031
4028998622,55cyclictest10650irq/39-dwc_otg09:03:031
402899862,15cyclictest0-21swapper/112:39:091
402899862,15cyclictest0-21swapper/112:39:091
4029998530,4cyclictest10750irq/39-dwc_otg_09:45:182
4029998530,4cyclictest10750irq/39-dwc_otg_09:45:182
402899856,7cyclictest24-21ksoftirqd/110:32:281
4030998449,21cyclictest42-21ksoftirqd/309:01:333
4030998449,21cyclictest42-21ksoftirqd/309:01:333
4030998446,27cyclictest42-21ksoftirqd/307:37:583
4029998463,6cyclictest33-21ksoftirqd/212:30:002
4029998457,7cyclictest33-21ksoftirqd/209:55:032
402999842,7cyclictest0-21swapper/209:38:482
4029998355,7cyclictest33-21ksoftirqd/207:35:022
4029998355,7cyclictest33-21ksoftirqd/207:35:022
4029998353,5cyclictest33-21ksoftirqd/210:45:412
4029998353,5cyclictest33-21ksoftirqd/210:45:412
4029998312,5cyclictest10850irq/39-dwc_otg_07:28:552
4029998310,10cyclictest33-21ksoftirqd/208:45:032
402999827,8cyclictest33-21ksoftirqd/210:40:022
4029998261,8cyclictest33-21ksoftirqd/209:11:452
4029998244,5cyclictest33-21ksoftirqd/209:42:502
4029998242,5cyclictest10650irq/39-dwc_otg11:22:542
402899822,9cyclictest24-21ksoftirqd/107:37:471
4029998167,7cyclictest10650irq/39-dwc_otg12:05:512
4029998160,8cyclictest33-21ksoftirqd/209:05:072
4029998155,6cyclictest10850irq/39-dwc_otg_09:32:332
402999812,17cyclictest0-21swapper/210:09:422
402999812,17cyclictest0-21swapper/210:09:422
4029998110,13cyclictest10650irq/39-dwc_otg11:01:532
4028998110,9cyclictest81rcu_preempt07:33:291
4028998110,9cyclictest81rcu_preempt07:33:291
4029998051,10cyclictest33-21ksoftirqd/212:20:292
4029998051,10cyclictest33-21ksoftirqd/212:20:292
4028998030,37cyclictest24-21ksoftirqd/108:01:191
402999795,7cyclictest33-21ksoftirqd/207:20:022
4029997952,7cyclictest33-21ksoftirqd/209:17:392
152699790,31rtkit-daemon765-21runrttasks07:06:153
402999788,11cyclictest81rcu_preempt08:30:022
4029997860,6cyclictest33-21ksoftirqd/208:09:002
402999785,5cyclictest10650irq/39-dwc_otg07:47:172
4029997855,10cyclictest33-21ksoftirqd/207:40:002
402999782,4cyclictest0-21swapper/208:20:152
402999782,4cyclictest0-21swapper/208:20:152
4029997758,7cyclictest33-21ksoftirqd/208:18:252
402999771,9cyclictest81rcu_preempt09:00:022
402999762,16cyclictest9985-21latency_hist08:00:022
4028997651,7cyclictest24-21ksoftirqd/108:49:241
4029997555,7cyclictest33-21ksoftirqd/208:35:302
402999749,9cyclictest33-21ksoftirqd/207:43:152
4029997347,6cyclictest33-21ksoftirqd/207:14:272
4029997347,6cyclictest33-21ksoftirqd/207:14:272
402899733,14cyclictest10650irq/39-dwc_otg09:05:451
402899671,4cyclictest10850irq/39-dwc_otg_08:07:331
152699470,5rtkit-daemon1525-21rtkit-daemon07:05:371
36802411,9sleep00-21swapper/007:08:530
37042392,6sleep20-21swapper/207:09:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional