You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-17 - 21:41

ARMv7 Processor rev 4 (v7l), Linux 4.6.5-rt10-v7 (Profile)

Latency plot of system in rack #b, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot3.osadl.org (updated Thu Sep 30, 2021 12:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20367991844,114cyclictest28462-21ssh10:15:550
203679917635,42cyclictest3-21ksoftirqd/012:04:540
203679917355,47cyclictest3-21ksoftirqd/009:14:270
203679917350,117cyclictest3-21ksoftirqd/012:05:080
203679916836,74cyclictest3-21ksoftirqd/012:12:420
203679916836,74cyclictest3-21ksoftirqd/012:12:420
20370991672,71cyclictest0-21swapper/212:08:402
203679916731,98cyclictest3-21ksoftirqd/011:08:330
203679916682,4cyclictest0-21swapper/012:39:560
203679916629,81cyclictest3-21ksoftirqd/007:47:480
203679916553,32cyclictest3-21ksoftirqd/008:01:350
203679916553,32cyclictest3-21ksoftirqd/008:01:350
203679916419,75cyclictest3-21ksoftirqd/009:53:150
203709916348,10cyclictest33-21ksoftirqd/208:28:082
2036799163106,9cyclictest0-21swapper/010:54:040
2036799163106,9cyclictest0-21swapper/010:54:040
20367991626,68cyclictest3-21ksoftirqd/011:16:160
203679916246,96cyclictest3-21ksoftirqd/011:11:230
203679916246,96cyclictest3-21ksoftirqd/011:11:230
203709916155,7cyclictest33-21ksoftirqd/211:19:572
203689916145,7cyclictest24-21ksoftirqd/107:57:511
203679916123,46cyclictest3-21ksoftirqd/010:31:370
203679916123,46cyclictest3-21ksoftirqd/010:31:370
203679915937,29cyclictest3-21ksoftirqd/011:47:120
203679915937,29cyclictest3-21ksoftirqd/011:47:120
20367991587,137cyclictest13686-21cron09:40:000
203679915848,31cyclictest3-21ksoftirqd/010:26:460
203679915839,92cyclictest3-21ksoftirqd/010:00:280
203679915834,25cyclictest3-21ksoftirqd/007:13:210
203679915834,25cyclictest3-21ksoftirqd/007:13:210
203679915826,105cyclictest3-21ksoftirqd/010:40:030
203679915826,105cyclictest3-21ksoftirqd/010:40:030
2036799158133,8cyclictest81rcu_preempt12:20:310
203679915732,70cyclictest3-21ksoftirqd/009:47:110
203679915732,70cyclictest3-21ksoftirqd/009:47:110
203679915643,93cyclictest3-21ksoftirqd/009:40:550
20367991562,101cyclictest81rcu_preempt11:50:570
203679915536,32cyclictest3-21ksoftirqd/009:59:590
20367991551,88cyclictest81rcu_preempt09:27:080
20372991541,29cyclictest8674-21ssh10:46:533
20367991546,65cyclictest81rcu_preempt09:34:230
20367991546,65cyclictest81rcu_preempt09:34:230
20370991526,8cyclictest33-21ksoftirqd/212:02:272
203709915231,6cyclictest33-21ksoftirqd/210:55:592
203729915137,21cyclictest42-21ksoftirqd/310:32:353
203729915137,21cyclictest42-21ksoftirqd/310:32:353
203679915168,15cyclictest17445-21ssh12:28:260
203679915137,50cyclictest3-21ksoftirqd/011:43:040
203679915137,50cyclictest3-21ksoftirqd/011:43:040
203679915125,31cyclictest3-21ksoftirqd/011:38:410
203679915036,9cyclictest3-21ksoftirqd/012:17:380
203679915036,9cyclictest3-21ksoftirqd/012:17:380
203679915032,29cyclictest3-21ksoftirqd/008:00:020
203689914844,10cyclictest24-21ksoftirqd/110:11:471
2036799148116,15cyclictest0-21swapper/009:21:310
203679914749,59cyclictest3-21ksoftirqd/008:48:320
203679914733,70cyclictest3-21ksoftirqd/008:24:000
203689914646,7cyclictest24-21ksoftirqd/109:44:141
203679914636,94cyclictest3-21ksoftirqd/007:19:560
20372991442,32cyclictest16369-21ssh11:05:553
203689914450,11cyclictest24-21ksoftirqd/107:18:111
203679914434,83cyclictest3-21ksoftirqd/010:45:580
20370991432,49cyclictest0-21swapper/209:19:082
20367991431,8cyclictest81rcu_preempt10:13:440
203689914259,8cyclictest24-21ksoftirqd/112:30:031
203689914251,7cyclictest24-21ksoftirqd/111:49:511
203689914251,7cyclictest24-21ksoftirqd/111:49:511
203709914134,6cyclictest33-21ksoftirqd/209:49:442
203709914134,6cyclictest33-21ksoftirqd/209:49:442
203689914165,8cyclictest24-21ksoftirqd/109:15:021
2036899141126,5cyclictest10750irq/39-dwc_otg_09:55:161
20372991401,28cyclictest20855-21latency_hist07:15:023
20372991401,28cyclictest20855-21latency_hist07:15:023
203679914043,79cyclictest3-21ksoftirqd/010:42:120
203689913978,5cyclictest10850irq/39-dwc_otg_09:55:011
203689913930,6cyclictest24-21ksoftirqd/112:09:341
203679913943,33cyclictest3-21ksoftirqd/008:06:520
203679913934,90cyclictest3-21ksoftirqd/010:56:410
20367991382,16cyclictest0-21swapper/008:40:020
20367991382,16cyclictest0-21swapper/008:40:020
203709913746,12cyclictest33-21ksoftirqd/210:06:182
203709913746,12cyclictest33-21ksoftirqd/210:06:182
203689913727,6cyclictest24-21ksoftirqd/108:11:521
203689913727,6cyclictest24-21ksoftirqd/108:11:521
203679913763,53cyclictest3-21ksoftirqd/007:39:230
203679913761,59cyclictest3-21ksoftirqd/009:05:300
203679913753,68cyclictest3-21ksoftirqd/011:20:210
203679913724,14cyclictest0-21swapper/008:16:040
20372991362,5cyclictest0-21swapper/312:14:583
20372991362,5cyclictest0-21swapper/312:14:583
203689913657,8cyclictest24-21ksoftirqd/112:14:451
203689913657,8cyclictest24-21ksoftirqd/112:14:451
20367991365,109cyclictest3-21ksoftirqd/008:30:030
203709913527,6cyclictest33-21ksoftirqd/211:32:212
20370991352,64cyclictest0-21swapper/212:38:112
203679913543,7cyclictest31156-21sh10:22:380
20367991352,80cyclictest0-21swapper/011:55:250
203679913524,86cyclictest3-21ksoftirqd/012:31:490
203689913467,5cyclictest10650irq/39-dwc_otg12:02:561
203679913450,53cyclictest3-21ksoftirqd/011:02:400
203679913344,68cyclictest3-21ksoftirqd/008:55:000
203679913344,68cyclictest3-21ksoftirqd/008:55:000
203679913337,71cyclictest3-21ksoftirqd/009:20:030
203709913227,6cyclictest33-21ksoftirqd/211:10:352
203709913227,6cyclictest33-21ksoftirqd/211:10:352
203689913244,6cyclictest24-21ksoftirqd/110:02:051
203689913236,9cyclictest24-21ksoftirqd/110:06:591
203689913236,9cyclictest24-21ksoftirqd/110:06:591
203689913224,6cyclictest24-21ksoftirqd/111:15:251
203689913211,10cyclictest24-21ksoftirqd/109:22:211
203679913242,75cyclictest3-21ksoftirqd/011:31:130
203689913159,9cyclictest24-21ksoftirqd/110:30:541
203689913159,9cyclictest24-21ksoftirqd/110:30:541
20367991313,111cyclictest0-21swapper/007:50:340
20372991301,36cyclictest3201-21ssh09:12:063
20370991302,12cyclictest0-21swapper/210:33:332
20370991302,12cyclictest0-21swapper/210:33:332
203689913061,6cyclictest24-21ksoftirqd/111:30:021
203689913061,6cyclictest24-21ksoftirqd/111:30:021
203679913050,10cyclictest3-21ksoftirqd/008:32:130
203679913044,9cyclictest3-21ksoftirqd/008:44:420
2036799130100,5cyclictest81rcu_preempt08:55:150
20372991292,5cyclictest0-21swapper/310:12:093
203689912953,9cyclictest24-21ksoftirqd/108:01:041
203689912953,9cyclictest24-21ksoftirqd/108:01:041
203689912939,9cyclictest24-21ksoftirqd/111:53:191
203679912959,52cyclictest3-21ksoftirqd/009:05:020
203679912959,52cyclictest3-21ksoftirqd/009:05:020
203689912858,7cyclictest24-21ksoftirqd/109:27:261
203689912852,6cyclictest24-21ksoftirqd/111:00:031
2036799128107,7cyclictest41ktimersoftd/011:25:470
2036799128107,7cyclictest41ktimersoftd/011:25:470
20372991273,32cyclictest0-21swapper/312:06:463
20372991272,25cyclictest0-21swapper/308:53:453
20372991272,25cyclictest0-21swapper/308:53:453
203709912750,12cyclictest33-21ksoftirqd/211:01:462
203709912730,7cyclictest33-21ksoftirqd/208:10:032
203709912730,7cyclictest33-21ksoftirqd/208:10:032
203689912761,8cyclictest24-21ksoftirqd/108:18:491
203689912751,9cyclictest24-21ksoftirqd/110:20:021
203689912745,7cyclictest24-21ksoftirqd/111:58:301
203689912745,6cyclictest24-21ksoftirqd/109:15:091
20367991277,104cyclictest0-21swapper/007:34:160
20372991261,38cyclictest7465-21sh10:44:093
20370991266,7cyclictest0-21swapper/208:34:382
203689912659,10cyclictest24-21ksoftirqd/110:57:221
203689912655,6cyclictest24-21ksoftirqd/111:42:481
203689912655,6cyclictest24-21ksoftirqd/111:42:481
203689912643,9cyclictest24-21ksoftirqd/110:45:021
203689912612,7cyclictest24-21ksoftirqd/109:49:411
203689912612,7cyclictest24-21ksoftirqd/109:49:411
203679912652,55cyclictest3-21ksoftirqd/007:25:030
20367991263,101cyclictest3-21ksoftirqd/008:15:010
20367991263,101cyclictest3-21ksoftirqd/008:15:010
20367991262,6cyclictest0-21swapper/007:41:330
2036799126102,8cyclictest3-21ksoftirqd/010:09:050
2036799126102,8cyclictest3-21ksoftirqd/010:09:050
20372991253,30cyclictest0-21swapper/312:34:163
203709912550,10cyclictest33-21ksoftirqd/210:35:242
203709912550,10cyclictest33-21ksoftirqd/210:35:242
20370991253,7cyclictest81rcu_preempt11:39:352
20370991252,8cyclictest0-21swapper/210:20:012
20370991252,17cyclictest0-21swapper/211:29:422
20370991252,17cyclictest0-21swapper/211:29:422
20368991257,5cyclictest27478-21latency_hist08:10:011
203689912546,6cyclictest24-21ksoftirqd/110:49:311
203679912556,54cyclictest3-21ksoftirqd/007:29:230
20370991242,67cyclictest0-21swapper/208:19:472
20370991242,58cyclictest0-21swapper/210:21:002
20370991242,14cyclictest0-21swapper/209:10:552
203689912450,9cyclictest24-21ksoftirqd/111:09:231
203689912436,10cyclictest24-21ksoftirqd/110:23:551
203709912352,9cyclictest33-21ksoftirqd/212:28:472
20368991238,6cyclictest1021-21cat09:00:001
203689912340,14cyclictest24-21ksoftirqd/112:38:111
20372991223,31cyclictest0-21swapper/308:05:043
203709912226,6cyclictest33-21ksoftirqd/209:55:032
203709912225,9cyclictest33-21ksoftirqd/208:37:592
203709912225,9cyclictest33-21ksoftirqd/208:37:592
203689912254,7cyclictest24-21ksoftirqd/111:10:331
203689912254,7cyclictest24-21ksoftirqd/111:10:331
203689912251,10cyclictest24-21ksoftirqd/111:23:151
203689912249,10cyclictest24-21ksoftirqd/112:21:331
203689912243,13cyclictest24-21ksoftirqd/108:50:031
203689912225,8cyclictest24-21ksoftirqd/109:31:001
203689912225,8cyclictest24-21ksoftirqd/109:31:001
20370991212,60cyclictest0-21swapper/209:36:212
20370991212,14cyclictest0-21swapper/212:21:262
203689912162,5cyclictest10750irq/39-dwc_otg_11:39:051
203689912136,8cyclictest24-21ksoftirqd/107:43:181
203689912136,18cyclictest24-21ksoftirqd/110:50:191
203689912136,18cyclictest24-21ksoftirqd/110:50:191
20372991202,37cyclictest0-21swapper/309:33:293
20372991202,37cyclictest0-21swapper/309:33:293
203709912052,12cyclictest33-21ksoftirqd/212:19:382
203709912052,12cyclictest33-21ksoftirqd/212:19:382
203709912027,7cyclictest33-21ksoftirqd/209:59:592
203689912050,11cyclictest24-21ksoftirqd/109:36:021
203689912042,11cyclictest24-21ksoftirqd/111:32:271
20372991197,43cyclictest32165-21latency_hist10:25:033
20372991192,48cyclictest0-21swapper/309:37:173
20372991192,38cyclictest0-21swapper/309:44:443
20372991191,40cyclictest13041-21sh12:17:343
20372991191,40cyclictest13041-21sh12:17:343
203689911932,9cyclictest24-21ksoftirqd/108:25:501
20372991182,40cyclictest32367-21ssh10:25:233
20372991182,38cyclictest0-21swapper/312:21:033
20372991181,7cyclictest0-21swapper/308:47:123
20372991181,6cyclictest22747-21ssh11:21:413
203729911815,34cyclictest2289-21diskmemload11:25:423
203729911815,34cyclictest2289-21diskmemload11:25:423
20370991187,9cyclictest25652-21latency_hist07:55:012
203709911870,5cyclictest10750irq/39-dwc_otg_09:00:022
203709911839,6cyclictest33-21ksoftirqd/209:41:132
203709911824,6cyclictest33-21ksoftirqd/208:09:552
203689911843,9cyclictest24-21ksoftirqd/110:26:351
203709911757,8cyclictest33-21ksoftirqd/211:07:292
203709911751,11cyclictest33-21ksoftirqd/211:46:342
203709911751,11cyclictest33-21ksoftirqd/211:46:342
203709911749,10cyclictest33-21ksoftirqd/208:24:262
203709911747,7cyclictest33-21ksoftirqd/211:56:212
20370991172,9cyclictest0-21swapper/211:40:392
20370991172,9cyclictest0-21swapper/211:40:392
203689911751,10cyclictest24-21ksoftirqd/112:30:591
203709911629,6cyclictest33-21ksoftirqd/210:05:032
203709911629,6cyclictest33-21ksoftirqd/209:23:242
203689911646,6cyclictest24-21ksoftirqd/107:39:411
203689911641,11cyclictest24-21ksoftirqd/112:16:041
203689911641,11cyclictest24-21ksoftirqd/112:16:041
203729911537,26cyclictest42-21ksoftirqd/309:17:463
20372991153,34cyclictest0-21swapper/311:00:023
20372991152,32cyclictest81rcu_preempt11:17:023
203709911550,7cyclictest33-21ksoftirqd/211:52:512
203689911543,7cyclictest24-21ksoftirqd/110:38:501
203689911543,7cyclictest24-21ksoftirqd/110:38:501
203729911428,20cyclictest42-21ksoftirqd/311:02:333
20372991141,4cyclictest0-21swapper/311:59:393
203709911452,9cyclictest33-21ksoftirqd/209:30:202
203709911452,9cyclictest33-21ksoftirqd/209:30:202
203709911434,6cyclictest33-21ksoftirqd/209:10:012
20370991142,5cyclictest0-21swapper/207:44:062
20372991132,6cyclictest0-21swapper/307:50:023
20372991132,41cyclictest22094-21apt-get12:40:013
203709911347,6cyclictest33-21ksoftirqd/209:27:112
203709911347,5cyclictest33-21ksoftirqd/210:26:212
203709911345,6cyclictest33-21ksoftirqd/208:42:012
203709911324,6cyclictest33-21ksoftirqd/212:10:082
203709911324,6cyclictest33-21ksoftirqd/212:10:082
203709911322,6cyclictest33-21ksoftirqd/212:30:402
203689911343,10cyclictest24-21ksoftirqd/109:10:011
203689911320,7cyclictest24-21ksoftirqd/107:13:341
203689911320,7cyclictest24-21ksoftirqd/107:13:341
203729911227,28cyclictest42-21ksoftirqd/309:05:473
203709911250,6cyclictest33-21ksoftirqd/207:11:032
203709911250,6cyclictest33-21ksoftirqd/207:11:032
203689911248,7cyclictest24-21ksoftirqd/108:21:291
203689911228,5cyclictest24-21ksoftirqd/107:54:191
203709911155,7cyclictest33-21ksoftirqd/207:36:292
203709911145,7cyclictest33-21ksoftirqd/209:00:382
203709911145,7cyclictest33-21ksoftirqd/209:00:382
203709911140,9cyclictest33-21ksoftirqd/210:41:022
203689911148,8cyclictest24-21ksoftirqd/107:46:101
203689911047,6cyclictest24-21ksoftirqd/107:34:401
20372991099,36cyclictest42-21ksoftirqd/308:57:243
203729910955,35cyclictest42-21ksoftirqd/311:50:043
20372991094,33cyclictest10850irq/39-dwc_otg_11:13:453
20372991094,33cyclictest10850irq/39-dwc_otg_11:13:453
20372991093,39cyclictest0-21swapper/312:29:453
203709910951,7cyclictest33-21ksoftirqd/207:27:052
203709910941,9cyclictest33-21ksoftirqd/210:13:062
20372991088,39cyclictest23942-21ssh10:05:013
20372991086,38cyclictest8493-21rm09:25:403
203729910836,30cyclictest42-21ksoftirqd/307:34:043
20372991082,8cyclictest0-21swapper/307:50:133
20372991082,42cyclictest0-21swapper/309:50:013
20372991082,42cyclictest0-21swapper/309:50:013
20372991081,5cyclictest0-21swapper/309:56:563
20372991081,41cyclictest26828-21latency_hist08:05:013
20372991081,41cyclictest26828-21latency_hist08:05:013
20370991084,7cyclictest33-21ksoftirqd/207:55:352
203709910846,6cyclictest33-21ksoftirqd/208:00:372
203709910846,6cyclictest33-21ksoftirqd/208:00:372
203689910847,10cyclictest24-21ksoftirqd/108:44:471
203689910846,6cyclictest24-21ksoftirqd/107:23:511
203689910834,6cyclictest24-21ksoftirqd/108:35:001
20368991083,36cyclictest10850irq/39-dwc_otg_08:37:521
20368991083,36cyclictest10850irq/39-dwc_otg_08:37:521
203689910833,11cyclictest24-21ksoftirqd/108:54:371
203689910833,11cyclictest24-21ksoftirqd/108:54:371
203729910747,20cyclictest42-21ksoftirqd/312:01:283
203729910743,11cyclictest42-21ksoftirqd/310:51:043
203729910743,11cyclictest42-21ksoftirqd/310:51:043
20372991073,30cyclictest10650irq/39-dwc_otg09:51:053
203709910751,11cyclictest33-21ksoftirqd/207:33:172
203689910736,6cyclictest24-21ksoftirqd/109:01:491
203689910736,6cyclictest24-21ksoftirqd/109:01:491
20372991062,36cyclictest0-21swapper/311:50:013
20372991062,36cyclictest0-21swapper/311:50:013
20370991061,50cyclictest0-21swapper/207:45:492
203729910513,33cyclictest31663-21latency_hist08:45:013
203709910552,6cyclictest33-21ksoftirqd/210:47:302
203709910551,16cyclictest33-21ksoftirqd/211:24:102
203689910537,6cyclictest24-21ksoftirqd/107:29:371
20372991041,33cyclictest1278-21runrttasks09:00:213
20372991041,33cyclictest1278-21runrttasks09:00:213
20372991037,40cyclictest42-21ksoftirqd/307:45:003
20372991034,42cyclictest1350-21lxpanel08:21:193
20372991032,37cyclictest10850irq/39-dwc_otg_07:20:003
203729910034,8cyclictest10850irq/39-dwc_otg_11:35:523
20372991002,6cyclictest0-21swapper/310:37:433
20372991002,6cyclictest0-21swapper/310:37:433
203729910018,24cyclictest42-21ksoftirqd/311:31:373
203709910034,5cyclictest33-21ksoftirqd/208:49:152
20372999850,29cyclictest42-21ksoftirqd/308:39:343
20372999850,29cyclictest42-21ksoftirqd/308:39:343
20370999760,21cyclictest33-21ksoftirqd/207:25:022
2037299961,26cyclictest0-21swapper/310:09:033
2037299961,26cyclictest0-21swapper/310:09:033
2037299956,25cyclictest10850irq/39-dwc_otg_07:20:353
20372999557,25cyclictest42-21ksoftirqd/308:18:353
2037299942,30cyclictest10850irq/39-dwc_otg_07:39:513
20372999116,26cyclictest42-21ksoftirqd/307:29:503
2037099916,5cyclictest10750irq/39-dwc_otg_08:53:292
2037099916,5cyclictest10750irq/39-dwc_otg_08:53:292
20370999154,7cyclictest33-21ksoftirqd/210:51:212
20370999154,7cyclictest33-21ksoftirqd/210:51:212
20372999049,30cyclictest42-21ksoftirqd/308:34:253
2037299901,8cyclictest0-21swapper/311:41:263
2037299901,8cyclictest0-21swapper/311:41:263
2037299887,28cyclictest10750irq/39-dwc_otg_09:24:513
2037299882,34cyclictest0-21swapper/308:12:533
2037299882,34cyclictest0-21swapper/308:12:533
2037299881,33cyclictest0-21swapper/310:15:343
20370998853,7cyclictest33-21ksoftirqd/207:15:502
20372998353,25cyclictest42-21ksoftirqd/308:25:593
20372997448,7cyclictest42-21ksoftirqd/307:55:403
197262401,7sleep20-21swapper/207:05:152
199452375,8sleep00-21swapper/007:08:080
197742242,16sleep30-21swapper/307:05:533
144299210,3rtkit-daemon24-21ksoftirqd/107:07:061
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional