You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2019-06-16 - 07:32

ARMv7 Processor rev 4 (v7l), Linux 4.6.5-rt10-v7 (Profile)

Latency plot of system in rack #b, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
The worst-case latency is NOT higher under extreme CPU load.
Results of all systems under extreme CPU load are combined on this summary graph.
The worst-case latency is NOT higher under graphics load.
Results of all systems with accelerated graphics are combined on this summary graph.
Characteristics of the highest latencies:
System rackbslot3.osadl.org (updated Sun Jun 16, 2019 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
176279915254,6cyclictest0-21swapper/020:00:030
176279915254,6cyclictest0-21swapper/020:00:030
17627991521,25cyclictest5226-21timerwakeupswit20:10:320
17627991485,63cyclictest11538-21ntp_kernel_pll_22:50:280
17627991461,68cyclictest0-21swapper/000:00:110
176279914215,70cyclictest3190-21ssh21:45:030
17627991351,81cyclictest21084-21ssh23:05:220
176279913517,68cyclictest19616-21cut21:15:020
176279913412,54cyclictest0-21swapper/023:20:220
17627991332,9cyclictest24737-21timerandwakeup22:20:440
17627991322,5cyclictest0-21swapper/022:10:280
176299912810,10cyclictest29963-21apt-get22:30:032
17627991281,6cyclictest27537-21ssh00:05:110
17627991281,6cyclictest24639-21ntp_states23:10:300
17627991271,78cyclictest14534-21interrupts22:55:220
17627991261,79cyclictest15998-21ssh00:35:350
17627991261,79cyclictest15998-21ssh00:35:350
176279912613,107cyclictest27180-21egrep19:40:100
176279912613,107cyclictest27180-21egrep19:40:100
17627991252,99cyclictest0-21swapper/022:45:030
17627991242,8cyclictest23336-21apt-get22:20:040
17627991242,8cyclictest23336-21apt-get22:20:040
17627991242,6cyclictest31075-21ssh22:30:340
17627991236,4cyclictest0-21swapper/019:35:100
17627991221,6cyclictest18641-21sed23:00:390
17627991221,6cyclictest18641-21sed23:00:390
17627991221,10cyclictest14397-21latency_hist21:00:020
17627991221,10cyclictest14397-21latency_hist21:00:020
17627991213,6cyclictest10850irq/39-dwc_otg_22:35:240
17627991213,6cyclictest10850irq/39-dwc_otg_22:35:240
17627991211,7cyclictest8321-21ntp_states22:45:290
17627991211,7cyclictest8321-21ntp_states22:45:290
17627991202,6cyclictest11902-21ntp_states23:40:270
17627991202,6cyclictest11902-21ntp_states23:40:270
17627991201,6cyclictest23000-21latency_hist21:20:030
17627991183,56cyclictest0-21swapper/021:25:020
17627991181,61cyclictest17389-21latency_hist23:50:010
17627991172,18cyclictest0-21swapper/023:50:110
17628991162,8cyclictest10645-21apt-get22:50:071
17627991162,6cyclictest30183-21/usr/sbin/munin23:20:020
17627991152,6cyclictest26508-21users21:25:390
17627991152,6cyclictest26508-21users21:25:390
176279911514,83cyclictest23074-21netstat19:25:230
17627991142,51cyclictest0-21swapper/023:36:120
17627991133,41cyclictest0-21swapper/021:55:390
17627991133,41cyclictest0-21swapper/021:55:390
17627991132,8cyclictest23937-21ssh00:00:020
17627991132,6cyclictest688-21apt-get20:00:500
17627991121,6cyclictest16634-21sh22:09:500
17627991121,6cyclictest16634-21sh22:09:500
17627991121,6cyclictest13562-21wc20:50:280
176279911132,21cyclictest10650irq/39-dwc_otg00:35:020
17627991111,59cyclictest0-21swapper/021:05:020
17628991109,43cyclictest13905-21apt-get22:55:071
17627991105,61cyclictest2014-21missed_timers23:25:270
176279911037,18cyclictest10650irq/39-dwc_otg22:25:380
176279911037,18cyclictest10650irq/39-dwc_otg22:25:380
17627991103,5cyclictest0-21swapper/019:20:020
17627991102,96cyclictest0-21swapper/020:40:020
17627991102,96cyclictest0-21swapper/020:40:020
17627991095,63cyclictest0-21swapper/020:40:070
17627991095,63cyclictest0-21swapper/020:40:070
17627991082,7cyclictest0-21swapper/000:20:030
176279910815,31cyclictest5474-21processes23:30:320
17628991075,5cyclictest10750irq/39-dwc_otg_23:40:061
17628991075,5cyclictest10750irq/39-dwc_otg_23:40:061
17629991052,3cyclictest0-21swapper/200:00:112
17628991051,56cyclictest17466-21df23:00:121
17628991051,56cyclictest17466-21df23:00:121
17627991052,10cyclictest7888-21ssh00:25:020
17628991046,27cyclictest10750irq/39-dwc_otg_00:30:171
17628991042,33cyclictest8540-21sed23:35:251
17627991041,6cyclictest31703-21latency_hist19:55:020
176279910414,52cyclictest6348-21wc20:15:230
176279910414,52cyclictest6348-21wc20:15:230
17629991037,70cyclictest10650irq/39-dwc_otg00:20:022
17628991036,33cyclictest15109-21gltestperf00:35:181
17628991036,33cyclictest15109-21gltestperf00:35:181
176279910321,20cyclictest0-21swapper/000:15:030
176279910321,20cyclictest0-21swapper/000:15:030
17627991031,5cyclictest10850irq/39-dwc_otg_00:25:050
17627991031,5cyclictest10850irq/39-dwc_otg_00:25:050
17627991022,46cyclictest0-21swapper/022:01:550
17627991021,76cyclictest0-21swapper/021:35:090
176299910113,11cyclictest18683-21head23:00:402
176299910113,11cyclictest18683-21head23:00:402
17628991016,37cyclictest31231-21irqstats00:10:221
17628991016,37cyclictest31231-21irqstats00:10:221
17628991011,8cyclictest688-21apt-get20:00:301
176279910113,28cyclictest8418-21/usr/sbin/munin20:25:300
176309910042,39cyclictest2013-21switchtime22:35:353
176309910042,39cyclictest2013-21switchtime22:35:353
17629991008,15cyclictest5236-21ls20:10:322
176279910021,27cyclictest19139-21latency_hist19:15:020
1762999992,9cyclictest14515-21if_wlan022:55:222
1762899995,36cyclictest10750irq/39-dwc_otg_22:15:421
1762899995,36cyclictest10750irq/39-dwc_otg_22:15:421
17628999927,22cyclictest24-21ksoftirqd/123:15:031
1762899992,5cyclictest10850irq/39-dwc_otg_22:40:361
1762899992,12cyclictest31148-21ls22:30:351
1762899981,28cyclictest19185-21cut19:15:021
1762799982,7cyclictest0-21swapper/020:25:010
1762799972,82cyclictest0-21swapper/019:20:230
17627999723,35cyclictest25274-21latency_hist19:35:020
17629999618,19cyclictest14209-21/usr/sbin/munin23:45:022
17629999618,19cyclictest14209-21/usr/sbin/munin23:45:022
1762899968,26cyclictest10850irq/39-dwc_otg_23:30:411
1762899962,31cyclictest0-21swapper/120:15:021
1762799962,8cyclictest0-21swapper/020:50:020
1762799962,8cyclictest0-21swapper/020:50:020
1762799961,10cyclictest2918-21grep20:05:170
17629999522,15cyclictest30302-21ssh21:35:072
17629999518,22cyclictest3927-21apt-get22:40:282
1762899952,29cyclictest0-21swapper/120:15:281
1762899952,29cyclictest0-21swapper/120:15:281
1762999947,41cyclictest0-21swapper/223:45:092
1762999947,13cyclictest0-21swapper/221:20:022
1762999944,12cyclictest0-21swapper/221:15:022
17629999411,9cyclictest11560-21ntpq22:50:302
1762899941,9cyclictest24737-21irqstats00:00:221
1762999937,14cyclictest18827-21ssh23:50:382
1762999932,23cyclictest0-21swapper/200:25:352
1762999932,23cyclictest0-21swapper/200:25:352
17628999312,26cyclictest16224-21diskmemload21:28:481
17628999312,26cyclictest16224-21diskmemload21:28:481
1762799932,69cyclictest8331-21wc21:55:030
1762999929,9cyclictest688-21apt-get20:00:422
1762999922,19cyclictest26037-21uname21:25:322
1762999922,19cyclictest26037-21uname21:25:322
1762899927,37cyclictest0-21swapper/121:35:091
1762899921,7cyclictest29136-21ssh22:28:101
1762899921,7cyclictest29136-21ssh22:28:101
123799920,1rtkit-daemon0-21swapper/019:30:283
1762999919,13cyclictest20945-21grep23:05:202
17629999115,20cyclictest14495-21munin-node00:35:022
1762899911,28cyclictest0-21swapper/100:26:191
1762899911,28cyclictest0-21swapper/100:26:191
17629999011,15cyclictest20117-21ssh22:15:022
17628999016,36cyclictest10850irq/39-dwc_otg_21:45:241
1762899901,5cyclictest10850irq/39-dwc_otg_00:15:341
1762899901,27cyclictest3087-21ssh23:26:381
1762999899,17cyclictest13451-21munin-run22:05:012
1762999894,14cyclictest7800-21cut22:45:172
1762999894,14cyclictest7800-21cut22:45:172
17629998924,19cyclictest10650irq/39-dwc_otg21:45:032
1762899891,6cyclictest21655-21switchtime23:05:361
1762899885,39cyclictest10650irq/39-dwc_otg23:50:391
1762899883,37cyclictest0-21swapper/123:15:091
1762999876,13cyclictest0-21swapper/223:20:182
17629998719,9cyclictest826-21apt-get22:35:062
17629998719,9cyclictest826-21apt-get22:35:062
17629998714,17cyclictest0-21swapper/200:05:082
17629998714,13cyclictest28290-21unixbench_multi19:40:332
17629998714,13cyclictest28290-21unixbench_multi19:40:332
1762799877,6cyclictest0-21swapper/021:40:510
1762799877,6cyclictest0-21swapper/021:40:510
1762999867,18cyclictest11482-21latency_hist22:00:012
1762999867,18cyclictest11482-21latency_hist22:00:012
17629998621,27cyclictest17721-21apt-get00:40:022
17629998621,27cyclictest17721-21apt-get00:40:022
17629998612,13cyclictest30157-21sh23:20:032
1762899867,31cyclictest0-21swapper/122:10:091
17627998619,54cyclictest3-21ksoftirqd/019:46:040
17627998619,54cyclictest3-21ksoftirqd/019:46:040
1762999854,11cyclictest27912-21switchtime22:25:352
17629998527,5cyclictest10650irq/39-dwc_otg22:05:222
17629998527,5cyclictest10650irq/39-dwc_otg22:05:222
17629998519,18cyclictest22233-21ssh23:55:362
17628998530,34cyclictest24-21ksoftirqd/123:58:581
1762799852,64cyclictest0-21swapper/020:35:030
1762999848,12cyclictest31359-21grep22:30:382
1762999842,21cyclictest0-21swapper/220:55:452
1762999842,21cyclictest0-21swapper/220:55:452
17629998417,11cyclictest24271-21/usr/sbin/munin22:20:322
1762999836,12cyclictest0-21swapper/220:50:202
17629998312,13cyclictest6632-21mailstats20:15:302
17629998312,13cyclictest6632-21mailstats20:15:302
17629998311,10cyclictest26996-21apt19:40:022
1762899832,40cyclictest10614-21latency_hist22:50:031
1762899832,40cyclictest10614-21latency_hist22:50:031
1762899831,4cyclictest10650irq/39-dwc_otg19:45:221
1762899831,4cyclictest10650irq/39-dwc_otg19:45:221
1762799832,63cyclictest30180-21ssh21:35:020
1762999823,37cyclictest0-21swapper/219:55:082
1762999823,37cyclictest0-21swapper/219:55:082
1762999822,20cyclictest0-21swapper/223:25:202
1762899829,33cyclictest10850irq/39-dwc_otg_23:45:371
17628998219,21cyclictest24-21ksoftirqd/121:23:011
17629998111,9cyclictest24607-21ssh23:10:282
1762899811,7cyclictest15947-21cron21:05:021
17627998116,22cyclictest0-21swapper/021:05:420
1762899806,27cyclictest10750irq/39-dwc_otg_23:20:191
1762899805,31cyclictest10750irq/39-dwc_otg_21:15:021
1762899801,37cyclictest6390-21ssh00:20:541
1763099792,7cyclictest3927-21apt-get22:40:313
1762999792,12cyclictest0-21swapper/200:12:332
1762999792,12cyclictest0-21swapper/200:12:332
1762899794,5cyclictest10750irq/39-dwc_otg_21:31:281
1762899794,25cyclictest29403-1kworker/1:1H00:08:061
1763099782,8cyclictest0-21swapper/322:51:213
17630997814,8cyclictest0-21swapper/300:30:373
1763099781,11cyclictest14573-21munin-node21:00:033
1763099781,11cyclictest14573-21munin-node21:00:033
1762999782,10cyclictest0-21swapper/219:20:232
1763099773,10cyclictest0-21swapper/323:45:173
1762999774,20cyclictest0-21swapper/220:05:162
1762999771,5cyclictest10850irq/39-dwc_otg_20:45:022
1762999771,5cyclictest10850irq/39-dwc_otg_20:45:022
17629997713,14cyclictest4800-21sort23:30:162
1762899772,30cyclictest0-21swapper/122:06:391
1762899772,30cyclictest0-21swapper/122:06:391
1762899771,5cyclictest0-21swapper/122:37:371
1762899771,5cyclictest0-21swapper/122:37:371
1763099763,14cyclictest0-21swapper/323:25:203
17630997613,6cyclictest10850irq/39-dwc_otg_21:00:163
1762999764,14cyclictest22341-21ssh22:17:282
1762999764,14cyclictest22341-21ssh22:17:282
1762999763,14cyclictest0-21swapper/221:05:012
17629997614,19cyclictest5257-21gltestperf00:20:192
1762899762,7cyclictest3922-21latency_hist20:10:021
1763099752,9cyclictest10750irq/39-dwc_otg_23:15:163
1762999752,8cyclictest0-21swapper/223:37:192
1762999752,14cyclictest0-21swapper/219:25:302
1762899753,4cyclictest10850irq/39-dwc_otg_22:01:361
1763099747,9cyclictest10750irq/39-dwc_otg_23:25:033
17630997414,10cyclictest20686-21grep22:15:223
17630997414,10cyclictest20686-21grep22:15:223
1762999742,14cyclictest31623-21latency_hist19:55:022
1762999742,11cyclictest0-21swapper/221:21:012
17629997416,13cyclictest18005-21gltestperf19:10:162
1762899742,27cyclictest0-21swapper/119:15:021
1762899741,35cyclictest25412-21latency_hist19:35:021
17630997317,6cyclictest10859-21cat23:40:023
17630997316,8cyclictest0-21swapper/323:30:163
1762999737,22cyclictest10650irq/39-dwc_otg19:50:012
1762999737,22cyclictest10650irq/39-dwc_otg19:50:012
17629997310,8cyclictest20559-21cron19:20:012
17628997333,10cyclictest24-21ksoftirqd/122:25:021
1762899732,7cyclictest10750irq/39-dwc_otg_19:35:031
1763099725,11cyclictest0-21swapper/319:45:283
1763099725,11cyclictest0-21swapper/319:45:283
1763099722,9cyclictest26893-21cat23:15:023
1763099722,27cyclictest17129-21ls22:10:123
1763099722,17cyclictest0-21swapper/300:15:173
1762999724,7cyclictest33-21ksoftirqd/220:50:012
1762999724,7cyclictest33-21ksoftirqd/220:50:012
1763099714,19cyclictest0-21swapper/323:55:023
1763099713,12cyclictest0-21swapper/322:25:023
17630997119,15cyclictest0-21swapper/322:45:163
17630997119,15cyclictest0-21swapper/322:45:163
1762899711,8cyclictest11702-21sed22:00:031
1763099702,8cyclictest27118-21sort22:25:183
1763099702,8cyclictest27118-21sort22:25:183
1763099702,10cyclictest16224-21diskmemload00:20:323
17628997023,20cyclictest24-21ksoftirqd/121:00:161
1763099699,9cyclictest10750irq/39-dwc_otg_00:25:383
1763099699,9cyclictest10750irq/39-dwc_otg_00:25:383
1763099698,9cyclictest10750irq/39-dwc_otg_00:10:373
1763099698,9cyclictest10750irq/39-dwc_otg_00:10:373
17630996926,9cyclictest0-21swapper/323:05:383
1763099692,16cyclictest14166-21grep23:45:023
1763099692,16cyclictest14166-21grep23:45:023
1763099692,13cyclictest21262-21ssh23:55:183
17630996918,12cyclictest30774-21gltestperf21:35:203
1762899696,26cyclictest10850irq/39-dwc_otg_21:00:021
1762899696,26cyclictest10850irq/39-dwc_otg_21:00:021
17628996927,28cyclictest24-21ksoftirqd/119:50:231
1762899692,6cyclictest3117-21sed21:45:021
1762899692,6cyclictest3117-21sed21:45:021
1762899692,41cyclictest8194-21latency_hist21:55:021
17630996825,7cyclictest27248-21sh00:05:023
1763099682,29cyclictest17725-21gltestperf23:00:193
1763099682,29cyclictest17725-21gltestperf23:00:193
1763099682,22cyclictest0-21swapper/322:05:413
1763099682,22cyclictest0-21swapper/322:05:413
1763099682,10cyclictest30294-21aten_rbpower_vo19:50:103
17630996812,9cyclictest10850irq/39-dwc_otg_21:35:023
1762999684,11cyclictest0-21swapper/221:52:362
1762899681,5cyclictest10850irq/39-dwc_otg_20:52:551
17628996811,43cyclictest21991-21grep19:20:321
17630996733,8cyclictest42-21ksoftirqd/322:55:063
17630996713,5cyclictest10750irq/39-dwc_otg_21:15:023
1762999677,10cyclictest25450-21latency_hist19:35:022
1762899675,4cyclictest10850irq/39-dwc_otg_19:25:251
1762899672,34cyclictest0-21swapper/120:50:021
1763099665,16cyclictest0-21swapper/321:20:023
1763099664,19cyclictest0-21swapper/320:10:023
1763099662,33cyclictest0-21swapper/319:10:153
1762899662,6cyclictest20332-1kworker/1:2H21:17:011
1762899661,39cyclictest8804-21uniq21:55:191
1762899661,20cyclictest7847-21cut20:25:171
1763099651,25cyclictest19883-21grep19:15:223
1762999658,10cyclictest16224-21diskmemload21:10:002
17629996526,6cyclictest33-21ksoftirqd/221:43:392
17629996526,6cyclictest33-21ksoftirqd/221:43:392
1762999652,17cyclictest0-21swapper/220:25:092
1763099648,9cyclictest10750irq/39-dwc_otg_21:10:033
1763099642,41cyclictest5985-21cut20:15:163
1763099642,41cyclictest5985-21cut20:15:163
1763099642,28cyclictest0-21swapper/320:10:063
1763099642,21cyclictest0-21swapper/319:35:093
1763099642,18cyclictest0-21swapper/322:01:253
17629996415,17cyclictest30061-21munin-plugin-st21:35:002
1763099634,39cyclictest10650irq/39-dwc_otg22:30:193
1763099633,19cyclictest0-21swapper/300:35:113
1763099633,19cyclictest0-21swapper/300:35:113
1763099632,8cyclictest0-21swapper/319:55:173
1763099632,8cyclictest0-21swapper/319:55:173
1763099632,11cyclictest0-21swapper/300:05:353
1762999621,10cyclictest0-21swapper/220:24:172
1762899624,5cyclictest27402-21grep19:40:171
1762899624,5cyclictest27402-21grep19:40:171
1763099611,21cyclictest0-21swapper/319:21:193
1762899614,19cyclictest0-21swapper/120:39:021
1762899614,19cyclictest0-21swapper/120:39:021
17630996031,5cyclictest42-21ksoftirqd/321:45:313
1763099602,20cyclictest0-21swapper/321:27:263
1763099602,20cyclictest0-21swapper/321:27:263
1762899602,6cyclictest17675-1kworker/1:2H19:55:111
1762899602,6cyclictest17675-1kworker/1:2H19:55:111
1763099598,23cyclictest0-21swapper/321:55:243
1763099598,23cyclictest0-21swapper/321:55:243
1762999571,21cyclictest0-21swapper/220:40:022
1762999571,21cyclictest0-21swapper/220:40:022
1762999553,20cyclictest0-21swapper/220:35:032
1762899549,39cyclictest9310-21wc20:35:031
1762899546,19cyclictest10750irq/39-dwc_otg_20:40:201
1762899546,19cyclictest10750irq/39-dwc_otg_20:40:201
1763099526,7cyclictest10850irq/39-dwc_otg_20:40:073
1763099526,7cyclictest10850irq/39-dwc_otg_20:40:073
123799520,7rtkit-daemon1236-21rtkit-daemon19:05:050
1763099513,24cyclictest10750irq/39-dwc_otg_19:25:233
17630995129,10cyclictest42-21ksoftirqd/321:55:023
1763099512,13cyclictest0-21swapper/320:55:013
1763099502,14cyclictest0-21swapper/320:25:023
1763099496,34cyclictest7969-21ls20:25:193
1763099496,32cyclictest1445-21ls20:00:443
1763099482,12cyclictest27150-21aten_rbpower_vo19:40:093
1763099482,12cyclictest27150-21aten_rbpower_vo19:40:093
1763099481,7cyclictest0-21swapper/321:21:533
1762899481,10cyclictest12668-21wc20:50:021
17628994712,32cyclictest7389-21sed20:25:011
17630994511,9cyclictest10650irq/39-dwc_otg21:40:033
17630994511,9cyclictest10650irq/39-dwc_otg21:40:033
1763099443,5cyclictest10850irq/39-dwc_otg_20:35:043
1763099443,5cyclictest10850irq/39-dwc_otg_20:35:043
1763099443,10cyclictest0-21swapper/320:50:023
1763099443,10cyclictest0-21swapper/320:50:023
17630994319,6cyclictest42-21ksoftirqd/320:31:593
none20:08:543
none20:08:542
none20:08:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional