You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-08-01 - 19:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

ARMv7 Processor rev 4 (v7l), Linux 4.18.16-rt9 (Profile)

Latency plot of shadow in rack #7, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack7slot3s.osadl.org (updated Sun Aug 01, 2021 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1007321810,4sleep31992499cyclictest09:30:523
283702890,6sleep21992399cyclictest11:51:162
207672860,5sleep11992299cyclictest09:45:031
316422770,5sleep21992399cyclictest10:37:052
316422770,5sleep21992399cyclictest10:37:052
19920997724,35cyclictest7950irq/56-dwc_otg_11:28:290
1992099751,21cyclictest0-21swapper/007:15:410
19920997413,12cyclictest0-21swapper/010:56:360
19922997314,14cyclictest14735-21ssh11:36:011
1992099731,13cyclictest2897-21ssh09:21:010
49262720,1sleep20-21swapper/211:23:392
313592720,5sleep31992499cyclictest09:16:063
1992099727,18cyclictest0-21swapper/010:31:110
19920997232,23cyclictest0-21swapper/009:26:020
1992099719,10cyclictest0-21swapper/012:02:480
45852700,2sleep10-21swapper/111:23:011
3772700,3sleep1315-21ssh10:00:411
19920997026,38cyclictest32354-21apt07:50:410
19920997018,41cyclictest0-21swapper/008:10:400
19920997012,13cyclictest0-21swapper/010:02:350
28582690,1sleep30-21swapper/312:39:443
272042690,2sleep20-21swapper/212:30:132
1992099696,13cyclictest0-21swapper/009:19:190
56762680,2sleep00-21swapper/011:25:010
1992399686,27cyclictest19550-21ssh12:20:552
1992099682,55cyclictest0-21swapper/009:34:000
1992099681,5cyclictest7950irq/56-dwc_otg_12:40:410
19920996813,15cyclictest7357-21sh10:46:500
19920996811,9cyclictest23977-21/usr/sbin/munin08:56:110
19923996719,8cyclictest8050irq/56-dwc_otg_12:10:532
1992099678,3cyclictest0-21swapper/012:30:400
19920996721,4cyclictest8050irq/56-dwc_otg_10:21:030
19920996714,44cyclictest0-21swapper/008:47:050
1992099671,20cyclictest0-21swapper/008:11:020
19920996711,10cyclictest0-21swapper/011:35:410
19924996611,18cyclictest8050irq/56-dwc_otg_12:30:473
1992099666,15cyclictest0-21swapper/010:26:000
19920996618,8cyclictest0-21swapper/010:44:220
19920996612,10cyclictest0-21swapper/012:00:230
1992099661,15cyclictest0-21swapper/011:55:160
1992099658,14cyclictest0-21swapper/010:53:220
1992099653,13cyclictest0-21swapper/012:21:490
1992099652,60cyclictest22430-21ntpq07:21:060
19920996514,8cyclictest30552-21latency_hist07:45:410
19920996514,3cyclictest0-21swapper/009:54:480
19920996514,3cyclictest0-21swapper/009:54:480
1992099651,19cyclictest0-21swapper/009:41:550
19920996510,17cyclictest0-21swapper/012:18:200
19920996510,17cyclictest0-21swapper/012:18:200
1992099647,5cyclictest15066-21fschecks_time11:36:060
19920996419,5cyclictest7826-21sh10:09:090
19920996326,22cyclictest8050irq/56-dwc_otg_11:06:020
1992099632,17cyclictest0-21swapper/008:22:150
19920996315,4cyclictest30739-21diskmemload11:13:530
19920996313,4cyclictest27932-21apt-get12:30:560
1992099631,26cyclictest0-21swapper/011:01:200
1992099631,19cyclictest7261-21ssh12:45:120
1992099631,17cyclictest0-21swapper/009:45:500
19920996311,4cyclictest501-21munin-node08:30:510
1992099631,12cyclictest0-21swapper/007:36:180
19920996216,8cyclictest0-21swapper/010:17:460
19920996216,8cyclictest0-21swapper/010:17:460
19920996216,4cyclictest0-21swapper/009:12:420
19920996215,39cyclictest0-21swapper/009:10:180
1992099621,12cyclictest0-21swapper/010:37:250
1992099621,12cyclictest0-21swapper/010:37:250
19920996211,10cyclictest30995-21ssh09:57:350
1992099616,13cyclictest32667-21aten_rbpower_en07:51:020
1992099616,13cyclictest32667-21aten_rbpower_en07:51:020
1992099612,15cyclictest0-21swapper/012:10:460
1992099611,13cyclictest0-21swapper/011:49:350
1992099611,13cyclictest0-21swapper/011:49:350
19920996015,3cyclictest8050irq/56-dwc_otg_08:35:530
19920996015,3cyclictest8050irq/56-dwc_otg_08:35:530
19920996015,10cyclictest0-21swapper/008:28:210
1992099601,17cyclictest0-21swapper/011:42:150
1992099601,17cyclictest0-21swapper/010:15:010
19920996011,6cyclictest0-21swapper/009:04:500
1992099601,12cyclictest0-21swapper/011:15:580
19920995912,5cyclictest14698-21/usr/sbin/munin09:36:160
1992099591,15cyclictest0-21swapper/007:32:150
19920995810,2cyclictest0-21swapper/008:01:250
1992399574,14cyclictest15386-21ssh12:15:532
1992399574,14cyclictest15386-21ssh12:15:532
1992099574,15cyclictest0-21swapper/012:07:100
1992099571,16cyclictest0-21swapper/008:50:550
1992099562,20cyclictest0-21swapper/008:16:490
1992099561,19cyclictest0-21swapper/007:26:530
1992399557,32cyclictest0-21swapper/208:01:042
19922995411,19cyclictest7850irq/56-dwc_otg12:20:551
1992299532,9cyclictest0-21swapper/112:30:561
19923995230,8cyclictest8050irq/56-dwc_otg_10:17:422
19923995230,8cyclictest8050irq/56-dwc_otg_10:17:422
1992299517,21cyclictest0-21swapper/110:55:491
1936825133,11sleep00-21swapper/007:12:090
297712500,2sleep10-21swapper/111:53:411
1992399506,9cyclictest7950irq/56-dwc_otg_09:36:002
1992399491,7cyclictest0-21swapper/210:55:492
1992499483,5cyclictest8050irq/56-dwc_otg_11:25:533
19923994816,12cyclictest8050irq/56-dwc_otg_07:21:042
1992299482,9cyclictest0-21swapper/107:20:571
19922994824,4cyclictest8050irq/56-dwc_otg_12:15:541
19922994824,4cyclictest8050irq/56-dwc_otg_12:15:541
1992399476,27cyclictest0-21swapper/208:10:552
19920994722,5cyclictest0-21swapper/008:45:410
1992399468,4cyclictest0-21swapper/209:00:572
1992399468,25cyclictest0-21swapper/209:20:562
1992399467,26cyclictest0-21swapper/208:20:552
1992399467,25cyclictest0-21swapper/210:00:462
1992399467,24cyclictest0-21swapper/212:00:562
1992399466,17cyclictest30783-21/usr/sbin/munin07:46:132
19923994627,4cyclictest8050irq/56-dwc_otg_11:14:092
1992099462,14cyclictest0-21swapper/008:00:400
1992399459,5cyclictest8050irq/56-dwc_otg_08:56:062
19923994521,8cyclictest8050irq/56-dwc_otg_09:31:172
126212450,2sleep20-21swapper/211:32:362
280492440,4sleep339-21ksoftirqd/311:11:563
1992499441,4cyclictest8050irq/56-dwc_otg_09:45:543
1992399447,24cyclictest0-21swapper/209:16:032
1992399447,16cyclictest0-21swapper/210:51:392
1992399444,24cyclictest3382-21rm10:42:082
1992399444,10cyclictest3780-21ssh12:40:592
1992299441,29cyclictest0-21swapper/107:30:571
1992499437,23cyclictest0-21swapper/308:10:573
19924994317,5cyclictest22334-21aten_rbpower_vo11:05:573
19924994315,7cyclictest11754-21if_eth012:11:043
1992399436,25cyclictest0-21swapper/211:55:462
1992399434,26cyclictest8933-21ssh11:28:252
19923994323,4cyclictest1728-21munin-plugin-st07:55:412
19923994323,4cyclictest1728-21munin-plugin-st07:55:412
1992299435,24cyclictest3023-21ssh12:00:561
1992499428,5cyclictest8050irq/56-dwc_otg_11:51:003
1992399424,21cyclictest24348-21sh09:50:082
1992399423,7cyclictest0-21swapper/211:36:012
19923994221,7cyclictest8050irq/56-dwc_otg_10:31:422
1992299427,22cyclictest0-21swapper/108:20:551
19922994223,5cyclictest17162-21latency_hist10:20:421
19922994223,5cyclictest17162-21latency_hist10:20:421
97542410,1sleep10-21swapper/110:50:491
281152410,1sleep30-21swapper/309:06:083
19924994119,5cyclictest8050irq/56-dwc_otg_12:25:403
1992399417,24cyclictest0-21swapper/210:21:002
1992399415,23cyclictest0-21swapper/208:40:552
19923994127,4cyclictest8050irq/56-dwc_otg_12:35:332
1992299416,25cyclictest0-21swapper/108:56:071
19922994114,6cyclictest8943-21idleruntime-cro08:15:401
32262400,2sleep30-21swapper/309:21:053
1992499401,15cyclictest28742-21ssh09:55:423
1992499401,15cyclictest28742-21ssh09:55:423
1992399408,17cyclictest8050irq/56-dwc_otg_08:26:102
19923994020,7cyclictest8050irq/56-dwc_otg_12:10:242
19923994018,8cyclictest7850irq/56-dwc_otg09:41:512
1992399401,5cyclictest7950irq/56-dwc_otg_10:09:202
1992299408,3cyclictest0-21swapper/109:52:161
1992299408,3cyclictest0-21swapper/109:52:161
19922994019,7cyclictest221ktimersoftd/108:30:411
19922994013,10cyclictest4210-21sh10:43:391
1992299401,28cyclictest27765-21ls07:36:121
1992499393,5cyclictest26959-21unixbench_multi10:31:153
1992399399,6cyclictest7950irq/56-dwc_otg_09:26:022
1992399397,20cyclictest0-21swapper/208:45:462
1992399394,11cyclictest0-21swapper/207:16:012
19923993921,8cyclictest8050irq/56-dwc_otg_11:45:422
19923993921,8cyclictest8050irq/56-dwc_otg_11:45:422
19923993920,10cyclictest8050irq/56-dwc_otg_09:50:572
19923993920,10cyclictest8050irq/56-dwc_otg_09:50:572
19923993919,8cyclictest8050irq/56-dwc_otg_09:56:002
19923993915,8cyclictest7950irq/56-dwc_otg_07:56:192
1992299396,24cyclictest0-21swapper/110:45:541
1992299394,3cyclictest0-21swapper/110:00:521
19922993912,16cyclictest10203-21latency_hist11:30:411
1992499384,12cyclictest8050irq/56-dwc_otg_08:45:403
19923993812,13cyclictest22659-21latency_hist11:45:412
19923993810,13cyclictest1818-21ssh12:37:502
1992299381,5cyclictest17339-21ssh09:40:401
1992299381,28cyclictest653-21ls07:51:101
1992299381,28cyclictest653-21ls07:51:101
1992299381,25cyclictest2094-21ls11:20:411
1992499377,15cyclictest8050irq/56-dwc_otg_10:45:573
1992499371,19cyclictest8050irq/56-dwc_otg_10:00:463
1992399379,6cyclictest7279-21diskmemload10:46:412
1992399375,22cyclictest18142-21ssh11:01:032
1992399375,21cyclictest30465-21ssh11:15:472
19923993711,13cyclictest8050irq/56-dwc_otg_07:32:122
19923993710,9cyclictest8050irq/56-dwc_otg_10:27:112
19922993725,6cyclictest221ktimersoftd/109:30:581
19922993722,12cyclictest8050irq/56-dwc_otg_11:55:461
19922993713,4cyclictest9307-21fschecks_count10:10:571
1992499366,5cyclictest7950irq/56-dwc_otg_11:55:463
1992499366,19cyclictest27410-21ssh12:30:363
1992499365,15cyclictest8050irq/56-dwc_otg_11:46:033
1992499365,15cyclictest8050irq/56-dwc_otg_11:46:033
19924993616,5cyclictest1401750wget10:55:533
19924993612,6cyclictest8050irq/56-dwc_otg_12:45:413
1992499361,23cyclictest18764-21ls09:41:193
1992299367,15cyclictest221ktimersoftd/111:01:271
19922993618,4cyclictest8050irq/56-dwc_otg_11:31:041
1992299361,6cyclictest7850irq/56-dwc_otg12:25:541
1992299361,3cyclictest0-21swapper/110:06:031
1992299361,28cyclictest20417-21grep08:46:001
1992299361,23cyclictest31424-21cut09:16:081
1992499358,6cyclictest8050irq/56-dwc_otg_10:00:413
1992499356,6cyclictest7850irq/56-dwc_otg10:50:573
1992499353,5cyclictest321250snmpd10:28:213
1992399358,6cyclictest8050irq/56-dwc_otg_07:36:082
1992399356,14cyclictest8050irq/56-dwc_otg_09:06:012
19923993512,12cyclictest7950irq/56-dwc_otg_10:12:492
19923993511,11cyclictest301ktimersoftd/209:15:412
19923993510,4cyclictest5634-21aten_rbpower_en08:05:562
1992299357,4cyclictest0-21swapper/112:05:591
19922993516,12cyclictest19785-21awk08:45:401
1992299351,16cyclictest0-21swapper/112:35:501
169402350,2sleep20-21swapper/208:36:042
169402350,2sleep20-21swapper/208:36:042
1992499346,15cyclictest20419-21ssh11:41:423
19924993410,4cyclictest0-21swapper/310:10:403
19924993410,12cyclictest0-21swapper/308:56:063
1992399342,21cyclictest25001-21chrt07:29:102
19923993415,4cyclictest7850irq/56-dwc_otg11:08:512
19923993414,6cyclictest301ktimersoftd/208:16:432
1992299347,6cyclictest25774-21wget10:31:001
19922993412,7cyclictest221ktimersoftd/109:25:581
1992299341,23cyclictest30739-21diskmemload11:11:041
1992299341,20cyclictest4390-21ls12:41:101
19922993410,8cyclictest8050irq/56-dwc_otg_10:25:041
1992499338,6cyclictest8050irq/56-dwc_otg_08:05:413
1992499337,5cyclictest15423-21taskset10:17:533
1992499337,5cyclictest15423-21taskset10:17:533
1992499336,5cyclictest8050irq/56-dwc_otg_10:41:023
1992499336,14cyclictest8050irq/56-dwc_otg_11:35:563
1992499335,14cyclictest8050irq/56-dwc_otg_09:36:133
1992499334,7cyclictest8050irq/56-dwc_otg_07:41:113
1992499334,11cyclictest8050irq/56-dwc_otg_07:46:003
1992499332,9cyclictest9946-21latency_hist09:30:413
1992499331,7cyclictest25411-21aten_rbpower_cu07:30:573
19924993317,9cyclictest21927-21cpuspeed07:20:583
1992499331,11cyclictest12078-21unixbench_multi08:21:133
1992399337,11cyclictest8050irq/56-dwc_otg_08:50:532
1992299339,5cyclictest7850irq/56-dwc_otg09:05:571
1992299338,8cyclictest0-21swapper/112:10:531
1992299337,9cyclictest2806-21fschecks_time09:21:001
1992299336,7cyclictest23-21ksoftirqd/108:16:151
1992299335,14cyclictest7950irq/56-dwc_otg_08:31:131
1992299332,3cyclictest7850irq/56-dwc_otg10:26:001
19922993317,10cyclictest221ktimersoftd/107:15:551
19922993311,9cyclictest9750irq/80-mmc011:45:581
19922993311,9cyclictest9750irq/80-mmc011:45:581
19922993311,18cyclictest0-21swapper/108:01:041
19922993310,12cyclictest0-21swapper/110:36:581
19922993310,12cyclictest0-21swapper/110:36:581
1992499328,12cyclictest8050irq/56-dwc_otg_12:16:053
1992499328,12cyclictest8050irq/56-dwc_otg_12:16:053
1992499327,5cyclictest8050irq/56-dwc_otg_11:01:073
1992499327,4cyclictest0-21swapper/311:18:033
1992499325,12cyclictest8050irq/56-dwc_otg_08:36:043
1992499325,12cyclictest8050irq/56-dwc_otg_08:36:043
1992499324,6cyclictest8050irq/56-dwc_otg_08:51:153
1992499322,18cyclictest0-21swapper/309:05:413
19924993212,11cyclictest11389-21pluginstate11:31:103
1992499321,16cyclictest8050irq/56-dwc_otg_08:26:243
19924993211,5cyclictest37-21rcuc/309:11:023
19924993210,4cyclictest1787-21latency_hist07:55:413
19924993210,4cyclictest1787-21latency_hist07:55:413
1992399322,9cyclictest29075-21wget07:40:572
1992299328,6cyclictest7850irq/56-dwc_otg07:30:411
1992299327,15cyclictest0-21swapper/108:50:531
1992299325,5cyclictest0-21swapper/111:40:571
1992299324,9cyclictest2252-21fschecks_time07:56:011
1992299322,8cyclictest31957-21grep07:46:151
1992499317,5cyclictest8050irq/56-dwc_otg_07:55:563
1992499316,5cyclictest8050irq/56-dwc_otg_07:26:083
1992499315,5cyclictest8050irq/56-dwc_otg_11:21:163
1992499311,16cyclictest0-21swapper/312:04:483
19924993111,4cyclictest7850irq/56-dwc_otg10:13:413
1992399311,17cyclictest14588-21chrt08:30:452
1992299317,7cyclictest21-21rcuc/109:49:461
1992299311,5cyclictest22309-21aten_rbpower_po11:05:571
1992499308,10cyclictest8050irq/56-dwc_otg_08:16:003
1992499306,4cyclictest7850irq/56-dwc_otg07:36:193
1992499302,5cyclictest0-21swapper/310:36:063
1992499302,5cyclictest0-21swapper/310:36:063
19924993018,5cyclictest0-21swapper/310:20:583
1992299308,8cyclictest21-21rcuc/109:15:411
1992299306,4cyclictest7850irq/56-dwc_otg07:41:131
1992299306,10cyclictest8050irq/56-dwc_otg_08:06:151
184862305,14sleep118553-21irqstats07:11:011
1992499293,5cyclictest7850irq/56-dwc_otg08:06:153
1992499292,16cyclictest0-21swapper/308:30:443
19924992914,5cyclictest20441-21latency07:16:043
1992499291,13cyclictest7159-21ssh12:05:583
1992299293,8cyclictest7850irq/56-dwc_otg09:00:591
1992499281,12cyclictest8050irq/56-dwc_otg_08:49:353
1992299282,10cyclictest0-21swapper/108:36:171
1992299282,10cyclictest0-21swapper/108:36:171
193552262,15sleep20-21swapper/207:11:592
179702253,12sleep30-21swapper/307:10:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional