You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-27 - 05:25

x86 Intel Atom E3845 @1915 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of system in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Mon Jun 27, 2022 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2296221750,2sleep11760299cyclictest00:55:521
911911080,4ptp4l401ktimersoftd/321:31:413
237652700,1sleep20-21swapper/201:30:112
91191680,1ptp4l401ktimersoftd/301:02:103
91191630,2ptp4l401ktimersoftd/302:59:363
257822620,4sleep31761399cyclictest00:57:233
91191580,1ptp4l401ktimersoftd/322:11:093
156582580,4sleep015662-21gltestperf01:21:330
91191570,1ptp4l401ktimersoftd/301:45:333
17602995740,13cyclictest0-21swapper/121:36:131
171802575,10sleep20-21swapper/221:32:112
91191560,1ptp4l401ktimersoftd/323:38:073
173082564,41sleep00-21swapper/021:33:460
231652540,2sleep20-21swapper/223:47:272
14022520,2sleep10-21swapper/101:06:361
91191510,1ptp4l401ktimersoftd/302:44:073
91191500,1ptp4l401ktimersoftd/300:42:533
91191500,1ptp4l401ktimersoftd/300:42:533
91191450,1ptp4l401ktimersoftd/323:53:523
91191430,2ptp4l3152-21kworker/3:123:44:223
91191430,1ptp4l401ktimersoftd/302:17:333
17602994316,23cyclictest31869-21ssh01:04:401
222062420,2sleep00-21swapper/022:51:280
193422420,25sleep11760299cyclictest21:36:371
193422420,25sleep11760299cyclictest21:36:371
91191410,11ptp4l401ktimersoftd/302:36:183
1760299412,11cyclictest29557-21rm01:36:311
17602994114,23cyclictest17587-21tail02:31:371
91191400,1ptp4l401ktimersoftd/302:12:493
91191400,1ptp4l401ktimersoftd/302:12:493
91191400,1ptp4l401ktimersoftd/300:49:363
91191400,1ptp4l401ktimersoftd/300:49:363
91191400,1ptp4l401ktimersoftd/300:31:493
27822400,4sleep11760299cyclictest01:41:381
17602994015,22cyclictest28112-21sed23:01:421
17602994014,21cyclictest8555-21sed02:21:381
17596994029,6cyclictest9-21ksoftirqd/022:41:270
91191390,1ptp4l401ktimersoftd/323:47:183
91191390,1ptp4l401ktimersoftd/302:26:443
91191390,1ptp4l401ktimersoftd/301:50:383
91191390,1ptp4l401ktimersoftd/301:38:353
91191390,1ptp4l401ktimersoftd/301:24:393
91191390,1ptp4l401ktimersoftd/300:28:293
91191390,1ptp4l401ktimersoftd/300:01:003
91191380,1ptp4l401ktimersoftd/323:29:183
91191380,1ptp4l401ktimersoftd/323:11:403
91191380,1ptp4l401ktimersoftd/323:11:403
91191380,1ptp4l401ktimersoftd/302:55:013
91191380,1ptp4l401ktimersoftd/302:39:143
91191380,1ptp4l401ktimersoftd/302:07:333
91191380,1ptp4l401ktimersoftd/301:57:373
91191380,1ptp4l401ktimersoftd/300:25:413
91191380,1ptp4l401ktimersoftd/300:10:493
91191380,1ptp4l401ktimersoftd/300:05:373
91191380,0ptp4l401ktimersoftd/300:52:373
1760899383,10cyclictest9298-21ssh00:41:412
1760899383,10cyclictest9298-21ssh00:41:412
17608993815,4cyclictest1109-21latency_hist23:16:152
17608993815,4cyclictest1109-21latency_hist23:16:152
1760299382,5cyclictest0-21swapper/101:16:301
17602993813,22cyclictest13185-21grep03:01:381
91191370,1ptp4l401ktimersoftd/322:41:333
91191370,1ptp4l401ktimersoftd/302:24:323
91191370,1ptp4l401ktimersoftd/301:54:333
91191370,0ptp4l401ktimersoftd/301:15:003
91191370,0ptp4l401ktimersoftd/300:38:323
91191370,0ptp4l401ktimersoftd/300:38:323
17608993714,4cyclictest46650irq/102-ens3-Tx00:56:452
1760299373,9cyclictest20899-21apt-get23:46:271
17602993713,21cyclictest23229-21sed00:21:371
91191360,1ptp4l401ktimersoftd/322:26:373
91191360,1ptp4l401ktimersoftd/301:35:453
91191360,1ptp4l401ktimersoftd/301:17:583
91191360,0ptp4l401ktimersoftd/301:07:373
1760299362,7cyclictest0-21swapper/122:31:251
1760299362,6cyclictest8088-21apt-get02:56:331
1760299362,6cyclictest0-21swapper/100:36:291
1760299362,6cyclictest0-21swapper/100:36:291
17602993613,20cyclictest10792-21diskmemload01:00:451
1760299360,6cyclictest29113-21apt-get23:06:271
91191350,1ptp4l401ktimersoftd/322:01:303
91191350,1ptp4l401ktimersoftd/300:13:313
1760299354,10cyclictest31482-21apt-get23:11:301
1760299354,10cyclictest31482-21apt-get23:11:301
1760299353,6cyclictest31937-21apt-get00:31:351
1760299353,4cyclictest0-21swapper/102:06:311
1760299352,7cyclictest46550irq/101-ens3-Tx01:51:371
1760299352,4cyclictest0-21swapper/102:51:321
1760299352,28cyclictest46550irq/101-ens3-Tx00:26:351
17602993513,3cyclictest0-21swapper/102:50:171
17602993512,20cyclictest3388-21if_enp1s0.122:11:311
17602993511,3cyclictest11197-21sh23:36:271
17602993510,4cyclictest952-21cut22:06:291
17602993510,4cyclictest17999-21mii-tool00:16:341
314492340,5sleep01759699cyclictest02:46:340
1760299349,4cyclictest4587-21grep02:16:491
1760299343,5cyclictest12528-21apt-get02:26:321
1760299342,7cyclictest23435-21apt-get21:46:261
1760299342,7cyclictest23435-21apt-get21:46:261
1760299341,8cyclictest17074-21apt-get22:41:261
1760299341,3cyclictest7356-21ssh00:06:101
1760299341,10cyclictest16216-21ssh01:56:311
17602993410,4cyclictest21582-21cat02:01:371
91191330,1ptp4l401ktimersoftd/322:23:063
91191330,1ptp4l401ktimersoftd/302:05:433
91191330,11ptp4l401ktimersoftd/323:23:163
91191330,0ptp4l401ktimersoftd/301:27:533
1760299339,4cyclictest31773-21grep22:01:351
1760299339,4cyclictest28530-21grep21:56:301
1760299338,4cyclictest6288-21irqrtprio01:11:371
1760299336,4cyclictest25926-21unixbench-2d22:56:431
1760299331,7cyclictest21844-21apt-get02:36:321
17602993311,4cyclictest21218-21sh01:26:401
17602993310,4cyclictest31393-21irqrtprio02:11:381
17602993310,4cyclictest31393-21irqrtprio02:11:381
91191320,1ptp4l401ktimersoftd/322:51:583
91191320,1ptp4l401ktimersoftd/302:50:513
91191320,1ptp4l401ktimersoftd/300:17:463
1760299326,22cyclictest0-21swapper/100:15:511
1760299322,6cyclictest5692-21apt-get23:22:231
17602993211,4cyclictest10792-21diskmemload00:47:501
17602993211,4cyclictest10792-21diskmemload00:47:501
17602993210,4cyclictest25943-21grep01:31:401
17602993210,3cyclictest9836-21sed22:26:151
17602993210,3cyclictest17039-21sed23:41:361
1760299320,11cyclictest0-21swapper/100:07:101
17596993218,8cyclictest9-21ksoftirqd/001:01:300
229092310,2sleep00-21swapper/023:47:010
1760299318,4cyclictest32028-21basename23:56:401
1760299318,3cyclictest11716-21taskset22:27:151
1760299317,4cyclictest3096-21timerwakeupswit23:16:441
1760299317,4cyclictest22123-21expr22:51:281
1760299311,9cyclictest25709-21ssh23:51:281
1760299310,12cyclictest0-21swapper/121:41:431
91191300,1ptp4l401ktimersoftd/321:48:533
91191300,1ptp4l401ktimersoftd/321:48:533
1760299309,3cyclictest6546-21/usr/sbin/munin01:46:321
1760299308,2cyclictest0-21swapper/101:25:471
1760299307,3cyclictest9115-21gltestperf23:31:321
1760299307,3cyclictest27993-21cut21:56:141
298092290,3sleep0101ktimersoftd/021:56:430
17608992913,13cyclictest16499-21sh03:05:322
1760299292,4cyclictest0-21swapper/122:16:291
91191280,1ptp4l401ktimersoftd/323:04:183
17596992822,3cyclictest9-21ksoftirqd/000:26:420
91191270,9ptp4l401ktimersoftd/322:49:593
91191270,1ptp4l401ktimersoftd/323:16:543
91191270,1ptp4l401ktimersoftd/322:32:583
1760299272,4cyclictest0-21swapper/102:41:411
17596992721,3cyclictest9-21ksoftirqd/003:06:210
91191260,1ptp4l401ktimersoftd/321:44:203
17596992615,5cyclictest9-21ksoftirqd/002:56:320
91191250,1ptp4l401ktimersoftd/323:31:283
91191250,1ptp4l401ktimersoftd/322:56:413
91191250,1ptp4l401ktimersoftd/322:36:253
91191250,1ptp4l401ktimersoftd/321:56:263
91191250,1ptp4l401ktimersoftd/321:51:263
91191250,1ptp4l401ktimersoftd/321:36:263
91191250,1ptp4l401ktimersoftd/321:36:263
17608992518,4cyclictest33-21ksoftirqd/223:05:252
1760299255,4cyclictest7420-21needreboot23:26:361
17596992520,3cyclictest9-21ksoftirqd/001:46:370
156712250,2sleep20-21swapper/201:56:042
91191240,1ptp4l401ktimersoftd/323:06:303
91191240,1ptp4l401ktimersoftd/322:16:253
91191240,1ptp4l401ktimersoftd/303:01:363
1760899243,12cyclictest26472-21ssh02:41:312
17608992418,3cyclictest33-21ksoftirqd/202:46:362
17608992417,4cyclictest30636-21cpuspeed_turbos22:01:262
1760899240,21cyclictest6048-21ssh00:36:482
1760899240,21cyclictest6048-21ssh00:36:482
1759699244,12cyclictest21851-21ssh02:36:310
17596992419,3cyclictest9-21ksoftirqd/023:21:340
17596992418,3cyclictest9987-21find23:31:390
17596992418,3cyclictest9-21ksoftirqd/023:56:350
17596992418,3cyclictest9-21ksoftirqd/001:51:530
17596992418,3cyclictest9-21ksoftirqd/001:31:450
17596992418,3cyclictest9-21ksoftirqd/000:56:430
17596992417,4cyclictest5158-21unixbench_singl02:51:510
17596992413,5cyclictest101ktimersoftd/000:01:280
12082240,5sleep21760899cyclictest02:13:592
12082240,5sleep21760899cyclictest02:13:592
91191230,1ptp4l401ktimersoftd/322:11:213
88792230,2sleep00-21swapper/001:14:230
17608992316,4cyclictest33-21ksoftirqd/221:48:102
17608992316,4cyclictest33-21ksoftirqd/221:48:102
1760899231,20cyclictest0-21swapper/201:06:482
1760299230,12cyclictest0-21swapper/122:50:501
1759699233,11cyclictest22128-21ssh00:21:290
17596992318,3cyclictest9-21ksoftirqd/022:06:310
17596992318,3cyclictest9-21ksoftirqd/002:26:190
17596992318,3cyclictest9-21ksoftirqd/002:16:380
17596992317,3cyclictest9-21ksoftirqd/022:01:240
17596992317,3cyclictest9-21ksoftirqd/002:11:320
17596992317,3cyclictest9-21ksoftirqd/002:11:320
17596992317,3cyclictest9-21ksoftirqd/002:01:380
17596992317,3cyclictest9-21ksoftirqd/001:26:370
17596992317,3cyclictest11608-21tune2fs23:36:310
17596992316,4cyclictest9-21ksoftirqd/022:30:320
1760899222,17cyclictest3830-21tail02:51:382
17608992216,4cyclictest33-21ksoftirqd/222:47:122
17608992216,3cyclictest33-21ksoftirqd/222:55:582
17608992216,3cyclictest3196-21grep00:01:292
17608992213,5cyclictest9969-21apt-get22:26:252
1760899221,2cyclictest0-21swapper/201:39:552
1760899221,19cyclictest0-21swapper/202:26:362
17602992216,3cyclictest25-21ksoftirqd/100:42:511
17602992216,3cyclictest25-21ksoftirqd/100:42:511
17596992217,3cyclictest9-21ksoftirqd/023:41:350
17596992217,3cyclictest9-21ksoftirqd/023:16:340
17596992217,3cyclictest9-21ksoftirqd/002:46:210
17596992217,3cyclictest9-21ksoftirqd/001:36:380
17596992216,4cyclictest9-21ksoftirqd/021:41:390
17596992216,3cyclictest9-21ksoftirqd/023:16:150
17596992216,3cyclictest9-21ksoftirqd/023:16:150
17596992216,3cyclictest9-21ksoftirqd/023:07:360
17596992216,3cyclictest3992-21tail22:11:350
17596992215,4cyclictest9-21ksoftirqd/021:50:130
17596992215,4cyclictest9-21ksoftirqd/021:50:130
17596992215,4cyclictest14143-21grep00:46:300
17596992215,4cyclictest14143-21grep00:46:300
17596992214,5cyclictest14403-21unixbench_multi00:11:470
1759699221,10cyclictest12135-21grep01:16:480
17608992116,3cyclictest33-21ksoftirqd/223:29:362
17608992116,3cyclictest17531-21sed22:41:312
17608992116,3cyclictest0-21swapper/222:57:452
17608992115,4cyclictest33-21ksoftirqd/221:52:442
17608992115,3cyclictest14491-21sh23:39:172
17608992114,4cyclictest9893-21sh00:07:092
17608992114,4cyclictest899-21runrttasks02:07:462
17608992114,4cyclictest8453-21grep01:46:482
17608992114,4cyclictest46650irq/102-ens3-Tx01:11:362
17608992114,4cyclictest33-21ksoftirqd/221:45:152
17608992114,4cyclictest18474-21grep00:16:372
17608992114,4cyclictest18397-21sh01:57:242
1760899211,2cyclictest0-21swapper/222:36:432
1760899211,2cyclictest0-21swapper/202:20:442
1760899211,18cyclictest0-21swapper/202:22:002
1760899211,18cyclictest0-21swapper/201:03:462
1760899211,17cyclictest15441-21df01:21:312
1760899211,17cyclictest0-21swapper/200:32:042
17596992116,3cyclictest9-21ksoftirqd/022:21:370
17596992116,3cyclictest9-21ksoftirqd/021:36:260
17596992116,3cyclictest9-21ksoftirqd/021:36:260
17596992116,3cyclictest9-21ksoftirqd/000:51:370
17596992116,3cyclictest9-21ksoftirqd/000:41:590
17596992116,3cyclictest9-21ksoftirqd/000:41:590
17596992115,3cyclictest9-21ksoftirqd/022:16:450
17596992115,3cyclictest14406-21idleruntime-cro22:36:140
17596992114,4cyclictest27668-21latency23:01:340
17596992114,4cyclictest16125-21/usr/sbin/munin01:56:300
17596992114,4cyclictest14916-21expr22:36:270
17596992113,6cyclictest9-21ksoftirqd/002:31:390
17596992113,5cyclictest2328-21grep01:41:350
17596992110,6cyclictest770-21apt-get01:06:310
1759699210,18cyclictest15223-21kworker/0:002:26:360
173132210,2sleep20-21swapper/200:49:232
173132210,2sleep20-21swapper/200:49:232
1760899203,9cyclictest16035-21ssh23:41:282
1760899203,10cyclictest12655-21ssh00:11:292
1760899202,15cyclictest5574-21grep23:21:452
17608992015,3cyclictest188-21jbd2/sda1-822:31:352
17608992014,4cyclictest25489-21sh00:24:282
17608992014,3cyclictest3765-21sh01:41:572
17608992014,3cyclictest33-21ksoftirqd/223:16:542
17608992014,3cyclictest29085-21sh23:54:182
17608992014,3cyclictest23184-21sh02:02:262
17608992013,4cyclictest8014-21basename02:56:312
17608992013,4cyclictest30822-21cat23:56:292
17608992013,4cyclictest28740-21if_ens321:56:322
17608992013,4cyclictest27701-21sh01:33:452
17608992013,4cyclictest18997-21cat00:51:322
17608992013,4cyclictest13412-21sh01:18:542
17608992012,5cyclictest28100-21irqstats00:26:432
1760899201,17cyclictest0-21swapper/223:34:322
1760899201,17cyclictest0-21swapper/202:36:302
17602992013,4cyclictest25-21ksoftirqd/122:39:041
17596992015,3cyclictest9-21ksoftirqd/002:11:190
17596992014,3cyclictest9-21ksoftirqd/023:53:230
17596992014,3cyclictest9-21ksoftirqd/023:27:140
17596992014,3cyclictest9-21ksoftirqd/021:54:550
17596992014,3cyclictest21589-21apt-key22:51:160
17596992013,4cyclictest7765-21/usr/sbin/munin00:06:490
17596992013,4cyclictest5967-21grep00:36:470
17596992013,4cyclictest5967-21grep00:36:470
17596992013,4cyclictest25815-21cat22:56:430
17596992013,4cyclictest19253-21sh00:16:480
17596992011,7cyclictest29639-1kworker/u9:100:33:030
17608991915,2cyclictest0-21swapper/222:16:282
17608991914,3cyclictest17022-21/usr/sbin/munin02:31:342
17608991912,4cyclictest8003-21grep22:21:302
17608991912,4cyclictest18179-21cat21:36:272
17608991912,4cyclictest18179-21cat21:36:272
1760899182,13cyclictest30683-21grep23:06:432
17608991812,3cyclictest3441-21if_ens322:11:312
1760899173,8cyclictest452-21apt-get22:06:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional