You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-05 - 01:28

x86 Intel Atom E3845 @1915 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of system in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6.osadl.org (updated Sun Dec 04, 2022 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3201222580,3sleep30-21swapper/310:59:573
204721800,5sleep2124599cyclictest13:45:012
1245721740,2sleep0123599cyclictest14:29:320
2093421610,4sleep2124599cyclictest15:44:352
2417321600,4sleep3125199cyclictest15:46:453
2018821550,5sleep3125199cyclictest12:49:573
1139021550,3sleep0123599cyclictest12:30:030
91191830,15ptp4l401ktimersoftd/316:19:453
91191830,15ptp4l401ktimersoftd/316:19:453
58642650,2sleep00-21swapper/014:21:370
267842630,2sleep00-21swapper/015:15:500
91191590,1ptp4l401ktimersoftd/315:54:043
148102580,2sleep10-21swapper/114:30:141
124099581,28cyclictest5411-21/usr/sbin/munin12:20:041
315202574,40sleep20-21swapper/210:59:532
123599570,3cyclictest297692chrt14:45:300
123599570,3cyclictest297692chrt14:45:300
123599568,24cyclictest18569-21irqrtprio14:35:040
65312530,2sleep10-21swapper/114:55:151
123599523,41cyclictest11339-21apt-get13:54:590
1245995139,5cyclictest33-21ksoftirqd/215:19:562
123599514,37cyclictest0-21swapper/016:04:560
123599512,40cyclictest0-21swapper/013:49:580
11042514,35sleep10-21swapper/111:04:161
1245995041,4cyclictest33-21ksoftirqd/216:25:052
124099492,37cyclictest6424-21apt-get13:49:581
123599492,36cyclictest21081-21apt-get14:05:040
124099470,24cyclictest14086-21latency_hist13:24:411
123599462,37cyclictest11731-21apt-get15:34:560
123599462,36cyclictest24180-21apt-get13:34:550
1245994533,5cyclictest33-21ksoftirqd/214:55:032
123599453,35cyclictest6863-21apt-get15:30:000
123599453,35cyclictest0-21swapper/016:10:020
123599453,34cyclictest9998-21apt-get14:59:580
124099442,32cyclictest8572-21apt-get16:04:561
124099440,22cyclictest25751-21latency_hist11:54:391
123599443,35cyclictest14398-21apt-get13:24:570
123599442,36cyclictest0-21swapper/011:59:510
123599432,35cyclictest0-21swapper/013:39:540
123599431,32cyclictest12971-21apt-get14:29:550
91191420,16ptp4l401ktimersoftd/313:05:083
124099422,29cyclictest8160-21apt-get14:25:021
124099422,20cyclictest2861-21ssh16:30:371
124099421,35cyclictest0-21swapper/114:05:041
124099421,28cyclictest30636-21sed13:40:121
124099421,25cyclictest24096-21/usr/sbin/munin13:35:041
124099421,23cyclictest10951-21irqstats15:00:061
124099420,26cyclictest16688-21users15:05:181
124099420,23cyclictest18028-21unixbench_singl14:00:201
123599423,32cyclictest0-21swapper/013:44:560
123599423,32cyclictest0-21swapper/013:14:540
123599422,32cyclictest16193-21apt-get13:59:560
123599421,35cyclictest0-21swapper/015:50:040
91191410,1ptp4l401ktimersoftd/316:24:543
1251994114,3cyclictest9783-21ls11:19:563
124099412,29cyclictest11738-21ssh15:34:561
124099411,27cyclictest26231-21awk13:00:081
124099411,27cyclictest26231-21awk13:00:081
124099410,28cyclictest0-21swapper/116:12:581
124099410,23cyclictest29094-21cut11:59:591
123599413,32cyclictest0-21swapper/013:04:520
123599413,31cyclictest25870-21apt-get14:09:540
123599413,31cyclictest19706-21apt-get12:49:520
123599411,32cyclictest32107-21apt-get13:09:530
123599411,32cyclictest32107-21apt-get13:09:530
123599410,4cyclictest26673-21diskmemload14:41:520
123599410,4cyclictest16525-21/usr/sbin/munin15:40:080
123599410,2cyclictest0-21swapper/014:58:280
91191400,1ptp4l401ktimersoftd/316:07:553
91191400,1ptp4l401ktimersoftd/316:00:173
91191400,1ptp4l401ktimersoftd/315:28:123
91191400,1ptp4l401ktimersoftd/313:20:073
1251994014,4cyclictest16992-21cat11:34:563
1251994014,4cyclictest16992-21cat11:34:563
1251994013,3cyclictest8069-21expr12:24:553
1245994029,5cyclictest33-21ksoftirqd/211:54:542
124099401,31cyclictest0-21swapper/113:54:591
123599400,4cyclictest8974-21grep12:25:030
123599400,4cyclictest26364-21ssh16:22:060
91191390,1ptp4l401ktimersoftd/315:30:123
91191390,1ptp4l401ktimersoftd/314:58:593
91191390,1ptp4l401ktimersoftd/314:37:063
91191390,1ptp4l401ktimersoftd/314:22:093
91191390,1ptp4l401ktimersoftd/313:41:073
91191390,1ptp4l401ktimersoftd/313:10:083
91191390,1ptp4l401ktimersoftd/313:10:083
91191390,1ptp4l401ktimersoftd/311:39:523
1251993912,4cyclictest24438-21expr13:34:573
1251993912,4cyclictest12759-21sed15:35:043
1245993922,3cyclictest33-21ksoftirqd/216:05:152
124099393,29cyclictest1535-21apt-get13:44:561
124099393,26cyclictest26401-21apt-get15:50:041
124099390,24cyclictest31584-21fschecks_count15:55:011
124099390,24cyclictest26673-21diskmemload15:33:401
124099390,24cyclictest23193-21sed12:55:041
124099390,21cyclictest30468-21ssh15:20:041
124099390,21cyclictest25686-21ssh16:20:571
124099390,20cyclictest17235-21ssh13:26:571
123599391,32cyclictest0-21swapper/011:44:550
123599391,32cyclictest0-21swapper/011:04:480
123599390,5cyclictest3407-21ssh15:59:440
123599390,4cyclictest19419-21tr13:29:570
123599390,2cyclictest0-21swapper/014:50:220
91191380,1ptp4l401ktimersoftd/315:18:173
91191380,1ptp4l401ktimersoftd/315:06:453
91191380,1ptp4l401ktimersoftd/314:40:313
91191380,1ptp4l401ktimersoftd/314:31:273
91191380,1ptp4l401ktimersoftd/314:05:513
91191380,1ptp4l401ktimersoftd/313:53:033
91191380,1ptp4l401ktimersoftd/313:18:163
125199382,5cyclictest0-21swapper/315:54:573
1245993828,5cyclictest33-21ksoftirqd/215:45:032
1245993827,5cyclictest33-21ksoftirqd/212:44:532
124099383,28cyclictest27240-21apt-get13:04:521
124099382,29cyclictest4599-21apt-get13:14:541
124099380,21cyclictest31463-21ssh16:27:281
124099380,21cyclictest28975-21ssh15:19:361
123599382,30cyclictest23511-21apt-get11:49:510
123599380,4cyclictest23080-21date16:19:450
123599380,4cyclictest23080-21date16:19:450
123599380,4cyclictest19587-21latency_hist12:49:400
123599380,4cyclictest10129-21irqrtprio11:19:580
123599380,3cyclictest17295-21kernelversion11:34:580
123599380,3cyclictest17295-21kernelversion11:34:580
91191370,1ptp4l401ktimersoftd/315:00:263
91191370,1ptp4l401ktimersoftd/314:12:223
91191370,1ptp4l401ktimersoftd/314:03:043
91191370,1ptp4l401ktimersoftd/313:45:023
1245993726,5cyclictest33-21ksoftirqd/212:19:522
1245993726,4cyclictest33-21ksoftirqd/214:34:572
1245993718,3cyclictest33-21ksoftirqd/214:05:092
124099371,22cyclictest374-21latency_hist12:09:391
124099370,20cyclictest0-21swapper/114:34:591
123599378,25cyclictest4990-21gltestperf11:09:540
123599373,28cyclictest0-21swapper/012:54:570
123599372,27cyclictest14019-21apt-get11:29:500
123599371,31cyclictest31270-21grep15:20:140
123599371,30cyclictest20246-21sed15:10:070
1235993712,22cyclictest3374-21mailstats15:25:110
123599370,5cyclictest7120-21cat11:14:540
123599370,4cyclictest20876-21date11:44:380
123599370,3cyclictest26673-21diskmemload15:49:240
91191360,1ptp4l401ktimersoftd/315:40:293
91191360,1ptp4l401ktimersoftd/314:48:193
91191360,1ptp4l401ktimersoftd/314:48:193
91191360,1ptp4l401ktimersoftd/313:59:113
91191360,1ptp4l401ktimersoftd/313:33:343
91191360,1ptp4l401ktimersoftd/313:25:423
78023613,12sleep09-21ksoftirqd/011:00:150
1251993611,3cyclictest46350irq/99-ens3-TxR16:30:083
124599365,4cyclictest33-21ksoftirqd/215:55:022
1245993629,4cyclictest33-21ksoftirqd/212:54:432
1245993621,3cyclictest33-21ksoftirqd/214:45:192
1245993621,3cyclictest33-21ksoftirqd/214:45:192
1245993616,7cyclictest33-21ksoftirqd/214:14:552
124099361,28cyclictest0-21swapper/114:09:541
124099361,20cyclictest0-21swapper/112:14:391
123599362,28cyclictest0-21swapper/012:04:530
123599361,31cyclictest1217-21fschecks_time16:30:040
123599361,30cyclictest26673-21diskmemload15:59:440
123599360,5cyclictest3387-21diskstats12:14:590
123599360,2cyclictest0-21swapper/012:35:030
91191350,1ptp4l401ktimersoftd/316:20:353
91191350,1ptp4l401ktimersoftd/315:10:523
91191350,1ptp4l401ktimersoftd/314:26:443
124599357,3cyclictest121rcu_preempt16:30:272
124599357,10cyclictest33-21ksoftirqd/213:44:422
1245993519,4cyclictest33-21ksoftirqd/212:19:402
124099352,27cyclictest0-21swapper/112:49:531
124099352,27cyclictest0-21swapper/112:29:531
1240993515,17cyclictest21244-21sh13:30:261
1240993514,18cyclictest29983-21sh14:45:521
1240993514,18cyclictest29983-21sh14:45:521
124099350,21cyclictest0-21swapper/115:59:571
124099350,20cyclictest0-21swapper/114:41:011
123599358,24cyclictest26951-21apt-config13:04:400
123599358,24cyclictest26951-21apt-config13:04:400
123599351,30cyclictest9657-21grep13:19:570
123599351,30cyclictest14894-21/usr/sbin/munin12:39:580
123599350,4cyclictest29874-21snmp_o5powerctl16:25:210
123599350,3cyclictest25903-21runrttasks11:54:540
123599350,2cyclictest0-21swapper/015:04:590
123599350,2cyclictest0-21swapper/014:16:340
123599350,2cyclictest0-21swapper/012:20:110
123599350,2cyclictest0-21swapper/011:29:380
91191340,1ptp4l401ktimersoftd/314:51:153
1251993411,4cyclictest4098-21open_files11:09:393
124599349,6cyclictest33-21ksoftirqd/215:35:002
1245993427,4cyclictest33-21ksoftirqd/213:04:442
1245993423,3cyclictest33-21ksoftirqd/212:54:402
1245993421,3cyclictest33-21ksoftirqd/211:49:552
1245993419,7cyclictest33-21ksoftirqd/214:09:572
1245993414,4cyclictest33-21ksoftirqd/213:00:012
1245993414,4cyclictest33-21ksoftirqd/213:00:012
1245993412,4cyclictest33-21ksoftirqd/216:10:532
124099342,25cyclictest32107-21apt-get13:09:531
124099342,25cyclictest32107-21apt-get13:09:531
124099342,24cyclictest1499-21apt-get11:04:501
124099341,29cyclictest20940-21sort11:44:381
124099341,28cyclictest26028-21cut11:54:551
1251993311,4cyclictest1060-21sh15:23:573
1245993325,4cyclictest33-21ksoftirqd/214:25:022
1245993321,4cyclictest33-21ksoftirqd/216:00:162
1245993321,4cyclictest33-21ksoftirqd/215:14:432
1245993319,10cyclictest33-21ksoftirqd/216:15:062
1245993319,10cyclictest33-21ksoftirqd/216:15:062
1245993315,3cyclictest33-21ksoftirqd/216:20:112
1245993312,4cyclictest33-21ksoftirqd/213:55:122
124099335,23cyclictest21153-21apt-get11:44:551
124099331,28cyclictest30765-21apt-get14:14:551
124099331,28cyclictest19656-21rm15:10:011
124099330,29cyclictest18082-21ssh15:40:121
124099330,18cyclictest0-21swapper/114:52:291
123599333,26cyclictest743-21cpu12:09:520
125199329,4cyclictest22821-21unixbench_singl11:45:123
1251993211,3cyclictest27115-21ptp4l11:55:043
1251993211,3cyclictest17498-21cstates12:44:543
124599322,4cyclictest33-21ksoftirqd/213:25:172
1245993224,4cyclictest33-21ksoftirqd/214:50:042
1245993222,3cyclictest33-21ksoftirqd/212:30:082
1245993222,3cyclictest33-21ksoftirqd/212:00:102
1245993221,8cyclictest33-21ksoftirqd/214:20:112
1245993213,4cyclictest33-21ksoftirqd/213:15:052
1245993211,4cyclictest33-21ksoftirqd/213:20:022
1240993213,15cyclictest4313-21ls14:20:081
1240993212,17cyclictest23031-21sed15:45:201
124099321,17cyclictest0-21swapper/115:28:321
124099320,28cyclictest20658-21rm16:15:421
124099320,28cyclictest20658-21rm16:15:421
125199312,7cyclictest24614-21apt-get12:59:513
125199312,7cyclictest24614-21apt-get12:59:513
1251993110,4cyclictest899-21runrttasks12:32:593
124599314,2cyclictest121rcu_preempt13:32:532
1245993121,3cyclictest33-21ksoftirqd/211:20:022
1245993119,4cyclictest33-21ksoftirqd/211:34:552
1245993119,4cyclictest33-21ksoftirqd/211:34:552
1245993119,3cyclictest33-21ksoftirqd/213:54:382
1245993117,4cyclictest33-21ksoftirqd/211:04:592
1245993117,11cyclictest33-21ksoftirqd/212:25:032
1245993117,11cyclictest33-21ksoftirqd/211:34:382
1245993114,14cyclictest33-21ksoftirqd/211:40:012
1245993113,7cyclictest33-21ksoftirqd/212:09:562
124099316,21cyclictest13291-21irqrtprio12:34:591
124099315,22cyclictest14817-21irqrtprio11:29:561
124099311,26cyclictest8197-21awk11:15:031
124099311,26cyclictest16753-21fschecks_time11:34:541
124099311,26cyclictest16753-21fschecks_time11:34:541
124099311,25cyclictest15559-21/usr/sbin/munin12:39:581
125199305,4cyclictest25165-21grep11:50:093
125199303,8cyclictest5488-21apt-get12:19:533
124599309,11cyclictest33-21ksoftirqd/214:00:102
124599304,6cyclictest121rcu_preempt13:09:592
124599304,6cyclictest121rcu_preempt13:09:592
124599302,3cyclictest121rcu_preempt11:09:382
1245993016,12cyclictest33-21ksoftirqd/215:00:182
1245993011,7cyclictest33-21ksoftirqd/215:05:122
1245993010,4cyclictest33-21ksoftirqd/213:35:072
124099301,25cyclictest17431-21tr12:44:541
124099301,25cyclictest10588-21awk11:20:021
1240993010,18cyclictest13241-21grep11:25:121
124099300,26cyclictest8509-21ps12:25:001
124099300,26cyclictest4264-21tail12:15:061
124599297,11cyclictest33-21ksoftirqd/215:25:012
1245992920,3cyclictest33-21ksoftirqd/215:50:052
124099290,25cyclictest3812-21uniq11:09:381
124599287,4cyclictest33-21ksoftirqd/211:14:532
124599286,4cyclictest33-21ksoftirqd/215:15:082
1245992823,3cyclictest33-21ksoftirqd/211:25:112
1245992822,3cyclictest33-21ksoftirqd/212:40:022
1245992819,3cyclictest33-21ksoftirqd/215:30:172
124599281,6cyclictest121rcu_preempt14:41:572
124599281,4cyclictest14414-21snmp_o5powerctl14:30:082
1245992721,3cyclictest33-21ksoftirqd/212:35:102
1245992721,3cyclictest33-21ksoftirqd/212:05:092
91191260,1ptp4l401ktimersoftd/311:34:383
91191260,1ptp4l401ktimersoftd/311:25:133
1245992620,3cyclictest33-21ksoftirqd/211:44:532
91191250,1ptp4l401ktimersoftd/314:14:543
91191250,1ptp4l401ktimersoftd/312:15:103
91191250,1ptp4l401ktimersoftd/312:09:543
91191250,1ptp4l401ktimersoftd/311:59:593
91191250,1ptp4l401ktimersoftd/311:05:043
91191250,0ptp4l401ktimersoftd/312:39:523
91191240,1ptp4l401ktimersoftd/316:10:063
91191240,1ptp4l401ktimersoftd/312:54:403
91191240,1ptp4l401ktimersoftd/312:34:523
91191240,1ptp4l401ktimersoftd/312:05:583
91191240,1ptp4l401ktimersoftd/311:14:543
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional