You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-09-30 - 19:09
/usr/bin/Xorg /usr/bin/Xorg

x86 Intel Atom E3845 @1915 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of system in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Fri Sep 30, 2022 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
419721570,3sleep22618899cyclictest14:24:232
91191930,4ptp4l401ktimersoftd/310:25:153
240242920,4sleep0111rcuc/010:24:020
91191760,11ptp4l401ktimersoftd/314:41:453
91191720,1ptp4l401ktimersoftd/311:06:083
91191650,7ptp4l401ktimersoftd/314:20:433
65832640,5sleep12618099cyclictest10:53:531
129592640,1sleep20-21swapper/214:00:132
195502630,2sleep20-21swapper/214:40:052
91191620,1ptp4l401ktimersoftd/312:56:033
20662620,2sleep30-21swapper/314:55:203
275892610,2sleep10-21swapper/113:43:101
91191600,1ptp4l401ktimersoftd/313:40:243
314822600,4sleep02617599cyclictest15:25:320
217942600,1sleep10-21swapper/111:24:091
91191590,1ptp4l401ktimersoftd/315:47:023
91191580,1ptp4l401ktimersoftd/315:23:363
91191580,1ptp4l401ktimersoftd/315:09:513
325412580,4sleep1241ktimersoftd/113:48:161
147082580,2sleep10-21swapper/114:35:061
301472560,2sleep30-21swapper/311:43:503
260592514,35sleep20-21swapper/210:28:462
91191500,1ptp4l401ktimersoftd/310:54:133
109032490,2sleep10-21swapper/114:31:571
91191480,1ptp4l401ktimersoftd/313:31:463
91191460,1ptp4l401ktimersoftd/310:29:223
91191440,1ptp4l401ktimersoftd/313:09:233
91191440,1ptp4l401ktimersoftd/313:09:233
91191410,1ptp4l401ktimersoftd/312:24:213
91191400,1ptp4l401ktimersoftd/314:14:593
91191400,0ptp4l401ktimersoftd/313:14:183
91191400,0ptp4l401ktimersoftd/313:14:183
91191390,1ptp4l401ktimersoftd/314:51:493
91191390,1ptp4l401ktimersoftd/314:27:433
91191390,1ptp4l401ktimersoftd/314:06:133
91191390,1ptp4l401ktimersoftd/313:55:383
91191390,1ptp4l401ktimersoftd/313:23:293
91191390,1ptp4l401ktimersoftd/312:43:023
91191390,1ptp4l401ktimersoftd/312:33:153
26180993920,12cyclictest17352-21ssh14:39:061
91191380,1ptp4l401ktimersoftd/315:42:093
91191380,1ptp4l401ktimersoftd/315:06:273
91191380,1ptp4l401ktimersoftd/314:36:333
91191380,1ptp4l401ktimersoftd/313:46:323
91191380,1ptp4l401ktimersoftd/313:25:113
91191380,1ptp4l401ktimersoftd/313:00:033
91191380,1ptp4l401ktimersoftd/312:49:213
91191380,1ptp4l401ktimersoftd/311:44:003
91191380,1ptp4l401ktimersoftd/310:59:163
91191380,0ptp4l401ktimersoftd/314:45:383
91191380,0ptp4l401ktimersoftd/314:45:383
91191370,1ptp4l401ktimersoftd/315:49:573
91191370,1ptp4l401ktimersoftd/315:32:223
91191370,1ptp4l401ktimersoftd/313:34:203
91191370,0ptp4l401ktimersoftd/315:00:363
91191370,0ptp4l401ktimersoftd/313:49:303
91191370,0ptp4l401ktimersoftd/312:45:573
91191370,0ptp4l401ktimersoftd/312:38:313
91191360,1ptp4l401ktimersoftd/315:56:393
91191360,1ptp4l401ktimersoftd/315:28:563
91191360,1ptp4l401ktimersoftd/315:17:223
91191360,1ptp4l401ktimersoftd/312:14:093
210692360,4sleep321051-21ssh14:09:143
91191350,1ptp4l401ktimersoftd/314:30:443
91191350,1ptp4l401ktimersoftd/313:59:533
91191340,1ptp4l401ktimersoftd/312:04:083
26188993425,4cyclictest33-21ksoftirqd/215:14:082
245082341,26sleep124590-21if_enp1s0.110:24:081
91191330,1ptp4l401ktimersoftd/315:34:083
91191330,1ptp4l401ktimersoftd/310:35:453
256502330,4sleep22618899cyclictest14:47:072
256502330,4sleep22618899cyclictest14:47:072
91191310,0ptp4l401ktimersoftd/310:47:213
26188993024,3cyclictest28077-21sh14:15:582
91191280,1ptp4l401ktimersoftd/310:53:123
91191280,1ptp4l401ktimersoftd/310:43:163
66122281,23sleep06702-21awk11:59:220
2618099285,12cyclictest11794-21ssh12:54:041
91191270,1ptp4l401ktimersoftd/312:12:573
91191270,1ptp4l401ktimersoftd/311:19:083
26180992716,6cyclictest25-21ksoftirqd/113:04:051
26180992715,9cyclictest19755-21rm14:08:311
26175992712,12cyclictest19168-21diskmemload13:21:310
2618899264,16cyclictest9484-21apt-get15:04:082
2618099264,5cyclictest121rcu_preempt13:34:071
26180992616,4cyclictest25-21ksoftirqd/111:39:031
26175992619,4cyclictest30715-21grep14:19:120
203502260,1sleep00-21swapper/014:09:070
91191250,9ptp4l401ktimersoftd/311:59:273
91191250,1ptp4l401ktimersoftd/313:05:153
91191250,1ptp4l401ktimersoftd/312:19:043
91191250,1ptp4l401ktimersoftd/311:24:043
91191250,1ptp4l401ktimersoftd/311:14:013
91191250,1ptp4l401ktimersoftd/311:13:503
321542250,5sleep2321ktimersoftd/212:40:472
2618899250,12cyclictest203492acpi14:09:072
91191240,1ptp4l401ktimersoftd/311:53:523
91191240,1ptp4l401ktimersoftd/311:49:183
91191240,1ptp4l401ktimersoftd/311:34:033
91191240,1ptp4l401ktimersoftd/311:29:083
2618899249,3cyclictest33-21ksoftirqd/214:29:102
2618899246,3cyclictest121rcu_preempt12:24:112
26188992419,3cyclictest33-21ksoftirqd/214:34:082
26188992418,3cyclictest33-21ksoftirqd/214:59:162
26188992418,3cyclictest33-21ksoftirqd/214:53:552
26188992418,3cyclictest33-21ksoftirqd/212:19:072
26188992418,3cyclictest33-21ksoftirqd/212:04:252
26188992418,3cyclictest33-21ksoftirqd/210:39:142
26188992417,3cyclictest33-21ksoftirqd/212:13:522
26188992412,10cyclictest33-21ksoftirqd/215:29:122
2618099248,9cyclictest4696-21rm12:46:021
26180992419,3cyclictest25-21ksoftirqd/114:53:551
26180992416,5cyclictest46550irq/101-ens3-Tx15:49:091
26180992415,7cyclictest11353-21/usr/sbin/munin11:04:051
26180992413,8cyclictest23723-21ssh14:11:551
2617599243,13cyclictest14349-21ssh15:09:080
17572241,3sleep11841-21smartctl11:49:151
161622240,4sleep216378-21cstates11:14:032
26188992318,3cyclictest33-21ksoftirqd/214:53:592
26188992318,3cyclictest33-21ksoftirqd/213:54:252
26188992318,3cyclictest33-21ksoftirqd/211:03:502
26188992317,3cyclictest33-21ksoftirqd/211:59:122
26188992317,3cyclictest24072-21grep13:39:132
26188992317,3cyclictest22046-21grep13:04:102
26188992316,3cyclictest33-21ksoftirqd/213:38:532
26188992310,10cyclictest33-21ksoftirqd/212:49:082
2618099238,8cyclictest1165-21rm14:22:011
26180992318,3cyclictest1714-21/usr/sbin/munin10:44:111
26180992316,4cyclictest20070-21grep12:29:111
26180992315,6cyclictest25-21ksoftirqd/113:29:121
26180992311,5cyclictest25-21ksoftirqd/112:39:041
26180992310,5cyclictest25-21ksoftirqd/115:44:101
26180992310,10cyclictest24536-21grep15:19:121
2617599234,11cyclictest63-21kswapd014:04:070
2617599233,11cyclictest19620-21ssh12:29:060
2617599231,4cyclictest11179-21apt-get15:39:080
176202230,3sleep2321ktimersoftd/214:04:512
44722220,2sleep00-21swapper/014:59:020
2618899228,3cyclictest317142rm15:25:562
26188992217,3cyclictest33-21ksoftirqd/213:44:112
26188992217,3cyclictest33-21ksoftirqd/213:33:532
26188992217,3cyclictest33-21ksoftirqd/213:13:522
26188992217,3cyclictest33-21ksoftirqd/213:13:522
26188992217,3cyclictest33-21ksoftirqd/212:29:192
26188992217,3cyclictest33-21ksoftirqd/211:43:502
26188992217,3cyclictest33-21ksoftirqd/211:04:162
26188992217,3cyclictest33-21ksoftirqd/210:53:502
26188992217,3cyclictest33-21ksoftirqd/210:33:492
26188992216,3cyclictest33-21ksoftirqd/212:48:522
26188992216,3cyclictest33-21ksoftirqd/211:48:592
26188992216,3cyclictest33-21ksoftirqd/211:44:102
26188992216,3cyclictest33-21ksoftirqd/211:19:182
26188992216,3cyclictest33-21ksoftirqd/210:44:082
26188992215,5cyclictest33-21ksoftirqd/211:09:012
26188992215,4cyclictest18779-21sh15:45:582
2618899221,3cyclictest12232-21chrt13:27:002
2618899220,5cyclictest1320-21gltestperf13:49:112
2618099226,9cyclictest0-21swapper/113:24:061
2618099223,11cyclictest11194-21ssh15:39:091
26180992217,3cyclictest25-21ksoftirqd/114:54:051
26180992217,3cyclictest25-21ksoftirqd/114:03:541
26180992217,3cyclictest25-21ksoftirqd/113:09:111
26180992217,3cyclictest25-21ksoftirqd/113:09:111
26180992217,3cyclictest25-21ksoftirqd/111:29:111
26180992216,3cyclictest25-21ksoftirqd/115:24:131
26180992215,4cyclictest7727-21sh13:54:391
26180992215,4cyclictest24879-21fschecks_count12:34:091
26180992215,4cyclictest17627-21sh15:11:561
26180992215,4cyclictest17414-21interrupts12:59:131
26180992214,6cyclictest26010-21ssh14:47:451
26180992214,6cyclictest26010-21ssh14:47:451
26180992214,5cyclictest46550irq/101-ens3-Tx15:29:111
26180992211,5cyclictest25-21ksoftirqd/115:34:091
26180992211,5cyclictest25-21ksoftirqd/112:24:031
26175992215,4cyclictest899-21runrttasks14:28:500
26175992215,4cyclictest5823-21sed10:49:220
26175992215,4cyclictest24627-21snmp_o5powerctl11:29:170
26175992215,4cyclictest13677-21/usr/sbin/munin13:29:160
2617599221,4cyclictest11226-21cut12:09:160
26175992214,5cyclictest9865-21sh13:58:200
26175992214,5cyclictest46450irq/100-ens3-Tx14:54:070
26175992214,4cyclictest18561-21/usr/sbin/munin13:34:180
2617599221,3cyclictest29498-21apt-get12:39:040
2617599220,4cyclictest22779-21taskset11:26:210
2617599220,3cyclictest23470-21ssh13:39:060
1364722215,3sleep233-21ksoftirqd/212:54:252
2618899214,11cyclictest6672-21apt-get10:54:032
26188992116,3cyclictest33-21ksoftirqd/215:09:102
26188992116,3cyclictest33-21ksoftirqd/210:33:502
26188992115,4cyclictest28100-21sh12:37:132
26188992115,4cyclictest2792-21/usr/sbin/munin11:54:092
2618899211,4cyclictest30322-21munin-run15:58:562
26180992116,3cyclictest25-21ksoftirqd/115:04:141
26180992116,3cyclictest25-21ksoftirqd/111:44:101
26180992116,3cyclictest25-21ksoftirqd/110:53:501
26180992115,4cyclictest25-21ksoftirqd/111:57:571
26180992115,3cyclictest8986-21/usr/sbin/munin10:59:051
26180992115,3cyclictest808-21acpi13:49:061
26180992115,3cyclictest29891-21gltestperf10:34:061
26180992115,3cyclictest25-21ksoftirqd/111:09:101
26180992115,3cyclictest1483-21latency_hist10:43:491
26180992115,3cyclictest14668-21/usr/sbin/munin12:19:151
26180992114,4cyclictest3354-21if_err_ens314:24:121
26180992114,4cyclictest12905-21if_enp1s0.112:14:111
26180992113,4cyclictest32108-21basename13:14:161
26180992113,4cyclictest32108-21basename13:14:161
26180992111,4cyclictest25-21ksoftirqd/110:29:001
26175992116,2cyclictest9-21ksoftirqd/011:52:420
26175992115,4cyclictest7017-21cut12:49:050
26175992115,3cyclictest9-21ksoftirqd/010:39:420
26175992114,4cyclictest9-21ksoftirqd/010:31:560
26175992114,4cyclictest9074-21ls13:24:080
26175992114,4cyclictest6185-21/usr/sbin/munin15:34:170
26175992114,4cyclictest16888-21cstates12:59:080
2617599211,3cyclictest17498-21snmp_o5powerctl11:14:140
26175992113,5cyclictest46450irq/100-ens3-Tx13:44:070
2617599211,18cyclictest0-21swapper/015:33:520
2617599211,18cyclictest0-21swapper/014:36:550
2617599211,18cyclictest0-21swapper/012:36:360
2617599211,17cyclictest14756-21ssh12:56:180
2617599211,17cyclictest1321-21chrt13:15:020
2617599211,17cyclictest1321-21chrt13:15:020
2618899204,9cyclictest4033-21apt-get13:19:082
26188992015,3cyclictest24123-21sh15:51:452
26188992014,3cyclictest8598-21sh15:35:172
26188992014,3cyclictest33-21ksoftirqd/215:39:102
26188992014,3cyclictest30523-21sh14:19:102
26188992014,3cyclictest16928-21expr12:59:082
26188992013,4cyclictest33-21ksoftirqd/211:38:432
26188992013,4cyclictest32134-21if_enp1s013:14:162
26188992013,4cyclictest32134-21if_enp1s013:14:162
26188992013,4cyclictest21317-21grep11:24:062
26180992015,3cyclictest8108-21hddtemp_smartct12:04:111
26180992015,3cyclictest25-21ksoftirqd/114:14:191
26180992015,3cyclictest16459-21fschecks_count11:14:051
26180992014,3cyclictest7907-21expr12:49:121
26180992014,3cyclictest4412-21sh14:58:551
26180992014,3cyclictest27727-21latency_hist11:38:501
26180992014,3cyclictest25-21ksoftirqd/115:57:201
26180992014,3cyclictest10159-21cstates12:09:071
26180992013,5cyclictest32713-21kworker/u8:013:20:581
26180992013,4cyclictest20202-21unixbench_singl11:19:201
26180992013,4cyclictest19402-21expr15:14:101
26175992015,2cyclictest9-21ksoftirqd/012:18:350
2617599201,4cyclictest4216-21snmp_o5powerctl11:54:170
26175992014,4cyclictest11156-21sh13:59:110
26175992014,3cyclictest28768-21grep10:33:500
26175992014,3cyclictest17445-21sendmail_mailst15:44:220
26175992014,3cyclictest17033-21/usr/sbin/munin12:24:130
2617599201,3cyclictest19168-21diskmemload14:15:200
26175992013,4cyclictest9-21ksoftirqd/011:45:480
26175992013,4cyclictest22219-21bc14:44:070
26175992013,4cyclictest22219-21bc14:44:070
26175992013,4cyclictest20882-21sed15:14:260
2617599201,2cyclictest0-21swapper/011:03:000
26175992012,5cyclictest17661-21cut14:39:110
2617599201,16cyclictest26695-21ssh15:20:440
2617599201,16cyclictest11430-21apt-get11:04:040
2617599200,4cyclictest14046-21df_inode11:09:040
26188991914,3cyclictest33-21ksoftirqd/211:29:052
26188991914,3cyclictest24021-21/usr/sbin/munin15:19:222
26180991914,3cyclictest6374-21phc2sys11:59:151
26175991913,4cyclictest9-21ksoftirqd/011:39:420
26175991913,3cyclictest9-21ksoftirqd/011:35:280
26175991913,3cyclictest9-21ksoftirqd/010:46:250
26175991913,3cyclictest7606-21sh14:29:090
26175991913,3cyclictest26652-21expr13:09:060
26175991913,3cyclictest26652-21expr13:09:060
26175991913,3cyclictest1925-21apt12:44:030
26175991913,3cyclictest18721-21cat11:19:030
2617599191,2cyclictest19168-21diskmemload13:04:320
26175991912,4cyclictest8364-21cut12:04:130
26175991912,4cyclictest1179-21forks13:49:100
2617599191,15cyclictest6214-21apt-get10:53:520
26188991811,4cyclictest13655-21cut12:14:172
26175991812,4cyclictest19168-21diskmemload15:07:260
2617599181,15cyclictest0-21swapper/015:54:070
2617599181,15cyclictest0-21swapper/014:49:230
26175991811,4cyclictest21576-21if_ens315:49:160
26175991811,4cyclictest15269-21if_enp1s012:19:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional