You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-27 - 04:11

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #8, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack8slot0.osadl.org (updated Mon Jun 27, 2022 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3000621380,3sleep2732899cyclictest21:45:142
725621280,1sleep344-21ksoftirqd/321:54:183
358021240,1sleep33575-21sshd22:48:263
108021230,0sleep30-21swapper/321:15:283
652721080,1sleep36531-21grep22:18:273
120682810,0sleep20-21swapper/222:30:172
30542790,1sleep11846-21nfsd22:47:041
301422790,1sleep330143-21bash22:05:163
287472790,1sleep11022-21runrttasks23:49:551
137232790,1sleep10-21swapper/123:16:191
93992770,2sleep09385-21bash22:27:220
213892770,0sleep2331rcuc/221:42:022
76892760,1sleep2331rcuc/223:57:502
55932760,1sleep05595-21bash00:06:300
48432760,1sleep24831-21sshd00:00:392
248722760,1sleep1241rcuc/123:33:591
6022750,1sleep2598-21grepconf.sh22:15:252
227482750,1sleep2331rcuc/200:04:202
38262740,0sleep30-21swapper/300:25:303
28992740,0sleep10-21swapper/123:01:271
284612740,1sleep328459-21sshd21:36:373
273132720,1sleep11844-21nfsd23:47:021
264712720,0sleep1241rcuc/121:10:571
240352720,1sleep224032-21sshd22:20:432
111952720,0sleep10-21swapper/121:55:561
9792710,0sleep30-21swapper/322:34:033
10952710,0sleep20-21swapper/221:55:292
60672700,0sleep30-21swapper/323:30:203
47132690,3sleep3732999cyclictest00:21:093
35822690,0sleep00-21swapper/000:26:590
274132690,0sleep1732799cyclictest00:22:111
98432680,1sleep29823-21sshd22:54:312
95462680,2sleep29475-21sshd21:58:382
200772680,1sleep120073-21sshd22:52:051
157212680,2sleep0732699cyclictest23:52:150
59832660,1sleep05982-21bash22:54:210
30192660,3sleep3732999cyclictest23:41:393
263952660,1sleep2331rcuc/223:28:232
26262660,1sleep32623-21grep21:31:123
30962650,1sleep33098-21bash23:44:323
27262650,2sleep2341ktimersoftd/221:04:092
161452650,0sleep00-21swapper/019:18:060
54582640,0sleep30-21swapper/322:47:103
48402630,1sleep1732799cyclictest22:31:241
241902630,0sleep20-21swapper/221:33:322
177262630,1sleep117724-21grepconf.sh00:01:141
272042620,0sleep20-21swapper/222:49:292
261492620,0sleep10-21swapper/123:06:451
107522620,1sleep110755-21bash23:08:531
36962610,0sleep00-21swapper/021:46:570
132092610,0sleep20-21swapper/223:17:442
239442600,1sleep2341ktimersoftd/200:30:542
230402600,0sleep00-21swapper/021:19:140
106502600,2sleep3732999cyclictest21:51:333
144732590,1sleep314468-21bash21:21:463
33132570,0sleep23299-21sshd23:01:282
286512570,2sleep1732799cyclictest21:26:411
140442540,2sleep1732799cyclictest22:38:541
693625327,8sleep00-21swapper/019:01:160
37312530,1sleep13727-21systemd23:40:131
250722520,0sleep325056-21sshd23:08:073
286962490,0sleep30-21swapper/323:01:093
679024620,8sleep30-21swapper/318:59:263
194312460,2sleep2732899cyclictest22:23:232
29481-21440,1sshd14032-21kworker/u8:421:32:241
684624327,10sleep10-21swapper/119:00:091
688624228,8sleep20-21swapper/219:00:382
732799324,7cyclictest21445-21grepconf.sh21:07:541
732899310,10cyclictest15292-21sshd23:12:072
732899290,8cyclictest12954-21id22:47:302
732899280,11cyclictest8839-21sshd22:33:012
732899270,10cyclictest4275-21bash23:43:092
7326992724,1cyclictest9-21ksoftirqd/023:22:230
258472270,1sleep325845-21grepconf.sh23:25:273
732799260,10cyclictest17529-21sshd23:28:011
7326992622,2cyclictest9-21ksoftirqd/021:59:570
53242260,0sleep00-21swapper/022:18:240
158702260,0sleep10-21swapper/123:20:401
732899250,9cyclictest12454-21sshd22:07:232
732899250,6cyclictest13644-21ls21:13:122
732899250,14cyclictest14056-21bash21:50:152
7326992520,3cyclictest9-21ksoftirqd/023:06:070
281202250,1sleep328117-21sshd23:16:573
132782250,2sleep013272-21systemd23:46:250
732899240,12cyclictest579-21grepconf.sh21:21:082
732899240,10cyclictest32623-21bash22:39:432
732799241,18cyclictest15223-21grepconf.sh00:03:591
732799240,8cyclictest21171-21id00:27:481
7326992420,1cyclictest9-21ksoftirqd/000:22:090
275332240,1sleep327534-21bash21:38:023
190992240,0sleep00-21swapper/000:11:350
732899230,8cyclictest32663-21cp22:12:352
732899230,10cyclictest8955-21id23:03:082
732899230,10cyclictest27467-21sshd23:39:502
732899230,10cyclictest19389-21systemd23:33:452
732799230,9cyclictest3118-21sshd21:35:281
732799230,8cyclictest6228-21bash21:45:371
732799230,8cyclictest2106-21bash22:19:421
158932230,1sleep015892-21id21:37:310
144942230,0sleep10-21swapper/121:51:431
140072230,1sleep214000-21sshd00:11:212
13142230,0sleep10-21swapper/123:25:491
104002230,1sleep010391-21sshd23:08:520
98882220,1sleep324524-21munin-node19:07:553
732999224,2cyclictest14659-21uname21:07:363
732999223,4cyclictest4682-21sshd22:38:293
732899220,21cyclictest5249-21sshd00:18:162
732899220,10cyclictest18172-21grep23:25:072
732799220,9cyclictest14541-21grep21:21:461
732799220,8cyclictest31645-21grep22:12:321
732799220,7cyclictest9111-21sshd00:11:081
290672220,1sleep30-21swapper/322:53:563
25372220,1sleep22504-21cp00:23:562
732999213,16cyclictest8508-21sshd00:14:043
732999211,10cyclictest857-21dbus-daemon23:52:543
732999210,2cyclictest10289-21systemd00:02:223
732999210,19cyclictest11451-21grep00:08:123
732899210,8cyclictest16414-21sshd00:15:552
732899210,19cyclictest8455-21grep21:08:432
732899210,19cyclictest5210-21sshd21:25:392
732799213,8cyclictest4955-21kill21:39:531
732799213,5cyclictest7225-21grep22:32:571
732799210,8cyclictest19365-21grepconf.sh22:26:241
7326992119,1cyclictest9-21ksoftirqd/022:10:230
732699210,1cyclictest121rcu_sched22:13:010
325072210,0sleep10-21swapper/123:55:571
203382210,3sleep0732699cyclictest00:30:440
164212210,1sleep216424-21grepconf.sh23:48:002
732999201,2cyclictest857-21dbus-daemon23:54:433
7329992011,7cyclictest14605-21sshd21:23:103
732999200,3cyclictest8386-21bash22:14:183
732999200,3cyclictest23144-21sshd23:33:553
732999200,2cyclictest31100-21memory00:28:133
732999200,1cyclictest18878-21sshd22:29:103
732999200,1cyclictest0-21swapper/321:58:523
732999200,19cyclictest7558-21sshd22:08:323
732999200,19cyclictest730-21sshd23:20:003
732999200,19cyclictest28416-21bash21:46:373
732799200,8cyclictest3566-21sshd21:58:231
732799200,8cyclictest15554-21bash00:31:591
732799200,10cyclictest0-21swapper/121:13:321
234932200,2sleep023490-21systemd-cgroups22:49:190
86242190,0sleep00-21swapper/000:02:170
732999190,2cyclictest857-21dbus-daemon00:03:133
732999190,2cyclictest1-21systemd23:07:383
732999190,2cyclictest0-21swapper/322:24:003
732999190,1cyclictest952-21sshd21:08:263
732899190,7cyclictest857-21dbus-daemon21:31:442
732899190,17cyclictest11909-21bash23:20:292
732799190,8cyclictest15809-21id22:54:481
732799190,7cyclictest436-21sshd22:05:231
7326991917,1cyclictest9-21ksoftirqd/021:28:110
7326991916,1cyclictest9-21ksoftirqd/023:40:060
7326991916,1cyclictest9-21ksoftirqd/023:29:490
7326991916,1cyclictest9-21ksoftirqd/021:05:160
7326991915,1cyclictest9-21ksoftirqd/022:44:420
732799189,7cyclictest857-21dbus-daemon00:14:041
732799180,8cyclictest12366-21bash22:17:211
7326991816,1cyclictest9-21ksoftirqd/022:36:190
7326991816,1cyclictest9-21ksoftirqd/021:38:170
7326991814,3cyclictest25138-21kworker/0:621:54:520
7326991814,3cyclictest12167-21kworker/0:123:35:270
7326991814,2cyclictest9-21ksoftirqd/022:39:540
7326991812,3cyclictest23499-21kworker/0:722:59:370
7326991812,1cyclictest9-21ksoftirqd/023:14:250
251782180,2sleep025134-21bash00:13:200
732999170,15cyclictest0-21swapper/319:08:143
7326991715,1cyclictest9-21ksoftirqd/021:17:520
7326991714,1cyclictest9-21ksoftirqd/023:53:230
7326991714,1cyclictest9-21ksoftirqd/021:24:070
732699170,2cyclictest13653-21cp21:10:240
732699170,16cyclictest16164-21kworker/0:322:28:160
732699166,1cyclictest9-21ksoftirqd/022:04:140
732699162,2cyclictest12940-21sshd23:26:210
7326991613,2cyclictest6796-21kworker/0:021:51:300
732899150,14cyclictest0-21swapper/220:48:132
732899150,13cyclictest7745-21perl20:03:082
732799151,9cyclictest1022-21runrttasks19:38:301
732999140,9cyclictest7715-21perl20:03:083
732899148,5cyclictest8450-21latency19:03:112
732899140,13cyclictest0-21swapper/219:58:132
732799140,13cyclictest7738-21tune2fs20:03:081
732799140,13cyclictest1022-21runrttasks20:33:091
732799140,13cyclictest0-21swapper/120:13:151
732699148,2cyclictest9-21ksoftirqd/021:02:550
732999134,2cyclictest5927-21bash21:02:553
732999130,0cyclictest0-21swapper/319:58:133
732899130,3cyclictest0-21swapper/220:28:102
732899130,12cyclictest23550-21runrttasks20:33:092
732899130,12cyclictest0-21swapper/220:26:152
732899130,0cyclictest0-21swapper/221:02:372
732799130,0cyclictest0-21swapper/120:48:131
732999120,11cyclictest0-21swapper/320:48:093
732899129,2cyclictest0-21swapper/219:13:032
732899129,1cyclictest0-21swapper/219:38:072
732899128,3cyclictest0-21swapper/220:13:142
732899120,11cyclictest0-21swapper/219:36:592
732899120,0cyclictest0-21swapper/219:22:072
732799121,6cyclictest1022-21runrttasks19:50:041
732799120,8cyclictest1022-21runrttasks19:17:231
732799120,7cyclictest3179-21awk19:53:121
732799120,7cyclictest16979-21grep19:18:111
732799120,7cyclictest1022-21runrttasks19:27:241
732799120,6cyclictest25250-21/usr/sbin/munin20:38:161
732799120,5cyclictest1022-21runrttasks19:44:191
732799120,5cyclictest0-21swapper/119:09:251
7326991210,1cyclictest490-21grep19:48:120
732999110,1cyclictest28638-21fw_conntrack20:43:083
732999110,1cyclictest0-21swapper/320:13:113
732999110,10cyclictest27182-21fw_forwarded_lo19:38:093
732999110,10cyclictest23999-21nfsd420:33:123
732999110,10cyclictest21910-21perl19:28:083
732899119,1cyclictest0-21swapper/219:55:132
732899118,1cyclictest0-21swapper/220:08:072
732899110,1cyclictest0-21swapper/220:53:072
732899110,1cyclictest0-21swapper/220:38:112
732899110,10cyclictest21983-21fschecks_time19:28:082
732799119,1cyclictest10075-21df_inode20:08:071
732799110,6cyclictest1022-21runrttasks20:44:161
732799110,0cyclictest0-21swapper/120:30:371
732799110,0cyclictest0-21swapper/119:58:131
732699119,1cyclictest13419-21ls20:13:140
732699117,3cyclictest4113-21kworker/0:020:01:000
732699110,2cyclictest10423-21fw_forwarded_lo20:08:090
732699110,1cyclictest1022-21runrttasks20:23:120
732699110,10cyclictest26695-21ntp_states20:38:160
732999108,1cyclictest0-21swapper/320:08:073
732999108,1cyclictest0-21swapper/319:53:073
732999100,9cyclictest0-21swapper/320:53:073
732999100,9cyclictest0-21swapper/319:13:143
732999100,1cyclictest32376-21fw_forwarded_lo19:48:083
732999100,1cyclictest17865-21diskstats20:23:073
732999100,1cyclictest15594-21fschecks_time20:18:093
732999100,1cyclictest0-21swapper/320:38:103
732899103,5cyclictest28545-21fschecks_time20:43:082
732899100,9cyclictest0-21swapper/219:48:092
732899100,9cyclictest0-21swapper/219:08:102
732899100,5cyclictest0-21swapper/220:18:182
732799108,1cyclictest15608-21perl20:18:091
732799100,9cyclictest19778-21crond20:27:541
732799100,6cyclictest4327-21cut20:58:121
732799100,1cyclictest0-21swapper/120:53:081
732699109,0cyclictest0-21swapper/020:18:080
732699108,1cyclictest23102-21diskstats20:33:070
732699108,1cyclictest22630-21ntp_states19:28:130
732699108,1cyclictest20909-21smartctl20:28:090
732699108,1cyclictest0-21swapper/019:33:070
732699100,9cyclictest0-21swapper/020:54:160
732699100,9cyclictest0-21swapper/020:43:080
732699100,9cyclictest0-21swapper/020:07:130
732699100,9cyclictest0-21swapper/019:38:140
732699100,9cyclictest0-21swapper/019:13:090
732699100,1cyclictest31241-21fw_forwarded_lo20:48:080
732699100,1cyclictest2588-21fw_conntrack19:53:070
732699100,1cyclictest0-21swapper/019:07:570
73299997,1cyclictest16848-21hddtemp_smartct19:18:093
73299990,8cyclictest0-21swapper/320:28:123
73289990,8cyclictest29863-21tail19:43:092
73289990,8cyclictest20727-21runrttasks19:25:352
73279997,1cyclictest21880-21perl19:28:081
73279990,8cyclictest9882-21latency_hist19:07:551
73269997,2cyclictest25018-21kworker/0:219:47:300
73269994,2cyclictest25018-21kworker/0:219:25:300
73279980,7cyclictest24019-21tr19:33:051
73269987,0cyclictest0-21swapper/019:07:160
73299975,1cyclictest30282-21expr19:43:123
73299975,1cyclictest24448-21grep19:33:073
73299975,1cyclictest19988-21ntp_states19:23:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional