You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-05-30 - 11:07

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #8, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack8slot0.osadl.org (updated Tue May 30, 2023 00:43:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2224421450,0sleep2341ktimersoftd/220:57:472
3193021040,0sleep20-21swapper/221:58:312
2679021040,0sleep2341ktimersoftd/223:29:252
248912820,1sleep00-21swapper/023:39:290
146862790,1sleep014671-21sshd23:43:420
322592750,1sleep032257-21sshd21:54:080
326002740,1sleep20-21swapper/223:52:222
207002740,1sleep11845-21nfsd20:50:281
235232710,1sleep0141rcuc/022:55:080
168362700,1sleep016838-21grep21:19:290
281652690,1sleep11845-21nfsd23:49:041
223162690,1sleep122318-21grepconf.sh20:59:141
64492680,0sleep30-21swapper/322:57:203
243642680,1sleep324327-21sshd22:50:503
23712680,1sleep2331rcuc/222:44:082
193032680,1sleep11845-21nfsd23:50:081
73712670,1sleep17364-21hddtemp_smartct20:59:581
81402660,1sleep30-21swapper/323:44:533
47802660,0sleep10-21swapper/123:03:111
323392660,1sleep132320-21sshd21:12:451
272872660,2sleep392150irq/27-p4p1-tx-23:10:063
102412660,0sleep0141rcuc/022:12:200
105042650,3sleep2341ktimersoftd/221:19:112
297322640,1sleep329718-21bash20:56:393
226362630,1sleep0141rcuc/023:51:520
248762620,0sleep30-21swapper/322:39:243
39742610,0sleep10-21swapper/123:37:021
264452610,2sleep13052199cyclictest21:27:321
237872610,1sleep1241rcuc/122:43:391
229522610,1sleep222935-21sshd21:00:392
61102600,0sleep0141rcuc/023:22:300
15782600,0sleep00-21swapper/023:08:590
321592590,2sleep33052399cyclictest23:33:593
295492590,0sleep20-21swapper/200:15:392
21352590,0sleep02105-21sshd00:08:150
154242590,0sleep215421-21sshd23:43:442
69712580,0sleep20-21swapper/221:52:582
258582580,0sleep025860-21sshd21:56:450
268962570,1sleep226868-21sshd00:14:022
187202570,2sleep13052199cyclictest00:13:371
255542550,0sleep30-21swapper/321:30:263
91602540,0sleep19163-21grep22:33:011
3008125428,8sleep10-21swapper/118:47:151
84022510,0sleep30-21swapper/320:52:513
3020425125,8sleep30-21swapper/318:48:493
99012490,3sleep33052399cyclictest21:04:293
310032490,1sleep0101ktimersoftd/000:17:170
3010424920,8sleep20-21swapper/218:47:322
105852480,0sleep10-21swapper/100:16:181
95752470,1sleep29577-21grepconf.sh21:36:582
214392470,0sleep30-21swapper/323:42:253
16252460,1sleep11622-21grepconf.sh21:18:461
150062440,2sleep03052099cyclictest21:06:060
2788824329,8sleep00-21swapper/018:44:330
223032300,0sleep10-21swapper/100:07:401
3052299273,8cyclictest30589-21id22:52:352
8722260,1sleep3842-21sshd21:14:193
3052299260,1cyclictest18178-21grepconf.sh22:57:532
30521992519,5cyclictest23591-21bash00:01:211
3052299242,9cyclictest18671-21fschecks_count21:04:512
36242230,3sleep1251ktimersoftd/121:07:031
3052299230,2cyclictest28389-21grep22:16:072
175852230,0sleep0908-21rs:main0
164762230,1sleep10-21swapper/121:59:181
94782220,1sleep3421rcuc/300:05:303
3052299228,6cyclictest0-21swapper/200:01:582
3052299220,2cyclictest29633-21grepconf.sh21:45:072
3052299220,1cyclictest0-21swapper/222:19:442
28642220,1sleep32859-21bash23:38:283
216032220,0sleep021599-21bash22:59:330
162482220,0sleep00-21swapper/023:18:330
120042220,1sleep30-21swapper/323:56:003
97652210,1sleep39764-21sshd23:19:443
83382210,0sleep10-21swapper/123:06:161
35562210,1sleep130518-21cyclictest22:19:301
3052299212,8cyclictest21725-21grep22:11:212
3052299210,9cyclictest857-21dbus-daemon20:51:062
3052299210,2cyclictest25581-21bash23:15:572
3052299210,1cyclictest23137-21sshd21:43:252
3052299210,11cyclictest15625-21cp23:05:072
30521992119,1cyclictest23524-21sshd21:40:271
174842210,1sleep11846-21nfsd21:51:571
307932200,0sleep330791-21sshd21:29:143
3052299200,8cyclictest22391-21sshd23:58:082
3052299200,8cyclictest14984-21sshd22:31:512
3052299200,7cyclictest23847-21sshd23:09:572
3052299200,1cyclictest2801-21sshd23:31:112
3052299200,1cyclictest0-21swapper/222:28:152
3052299200,1cyclictest0-21swapper/222:28:152
3052299200,1cyclictest0-21swapper/222:09:272
3052099207,3cyclictest9-21ksoftirqd/000:13:270
3052099201,1cyclictest121rcu_sched22:41:390
19782200,1sleep31845-21nfsd22:39:483
44222190,1sleep1241rcuc/122:54:211
3052299191,17cyclictest14634-21sshd23:37:312
3052299190,9cyclictest3914-21grep22:47:042
3052299190,9cyclictest19866-21sshd22:36:172
3052299190,1cyclictest8593-21sshd21:23:382
3052299190,18cyclictest857-21dbus-daemon21:24:482
3052299190,17cyclictest5463-21switchtime21:10:012
3052299190,17cyclictest0-21swapper/221:29:332
3052099198,9cyclictest9-21ksoftirqd/022:23:140
30520991917,1cyclictest9-21ksoftirqd/021:01:480
241612190,0sleep124152-21sshd23:55:011
179912190,0sleep00-21swapper/022:49:110
3052299180,1cyclictest31175-21sshd00:04:592
3052299180,1cyclictest18856-21sshd23:45:232
3052299180,10cyclictest1515-21grepconf.sh23:00:032
30521991816,1cyclictest28067-21grep23:30:511
271752180,0sleep20-21swapper/221:59:472
126242180,1sleep31844-21nfsd22:03:333
69052170,0sleep30-21swapper/323:16:363
48812170,0sleep1241rcuc/122:12:051
30523991715,1cyclictest29283-21bash22:48:143
30523991715,1cyclictest25371-21sshd22:10:023
30523991715,1cyclictest1649-21sshd21:43:553
3052299170,1cyclictest0-21swapper/223:19:372
30521991715,1cyclictest7462-21sshd22:18:091
3052099174,1cyclictest9-21ksoftirqd/021:19:520
30520991715,1cyclictest9-21ksoftirqd/022:51:480
30520991715,1cyclictest9-21ksoftirqd/020:56:110
30520991714,1cyclictest9-21ksoftirqd/021:26:150
3052099171,1cyclictest21416-21sshd21:31:440
3052099171,1cyclictest111rcu_preempt23:54:560
3052099170,1cyclictest121rcu_sched00:00:160
282572170,0sleep10-21swapper/123:19:061
166692170,1sleep316668-21sshd21:57:483
30523991614,1cyclictest44-21ksoftirqd/321:14:503
30523991612,3cyclictest44-21ksoftirqd/322:25:213
30523991612,3cyclictest44-21ksoftirqd/322:25:213
30523991612,2cyclictest28965-21sshd22:19:113
3052099166,1cyclictest9-21ksoftirqd/021:49:280
30520991614,1cyclictest9-21ksoftirqd/023:24:560
30520991614,1cyclictest9-21ksoftirqd/022:26:170
30520991614,1cyclictest9-21ksoftirqd/022:26:170
30520991614,1cyclictest22361-21sshd20:52:010
30520991613,2cyclictest16826-21bash22:31:550
30520991612,3cyclictest26335-21bash21:36:160
30520991612,1cyclictest9-21ksoftirqd/022:05:410
30520991610,1cyclictest9-21ksoftirqd/022:03:370
207232160,0sleep10-21swapper/119:29:531
13232160,1sleep01324-21sshd23:29:430
30523991513,1cyclictest26262-21tune2fs21:19:533
3052399150,13cyclictest14221-21grep00:04:103
3052299150,8cyclictest19731-21latency_hist19:29:302
30521991513,1cyclictest879-21systemd-logind22:02:441
30521991513,1cyclictest32099-21sshd21:39:281
30521991513,1cyclictest26537-21bash23:23:271
30521991513,1cyclictest19149-21sshd22:54:581
30521991513,1cyclictest17781-21sshd23:24:321
3052099151,3cyclictest13516-21kworker/0:022:15:450
3052099150,3cyclictest121rcu_sched23:10:210
3052099150,1cyclictest121rcu_sched21:39:490
3052099150,1cyclictest111rcu_preempt23:46:160
3052099150,1cyclictest0-21swapper/021:11:380
3052399143,10cyclictest857-21dbus-daemon21:47:343
30523991412,1cyclictest44-21ksoftirqd/323:07:093
30523991412,1cyclictest3378-21sshd23:52:313
30523991412,1cyclictest13799-21sshd00:14:573
30523991412,1cyclictest13023-21sshd23:27:153
30523991411,1cyclictest16472-21sshd22:31:543
3052399140,13cyclictest0-21swapper/322:20:283
3052299143,6cyclictest0-21swapper/219:15:012
3052299140,7cyclictest19891-21atenall_r8power19:29:482
3052199147,1cyclictest18684-21sshd22:24:391
3052199147,1cyclictest18684-21sshd22:24:391
30521991412,1cyclictest31843-21sshd21:48:111
30521991412,1cyclictest22637-21grepconf.sh23:44:061
30521991412,1cyclictest11684-21sshd21:22:151
3052199140,1cyclictest857-21dbus-daemon22:35:301
3052199140,1cyclictest1845-21nfsd22:45:021
30523991311,1cyclictest9318-21sshd00:10:053
30523991311,1cyclictest22597-21sshd22:05:263
30523991311,1cyclictest1-21systemd23:02:063
3052299139,3cyclictest0-21swapper/219:36:352
3052299130,1cyclictest0-21swapper/219:43:182
3052299130,0cyclictest0-21swapper/220:19:412
3052299130,0cyclictest0-21swapper/219:52:162
3052299130,0cyclictest0-21swapper/219:24:092
3052199130,4cyclictest25589-21bash23:11:321
3052199130,1cyclictest0-21swapper/122:04:471
30523991210,1cyclictest0-21swapper/318:54:313
3052399120,1cyclictest0-21swapper/321:49:313
3052399120,1cyclictest0-21swapper/321:06:163
3052399120,11cyclictest24989-21sshd21:36:113
3052299123,8cyclictest4922-21cut18:59:552
3052299120,8cyclictest7479-21fschecks_time19:04:492
3052299120,7cyclictest1209-21wc18:54:312
3052299120,7cyclictest0-21swapper/220:09:572
3052299120,7cyclictest0-21swapper/220:04:302
3052299120,1cyclictest10179-21fschecks_time19:09:532
3052299120,0cyclictest0-21swapper/220:06:122
3052199122,9cyclictest0-21swapper/121:29:451
3052299110,8cyclictest0-21swapper/219:44:512
3052299110,7cyclictest2891-21cat19:59:292
3052299110,7cyclictest22202-21sed20:34:522
3052299110,6cyclictest0-21swapper/220:39:502
3052299110,2cyclictest18650-21/usr/sbin/munin20:29:542
3052299110,1cyclictest92050irq/26-p4p1-rx-18:49:462
3052299110,1cyclictest11804-21if_em120:14:552
3052299110,1cyclictest0-21swapper/220:44:522
3052399108,1cyclictest10283-21hddtemp_smartct19:09:543
3052399100,9cyclictest0-21swapper/320:22:513
3052399100,9cyclictest0-21swapper/320:14:363
3052399100,9cyclictest0-21swapper/320:12:103
3052399100,9cyclictest0-21swapper/320:07:523
3052399100,9cyclictest0-21swapper/319:19:463
3052399100,9cyclictest0-21swapper/318:52:143
3052399100,0cyclictest0-21swapper/319:30:283
3052399100,0cyclictest0-21swapper/319:03:313
3052299100,8cyclictest17362-21awk20:24:582
3052199109,0cyclictest0-21swapper/119:39:531
3052199108,1cyclictest0-21swapper/120:09:481
3052199100,9cyclictest0-21swapper/120:21:351
3052199100,9cyclictest0-21swapper/119:29:121
3052199100,1cyclictest0-21swapper/119:14:511
3052199100,0cyclictest0-21swapper/119:34:531
3052099100,9cyclictest30225-21/usr/sbin/munin19:49:500
3052099100,9cyclictest0-21swapper/020:47:520
3052099100,9cyclictest0-21swapper/020:02:540
3052099100,9cyclictest0-21swapper/019:02:300
305239998,0cyclictest0-21swapper/319:24:583
305239998,0cyclictest0-21swapper/319:15:013
305239990,8cyclictest20508-21httpd19:49:513
305239990,0cyclictest0-21swapper/320:27:443
305219990,0cyclictest0-21swapper/119:19:511
305209998,0cyclictest0-21swapper/020:26:020
305209998,0cyclictest0-21swapper/020:10:410
305209998,0cyclictest0-21swapper/019:56:030
305209992,2cyclictest9-21ksoftirqd/019:39:540
305209990,8cyclictest0-21swapper/018:52:090
305209990,0cyclictest0-21swapper/020:40:330
305209990,0cyclictest0-21swapper/018:54:310
305239987,0cyclictest0-21swapper/320:49:283
305239987,0cyclictest0-21swapper/320:40:033
305239987,0cyclictest0-21swapper/320:34:423
305219987,0cyclictest0-21swapper/120:47:161
305219987,0cyclictest0-21swapper/119:59:311
305219987,0cyclictest0-21swapper/119:56:231
305209987,0cyclictest0-21swapper/019:29:200
305209987,0cyclictest0-21swapper/019:24:200
305209986,1cyclictest0-21swapper/019:34:520
305209984,3cyclictest9-21ksoftirqd/019:29:480
305209984,3cyclictest0-21swapper/019:15:000
10697280,0sleep1241rcuc/119:09:581
305239975,1cyclictest3843-21cut19:59:553
305239975,1cyclictest28162-21fschecks_count19:44:503
305239975,1cyclictest26789-21timerandwakeup19:40:033
305239970,1cyclictest8868-21taskset19:06:133
305219975,1cyclictest28403-21fschecks_time19:44:511
305219970,1cyclictest32331-21sed18:49:551
305219970,1cyclictest31677-21ntp_states19:49:581
305219970,1cyclictest21024-21seq20:34:131
305219970,1cyclictest2027-21df_inode18:54:481
305219970,1cyclictest1882-21sendmail20:16:231
305219970,1cyclictest17760-21switchtime20:25:031
305209974,3cyclictest0-21swapper/019:11:400
305209974,3cyclictest0-21swapper/019:06:200
305209974,0cyclictest0-21swapper/020:07:400
305209973,3cyclictest20246-21/usr/sbin/munin20:30:020
305209970,1cyclictest28521-21hddtemp_smartct19:44:520
305209970,1cyclictest22087-21fw_conntrack20:34:500
305209970,1cyclictest11650-21fw_forwarded_lo20:14:530
305209970,1cyclictest0-21swapper/020:19:410
305239964,1cyclictest18784-21cpu20:29:503
305239964,1cyclictest16743-21kworker/3:219:34:443
305239960,1cyclictest1650-21strings19:54:563
305219966,0cyclictest0-21swapper/120:08:551
305219965,0cyclictest0-21swapper/120:39:431
305219961,2cyclictest22532-21netstat20:34:561
305219960,5cyclictest0-21swapper/119:00:021
305219953,1cyclictest941-21snmpd19:04:411
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional