You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-21 - 12:23

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #8, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack8slot0.osadl.org (updated Fri May 20, 2022 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
658521110,0sleep30-21swapper/323:08:593
988921050,1sleep01208299cyclictest22:41:010
1078021040,0sleep010768-21sshd23:44:240
276582840,1sleep327652-21sshd22:47:173
151322830,3sleep31208599cyclictest22:34:103
73742810,1sleep07377-21bash00:30:550
38182760,0sleep03819-21grepconf.sh22:15:230
316732750,0sleep30-21swapper/300:33:273
229472750,0sleep20-21swapper/200:24:082
217792740,2sleep3431ktimersoftd/322:57:003
290612730,1sleep129058-21sshd21:31:421
33512720,1sleep23347-21sshd22:30:492
29992720,1sleep22899-21sshd23:52:322
99692710,1sleep09957-21sshd00:10:220
87242710,0sleep20-21swapper/223:00:322
87242710,0sleep20-21swapper/223:00:322
247672710,1sleep1241rcuc/122:12:111
176362710,1sleep117634-21sshd22:48:161
59072700,2sleep01208299cyclictest23:04:390
41142700,1sleep04078-21rm23:34:100
91242690,1sleep09123-21sshd21:29:280
73932690,0sleep10-21swapper/123:24:321
62672690,0sleep00-21swapper/000:26:220
310332690,0sleep20-21swapper/223:11:262
279862690,1sleep31-21systemd23:46:323
186012690,0sleep10-21swapper/123:37:401
139042690,0sleep30-21swapper/321:42:183
57342680,1sleep1606-21systemd-journal22:21:051
178662680,3sleep11208399cyclictest22:55:251
175082670,0sleep30-21swapper/322:00:383
59042660,0sleep20-21swapper/200:02:552
178532660,1sleep0882-21NetworkManager22:28:420
298062650,1sleep3857-21dbus-daemon22:26:253
17652650,0sleep10-21swapper/121:40:201
6872640,0sleep0141rcuc/021:27:440
264682630,1sleep126469-21grepconf.sh00:11:081
204092630,1sleep126-21ksoftirqd/122:52:411
101022630,0sleep09-21ksoftirqd/021:09:590
154582620,0sleep0141rcuc/023:02:140
154582620,0sleep0141rcuc/023:02:140
110012620,0sleep30-21swapper/323:31:403
313662610,0sleep10-21swapper/123:58:171
143392610,3sleep11208399cyclictest21:54:511
215152600,1sleep2341ktimersoftd/221:18:512
303262590,0sleep10-21swapper/121:27:371
226272580,0sleep10-21swapper/121:59:321
187832580,1sleep118785-21grepconf.sh00:16:371
64582560,1sleep16456-21sshd21:14:051
43102560,0sleep3421rcuc/300:01:193
265702560,0sleep226572-21bash22:23:272
57752550,0sleep30-21swapper/321:25:063
292132550,0sleep10-21swapper/120:34:471
110932540,0sleep10-21swapper/100:20:381
1170025226,8sleep30-21swapper/319:02:523
1149724924,8sleep00-21swapper/019:00:280
3482480,1sleep2350-21grepconf.sh00:11:252
21672480,2sleep32151-21bash00:15:513
171152470,1sleep01-21systemd22:20:080
1160124523,5sleep10-21swapper/119:01:381
1157424227,8sleep20-21swapper/219:01:192
133602390,0sleep113359-21grep21:45:011
255742380,1sleep225577-21bash23:23:532
309682340,0sleep00-21swapper/021:23:270
1208299336,4cyclictest9-21ksoftirqd/021:35:440
196832300,0sleep20-21swapper/222:37:102
273212290,1sleep20-21swapper/200:31:492
12085992926,1cyclictest44-21ksoftirqd/321:34:593
12083992912,2cyclictest26-21ksoftirqd/123:22:521
53952280,0sleep20-21swapper/223:44:102
12083992813,3cyclictest26-21ksoftirqd/123:33:241
12083992810,1cyclictest26-21ksoftirqd/122:27:101
12082992825,1cyclictest9-21ksoftirqd/021:19:150
196162270,1sleep20-21swapper/223:56:172
12083992713,2cyclictest26-21ksoftirqd/121:23:331
12083992713,1cyclictest26-21ksoftirqd/123:45:471
252672260,1sleep325268-21bash00:06:403
12083992624,1cyclictest26-21ksoftirqd/121:09:191
12083992613,9cyclictest26-21ksoftirqd/121:34:441
12083992613,1cyclictest26-21ksoftirqd/121:17:271
12083992612,3cyclictest26-21ksoftirqd/122:09:201
12083992612,3cyclictest26-21ksoftirqd/122:09:201
12083992611,3cyclictest26-21ksoftirqd/122:43:341
12082992622,2cyclictest9-21ksoftirqd/023:16:440
40002250,1sleep34001-21grepconf.sh23:24:223
217152250,2sleep1923-21polkitd21:52:221
21582250,0sleep00-21swapper/000:14:270
12084992521,2cyclictest35-21ksoftirqd/221:32:362
12083992523,1cyclictest26-21ksoftirqd/100:06:111
12083992510,1cyclictest26-21ksoftirqd/123:03:271
12083992510,1cyclictest26-21ksoftirqd/123:03:271
48122240,0sleep31-21systemd21:20:533
205692240,1sleep220546-21bash22:03:342
12085992422,1cyclictest44-21ksoftirqd/321:33:023
1208399249,1cyclictest26-21ksoftirqd/123:08:131
1208399249,1cyclictest26-21ksoftirqd/100:31:151
1208399248,3cyclictest26-21ksoftirqd/123:51:231
12083992421,1cyclictest26-21ksoftirqd/123:14:551
12083992414,1cyclictest26-21ksoftirqd/100:24:421
12083992411,2cyclictest26-21ksoftirqd/122:29:431
12082992422,1cyclictest9-21ksoftirqd/000:06:440
12082992421,2cyclictest12362-21kworker/0:600:23:400
12082992420,1cyclictest9-21ksoftirqd/022:06:430
12082992420,1cyclictest9-21ksoftirqd/022:06:430
12082992419,3cyclictest9-21ksoftirqd/023:11:360
158242230,1sleep315751-21sshd23:56:063
12084992321,1cyclictest35-21ksoftirqd/221:28:002
12084992319,2cyclictest35-21ksoftirqd/200:16:582
1208399238,3cyclictest26-21ksoftirqd/122:38:061
12083992320,1cyclictest26-21ksoftirqd/123:41:171
12083992312,1cyclictest26-21ksoftirqd/122:14:421
1208299236,1cyclictest9-21ksoftirqd/023:24:440
12082992321,1cyclictest9-21ksoftirqd/023:35:090
12082992321,1cyclictest9-21ksoftirqd/021:44:260
12082992320,2cyclictest10890-21kworker/0:422:34:380
1208299230,3cyclictest24759-21sshd21:56:480
100392230,1sleep19954-21sshd00:00:091
62912220,1sleep0141rcuc/023:57:110
31502220,0sleep0141rcuc/022:12:380
230152220,2sleep31208599cyclictest00:27:093
12083992210,2cyclictest26-21ksoftirqd/123:09:261
12082992220,1cyclictest9-21ksoftirqd/022:53:120
274362210,1sleep227388-21bash22:50:052
1208499211,1cyclictest121rcu_sched23:28:232
12082992117,1cyclictest9-21ksoftirqd/023:59:590
12082992117,1cyclictest9-21ksoftirqd/022:56:530
1208299210,1cyclictest24873-21sshd21:04:570
1208499208,2cyclictest35-21ksoftirqd/221:08:312
1208299204,1cyclictest9-21ksoftirqd/021:41:100
12082992018,1cyclictest9-21ksoftirqd/023:22:280
12082992018,1cyclictest9-21ksoftirqd/022:47:200
12082992017,1cyclictest9-21ksoftirqd/022:30:140
12082992016,3cyclictest12362-21kworker/0:623:50:340
1208299200,2cyclictest13218-21bash22:00:280
1208299200,1cyclictest111rcu_preempt23:45:340
225232190,1sleep222457-21sshd22:13:282
145472190,1sleep214548-21grepconf.sh00:26:442
12085991917,1cyclictest44-21ksoftirqd/321:50:533
12084991917,1cyclictest35-21ksoftirqd/223:05:512
12084991917,1cyclictest35-21ksoftirqd/221:22:322
12084991916,1cyclictest35-21ksoftirqd/223:39:072
1208499191,4cyclictest121rcu_sched22:18:122
12082991917,1cyclictest9-21ksoftirqd/021:49:440
150142180,1sleep215012-21sshd00:04:432
1208599186,11cyclictest30039-21grepconf.sh23:39:363
12085991816,1cyclictest44-21ksoftirqd/323:10:323
12085991816,1cyclictest44-21ksoftirqd/323:03:323
12085991816,1cyclictest44-21ksoftirqd/323:03:323
12084991816,1cyclictest35-21ksoftirqd/222:49:172
26742170,1sleep22673-21sshd21:47:222
237772170,1sleep323778-21bash21:04:533
12085991715,1cyclictest44-21ksoftirqd/323:36:493
12085991714,2cyclictest44-21ksoftirqd/322:53:023
12085991713,2cyclictest44-21ksoftirqd/322:17:173
12085991712,1cyclictest44-21ksoftirqd/323:49:363
12084991715,1cyclictest35-21ksoftirqd/222:56:472
12084991714,2cyclictest6589-21sshd21:34:552
12084991714,1cyclictest14725-21id22:25:442
12084991713,3cyclictest35-21ksoftirqd/221:39:332
12084991713,2cyclictest35-21ksoftirqd/223:33:572
12085991614,1cyclictest44-21ksoftirqd/322:41:233
12085991614,1cyclictest44-21ksoftirqd/322:23:393
12085991614,1cyclictest44-21ksoftirqd/322:09:463
12085991614,1cyclictest44-21ksoftirqd/321:46:443
12085991614,1cyclictest44-21ksoftirqd/321:18:083
12085991614,1cyclictest44-21ksoftirqd/321:09:593
12085991614,1cyclictest44-21ksoftirqd/300:13:363
12085991614,1cyclictest0-21swapper/322:34:403
1208499169,5cyclictest25844-21bash23:15:222
1208499163,1cyclictest35-21ksoftirqd/222:04:342
1208499163,1cyclictest35-21ksoftirqd/222:04:342
12084991614,1cyclictest35-21ksoftirqd/222:39:412
12084991614,1cyclictest35-21ksoftirqd/221:54:362
12084991614,1cyclictest35-21ksoftirqd/221:10:592
12084991613,1cyclictest35-21ksoftirqd/221:50:202
12084991611,3cyclictest28423-21sshd23:45:072
12085991513,1cyclictest44-21ksoftirqd/321:57:503
12085991510,4cyclictest0-21swapper/322:04:393
12085991510,4cyclictest0-21swapper/322:04:393
1208599150,10cyclictest6477-21sshd23:25:523
12082991513,2cyclictest17646-21kworker/0:120:34:420
12085991412,1cyclictest44-21ksoftirqd/300:23:253
12085991411,2cyclictest44-21ksoftirqd/323:16:143
1208399136,1cyclictest889-21perl20:44:391
12083991311,1cyclictest26-21ksoftirqd/121:04:251
1208299130,11cyclictest10758-21grep21:04:250
1208499128,1cyclictest17056-21atenall_r8power20:14:352
1208499120,2cyclictest20954-21awk20:19:432
12083991210,1cyclictest23204-21irqstats20:24:421
1208299127,2cyclictest17646-21kworker/0:119:44:580
1208599119,1cyclictest0-21swapper/319:14:413
1208599110,9cyclictest0-21swapper/319:44:393
1208599110,10cyclictest31315-21awk20:39:433
1208599110,10cyclictest23968-21grep19:24:383
1208599110,10cyclictest22832-21cut20:24:393
1208599110,10cyclictest14747-21users19:09:253
1208499119,1cyclictest13141-21grep20:04:422
1208499118,1cyclictest0-21swapper/219:24:382
1208499110,9cyclictest0-21swapper/220:34:382
1208499110,1cyclictest0-21swapper/220:44:402
1208499110,1cyclictest0-21swapper/220:39:382
1208499110,10cyclictest18896-21perl19:14:402
1208499110,10cyclictest0-21swapper/220:59:462
1208399119,1cyclictest3849-21irqstats20:49:401
1208399110,9cyclictest0-21swapper/119:49:381
1208399110,1cyclictest0-21swapper/120:54:381
1208399110,1cyclictest0-21swapper/120:19:381
1208399110,1cyclictest0-21swapper/120:14:471
1208399110,1cyclictest0-21swapper/119:44:391
1208399110,10cyclictest32591-21ntp_states19:39:461
1208399110,10cyclictest31104-21sort19:39:261
1208399110,10cyclictest0-21swapper/120:29:411
1208299119,1cyclictest0-21swapper/019:24:420
1208299118,2cyclictest17646-21kworker/0:119:49:380
1208299116,0cyclictest17646-21kworker/0:120:51:260
12082991110,0cyclictest0-21swapper/020:09:480
1208299110,2cyclictest8012-21ntp_states19:54:430
1208299110,1cyclictest30461-21df_inode20:39:380
1208299110,1cyclictest15462-21diskstats19:09:270
1208299110,1cyclictest0-21swapper/020:19:380
1208299110,1cyclictest0-21swapper/019:34:370
1208299110,1cyclictest0-21swapper/019:29:380
1208299110,10cyclictest6774-21grep20:54:420
1208299110,10cyclictest587-21diskstats20:44:380
1208599108,1cyclictest10075-21hddtemp_smartct19:59:423
1208599108,1cyclictest0-21swapper/320:34:383
1208599108,1cyclictest0-21swapper/319:29:373
1208599100,9cyclictest8014-21ntpq19:54:433
1208599100,9cyclictest3279-21diskstats20:49:373
1208599100,9cyclictest29945-21ntpq19:34:433
1208599100,9cyclictest20780-21ls20:19:423
1208599100,9cyclictest0-21swapper/320:59:393
1208599100,9cyclictest0-21swapper/320:14:393
1208599100,1cyclictest5878-21diskstats20:54:373
1208599100,1cyclictest4430-21diskstats19:49:383
1208599100,1cyclictest15071-21perl20:09:383
1208599100,1cyclictest0-21swapper/320:29:383
1208599100,1cyclictest0-21swapper/320:04:373
1208599100,1cyclictest0-21swapper/319:39:383
1208599100,1cyclictest0-21swapper/319:04:383
1208499108,1cyclictest7343-21perl19:54:382
1208499108,1cyclictest31921-21perl19:39:392
1208499108,1cyclictest16242-21perl19:09:392
1208499108,1cyclictest13543-21ntp_states19:04:442
1208499108,1cyclictest0-21swapper/220:29:382
1208499100,9cyclictest6799-21cut20:54:422
1208499100,9cyclictest15101-21perl20:09:382
1208499100,9cyclictest0-21swapper/219:49:422
1208499100,9cyclictest0-21swapper/219:19:382
1208499100,1cyclictest27162-21nfsd419:29:422
1208499100,1cyclictest0-21swapper/220:24:422
1208499100,1cyclictest0-21swapper/219:44:372
1208499100,1cyclictest0-21swapper/219:34:432
1208399108,1cyclictest7016-21df_inode19:54:361
1208399108,1cyclictest24208-21hddtemp_smartct19:24:401
1208399108,1cyclictest18577-21diskstats19:14:391
1208399108,1cyclictest12235-21diskstats20:04:371
1208399108,1cyclictest0-21swapper/120:09:441
1208399100,9cyclictest26360-21diskstats19:29:371
1208399100,9cyclictest0-21swapper/119:59:381
1208399100,9cyclictest0-21swapper/119:19:371
1208399100,9cyclictest0-21swapper/119:09:251
1208299108,1cyclictest17646-21kworker/0:120:04:380
1208299107,2cyclictest1321-21kworker/0:219:04:260
1208299100,9cyclictest0-21swapper/020:29:330
1208299100,9cyclictest0-21swapper/020:24:390
1208299100,9cyclictest0-21swapper/020:14:370
1208299100,9cyclictest0-21swapper/019:59:450
1208299100,9cyclictest0-21swapper/019:19:370
1208299100,1cyclictest0-21swapper/019:39:460
1208299100,1cyclictest0-21swapper/019:14:400
120859997,1cyclictest0-21swapper/319:19:383
120859990,0cyclictest0-21swapper/320:44:433
120849997,1cyclictest0-21swapper/219:59:442
120839990,0cyclictest0-21swapper/120:39:381
120839990,0cyclictest0-21swapper/119:09:241
120849988,0cyclictest0-21swapper/220:49:432
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional