You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-07 - 10:45

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #8, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack8slot0.osadl.org (updated Wed Jun 07, 2023 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1608121010,0sleep3431ktimersoftd/321:09:543
179222990,0sleep00-21swapper/000:14:530
68232820,0sleep16825-21sshd20:54:561
80312790,1sleep126-21ksoftirqd/122:08:361
190382790,0sleep00-21swapper/020:49:420
141892760,3sleep2719299cyclictest22:25:172
302402750,1sleep3421rcuc/321:29:343
140212750,1sleep014007-21sshd23:56:180
183282730,1sleep01846-21nfsd21:15:520
158852730,1sleep315843-21sshd21:04:083
14822720,1sleep1952-21sshd21:22:261
88632710,0sleep10-21swapper/122:41:031
121942710,1sleep312180-21bash23:24:463
46612700,1sleep2331rcuc/223:40:242
302972700,0sleep30-21swapper/323:03:423
277292700,1sleep327730-21bash23:24:063
136902700,1sleep013689-21bash00:02:270
189502690,0sleep118946-21sshd21:33:291
326272680,1sleep032602-21sshd22:36:250
66472670,0sleep20-21swapper/220:53:332
56632670,1sleep35649-21sshd21:42:453
56632670,1sleep35649-21sshd21:42:453
317652670,17sleep292050irq/26-p4p1-rx-00:04:492
233692670,1sleep023368-21grepconf.sh21:52:000
222482670,0sleep01844-21nfsd22:28:470
3182660,0sleep00-21swapper/021:06:180
305002660,0sleep10-21swapper/122:19:591
26522660,0sleep00-21swapper/023:40:180
170222660,1sleep0141rcuc/023:51:530
120632660,0sleep10-21swapper/121:45:471
82662640,0sleep1241rcuc/100:08:211
104622640,1sleep110465-21sendmail_mailtr21:09:391
294892630,0sleep00-21swapper/022:46:150
282622630,0sleep00-21swapper/022:43:220
158322630,0sleep10-21swapper/123:29:291
149882630,1sleep214981-21sshd22:22:202
226692620,1sleep022673-21bash21:40:370
226692620,1sleep022673-21bash21:40:370
51492610,0sleep15153-21grepconf.sh22:28:001
83792600,0sleep00-21swapper/022:02:460
217812600,2sleep392150irq/27-p4p1-tx-00:18:133
10172600,1sleep31013-21sshd20:51:503
23802580,0sleep00-21swapper/023:44:550
19352570,0sleep11933-21bash22:03:591
318882560,0sleep231889-21bash23:21:162
246652510,0sleep00-21swapper/022:59:060
286932480,1sleep328656-21sshd21:22:123
291002470,0sleep30-21swapper/323:10:513
236182470,0sleep30-21swapper/321:04:283
681824329,8sleep10-21swapper/118:48:231
667724328,9sleep30-21swapper/318:46:363
654724329,8sleep20-21swapper/218:45:032
651424228,8sleep00-21swapper/018:44:410
286742420,0sleep128675-21bash22:10:571
303262330,0sleep30-21swapper/322:44:503
55922300,1sleep05579-21bash21:38:330
327642280,1sleep132727-21sshd21:03:261
238752270,1sleep1857-21dbus-daemon23:04:481
57412230,0sleep00-21swapper/022:12:560
149142230,17sleep292050irq/26-p4p1-rx-00:04:052
138202230,0sleep20-21swapper/200:16:162
719199229,2cyclictest26-21ksoftirqd/121:56:411
278012220,0sleep10-21swapper/100:15:221
251912220,1sleep00-21swapper/021:57:490
197322210,1sleep1241rcuc/122:47:161
719199209,1cyclictest26-21ksoftirqd/123:15:041
719199209,1cyclictest26-21ksoftirqd/122:49:581
719199209,1cyclictest26-21ksoftirqd/100:10:021
719199208,1cyclictest26-21ksoftirqd/121:49:421
7191992018,1cyclictest26-21ksoftirqd/122:54:301
7191992010,3cyclictest26-21ksoftirqd/123:19:321
323312200,0sleep232330-21sshd23:27:132
321722200,0sleep20-21swapper/221:28:122
276952200,0sleep01846-21nfsd21:47:550
130512200,1sleep213052-21grep21:06:522
127982200,1sleep012796-21bash21:12:430
7193991915,3cyclictest16210-21grepconf.sh22:23:563
719299192,3cyclictest4050-21grepconf.sh23:03:582
719199199,1cyclictest26-21ksoftirqd/123:57:591
719199198,2cyclictest26-21ksoftirqd/123:40:441
7191991910,1cyclictest26-21ksoftirqd/123:02:321
719199190,1cyclictest5732-21kworker/1:120:49:431
39332190,0sleep23928-21sshd23:08:182
323462190,0sleep20-21swapper/221:45:162
278792190,0sleep027884-21bash22:15:210
273882190,1sleep127387-21grepconf.sh23:46:081
173782190,0sleep117375-21sshd00:01:031
154032190,0sleep115402-21sshd21:05:311
13742190,1sleep1854-21rngd21:38:221
719299181,3cyclictest488-21grepconf.sh21:13:402
719199187,1cyclictest26-21ksoftirqd/123:24:361
719199187,1cyclictest26-21ksoftirqd/121:14:381
719199184,3cyclictest26-21ksoftirqd/121:40:281
719199184,3cyclictest26-21ksoftirqd/121:40:281
7190991815,1cyclictest20240-21grep22:09:100
70682180,0sleep27019-21sshd21:00:472
31012180,0sleep11846-21nfsd22:33:451
302972180,0sleep10-21swapper/119:29:361
257702180,0sleep20-21swapper/222:46:052
136312180,0sleep30-21swapper/323:36:283
119482180,1sleep0141rcuc/023:05:430
7192991715,1cyclictest606-21systemd-journal23:48:092
719199175,1cyclictest26-21ksoftirqd/123:09:361
7191991715,1cyclictest26-21ksoftirqd/122:39:111
7191991712,1cyclictest26-21ksoftirqd/122:14:291
66322170,0sleep20-21swapper/223:33:232
37092170,0sleep00-21swapper/022:49:280
123562170,1sleep212345-21bash23:34:592
7193991614,1cyclictest20515-21sshd22:28:433
7193991613,1cyclictest21587-21sshd21:24:453
7193991612,3cyclictest16375-21sshd23:58:003
719299162,3cyclictest2863-21id20:54:452
7192991614,1cyclictest1-21systemd23:14:182
719299161,1cyclictest24570-21bash22:06:242
719299160,2cyclictest606-21systemd-journal21:31:212
719199167,1cyclictest26-21ksoftirqd/123:49:231
719199165,3cyclictest26-21ksoftirqd/123:34:261
163022160,0sleep00-21swapper/021:21:370
7193991513,1cyclictest879-21systemd-logind21:55:153
7193991513,1cyclictest606-21systemd-journal22:49:113
7193991513,1cyclictest3757-21sshd22:08:253
7193991513,1cyclictest24608-21sshd22:40:193
7193991513,1cyclictest22550-21sshd23:16:263
7193991512,2cyclictest20933-21sshd21:46:113
7193991511,1cyclictest23018-21bash22:09:183
719299154,1cyclictest35-21ksoftirqd/221:19:092
719299153,3cyclictest35-21ksoftirqd/222:33:142
719299152,3cyclictest14417-21id23:53:172
719299152,1cyclictest2185-21grepconf.sh21:51:012
719299152,1cyclictest20476-21sshd22:43:012
7192991513,1cyclictest906-21in:imuxsock21:55:062
7192991513,1cyclictest8336-21sshd22:35:202
7192991513,1cyclictest25810-21sshd22:18:162
719299151,1cyclictest6493-21sshd00:12:542
719299151,1cyclictest0-21swapper/221:43:522
719299151,1cyclictest0-21swapper/221:43:522
719299150,12cyclictest0-21swapper/222:13:222
719199154,2cyclictest26-21ksoftirqd/121:26:001
7190991513,1cyclictest26765-21sshd21:03:100
7190991513,1cyclictest19940-21sshd21:24:410
7190991512,2cyclictest879-21systemd-logind20:56:480
7190991512,2cyclictest8749-21sshd23:27:390
7190991512,2cyclictest23103-21sshd23:12:030
719099150,1cyclictest24113-21sshd00:10:380
36402150,0sleep33643-21bash23:48:073
252752150,0sleep20-21swapper/221:36:342
16012150,0sleep30-21swapper/323:52:403
719399147,1cyclictest1846-21nfsd23:42:493
7193991412,1cyclictest6034-21sshd22:29:303
7193991412,1cyclictest32032-21sshd22:17:033
7193991412,1cyclictest29196-21sshd20:58:553
7193991412,1cyclictest23100-21sshd21:51:593
7193991412,1cyclictest1-21systemd22:39:083
7193991411,2cyclictest18683-21sshd00:07:163
719299148,3cyclictest0-21swapper/222:00:012
719299145,2cyclictest35-21ksoftirqd/223:55:452
719299142,1cyclictest341ktimersoftd/222:54:402
7192991411,1cyclictest6254-21sshd23:11:182
719099142,10cyclictest19348-21sshd22:30:050
7190991412,1cyclictest879-21systemd-logind23:29:280
7190991412,1cyclictest7328-21sshd22:20:250
7190991412,1cyclictest31972-21sshd23:02:190
7190991412,1cyclictest22570-21sshd23:14:560
127272140,2sleep3431ktimersoftd/300:13:123
7193991311,1cyclictest879-21systemd-logind21:59:473
7193991311,1cyclictest5026-21sshd21:37:063
719399131,10cyclictest925-21gdbus22:55:393
7193991310,1cyclictest1-21systemd23:04:363
719399130,3cyclictest32426-21sshd00:00:153
719399130,1cyclictest13401-21sshd21:14:153
719299131,2cyclictest14524-21sshd22:52:482
719299130,12cyclictest857-21dbus-daemon21:19:572
7190991311,1cyclictest24556-21bash23:35:310
719099130,1cyclictest0-21swapper/023:21:440
719099130,1cyclictest0-21swapper/021:30:590
719399121,10cyclictest26077-21sshd23:29:553
719399120,1cyclictest0-21swapper/320:34:393
719099121,1cyclictest5257-21sshd00:05:060
719399110,9cyclictest0-21swapper/318:54:113
719399110,2cyclictest26999-21perl19:24:263
719299118,2cyclictest19198-21tune2fs19:09:322
719199119,1cyclictest28152sleep120:43:301
719199110,10cyclictest10057-21grep18:54:121
719099119,1cyclictest0-21swapper/018:49:340
719099118,2cyclictest10469-21sort18:54:120
719099110,1cyclictest0-21swapper/019:04:300
719099110,10cyclictest31687-21nfsd420:34:370
719099110,10cyclictest23267-21fschecks_time20:19:320
719099110,10cyclictest0-21swapper/019:24:320
719399109,0cyclictest0-21swapper/318:50:273
719399100,9cyclictest0-21swapper/320:40:073
719399100,9cyclictest0-21swapper/319:31:343
719399100,9cyclictest0-21swapper/319:12:453
719399100,0cyclictest0-21swapper/319:07:393
719299108,1cyclictest0-21swapper/218:54:112
719299100,1cyclictest16617-21perl19:04:302
719299100,1cyclictest0-21swapper/218:59:322
719299100,0cyclictest0-21swapper/220:03:202
719199108,1cyclictest2406-21perl19:39:301
719199108,1cyclictest21811-21perl19:14:291
719199108,1cyclictest14025-21cat18:59:321
719199108,1cyclictest0-21swapper/119:24:261
719199100,9cyclictest0-21swapper/120:34:511
719199100,9cyclictest0-21swapper/119:54:361
719199100,1cyclictest4024-21smartctl20:44:321
719199100,1cyclictest19146-21perl19:09:321
719099109,0cyclictest0-21swapper/020:04:440
719099108,1cyclictest14022-21perl18:59:320
719099100,9cyclictest20679-21perl20:14:260
719099100,9cyclictest19640-21strings19:09:360
719099100,9cyclictest0-21swapper/020:39:280
719099100,0cyclictest0-21swapper/019:47:390
719099100,0cyclictest0-21swapper/019:36:050
719099100,0cyclictest0-21swapper/019:36:050
719099100,0cyclictest0-21swapper/019:16:030
71939998,0cyclictest0-21swapper/320:03:593
71939998,0cyclictest0-21swapper/319:43:113
71939998,0cyclictest0-21swapper/318:59:333
71939997,1cyclictest0-21swapper/319:14:343
71939996,2cyclictest953-21sed19:34:393
71939996,2cyclictest953-21sed19:34:393
71939990,9cyclictest0-21swapper/319:49:263
71939990,0cyclictest0-21swapper/320:24:403
71929990,2cyclictest0-21swapper/220:34:302
71929990,2cyclictest0-21swapper/220:31:082
71929990,2cyclictest0-21swapper/220:31:082
71929990,2cyclictest0-21swapper/218:49:332
71929990,0cyclictest331rcuc/220:19:322
71929990,0cyclictest0-21swapper/220:44:322
71919998,0cyclictest0-21swapper/120:33:001
71919998,0cyclictest0-21swapper/120:33:001
71919998,0cyclictest0-21swapper/120:24:311
71919998,0cyclictest0-21swapper/120:20:551
71919998,0cyclictest0-21swapper/119:22:421
71909998,0cyclictest0-21swapper/020:31:200
71909998,0cyclictest0-21swapper/020:31:200
71909998,0cyclictest0-21swapper/020:12:240
71909990,0cyclictest0-21swapper/020:45:380
71909990,0cyclictest0-21swapper/019:49:270
71939987,0cyclictest0-21swapper/320:32:483
71939987,0cyclictest0-21swapper/320:32:483
71929988,0cyclictest0-21swapper/219:49:272
71929987,0cyclictest0-21swapper/219:41:102
71929986,1cyclictest0-21swapper/220:14:272
71929980,1cyclictest14984-21cstates20:04:262
71929980,0cyclictest0-21swapper/219:56:092
71919987,0cyclictest0-21swapper/118:53:401
71939976,0cyclictest0-21swapper/320:46:233
71939976,0cyclictest0-21swapper/320:17:213
71939976,0cyclictest0-21swapper/320:13:033
71939975,1cyclictest23905-21ntpdc20:19:373
71939970,1cyclictest24307-21perl19:19:333
71939970,1cyclictest11606-21proftpd19:56:093
71929975,1cyclictest0-21swapper/220:39:292
71929975,1cyclictest0-21swapper/219:24:262
71929972,2cyclictest35-21ksoftirqd/219:44:282
71929971,3cyclictest35-21ksoftirqd/219:14:252
71929971,2cyclictest35-21ksoftirqd/220:09:262
71929970,1cyclictest92150irq/27-p4p1-tx-20:24:222
71929970,1cyclictest32310-21sh19:34:312
71929970,1cyclictest32310-21sh19:34:312
71929970,1cyclictest0-21swapper/219:30:352
71929970,0cyclictest0-21swapper/219:19:322
71919976,0cyclictest0-21swapper/120:00:351
71919975,1cyclictest0-21swapper/119:04:311
71919973,1cyclictest26-21ksoftirqd/120:14:311
71919970,1cyclictest111rcu_preempt20:09:101
71909976,0cyclictest0-21swapper/020:25:180
71909970,1cyclictest30007-21/usr/sbin/munin19:29:330
71909970,1cyclictest25056-21ntp_states19:19:380
71939964,1cyclictest65672sleep319:48:403
71939963,1cyclictest431ktimersoftd/320:04:273
71919961,2cyclictest121rcu_sched19:44:331
71919961,1cyclictest19803-21latency_hist20:14:101
71919960,1cyclictest111rcu_preempt19:34:281
71919960,1cyclictest111rcu_preempt19:34:281
71919960,0cyclictest0-21swapper/119:49:211
71909964,1cyclictest115812sleep019:55:500
71909960,5cyclictest0-21swapper/019:42:120
71909950,0cyclictest0-21swapper/019:59:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional