You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-29 - 12:48

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #9, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack9slot0.osadl.org (updated Sun May 29, 2022 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
919521030,2sleep32613699cyclictest21:23:513
59642810,1sleep0141rcuc/022:41:300
131942780,0sleep00-21swapper/022:37:370
131942780,0sleep00-21swapper/022:37:370
181112740,1sleep2598-21systemd-journal23:58:172
195672710,1sleep1251ktimersoftd/100:18:161
151982690,1sleep2331rcuc/223:21:232
151982690,1sleep2331rcuc/223:21:232
41752680,2sleep32613699cyclictest00:20:513
41752680,2sleep32613699cyclictest00:20:513
26072670,0sleep2331rcuc/222:41:042
248312660,2sleep02613399cyclictest22:56:120
248312660,2sleep02613399cyclictest22:56:120
302182650,0sleep10-21swapper/121:32:181
293112640,0sleep20-21swapper/200:10:242
54772630,0sleep00-21swapper/000:26:040
43932600,0sleep10-21swapper/122:26:161
43932600,0sleep10-21swapper/122:26:161
191352580,0sleep30-21swapper/323:27:333
191352580,0sleep30-21swapper/323:27:333
32272560,1sleep3431ktimersoftd/322:26:063
32272560,1sleep3431ktimersoftd/322:26:063
2582825238,8sleep10-21swapper/119:03:531
2565125121,9sleep00-21swapper/019:01:390
193642490,3sleep32613699cyclictest22:38:323
193642490,3sleep32613699cyclictest22:38:323
2574524732,8sleep20-21swapper/219:02:492
2586424530,8sleep30-21swapper/319:04:193
104412260,1sleep01718-21nfsd21:47:080
104412260,1sleep01718-21nfsd21:47:080
49162200,8sleep35093-21grepconf.sh23:55:593
157002200,0sleep20-21swapper/222:16:392
84432190,1sleep28444-21kworker/u8:222:27:052
84432190,1sleep28444-21kworker/u8:222:27:052
288922190,0sleep21-21systemd21:38:162
288922190,0sleep21-21systemd21:38:162
26133991917,1cyclictest9-21ksoftirqd/022:31:570
226792190,0sleep10-21swapper/123:43:141
143052190,1sleep214308-21switchtime19:39:502
139862190,1sleep3598-21systemd-journal21:41:343
94002180,0sleep10-21swapper/122:21:191
26136991812,5cyclictest1-21systemd23:35:463
26136991812,5cyclictest1-21systemd23:35:463
26136991811,5cyclictest0-21swapper/321:56:553
20442170,1sleep12068-21runrttasks22:31:131
99402160,2sleep22613599cyclictest22:21:242
2613699162,4cyclictest848-21NetworkManager22:13:373
2613699162,4cyclictest848-21NetworkManager22:13:373
2613699160,10cyclictest0-21swapper/300:09:343
162482160,1sleep316244-21bash23:21:323
162482160,1sleep316244-21bash23:21:323
112692160,0sleep10-21swapper/121:19:281
46372150,0sleep00-21swapper/000:31:130
26136991510,0cyclictest0-21swapper/300:09:063
2613599153,1cyclictest30017-21sshd00:00:042
2613499150,14cyclictest26065-21kworker/1:022:43:571
2613399153,11cyclictest9-21ksoftirqd/000:23:450
2613399153,11cyclictest9-21ksoftirqd/000:23:450
2613399152,1cyclictest9-21ksoftirqd/023:08:070
2613399152,1cyclictest9-21ksoftirqd/023:08:070
26133991513,1cyclictest9-21ksoftirqd/021:04:410
26133991513,1cyclictest9-21ksoftirqd/021:04:410
26133991512,2cyclictest9-21ksoftirqd/022:08:040
26133991512,1cyclictest9-21ksoftirqd/023:02:540
26133991512,1cyclictest9-21ksoftirqd/023:02:540
2613399151,1cyclictest121rcu_sched22:48:370
2613399151,1cyclictest121rcu_sched22:48:370
20632150,0sleep30-21swapper/322:52:033
20632150,0sleep30-21swapper/322:52:033
281262140,0sleep30-21swapper/321:04:393
281262140,0sleep30-21swapper/321:04:393
264862140,0sleep10-21swapper/120:04:411
264862140,0sleep10-21swapper/120:04:411
26135991412,1cyclictest1-21systemd22:45:152
26135991412,1cyclictest1-21systemd22:45:152
26135991411,2cyclictest886-21gdbus23:48:232
26134991410,3cyclictest15708-21systemd00:12:581
2613499140,12cyclictest20245-21kworker/1:521:55:491
2613399147,1cyclictest9-21ksoftirqd/021:59:260
2613399145,3cyclictest9-21ksoftirqd/022:12:340
2613399145,3cyclictest9-21ksoftirqd/022:12:340
2613399142,1cyclictest9-21ksoftirqd/023:10:340
2613399142,1cyclictest9-21ksoftirqd/023:10:340
26133991412,1cyclictest9-21ksoftirqd/023:34:020
26133991412,1cyclictest9-21ksoftirqd/022:29:200
26133991412,1cyclictest9-21ksoftirqd/022:29:200
2613399141,1cyclictest9-21ksoftirqd/023:42:030
2613399141,1cyclictest9-21ksoftirqd/000:07:210
2613399140,2cyclictest121rcu_sched21:13:090
26136991311,1cyclictest1-21systemd21:46:143
26136991311,1cyclictest1-21systemd21:46:143
26136991311,1cyclictest0-21swapper/321:27:043
2613699130,1cyclictest806-21dbus-daemon21:30:053
2613699130,12cyclictest24515-21bash23:12:183
2613699130,12cyclictest24515-21bash23:12:183
2613599136,5cyclictest23865-21sshd22:29:382
26135991311,1cyclictest0-21swapper/221:44:172
26135991310,2cyclictest2814-21sshd21:22:542
26135991310,1cyclictest0-21swapper/200:33:452
26134991311,1cyclictest19861-21sshd22:49:201
26134991311,1cyclictest19861-21sshd22:49:201
26134991311,1cyclictest0-21swapper/121:19:261
26134991311,1cyclictest0-21swapper/121:19:261
2613499130,1cyclictest0-21swapper/123:34:391
2613499130,1cyclictest0-21swapper/123:34:391
2613499130,1cyclictest0-21swapper/119:24:401
2613499130,1cyclictest0-21swapper/119:24:401
2613499130,12cyclictest0-21swapper/122:14:571
2613399139,1cyclictest9-21ksoftirqd/023:51:140
2613399139,1cyclictest9-21ksoftirqd/023:51:140
2613399139,1cyclictest9-21ksoftirqd/023:38:000
2613399139,1cyclictest9-21ksoftirqd/023:38:000
2613399134,1cyclictest9-21ksoftirqd/022:14:510
2613399133,1cyclictest9-21ksoftirqd/021:32:410
2613399131,1cyclictest121rcu_sched21:21:260
26133991311,1cyclictest9-21ksoftirqd/022:50:200
26133991311,1cyclictest9-21ksoftirqd/022:50:200
26133991311,1cyclictest9-21ksoftirqd/022:22:250
26133991311,1cyclictest9-21ksoftirqd/021:49:560
26133991311,1cyclictest9-21ksoftirqd/021:49:560
26133991311,1cyclictest9-21ksoftirqd/021:41:510
26133991310,1cyclictest9-21ksoftirqd/023:24:340
26133991310,1cyclictest9-21ksoftirqd/023:24:340
2613399130,1cyclictest8608-21sshd00:12:040
2613399130,1cyclictest111rcu_preempt23:18:180
179732130,0sleep00-21swapper/023:47:170
2613699123,4cyclictest848-21NetworkManager00:15:063
26136991210,1cyclictest0-21swapper/323:15:193
2613599123,4cyclictest838-21systemd-logind23:13:482
2613599123,4cyclictest838-21systemd-logind23:13:482
26135991210,1cyclictest35-21ksoftirqd/222:13:272
26135991210,1cyclictest35-21ksoftirqd/222:13:272
26135991210,1cyclictest1469-21sshd23:39:582
26135991210,1cyclictest0-21swapper/223:50:462
26135991210,1cyclictest0-21swapper/223:50:462
2613499124,6cyclictest7273-21bash00:26:181
2613499120,11cyclictest12299-21irqstats20:39:421
2613499120,11cyclictest0-21swapper/122:11:281
2613499120,11cyclictest0-21swapper/122:11:281
2613399129,1cyclictest9-21ksoftirqd/021:16:370
2613399129,1cyclictest9-21ksoftirqd/021:16:370
2613399128,1cyclictest9-21ksoftirqd/021:38:000
2613399128,1cyclictest9-21ksoftirqd/021:38:000
2613399122,1cyclictest9-21ksoftirqd/023:56:130
2613399122,1cyclictest121rcu_sched23:20:090
2613399122,1cyclictest121rcu_sched23:20:090
26133991211,0cyclictest661-40kipmi019:29:430
26133991210,1cyclictest9-21ksoftirqd/022:04:240
26133991210,1cyclictest9-21ksoftirqd/022:04:240
26133991210,1cyclictest0-21swapper/020:09:460
2613399120,1cyclictest20027-21grepconf.sh21:25:200
2613399120,1cyclictest121rcu_sched00:00:010
2613399120,11cyclictest23283-21kworker/0:500:16:430
133752120,0sleep2341ktimersoftd/200:22:222
133752120,0sleep2341ktimersoftd/200:22:222
2613699119,1cyclictest0-21swapper/321:03:013
2613699118,2cyclictest806-21dbus-daemon22:57:363
2613699118,2cyclictest806-21dbus-daemon22:57:363
2613699117,2cyclictest884-21polkitd21:36:403
2613699117,2cyclictest884-21polkitd21:36:403
2613699112,5cyclictest14010-21systemd22:22:113
2613699110,1cyclictest1-21systemd00:25:203
2613699110,10cyclictest31864-21systemd23:29:413
2613699110,10cyclictest0-21swapper/322:17:563
2613699110,10cyclictest0-21swapper/321:10:133
2613699110,10cyclictest0-21swapper/319:46:213
2613599119,1cyclictest35-21ksoftirqd/222:04:242
2613599119,1cyclictest35-21ksoftirqd/222:04:242
2613599112,4cyclictest848-21NetworkManager23:34:552
2613599112,4cyclictest848-21NetworkManager23:34:552
2613599112,3cyclictest801-21nscd23:24:372
2613599112,3cyclictest801-21nscd23:24:372
2613599110,7cyclictest12350-21sshd21:13:092
2613599110,0cyclictest0-21swapper/221:26:512
2613499119,1cyclictest26648-21sshd00:24:141
2613499119,1cyclictest26648-21sshd00:24:141
2613499119,1cyclictest26-21ksoftirqd/123:56:121
2613499119,1cyclictest26-21ksoftirqd/100:03:321
2613499119,1cyclictest0-21swapper/122:01:291
2613499119,1cyclictest0-21swapper/122:01:291
2613499119,1cyclictest0-21swapper/121:36:441
2613499119,1cyclictest0-21swapper/121:36:441
26134991110,0cyclictest0-21swapper/121:40:131
26134991110,0cyclictest0-21swapper/100:31:471
2613499110,9cyclictest0-21swapper/121:53:521
2613499110,9cyclictest0-21swapper/121:53:521
2613499110,10cyclictest0-21swapper/123:13:371
2613499110,10cyclictest0-21swapper/123:13:371
2613499110,0cyclictest0-21swapper/123:21:381
2613499110,0cyclictest0-21swapper/123:21:381
26133991110,0cyclictest661-40kipmi020:24:410
2613699109,0cyclictest0-21swapper/323:50:383
2613699109,0cyclictest0-21swapper/323:50:383
2613699109,0cyclictest0-21swapper/322:45:213
2613699109,0cyclictest0-21swapper/322:45:213
2613699109,0cyclictest0-21swapper/320:37:423
2613699109,0cyclictest0-21swapper/320:30:373
2613699109,0cyclictest0-21swapper/320:15:383
2613699109,0cyclictest0-21swapper/320:13:253
2613699109,0cyclictest0-21swapper/320:05:033
2613699109,0cyclictest0-21swapper/320:05:033
2613699109,0cyclictest0-21swapper/319:58:543
2613699108,1cyclictest44-21ksoftirqd/322:01:353
2613699108,1cyclictest44-21ksoftirqd/322:01:353
2613699104,1cyclictest88150irq/26-p4p1-rx-22:29:573
2613699103,3cyclictest13544-21systemd00:32:473
2613699103,1cyclictest17952-21sshd22:43:313
2613699100,9cyclictest1-21systemd23:45:113
2613699100,9cyclictest0-21swapper/320:59:113
2613699100,6cyclictest848-21NetworkManager21:17:333
2613699100,6cyclictest848-21NetworkManager21:17:333
2613699100,6cyclictest28151-21sshd23:02:493
2613699100,6cyclictest28151-21sshd23:02:493
2613699100,4cyclictest8405-21sshd23:41:063
2613699100,0cyclictest29946-21systemd-cgroups00:00:033
2613699100,0cyclictest0-21swapper/321:52:513
2613699100,0cyclictest0-21swapper/321:52:513
2613699100,0cyclictest0-21swapper/320:52:273
2613699100,0cyclictest0-21swapper/320:26:123
2613699100,0cyclictest0-21swapper/319:39:303
2613699100,0cyclictest0-21swapper/319:24:243
2613599109,0cyclictest0-21swapper/222:35:372
2613599109,0cyclictest0-21swapper/222:35:372
2613599108,1cyclictest35-21ksoftirqd/223:04:422
2613599108,1cyclictest35-21ksoftirqd/223:04:422
2613599108,1cyclictest0-21swapper/221:56:212
2613599103,3cyclictest0-21swapper/200:24:472
2613599103,1cyclictest8012-21grep21:18:592
2613599103,1cyclictest8012-21grep21:18:592
2613599101,4cyclictest1-21systemd23:32:052
2613599101,4cyclictest0-21swapper/222:53:222
2613599101,4cyclictest0-21swapper/222:53:222
2613599100,9cyclictest5228-21kworker/2:623:15:102
2613599100,9cyclictest28110-21ystemctl21:04:392
2613599100,9cyclictest28110-21ystemctl21:04:392
2613599100,0cyclictest0-21swapper/223:00:102
2613599100,0cyclictest0-21swapper/223:00:102
2613599100,0cyclictest0-21swapper/221:53:592
2613599100,0cyclictest0-21swapper/221:53:592
2613599100,0cyclictest0-21swapper/221:49:072
2613599100,0cyclictest0-21swapper/221:49:072
2613599100,0cyclictest0-21swapper/220:39:242
2613599100,0cyclictest0-21swapper/219:18:292
2613499109,0cyclictest0-21swapper/123:07:001
2613499109,0cyclictest0-21swapper/123:07:001
2613499109,0cyclictest0-21swapper/122:36:341
2613499109,0cyclictest0-21swapper/122:36:341
2613499109,0cyclictest0-21swapper/122:07:591
2613499109,0cyclictest0-21swapper/119:19:471
2613499108,1cyclictest0-21swapper/119:15:021
2613499105,1cyclictest869-21rs:main1
2613499105,1cyclictest869-21rs:main1
2613499105,1cyclictest18094-21kworker/1:223:25:011
2613499105,1cyclictest18094-21kworker/1:223:25:011
2613499103,4cyclictest884-21polkitd21:28:041
2613499102,3cyclictest838-21systemd-logind23:46:101
2613499100,9cyclictest9210-21kworker/1:623:03:071
2613499100,9cyclictest9210-21kworker/1:623:03:071
2613499100,1cyclictest30401-21systemd21:04:471
2613499100,1cyclictest30401-21systemd21:04:471
2613499100,0cyclictest0-21swapper/123:30:341
2613499100,0cyclictest0-21swapper/120:14:371
2613399108,1cyclictest9-21ksoftirqd/021:04:260
2613399107,2cyclictest0-21swapper/020:29:420
2613399100,9cyclictest0-21swapper/019:35:480
2613399100,5cyclictest0-21swapper/019:24:480
2613399100,5cyclictest0-21swapper/019:24:480
261369998,0cyclictest0-21swapper/319:32:463
261369998,0cyclictest0-21swapper/319:09:043
261369990,8cyclictest6947-21kworker/3:722:05:313
261369990,2cyclictest14452-21sshd23:05:323
261369990,2cyclictest14452-21sshd23:05:323
261359998,0cyclictest0-21swapper/220:30:102
261359998,0cyclictest0-21swapper/220:27:092
261359998,0cyclictest0-21swapper/219:20:562
261359998,0cyclictest0-21swapper/219:04:542
261359997,1cyclictest35-21ksoftirqd/200:08:272
261359997,1cyclictest26549-21systemd21:31:392
261359996,2cyclictest7130-21sshd00:16:202
261359993,5cyclictest0-21swapper/222:04:552
261359992,1cyclictest661-40kipmi019:24:482
261359992,1cyclictest661-40kipmi019:24:482
261359990,8cyclictest0-21swapper/220:43:592
261359990,8cyclictest0-21swapper/219:35:132
261359990,4cyclictest0-21swapper/222:54:422
261359990,4cyclictest0-21swapper/222:54:422
261359990,0cyclictest0-21swapper/220:44:552
261349998,0cyclictest0-21swapper/121:45:481
261349998,0cyclictest0-21swapper/121:45:481
261349998,0cyclictest0-21swapper/121:13:441
261349998,0cyclictest0-21swapper/120:20:181
261349998,0cyclictest0-21swapper/119:39:391
261349996,2cyclictest22127-21systemd22:55:341
261349996,2cyclictest22127-21systemd22:55:341
261349993,5cyclictest0-21swapper/123:15:501
261349993,1cyclictest598-21systemd-journal23:49:321
261349993,1cyclictest598-21systemd-journal23:49:321
261349990,8cyclictest0-21swapper/119:31:171
261349990,4cyclictest886-21gdbus00:07:211
261349990,0cyclictest0-21swapper/120:26:001
261339998,0cyclictest904-21snmpd19:15:270
261339998,0cyclictest0-21swapper/020:39:480
261339998,0cyclictest0-21swapper/020:17:160
261339992,2cyclictest0-21swapper/019:54:420
261339990,0cyclictest0-21swapper/019:50:400
261369987,0cyclictest0-21swapper/319:26:303
261369987,0cyclictest0-21swapper/319:26:303
261369987,0cyclictest0-21swapper/319:15:273
261369987,0cyclictest0-21swapper/319:11:513
261359981,1cyclictest661-40kipmi020:49:432
261349987,0cyclictest0-21swapper/120:50:031
261349987,0cyclictest0-21swapper/120:11:081
261349980,2cyclictest0-21swapper/120:59:271
261339987,0cyclictest0-21swapper/020:59:120
261339987,0cyclictest0-21swapper/019:07:490
261339980,2cyclictest25347-21latency_hist20:04:250
261369976,0cyclictest0-21swapper/320:42:553
261369975,1cyclictest20063-21seq19:53:063
261369970,2cyclictest0-21swapper/320:44:413
261359971,0cyclictest661-40kipmi020:14:432
261359970,1cyclictest1718-21nfsd20:59:452
261359970,1cyclictest0-21swapper/220:54:262
261359970,1cyclictest0-21swapper/220:19:462
261359970,1cyclictest0-21swapper/220:09:262
261359970,1cyclictest0-21swapper/220:04:262
261359970,1cyclictest0-21swapper/220:04:262
261359970,1cyclictest0-21swapper/219:59:402
261359970,1cyclictest0-21swapper/219:54:372
261359970,1cyclictest0-21swapper/219:49:372
261359970,1cyclictest0-21swapper/219:44:252
261359970,1cyclictest0-21swapper/219:29:382
261359970,1cyclictest0-21swapper/219:09:262
261349976,0cyclictest0-21swapper/120:54:481
261349976,0cyclictest0-21swapper/120:00:131
261349972,2cyclictest0-21swapper/120:44:411
261349970,2cyclictest0-21swapper/120:34:421
261349970,1cyclictest30327-21fw_conntrack19:09:391
261349970,1cyclictest27766-21smart_sda19:04:471
261349970,1cyclictest21187-21fw_forwarded_lo19:54:401
261349970,1cyclictest201152chrt19:53:471
261349970,1cyclictest11698-21sshd19:34:531
261339976,0cyclictest0-21swapper/020:21:130
261339976,0cyclictest0-21swapper/020:07:380
261339976,0cyclictest0-21swapper/020:07:380
261339975,1cyclictest10243-21processes20:34:460
261339970,1cyclictest29048-21sed19:09:260
261339970,1cyclictest17141-21awk19:44:490
261339970,1cyclictest14899-21kernelversion20:44:410
261339970,1cyclictest13828-21missed_timers19:39:460
261339970,1cyclictest0-21swapper/020:49:400
261369965,0cyclictest0-21swapper/320:01:063
261369964,1cyclictest0-21swapper/320:19:413
261369962,2cyclictest0-21swapper/319:34:433
261349964,1cyclictest27712-21kworker/1:119:44:391
261349960,2cyclictest0-21swapper/120:29:411
261339960,5cyclictest0-21swapper/019:19:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional