You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-03 - 08:39

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #8, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack8slot0.osadl.org (updated Sun Jul 03, 2022 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3004721690,1sleep1241rcuc/121:47:111
1858521650,1sleep018579-21sshd23:57:560
2660621500,1sleep326609-21sshd00:32:073
3220521240,1sleep332198-21sshd00:26:343
2151621170,3sleep31687199cyclictest00:12:473
265382990,0sleep10-21swapper/122:23:551
66562940,1sleep16653-21sshd00:03:111
300242860,2sleep11-21systemd23:15:201
195582840,1sleep019546-21sshd00:17:050
296612820,2sleep029567-21systemd21:11:530
229462820,0sleep10-21swapper/100:24:361
198992820,1sleep10-21swapper/122:57:511
264082790,0sleep31846-21nfsd21:34:183
227512790,0sleep00-21swapper/021:07:200
111912790,1sleep111190-21sshd23:18:441
62362770,0sleep10-21swapper/123:24:101
179082770,3sleep31687199cyclictest21:05:393
288632760,1sleep2341ktimersoftd/223:29:282
23602760,2sleep02344-21sshd00:28:040
176122750,1sleep1241rcuc/121:38:091
87922740,1sleep01-21systemd23:47:060
74922740,1sleep17481-21bash23:42:461
322832720,1sleep032235-21sshd21:48:380
213942720,1sleep121395-21id23:53:281
148892710,0sleep21-21systemd21:42:142
117952710,1sleep01685299cyclictest22:34:450
156552700,0sleep10-21swapper/123:03:211
15532700,1sleep30-21swapper/322:35:443
247092690,0sleep3421rcuc/321:51:143
61952680,0sleep20-21swapper/222:13:022
247732680,0sleep10-21swapper/121:32:511
215082680,0sleep20-21swapper/222:09:292
176132680,0sleep20-21swapper/222:02:112
171792680,2sleep117182-21sshd22:22:111
311322670,0sleep00-21swapper/022:59:470
230882670,1sleep123087-21sshd22:00:581
53042660,1sleep05303-21grep22:13:000
115832660,0sleep10-21swapper/100:12:211
204592650,2sleep392150irq/27-p4p1-tx-22:32:193
173642650,1sleep017360-21systemd-cgroups23:38:520
173642650,1sleep017360-21systemd-cgroups23:38:520
120252650,1sleep212027-21grepconf.sh21:11:072
287942640,1sleep028793-21bash23:06:450
45142630,0sleep30-21swapper/323:18:263
305072630,1sleep030492-21bash21:20:230
83242620,1sleep20-21swapper/222:24:332
7552620,0sleep00-21swapper/023:26:490
281612620,1sleep328162-21grepconf.sh00:08:343
259102620,0sleep325875-21cp22:08:143
207492620,2sleep01685299cyclictest23:56:320
253332610,1sleep125316-21bash23:39:131
253332610,1sleep125316-21bash23:39:131
271022600,0sleep20-21swapper/220:22:512
126122600,0sleep10-21swapper/119:52:581
91812590,0sleep30-21swapper/319:47:513
85622590,2sleep01685299cyclictest23:51:230
318612590,2sleep331851-21bash21:59:563
168352570,1sleep10-21swapper/121:07:051
1655825528,8sleep30-21swapper/319:01:173
185102540,0sleep30-21swapper/321:11:243
1633725025,8sleep10-21swapper/118:58:381
1637024823,8sleep20-21swapper/218:58:592
261032470,1sleep226098-21bash00:02:402
247942440,0sleep10-21swapper/100:27:401
1407624227,8sleep00-21swapper/018:57:410
1685799310,1cyclictest111rcu_preempt23:10:591
16857992724,2cyclictest26-21ksoftirqd/123:50:351
16857992624,1cyclictest26-21ksoftirqd/100:17:131
16857992619,1cyclictest26-21ksoftirqd/121:49:481
16857992611,1cyclictest26-21ksoftirqd/100:17:461
89382250,1sleep3421rcuc/322:21:493
35252250,1sleep11-21systemd21:57:171
287212250,1sleep228725-21id22:42:372
227982250,0sleep30-21swapper/300:05:253
16852992522,1cyclictest9-21ksoftirqd/023:17:520
56042240,0sleep00-21swapper/021:33:220
114182240,2sleep1241rcuc/122:04:471
292572230,1sleep0141rcuc/021:45:410
237432230,0sleep00-21swapper/023:29:140
1685799239,1cyclictest26-21ksoftirqd/123:29:521
16857992321,1cyclictest26-21ksoftirqd/122:14:501
16857992319,2cyclictest26-21ksoftirqd/122:32:541
16852992321,1cyclictest9-21ksoftirqd/022:38:070
16852992321,1cyclictest9-21ksoftirqd/022:18:010
12262230,1sleep01-21systemd22:52:450
93262220,1sleep3857-21dbus-daemon21:56:073
86932220,1sleep38696-21bash23:34:143
264972220,1sleep326494-21sshd21:25:523
190992220,1sleep219096-21bash21:05:422
1685799228,1cyclictest26-21ksoftirqd/122:11:541
16857992220,1cyclictest26-21ksoftirqd/122:38:191
16857992220,1cyclictest26-21ksoftirqd/121:24:581
16857992219,1cyclictest26-21ksoftirqd/121:31:281
16857992219,1cyclictest26-21ksoftirqd/100:00:191
16857992212,1cyclictest26-21ksoftirqd/121:08:001
16857992210,1cyclictest26-21ksoftirqd/122:46:361
165942220,1sleep216577-21sshd23:17:372
113682220,0sleep20-21swapper/200:10:492
99622210,2sleep09894-21systemd23:35:430
270862210,1sleep027084-21sshd00:08:310
262762210,1sleep326275-21bash21:38:313
196992210,1sleep319666-21sshd22:47:553
1687199210,10cyclictest4337-21grep23:05:413
16865992119,1cyclictest35-21ksoftirqd/223:04:002
16865992119,1cyclictest35-21ksoftirqd/200:21:482
1685799217,2cyclictest26-21ksoftirqd/122:54:501
1685799216,2cyclictest26-21ksoftirqd/121:15:591
16857992119,1cyclictest26-21ksoftirqd/122:47:511
16857992118,1cyclictest26-21ksoftirqd/122:28:111
16852992119,1cyclictest9-21ksoftirqd/022:44:480
310822200,1sleep231079-21systemd00:02:522
1687199200,2cyclictest7950-21sshd21:47:383
1687199200,11cyclictest20290-21grepconf.sh00:02:233
16865992017,2cyclictest35-21ksoftirqd/223:37:182
1686599200,18cyclictest26212-21kworker/2:300:25:562
16857992017,1cyclictest26-21ksoftirqd/123:33:491
16852992010,1cyclictest9-21ksoftirqd/021:25:020
142432200,1sleep2879-21systemd-logind23:50:092
59402190,1sleep25941-21sshd22:20:152
1687199192,10cyclictest18805-21sshd00:21:273
1687199191,4cyclictest23792-21sshd22:06:453
16871991911,7cyclictest32006-21cp21:13:223
16871991911,6cyclictest26667-21sshd22:58:063
1687199191,10cyclictest0-21swapper/323:37:503
1687199191,10cyclictest0-21swapper/323:37:503
1687199190,2cyclictest879-21systemd-logind23:16:523
1687199190,1cyclictest0-21swapper/322:56:173
1687199190,18cyclictest3805-21sshd21:17:483
1687199190,18cyclictest11792-21bash23:52:593
16865991917,1cyclictest35-21ksoftirqd/221:32:412
16865991917,1cyclictest35-21ksoftirqd/221:17:012
16865991915,1cyclictest35-21ksoftirqd/223:08:142
16865991914,3cyclictest35-21ksoftirqd/221:57:162
16857991916,1cyclictest26-21ksoftirqd/121:18:061
16852991917,1cyclictest9-21ksoftirqd/022:02:400
19302180,2sleep21924-21grepconf.sh21:48:442
189972180,1sleep018998-21grepconf.sh21:31:100
1687199188,8cyclictest20427-21id22:43:373
1687199186,3cyclictest26966-21sshd23:23:383
16871991810,7cyclictest20512-21grepconf.sh22:37:583
1687199180,2cyclictest879-21systemd-logind23:49:543
1687199180,1cyclictest606-21systemd-journal23:44:053
1687199180,1cyclictest0-21swapper/323:07:453
1687199180,16cyclictest11517-21sshd21:29:243
1687199180,12cyclictest0-21swapper/322:15:053
1687199180,11cyclictest11726-21bash22:23:173
1687199180,10cyclictest857-21dbus-daemon23:28:003
16865991816,1cyclictest35-21ksoftirqd/223:55:222
16865991816,1cyclictest35-21ksoftirqd/222:57:312
16865991810,5cyclictest35-21ksoftirqd/222:35:472
16852991816,1cyclictest9-21ksoftirqd/023:11:580
16852991814,2cyclictest9-21ksoftirqd/022:28:040
16852991814,2cyclictest9-21ksoftirqd/021:56:100
16865991715,1cyclictest35-21ksoftirqd/223:44:592
16865991715,1cyclictest35-21ksoftirqd/223:24:132
16865991715,1cyclictest35-21ksoftirqd/222:58:332
16865991715,1cyclictest35-21ksoftirqd/221:28:012
16865991715,1cyclictest35-21ksoftirqd/221:17:512
16865991715,1cyclictest35-21ksoftirqd/200:27:502
16865991715,1cyclictest35-21ksoftirqd/200:15:262
16865991714,2cyclictest35-21ksoftirqd/223:20:182
16865991713,3cyclictest35-21ksoftirqd/222:47:332
1686599171,2cyclictest121rcu_sched22:50:002
1686599170,16cyclictest1607-21kworker/2:421:44:202
1686599170,15cyclictest13834-21kworker/2:323:40:222
1686599170,15cyclictest13834-21kworker/2:323:40:222
16852991715,1cyclictest9-21ksoftirqd/023:12:540
16852991715,1cyclictest9-21ksoftirqd/022:49:160
16852991715,1cyclictest9-21ksoftirqd/022:10:510
16852991715,1cyclictest31778-21grepconf.sh00:22:030
16852991714,1cyclictest9-21ksoftirqd/022:25:110
16852991713,2cyclictest9-21ksoftirqd/022:03:430
16852991713,1cyclictest9-21ksoftirqd/021:38:010
16852991713,1cyclictest9-21ksoftirqd/021:15:090
138622170,0sleep013859-21bash00:27:110
1687199160,10cyclictest0-21swapper/320:37:533
16865991614,1cyclictest35-21ksoftirqd/222:28:002
16865991614,1cyclictest35-21ksoftirqd/222:03:192
16865991614,1cyclictest35-21ksoftirqd/221:27:002
16852991614,1cyclictest9-21ksoftirqd/000:04:290
1687199150,1cyclictest0-21swapper/319:22:543
1687199148,5cyclictest0-21swapper/319:02:593
1687199147,1cyclictest4993-21grep19:38:023
1687199147,1cyclictest0-21swapper/319:12:413
1687199140,9cyclictest0-21swapper/320:32:523
1687199130,8cyclictest0-21swapper/320:27:543
1687199129,2cyclictest0-21swapper/320:14:483
1686599120,10cyclictest17940-21awk20:02:592
1687199119,1cyclictest44-21ksoftirqd/321:02:413
1687199110,1cyclictest0-21swapper/319:17:533
1687199110,10cyclictest0-21swapper/320:52:553
1687199110,0cyclictest0-21swapper/320:17:533
1686599110,9cyclictest19671-21fw_forwarded_lo19:07:412
1686599110,9cyclictest10734-21diskstats20:52:532
1686599110,9cyclictest0-21swapper/220:12:542
1686599110,9cyclictest0-21swapper/219:37:542
1686599110,1cyclictest5806-21perl20:42:542
1686599110,1cyclictest0-21swapper/220:57:552
1686599110,1cyclictest0-21swapper/220:07:522
1686599110,1cyclictest0-21swapper/219:32:552
1686599110,1cyclictest0-21swapper/219:02:542
1686599110,10cyclictest490-21fschecks_time20:32:532
1686599110,10cyclictest25912-21ntp_states20:17:592
1685799119,1cyclictest0-21swapper/119:47:531
1685799110,1cyclictest5087-21/usr/sbin/munin20:42:591
1685799110,1cyclictest0-21swapper/120:52:581
1685799110,10cyclictest29579-21grep19:22:581
1687199108,1cyclictest17990-21grep20:02:593
1687199100,9cyclictest6530-21ntpq20:43:003
1687199100,9cyclictest12860-21ntp_states19:53:003
1687199100,9cyclictest0-21swapper/319:35:113
1687199100,1cyclictest23904-21hddtemp_smartct19:12:553
1686599108,1cyclictest6997-21perl19:42:532
1686599108,1cyclictest24367-21nfsd419:12:592
1686599100,9cyclictest26823-21strings19:17:582
1686599100,9cyclictest0-21swapper/220:37:582
1686599100,1cyclictest29645-21ntp_states19:22:592
1685799108,1cyclictest27842-21perl20:22:541
1685799108,1cyclictest26403-21fw_conntrack19:17:541
1685799108,1cyclictest0-21swapper/120:02:541
1685799108,1cyclictest0-21swapper/119:27:531
1685799100,9cyclictest6224-21/usr/sbin/munin19:43:011
1685799100,9cyclictest14331-21ntpq20:58:001
1685799100,9cyclictest0-21swapper/120:47:531
1685799100,9cyclictest0-21swapper/120:27:591
1685799100,9cyclictest0-21swapper/120:17:541
1685799100,9cyclictest0-21swapper/119:12:541
1685799100,1cyclictest32711-21diskstats20:32:521
1685799100,1cyclictest0-21swapper/120:37:531
1685799100,1cyclictest0-21swapper/119:07:551
1685299109,0cyclictest0-21swapper/019:17:490
1685299109,0cyclictest0-21swapper/019:14:470
1685299108,1cyclictest8584-21hddtemp_smartct20:47:550
1685299108,1cyclictest27789-21perl20:22:540
1685299108,1cyclictest0-21swapper/020:42:540
1685299108,1cyclictest0-21swapper/020:32:530
1685299108,1cyclictest0-21swapper/020:17:590
1685299108,1cyclictest0-21swapper/019:07:410
1685299100,9cyclictest19684-21diskstats20:07:520
1685299100,9cyclictest1797-21fw_conntrack19:32:550
1685299100,9cyclictest17084-21diskstats20:02:540
1685299100,9cyclictest0-21swapper/020:12:540
1685299100,9cyclictest0-21swapper/019:57:540
1685299100,9cyclictest0-21swapper/019:42:530
1685299100,9cyclictest0-21swapper/019:22:590
1685299100,1cyclictest3857-21grep20:37:580
1685299100,1cyclictest13343-21diskstats20:57:540
1685299100,1cyclictest0-21swapper/020:52:530
1685299100,1cyclictest0-21swapper/020:27:530
1685299100,1cyclictest0-21swapper/019:38:030
1685299100,1cyclictest0-21swapper/019:02:540
168719998,0cyclictest0-21swapper/319:57:543
168719997,1cyclictest8141-21diskstats20:47:533
168719997,1cyclictest28510-21ntp_states20:23:003
168659990,0cyclictest0-21swapper/220:47:592
168659990,0cyclictest0-21swapper/219:49:282
168579997,1cyclictest14927-21smartctl19:57:551
168579990,6cyclictest121rcu_sched19:07:401
168579990,0cyclictest0-21swapper/120:07:521
168579990,0cyclictest0-21swapper/119:32:551
168529998,0cyclictest0-21swapper/019:31:030
168529990,0cyclictest0-21swapper/019:52:550
168529990,0cyclictest0-21swapper/019:48:290
168719987,0cyclictest0-21swapper/320:09:413
168659987,0cyclictest0-21swapper/219:54:282
168579980,0cyclictest0-21swapper/119:39:261
168719975,1cyclictest85682sleep319:47:273
168719975,1cyclictest1022-21runrttasks19:29:243
168659973,3cyclictest0-21swapper/220:30:042
168579970,1cyclictest23004-21memory20:12:571
168659960,5cyclictest0-21swapper/219:28:082
168659960,0cyclictest0-21swapper/219:57:502
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional