You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-01 - 00:09

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #8, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the alll highest latencies:
System rack8slot0.osadl.org (updated Thu Jun 30, 2022 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1275321600,2sleep02953199cyclictest10:41:220
151021430,1sleep12953299cyclictest11:32:031
2852421330,1sleep128475-21sshd09:42:331
485521210,2sleep32953499cyclictest11:43:363
2441321200,2sleep02953199cyclictest11:08:440
3032321130,0sleep30-21swapper/311:21:513
2667321060,0sleep01845-21nfsd09:53:430
163912900,2sleep316273-21sshd11:06:593
82732830,1sleep28264-21grepconf.sh10:35:272
302932800,1sleep330295-21kworker/u8:310:51:593
180652800,1sleep018032-21sshd10:48:360
33142790,1sleep23312-21grepconf.sh09:20:092
263272790,1sleep326314-21bash10:00:483
254282790,0sleep30-21swapper/309:35:143
37112780,0sleep20-21swapper/211:29:152
99202770,11sleep292050irq/26-p4p1-rx-10:32:422
64172770,1sleep26418-21systemd-cgroups12:26:332
119852770,1sleep021061-21httpd10:18:330
134292760,1sleep113397-21sshd09:57:291
26212750,2sleep12953299cyclictest09:27:141
228352730,0sleep30-21swapper/311:37:143
216312730,0sleep20-21swapper/212:21:282
184282730,1sleep018429-21grepconf.sh09:46:170
175082720,2sleep12953299cyclictest09:36:201
169712720,0sleep00-21swapper/010:16:000
292962710,1sleep3421rcuc/311:13:163
17662710,1sleep0101ktimersoftd/012:30:400
237562700,1sleep123737-21bash10:09:111
192502700,0sleep30-21swapper/310:27:303
15772690,1sleep328285-21kworker/3:512:12:023
134902690,1sleep013485-21bash09:22:030
242222680,0sleep10-21swapper/111:20:081
140452680,1sleep014046-21bash12:22:340
129112680,0sleep2331rcuc/209:50:162
111522680,0sleep111149-21sshd10:02:581
49812660,2sleep0141rcuc/009:25:560
252702660,1sleep1251ktimersoftd/112:04:271
229862660,1sleep022978-21sshd11:15:540
199992660,0sleep30-21swapper/312:17:083
288462650,1sleep128849-21grepconf.sh11:23:091
109992650,0sleep10-21swapper/111:33:511
259222640,1sleep025923-21grepconf.sh11:44:330
130572630,0sleep3421rcuc/309:47:283
278412610,1sleep227843-21sshd12:16:022
180342610,0sleep1251ktimersoftd/111:05:371
91702600,1sleep39168-21sshd10:28:263
182642560,1sleep018261-21grepconf.sh11:54:110
2895625125,8sleep00-21swapper/006:59:020
2894424329,8sleep30-21swapper/306:58:533
2901724228,8sleep20-21swapper/206:59:482
2899924228,8sleep10-21swapper/106:59:351
188442340,1sleep2331rcuc/211:11:232
194702330,1sleep319475-21bash09:19:263
29531992925,2cyclictest9-21ksoftirqd/010:24:090
45222280,2sleep04475-21sshd09:11:490
283982270,1sleep328399-21bash11:51:503
254762270,3sleep32953499cyclictest09:14:053
29531992623,1cyclictest9-21ksoftirqd/010:36:110
29534992512,11cyclictest44-21ksoftirqd/310:04:443
97762240,0sleep20-21swapper/211:39:302
297472240,1sleep329751-21grepconf.sh11:26:033
29531992422,1cyclictest9-21ksoftirqd/011:20:090
77902230,1sleep17735-21sshd12:09:201
29531992320,2cyclictest9-21ksoftirqd/012:09:360
29531992320,1cyclictest9-21ksoftirqd/011:49:570
15112230,0sleep10-21swapper/111:52:041
95442220,1sleep10-21swapper/111:02:281
29531992220,1cyclictest9-21ksoftirqd/009:16:160
29531992219,2cyclictest9-21ksoftirqd/011:04:590
29531992217,1cyclictest9-21ksoftirqd/011:26:340
216272220,1sleep31-21systemd12:31:313
205592220,2sleep12953299cyclictest12:19:581
154902220,2sleep215460-21bash09:03:372
86882210,2sleep38611-21sshd10:35:283
76622210,0sleep17661-21systemd-cgroups09:14:431
325392210,1sleep232524-21sshd10:54:552
325392210,1sleep232524-21sshd10:54:552
321972210,1sleep2857-21dbus-daemon09:44:032
316612210,2sleep231651-21bash10:16:382
29533992115,3cyclictest35-21ksoftirqd/211:22:002
29531992118,1cyclictest9-21ksoftirqd/009:41:200
29531992117,1cyclictest9-21ksoftirqd/009:51:350
256242210,1sleep2857-21dbus-daemon10:20:352
99602200,0sleep20-21swapper/209:12:032
98112200,0sleep20-21swapper/209:40:182
61052200,0sleep06106-21sshd11:30:500
314112200,1sleep231410-21systemd-cgroups11:56:142
302142200,1sleep030213-21grep11:34:430
298882200,0sleep2331rcuc/211:37:332
29532992016,1cyclictest26-21ksoftirqd/110:12:581
29531992017,1cyclictest9-21ksoftirqd/009:33:110
2953199201,2cyclictest121rcu_sched12:27:060
148662200,1sleep214863-21sshd09:23:302
106672200,1sleep2857-21dbus-daemon10:42:442
106472200,1sleep1879-21systemd-logind11:58:091
54922190,0sleep3421rcuc/310:09:503
299302190,0sleep129928-21sshd09:31:111
2953499190,17cyclictest12056-21systemd11:12:353
29533991917,1cyclictest35-21ksoftirqd/210:00:562
29533991916,2cyclictest35-21ksoftirqd/210:06:062
29532991917,1cyclictest26-21ksoftirqd/109:19:481
29532991916,2cyclictest857-21dbus-daemon10:39:591
29532991916,1cyclictest26-21ksoftirqd/110:45:281
29531991917,1cyclictest9-21ksoftirqd/011:38:020
29531991916,2cyclictest5744-21grepconf.sh10:32:310
29531991916,1cyclictest9-21ksoftirqd/010:57:410
29531991916,1cyclictest9-21ksoftirqd/010:57:410
29531991916,1cyclictest9-21ksoftirqd/010:12:140
29531991915,1cyclictest9-21ksoftirqd/010:00:580
275752190,1sleep327498-21sshd12:04:333
190512190,1sleep019046-21sshd10:04:410
163062190,0sleep10-21swapper/110:51:211
120352190,1sleep312032-21sshd11:53:543
80012180,1sleep1241rcuc/111:38:001
72362180,0sleep10-21swapper/110:55:141
72362180,0sleep10-21swapper/110:55:141
29534991813,1cyclictest44-21ksoftirqd/309:53:213
29533991815,2cyclictest35-21ksoftirqd/212:06:332
29533991815,1cyclictest35-21ksoftirqd/211:46:142
29532991816,1cyclictest26-21ksoftirqd/109:44:231
29532991814,2cyclictest26-21ksoftirqd/112:31:201
29531991816,1cyclictest9-21ksoftirqd/012:03:100
29531991816,1cyclictest9-21ksoftirqd/009:03:020
29531991813,1cyclictest13414-21sshd09:29:010
264932180,1sleep126452-21cp10:02:141
41282170,1sleep34125-21sshd09:41:313
300192170,0sleep10-21swapper/112:17:341
2953499175,10cyclictest23276-21uname12:18:393
29534991715,1cyclictest44-21ksoftirqd/310:39:073
29534991714,2cyclictest44-21ksoftirqd/310:44:203
29534991713,3cyclictest44-21ksoftirqd/309:51:483
29533991715,1cyclictest35-21ksoftirqd/211:26:432
29533991715,1cyclictest35-21ksoftirqd/211:00:192
29533991715,1cyclictest35-21ksoftirqd/210:08:402
29533991715,1cyclictest35-21ksoftirqd/209:57:072
29533991714,1cyclictest35-21ksoftirqd/210:47:032
29533991713,3cyclictest35-21ksoftirqd/209:36:562
29532991715,1cyclictest26-21ksoftirqd/110:20:151
29532991715,1cyclictest26-21ksoftirqd/109:50:511
29532991715,1cyclictest26-21ksoftirqd/109:04:211
29531991715,1cyclictest9-21ksoftirqd/012:13:050
29531991715,1cyclictest9-21ksoftirqd/011:58:200
29531991715,1cyclictest9-21ksoftirqd/010:42:540
29531991714,1cyclictest9-21ksoftirqd/010:58:430
164472170,0sleep30-21swapper/311:02:463
29534991614,1cyclictest44-21ksoftirqd/312:25:433
29534991614,1cyclictest44-21ksoftirqd/309:31:343
29534991613,2cyclictest44-21ksoftirqd/310:55:053
29534991613,2cyclictest44-21ksoftirqd/310:55:053
29534991613,1cyclictest44-21ksoftirqd/310:20:413
29534991613,1cyclictest44-21ksoftirqd/310:15:273
29533991614,1cyclictest35-21ksoftirqd/211:58:542
29533991614,1cyclictest35-21ksoftirqd/210:51:012
29533991613,2cyclictest857-21dbus-daemon09:13:232
29533991612,1cyclictest35-21ksoftirqd/211:13:272
29533991611,2cyclictest35-21ksoftirqd/209:30:102
2953399160,12cyclictest9365-21kill12:09:242
29532991614,1cyclictest26-21ksoftirqd/110:22:521
29532991613,2cyclictest30881-21rm11:56:121
29532991613,1cyclictest26-21ksoftirqd/111:43:101
219892160,2sleep121994-21bash10:31:491
2953499154,10cyclictest879-21systemd-logind11:57:543
29534991513,1cyclictest44-21ksoftirqd/309:06:033
29534991512,2cyclictest44-21ksoftirqd/309:11:003
29534991512,1cyclictest44-21ksoftirqd/311:39:223
2953499150,5cyclictest0-21swapper/309:25:173
29533991512,2cyclictest35-21ksoftirqd/211:04:062
2953399150,13cyclictest879-21systemd-logind10:24:382
29532991513,1cyclictest26-21ksoftirqd/111:14:491
29532991513,1cyclictest26-21ksoftirqd/111:11:531
29532991513,1cyclictest25867-21systemd-cgroups09:11:201
2953499140,13cyclictest20751-21sshd11:30:033
29533991411,2cyclictest35-21ksoftirqd/211:48:072
2953399140,4cyclictest13988-21grepconf.sh12:29:472
29532991412,1cyclictest26-21ksoftirqd/112:24:471
29531991412,1cyclictest4108-21/usr/sbin/munin07:13:010
29533991311,1cyclictest0-21swapper/207:43:052
2953299133,9cyclictest30879-21grepconf.sh10:33:331
29531991210,1cyclictest0-21swapper/007:53:040
2953499110,9cyclictest0-21swapper/307:52:583
2953499110,1cyclictest0-21swapper/307:48:053
2953499110,10cyclictest6095-21ntpq08:18:053
2953499110,10cyclictest19490-21tune2fs07:43:003
2953399118,2cyclictest21866-21df_inode07:47:582
2953399118,0cyclictest0-21swapper/207:37:592
2953399115,0cyclictest2175-21kworker/2:007:28:112
2953399111,1cyclictest0-21swapper/208:48:002
2953399110,9cyclictest0-21swapper/207:57:582
2953399110,9cyclictest0-21swapper/207:13:002
2953399110,1cyclictest8692-21ntp_states08:23:042
2953399110,1cyclictest0-21swapper/207:18:002
2953299119,1cyclictest0-21swapper/107:13:001
2953299110,10cyclictest32278-21diskstats08:07:581
2953299110,10cyclictest27414-21fw_conntrack07:57:591
2953299110,10cyclictest24466-21diskstats07:52:581
2953199119,1cyclictest0-21swapper/008:22:580
2953199118,2cyclictest16623-21df_inode07:37:580
2953199110,2cyclictest12419-21ntp_states07:28:040
2953199110,1cyclictest22318-21smartctl07:48:000
2953199110,1cyclictest0-21swapper/008:42:500
2953199110,1cyclictest0-21swapper/008:38:000
2953199110,10cyclictest729-21awk08:08:030
2953199110,10cyclictest30669-21ntp_states08:03:050
2953199110,10cyclictest20210-21ntp_states07:43:050
2953199110,10cyclictest14376-21fw_conntrack07:33:000
2953499108,1cyclictest27303-21grep07:57:583
2953499108,1cyclictest0-21swapper/308:43:053
2953499108,1cyclictest0-21swapper/307:37:593
2953499108,1cyclictest0-21swapper/307:22:583
2953499108,1cyclictest0-21swapper/307:07:593
2953499100,9cyclictest29945-21fschecks_time08:03:003
2953499100,9cyclictest21164-21smartctl08:48:003
2953499100,9cyclictest12111-21memory07:28:023
2953499100,9cyclictest0-21swapper/307:33:033
2953499100,1cyclictest3850-21perl07:13:003
2953499100,1cyclictest0-21swapper/309:02:333
2953499100,1cyclictest0-21swapper/308:28:073
2953499100,0cyclictest0-21swapper/308:08:233
2953499100,0cyclictest0-21swapper/307:18:003
2953399108,1cyclictest30612-21cut08:03:052
2953399108,1cyclictest14709-21memory07:33:032
2953399107,2cyclictest10617-21perl08:28:022
2953399100,9cyclictest0-21swapper/208:33:002
2953399100,9cyclictest0-21swapper/207:08:042
2953399100,1cyclictest9184-21fw_conntrack07:22:592
2953399100,1cyclictest6094-21ntp_states08:18:052
2953399100,1cyclictest25931-21diskstats08:58:002
2953399100,1cyclictest2499-21diskstats08:12:582
2953399100,1cyclictest24244-21grep08:53:042
2953399100,1cyclictest0-21swapper/208:43:042
2953399100,0cyclictest0-21swapper/208:07:582
2953399100,0cyclictest0-21swapper/207:53:132
2953299109,0cyclictest0-21swapper/108:28:011
2953299108,1cyclictest8841-21diskstats07:22:581
2953299108,1cyclictest24314-21ntp_states08:53:051
2953299108,1cyclictest0-21swapper/108:33:001
2953299100,9cyclictest27816-40dnf09:02:331
2953299100,9cyclictest22208-21perl07:47:591
2953299100,9cyclictest21171-21smartctl08:48:001
2953299100,9cyclictest0-21swapper/108:03:001
2953299100,9cyclictest0-21swapper/107:42:591
2953299100,9cyclictest0-21swapper/107:28:031
2953299100,1cyclictest6686-21hddtemp_smartct07:18:011
2953299100,1cyclictest1949-21grep07:08:041
2953299100,1cyclictest18885-21nfsd408:43:041
2953299100,1cyclictest16969-21fw_conntrack07:37:591
2953299100,1cyclictest0-21swapper/108:18:051
2953299100,1cyclictest0-21swapper/107:33:041
2953299100,0cyclictest0-21swapper/107:04:151
2953199108,1cyclictest9829-21ntp_states07:23:050
2953199108,1cyclictest2843-21fw_conntrack08:12:590
2953199108,1cyclictest23322-21diskstats08:52:580
2953199108,1cyclictest13331-21hddtemp_smartct08:33:010
2953199108,1cyclictest0-21swapper/008:58:010
2953199100,9cyclictest0-21swapper/007:58:340
2953199100,9cyclictest0-21swapper/007:07:470
295349990,0cyclictest0-21swapper/308:38:043
295349990,0cyclictest0-21swapper/308:33:053
295329998,0cyclictest0-21swapper/108:38:041
295329990,0cyclictest0-21swapper/108:23:041
295329990,0cyclictest0-21swapper/108:12:581
295319998,0cyclictest0-21swapper/008:17:510
295319990,0cyclictest0-21swapper/007:18:040
295349987,0cyclictest24068-21ls08:53:033
295349987,0cyclictest0-21swapper/308:13:033
295349986,1cyclictest30339-21perl07:03:003
295319981,1cyclictest0-21swapper/007:03:070
295319980,0cyclictest0-21swapper/008:30:170
295349975,1cyclictest7600-21cstates08:22:573
295339970,1cyclictest0-21swapper/207:03:052
21288270,1sleep021399-21memory08:48:020
295339960,0cyclictest0-21swapper/208:37:462
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional