You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-07-29 - 17:21

Intel(R) Xeon(R) CPU E3-1220L V2 @ 2.30GHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #9, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack9slot0.osadl.org (updated Thu Jul 29, 2021 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1831121390,2sleep0553399cyclictest09:52:190
726521270,1sleep2877-21polkitd11:21:382
58392840,1sleep05842-21grepconf.sh10:24:010
250702790,1sleep11472-21nfsd09:10:311
250702790,1sleep11472-21nfsd09:10:311
312612780,0sleep20-21swapper/210:12:162
172172770,0sleep10-21swapper/112:05:261
168102770,0sleep21-21systemd11:58:502
82732740,1sleep28272-21sshd11:00:342
304882730,5sleep130484-21systemd-cgroups11:35:161
38802720,0sleep30-21swapper/310:51:213
8372700,0sleep1835-21sshd10:54:041
62672680,0sleep10-21swapper/111:27:101
37032680,1sleep2341ktimersoftd/210:36:172
6992670,0sleep3421rcuc/310:12:263
47532650,0sleep00-21swapper/011:32:470
39932650,1sleep23992-21sshd10:05:592
34752650,0sleep10-21swapper/111:11:511
222352640,0sleep20-21swapper/211:10:362
44792620,0sleep20-21swapper/211:18:182
282742610,1sleep028276-21grepconf.sh11:56:510
194872610,0sleep00-21swapper/011:10:180
143872610,0sleep30-21swapper/311:33:463
11832590,2sleep2554499cyclictest10:02:272
249532570,3sleep2554499cyclictest11:31:402
74652560,1sleep2341ktimersoftd/210:39:262
511025626,9sleep20-21swapper/206:56:522
504925641,9sleep10-21swapper/106:56:111
134602530,1sleep01473-21nfsd10:30:500
528425123,9sleep30-21swapper/306:59:023
528124531,8sleep00-21swapper/006:58:590
26802260,0sleep00-21swapper/011:48:220
301632240,0sleep00-21swapper/012:15:550
151432240,1sleep1818-21dbus-daemon10:30:591
83962220,1sleep08366-21sshd09:39:000
143092220,1sleep314310-21grep10:42:523
300712210,1sleep330067-21smartctl10:44:163
300712210,1sleep330067-21smartctl10:44:163
136582210,1sleep21-21systemd10:27:442
136582210,1sleep21-21systemd10:27:442
237242200,0sleep10-21swapper/109:16:081
237242200,0sleep10-21swapper/109:16:081
322692190,0sleep10-21swapper/109:38:171
137072190,1sleep0141rcuc/009:15:110
137072190,1sleep0141rcuc/009:15:110
554499185,5cyclictest9453-21bash12:07:372
554499184,2cyclictest818-21dbus-daemon09:34:532
554499176,3cyclictest29780-21bash12:12:282
243342170,1sleep024335-21bash11:20:080
554499165,6cyclictest29303-21sshd09:43:502
554499165,6cyclictest29303-21sshd09:43:502
554499165,3cyclictest818-21dbus-daemon10:56:382
554499165,3cyclictest29668-21systemd11:08:182
554499165,3cyclictest27542-21sshd10:50:282
554499164,6cyclictest20451-21systemd09:52:282
554499164,5cyclictest8691-21bash11:48:532
554499163,3cyclictest17123-21rm12:17:492
554499162,13cyclictest1473-21nfsd09:24:542
5533991613,2cyclictest817-21systemd-logind09:04:470
268492160,0sleep00-21swapper/010:56:470
113462160,0sleep00-21swapper/009:48:340
113462160,0sleep00-21swapper/009:48:340
554899151,13cyclictest9744-21grepconf.sh09:04:433
554899151,13cyclictest87450irq/26-p4p1-rx-11:04:283
5548991511,1cyclictest44-21ksoftirqd/312:26:203
5548991510,2cyclictest0-21swapper/310:37:583
554899150,1cyclictest817-21systemd-logind10:55:303
554899150,14cyclictest0-21swapper/311:49:223
554499155,3cyclictest8665-21grepconf.sh10:45:232
554499155,3cyclictest8665-21grepconf.sh10:45:232
554499155,3cyclictest29872-21bash09:16:422
554499155,3cyclictest29872-21bash09:16:422
554499155,3cyclictest1457-21bash12:19:272
554499155,2cyclictest25233-21grepconf.sh10:22:572
554499154,5cyclictest3828-21bash10:33:122
554499154,5cyclictest2552-21bash11:42:572
554499154,3cyclictest6669-21bash09:23:252
554499154,3cyclictest28936-21sshd09:10:512
554499154,3cyclictest28936-21sshd09:10:512
554499154,3cyclictest25731-21consoletype12:28:342
554499154,3cyclictest17415-21grep09:33:502
554499154,3cyclictest17415-21grep09:33:502
554499154,3cyclictest1-21systemd11:26:352
554499154,3cyclictest1-21systemd10:14:192
554499154,3cyclictest1-21systemd09:58:462
554499154,3cyclictest11359-21sshd09:04:522
554499153,3cyclictest3455-21bash12:00:432
553399150,1cyclictest9780-21systemd-cgroups10:51:540
78252140,0sleep00-21swapper/009:59:480
554899143,10cyclictest431ktimersoftd/309:43:013
554899143,10cyclictest431ktimersoftd/309:43:013
5548991411,2cyclictest30714-21sshd11:42:373
5548991411,2cyclictest29159-21sshd10:26:103
5548991411,2cyclictest29159-21sshd10:26:103
5548991411,2cyclictest0-21swapper/309:44:453
5548991411,2cyclictest0-21swapper/309:44:453
5548991410,2cyclictest9263-21sshd11:55:023
554499144,4cyclictest1-21systemd11:34:382
554499144,3cyclictest18893-21grepconf.sh09:01:132
554499144,3cyclictest18893-21grepconf.sh09:01:132
554499144,2cyclictest11429-21bash11:49:102
554499143,5cyclictest3122-21bash09:44:202
554499143,5cyclictest3122-21bash09:44:202
5538991412,1cyclictest20867-21systemd-cgroups11:19:461
5538991412,1cyclictest17739-21systemd-cgroups10:37:291
5538991411,2cyclictest28266-21sshd11:02:201
5538991411,2cyclictest18168-21sshd09:39:481
5538991411,2cyclictest18168-21sshd09:39:481
5538991411,1cyclictest31437-21sshd10:20:391
553899140,13cyclictest6547-21systemd09:51:161
5533991411,2cyclictest7465-21sshd09:09:050
5533991411,2cyclictest7465-21sshd09:09:050
553399140,2cyclictest1-21systemd11:02:350
553399140,13cyclictest15897-21sshd10:13:470
5548991311,0cyclictest431ktimersoftd/309:29:283
5548991311,0cyclictest431ktimersoftd/309:29:283
554899130,1cyclictest0-21swapper/310:01:503
553899136,3cyclictest12937-21kill09:54:331
5538991311,1cyclictest11969-21systemd-cgroups09:04:551
553899130,12cyclictest10973-21bash09:30:281
553899130,12cyclictest10973-21bash09:30:281
553899130,12cyclictest0-21swapper/110:01:431
5533991311,1cyclictest12775-21sshd12:20:310
5533991310,2cyclictest21115-21sshd12:05:460
553399130,1cyclictest0-21swapper/010:35:450
553399130,1cyclictest0-21swapper/009:21:030
553399130,12cyclictest0-21swapper/010:41:190
554899129,2cyclictest597-21systemd-journal09:49:273
554899129,2cyclictest22881-21systemd12:03:043
554899129,2cyclictest0-21swapper/312:18:303
554899124,1cyclictest44-21ksoftirqd/311:12:313
554899123,4cyclictest818-21dbus-daemon10:15:163
554899120,1cyclictest87450irq/26-p4p1-rx-09:56:503
554899120,11cyclictest8521-21systemd12:10:323
554899120,11cyclictest421rcuc/311:00:403
554499124,3cyclictest2237-21missed_timers08:54:272
554499123,6cyclictest8226-21fschecks_count07:04:022
554499123,3cyclictest31932-21latency08:49:192
554499123,3cyclictest2383-21latency_hist07:54:032
554499121,1cyclictest0-21swapper/208:14:442
553899129,2cyclictest11018-21sshd12:10:451
5538991210,1cyclictest24536-21systemd-cgroups10:53:151
5538991210,1cyclictest1473-21nfsd08:20:111
5538991210,1cyclictest0-21swapper/111:05:501
5538991210,1cyclictest0-21swapper/110:48:251
5538991210,1cyclictest0-21swapper/110:48:251
553899120,1cyclictest26075-21sshd11:59:381
553899120,1cyclictest11940-21sshd08:59:551
553899120,1cyclictest11940-21sshd08:59:551
5533991210,1cyclictest30383-21sshd11:05:290
5533991210,1cyclictest24835-21systemd-cgroups10:25:420
5533991210,1cyclictest24835-21systemd-cgroups10:25:420
5533991210,1cyclictest0-21swapper/009:41:510
5533991210,1cyclictest0-21swapper/009:41:510
283622120,1sleep1241rcuc/110:08:351
192342120,0sleep00-21swapper/011:34:150
60722110,0sleep30-21swapper/308:59:153
60722110,0sleep30-21swapper/308:59:153
554899119,1cyclictest818-21dbus-daemon12:08:383
554899119,1cyclictest7364-21sshd09:09:053
554899119,1cyclictest7364-21sshd09:09:053
554899119,1cyclictest2653-21systemd11:14:543
554899114,4cyclictest44-21ksoftirqd/310:06:503
554899113,1cyclictest44-21ksoftirqd/311:44:243
554899111,7cyclictest7520-21kworker/3:211:24:283
554899110,10cyclictest44-21ksoftirqd/311:37:243
554899110,10cyclictest0-21swapper/309:14:123
554899110,10cyclictest0-21swapper/309:14:123
554899110,0cyclictest16887-21sshd09:24:293
554899110,0cyclictest0-21swapper/310:21:003
554899110,0cyclictest0-21swapper/309:35:553
554499114,3cyclictest16080-21awk07:14:292
554499114,2cyclictest18137-21grep07:19:272
554499113,5cyclictest20778-21grep07:24:272
554499113,3cyclictest7591-21/usr/sbin/munin08:04:172
554499113,3cyclictest26972-21sed07:39:022
554499113,3cyclictest24745-21switchtime08:34:242
554499113,3cyclictest24745-21switchtime08:34:242
554499112,3cyclictest5260-21expr07:59:202
554499112,3cyclictest14006-21cat07:14:022
554499110,10cyclictest0-21swapper/208:09:312
554499110,10cyclictest0-21swapper/207:54:242
553899119,1cyclictest0-21swapper/112:15:251
553899119,1cyclictest0-21swapper/111:46:091
553899119,1cyclictest0-21swapper/111:31:031
553899116,4cyclictest10425-21grepconf.sh10:16:011
553899112,3cyclictest5595-21sshd09:47:591
553899112,3cyclictest5595-21sshd09:47:591
553899111,6cyclictest23769-21kworker/1:310:13:441
553899111,3cyclictest11492-21sshd11:58:181
5538991110,0cyclictest0-21swapper/111:51:091
5538991110,0cyclictest0-21swapper/108:39:211
553899110,3cyclictest26195-21sshd12:28:361
553399119,1cyclictest8742-21systemd11:40:270
553399110,10cyclictest0-21swapper/011:18:160
553399110,10cyclictest0-21swapper/009:00:150
553399110,10cyclictest0-21swapper/009:00:150
553399110,10cyclictest0-21swapper/008:21:200
553399110,0cyclictest0-21swapper/009:55:260
554899106,3cyclictest0-21swapper/308:19:393
554899102,2cyclictest818-21dbus-daemon09:21:033
554899100,6cyclictest19280-21kworker/3:012:23:563
554499104,2cyclictest26573-21sed08:39:182
554499103,3cyclictest8395-21timerwakeupswit07:04:032
554499103,3cyclictest28422-21awk07:39:212
554499103,3cyclictest0-21swapper/208:19:192
554499103,2cyclictest22307-21df_abs07:29:222
554499103,2cyclictest21900-21awk08:29:272
554499103,2cyclictest18665-21perl08:24:192
554499102,3cyclictest0-21swapper/207:44:282
553899108,1cyclictest14001-21sshd09:27:531
553899105,4cyclictest25109-21sshd10:40:571
553899102,2cyclictest2538-21sshd09:20:001
553899100,3cyclictest1473-21nfsd11:39:351
553399109,0cyclictest0-21swapper/009:25:210
553399109,0cyclictest0-21swapper/008:13:260
553399109,0cyclictest0-21swapper/007:37:260
553399106,2cyclictest17793-21sshd11:25:170
553399104,3cyclictest11410-21kworker/u8:111:53:190
553399102,2cyclictest877-21polkitd09:31:340
553399102,2cyclictest877-21polkitd09:31:340
553399100,9cyclictest0-21swapper/007:17:410
553399100,5cyclictest838-21NetworkManager12:25:080
553399100,0cyclictest0-21swapper/008:34:190
553399100,0cyclictest0-21swapper/008:34:190
553399100,0cyclictest0-21swapper/008:25:240
553399100,0cyclictest0-21swapper/007:54:230
553399100,0cyclictest0-21swapper/007:45:270
553399100,0cyclictest0-21swapper/007:29:530
55489992,2cyclictest0-21swapper/307:19:233
55489991,3cyclictest29151-21sshd10:29:173
55489991,1cyclictest44-21ksoftirqd/311:20:133
55489990,2cyclictest0-21swapper/308:49:183
55449993,2cyclictest29109-21taskset08:44:342
55389998,0cyclictest0-21swapper/108:14:581
55389998,0cyclictest0-21swapper/107:49:311
55389998,0cyclictest0-21swapper/107:14:331
55389997,1cyclictest0-21swapper/107:29:251
55389996,2cyclictest31843-21bash12:22:331
55389994,4cyclictest5104-21bash11:15:071
55389990,8cyclictest18454-21kworker/1:410:24:551
55389990,8cyclictest18454-21kworker/1:410:24:551
55389990,1cyclictest0-21swapper/107:24:301
55389990,0cyclictest0-21swapper/107:11:321
55339998,0cyclictest0-21swapper/008:55:160
55339998,0cyclictest0-21swapper/008:50:440
55339998,0cyclictest0-21swapper/008:46:260
55339998,0cyclictest0-21swapper/008:33:460
55339998,0cyclictest0-21swapper/008:17:160
55339998,0cyclictest0-21swapper/008:06:000
55339998,0cyclictest0-21swapper/008:02:240
55339995,1cyclictest1065-21grep10:44:350
55339995,1cyclictest1065-21grep10:44:350
55339993,1cyclictest0-21swapper/010:16:140
55339990,8cyclictest19940-21kworker/0:410:04:460
55339990,7cyclictest2211-21kworker/0:212:13:580
55339990,0cyclictest0-21swapper/008:42:220
55489987,0cyclictest0-21swapper/308:14:573
55489981,2cyclictest0-21swapper/308:44:363
55489981,2cyclictest0-21swapper/307:24:223
55489980,5cyclictest0-21swapper/308:09:193
55389987,0cyclictest0-21swapper/108:04:301
55339986,1cyclictest20282-21systemd11:59:090
55339981,2cyclictest0-21swapper/007:19:240
55339980,7cyclictest2206-21awk07:54:020
55489976,0cyclictest0-21swapper/308:04:443
55489976,0cyclictest0-21swapper/307:32:263
55489975,1cyclictest10921-21/usr/sbin/munin07:04:313
55489973,3cyclictest0-21swapper/307:34:133
55489970,2cyclictest0-21swapper/308:39:203
55489970,2cyclictest0-21swapper/308:34:183
55489970,2cyclictest0-21swapper/308:34:183
55489970,2cyclictest0-21swapper/307:59:253
55489970,2cyclictest0-21swapper/307:14:213
55489970,1cyclictest31246-21smart_sda07:44:313
55489970,1cyclictest2873-21diskstats07:54:173
55489970,1cyclictest1868-21chrt07:50:133
55489970,1cyclictest18323-21df08:24:173
55489970,1cyclictest11936-21df07:09:153
55489970,1cyclictest0-21swapper/308:54:253
55489970,0cyclictest0-21swapper/308:32:583
55389970,5cyclictest0-21swapper/108:44:361
55389970,1cyclictest6442-21ntp_states07:59:281
55389970,1cyclictest0-21swapper/107:34:171
55339975,1cyclictest19293-21/usr/sbin/munin07:24:270
55339975,1cyclictest11741-21cpuspeed_turbos07:09:150
55339970,2cyclictest0-21swapper/007:39:180
55339970,2cyclictest0-21swapper/007:04:040
55339970,1cyclictest0-21swapper/006:59:250
55489964,1cyclictest77362sleep307:01:543
55489964,1cyclictest29215-21sshd07:41:533
55389965,0cyclictest0-21swapper/108:09:301
55389964,1cyclictest17538-21tail07:19:211
55389963,2cyclictest3572-21chrt07:54:231
55389963,2cyclictest30863-21grep08:49:111
55389962,2cyclictest0-21swapper/107:44:251
55389962,2cyclictest0-21swapper/107:04:031
55389962,2cyclictest0-21swapper/106:59:221
55389962,1cyclictest0-21swapper/108:29:171
55389960,4cyclictest0-21swapper/108:54:261
55389960,1cyclictest0-21swapper/107:39:181
55389953,1cyclictest22838-21kworker/1:008:34:091
55389953,1cyclictest22838-21kworker/1:008:34:091
55389953,1cyclictest18940-21gawk08:24:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional