You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-09-30 - 18:28
/usr/bin/Xorg /usr/bin/Xorg

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #a, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Fri Sep 30, 2022 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7862970,0sleep00-21swapper/009:15:310
52372910,0sleep20-21swapper/211:53:282
77482840,0sleep10-21swapper/111:28:461
221162840,0sleep322106-21sshd10:37:293
651326124,19sleep00-21swapper/007:08:550
202742590,0sleep220271-21proc_pri11:10:262
202742590,0sleep220271-21proc_pri11:10:262
162892580,0sleep1201ktimersoftd/111:18:261
162892580,0sleep1201ktimersoftd/111:18:261
85992570,0sleep21776-21runrttasks11:20:262
218092570,6sleep30-21swapper/310:54:033
276322560,0sleep20-21swapper/210:07:352
26442560,0sleep02640-21bash11:06:100
626525532,19sleep10-21swapper/107:05:511
232912550,0sleep023287-21rm10:01:410
199222550,1sleep30-21swapper/311:38:073
142412550,0sleep1201ktimersoftd/110:42:211
26342540,1sleep10-21swapper/112:15:171
188062540,1sleep018792-21sshd09:53:030
74922530,1sleep00-21swapper/009:32:450
659925331,18sleep30-21swapper/307:09:573
207162530,0sleep30-21swapper/311:49:153
297252520,0sleep10-21swapper/110:07:461
76322510,0sleep30-21swapper/310:08:413
274282510,0sleep20-21swapper/211:16:352
274282510,0sleep20-21swapper/211:16:342
256952510,0sleep325667-21sshd12:20:053
650525027,19sleep20-21swapper/207:08:482
90382490,0sleep20-21swapper/211:48:152
25132480,0sleep22512-21sshd11:58:452
156452480,0sleep215637-21rm12:02:362
141502480,0sleep014147-21sshd12:13:330
281722470,0sleep231967-21diskmemload12:20:152
18872470,0sleep3381ktimersoftd/312:18:013
176082470,3sleep010-21rcuc/007:30:160
152452470,0sleep20-21swapper/211:32:082
133272470,0sleep00-21swapper/010:42:140
115982460,0sleep311583-21sshd09:24:513
161592450,0sleep20-21swapper/212:19:152
183412440,0sleep10-21swapper/110:20:321
315382430,0sleep00-21swapper/010:57:380
315382430,0sleep00-21swapper/010:57:380
260482430,0sleep00-21swapper/012:22:490
272602400,0sleep227262-21id10:24:112
129922370,0sleep00-21swapper/011:56:500
91642340,0sleep30-21swapper/311:09:353
6942250,3sleep228-21rcuc/209:29:262
176052240,1sleep119-21rcuc/111:13:001
176052240,1sleep119-21rcuc/111:13:001
6859992119,1cyclictest13666-21sshd11:37:331
6859992111,6cyclictest22452-21sshd11:32:461
685999180,1cyclictest0-21swapper/110:13:571
231342180,0sleep20-21swapper/210:26:312
199632180,2sleep00-21swapper/012:16:460
6861991715,1cyclictest15858-21sshd11:15:323
6861991715,1cyclictest15858-21sshd11:15:323
6858991715,1cyclictest9491-21sshd12:38:000
685899170,9cyclictest389-21sshd10:16:180
685899170,7cyclictest0-21swapper/010:50:200
685899170,16cyclictest0-21swapper/009:43:410
685999165,4cyclictest0-21swapper/110:16:381
685999165,4cyclictest0-21swapper/107:23:301
6858991615,1cyclictest20112-21sshd11:02:090
53422160,0sleep00-21swapper/011:39:400
111592160,1sleep10-21swapper/111:01:221
70012150,2sleep00-21swapper/010:25:120
6860991513,1cyclictest0-21swapper/210:16:342
686099150,14cyclictest8093-21sshd09:32:472
685999155,4cyclictest0-21swapper/108:21:221
685999155,4cyclictest0-21swapper/108:05:101
685999155,4cyclictest0-21swapper/107:44:151
685999155,3cyclictest0-21swapper/107:36:111
685999154,4cyclictest0-21swapper/107:32:141
6859991513,1cyclictest21549-21sshd12:33:301
6859991513,0cyclictest118850irq/25-eth010:04:351
685999151,2cyclictest31205-21sshd12:06:401
685899159,5cyclictest0-21swapper/011:30:050
685899159,5cyclictest0-21swapper/010:35:240
6858991513,1cyclictest3-21ksoftirqd/009:37:430
6858991513,1cyclictest0-21swapper/009:22:090
685899150,6cyclictest3-21ksoftirqd/011:21:040
685899150,1cyclictest23955-21sshd09:56:120
685899150,14cyclictest12109-21sshd10:47:420
274562150,0sleep127431-21sshd11:55:191
97592140,0sleep30-21swapper/311:56:333
686199149,2cyclictest0-21swapper/310:29:283
6861991412,1cyclictest0-21swapper/309:17:383
6861991412,1cyclictest0-21swapper/309:10:353
686199141,1cyclictest0-21swapper/310:01:003
686199141,12cyclictest0-21swapper/309:40:273
686199141,10cyclictest118850irq/25-eth009:53:123
686199140,13cyclictest0-21swapper/309:47:033
686199140,11cyclictest0-21swapper/312:36:373
686099144,1cyclictest30-21ksoftirqd/209:19:262
6860991413,1cyclictest30-21ksoftirqd/210:30:302
6860991413,1cyclictest28-21rcuc/209:37:442
6860991412,1cyclictest0-21swapper/212:38:012
6860991412,1cyclictest0-21swapper/211:02:102
686099140,13cyclictest13416-21sshd12:07:552
685999141,5cyclictest0-21swapper/111:44:121
685999141,5cyclictest0-21swapper/108:27:351
6859991412,1cyclictest12658-21bash09:35:561
685999140,8cyclictest0-21swapper/109:11:211
685999140,7cyclictest0-21swapper/109:03:421
685999140,13cyclictest0-21swapper/112:13:591
685999140,13cyclictest0-21swapper/111:48:441
685999140,13cyclictest0-21swapper/109:23:201
685999140,10cyclictest0-21swapper/108:35:591
685899149,4cyclictest0-21swapper/009:26:220
685899148,5cyclictest22684-21sshd11:52:080
685899147,6cyclictest0-21swapper/011:25:480
685899142,1cyclictest3-21ksoftirqd/012:09:280
6858991412,1cyclictest3-21ksoftirqd/011:40:330
6858991412,1cyclictest3-21ksoftirqd/010:31:270
685899140,13cyclictest2328-21bash10:10:560
685899140,13cyclictest2182-21sshd12:31:490
685899140,13cyclictest0-21swapper/012:29:090
277102140,0sleep20-21swapper/212:31:142
146342140,0sleep20-21swapper/209:11:122
686199139,1cyclictest1644-21sshd12:12:273
686199139,1cyclictest0-21swapper/312:00:463
686199139,1cyclictest0-21swapper/311:52:003
686199139,1cyclictest0-21swapper/310:20:313
686199138,3cyclictest0-21swapper/311:12:503
686199138,3cyclictest0-21swapper/311:12:503
686199138,2cyclictest31011-21sshd11:00:203
686199138,2cyclictest1081-21bash12:31:443
686199138,2cyclictest0-21swapper/311:42:363
686199137,5cyclictest0-21swapper/309:55:163
6861991312,1cyclictest0-21swapper/309:25:533
686199131,11cyclictest0-21swapper/310:40:173
686199130,2cyclictest10153-21sshd09:32:593
686199130,12cyclictest12920-21sshd11:31:573
686199130,12cyclictest1282-21sshd10:10:503
686199130,12cyclictest0-21swapper/312:28:233
686199130,12cyclictest0-21swapper/311:20:143
686199130,10cyclictest14148-21sshd12:07:593
686099133,9cyclictest30-21ksoftirqd/209:45:262
686099133,9cyclictest22119-21cp09:56:022
686099133,1cyclictest16476-21cp10:03:542
686099130,4cyclictest23785-21sshd10:43:092
686099130,12cyclictest7415-21bash09:52:052
686099130,12cyclictest17988-21bash10:37:072
686099130,12cyclictest0-21swapper/212:10:472
686099130,0cyclictest0-21swapper/211:08:372
685999139,1cyclictest118850irq/25-eth012:22:151
685999139,1cyclictest0-21swapper/109:40:051
685999138,2cyclictest10781-21sshd11:20:391
685999138,2cyclictest0-21swapper/112:36:041
685999136,4cyclictest0-21swapper/110:53:101
685999135,4cyclictest0-21swapper/108:59:381
685999135,4cyclictest0-21swapper/108:30:551
685999135,4cyclictest0-21swapper/108:17:421
685999133,5cyclictest0-21swapper/109:08:311
685999131,5cyclictest0-21swapper/108:46:511
6859991311,1cyclictest25396-21sshd10:35:031
685999130,6cyclictest0-21swapper/108:40:591
685999130,4cyclictest12050irq/23-ehci_hcd11:05:181
685999130,2cyclictest0-21swapper/110:32:011
685999130,1cyclictest31809-21sshd11:50:131
685999130,12cyclictest22772-21bash09:56:061
685999130,12cyclictest17550-21sshd10:26:011
685999130,12cyclictest0-21swapper/112:00:371
685999130,12cyclictest0-21swapper/109:50:231
685999130,12cyclictest0-21swapper/108:50:191
685999130,10cyclictest0-21swapper/109:46:311
685899138,4cyclictest3-21ksoftirqd/009:45:550
685899132,10cyclictest0-21swapper/012:02:240
6858991311,1cyclictest2192-21sshd11:47:390
685899131,11cyclictest10-21rcuc/010:22:420
685899130,12cyclictest19392-21sshd11:15:510
685899130,12cyclictest19392-21sshd11:15:510
685899130,12cyclictest17562-21id10:06:440
685899130,12cyclictest0-21swapper/011:12:460
685899130,12cyclictest0-21swapper/011:12:460
685899130,12cyclictest0-21swapper/009:11:340
685899130,12cyclictest0-21swapper/008:50:170
304332130,1sleep330431-21bash10:32:403
686199129,2cyclictest0-21swapper/311:25:273
686199121,1cyclictest118850irq/25-eth010:15:173
6861991210,1cyclictest0-21swapper/310:55:113
6861991210,1cyclictest0-21swapper/310:55:113
6861991210,1cyclictest0-21swapper/310:45:223
686199120,1cyclictest0-21swapper/309:35:073
686199120,10cyclictest2067-21tune2fs08:05:153
686099123,9cyclictest863-21sshd10:52:142
686099122,9cyclictest28-21rcuc/210:55:122
686099122,9cyclictest28-21rcuc/210:55:122
6860991210,1cyclictest30-21ksoftirqd/210:14:242
6860991210,1cyclictest0-21swapper/211:26:382
686099120,11cyclictest30650-21cp12:25:562
685999129,2cyclictest0-21swapper/109:30:091
685999128,2cyclictest0-21swapper/110:45:111
685999128,1cyclictest118850irq/25-eth010:55:501
685999128,1cyclictest118850irq/25-eth010:55:501
685999125,4cyclictest0-21swapper/107:52:111
685999125,3cyclictest0-21swapper/109:15:071
685999124,4cyclictest0-21swapper/107:28:101
685999121,10cyclictest0-21swapper/109:27:161
685999120,9cyclictest0-21swapper/107:10:431
685999120,8cyclictest0-21swapper/107:49:191
685999120,4cyclictest0-21swapper/107:59:471
685999120,10cyclictest0-21swapper/112:27:521
685899120,11cyclictest0-21swapper/007:40:300
6861991110,1cyclictest0-21swapper/307:45:143
686199110,2cyclictest0-21swapper/307:15:013
686199110,1cyclictest0-21swapper/308:50:043
686199110,1cyclictest0-21swapper/308:35:393
686199110,1cyclictest0-21swapper/308:13:083
686199110,1cyclictest0-21swapper/308:03:023
686199110,1cyclictest0-21swapper/307:35:083
686199110,11cyclictest0-21swapper/308:23:143
686199110,11cyclictest0-21swapper/307:57:543
686199110,11cyclictest0-21swapper/307:27:433
686099118,2cyclictest0-21swapper/209:40:222
686099118,0cyclictest0-21swapper/210:45:292
6860991110,1cyclictest30-21ksoftirqd/209:20:222
686099110,11cyclictest0-21swapper/207:45:252
686099110,10cyclictest22823-21sshd11:35:292
686099110,10cyclictest0-21swapper/211:40:262
686099110,10cyclictest0-21swapper/207:15:002
685999113,4cyclictest0-21swapper/108:01:381
685999112,5cyclictest0-21swapper/107:19:261
685999111,7cyclictest0-21swapper/108:10:381
685899118,2cyclictest0-21swapper/007:15:010
6858991110,1cyclictest0-21swapper/008:04:060
6858991110,1cyclictest0-21swapper/007:21:560
685899110,1cyclictest0-21swapper/008:12:420
685899110,11cyclictest0-21swapper/007:47:370
686199109,1cyclictest0-21swapper/309:05:443
686199109,1cyclictest0-21swapper/309:01:073
686199109,1cyclictest0-21swapper/308:56:283
686199109,1cyclictest0-21swapper/307:51:033
686199109,1cyclictest0-21swapper/307:41:383
686199100,10cyclictest0-21swapper/308:41:073
686099108,1cyclictest0-21swapper/208:35:162
686099100,9cyclictest11521-21perl08:25:152
686099100,9cyclictest0-21swapper/208:00:142
686099100,10cyclictest0-21swapper/208:59:252
686099100,10cyclictest0-21swapper/208:54:032
686099100,10cyclictest0-21swapper/207:58:462
686099100,10cyclictest0-21swapper/207:11:222
685899109,1cyclictest0-21swapper/008:55:340
685899109,1cyclictest0-21swapper/007:26:200
685899108,1cyclictest16322-21perl08:35:150
685899100,9cyclictest18366-21diskstats08:40:180
685899100,1cyclictest0-21swapper/008:25:140
685899100,10cyclictest0-21swapper/008:45:550
68619999,0cyclictest0-21swapper/307:31:263
68619995,2cyclictest7213-21kworker/3:107:20:283
68619990,1cyclictest0-21swapper/308:45:173
68609998,1cyclictest0-21swapper/208:41:512
68609998,1cyclictest0-21swapper/208:12:432
68609990,9cyclictest0-21swapper/207:35:052
68589998,1cyclictest13538-21cstates08:30:130
68589998,1cyclictest0-21swapper/009:03:200
68589998,1cyclictest0-21swapper/008:16:030
68589998,1cyclictest0-21swapper/008:08:100
68589998,1cyclictest0-21swapper/007:57:080
68589992,5cyclictest0-21swapper/007:10:120
68619987,1cyclictest0-21swapper/308:34:023
68619987,1cyclictest0-21swapper/308:28:413
68619981,6cyclictest0-21swapper/307:15:003
68609988,0cyclictest0-21swapper/207:50:152
68609987,1cyclictest0-21swapper/208:49:312
68609987,1cyclictest0-21swapper/207:31:152
68609980,8cyclictest0-21swapper/208:31:112
68609980,8cyclictest0-21swapper/208:19:342
68609980,7cyclictest0-21swapper/208:05:112
68589987,1cyclictest0-21swapper/007:38:390
68589980,3cyclictest0-21swapper/009:06:000
68619977,0cyclictest0-21swapper/308:15:163
68609976,1cyclictest0-21swapper/209:04:112
68609976,1cyclictest0-21swapper/208:24:552
68609970,7cyclictest0-21swapper/209:05:482
68589972,2cyclictest0-21swapper/007:50:370
68589970,2cyclictest0-21swapper/008:20:120
68609965,1cyclictest0-21swapper/207:40:242
68609960,6cyclictest0-21swapper/207:20:072
68609960,5cyclictest0-21swapper/207:25:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional