You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-02 - 19:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Sat Dec 02, 2023 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
157602980,1sleep119-21rcuc/110:45:411
7712940,1sleep1743-21sshd11:45:391
240122880,0sleep324007-21rm09:14:053
13752840,0sleep11373-21bash11:04:121
43152590,1sleep34300-21sshd10:05:173
238612580,1sleep223839-21sshd10:14:332
212092570,0sleep10-21swapper/109:42:431
181452570,0sleep30-21swapper/311:34:473
297782550,1sleep129748-21sshd11:52:521
92812540,0sleep00-21swapper/011:02:190
82312540,1sleep38207-21sshd09:46:583
44702530,0sleep337-21rcuc/311:14:123
132082530,0sleep00-21swapper/011:44:140
258542520,1sleep00-21swapper/009:43:070
168372520,0sleep30-21swapper/310:26:083
146672510,0sleep10-21swapper/111:36:541
50222500,1sleep25020-21sshd09:51:582
24262500,0sleep20-21swapper/209:30:382
1342425027,19sleep20-21swapper/207:08:082
1330625028,18sleep30-21swapper/307:06:373
110952500,1sleep211063-21sshd10:00:272
294352490,0sleep10-21swapper/109:48:451
267142490,0sleep10-21swapper/109:16:511
219142490,0sleep30-21swapper/310:31:253
152972490,0sleep36540-21diskmemload09:42:133
95922480,1sleep29593-21sshd12:09:562
318792480,0sleep031876-21bash12:25:190
264142480,1sleep126390-21sshd11:10:531
199162480,0sleep319912-21cp10:48:323
1335924825,19sleep10-21swapper/107:07:181
1124724825,19sleep00-21swapper/007:05:010
65082470,0sleep20-21swapper/212:12:162
198452470,0sleep26540-21diskmemload11:47:082
195862470,1sleep219585-21sshd12:37:482
183752470,0sleep20-21swapper/209:47:492
155622470,1sleep115559-21sshd10:30:551
114532450,1sleep20-21swapper/209:15:362
53872420,0sleep00-21swapper/010:40:070
59112400,0sleep20-21swapper/210:42:352
255222220,1sleep26540-21diskmemload12:00:312
306162210,0sleep20-21swapper/210:56:362
286512190,1sleep228652-21sshd12:27:432
13827991918,1cyclictest23498-21sshd09:16:363
14572180,1sleep31432-21sshd12:36:173
13814991816,1cyclictest11344-21sshd09:34:020
1381499180,16cyclictest0-21swapper/010:49:490
99392170,0sleep19936-21sshd11:24:241
99392170,0sleep19936-21sshd11:24:241
29862170,0sleep10-21swapper/110:17:501
13827991713,3cyclictest0-21swapper/311:28:543
1381499172,11cyclictest14085-21sshd11:39:220
13814991715,1cyclictest6540-21diskmemload09:45:430
127992170,1sleep012778-21sshd10:25:490
78202160,1sleep119-21rcuc/112:09:471
58912160,0sleep30-21swapper/310:10:343
40742160,1sleep28-21rcu_preempt10:47:192
303372160,0sleep10-21swapper/112:38:421
13823991614,1cyclictest30-21ksoftirqd/211:30:262
1381899160,15cyclictest0-21swapper/110:52:571
1381499167,3cyclictest0-21swapper/009:29:350
68962150,1sleep00-21swapper/011:56:230
56962150,0sleep00-21swapper/011:16:420
56962150,0sleep00-21swapper/011:16:420
13827991513,1cyclictest0-21swapper/309:36:253
1382799150,2cyclictest31751-21sshd09:51:303
1382799150,1cyclictest32054-21sshd10:51:523
1382799150,10cyclictest30358-21bash09:25:063
1382399150,1cyclictest28-21rcuc/211:28:542
1382399150,14cyclictest0-21swapper/212:30:232
13818991514,1cyclictest0-21swapper/111:08:191
1381499159,1cyclictest15521-21bash09:13:230
1381499158,6cyclictest23723-21sshd11:45:020
1381499158,3cyclictest0-21swapper/012:30:070
1381499157,7cyclictest0-21swapper/011:51:060
1381499152,9cyclictest14020-21sshd11:12:270
1381499152,1cyclictest17357-21sshd10:16:260
1381499152,1cyclictest0-21swapper/010:50:140
13814991513,1cyclictest0-21swapper/010:36:020
13814991512,2cyclictest0-21swapper/008:21:030
1381499150,3cyclictest32592-21sshd11:21:090
1381499150,3cyclictest32592-21sshd11:21:090
1381499150,3cyclictest29485-21sshd11:25:460
1381499150,2cyclictest28474-21sshd09:17:000
1381499150,2cyclictest0-21swapper/011:33:320
109272150,1sleep00-21swapper/009:55:080
27672140,1sleep30-21swapper/311:21:213
27672140,1sleep30-21swapper/311:21:213
205222140,1sleep10-21swapper/109:32:061
1382799149,1cyclictest10250irq/24-ahci[00011:50:043
13827991412,1cyclictest12577-21sshd09:20:583
1382799140,13cyclictest0-21swapper/311:15:243
1382799140,13cyclictest0-21swapper/311:15:243
13823991412,1cyclictest0-21swapper/211:43:442
1382399140,13cyclictest0-21swapper/210:51:122
1382399140,13cyclictest0-21swapper/209:22:342
1382399140,12cyclictest0-21swapper/210:26:572
1381899149,4cyclictest0-21swapper/110:02:341
1381899144,1cyclictest16930-21kworker/1:011:41:441
1381899143,10cyclictest952-21sshd09:38:251
1381899141,12cyclictest0-21swapper/110:40:161
1381499149,4cyclictest0-21swapper/012:06:060
1381499149,4cyclictest0-21swapper/009:54:080
1381499148,5cyclictest27445-21sshd11:08:370
1381499147,3cyclictest22867-21sshd10:31:290
1381499141,1cyclictest19421-21sshd12:21:300
1381499140,3cyclictest0-21swapper/010:13:370
1381499140,2cyclictest0-21swapper/010:56:400
1381499140,2cyclictest0-21swapper/010:05:540
1381499140,1cyclictest18594-21bash12:10:340
1381499140,13cyclictest0-21swapper/012:00:450
1381499140,13cyclictest0-21swapper/009:20:400
1382799139,1cyclictest0-21swapper/311:37:523
1382799138,4cyclictest0-21swapper/312:31:383
1382799138,2cyclictest31981-21sshd12:11:413
1382799137,2cyclictest22521-21bash10:36:283
1382799132,10cyclictest20045-21sshd11:05:353
13827991311,1cyclictest0-21swapper/310:19:303
1382799130,4cyclictest12639-21bash11:49:043
1382799130,4cyclictest0-21swapper/312:20:123
1382799130,1cyclictest0-21swapper/311:00:093
1382799130,12cyclictest20887-21sshd11:44:493
1382799130,12cyclictest0-21swapper/312:07:023
1382799130,12cyclictest0-21swapper/310:21:043
1382799130,10cyclictest8993-21bash11:56:333
1382399139,1cyclictest0-21swapper/211:39:082
1382399138,4cyclictest0-21swapper/211:10:062
1382399132,10cyclictest2681-21sshd09:35:522
1382399131,3cyclictest0-21swapper/212:20:042
13823991311,1cyclictest14557-21sshd11:00:192
13823991310,2cyclictest30-21ksoftirqd/211:21:192
13823991310,2cyclictest30-21ksoftirqd/211:21:192
1382399130,4cyclictest0-21swapper/211:55:352
1382399130,1cyclictest9228-21sshd09:25:552
1382399130,1cyclictest19633-21bash11:17:452
1382399130,1cyclictest19633-21bash11:17:452
1382399130,12cyclictest29677-21sshd10:19:512
1382399130,12cyclictest22020-21sshd09:58:462
1382399130,12cyclictest20646-21sshd10:33:492
1382399130,12cyclictest0-21swapper/209:10:462
1382399130,10cyclictest0-21swapper/210:06:292
1381899138,4cyclictest0-21swapper/111:30:481
1381899138,2cyclictest4024-21sshd10:25:151
13818991311,1cyclictest114750irq/25-eth010:39:001
1381899131,11cyclictest0-21swapper/112:10:171
1381899130,2cyclictest0-21swapper/111:18:341
1381899130,2cyclictest0-21swapper/111:18:341
1381899130,1cyclictest8350-21cp12:15:101
1381899130,13cyclictest0-21swapper/111:55:291
1381899130,12cyclictest19712-21sshd09:26:471
1381899130,12cyclictest18236-21sshd10:14:091
1381899130,12cyclictest16397-21sshd12:02:301
1381899130,12cyclictest0-21swapper/112:27:271
1381899130,12cyclictest0-21swapper/109:52:131
1381899130,10cyclictest30475-21sshd09:56:461
1381899130,10cyclictest0-21swapper/110:06:131
1381899130,10cyclictest0-21swapper/109:10:021
1381499139,4cyclictest114750irq/25-eth010:20:060
1381499138,2cyclictest0-21swapper/009:36:190
1381499130,1cyclictest20064-21sshd10:01:120
1381499130,12cyclictest0-21swapper/012:35:430
1381499130,12cyclictest0-21swapper/012:16:420
1382799129,2cyclictest0-21swapper/312:01:133
1382799129,2cyclictest0-21swapper/310:55:223
1382799128,3cyclictest0-21swapper/312:17:243
1382799128,1cyclictest6759-21id10:00:113
1382799121,10cyclictest0-21swapper/309:30:373
13827991210,1cyclictest28660-21latency_hist07:40:003
13827991210,1cyclictest0-21swapper/312:25:303
1382799120,1cyclictest32440-21sshd10:42:083
1382799120,11cyclictest0-21swapper/309:55:153
1382399129,2cyclictest0-21swapper/210:38:042
1382399129,2cyclictest0-21swapper/209:40:182
1382399123,8cyclictest0-21swapper/208:00:382
1382399121,2cyclictest0-21swapper/212:16:372
1382399121,2cyclictest0-21swapper/210:20:162
13823991211,1cyclictest30-21ksoftirqd/211:50:422
1382399120,11cyclictest20035-21sshd11:05:342
1381899129,2cyclictest0-21swapper/112:31:431
1381899129,2cyclictest0-21swapper/110:56:231
1381899129,2cyclictest0-21swapper/109:20:091
1381899122,9cyclictest17056-21sshd10:21:181
1381899121,2cyclictest0-21swapper/107:15:001
13818991210,1cyclictest0-21swapper/111:25:201
1381899120,11cyclictest0-21swapper/112:21:131
1381499120,9cyclictest0-21swapper/007:15:240
1382799110,1cyclictest0-21swapper/308:25:323
1382799110,11cyclictest0-21swapper/308:00:543
1382799110,11cyclictest0-21swapper/307:44:043
13823991110,1cyclictest0-21swapper/208:44:162
13823991110,1cyclictest0-21swapper/207:19:072
1382399110,1cyclictest0-21swapper/208:30:402
1382399110,11cyclictest0-21swapper/209:09:282
1381899113,7cyclictest0-21swapper/107:27:371
1381899112,8cyclictest0-21swapper/108:05:381
1381899112,8cyclictest0-21swapper/107:55:381
13818991110,1cyclictest0-21swapper/108:15:301
1381499115,3cyclictest0-21swapper/008:05:270
1381499110,10cyclictest0-21swapper/008:57:590
1382799109,1cyclictest0-21swapper/308:38:403
1382799109,1cyclictest0-21swapper/308:24:363
1382799100,1cyclictest0-21swapper/307:48:353
1382799100,10cyclictest0-21swapper/307:53:073
1382799100,10cyclictest0-21swapper/307:23:443
1382399109,1cyclictest0-21swapper/208:55:112
1382399109,1cyclictest0-21swapper/207:22:432
1382399100,1cyclictest0-21swapper/207:48:572
1382399100,10cyclictest0-21swapper/208:19:522
1382399100,10cyclictest0-21swapper/207:53:582
1382399100,10cyclictest0-21swapper/207:44:252
1381899109,1cyclictest0-21swapper/107:52:301
1381899109,1cyclictest0-21swapper/107:23:061
13818991010,0cyclictest0-21swapper/108:40:221
1381899100,10cyclictest0-21swapper/109:08:221
1381899100,10cyclictest0-21swapper/109:04:041
1381899100,10cyclictest0-21swapper/108:26:191
1381899100,10cyclictest0-21swapper/107:34:511
1381499109,1cyclictest0-21swapper/007:59:270
1381499103,4cyclictest0-21swapper/007:20:220
1381499100,9cyclictest0-21swapper/008:35:230
1381499100,10cyclictest0-21swapper/007:47:430
1381499100,10cyclictest0-21swapper/007:44:350
138279999,0cyclictest0-21swapper/308:14:443
138279998,1cyclictest0-21swapper/309:08:313
138279998,1cyclictest0-21swapper/309:04:133
138279998,1cyclictest0-21swapper/308:54:133
138279998,1cyclictest0-21swapper/308:09:093
138279998,1cyclictest0-21swapper/307:27:483
138279990,9cyclictest0-21swapper/308:15:123
138239998,1cyclictest0-21swapper/208:29:452
138189999,0cyclictest0-21swapper/108:58:501
138189998,1cyclictest0-21swapper/108:49:191
138189998,1cyclictest0-21swapper/108:39:541
138189998,1cyclictest0-21swapper/107:43:271
138189998,1cyclictest0-21swapper/107:39:231
138149994,4cyclictest0-21swapper/008:30:190
138149994,2cyclictest0-21swapper/008:00:230
138149990,9cyclictest0-21swapper/007:38:180
138149990,9cyclictest0-21swapper/007:13:340
138149990,8cyclictest21674-21munin-node07:25:230
138149990,5cyclictest0-21swapper/009:09:410
138279987,1cyclictest0-21swapper/308:49:293
138279987,1cyclictest0-21swapper/307:31:523
138279987,1cyclictest0-21swapper/307:17:003
138279987,1cyclictest0-21swapper/307:12:353
138279983,2cyclictest0-21swapper/308:34:183
138279981,6cyclictest0-21swapper/307:55:293
138239988,0cyclictest0-21swapper/209:04:432
138239981,6cyclictest0-21swapper/208:53:192
138239981,6cyclictest0-21swapper/207:55:222
138239980,7cyclictest0-21swapper/208:10:292
138189987,1cyclictest0-21swapper/108:00:171
138189987,1cyclictest0-21swapper/107:47:591
138189983,5cyclictest0-21swapper/108:33:531
138189981,6cyclictest0-21swapper/108:50:241
138189980,7cyclictest0-21swapper/108:12:551
138149987,1cyclictest0-21swapper/007:54:270
138149986,1cyclictest0-21swapper/009:00:270
138149986,1cyclictest0-21swapper/008:45:310
138149985,3cyclictest0-21swapper/008:43:450
138149982,4cyclictest0-21swapper/008:50:210
138149982,4cyclictest0-21swapper/008:28:380
138279975,1cyclictest1730-21runrttasks08:57:553
138279970,4cyclictest0-21swapper/308:41:433
138239976,1cyclictest0-21swapper/207:35:512
138239976,1cyclictest0-21swapper/207:31:192
138239975,1cyclictest153832chrt08:20:092
138239971,5cyclictest0-21swapper/207:10:232
138239970,6cyclictest0-21swapper/208:05:192
138239970,3cyclictest0-21swapper/207:25:232
138189976,1cyclictest0-21swapper/108:24:551
138189975,1cyclictest15874-21taskset07:13:381
138149972,3cyclictest0-21swapper/008:10:120
138149972,2cyclictest0-21swapper/008:15:190
138149970,5cyclictest0-21swapper/007:30:070
138239961,4cyclictest0-21swapper/208:35:342
138239960,5cyclictest0-21swapper/208:45:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional