You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-21 - 23:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackaslot0.osadl.org (updated Thu Sep 21, 2023 12:44:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2477321040,0sleep20-21swapper/211:29:412
1504021020,0sleep30-21swapper/310:20:193
208922900,0sleep020891-21sshd12:39:220
101542890,1sleep21076299cyclictest10:22:332
262682860,0sleep10-21swapper/109:12:141
94602620,0sleep09433-21sshd11:57:020
86072610,0sleep10-21swapper/110:53:101
96392600,0sleep20-21swapper/210:16:562
187802600,1sleep337-21rcuc/311:47:203
71232570,0sleep17121-21sshd11:35:561
287472570,0sleep00-21swapper/009:38:490
261582570,0sleep30-21swapper/312:19:043
222382570,1sleep122237-21bash11:31:591
209952570,1sleep10-21swapper/111:42:171
19292570,0sleep11932-21sshd11:00:591
91312560,1sleep09132-21bash11:38:470
21622550,1sleep12158-21bash12:35:181
258082540,0sleep325809-21bash11:11:233
258082540,0sleep325809-21bash11:11:233
219412540,0sleep00-21swapper/011:21:320
131302540,6sleep03-21ksoftirqd/010:50:440
265522530,1sleep326550-21sshd09:58:513
53582520,0sleep15348-21sshd10:22:081
193212520,0sleep119318-21bash11:50:021
136742510,0sleep20-21swapper/210:08:592
117122510,0sleep311711-21sshd09:54:383
1020525125,9sleep20-21swapper/207:06:232
57682500,0sleep30-21swapper/309:33:193
279322500,0sleep027933-21sshd12:29:350
162062500,1sleep116164-21sshd09:46:271
109312500,0sleep10-21swapper/110:59:031
967524926,19sleep10-21swapper/107:05:301
289712490,0sleep10-21swapper/109:56:081
228202490,1sleep21730-21runrttasks08:40:272
148152490,0sleep30-21swapper/311:02:083
145612490,0sleep214558-21sshd10:39:412
1044824926,19sleep30-21swapper/307:09:253
962624826,18sleep00-21swapper/007:05:290
47122480,1sleep34690-21sshd10:16:303
189702480,0sleep018965-21sshd11:47:200
181042480,0sleep30-21swapper/310:12:063
58212470,0sleep30-21swapper/311:25:293
279782470,0sleep30-21swapper/311:55:543
219682470,1sleep121967-21sshd12:26:291
173882470,0sleep20-21swapper/211:23:512
321142460,0sleep332116-21id11:53:413
149392460,0sleep014937-21bash11:05:030
182282430,0sleep10-21swapper/110:34:221
46822410,0sleep20-21swapper/209:39:352
115632300,0sleep211565-21id09:40:112
290812220,1sleep329060-21sshd12:01:113
10761992220,1cyclictest14926-21sshd11:47:011
92742200,0sleep10-21swapper/109:26:201
10762992019,1cyclictest0-21swapper/212:32:242
1076199200,19cyclictest1493-21nfsd10:28:431
1076399190,18cyclictest0-21swapper/312:39:313
10762991918,1cyclictest0-21swapper/212:09:022
10761991917,1cyclictest18234-21sshd11:16:001
10761991917,1cyclictest18234-21sshd11:16:001
127852180,1sleep112733-21sshd10:03:171
10761991816,1cyclictest3442-21sshd09:36:191
1076199180,1cyclictest26584-21sshd12:00:571
83172170,1sleep18318-21bash09:22:591
118342170,1sleep10-21swapper/111:07:321
1076399173,10cyclictest0-21swapper/308:59:433
10763991715,1cyclictest0-21swapper/310:47:023
10761991715,1cyclictest4640-21sshd12:17:191
1076099173,10cyclictest4637-21sshd10:33:100
103092170,0sleep30-21swapper/309:40:043
245512160,0sleep024530-21sshd12:24:100
169162160,1sleep08-21rcu_preempt12:05:230
145602160,0sleep30-21swapper/312:07:473
1076399163,9cyclictest0-21swapper/307:14:463
1076399162,10cyclictest0-21swapper/308:06:343
1076399161,10cyclictest0-21swapper/307:15:043
1076199169,1cyclictest0-21swapper/111:57:031
10760991610,3cyclictest31694-21sshd10:58:000
1076099160,15cyclictest0-21swapper/010:16:040
245432150,0sleep30-21swapper/309:18:123
206002150,0sleep30-21swapper/311:42:163
159082150,0sleep00-21swapper/012:00:100
131592150,0sleep113157-21sshd11:23:301
118382150,1sleep311831-21sshd12:12:433
10763991513,2cyclictest21863-21sshd11:16:183
10763991513,2cyclictest21863-21sshd11:16:183
10763991513,1cyclictest0-21swapper/310:02:443
1076299159,1cyclictest0-21swapper/209:22:282
10762991513,1cyclictest9572-21sshd11:54:302
10762991513,1cyclictest0-21swapper/212:16:512
1076299150,1cyclictest10250irq/24-ahci[00010:33:262
1076299150,14cyclictest0-21swapper/211:34:462
1076299150,14cyclictest0-21swapper/211:01:582
1076199159,5cyclictest0-21swapper/109:43:481
1076199151,1cyclictest1494-21nfsd11:11:471
1076199151,1cyclictest1494-21nfsd11:11:471
1076199150,1cyclictest31011-21sshd10:07:421
1076199150,10cyclictest0-21swapper/109:31:461
1076099159,3cyclictest11801-21sshd11:52:010
1076099158,4cyclictest0-21swapper/009:34:540
1076099153,9cyclictest0-21swapper/011:03:270
1076099152,3cyclictest0-21swapper/012:17:310
1076099151,3cyclictest0-21swapper/012:30:020
10760991513,1cyclictest27731-21sshd10:12:550
1076099150,4cyclictest0-21swapper/010:03:540
1076099150,14cyclictest0-21swapper/011:13:250
1076099150,14cyclictest0-21swapper/011:13:250
1076099150,12cyclictest2816-21sshd09:13:100
1076099150,12cyclictest22791-21bash11:19:060
1076099150,12cyclictest22791-21bash11:19:060
1076099150,12cyclictest0-21swapper/009:25:330
75952140,0sleep00-21swapper/010:47:310
55442140,0sleep15543-21sshd10:35:581
255002140,0sleep33468-21diskmemload09:47:173
202502140,0sleep20-21swapper/210:26:022
201592140,0sleep30-21swapper/311:08:173
18312140,0sleep10-21swapper/110:13:311
1076399149,2cyclictest25456-21sshd12:26:453
1076399140,14cyclictest0-21swapper/309:22:163
1076399140,13cyclictest0-21swapper/310:55:233
1076299149,1cyclictest0-21swapper/209:16:322
1076299149,1cyclictest0-21swapper/209:14:422
1076299148,5cyclictest0-21swapper/210:43:022
1076299148,2cyclictest22383-21sshd11:05:332
1076299144,9cyclictest30-21ksoftirqd/211:47:162
10762991412,1cyclictest9347-21sshd11:38:492
10762991412,1cyclictest30-21ksoftirqd/210:54:312
1076299140,13cyclictest0-21swapper/212:23:532
1076199149,1cyclictest11001-21sshd10:17:041
1076199149,1cyclictest0-21swapper/110:43:241
1076199148,2cyclictest4545-21sshd12:32:511
1076199148,2cyclictest12680-21sshd11:25:591
1076199141,12cyclictest0-21swapper/109:54:491
1076199140,1cyclictest0-21swapper/109:15:211
1076199140,12cyclictest0-21swapper/110:47:201
1076099148,5cyclictest0-21swapper/009:15:440
1076099148,3cyclictest0-21swapper/010:38:100
10760991412,1cyclictest9787-21bash09:23:070
10760991412,1cyclictest12998-21bash11:26:000
1076099141,12cyclictest0-21swapper/011:30:310
10760991411,2cyclictest0-21swapper/010:25:080
1076099140,3cyclictest0-21swapper/011:40:340
1076099140,13cyclictest0-21swapper/010:41:360
80942130,0sleep28096-21id10:58:472
1076399139,1cyclictest114750irq/25-eth009:25:293
1076399139,1cyclictest0-21swapper/310:38:133
1076399138,4cyclictest4680-21sshd12:22:343
1076399138,4cyclictest2142-21sshd10:30:083
1076399133,6cyclictest0-21swapper/308:01:123
1076399133,5cyclictest0-21swapper/307:57:063
1076399132,6cyclictest0-21swapper/307:20:343
1076399132,10cyclictest25477-21cp09:12:093
10763991311,1cyclictest16710-21sshd12:31:113
1076399130,1cyclictest0-21swapper/311:21:503
1076399130,12cyclictest0-21swapper/310:27:413
1076399130,12cyclictest0-21swapper/309:39:113
1076399130,10cyclictest26198-21sshd11:32:203
1076299139,1cyclictest0-21swapper/210:45:462
1076299138,4cyclictest31791-21sshd09:29:192
1076299138,1cyclictest0-21swapper/212:25:482
1076299138,1cyclictest0-21swapper/209:55:142
1076299132,10cyclictest22060-21sshd12:00:352
10762991311,1cyclictest357-21bash12:37:422
1076299130,12cyclictest32058-21sshd11:19:512
1076299130,12cyclictest32058-21sshd11:19:512
1076299130,12cyclictest1839-21sshd09:50:502
1076299130,12cyclictest0-21swapper/211:40:052
1076299130,12cyclictest0-21swapper/210:00:092
1076199131,1cyclictest114750irq/25-eth012:20:451
1076199130,12cyclictest32596-21sshd12:09:151
1076199130,12cyclictest0-21swapper/112:10:111
1076099134,8cyclictest0-21swapper/008:11:390
1076099130,3cyclictest0-21swapper/010:06:340
1076099130,2cyclictest28190-21sshd09:50:240
1076099130,1cyclictest0-21swapper/009:42:070
1076099130,12cyclictest25232-21sshd12:13:490
1076099130,12cyclictest0-21swapper/010:20:190
1076099130,12cyclictest0-21swapper/009:59:130
1076099130,10cyclictest0-21swapper/009:45:180
297222120,0sleep20-21swapper/208:55:242
1076399129,2cyclictest0-21swapper/311:35:053
1076399125,4cyclictest0-21swapper/308:45:493
1076399124,4cyclictest0-21swapper/310:41:243
1076399123,5cyclictest0-21swapper/309:06:263
1076399123,5cyclictest0-21swapper/309:02:223
1076399123,5cyclictest0-21swapper/308:43:003
1076399123,5cyclictest0-21swapper/308:20:123
1076399122,6cyclictest0-21swapper/307:27:313
1076399122,5cyclictest0-21swapper/308:11:523
1076399121,10cyclictest0-21swapper/310:08:223
1076399120,9cyclictest0-21swapper/310:50:433
1076399120,4cyclictest0-21swapper/308:15:463
1076299129,2cyclictest0-21swapper/212:11:312
1076299129,2cyclictest0-21swapper/210:10:012
1076299129,2cyclictest0-21swapper/209:30:062
1076299129,1cyclictest114750irq/25-eth009:46:202
1076299120,1cyclictest16371-21id11:10:332
1076299120,1cyclictest16371-21id11:10:332
1076299120,11cyclictest0-21swapper/211:55:072
1076099120,8cyclictest0-21swapper/008:25:240
1076399118,2cyclictest0-21swapper/308:25:213
1076399112,9cyclictest0-21swapper/307:32:503
1076399112,3cyclictest0-21swapper/308:33:323
1076399111,6cyclictest0-21swapper/307:36:463
1076399110,10cyclictest0-21swapper/307:47:303
1076299110,10cyclictest13232-21fw_forwarded_lo07:15:012
1076199119,1cyclictest0-21swapper/109:00:201
10761991110,1cyclictest0-21swapper/107:37:241
1076199110,1cyclictest0-21swapper/107:52:301
1076199110,11cyclictest0-21swapper/107:21:301
10760991110,1cyclictest0-21swapper/007:29:050
1076099110,8cyclictest0-21swapper/009:00:200
1076099110,8cyclictest0-21swapper/007:55:330
1076099110,1cyclictest0-21swapper/008:05:270
1076099110,11cyclictest0-21swapper/008:21:360
1076099110,11cyclictest0-21swapper/007:10:360
1076099110,10cyclictest0-21swapper/009:06:120
1076399102,3cyclictest0-21swapper/308:38:423
1076399100,9cyclictest0-21swapper/308:50:313
1076399100,10cyclictest0-21swapper/307:50:543
1076399100,10cyclictest0-21swapper/307:41:083
1076299100,1cyclictest0-21swapper/209:00:202
1076199108,1cyclictest13261-21diskstats07:15:011
1076199100,9cyclictest0-21swapper/109:10:001
1076199100,9cyclictest0-21swapper/108:40:231
1076199100,1cyclictest0-21swapper/108:45:221
1076199100,0cyclictest0-21swapper/108:35:221
1076099108,1cyclictest28860-21perl07:45:230
1076099107,2cyclictest0-21swapper/008:30:220
1076099104,1cyclictest0-21swapper/007:35:190
10760991010,0cyclictest0-21swapper/008:01:300
1076099100,8cyclictest0-21swapper/008:58:300
1076099100,7cyclictest0-21swapper/008:45:300
1076099100,1cyclictest0-21swapper/008:15:470
1076099100,1cyclictest0-21swapper/007:15:020
1076099100,10cyclictest0-21swapper/008:36:220
1076099100,10cyclictest0-21swapper/007:50:350
1076099100,10cyclictest0-21swapper/007:41:520
1076099100,10cyclictest0-21swapper/007:33:230
107629997,2cyclictest0-21swapper/208:16:412
107619999,0cyclictest0-21swapper/108:55:001
107619998,1cyclictest0-21swapper/108:34:341
107619998,1cyclictest0-21swapper/107:56:271
107619998,1cyclictest0-21swapper/107:13:221
107619990,6cyclictest0-21swapper/108:12:091
107619990,1cyclictest0-21swapper/107:45:231
107609998,1cyclictest0-21swapper/007:24:410
107609990,8cyclictest0-21swapper/008:40:230
107609990,2cyclictest26775-21cpuspeed_turbos08:50:240
107629988,0cyclictest0-21swapper/208:10:202
107629983,4cyclictest23725-21df07:35:202
107629982,5cyclictest0-21swapper/208:20:242
107629981,6cyclictest0-21swapper/208:45:222
107629981,6cyclictest0-21swapper/208:25:222
107629981,6cyclictest0-21swapper/207:45:292
107629981,6cyclictest0-21swapper/207:10:302
107629981,3cyclictest0-21swapper/207:55:222
107619981,6cyclictest0-21swapper/108:20:271
107619981,6cyclictest0-21swapper/107:40:281
107619980,8cyclictest0-21swapper/107:26:501
107629975,1cyclictest3314-21grep08:00:312
107629971,5cyclictest0-21swapper/208:50:232
107629971,5cyclictest0-21swapper/208:30:182
107629970,6cyclictest0-21swapper/209:05:282
107629970,6cyclictest0-21swapper/208:35:182
107629970,6cyclictest0-21swapper/208:05:232
107629970,6cyclictest0-21swapper/207:50:192
107629970,6cyclictest0-21swapper/207:40:312
107629970,6cyclictest0-21swapper/207:30:232
107619976,1cyclictest0-21swapper/108:52:271
107619975,1cyclictest5249-21atenall_rapower08:05:221
107619971,5cyclictest0-21swapper/108:15:221
107619971,1cyclictest114750irq/25-eth008:25:281
107619970,6cyclictest0-21swapper/108:00:321
107629960,5cyclictest0-21swapper/207:25:192
107629960,5cyclictest0-21swapper/207:20:212
107619965,1cyclictest21831-21if_err_eth107:30:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional