You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-28 - 07:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackaslot0.osadl.org (updated Sun Apr 28, 2024 00:44:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
309822880,1sleep041ktimersoftd/000:30:480
59812670,1sleep20-21swapper/223:00:592
102872670,1sleep20-21swapper/223:11:082
3022600,1sleep010-21rcuc/023:47:210
285932600,1sleep13225899cyclictest22:01:331
275952600,1sleep127578-21sshd21:32:151
271112590,1sleep027110-21sshd23:22:160
88002580,6sleep03-21ksoftirqd/023:08:380
38242580,1sleep13786-21sshd00:05:131
314322580,6sleep121-21ksoftirqd/122:45:441
314322580,6sleep121-21ksoftirqd/122:45:431
225432570,1sleep222537-21sshd22:05:532
192812570,2sleep03225799cyclictest23:51:130
214532560,0sleep30-21swapper/322:59:483
110602560,0sleep00-21swapper/021:52:570
127002550,0sleep3381ktimersoftd/322:41:533
126402550,0sleep30-21swapper/300:21:293
55912540,0sleep10-21swapper/122:34:011
3165225431,19sleep20-21swapper/219:05:452
202462530,1sleep320219-21sshd23:14:263
145762530,1sleep214575-21sshd21:58:042
278092520,0sleep30-21swapper/321:27:243
259432520,0sleep125921-21sshd22:25:401
169262520,0sleep216899-21sshd23:43:422
156602520,1sleep315661-21munin-node22:15:123
277682510,0sleep10-21swapper/122:52:521
250692510,0sleep30-21swapper/322:08:353
232062510,0sleep20-21swapper/223:26:552
176492510,0sleep10-21swapper/100:27:081
58142500,0sleep20-21swapper/222:34:032
3192025027,19sleep00-21swapper/019:09:000
3166325027,19sleep30-21swapper/319:05:543
296402500,0sleep10-21swapper/121:25:111
264112500,0sleep026389-21sshd00:35:450
104452500,0sleep210444-21sshd00:37:112
3189724927,19sleep10-21swapper/119:08:441
167202490,0sleep10-21swapper/123:43:411
135912490,1sleep313588-21bash23:38:303
256362480,0sleep10-21swapper/100:01:401
195772470,0sleep10-21swapper/121:58:281
123592470,0sleep10-21swapper/123:30:591
287542450,0sleep21547-21nfsd22:43:082
192152450,0sleep219212-21sshd22:03:172
160172450,1sleep221584-21diskmemload23:09:122
304602440,0sleep30-21swapper/300:17:453
268152440,0sleep00-21swapper/022:15:580
148682420,0sleep20-21swapper/200:19:082
24252400,1sleep13225899cyclictest22:38:421
15682400,0sleep230-21ksoftirqd/221:32:442
39682370,0sleep20-21swapper/222:14:192
3226099231,1cyclictest120050irq/25-eth022:13:333
32258992319,4cyclictest32764-21bash00:15:191
32257992321,1cyclictest8079-21sshd21:42:580
178022230,5sleep339-21ksoftirqd/322:00:423
32259992119,1cyclictest0-21swapper/223:46:442
3225999210,20cyclictest0-21swapper/200:27:092
32260992018,1cyclictest120050irq/25-eth023:51:093
3226099200,19cyclictest0-21swapper/321:43:323
3225799190,16cyclictest13799-21sshd00:00:400
181842190,1sleep20-21swapper/222:57:022
63222180,0sleep041ktimersoftd/022:36:290
35322180,0sleep20-21swapper/222:38:482
32257991816,1cyclictest26222-21sshd22:52:460
3225799180,2cyclictest1871-21bash21:20:330
153392180,0sleep10-21swapper/122:17:341
32260991716,1cyclictest0-21swapper/322:30:253
32259991715,1cyclictest0-21swapper/223:18:572
3225899174,1cyclictest21-21ksoftirqd/123:00:011
3225799179,7cyclictest41ktimersoftd/022:20:150
3225799174,12cyclictest3-21ksoftirqd/022:41:180
3225799170,2cyclictest17877-21sshd22:00:420
3225799170,16cyclictest41ktimersoftd/000:20:320
114792170,0sleep03-21ksoftirqd/021:33:310
3225899166,9cyclictest21-21ksoftirqd/123:19:121
3225799169,6cyclictest41ktimersoftd/023:35:310
3225799169,2cyclictest18754-21sshd22:12:590
3225799166,6cyclictest0-21swapper/023:01:280
3225799165,3cyclictest0-21swapper/023:56:430
3225799164,11cyclictest3-21ksoftirqd/021:59:160
3225799161,14cyclictest41ktimersoftd/000:15:350
3225799161,14cyclictest10-21rcuc/021:46:590
3225799160,15cyclictest0-21swapper/023:41:530
278852160,0sleep20-21swapper/200:14:592
250762160,0sleep20-21swapper/221:39:252
20532160,0sleep20-21swapper/222:48:292
20532160,0sleep20-21swapper/222:48:292
128372160,0sleep10-21swapper/123:13:521
87892150,1sleep38787-21sshd22:29:233
87512150,1sleep21784-21runrttasks20:40:242
7892150,1sleep337-21rcuc/323:08:023
3226099151,2cyclictest0-21swapper/300:07:003
32259991513,1cyclictest0-21swapper/221:18:222
3225999151,13cyclictest26713-21sshd22:50:192
3225899150,14cyclictest16490-21sshd21:36:161
3225799159,5cyclictest0-21swapper/021:26:110
3225799158,6cyclictest21918-21sshd21:19:440
3225799157,7cyclictest11783-21sshd23:28:330
3225799154,1cyclictest3-21ksoftirqd/022:31:290
32257991511,3cyclictest3-21ksoftirqd/000:06:090
3225799150,1cyclictest41ktimersoftd/023:32:590
3225799150,14cyclictest41ktimersoftd/021:10:400
3225799150,14cyclictest0-21swapper/000:28:210
3225799150,10cyclictest7997-21sshd22:56:160
31272150,0sleep20-21swapper/223:55:002
290482150,0sleep20-21swapper/221:54:202
275572150,1sleep127555-21sshd00:33:131
264272150,0sleep326401-21sshd22:50:183
3226099149,4cyclictest0-21swapper/323:01:323
3226099149,4cyclictest0-21swapper/300:12:073
32260991412,1cyclictest0-21swapper/321:24:043
3226099141,12cyclictest4585-21sshd00:02:363
3226099140,13cyclictest10139-21sshd00:37:093
3225999141,12cyclictest0-21swapper/221:12:312
3225999140,13cyclictest0-21swapper/200:05:392
3225899149,2cyclictest24908-21sshd22:40:231
3225899149,1cyclictest120050irq/25-eth021:46:591
3225899144,1cyclictest21-21ksoftirqd/121:17:071
32258991413,1cyclictest21-21ksoftirqd/121:42:051
32258991413,1cyclictest19-21rcuc/122:11:581
3225899141,2cyclictest0-21swapper/122:05:481
3225899140,1cyclictest21-21ksoftirqd/121:13:111
3225899140,13cyclictest7344-21bash23:57:441
3225899140,13cyclictest0-21swapper/120:35:201
3225799148,5cyclictest0-21swapper/021:35:250
3225799142,2cyclictest31472-21bash23:10:200
32257991413,1cyclictest3-21ksoftirqd/022:46:430
32257991413,1cyclictest3-21ksoftirqd/022:46:430
32257991413,1cyclictest3-21ksoftirqd/022:05:070
3225799141,2cyclictest0-21swapper/020:30:090
32257991411,1cyclictest32231-21sshd23:15:170
3225799140,0cyclictest41ktimersoftd/000:11:090
231252140,0sleep30-21swapper/300:30:153
138182140,1sleep113819-21bash00:21:351
3226099139,1cyclictest22844-21rm21:48:593
3226099138,4cyclictest2708-21sshd23:40:103
3226099138,4cyclictest10551-21sshd22:36:493
3226099138,2cyclictest26009-21sshd21:51:373
3226099138,2cyclictest19988-21sshd22:20:223
3226099131,3cyclictest0-21swapper/321:11:183
32260991310,1cyclictest120050irq/25-eth023:55:053
3226099130,12cyclictest25278-21bash21:17:303
3226099130,12cyclictest10703-21sshd23:25:543
3226099130,12cyclictest0-21swapper/323:32:273
3226099130,12cyclictest0-21swapper/323:17:153
3226099130,10cyclictest16440-21sshd21:31:243
3226099130,10cyclictest0-21swapper/323:46:233
3226099130,10cyclictest0-21swapper/300:28:353
3225999139,3cyclictest0-21swapper/223:34:142
3225999138,4cyclictest11458-21sshd23:35:492
32259991311,1cyclictest0-21swapper/222:15:022
3225999130,4cyclictest25825-21sshd21:20:012
3225999130,4cyclictest25236-21bash21:46:402
3225999130,4cyclictest0-21swapper/200:00:072
3225999130,12cyclictest11607-21sshd00:34:362
3225999130,12cyclictest0-21swapper/219:15:012
3225999130,10cyclictest23907-21sshd21:41:422
3225899138,2cyclictest32045-21sshd21:52:051
3225899138,2cyclictest21148-21sshd22:20:271
3225899132,11cyclictest21476-21kworker/1:121:24:011
3225899132,10cyclictest21-21ksoftirqd/123:23:071
3225899131,9cyclictest120050irq/25-eth000:10:011
3225899131,3cyclictest21-21ksoftirqd/100:35:231
32258991312,1cyclictest21-21ksoftirqd/123:50:471
32258991312,1cyclictest21-21ksoftirqd/123:47:501
32258991310,1cyclictest120050irq/25-eth022:56:201
3225899130,1cyclictest0-21swapper/123:38:441
3225799130,10cyclictest0-21swapper/022:26:020
286812130,0sleep30-21swapper/323:22:233
3226099128,3cyclictest0-21swapper/321:36:203
3226099121,10cyclictest0-21swapper/322:45:273
3226099121,10cyclictest0-21swapper/322:45:273
32260991210,1cyclictest10250irq/24-ahci[00021:57:203
3225999129,2cyclictest0-21swapper/223:55:022
3225999129,2cyclictest0-21swapper/221:28:332
3225999129,2cyclictest0-21swapper/200:22:112
32259991211,1cyclictest21584-21diskmemload23:20:222
3225999120,11cyclictest0-21swapper/222:20:262
32258991211,1cyclictest21-21ksoftirqd/123:27:351
3225899120,11cyclictest0-21swapper/123:05:101
3225899120,11cyclictest0-21swapper/119:35:191
3225999110,10cyclictest15949-21bash22:25:012
3225899119,1cyclictest0-21swapper/119:15:021
3225899113,7cyclictest0-21swapper/120:34:551
3225799110,11cyclictest0-21swapper/021:09:460
3225799110,10cyclictest0-21swapper/020:53:170
3225799110,10cyclictest0-21swapper/020:15:320
3225799110,10cyclictest0-21swapper/019:15:010
3226099109,1cyclictest0-21swapper/319:33:593
3226099101,8cyclictest0-21swapper/320:04:393
3225999100,10cyclictest0-21swapper/219:55:132
3225899102,5cyclictest0-21swapper/120:15:101
3225899100,9cyclictest0-21swapper/119:30:211
3225899100,1cyclictest21765-21date21:10:001
3225899100,10cyclictest0-21swapper/119:11:001
3225799109,1cyclictest0-21swapper/021:01:180
3225799109,1cyclictest0-21swapper/020:29:480
3225799100,5cyclictest0-21swapper/019:30:140
3225799100,10cyclictest0-21swapper/020:45:230
322609998,1cyclictest0-21swapper/321:08:253
322609990,9cyclictest0-21swapper/320:16:503
322599998,1cyclictest0-21swapper/220:33:402
322599998,1cyclictest0-21swapper/220:14:572
322599990,8cyclictest0-21swapper/220:51:542
322599990,6cyclictest0-21swapper/219:50:102
322599990,1cyclictest0-21swapper/219:23:372
322589998,1cyclictest0-21swapper/119:58:301
322589998,1cyclictest0-21swapper/119:25:301
322589995,4cyclictest21-21ksoftirqd/120:20:021
322589994,5cyclictest0-21swapper/119:22:231
322589991,5cyclictest0-21swapper/120:46:571
322589991,5cyclictest0-21swapper/120:44:451
322589990,9cyclictest0-21swapper/121:02:561
322589990,9cyclictest0-21swapper/120:54:221
322589990,9cyclictest0-21swapper/119:53:171
322579997,1cyclictest0-21swapper/020:10:190
322579990,8cyclictest41ktimersoftd/020:20:240
322579990,8cyclictest41ktimersoftd/020:00:300
322609985,2cyclictest31887-21munin-node20:20:293
322609981,6cyclictest0-21swapper/321:00:103
322609981,6cyclictest0-21swapper/320:40:273
322609981,6cyclictest0-21swapper/319:25:143
322609980,7cyclictest0-21swapper/319:44:253
322609980,7cyclictest0-21swapper/319:24:103
322599987,1cyclictest0-21swapper/221:01:462
322599987,1cyclictest0-21swapper/220:15:052
322599984,4cyclictest0-21swapper/220:55:302
322599981,6cyclictest0-21swapper/220:20:182
322599981,6cyclictest0-21swapper/219:25:182
322589983,5cyclictest0-21swapper/120:55:401
322589983,3cyclictest0-21swapper/120:28:291
322589983,3cyclictest0-21swapper/119:42:131
322589980,4cyclictest0-21swapper/120:10:571
322579987,1cyclictest0-21swapper/020:37:350
322579985,2cyclictest0-21swapper/019:45:160
322579981,4cyclictest0-21swapper/019:20:300
322579980,8cyclictest0-21swapper/020:07:490
322579980,7cyclictest0-21swapper/021:00:010
322579980,4cyclictest9625-21munin-run20:45:010
322609976,1cyclictest0-21swapper/320:56:483
322609975,1cyclictest404-21atenall_rapower20:25:123
322609975,1cyclictest2804-21munin-node19:15:023
322609975,1cyclictest26942-21munin-node20:10:303
322609975,1cyclictest12784-21cstates19:35:133
322609971,6cyclictest0-21swapper/319:10:093
322609971,5cyclictest0-21swapper/319:55:113
322609970,6cyclictest0-21swapper/320:50:153
322609970,6cyclictest0-21swapper/320:45:103
322609970,6cyclictest0-21swapper/320:35:133
322609970,6cyclictest0-21swapper/320:30:123
322609970,6cyclictest0-21swapper/320:05:113
322599975,1cyclictest21342sleep220:25:512
322599973,2cyclictest0-21swapper/220:45:182
322599971,5cyclictest0-21swapper/219:35:132
322599970,6cyclictest0-21swapper/221:05:142
322599970,6cyclictest0-21swapper/220:35:262
322599970,6cyclictest0-21swapper/220:05:152
322599970,6cyclictest0-21swapper/220:00:122
322599970,6cyclictest0-21swapper/219:40:552
322599970,4cyclictest0-21swapper/219:45:102
322599970,4cyclictest0-21swapper/219:12:232
322589972,5cyclictest21-21ksoftirqd/119:46:471
322589972,5cyclictest0-21swapper/120:05:151
322589972,3cyclictest0-21swapper/120:00:311
322579975,1cyclictest14799-21chrt19:40:100
322579972,4cyclictest3-21ksoftirqd/019:10:110
322579971,5cyclictest41ktimersoftd/019:25:150
322579970,6cyclictest0-21swapper/019:39:590
322579970,1cyclictest18864-21diskstats19:55:100
322609964,1cyclictest15419-21munin-node19:45:073
322599960,5cyclictest0-21swapper/219:30:242
322579960,6cyclictest0-21swapper/019:50:500
322609950,4cyclictest18196-21turbostat19:54:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional