You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 04:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot0.osadl.org (updated Sat Jul 27, 2024 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2886521210,2sleep10-21swapper/122:35:241
453921190,3sleep2289999cyclictest22:03:462
195612950,1sleep00-21swapper/000:37:340
250629333,56sleep10-21swapper/119:08:211
246962910,2sleep224690-21sshd23:49:032
291652870,2sleep20-21swapper/222:05:542
257612860,2sleep30-21swapper/323:52:033
133292860,2sleep20-21swapper/221:26:242
99472850,2sleep20-21swapper/200:30:152
99472850,2sleep20-21swapper/200:30:152
64132850,2sleep30-21swapper/300:08:233
205482850,2sleep10-21swapper/100:09:461
244432840,3sleep0289099cyclictest00:07:000
4622830,1sleep0460-21seq23:29:010
151042830,1sleep20-21swapper/200:06:062
261228232,45sleep30-21swapper/319:09:383
114342820,2sleep111432-21sshd22:07:181
6422800,2sleep2643-21sshd23:05:192
289392800,2sleep30-21swapper/323:31:323
285092790,3sleep228505-21bash21:57:052
253782790,2sleep225372-21bash22:32:082
253782790,2sleep225372-21bash22:32:082
64502780,2sleep26448-21sshd21:43:222
326262780,2sleep32405-21runrttasks00:13:573
284452780,1sleep028442-21bash22:08:540
263552760,2sleep3290399cyclictest21:27:373
23812760,1sleep00-21swapper/021:51:460
240832740,0sleep00-21swapper/000:28:320
240832740,0sleep00-21swapper/000:28:320
263927332,12sleep20-21swapper/219:09:582
90882710,4sleep1289499cyclictest23:59:321
306252710,4sleep2289999cyclictest22:41:262
205372710,1sleep10-21swapper/123:51:341
188132710,2sleep20-21swapper/222:19:502
202812700,2sleep1289499cyclictest22:28:471
241542690,1sleep224152-21sshd22:14:252
22202690,2sleep10-21swapper/123:08:261
192132660,0sleep119209-21rm00:12:381
279902650,3sleep31848-21nfsd21:54:103
85712640,1sleep08556-21sshd21:25:570
249025733,21sleep00-21swapper/019:08:070
189042460,1sleep30-21swapper/322:08:013
52552340,31sleep3135650irq/27-eth023:02:483
45702340,1sleep00-21swapper/021:43:130
253352340,32sleep3135650irq/27-eth021:18:473
177892340,1sleep010-21rcuc/022:10:460
7072320,30sleep1135650irq/27-eth021:10:401
5642320,29sleep1135650irq/27-eth022:15:131
306982310,2sleep236-21rcuop/221:54:252
158062300,1sleep015804-21bash00:30:450
158062300,1sleep015804-21bash00:30:450
315102290,2sleep10-21swapper/121:19:211
115852290,3sleep211582-21sshd22:25:022
231892280,2sleep223188-21sshd00:03:542
241622270,4sleep324148-21sshd22:43:513
209782270,2sleep10-21swapper/122:20:011
128212270,1sleep10-21swapper/122:54:391
204962260,2sleep12405-21runrttasks21:30:021
164462260,1sleep10-21swapper/122:34:201
164462260,1sleep10-21swapper/122:34:191
56662250,3sleep2289999cyclictest23:20:292
36392250,2sleep10-21swapper/100:23:281
288772250,23sleep1135650irq/27-eth022:03:031
16512250,2sleep21645-21sshd00:23:162
72092240,2sleep32405-21runrttasks19:19:593
287792240,1sleep028771-21sshd21:10:180
104382240,0sleep310435-21sshd21:40:433
291462230,11sleep1135650irq/27-eth021:54:161
289999234,15cyclictest26618-21sshd23:43:152
2894992319,2cyclictest0-21swapper/122:46:531
2894992319,2cyclictest0-21swapper/122:46:521
249292230,1sleep10-21swapper/122:11:261
231472230,21sleep3135650irq/27-eth022:11:183
135182230,2sleep113515-21sshd23:24:171
320272220,20sleep3135650irq/27-eth022:35:393
289999223,15cyclictest23557-21sshd21:33:142
189282220,2sleep041ktimersoftd/023:24:480
92832210,3sleep10-21swapper/121:40:371
289999214,15cyclictest2345-21sshd23:55:492
289099218,4cyclictest0-21swapper/021:21:520
2890992119,1cyclictest28975-21bash22:41:160
265752210,2sleep226574-21id23:37:162
20262210,2sleep20-21swapper/200:14:082
289999200,17cyclictest33-21ksoftirqd/221:35:532
289499200,6cyclictest20815-21sshd21:38:511
151702200,18sleep3135650irq/27-eth023:42:113
289999193,11cyclictest33-21ksoftirqd/200:15:012
289999192,14cyclictest33-21ksoftirqd/221:21:412
290399181,4cyclictest32765-21sshd23:37:523
290399180,13cyclictest0-21swapper/321:10:353
290399180,11cyclictest6846-21sshd22:15:393
289999185,5cyclictest32440-21sshd00:35:322
289999183,13cyclictest1848-21nfsd23:31:292
289999183,10cyclictest33-21ksoftirqd/221:46:322
289999182,11cyclictest4051-21sshd23:14:332
289999180,13cyclictest4306-21sshd23:29:222
289499186,4cyclictest17639-21sshd23:15:401
289499180,5cyclictest20595-21sshd22:43:311
289499180,10cyclictest0-21swapper/123:34:411
2890991816,1cyclictest8872-21sshd23:09:040
2890991816,1cyclictest23952-21sshd23:54:560
2890991815,2cyclictest25549-21sshd22:46:530
2890991815,2cyclictest25549-21sshd22:46:530
2890991811,4cyclictest0-21swapper/021:16:190
289099180,12cyclictest0-21swapper/000:22:520
225172180,0sleep041ktimersoftd/021:47:460
290399178,7cyclictest0-21swapper/323:22:323
290399172,3cyclictest32707-21sshd23:17:073
290399170,15cyclictest1959-21sshd22:51:323
290399170,12cyclictest9179-21sshd23:47:353
290399170,10cyclictest11735-21sshd21:23:233
289999173,11cyclictest5364-21sshd22:53:572
289999170,9cyclictest33-21ksoftirqd/222:47:352
289999170,9cyclictest33-21ksoftirqd/222:47:352
289999170,13cyclictest24342-21sshd21:18:422
289499178,7cyclictest31932-21sshd23:43:441
289499176,4cyclictest8962-21sshd23:00:111
289499173,4cyclictest29163-21bash00:25:491
289499173,4cyclictest29163-21bash00:25:481
289499173,13cyclictest18266-21sshd00:15:331
289099177,9cyclictest27897-21sshd23:16:390
289099173,8cyclictest1066-21sshd22:18:100
2890991715,1cyclictest1974-21sshd22:50:340
2890991715,1cyclictest0-21swapper/022:27:570
2890991714,2cyclictest24310-21sshd23:13:250
2890991714,2cyclictest0-21swapper/021:31:240
289099170,5cyclictest5587-21bash23:02:490
289099170,16cyclictest0-21swapper/000:17:410
289099170,15cyclictest1959-21sshd00:14:470
289099170,13cyclictest1848-21nfsd23:42:540
202742170,15sleep1135650irq/27-eth021:27:031
12192170,15sleep1135650irq/27-eth023:49:551
290399169,4cyclictest30766-21sshd23:05:103
290399169,3cyclictest0-21swapper/322:46:573
290399169,3cyclictest0-21swapper/322:46:573
2903991613,2cyclictest0-21swapper/300:26:523
2903991613,2cyclictest0-21swapper/300:26:523
290399160,5cyclictest14373-21sshd22:34:083
290399160,5cyclictest14373-21sshd22:34:073
290399160,4cyclictest25221-21bash21:56:463
290399160,4cyclictest21802-21sshd22:55:233
290399160,3cyclictest31450-21sshd00:32:193
290399160,3cyclictest31450-21sshd00:32:193
290399160,14cyclictest4721-21sshd23:26:223
290399160,14cyclictest27299-21sshd23:55:143
290399160,14cyclictest23611-21bash22:29:053
290399160,14cyclictest12790-21bash00:24:233
290399160,14cyclictest0-21swapper/321:35:133
290399160,14cyclictest0-21swapper/321:30:093
290399160,11cyclictest9819-21sshd00:17:553
290399160,11cyclictest14621-21sshd00:37:043
290399160,11cyclictest0-21swapper/321:48:073
289999165,3cyclictest25-21rcuop/121:12:332
289999162,13cyclictest1131-21jbd2/dm-2-823:16:442
289999162,11cyclictest13876-21munin-run22:40:002
289999160,4cyclictest11651-21ntp_states23:00:222
289999160,14cyclictest0-21swapper/223:52:062
289499164,3cyclictest0-21swapper/123:11:431
289499164,3cyclictest0-21swapper/122:56:511
289499161,3cyclictest3103-21sshd21:45:561
289499160,6cyclictest1959-21sshd21:20:031
289499160,3cyclictest31309-21sshd23:25:481
289499160,3cyclictest0-21swapper/123:35:311
289499160,14cyclictest7396-21sshd00:39:371
289499160,14cyclictest0-21swapper/121:55:181
289499160,11cyclictest135650irq/27-eth000:01:221
289099168,7cyclictest0-21swapper/022:57:130
289099163,10cyclictest0-21swapper/022:34:110
289099163,10cyclictest0-21swapper/022:34:100
2890991614,1cyclictest0-21swapper/023:36:390
2890991614,1cyclictest0-21swapper/022:22:130
289099160,14cyclictest9744-21sshd00:02:340
289099160,14cyclictest0-21swapper/021:37:590
289099160,11cyclictest31732-21sshd23:49:430
289099160,11cyclictest0-21swapper/021:55:260
226542160,2sleep10-21swapper/100:31:261
226542160,2sleep10-21swapper/100:31:261
152592160,14sleep3135650irq/27-eth022:22:243
290399150,3cyclictest20356-21sshd23:10:063
290399150,13cyclictest16609-21bash00:00:123
290399150,10cyclictest0-21swapper/322:02:533
289999157,6cyclictest0-21swapper/200:25:062
289999157,6cyclictest0-21swapper/200:25:062
289999152,8cyclictest15435-21munin-run20:50:002
289999152,11cyclictest2291-21kworker/u8:219:15:422
289999152,10cyclictest144550irq/28-eth1-rx-20:01:482
289999151,4cyclictest0-21swapper/220:06:172
289999151,4cyclictest0-21swapper/219:27:052
2899991512,2cyclictest14864-21id22:22:202
289999150,13cyclictest32339-21sshd22:56:202
289499150,10cyclictest135650irq/27-eth020:25:131
289099156,8cyclictest0-21swapper/019:35:180
2890991513,1cyclictest0-21swapper/023:58:330
289099150,12cyclictest0-21swapper/019:55:410
289099150,10cyclictest0-21swapper/022:04:160
290399140,3cyclictest135650irq/27-eth021:07:143
289999149,4cyclictest135650irq/27-eth020:56:092
289999149,4cyclictest135650irq/27-eth020:56:092
289999143,1cyclictest0-21swapper/220:15:142
289999142,10cyclictest417-21jbd2/dm-0-819:21:022
289999140,13cyclictest1848-21nfsd20:42:262
289999140,13cyclictest0-21swapper/221:07:432
289499149,4cyclictest0-21swapper/120:35:031
289499148,5cyclictest0-21swapper/121:01:261
289499148,5cyclictest0-21swapper/120:00:321
289499148,3cyclictest0-21swapper/120:47:101
289499148,3cyclictest0-21swapper/120:30:481
289499147,3cyclictest135650irq/27-eth020:59:491
289499147,3cyclictest135650irq/27-eth020:59:481
2894991410,3cyclictest135650irq/27-eth021:05:011
289499140,7cyclictest0-21swapper/119:10:171
289499140,13cyclictest0-21swapper/120:55:001
289499140,13cyclictest0-21swapper/120:20:321
289499140,13cyclictest0-21swapper/120:08:321
289499140,10cyclictest0-21swapper/119:25:131
289099148,2cyclictest0-21swapper/020:10:240
289099147,4cyclictest0-21swapper/022:39:540
289099144,9cyclictest0-21swapper/023:31:520
2890991413,1cyclictest0-21swapper/020:57:070
2890991413,1cyclictest0-21swapper/020:57:060
289099140,7cyclictest0-21swapper/020:40:170
289099140,13cyclictest0-21swapper/020:39:390
94932130,3sleep30-21swapper/320:35:123
290399139,3cyclictest135650irq/27-eth021:00:023
290399139,3cyclictest135650irq/27-eth020:22:353
290399139,3cyclictest135650irq/27-eth019:25:013
290399136,3cyclictest0-21swapper/320:30:113
290399131,11cyclictest135650irq/27-eth019:50:103
290399131,11cyclictest135650irq/27-eth019:10:333
2903991311,1cyclictest0-21swapper/320:25:403
290399130,5cyclictest0-21swapper/320:50:313
290399130,12cyclictest1848-21nfsd19:40:283
290399130,12cyclictest135650irq/27-eth020:00:003
290399130,12cyclictest0-21swapper/320:55:473
290399130,12cyclictest0-21swapper/320:55:463
290399130,12cyclictest0-21swapper/320:45:093
290399130,12cyclictest0-21swapper/320:40:443
290399130,12cyclictest0-21swapper/320:18:313
290399130,12cyclictest0-21swapper/320:13:333
290399130,12cyclictest0-21swapper/319:55:313
290399130,12cyclictest0-21swapper/319:31:593
290399130,12cyclictest0-21swapper/319:22:383
289999138,4cyclictest135650irq/27-eth019:45:182
289999131,11cyclictest21483-1kworker/dying19:50:442
2899991310,2cyclictest0-21swapper/219:40:162
289999130,5cyclictest0-21swapper/219:31:582
289999130,12cyclictest73092sleep220:30:132
289999130,12cyclictest15657-21munin-node20:50:122
289999130,12cyclictest0-21swapper/220:35:352
289999130,12cyclictest0-21swapper/220:13:292
289999130,12cyclictest0-21swapper/219:14:002
289999130,11cyclictest2405-21runrttasks21:00:062
289999130,11cyclictest2257-21cpu20:20:112
289499138,4cyclictest0-21swapper/120:10:381
289499138,4cyclictest0-21swapper/119:50:331
289499138,2cyclictest0-21swapper/119:46:011
289499137,5cyclictest0-21swapper/119:40:361
289499131,11cyclictest0-21swapper/119:22:101
289499130,12cyclictest0-21swapper/120:15:351
289499130,11cyclictest14519-21diskstats19:35:121
289499130,11cyclictest12819-21memory19:30:181
289499130,10cyclictest0-21swapper/120:40:541
289499130,10cyclictest0-21swapper/119:56:541
289099139,2cyclictest0-21swapper/021:02:070
289099137,3cyclictest0-21swapper/020:31:420
289099131,3cyclictest0-21swapper/020:51:340
289099130,2cyclictest0-21swapper/020:07:170
289099130,1cyclictest0-21swapper/020:21:280
289099130,1cyclictest0-21swapper/019:30:230
289099130,12cyclictest0-21swapper/020:04:100
289099130,12cyclictest0-21swapper/019:41:460
290399120,3cyclictest28679-21munin-node20:05:183
290399120,11cyclictest1847-21nfsd19:35:353
290399120,10cyclictest18776-21munin-node19:45:093
289999127,4cyclictest1848-21nfsd20:25:512
289999120,11cyclictest1848-21nfsd19:35:212
289499120,10cyclictest5436-21df19:15:101
289099128,3cyclictest0-21swapper/019:25:370
289099121,4cyclictest0-21swapper/020:15:170
2890991210,1cyclictest0-21swapper/019:13:330
289099120,1cyclictest0-21swapper/019:17:390
289099120,11cyclictest2405-21runrttasks19:45:040
289099120,11cyclictest0-21swapper/021:05:360
289099120,11cyclictest0-21swapper/020:45:100
289099120,11cyclictest0-21swapper/020:27:360
289099120,11cyclictest0-21swapper/019:20:220
289999111,9cyclictest0-21swapper/219:55:212
289099112,8cyclictest7231-21kworker/0:119:50:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional