You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-04 - 02:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Fri Oct 04, 2024 00:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
232421410,0sleep32323-21bash21:21:333
2867521260,2sleep328670-21sshd21:35:233
1226321210,3sleep20-21swapper/221:52:132
2762621160,5sleep00-21swapper/023:56:220
1178121070,1sleep20-21swapper/223:13:242
494129733,43sleep10-21swapper/119:09:261
145242930,2sleep10-21swapper/100:22:201
47462920,2sleep30-21swapper/300:09:123
304072920,2sleep230395-21sshd21:58:062
494528833,42sleep30-21swapper/319:09:283
201092870,1sleep2524699cyclictest00:03:092
153022870,3sleep1524599cyclictest23:58:481
75612830,1sleep10-21swapper/121:11:161
225012830,1sleep30-21swapper/300:19:253
156822830,1sleep015684-21id21:23:060
135862830,1sleep00-21swapper/023:17:190
79962820,1sleep2524699cyclictest22:43:192
288332810,1sleep00-21swapper/021:31:480
280952810,1sleep028094-21bash22:52:590
202682810,1sleep041ktimersoftd/022:18:560
189872790,1sleep30-21swapper/322:18:473
224082770,1sleep2524699cyclictest23:25:472
233442760,2sleep20-21swapper/221:42:192
187222760,1sleep00-21swapper/023:44:120
290412750,2sleep30-21swapper/321:54:153
234242730,2sleep20-21swapper/223:52:122
13862730,5sleep1524599cyclictest22:09:311
84572720,1sleep30-21swapper/323:39:193
269462720,2sleep11847-21nfsd23:33:591
210422720,2sleep20-21swapper/222:22:392
39372700,2sleep30-21swapper/323:27:283
328627032,21sleep20-21swapper/219:05:142
319922700,3sleep2524699cyclictest21:32:102
459425835,11sleep00-21swapper/019:05:250
289322300,28sleep1135650irq/27-eth021:17:191
279162290,27sleep2135650irq/27-eth023:56:262
5742280,2sleep30-21swapper/321:28:423
524299288,5cyclictest3-21ksoftirqd/023:31:280
300942280,0sleep00-21swapper/023:23:010
250172280,26sleep3135650irq/27-eth023:30:013
139582260,2sleep10-21swapper/100:02:251
299352250,2sleep30-21swapper/300:12:163
216362250,2sleep20-21swapper/222:19:062
208672250,22sleep2135650irq/27-eth022:04:252
125032250,3sleep10-21swapper/122:21:381
254472240,2sleep20-21swapper/222:26:492
225322240,3sleep20-21swapper/223:22:062
133792240,2sleep113376-21sshd23:24:531
524799230,20cyclictest0-21swapper/320:08:253
45982230,0sleep00-21swapper/021:14:400
54782220,1sleep10-21swapper/100:37:271
524699223,6cyclictest0-21swapper/222:54:272
524699223,16cyclictest2084-21sshd23:34:532
524699222,13cyclictest0-21swapper/223:17:212
317752220,1sleep10-21swapper/123:45:331
281312220,2sleep10-21swapper/100:32:061
271162220,20sleep1135650irq/27-eth022:38:061
152522220,2sleep30-21swapper/323:43:483
54082210,19sleep3135650irq/27-eth023:05:133
524299210,4cyclictest0-21swapper/022:00:320
255562210,2sleep20-21swapper/221:16:552
87612200,18sleep1135650irq/27-eth023:28:031
524799200,11cyclictest0-21swapper/321:49:493
524699201,13cyclictest3443-21sshd23:35:012
524299205,12cyclictest0-21swapper/022:39:410
51222200,1sleep00-21swapper/000:33:210
217002200,1sleep00-21swapper/023:37:030
209682201,17sleep1135650irq/27-eth021:23:441
524699193,8cyclictest135650irq/27-eth020:26:552
524299197,5cyclictest31823-21sshd22:45:570
524299197,5cyclictest31823-21sshd22:45:560
25662190,1sleep20-21swapper/222:46:192
25662190,1sleep20-21swapper/222:46:192
252552190,17sleep1135650irq/27-eth021:57:301
22682190,2sleep12267-21sshd21:47:191
108302190,2sleep110826-21bash00:05:541
101462190,0sleep31847-21nfsd23:46:513
5247991812,4cyclictest13871-21bash22:07:113
5247991810,6cyclictest1457-21sshd00:00:533
524799180,6cyclictest0-21swapper/321:12:253
524799180,12cyclictest31463-21sshd00:20:223
524699183,9cyclictest36-21rcuop/222:55:012
524699183,5cyclictest30199-21sshd21:28:232
524699182,7cyclictest10326-21perl19:20:132
524699182,13cyclictest24889-21sshd00:35:442
524699182,13cyclictest135650irq/27-eth021:06:432
524599183,13cyclictest24879-21sshd22:45:131
524599183,13cyclictest24879-21sshd22:45:131
524599180,17cyclictest135650irq/27-eth022:55:071
524299183,9cyclictest9521-21bash23:01:530
5242991814,3cyclictest1848-21nfsd22:05:170
524299180,9cyclictest13652-21sshd23:28:390
524299180,7cyclictest17612-21rm22:29:410
524299180,16cyclictest27235-21sshd23:07:430
524299180,16cyclictest11973-21sshd21:30:000
524299180,13cyclictest0-21swapper/000:22:100
524299180,12cyclictest21359-21sshd00:03:190
180322180,0sleep30-21swapper/322:48:103
180322180,0sleep30-21swapper/322:48:093
154952180,2sleep32405-21runrttasks19:30:193
60022170,15sleep1135650irq/27-eth022:31:571
58372170,15sleep3135650irq/27-eth021:44:063
5247991712,3cyclictest10061-21sshd21:15:123
524699175,11cyclictest30814-21ntp_states00:20:192
524699173,10cyclictest135650irq/27-eth020:53:052
524699172,10cyclictest3321-21bash22:31:372
524699172,10cyclictest13962-21sshd00:06:172
524699172,10cyclictest13119-21sshd22:36:252
524699171,11cyclictest18285-21bash00:18:532
524699171,10cyclictest417-21jbd2/dm-0-820:45:592
524599170,13cyclictest0-21swapper/122:40:421
524599170,12cyclictest22640-21munin-plugin-st21:00:001
524599170,12cyclictest22640-21munin-plugin-st21:00:001
524599170,12cyclictest16955-21sshd22:29:361
524299174,9cyclictest1959-21sshd21:36:280
524299173,3cyclictest22758-21sshd00:07:230
524299173,10cyclictest0-21swapper/000:39:590
524299172,9cyclictest0-21swapper/021:55:110
524299171,3cyclictest0-21swapper/000:13:310
5242991713,1cyclictest0-21swapper/021:16:500
5242991712,1cyclictest144550irq/28-eth1-rx-23:13:360
524299170,16cyclictest0-21swapper/021:52:240
524299170,13cyclictest14457-21rm21:45:060
36472170,1sleep20-21swapper/223:01:112
147092170,1sleep10-21swapper/122:18:171
524799162,11cyclictest4758-21sshd23:20:083
524799162,10cyclictest19602-21sshd00:35:123
524799161,3cyclictest0-21swapper/300:25:403
524799161,14cyclictest0-21swapper/320:15:433
5247991610,4cyclictest25274-21munin-run00:00:003
524699163,8cyclictest135650irq/27-eth021:04:032
524699163,8cyclictest135650irq/27-eth020:59:592
524699163,8cyclictest135650irq/27-eth020:59:592
524699163,8cyclictest135650irq/27-eth020:30:392
524699163,8cyclictest135650irq/27-eth020:19:462
524699163,8cyclictest135650irq/27-eth020:14:352
524699163,8cyclictest135650irq/27-eth019:46:192
524699163,8cyclictest135650irq/27-eth019:41:272
524699163,8cyclictest135650irq/27-eth019:18:092
524699163,10cyclictest22697-21sshd21:45:532
524699163,10cyclictest135650irq/27-eth022:10:052
524699163,10cyclictest135650irq/27-eth019:28:472
524699163,10cyclictest0-21swapper/221:14:292
524699162,13cyclictest135650irq/27-eth020:23:352
5246991611,2cyclictest9985-21sshd23:43:102
524599162,2cyclictest6645-21sshd23:01:321
524299169,3cyclictest36-21rcuop/223:45:150
524299164,9cyclictest0-21swapper/023:52:460
524299163,9cyclictest0-21swapper/000:28:200
5242991612,1cyclictest15749-21sshd21:41:240
5242991612,1cyclictest14998-21sshd22:32:590
5242991610,2cyclictest0-21swapper/022:40:120
524299160,9cyclictest0-21swapper/022:20:440
524299160,1cyclictest0-21swapper/019:14:480
524299160,13cyclictest0-21swapper/000:18:160
524299160,12cyclictest0-21swapper/022:55:250
133102161,13sleep3135650irq/27-eth022:21:453
90152150,2sleep30-21swapper/322:58:113
524799157,7cyclictest24176-21sshd22:12:003
524799157,6cyclictest0-21swapper/323:15:453
524799153,6cyclictest135650irq/27-eth022:40:463
524799153,10cyclictest135650irq/27-eth022:25:173
524799152,12cyclictest0-21swapper/319:15:533
524799150,14cyclictest21639-21sshd22:52:133
524799150,10cyclictest8993-21sshd22:32:163
524699153,5cyclictest135650irq/27-eth022:09:272
524699152,8cyclictest1848-21nfsd00:32:282
524699152,8cyclictest135650irq/27-eth019:12:552
524699152,11cyclictest31514-21sshd23:08:132
524699152,10cyclictest28808-21bash23:45:182
524699152,10cyclictest24388-21sshd00:11:332
524699151,10cyclictest1131-21jbd2/dm-2-821:20:292
524699150,13cyclictest0-21swapper/219:39:532
524599159,5cyclictest26358-21sshd21:42:401
524599158,5cyclictest17435-21sshd00:14:491
524599158,3cyclictest5919-21munin-node22:50:231
524599151,13cyclictest5278-21munin-node23:50:151
524599150,6cyclictest0-21swapper/121:36:111
524599150,6cyclictest0-21swapper/100:27:231
524599150,3cyclictest22374-21sshd23:14:401
524599150,13cyclictest31979-21taskset20:06:221
524599150,13cyclictest0-21swapper/123:36:371
524599150,13cyclictest0-21swapper/121:34:161
524599150,13cyclictest0-21swapper/121:05:181
524299155,1cyclictest0-21swapper/020:25:180
524299150,9cyclictest0-21swapper/020:30:190
524299150,1cyclictest0-21swapper/022:10:350
524299150,1cyclictest0-21swapper/020:45:120
524799147,5cyclictest2162-21sshd00:32:583
5247991412,1cyclictest0-21swapper/323:50:193
5247991411,2cyclictest0-21swapper/321:30:083
524799141,11cyclictest5892-21iostat_ios21:55:143
524799140,4cyclictest20405-21sshd23:14:273
524799140,12cyclictest1959-21sshd23:00:143
524799140,12cyclictest16261-21sshd22:00:123
524799140,11cyclictest1848-21nfsd20:40:003
524699142,10cyclictest23010-21sshd00:27:252
524699142,10cyclictest135650irq/27-eth019:50:112
524699141,8cyclictest25563-21sshd21:35:112
524699141,10cyclictest0-21swapper/220:40:102
524599143,6cyclictest0-21swapper/123:09:221
524599142,4cyclictest135650irq/27-eth022:11:221
524599142,3cyclictest9235-21munin-node20:30:111
5245991411,2cyclictest0-21swapper/119:20:191
524599141,11cyclictest3939-21sshd21:25:211
524599140,13cyclictest22369-21sshd23:18:241
524599140,13cyclictest19012-21munin-node20:50:171
524599140,13cyclictest0-21swapper/119:47:011
524599140,12cyclictest15401-21sshd22:00:081
524599140,12cyclictest15089-21sshd23:40:041
524799137,5cyclictest21338-21munin-node20:55:143
524799137,5cyclictest21338-21munin-node20:55:143
524799131,11cyclictest135650irq/27-eth022:35:383
524799131,11cyclictest135650irq/27-eth020:45:043
524799131,11cyclictest0-21swapper/319:44:033
524799130,4cyclictest5450-21cpuspeed_turbos19:10:113
524799130,4cyclictest25691-21munin-node19:55:143
524799130,12cyclictest0-21swapper/321:05:213
524799130,12cyclictest0-21swapper/321:00:053
524799130,12cyclictest0-21swapper/320:51:583
524799130,12cyclictest0-21swapper/320:43:213
524799130,12cyclictest0-21swapper/320:30:053
524799130,12cyclictest0-21swapper/320:25:113
524799130,12cyclictest0-21swapper/320:21:553
524799130,12cyclictest0-21swapper/320:11:293
524799130,12cyclictest0-21swapper/320:01:143
524799130,12cyclictest0-21swapper/319:46:573
524799130,12cyclictest0-21swapper/319:35:313
524799130,11cyclictest23753-21diskstats19:50:133
524699137,4cyclictest0-21swapper/220:04:332
524699133,9cyclictest417-21jbd2/dm-0-820:05:052
524699132,8cyclictest0-21swapper/219:58:592
524699130,12cyclictest0-21swapper/220:35:442
524599137,5cyclictest0-21swapper/121:00:561
524599137,5cyclictest0-21swapper/120:47:241
524599137,5cyclictest0-21swapper/120:10:401
524599132,5cyclictest7593-21sshd00:17:301
524599130,4cyclictest18432-21sshd19:37:221
524599130,12cyclictest30246-21sshd21:50:281
524599130,12cyclictest1848-21nfsd20:26:261
524599130,12cyclictest0-21swapper/120:35:081
524599130,12cyclictest0-21swapper/120:20:021
524599130,12cyclictest0-21swapper/120:01:261
524599130,12cyclictest0-21swapper/119:55:441
524599130,12cyclictest0-21swapper/119:44:111
524599130,12cyclictest0-21swapper/119:29:561
524599130,11cyclictest8304-21irqstats19:15:161
524599130,11cyclictest15108-21iostat_ios19:30:151
524299138,2cyclictest0-21swapper/021:06:390
5242991311,1cyclictest0-21swapper/020:43:040
5242991311,1cyclictest0-21swapper/019:26:140
524299130,12cyclictest0-21swapper/020:14:460
524299130,12cyclictest0-21swapper/019:24:380
524299130,10cyclictest0-21swapper/020:55:010
524299130,10cyclictest0-21swapper/020:55:010
524799120,3cyclictest10565-21iostat_ios19:20:143
524799120,10cyclictest0-21swapper/319:25:113
524699120,11cyclictest14346-21munin-node19:30:202
524599127,3cyclictest23746-21df_inode19:50:131
5245991211,1cyclictest0-21swapper/119:10:071
524599120,11cyclictest0-21swapper/120:40:081
524599120,11cyclictest0-21swapper/120:17:441
524299129,2cyclictest0-21swapper/019:50:120
524299128,3cyclictest0-21swapper/019:30:040
524299125,3cyclictest18644-21df_inode20:50:150
5242991210,1cyclictest0-21swapper/021:02:380
524299120,3cyclictest0-21swapper/020:35:390
524299120,11cyclictest0-21swapper/020:03:240
524299120,11cyclictest0-21swapper/019:19:040
524299120,10cyclictest0-21swapper/019:35:160
524299119,1cyclictest0-21swapper/020:06:050
524299118,2cyclictest0-21swapper/019:40:130
524299116,4cyclictest0-21swapper/019:55:250
524299111,9cyclictest0-21swapper/020:15:180
524299111,8cyclictest0-21swapper/019:45:420
524299111,2cyclictest0-21swapper/020:21:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional