You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 13:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Thu Apr 25, 2024 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1316721280,1sleep213160-21cp22:27:522
2057721240,1sleep10-21swapper/122:55:051
1873021230,1sleep018690-21sshd00:15:230
582521170,2sleep20-21swapper/200:05:392
1919210635,43sleep10-21swapper/119:06:331
243362980,0sleep00-21swapper/000:20:160
71212950,2sleep30-21swapper/300:01:563
54562930,1sleep00-21swapper/022:49:310
22682890,2sleep11877-21nfsd22:08:001
207212890,3sleep10-21swapper/122:17:341
188628836,43sleep30-21swapper/319:06:123
173212850,5sleep136-21rcuop/223:59:171
82762840,2sleep10-21swapper/123:54:231
298222840,2sleep00-21swapper/021:33:490
277782840,1sleep00-21swapper/000:12:300
206028443,12sleep20-21swapper/219:07:512
80622830,3sleep10-21swapper/100:05:581
279132820,3sleep0245999cyclictest00:29:100
117912810,0sleep00-21swapper/023:39:400
295012800,1sleep20-21swapper/223:15:062
149292800,2sleep30-21swapper/300:06:533
104072800,2sleep310406-21bash00:35:013
6132790,1sleep2611-21bash00:01:062
39572790,2sleep33955-21sshd23:23:293
325062790,2sleep232494-21sshd22:07:452
237112780,0sleep00-21swapper/023:21:570
46942770,2sleep34693-21bash21:49:463
291752770,3sleep20-21swapper/222:52:142
170162770,2sleep217012-21sshd21:47:262
167392770,2sleep10-21swapper/100:27:431
202312740,4sleep2247199cyclictest22:25:012
63522730,2sleep30-21swapper/323:27:333
322202730,2sleep10-21swapper/121:49:131
24462730,2sleep12441-21sshd23:04:191
299832720,3sleep10-21swapper/123:37:571
104732710,2sleep110457-21sshd22:23:521
78952690,4sleep2247199cyclictest23:27:442
98002630,3sleep0245999cyclictest21:54:010
219126234,4sleep00-21swapper/019:09:260
207702300,28sleep1138550irq/27-eth023:33:041
133262300,0sleep00-21swapper/022:20:210
301492290,2sleep20-21swapper/200:25:192
303822280,3sleep20-21swapper/200:37:252
67122270,0sleep00-21swapper/022:15:520
232392270,24sleep2138550irq/27-eth022:17:522
38982260,0sleep00-21swapper/022:11:520
282922260,2sleep228289-21sshd21:14:472
31212250,3sleep30-21swapper/322:04:253
31212250,3sleep30-21swapper/322:04:253
284732250,2sleep10-21swapper/121:59:541
196892250,2sleep219688-21sshd23:44:222
119072250,23sleep1138550irq/27-eth021:27:581
86352240,2sleep20-21swapper/223:12:382
298942240,0sleep20-21swapper/222:00:042
298942240,0sleep20-21swapper/222:00:032
25682240,2sleep12564-21bash22:41:391
246799248,2cyclictest0-21swapper/100:34:191
103652240,1sleep30-21swapper/323:58:263
255022230,2sleep125503-21sshd21:21:551
246799237,2cyclictest0-21swapper/123:05:121
246799230,10cyclictest0-21swapper/123:20:111
246799220,1cyclictest0-21swapper/121:19:021
246799220,10cyclictest0-21swapper/122:10:141
246799220,10cyclictest0-21swapper/121:43:401
246799220,10cyclictest0-21swapper/121:30:271
246799220,10cyclictest0-21swapper/120:45:241
66972210,2sleep20-21swapper/223:08:372
247199215,9cyclictest30962-21bash21:56:232
246799211,9cyclictest0-21swapper/100:16:091
246799210,11cyclictest0-21swapper/123:27:411
246799210,10cyclictest0-21swapper/122:35:231
246799210,10cyclictest0-21swapper/122:00:281
246799210,10cyclictest0-21swapper/122:00:281
246799210,10cyclictest0-21swapper/100:04:531
246799210,0cyclictest0-21swapper/123:18:571
81552200,1sleep20-21swapper/222:57:232
246799209,1cyclictest0-21swapper/100:23:221
246799205,0cyclictest0-21swapper/121:14:511
246799200,5cyclictest0-21swapper/122:48:461
246799200,2cyclictest0-21swapper/100:39:221
246799200,10cyclictest0-21swapper/121:36:281
152312200,2sleep10-21swapper/123:13:251
67922190,9sleep30-21swapper/323:46:383
245999192,3cyclictest25347-21sshd00:36:480
240452190,16sleep3138550irq/27-eth021:51:573
247199184,12cyclictest12252-21proc_pri21:35:272
246799182,4cyclictest0-21swapper/100:14:211
2459991811,3cyclictest0-21swapper/023:30:420
236672180,0sleep00-21swapper/022:06:430
289692170,15sleep3138550irq/27-eth021:29:593
247799175,5cyclictest404-21sshd00:21:213
247799170,15cyclictest0-21swapper/300:27:163
247799170,12cyclictest0-21swapper/321:33:143
247199172,14cyclictest0-21swapper/223:21:522
245999170,13cyclictest0-21swapper/021:22:030
126372170,0sleep112622-21sshd23:47:181
98052160,2sleep29802-21sshd22:38:472
261782160,0sleep226177-21bash21:18:152
247799164,3cyclictest3511-21sshd22:53:033
2477991613,2cyclictest2444-21sshd22:15:223
2477991612,3cyclictest3192-21sshd23:50:043
2477991611,3cyclictest0-21swapper/323:42:213
2477991611,1cyclictest2483-21sshd22:37:543
247799160,7cyclictest0-21swapper/300:16:033
247799160,14cyclictest0-21swapper/323:05:203
247799160,11cyclictest24082-21bash21:10:273
247199163,9cyclictest5080-21sshd00:34:232
247199163,4cyclictest18420-21sshd23:59:272
247199162,10cyclictest32537-21sshd23:49:432
2471991612,3cyclictest25661-21bash23:03:112
247199160,14cyclictest0-21swapper/223:30:252
247199160,14cyclictest0-21swapper/221:23:402
246799160,14cyclictest0-21swapper/120:00:301
245999168,4cyclictest0-21swapper/019:20:200
152702160,1sleep015271-21sshd22:54:280
247799157,3cyclictest18050-21sshd22:32:123
247799157,3cyclictest16073-21sshd00:11:003
247799156,8cyclictest0-21swapper/321:17:183
2477991512,2cyclictest0-21swapper/322:07:073
247799151,13cyclictest25049-21sshd21:40:413
2477991511,3cyclictest11964-21bash22:46:293
247799150,6cyclictest0-21swapper/321:35:503
247799150,6cyclictest0-21swapper/321:24:203
247199158,5cyclictest690-21sshd21:34:132
247199157,3cyclictest15460-21sshd00:10:552
2471991512,2cyclictest16920-21sshd23:51:342
247199151,13cyclictest24010-21bash22:40:212
2471991511,3cyclictest10950irq/23-ehci_hcd20:11:392
2471991510,4cyclictest27295-21sshd21:40:582
247199150,13cyclictest24339-21sshd22:32:572
246799159,5cyclictest138550irq/27-eth020:23:151
246799157,7cyclictest0-21swapper/122:51:381
2467991512,1cyclictest0-21swapper/122:30:061
2467991511,3cyclictest10950irq/23-ehci_hcd19:46:111
246799151,12cyclictest11734-21fschecks_time19:40:101
246799150,4cyclictest17032-21grep19:50:281
246799150,4cyclictest138550irq/27-eth023:40:081
245999158,3cyclictest0-21swapper/021:25:170
245999157,7cyclictest0-21swapper/022:30:270
245999154,4cyclictest0-21swapper/023:10:380
245999151,9cyclictest28750irq/26-ahci[00021:10:420
2459991513,1cyclictest0-21swapper/022:27:270
245999151,2cyclictest2053-21sshd23:08:030
245999150,4cyclictest32030-21sshd21:18:590
245999150,1cyclictest0-21swapper/021:43:580
245999150,14cyclictest0-21swapper/023:00:370
245999150,14cyclictest0-21swapper/020:40:320
245999150,11cyclictest0-21swapper/000:02:340
245999150,10cyclictest11351-21sshd22:35:110
239562150,2sleep041ktimersoftd/023:18:120
179322150,13sleep3138550irq/27-eth022:13:333
247799144,8cyclictest337-21sshd23:30:353
247799144,2cyclictest10950irq/23-ehci_hcd20:43:133
247799141,4cyclictest1987-21sshd00:30:153
2477991411,2cyclictest12687-21bash23:35:503
2477991410,3cyclictest1987-21sshd22:21:043
247799140,9cyclictest10082-21idleruntime-cro20:50:003
247799140,5cyclictest21118-21needreboot20:00:233
247799140,5cyclictest0-21swapper/322:56:593
247799140,2cyclictest0-21swapper/323:15:233
247799140,13cyclictest24798-21sshd23:10:393
247799140,13cyclictest22360-21bash22:28:593
247799140,13cyclictest14638-21sshd23:01:543
247799140,10cyclictest0-21swapper/322:40:053
247199148,5cyclictest22488-21sshd00:15:482
247199147,5cyclictest22614-21sshd21:25:232
247199147,2cyclictest0-21swapper/223:36:092
247199141,12cyclictest15953-21sshd00:23:282
2471991410,3cyclictest32466-21sshd22:45:102
247199140,13cyclictest1877-21nfsd21:50:162
247199140,12cyclictest20534-21sshd22:10:092
247199140,12cyclictest10304-21crond19:35:012
246799141,4cyclictest2514-21munin-node19:10:111
246799140,5cyclictest0-21swapper/122:26:111
246799140,3cyclictest138550irq/27-eth019:55:471
246799140,3cyclictest138550irq/27-eth019:36:461
246799140,12cyclictest10245-21sshd21:50:201
245999147,4cyclictest0-21swapper/020:45:510
245999146,4cyclictest0-21swapper/023:58:440
245999144,9cyclictest0-21swapper/022:40:250
245999144,1cyclictest0-21swapper/020:26:130
245999141,7cyclictest3891-21sshd21:45:490
245999141,2cyclictest0-21swapper/023:45:260
245999140,6cyclictest4653-21id22:00:460
245999140,6cyclictest4653-21id22:00:450
245999140,1cyclictest0-21swapper/000:05:050
245999140,13cyclictest0-21swapper/022:57:220
245999140,13cyclictest0-21swapper/020:00:520
245999140,10cyclictest0-21swapper/023:52:200
247799138,3cyclictest25005-21diskstats20:10:143
247799137,5cyclictest27943-21nfsd420:15:223
247799137,4cyclictest20968-21sshd21:55:163
247799133,1cyclictest0-21swapper/320:51:173
247799132,3cyclictest10950irq/23-ehci_hcd20:20:533
2477991311,1cyclictest0-21swapper/319:15:283
247799130,12cyclictest0-21swapper/321:00:253
247799130,12cyclictest0-21swapper/320:56:483
247799130,12cyclictest0-21swapper/320:32:013
247799130,12cyclictest0-21swapper/320:06:093
247799130,12cyclictest0-21swapper/319:58:193
247799130,11cyclictest6137-21iostat_ios19:20:123
247799130,11cyclictest32274-21memory20:25:183
247799130,11cyclictest18559-21grep21:05:303
247799130,11cyclictest13419-21munin-node19:45:243
247799130,11cyclictest10567-21seq19:35:323
247199137,5cyclictest0-21swapper/219:43:512
247199132,10cyclictest0-21swapper/220:40:132
247199131,4cyclictest29910-21iostat20:20:202
247199131,11cyclictest28750irq/26-ahci[00020:36:362
247199130,5cyclictest19576-21runrttasks19:55:482
247199130,5cyclictest1877-21nfsd19:35:582
247199130,3cyclictest138550irq/27-eth019:50:142
247199130,12cyclictest0-21swapper/221:04:242
247199130,12cyclictest0-21swapper/220:48:242
247199130,12cyclictest0-21swapper/220:34:472
247199130,12cyclictest0-21swapper/220:29:282
247199130,12cyclictest0-21swapper/220:19:252
247199130,12cyclictest0-21swapper/220:03:492
247199130,12cyclictest0-21swapper/219:46:312
247199130,12cyclictest0-21swapper/219:21:452
247199130,12cyclictest0-21swapper/219:19:222
247199130,11cyclictest23187-21irqstats20:05:212
247199130,11cyclictest17917-21memory21:05:232
246799139,3cyclictest10950irq/23-ehci_hcd20:09:121
246799139,2cyclictest0-21swapper/120:25:471
246799137,5cyclictest0-21swapper/121:00:461
246799137,4cyclictest2121-21runrttasks19:20:521
2467991311,1cyclictest0-21swapper/120:56:031
246799130,4cyclictest2121-21runrttasks19:31:051
246799130,12cyclictest0-21swapper/120:17:531
246799130,12cyclictest0-21swapper/120:11:231
246799130,12cyclictest0-21swapper/119:17:481
246799130,10cyclictest138550irq/27-eth020:31:291
245999137,3cyclictest0-21swapper/019:45:050
245999134,8cyclictest8036-21sshd00:30:360
2459991311,1cyclictest0-21swapper/021:08:290
2459991310,2cyclictest10508-21kworker/0:019:40:030
245999130,9cyclictest0-21swapper/021:35:530
245999130,2cyclictest30813-21id23:41:510
245999130,2cyclictest22949-21sshd21:55:260
245999130,1cyclictest29440-21df20:20:130
245999130,12cyclictest2370-21awk20:30:260
245999130,12cyclictest0-21swapper/023:26:370
245999130,12cyclictest0-21swapper/020:51:500
245999130,12cyclictest0-21swapper/020:10:270
245999130,12cyclictest0-21swapper/020:05:160
245999130,12cyclictest0-21swapper/019:32:330
245999130,12cyclictest0-21swapper/019:10:230
247799126,1cyclictest445-21jbd2/dm-0-819:50:153
247799120,3cyclictest8280-21taskset19:30:053
247799120,3cyclictest2837-21df_inode19:10:113
247799120,3cyclictest2121-21runrttasks19:26:553
247799120,11cyclictest1877-21nfsd19:40:163
247799120,11cyclictest0-21swapper/320:35:263
247199128,3cyclictest3642-21ntp_states19:10:192
247199120,11cyclictest12733-21cpuspeed_turbos20:55:112
247199120,11cyclictest0-21swapper/220:50:052
247199120,11cyclictest0-21swapper/219:25:472
246799120,3cyclictest6537-21iostat_ios20:40:161
246799120,3cyclictest17701-21munin-node21:05:181
246799120,3cyclictest0-21swapper/120:35:111
246799120,11cyclictest1877-21nfsd20:50:111
246799120,11cyclictest0-21swapper/119:25:141
245999129,1cyclictest0-21swapper/019:35:130
245999120,4cyclictest0-21swapper/021:01:530
245999120,2cyclictest0-21swapper/020:56:590
245999120,1cyclictest0-21swapper/019:56:250
245999120,1cyclictest0-21swapper/019:19:570
245999120,11cyclictest0-21swapper/020:35:120
245999120,11cyclictest0-21swapper/020:15:030
245999120,11cyclictest0-21swapper/019:25:420
245999119,1cyclictest0-21swapper/019:50:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional