You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-11 - 04:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Tue Feb 11, 2025 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1393921330,2sleep02757499cyclictest00:27:150
418521250,0sleep04184-21sshd22:50:400
2654721250,4sleep12757899cyclictest23:59:181
1549121250,2sleep215488-21sshd23:52:062
3163021180,0sleep131615-21sshd23:06:001
1490321070,3sleep02757499cyclictest22:26:190
56892950,1sleep05691-21bash21:38:590
56892950,1sleep05691-21bash21:38:590
90012910,0sleep08998-21sshd21:24:120
253232910,2sleep325320-21bash22:08:193
59282860,0sleep00-21swapper/023:44:590
2730028633,49sleep30-21swapper/319:09:323
251762860,1sleep10-21swapper/100:02:111
224862860,2sleep10-21swapper/100:11:211
236772850,2sleep223673-21bash22:36:312
39892840,3sleep02757499cyclictest23:06:280
145262830,1sleep20-21swapper/223:55:072
303582820,2sleep10-21swapper/122:02:251
156952820,2sleep115682-21sshd22:58:071
2719528133,44sleep10-21swapper/119:08:141
180682810,3sleep00-21swapper/000:14:170
78752800,1sleep30-21swapper/322:41:223
6862800,1sleep20-21swapper/222:18:332
310092800,3sleep30-21swapper/322:37:173
240872800,2sleep11901-21nscd23:40:191
238242800,5sleep32758799cyclictest21:28:403
238242800,5sleep32758799cyclictest21:28:393
116962800,2sleep211691-21bash00:00:522
52542790,1sleep30-21swapper/323:16:043
299222790,3sleep32758799cyclictest22:24:343
258912790,2sleep30-21swapper/321:37:503
258912790,2sleep30-21swapper/321:37:503
2529027924,19sleep20-21swapper/219:05:082
172102780,2sleep10-21swapper/123:36:271
57552770,1sleep10-21swapper/121:45:001
320432770,1sleep032037-21sshd23:56:420
233092770,1sleep20-21swapper/200:31:302
127122770,1sleep00-21swapper/022:07:040
6342750,2sleep30-21swapper/320:30:263
207642740,5sleep12757899cyclictest00:08:091
138572740,1sleep00-21swapper/021:42:430
138572740,1sleep00-21swapper/021:42:430
4252730,5sleep32758799cyclictest21:11:203
83372720,1sleep10-21swapper/123:45:121
274662690,3sleep11847-21nfsd22:49:581
2707925833,13sleep00-21swapper/019:06:570
51042540,1sleep05097-21cp21:29:570
51042540,1sleep05097-21cp21:29:560
79522520,2sleep20-21swapper/221:12:042
250282490,2sleep325026-21sshd23:46:513
61552380,3sleep26146-21sshd21:57:092
321512330,1sleep032127-21sshd23:34:490
81112300,2sleep38110-21bash22:51:033
57382300,2sleep05736-21bash22:47:430
116052300,2sleep00-21swapper/023:23:070
283142290,1sleep30-21swapper/322:30:443
201482290,3sleep10-21swapper/123:04:521
66432280,3sleep20-21swapper/223:22:362
3382280,0sleep2328-21sshd00:15:382
142462280,2sleep20-21swapper/222:00:492
54602270,5sleep32758799cyclictest23:38:323
39122270,1sleep20-21swapper/221:38:492
39122270,1sleep20-21swapper/221:38:482
2758799268,14cyclictest11680-21rdmsr00:30:183
93682250,2sleep10-21swapper/100:23:201
27583992519,4cyclictest16462-21sshd21:24:542
2758399250,22cyclictest33-21ksoftirqd/222:45:052
2757499254,11cyclictest26326-21kworker/0:100:30:030
18532250,3sleep21828-21sshd22:40:452
144672250,23sleep226950irq/26-ahci[00023:26:392
27583992413,3cyclictest13108-21sshd00:27:102
27574992421,2cyclictest1847-21nfsd21:18:270
27587992311,7cyclictest31333-21sshd23:28:193
2758399231,19cyclictest33-21ksoftirqd/222:27:292
243432230,2sleep124324-21sshd21:58:521
106602230,1sleep10-21swapper/121:21:161
313902220,20sleep1135650irq/27-eth023:25:051
2758399223,3cyclictest33-21ksoftirqd/200:22:342
2758399222,17cyclictest33-21ksoftirqd/223:46:222
105142220,2sleep310507-21sshd21:30:193
105142220,2sleep310507-21sshd21:30:193
292602210,2sleep229252-21sshd21:50:152
2758399210,19cyclictest33-21ksoftirqd/200:11:052
2758399210,18cyclictest33-21ksoftirqd/223:00:592
27578992118,2cyclictest135650irq/27-eth023:24:171
2757499211,14cyclictest17309-21sshd00:04:360
225962210,18sleep2135650irq/27-eth021:49:432
189172210,2sleep22405-21runrttasks22:52:072
160612210,11sleep3135650irq/27-eth000:14:043
81462200,2sleep28149-21unixbench-2d19:35:232
44502200,1sleep24432-21sshd21:17:442
2758399202,15cyclictest417-21jbd2/dm-0-820:16:342
2758399201,18cyclictest33-21ksoftirqd/200:08:482
2758399201,16cyclictest33-21ksoftirqd/222:58:312
27574992011,3cyclictest14596-21bash00:23:540
2757499200,16cyclictest0-21swapper/022:59:150
2757499200,16cyclictest0-21swapper/000:16:060
2757499200,12cyclictest0-21swapper/000:39:100
252422200,18sleep2135650irq/27-eth022:14:402
226722200,1sleep022670-21bash23:52:490
168952200,2sleep20-21swapper/221:30:552
168952200,2sleep20-21swapper/221:30:542
33532190,4sleep12757899cyclictest00:19:231
296602191,16sleep3135650irq/27-eth021:53:223
277942190,0sleep30-21swapper/321:47:083
2758799194,1cyclictest17895-21cut23:30:103
2758399198,5cyclictest25860-21sshd23:15:012
2758399191,6cyclictest1848-21nfsd23:35:192
27583991913,4cyclictest28060-21sshd22:30:412
27583991913,3cyclictest4704-21sshd21:41:512
27583991913,3cyclictest4704-21sshd21:41:502
27583991912,5cyclictest12717-21bash21:27:372
27583991912,5cyclictest12717-21bash21:27:372
27583991911,5cyclictest33-21ksoftirqd/223:40:482
2758399190,17cyclictest33-21ksoftirqd/223:10:052
2758399190,16cyclictest33-21ksoftirqd/223:08:352
2757499190,13cyclictest0-21swapper/023:28:480
248332190,17sleep1135650irq/27-eth022:20:491
238612190,17sleep3135650irq/27-eth000:21:263
162252190,0sleep316224-21bash22:04:143
159902190,2sleep21848-21nfsd23:30:022
27587991810,5cyclictest29055-21sshd00:02:343
2757899180,13cyclictest1959-21sshd22:12:511
2757499184,3cyclictest7621-21sshd00:10:000
2757499180,1cyclictest21816-21sshd22:39:390
2757499180,14cyclictest0-21swapper/021:10:220
2757499180,13cyclictest0-21swapper/023:04:420
2757499180,10cyclictest0-21swapper/023:49:340
148182180,6sleep03-21ksoftirqd/022:16:420
2758799178,6cyclictest1845-21nfsd23:57:313
2758799177,5cyclictest8204-21sshd22:16:033
27587991714,2cyclictest0-21swapper/323:22:483
27587991710,4cyclictest1754-21bash00:15:483
2758799170,12cyclictest32643-21sshd21:20:213
2758799170,12cyclictest30065-21sshd22:11:523
2758799170,11cyclictest8282-21sshd22:47:593
2758799170,10cyclictest1846-21nfsd00:27:563
2758399178,7cyclictest1915-21snmpd20:05:162
2758399174,12cyclictest0-21swapper/222:09:342
2758399173,10cyclictest0-21swapper/220:56:062
27583991712,3cyclictest1848-21nfsd22:20:252
2757899178,5cyclictest0-21swapper/121:25:101
2757899178,5cyclictest0-21swapper/121:25:101
2757899178,4cyclictest10766-21sshd23:13:301
2757899175,3cyclictest0-21swapper/122:07:261
2757899170,15cyclictest0-21swapper/122:52:001
190372170,15sleep3135650irq/27-eth023:52:293
2758799168,6cyclictest0-21swapper/323:41:283
27587991610,1cyclictest6990-21cp00:09:583
2758799160,14cyclictest0-21swapper/323:00:253
2758799160,11cyclictest26104-21sshd23:08:433
2758799160,11cyclictest12419-21sshd22:26:053
2758399163,10cyclictest0-21swapper/219:41:502
27583991610,4cyclictest29089-21bash00:38:502
2758399160,13cyclictest33-21ksoftirqd/219:15:012
2757899168,3cyclictest30715-21ls22:40:241
2757899163,12cyclictest21749-21sshd23:17:451
2757899161,3cyclictest1847-21nfsd21:11:511
27578991611,4cyclictest27373-21sshd21:16:511
27578991610,5cyclictest1959-21sshd21:51:411
2757899160,4cyclictest135650irq/27-eth022:30:151
2757899160,3cyclictest0-21swapper/123:51:261
2757899160,14cyclictest8173-21fschecks_time21:30:111
2757899160,14cyclictest8173-21fschecks_time21:30:111
2757899160,14cyclictest0-21swapper/121:41:001
2757899160,14cyclictest0-21swapper/121:41:001
2757899160,14cyclictest0-21swapper/119:35:211
2757899160,11cyclictest28144-21bash00:38:441
2757899160,11cyclictest0-21swapper/122:26:581
2757899160,11cyclictest0-21swapper/119:25:591
2757499160,14cyclictest0-21swapper/023:36:210
2758799159,4cyclictest10752-21id21:42:253
2758799159,4cyclictest10752-21id21:42:253
2758799159,1cyclictest12618-21sshd21:57:443
2758799157,7cyclictest0-21swapper/320:14:013
2758799157,3cyclictest17088-21bash00:37:343
2758799150,6cyclictest0-21swapper/321:05:123
2758799150,6cyclictest0-21swapper/320:55:173
2758799150,13cyclictest0-21swapper/320:45:143
2758799150,12cyclictest0-21swapper/322:55:293
2758799150,11cyclictest135650irq/27-eth021:16:353
27583991510,4cyclictest0-21swapper/219:56:422
2758399150,6cyclictest1848-21nfsd20:50:152
2757899150,6cyclictest0-21swapper/100:32:581
2757899150,14cyclictest0-21swapper/123:31:191
2757899150,13cyclictest24222-21sshd21:37:401
2757899150,13cyclictest24222-21sshd21:37:401
2757899150,11cyclictest135650irq/27-eth000:26:511
2757899150,10cyclictest0-21swapper/122:39:421
2757499151,12cyclictest0-21swapper/022:01:090
2757499150,3cyclictest26304-21sshd23:18:110
2757499150,13cyclictest27237-21bash21:56:020
2757499150,11cyclictest24545-21sshd21:49:540
2758799147,6cyclictest0-21swapper/319:19:303
27587991412,1cyclictest0-21swapper/319:21:343
27587991412,1cyclictest0-21swapper/319:21:333
2758799141,12cyclictest0-21swapper/320:21:233
2758799140,5cyclictest19994-21sshd23:11:103
2758799140,13cyclictest0-21swapper/320:25:563
2758399141,8cyclictest1131-21jbd2/dm-2-819:15:452
2758399141,12cyclictest0-21swapper/221:07:012
2758399140,5cyclictest0-21swapper/219:45:162
2758399140,11cyclictest0-21swapper/220:21:482
2757899148,5cyclictest28724-21munin-node19:10:181
2757899141,8cyclictest29995-21bash22:15:071
2757899141,12cyclictest135650irq/27-eth019:30:561
2757899140,5cyclictest1915-21snmpd20:56:201
2757899140,3cyclictest0-21swapper/119:41:391
2757899140,13cyclictest0-21swapper/120:34:591
2757499147,6cyclictest0-21swapper/020:48:210
2757499140,2cyclictest1983-21sshd21:50:410
2757499140,13cyclictest0-21swapper/023:11:440
2757499140,12cyclictest16787-21sshd22:10:310
2757499140,12cyclictest0-21swapper/021:31:340
2757499140,12cyclictest0-21swapper/021:31:330
2758799137,5cyclictest0-21swapper/319:40:593
2758799137,3cyclictest0-21swapper/320:35:233
2758799132,10cyclictest1848-21nfsd19:35:573
2758799132,10cyclictest135650irq/27-eth020:05:063
2758799130,12cyclictest0-21swapper/321:00:073
2758799130,12cyclictest0-21swapper/320:50:343
2758799130,12cyclictest0-21swapper/320:43:523
2758799130,12cyclictest0-21swapper/320:17:243
2758799130,12cyclictest0-21swapper/319:45:193
2758799130,12cyclictest0-21swapper/319:27:283
2758799130,12cyclictest0-21swapper/319:10:133
2758799130,11cyclictest14209-21iostat_ios19:50:173
2758399139,4cyclictest0-21swapper/220:41:502
2758399136,6cyclictest0-21swapper/220:10:272
2758399132,7cyclictest19375-21munin-node20:00:212
2758399131,3cyclictest5105-21iostat19:30:192
2758399131,10cyclictest135650irq/27-eth021:00:022
2758399130,12cyclictest0-21swapper/220:35:252
2758399130,12cyclictest0-21swapper/220:30:262
2758399130,12cyclictest0-21swapper/220:25:302
2757899139,3cyclictest135650irq/27-eth020:25:281
2757899138,4cyclictest15906-21munin-node21:05:151
2757899137,5cyclictest0-21swapper/119:55:221
2757899137,2cyclictest0-21swapper/120:04:031
2757899132,3cyclictest135650irq/27-eth019:46:231
2757899132,10cyclictest135650irq/27-eth020:05:211
27578991311,1cyclictest0-21swapper/120:40:241
2757899130,4cyclictest23304-21if_eth020:10:171
2757899130,12cyclictest26601-21taskset20:16:511
2757899130,12cyclictest0-21swapper/121:02:511
2757899130,12cyclictest0-21swapper/119:21:501
2757899130,12cyclictest0-21swapper/119:21:491
2757899130,12cyclictest0-21swapper/119:17:061
2757899130,11cyclictest6905-21irqstats20:45:191
2757499138,4cyclictest30701-21sshd22:40:250
2757499138,3cyclictest21094-21sshd22:20:240
2757499136,6cyclictest0-21swapper/020:55:220
2757499131,11cyclictest24259-21rm22:30:200
27574991311,1cyclictest0-21swapper/020:54:000
27574991311,1cyclictest0-21swapper/019:55:120
2757499130,5cyclictest0-21swapper/019:50:170
2757499130,1cyclictest0-21swapper/021:06:470
2757499130,12cyclictest0-21swapper/020:41:020
2757499130,12cyclictest0-21swapper/020:33:160
2757499130,12cyclictest0-21swapper/019:47:320
2757499130,12cyclictest0-21swapper/019:33:570
2757499130,12cyclictest0-21swapper/019:27:130
2758799121,3cyclictest135650irq/27-eth019:55:133
2758799120,10cyclictest5102-21iostat19:30:183
2758799120,10cyclictest18757-21iostat_ios20:00:153
2758399128,3cyclictest2327-21df19:25:142
2758399120,3cyclictest6960-21munin-node20:45:182
2758399120,12cyclictest0-21swapper/219:54:582
2758399120,10cyclictest32429-21df19:20:122
2758399120,10cyclictest32429-21df19:20:122
2757899120,3cyclictest27441-21diskstats20:20:151
2757899120,3cyclictest2444-21munin-node20:35:161
2757899120,11cyclictest135650irq/27-eth019:50:451
2757899120,11cyclictest0-21swapper/120:50:381
2757499128,3cyclictest29723-21diskstats20:25:130
2757499128,3cyclictest0-21swapper/019:20:580
2757499128,3cyclictest0-21swapper/019:20:580
2757499121,9cyclictest0-21swapper/020:35:210
2757499120,4cyclictest0-21swapper/019:35:140
2757499120,2cyclictest0-21swapper/021:00:210
2757499120,1cyclictest0-21swapper/019:11:400
2757499120,11cyclictest0-21swapper/020:17:310
2757499120,11cyclictest0-21swapper/020:10:070
2757499120,11cyclictest0-21swapper/020:06:500
2757499120,11cyclictest0-21swapper/020:00:210
2757499120,11cyclictest0-21swapper/019:40:130
2757499120,11cyclictest0-21swapper/019:15:200
2757499110,10cyclictest0-21swapper/020:20:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional