You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-23 - 17:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Sat Sep 23, 2023 12:44:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110321070,0sleep31046-21sshd11:57:153
6132900,1sleep3583-21sshd10:04:303
132162850,0sleep113217-21id09:11:391
30932700,3sleep119-21rcuc/109:32:511
13382690,1sleep13189799cyclictest12:33:511
57692620,1sleep20-21swapper/211:38:152
59352610,1sleep25933-21bash09:24:472
285352600,3sleep337-21rcuc/309:18:273
116382600,1sleep011633-21sshd10:21:370
228972590,1sleep337-21rcuc/311:17:333
191152590,0sleep30-21swapper/310:44:123
129802590,0sleep30-21swapper/309:22:353
73002580,1sleep00-21swapper/010:05:030
320552570,0sleep10-21swapper/110:39:491
89012550,0sleep20-21swapper/210:45:592
260942550,0sleep20-21swapper/211:34:312
178712550,0sleep317865-21sshd09:42:173
60032540,2sleep228-21rcuc/212:20:142
46972540,0sleep30-21swapper/312:20:073
210922540,0sleep20-21swapper/209:50:462
158902540,0sleep30-21swapper/310:27:253
37972530,1sleep23189899cyclictest11:54:412
48722520,1sleep24874-21bash09:10:552
32282520,1sleep00-21swapper/009:19:040
3130525224,24sleep00-21swapper/007:05:540
251032520,0sleep010-21rcuc/010:11:560
85482510,0sleep10-21swapper/111:41:111
145272510,1sleep30-21swapper/311:30:393
13092510,1sleep11300-21bash11:26:481
3158625027,19sleep20-21swapper/207:09:282
3127825024,8sleep30-21swapper/307:05:323
134442500,0sleep00-21swapper/010:54:380
117632500,0sleep31495-21nfsd11:46:533
34302490,0sleep03-21ksoftirqd/010:18:170
103682490,0sleep00-21swapper/011:33:080
3052924826,18sleep10-21swapper/107:05:221
243252480,0sleep11730-21runrttasks12:38:401
305092470,0sleep10-21swapper/110:15:091
233202460,0sleep30-21swapper/311:12:003
317312450,0sleep30-21swapper/309:29:473
252352450,0sleep30-21swapper/311:37:073
268052440,0sleep20-21swapper/209:18:172
112752440,0sleep211276-21sshd12:15:052
251412430,0sleep00-21swapper/009:10:020
31897992220,1cyclictest19617-21sshd10:25:041
31899992119,1cyclictest0-21swapper/312:33:493
3189999210,20cyclictest0-21swapper/310:22:353
31896992114,1cyclictest6167-21sshd11:49:130
84292200,1sleep08371-21sshd09:35:570
3189699202,4cyclictest28381-21sshd10:42:110
3189699201,16cyclictest22757-21sshd10:38:590
31897991913,3cyclictest21-21ksoftirqd/110:42:121
3189699199,9cyclictest18572-21sshd09:34:100
3189699199,6cyclictest0-21swapper/011:57:520
3189699199,5cyclictest0-21swapper/012:10:450
31896991918,1cyclictest3072-21sshd10:26:190
3189699191,17cyclictest27600-21sshd09:23:510
31898991816,1cyclictest7125-21sshd11:21:472
3189799185,2cyclictest21-21ksoftirqd/109:48:001
31897991817,1cyclictest6908-21sshd12:23:051
31897991811,4cyclictest21-21ksoftirqd/112:18:381
31897991811,4cyclictest21-21ksoftirqd/109:20:561
3189699189,6cyclictest0-21swapper/011:19:140
3189699189,5cyclictest30411-21sshd11:04:240
3189699189,2cyclictest0-21swapper/012:18:400
3189699180,17cyclictest21731-21sshd12:38:260
246662180,1sleep024636-21sshd10:30:500
3189899170,16cyclictest9962-21sshd12:06:272
3189799172,11cyclictest26271-21sshd11:15:061
31897991714,1cyclictest21-21ksoftirqd/111:50:571
31897991712,1cyclictest21-21ksoftirqd/111:38:051
31897991712,1cyclictest21-21ksoftirqd/109:16:591
3189699179,4cyclictest4986-21sshd10:45:370
3189699179,4cyclictest10182-21sshd12:29:020
3189699178,5cyclictest0-21swapper/011:50:210
3189699175,11cyclictest21573-21sshd09:42:370
3189699172,4cyclictest19254-21sshd11:11:390
3189699172,12cyclictest7123-21sshd09:59:540
3189699172,12cyclictest4496-21sshd12:03:110
3189699171,4cyclictest13424-21bash09:52:460
3189699171,14cyclictest8786-21sshd11:24:440
139902170,1sleep213964-21sshd12:37:452
7002160,1sleep2698-21sshd10:18:032
31899991615,1cyclictest114750irq/25-eth009:38:173
3189799169,2cyclictest16420-21sshd10:08:311
3189799163,1cyclictest21-21ksoftirqd/111:45:011
31897991614,1cyclictest21-21ksoftirqd/110:00:151
31897991614,1cyclictest19-21rcuc/110:32:481
31897991611,1cyclictest21-21ksoftirqd/111:32:071
31897991611,1cyclictest21-21ksoftirqd/110:59:021
3189799160,1cyclictest19-21rcuc/110:10:061
3189699169,6cyclictest30346-21bash09:26:480
3189699169,3cyclictest16791-21sshd11:28:100
3189699168,4cyclictest0-21swapper/012:05:370
3189699162,9cyclictest5458-21bash11:07:430
3189699162,9cyclictest5458-21bash11:07:430
3189699162,5cyclictest18043-21id09:47:510
3189699162,4cyclictest24825-21rm12:33:030
3189699162,4cyclictest23550-21sshd10:55:260
3189699162,4cyclictest0-21swapper/010:00:050
31896991610,5cyclictest1430-21sshd12:22:350
3189699160,2cyclictest6853-21sshd11:41:020
3189699160,12cyclictest6521-21sshd11:35:300
311012160,0sleep30-21swapper/309:48:583
257192160,1sleep325716-21sshd11:20:343
194022160,0sleep30-21swapper/310:11:273
31899991510,5cyclictest0-21swapper/311:28:123
3189999150,4cyclictest0-21swapper/310:09:293
3189899151,5cyclictest0-21swapper/210:34:002
31898991513,1cyclictest0-21swapper/211:57:542
3189899150,14cyclictest22358-21sshd09:34:302
3189799155,1cyclictest21-21ksoftirqd/109:29:191
3189799153,3cyclictest21-21ksoftirqd/112:27:051
3189799152,1cyclictest21-21ksoftirqd/110:50:341
31897991513,1cyclictest21-21ksoftirqd/112:14:431
31897991513,1cyclictest21-21ksoftirqd/111:21:131
31897991513,1cyclictest21-21ksoftirqd/111:10:221
31897991513,1cyclictest21-21ksoftirqd/111:06:251
31897991513,1cyclictest21-21ksoftirqd/111:06:251
31897991513,1cyclictest21-21ksoftirqd/109:58:481
3189799150,3cyclictest0-21swapper/109:44:011
230302150,0sleep30-21swapper/309:34:323
43262140,1sleep324601-21diskmemload11:43:363
3189899144,9cyclictest30-21ksoftirqd/210:50:342
3189899140,11cyclictest0-21swapper/209:35:172
3189799148,1cyclictest8550-21sshd11:55:071
3189799147,4cyclictest21-21ksoftirqd/112:08:071
31897991413,1cyclictest21-21ksoftirqd/112:00:521
31897991413,1cyclictest21-21ksoftirqd/110:21:251
31897991412,1cyclictest21-21ksoftirqd/111:00:281
31897991412,1cyclictest21-21ksoftirqd/110:47:371
31897991412,1cyclictest21-21ksoftirqd/109:50:251
31897991412,1cyclictest21-21ksoftirqd/109:36:401
3189699141,8cyclictest24572-21fschecks_time08:00:220
61062130,0sleep20-21swapper/209:41:172
3189999138,2cyclictest0-21swapper/312:11:203
3189999131,9cyclictest114750irq/25-eth011:50:053
3189999131,1cyclictest21548-21sshd12:35:323
31899991310,3cyclictest27593-21sshd10:55:433
3189999130,4cyclictest0-21swapper/310:37:473
3189999130,12cyclictest27311-21bash12:07:593
3189999130,12cyclictest13812-21sshd09:14:293
3189999130,12cyclictest0-21swapper/311:07:533
3189999130,12cyclictest0-21swapper/311:07:523
3189999130,12cyclictest0-21swapper/311:01:113
3189999130,12cyclictest0-21swapper/310:17:313
3189899138,5cyclictest0-21swapper/211:28:352
3189899138,4cyclictest0-21swapper/211:13:422
31898991311,1cyclictest0-21swapper/212:13:042
3189899130,2cyclictest0-21swapper/211:47:012
3189899130,2cyclictest0-21swapper/210:10:042
3189899130,12cyclictest28357-21sshd11:09:442
3189899130,12cyclictest28357-21sshd11:09:432
3189899130,12cyclictest0-21swapper/212:26:262
3189899130,12cyclictest0-21swapper/212:02:302
3189899130,12cyclictest0-21swapper/210:41:192
3189899130,12cyclictest0-21swapper/210:36:512
3189899130,12cyclictest0-21swapper/209:58:522
3189899130,12cyclictest0-21swapper/209:27:272
3189899130,12cyclictest0-21swapper/208:09:352
3189899130,10cyclictest0-21swapper/211:40:272
3189699130,12cyclictest0-21swapper/008:20:250
293112130,0sleep30-21swapper/310:53:123
3189999128,2cyclictest0-21swapper/310:46:373
3189999128,1cyclictest19598-21sshd09:58:173
3189999128,1cyclictest0-21swapper/309:50:373
3189999122,1cyclictest22553-21sshd10:30:403
3189999121,10cyclictest0-21swapper/307:15:013
31899991210,1cyclictest15701-21sshd12:15:253
3189999120,12cyclictest0-21swapper/312:25:073
3189999120,11cyclictest0-21swapper/312:01:523
3189899129,2cyclictest0-21swapper/210:22:112
3189899129,2cyclictest0-21swapper/209:45:182
3189899121,1cyclictest114750irq/25-eth012:30:552
3189899120,11cyclictest21604-21sshd10:55:212
3189899120,11cyclictest0-21swapper/211:16:162
3189899120,11cyclictest0-21swapper/211:02:032
3189899120,11cyclictest0-21swapper/210:29:042
3189699121,8cyclictest0-21swapper/007:20:240
3189699121,3cyclictest0-21swapper/008:40:250
3189699120,8cyclictest0-21swapper/007:55:300
31899991110,1cyclictest0-21swapper/308:20:303
3189899119,1cyclictest114750irq/25-eth010:05:592
3189899111,9cyclictest114750irq/25-eth010:00:152
3189799110,1cyclictest0-21swapper/108:46:231
3189799110,11cyclictest0-21swapper/107:50:521
3189799110,11cyclictest0-21swapper/107:32:161
3189699116,2cyclictest0-21swapper/007:45:320
3189699112,8cyclictest15748-21df_inode08:50:220
3189699111,7cyclictest0-21swapper/008:30:200
3189699111,5cyclictest0-21swapper/007:25:210
3189699110,11cyclictest0-21swapper/008:37:020
3189699110,11cyclictest0-21swapper/007:43:290
3189699110,11cyclictest0-21swapper/007:10:020
3189999100,6cyclictest0-21swapper/308:05:213
3189899109,1cyclictest0-21swapper/208:45:292
3189899109,1cyclictest0-21swapper/207:49:092
3189899100,9cyclictest0-21swapper/207:35:242
3189899100,9cyclictest0-21swapper/207:15:022
3189799109,1cyclictest0-21swapper/108:55:061
3189799109,1cyclictest0-21swapper/108:41:161
3189799109,1cyclictest0-21swapper/107:44:001
3189799108,1cyclictest1952-21sed07:15:011
3189799100,1cyclictest8113-21perl07:25:241
3189799100,10cyclictest0-21swapper/109:00:131
3189799100,10cyclictest0-21swapper/108:27:341
3189699109,1cyclictest0-21swapper/008:55:230
3189699109,1cyclictest0-21swapper/008:29:580
3189699109,1cyclictest0-21swapper/007:50:200
3189699101,5cyclictest0-21swapper/009:00:210
3189699100,9cyclictest0-21swapper/007:15:020
3189699100,7cyclictest29158-21sh08:10:230
3189699100,6cyclictest0-21swapper/007:30:200
3189699100,2cyclictest31085-21munin-node08:15:260
3189699100,1cyclictest0-21swapper/009:08:390
3189699100,10cyclictest0-21swapper/008:06:290
318999992,4cyclictest0-21swapper/307:55:483
318999990,9cyclictest0-21swapper/308:16:503
318999990,9cyclictest0-21swapper/307:45:263
318999990,9cyclictest0-21swapper/307:36:413
318999990,6cyclictest0-21swapper/308:31:363
318999990,6cyclictest0-21swapper/308:27:263
318999990,4cyclictest0-21swapper/309:08:083
318999990,3cyclictest0-21swapper/307:30:263
318999990,1cyclictest0-21swapper/308:11:463
318989998,1cyclictest0-21swapper/208:58:362
318989998,1cyclictest0-21swapper/208:31:252
318989998,1cyclictest0-21swapper/208:25:232
318989990,9cyclictest0-21swapper/208:18:112
318989990,9cyclictest0-21swapper/207:31:152
318989990,9cyclictest0-21swapper/207:26:012
318989990,6cyclictest0-21swapper/208:50:112
318989990,1cyclictest0-21swapper/207:54:292
318989990,1cyclictest0-21swapper/207:43:482
318979999,0cyclictest0-21swapper/109:05:201
318979998,1cyclictest0-21swapper/108:52:331
318979998,1cyclictest0-21swapper/107:55:171
318979990,4cyclictest0-21swapper/108:31:461
318969998,1cyclictest0-21swapper/007:36:100
318969990,7cyclictest0-21swapper/008:45:290
318999983,5cyclictest0-21swapper/308:51:313
318999983,5cyclictest0-21swapper/308:38:173
318999983,5cyclictest0-21swapper/308:04:063
318999983,5cyclictest0-21swapper/307:50:383
318999983,5cyclictest0-21swapper/307:10:203
318999982,6cyclictest0-21swapper/308:58:493
318999981,6cyclictest0-21swapper/308:40:223
318999980,7cyclictest0-21swapper/309:00:213
318989987,1cyclictest0-21swapper/208:21:542
318989987,1cyclictest0-21swapper/208:11:052
318989987,1cyclictest0-21swapper/207:56:552
318989980,8cyclictest0-21swapper/209:00:072
318979987,1cyclictest0-21swapper/108:35:411
318979987,1cyclictest0-21swapper/108:08:041
318979987,1cyclictest0-21swapper/107:48:251
318979980,6cyclictest0-21swapper/108:14:101
318979980,5cyclictest0-21swapper/107:37:101
318979980,5cyclictest0-21swapper/107:23:401
318999972,5cyclictest0-21swapper/307:43:163
318999970,7cyclictest0-21swapper/307:20:053
318989976,1cyclictest0-21swapper/208:38:242
318989970,6cyclictest8-21rcu_preempt08:40:212
318989970,6cyclictest0-21swapper/209:05:212
318989970,6cyclictest0-21swapper/208:00:312
318989970,6cyclictest0-21swapper/207:20:212
318979976,1cyclictest0-21swapper/107:13:551
318979975,1cyclictest21-21ksoftirqd/108:05:001
318979970,6cyclictest0-21swapper/108:20:191
318979970,6cyclictest0-21swapper/108:15:261
318999965,1cyclictest13698-21perl08:45:243
318999960,6cyclictest0-21swapper/307:25:033
318989960,5cyclictest0-21swapper/207:10:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional