You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-11-29 - 18:21

x86 Intel Core i7-2600K @3400 MHz, Linux 5.9.0-rc2-rt1 (Profile)

Latency plot of system in rack #4, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h200 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100, highest latencies:
System rack4slot6.osadl.org (updated Tue Nov 29, 2022 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2235552990,94pltrace0-21swapper/407:09:324
2216029377,12sleep30-21swapper/307:05:363
2247328670,12sleep20-21swapper/207:09:432
2244228064,12sleep00-21swapper/007:09:180
2236427963,12sleep70-21swapper/707:08:137
275022780,1sleep70-21swapper/711:15:277
2218927762,11sleep50-21swapper/507:06:025
2218127256,12sleep60-21swapper/607:05:556
90782710,0sleep40-21swapper/412:00:274
90782710,0sleep40-21swapper/412:00:274
2228826756,7sleep10-21swapper/107:07:261
255142540,0sleep30-21swapper/310:43:023
190612530,0sleep40-21swapper/411:08:264
165172480,0sleep70-21swapper/708:50:187
3232752250,1pltrace32331-21tail10:18:090
2266499230,22cyclictest0-21swapper/408:10:244
1532352230,1pltrace421rcuc/510:33:085
172932210,0sleep70-21swapper/707:55:147
2366652200,2pltrace9-21ksoftirqd/009:40:260
2266499200,1cyclictest0-21swapper/408:50:214
170672200,1sleep543-21ksoftirqd/510:35:195
149952200,0sleep70-21swapper/712:39:317
192892180,1sleep10-21swapper/109:34:351
860252170,0pltrace0-21swapper/511:00:185
71002170,0sleep20-21swapper/208:35:142
62702170,0sleep40-21swapper/408:33:084
2757152170,1pltrace49-21ksoftirqd/611:50:226
2597752170,7pltrace27473-21/usr/sbin/munin12:20:306
2266499170,1cyclictest0-21swapper/412:05:294
2266499170,1cyclictest0-21swapper/412:05:284
1180552170,3pltrace13871-21df10:00:216
1059252170,2pltrace9-21ksoftirqd/012:07:510
1059252170,2pltrace9-21ksoftirqd/012:07:510
860252160,9pltrace8741-21ssh10:58:245
281462160,0sleep30-21swapper/307:15:203
2404652160,9pltrace0-21swapper/011:17:270
2404652160,10pltrace27043-21awk11:15:225
2366652160,6pltrace0-21swapper/609:40:256
1898152160,1pltrace19128-21sh08:00:003
1898152160,1pltrace0-21swapper/008:00:480
1471552160,1pltrace9-21ksoftirqd/008:50:100
1180552160,1pltrace9-21ksoftirqd/010:01:230
907052150,6pltrace0-21swapper/212:35:512
860252150,1pltrace9-21ksoftirqd/010:58:500
506452150,6pltrace5158-21sh10:23:194
2757152150,5pltrace28422-21ssh11:49:415
2757152150,1pltrace0-21swapper/011:50:370
2404652150,10pltrace27049-21ssh11:15:224
2404652150,0pltrace0-21swapper/211:16:252
2366652150,6pltrace0-21swapper/009:39:510
2366652150,1pltrace28186-21ssh09:42:014
2366652150,1pltrace25-21ksoftirqd/209:41:272
2264699150,14cyclictest0-21swapper/111:03:301
2047052150,0pltrace0-21swapper/010:41:520
1223752150,1pltrace0-21swapper/711:35:167
1180552150,1pltrace0-21swapper/210:01:512
1059252150,2pltrace14664-21ssh12:06:165
1059252150,2pltrace14664-21ssh12:06:165
1054852150,5pltrace0-21swapper/707:47:347
907052140,1pltrace0-21swapper/012:35:230
907052140,1pltrace0-21swapper/012:34:430
860252140,6pltrace0-21swapper/410:58:314
860252140,5pltrace10022-21ssh11:00:064
347752140,0pltrace0-21swapper/508:32:135
3232752140,0pltrace0-21swapper/010:22:440
307552140,6pltrace0-21swapper/709:21:377
307552140,1pltrace26144-21diskmemload09:21:042
307552140,0pltrace0-21swapper/009:21:570
2757152140,1pltrace0-21swapper/211:49:352
2757152140,0pltrace0-21swapper/411:51:304
2757152140,0pltrace0-21swapper/211:50:302
2597752140,5pltrace0-21swapper/212:20:222
2597752140,5pltrace0-21swapper/012:20:230
2597752140,0pltrace0-21swapper/412:21:504
2404652140,1pltrace28084-21ssh11:16:106
2265299140,12cyclictest0-21swapper/211:04:562
2047052140,1pltrace25118-21ssh10:42:184
1223752140,6pltrace13626-21chrt11:35:034
1223752140,2pltrace12969-21ssh11:34:296
1180552140,6pltrace0-21swapper/510:01:235
1180552140,1pltrace111rcu_preempt10:00:564
1059252140,11pltrace0-21swapper/012:03:540
1059252140,11pltrace0-21swapper/012:03:540
907052130,5pltrace0-21swapper/412:35:584
907052130,0pltrace0-21swapper/712:33:127
860252130,1pltrace8862-21sh10:58:366
822352130,0pltrace0-21swapper/609:28:026
506452130,2pltrace111rcu_preempt10:24:226
347752130,0pltrace0-21swapper/008:32:580
3271552130,0pltrace0-21swapper/411:55:054
3271552130,0pltrace0-21swapper/411:55:054
3232752130,4pltrace0-21swapper/210:22:302
307552130,5pltrace0-21swapper/409:22:244
2757152130,0pltrace0-21swapper/611:49:556
2757152130,0pltrace0-21swapper/011:49:480
2404652130,4pltrace0-21swapper/311:17:403
2318252130,5pltrace0-21swapper/409:07:594
22646991310,2cyclictest0-21swapper/111:21:491
2263999131,11cyclictest0-21swapper/011:09:310
2263999131,11cyclictest0-21swapper/010:47:500
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional