You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-17 - 06:06

Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz, Linux 5.9.0-rc2-rt1 (Profile)

Latency plot of system in rack #4, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h200 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack4slot6.osadl.org (updated Sun Oct 17, 2021 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8293521300,125pltrace0-21swapper/119:09:331
11031521270,109pltrace0-21swapper/719:09:447
11031521260,114pltrace0-21swapper/319:09:523
8293521230,113pltrace0-21swapper/519:09:255
1456752860,3pltrace0-21swapper/700:14:367
2855052770,0pltrace0-21swapper/721:24:357
3103252760,1pltrace31035-21grep23:59:366
143292740,0sleep50-21swapper/523:12:195
869627362,7sleep20-21swapper/219:05:032
1104127362,7sleep60-21swapper/619:09:406
3105352710,0pltrace0-21swapper/719:44:357
1074527160,7sleep00-21swapper/019:05:490
677452690,0pltrace0-21swapper/421:34:354
67122680,1sleep119-21ksoftirqd/100:05:351
1737752670,0pltrace0-21swapper/219:19:342
137862670,1sleep60-21swapper/622:40:326
87432650,0sleep50-21swapper/523:37:515
2741152650,0pltrace0-21swapper/722:24:367
183302640,0sleep40-21swapper/423:46:074
183302640,0sleep40-21swapper/423:46:074
1087526251,7sleep40-21swapper/419:07:374
3270652190,2pltrace111rcu_preempt22:34:141
3270652180,2pltrace111rcu_preempt22:33:036
2683752180,4pltrace111rcu_preempt22:57:312
2604852180,1pltrace25-21ksoftirqd/220:35:232
1622452180,11pltrace0-21swapper/022:45:320
1622452180,0pltrace111rcu_preempt22:45:591
980352170,1pltrace25-21ksoftirqd/223:42:502
980352170,1pltrace25-21ksoftirqd/223:42:502
413452170,6pltrace0-21swapper/119:55:271
275822170,0sleep40-21swapper/400:25:254
2270752170,9pltrace0-21swapper/021:52:160
2270752170,2pltrace111rcu_preempt21:52:596
2042152170,2pltrace24003-21ssh23:51:436
2042152170,2pltrace24003-21ssh23:51:436
1680752170,11pltrace0-21swapper/022:17:180
1622452170,1pltrace19350-21ssh22:45:582
145552170,10pltrace5879-21ssh21:33:071
1383752170,7pltrace13900-21grep19:15:010
980352160,6pltrace0-21swapper/123:41:551
980352160,6pltrace0-21swapper/123:41:551
923852160,6pltrace12679-21ssh00:11:282
923852160,2pltrace13049-21diskmemload00:12:066
84952160,1pltrace49-21ksoftirqd/622:00:586
505252160,1pltrace19-21ksoftirqd/123:08:171
3105352160,0pltrace0-21swapper/119:47:221
3103252160,7pltrace31244-21sh23:59:560
2630752160,8pltrace0-21swapper/023:25:310
2630752160,6pltrace0-21swapper/123:26:461
2630752160,2pltrace111rcu_preempt23:26:096
2630752160,1pltrace26483-21ssh23:24:530
2516552160,0pltrace0-21swapper/100:27:051
2270752160,6pltrace26944-21ssh21:52:501
2042152160,6pltrace0-21swapper/023:52:200
2042152160,6pltrace0-21swapper/023:52:200
201222160,1sleep0101rcuc/023:49:080
201222160,1sleep0101rcuc/023:49:080
1793552160,7pltrace20544-21timerandwakeup21:15:291
1793552160,5pltrace0-21swapper/621:15:466
1793552160,1pltrace0-21swapper/221:15:212
1680752160,6pltrace0-21swapper/222:16:042
1680752160,1pltrace49-21ksoftirqd/622:16:146
1383752160,1pltrace0-21swapper/719:15:207
133172160,0sleep50-21swapper/520:10:185
1209552160,1pltrace0-21swapper/021:42:560
980352150,6pltrace0-21swapper/023:42:040
980352150,6pltrace0-21swapper/023:42:040
923852150,2pltrace1112-21snmpd00:12:351
923852150,1pltrace9-21ksoftirqd/000:12:160
84952150,6pltrace0-21swapper/122:01:151
84952150,5pltrace0-21swapper/222:01:232
84952150,0pltrace0-21swapper/022:00:580
686852150,5pltrace0-21swapper/220:00:102
505252150,6pltrace10104-21ssh23:09:120
3270652150,6pltrace4659-21ssh22:33:022
3270652150,5pltrace0-21swapper/022:33:200
3105352150,2pltrace111rcu_preempt19:45:257
2630752150,4pltrace0-21swapper/323:25:033
2630752150,0pltrace0-21swapper/223:25:222
2558252150,2pltrace26861-21perl19:35:167
2516552150,1pltrace28863-21ssh00:26:550
2323552150,9pltrace0-21swapper/121:22:521
1793552150,2pltrace111rcu_preempt21:15:303
1784152150,1pltrace111rcu_preempt20:23:306
1680752150,0pltrace0-21swapper/122:17:001
1622452150,6pltrace19531-21ssh22:46:167
1510552150,5pltrace0-21swapper/120:18:471
1383752150,0pltrace0-21swapper/119:15:011
1209552150,5pltrace0-21swapper/221:43:142
1209552150,5pltrace0-21swapper/121:43:051
1125499150,14cyclictest0-21swapper/220:30:202
980352140,4pltrace0-21swapper/623:42:326
980352140,4pltrace0-21swapper/623:42:326
733452140,4pltrace0-21swapper/121:02:351
505252140,6pltrace0-21swapper/623:07:226
460152140,0pltrace111rcu_preempt20:56:483
460152140,0pltrace0-21swapper/120:56:161
413452140,5pltrace0-21swapper/219:55:352
3270652140,0pltrace0-21swapper/722:32:537
3103252140,4pltrace0-21swapper/223:59:392
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional