You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-05 - 21:40

x86 Intel Core i7-2600K @3400 MHz, Linux 5.15.7-rt23 (Profile)

Latency plot of system in rack #4, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h200 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack4slot6.osadl.org (updated Fri Dec 24, 2021 02:27:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8059521280,0pltrace0-21swapper/322:56:463
3152921260,0sleep10-21swapper/122:10:241
2927221220,0sleep30-21swapper/323:20:203
30866521200,110pltrace0-21swapper/319:05:143
1265521030,94pltrace0-21swapper/519:10:015
3086652980,88pltrace0-21swapper/719:05:217
126552900,86pltrace0-21swapper/119:06:481
119328368,10sleep20-21swapper/219:05:592
128727661,10sleep40-21swapper/419:06:574
3178352730,1pltrace44-21ksoftirqd/420:56:454
1390752730,0pltrace0-21swapper/321:16:453
787852720,0pltrace0-21swapper/500:06:465
979752700,2pltrace9802-21pltrace-run21:46:462
122726954,10sleep00-21swapper/019:06:290
121526956,9sleep60-21swapper/619:06:206
325652680,0pltrace0-21swapper/300:01:463
156472680,1sleep40-21swapper/422:30:224
263412670,0sleep20-21swapper/221:30:192
177672660,0sleep40-21swapper/421:55:204
204162640,0sleep40-21swapper/422:35:184
2647152630,0pltrace0-21swapper/123:51:471
127072630,0sleep20-21swapper/219:25:212
216102620,1sleep00-21swapper/022:00:210
69952610,0sleep00-21swapper/022:55:330
128232610,1sleep30-21swapper/300:12:283
32942600,0sleep30-21swapper/322:52:003
144402600,0sleep00-21swapper/021:51:480
317582590,0sleep00-21swapper/023:24:580
103572590,0sleep40-21swapper/421:14:424
2897052580,0pltrace0-21swapper/020:51:450
1770352580,1pltrace0-21swapper/220:31:452
769752570,0pltrace0-21swapper/223:31:462
2177352560,1pltrace0-21swapper/100:21:461
215922550,0sleep40-21swapper/421:25:164
10752550,0sleep10-21swapper/122:50:221
52652540,0sleep40-21swapper/421:42:064
2327952540,1pltrace0-21swapper/522:01:465
73552530,1pltrace740-21pltrace-run20:01:454
286212510,1sleep444-21ksoftirqd/420:50:314
14692500,0sleep10-21swapper/100:00:161
93032490,0sleep5501rcuc/521:12:515
166312490,0sleep20-21swapper/200:15:392
417252480,0pltrace0-21swapper/619:11:456
805952430,0pltrace65-21ksoftirqd/722:59:107
279862400,1sleep40-21swapper/422:45:124
805952350,0pltrace0-21swapper/723:01:127
36552270,1pltrace368-21grep21:36:465
1669992624,1cyclictest0-21swapper/520:39:415
3232250,0sleep60-21swapper/620:00:346
283882240,0sleep00-21swapper/000:30:190
260442240,1sleep3361rcuc/319:50:133
1390752240,0pltrace0-21swapper/721:19:357
311052230,1pltrace0-21swapper/500:36:465
286122230,0sleep2291rcuc/222:08:562
1642992119,1cyclictest141rcuc/020:39:410
2356352200,2pltrace23567-21pltrace-run21:26:455
2356352200,16pltrace65-21ksoftirqd/721:27:457
1885552200,8pltrace65-21ksoftirqd/721:57:367
164299200,1cyclictest0-21swapper/020:49:550
154872200,0sleep20-21swapper/223:40:142
267752190,0sleep60-21swapper/620:50:176
212392190,0sleep10-21swapper/123:10:501
196972190,0sleep30-21swapper/321:58:483
16012190,1sleep30-21swapper/321:00:233
504752180,0pltrace0-21swapper/721:10:327
3105952180,0pltrace0-21swapper/300:36:463
292222180,0sleep20-21swapper/223:55:202
2177352180,11pltrace0-21swapper/700:25:597
108102180,0sleep30-21swapper/323:35:183
263892170,3sleep337-21ksoftirqd/300:26:463
188812170,0sleep50-21swapper/523:10:045
1207052170,1pltrace12075-21pltrace-run20:21:457
73552160,1pltrace2425-21ls20:05:153
73552160,1pltrace0-21swapper/220:05:012
57162160,3sleep3361rcuc/321:43:023
416652160,3pltrace5131-21taskset22:19:123
36162160,0sleep1221rcuc/119:10:221
2820852160,1pltrace0-21swapper/621:36:456
2356352160,12pltrace24120-21ssh21:28:001
2177352160,0pltrace0-21swapper/200:25:142
216402160,0sleep70-21swapper/719:40:247
1909352160,3pltrace19143-21seq19:37:217
1776952160,3pltrace21006-21pltrace_jitter23:45:192
1288052160,1pltrace0-21swapper/222:30:302
1251052160,0pltrace0-21swapper/700:12:427
769752150,6pltrace0-21swapper/623:32:116
36552150,1pltrace527-21ssh21:37:052
311052150,3pltrace4122-21rm00:39:221
3103052150,1pltrace0-21swapper/623:58:486
3063852150,0pltrace0-21swapper/722:51:327
279862150,0sleep50-21swapper/522:07:155
2778952150,1pltrace28312-21ssh22:08:051
2607752150,2pltrace26685-21ssh23:18:202
2596652150,10pltrace26288-21ssh22:42:341
2177352150,2pltrace25992-21ssh00:25:516
1885552150,1pltrace19430-21ssh21:58:062
1776952150,1pltrace0-21swapper/023:41:460
1776952150,0pltrace0-21swapper/723:45:127
1390752150,6pltrace0-21swapper/421:17:314
1288052150,2pltrace15739-21irqstats_LOC22:30:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional