You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-04 - 06:35

x86 Intel Core i3-2100T @2500 MHz, Linux 4.14.28-rt23 (Profile)

Latency plot of system in rack #0, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Sun Jun 04, 2023 00:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1066121410,0sleep60-21swapper/600:12:526
989921280,1sleep29898-21sshd21:12:102
2786421240,4sleep51774099cyclictest23:03:485
883721230,0sleep60-21swapper/600:25:106
1092621160,0sleep10-21swapper/122:46:211
987121090,1sleep01-21systemd23:53:460
987121090,1sleep01-21systemd23:53:460
695821090,1sleep76959-21tty00:21:417
260232960,1sleep226018-21sshd23:18:202
287712940,0sleep028766-21bash23:16:100
274442920,0sleep60-21swapper/600:03:226
274442920,0sleep60-21swapper/600:03:226
9702890,4sleep11771799cyclictest21:16:171
42112890,1sleep64209-21bash21:11:586
310052880,1sleep70-21swapper/722:33:367
180122880,2sleep40-21swapper/400:15:214
120962870,0sleep50-21swapper/523:40:195
246622860,0sleep0121rcuc/023:57:380
13252850,1sleep21327-21sshd00:14:482
160992840,1sleep316093-21sshd00:36:373
115512840,1sleep60-21swapper/621:23:216
71642830,0sleep50-21swapper/522:32:455
309072830,1sleep30-21swapper/322:15:363
251792830,0sleep10-21swapper/100:23:291
248132830,1sleep30-21swapper/323:05:553
118322830,0sleep10-21swapper/100:18:321
105012830,0sleep10-21swapper/123:20:041
81532820,1sleep50-21swapper/500:11:385
293212820,0sleep70-21swapper/721:11:437
103842820,1sleep30-21swapper/321:12:103
73522810,1sleep17357-21bash22:19:191
315322810,0sleep20-21swapper/221:18:272
303532810,1sleep530345-21sshd22:24:365
271392810,1sleep627137-21bash21:58:406
271392810,1sleep627137-21bash21:58:406
176292810,0sleep30-21swapper/321:50:273
176292810,0sleep30-21swapper/321:50:273
110532810,1sleep411050-21sshd21:37:534
259692800,2sleep1221rcuc/123:03:431
12722800,1sleep40-21swapper/422:24:434
70132790,0sleep10-21swapper/121:22:031
3282790,0sleep40-21swapper/400:10:174
255232790,3sleep01771199cyclictest22:41:140
164922790,0sleep00-21swapper/022:29:440
142892780,1sleep214282-21bash23:26:542
285132770,0sleep10-21swapper/122:30:091
274052770,0sleep30-21swapper/321:57:333
274052770,0sleep30-21swapper/321:57:323
258572770,0sleep40-21swapper/423:41:554
238712770,4sleep51774099cyclictest23:51:585
238712770,4sleep51774099cyclictest23:51:585
238302770,1sleep723801-21sshd22:09:477
32862760,0sleep00-21swapper/021:53:210
32862760,0sleep00-21swapper/021:53:210
23292760,1sleep2666-21dbus-daemon21:52:112
23292760,1sleep2666-21dbus-daemon21:52:102
231532760,1sleep61-21systemd22:24:216
205452760,1sleep50-21swapper/522:46:415
138592760,1sleep513854-21sshd00:24:135
311952750,0sleep70-21swapper/723:44:237
223792750,1sleep122342-21sshd23:09:131
143972750,1sleep10-21swapper/123:14:351
12072750,0sleep40-21swapper/422:48:154
296212740,0sleep40-21swapper/421:30:404
269352740,1sleep2321ktimersoftd/222:28:582
21962740,1sleep7761rcuc/700:10:207
95842730,0sleep40-21swapper/400:24:044
41402730,0sleep40-21swapper/423:53:344
41402730,0sleep40-21swapper/423:53:344
282012730,4sleep61774699cyclictest23:46:306
282012730,4sleep61774699cyclictest23:46:296
144872730,0sleep40-21swapper/421:20:054
58902720,0sleep55891-21systemd-cgroups22:10:175
303442720,0sleep50-21swapper/521:50:535
303442720,0sleep50-21swapper/521:50:535
239282720,0sleep40-21swapper/422:12:014
178862720,1sleep717879-21sshd22:39:537
65462710,4sleep51774099cyclictest23:10:545
315382710,0sleep00-21swapper/022:59:260
315382710,0sleep00-21swapper/022:59:260
277812710,4sleep01771199cyclictest21:10:320
261152710,0sleep00-21swapper/022:14:210
124422710,0sleep50-21swapper/523:20:085
118182710,1sleep3401rcuc/322:31:483
303192700,1sleep451-21ksoftirqd/400:34:544
212362700,0sleep10-21swapper/123:35:031
174262700,1sleep617416-21rm23:00:046
300682690,0sleep00-21swapper/021:43:030
300682690,0sleep00-21swapper/021:43:030
190852690,1sleep519083-21bash00:32:155
130112690,0sleep5581rcuc/521:45:485
130112690,0sleep5581rcuc/521:45:485
232402680,3sleep51774099cyclictest00:26:455
131692680,0sleep50-21swapper/521:36:505
93312670,1sleep41043-21runrttasks00:38:394
7632660,1sleep20-21swapper/200:21:292
289352650,1sleep328929-21bash22:36:523
157882650,0sleep60-21swapper/622:03:526
66412640,0sleep70-21swapper/722:02:257
140232640,3sleep01771199cyclictest23:06:400
12802630,1sleep51277-21sshd22:57:155
12802630,1sleep51277-21sshd22:57:145
37492620,2sleep13752-21sshd22:45:001
213712620,4sleep41773699cyclictest23:13:414
172812600,0sleep20-21swapper/222:38:432
1740225949,6sleep50-21swapper/519:08:445
1738625948,7sleep00-21swapper/019:08:310
279332580,0sleep10-21swapper/122:36:511
1748825848,6sleep60-21swapper/619:09:496
157112540,4sleep11771799cyclictest21:10:091
245532530,5sleep280550irq/25-eno1-rx-21:21:322
1733325343,6sleep40-21swapper/419:07:554
1740925140,7sleep30-21swapper/319:08:513
1735024928,6sleep20-21swapper/219:08:102
1728924927,7sleep70-21swapper/719:07:257
1740724736,7sleep10-21swapper/119:08:481
79202460,1sleep57916-21sshd21:34:265
273852280,1sleep727382-21sshd22:44:427
274982260,1sleep5581rcuc/523:18:225
78202250,1sleep30-21swapper/323:45:473
78202250,1sleep30-21swapper/323:45:463
224512250,1sleep022444-21sshd00:33:300
222002250,1sleep622199-21bash22:25:256
284952240,1sleep40-21swapper/423:58:554
267412240,0sleep00-21swapper/023:45:200
267412240,0sleep00-21swapper/023:45:190
241292240,11sleep280550irq/25-eno1-rx-23:22:452
178792240,1sleep117877-21sshd23:15:471
80872230,1sleep28084-21sshd22:02:292
62642230,0sleep60-21swapper/623:33:236
226692230,2sleep50-21swapper/522:44:325
21962230,0sleep50-21swapper/523:29:545
187222230,1sleep1666-21dbus-daemon22:23:041
126802230,1sleep3401rcuc/300:07:193
11542230,1sleep30-21swapper/322:04:303
52212220,1sleep25224-21bash00:00:212
52212220,1sleep25224-21bash00:00:202
305932220,1sleep10-21swapper/100:05:411
272712220,1sleep727268-21sshd23:49:527
272712220,1sleep727268-21sshd23:49:527
262502220,1sleep50-21swapper/521:17:105
210452220,1sleep5666-21dbus-daemon23:33:555
1774099220,4cyclictest0-21swapper/500:07:015
113202220,0sleep40-21swapper/423:26:484
72342210,1sleep07-21ksoftirqd/023:39:030
319012210,1sleep00-21swapper/023:30:530
23152210,1sleep60-21swapper/621:53:196
23152210,1sleep60-21swapper/621:53:196
22572210,1sleep60-21swapper/621:42:056
22572210,1sleep60-21swapper/621:42:056
191922210,0sleep119191-21bash23:33:501
17740992119,1cyclictest866-21sshd21:43:095
17740992119,1cyclictest866-21sshd21:43:085
1774099210,1cyclictest8675-21ntp_states00:00:275
1774099210,1cyclictest8675-21ntp_states00:00:265
1774099210,0cyclictest0-21swapper/523:55:095
37012200,0sleep50-21swapper/521:11:575
294852200,1sleep21-21systemd23:57:482
285922200,1sleep21-21systemd22:07:422
26882200,1sleep40-21swapper/422:41:354
251822200,0sleep60-21swapper/600:36:576
219362200,1sleep40-21swapper/421:17:014
210122200,1sleep6671rcuc/623:42:536
18662200,1sleep31864-21sshd23:18:373
184002200,0sleep70-21swapper/700:38:587
1774699200,18cyclictest9860-21sshd23:05:256
17740992018,1cyclictest17359-21sshd23:47:155
17740992018,1cyclictest17359-21sshd23:47:155
1774099200,1cyclictest15965-21bash00:36:375
1774099200,1cyclictest0-21swapper/500:15:195
1771799200,18cyclictest0-21swapper/121:39:441
116312200,1sleep411626-21sshd00:25:164
108872200,0sleep7761rcuc/700:03:557
108872200,0sleep7761rcuc/700:03:557
74212190,1sleep7761rcuc/700:09:247
296222190,0sleep7761rcuc/721:28:277
294252190,1sleep70-21swapper/722:20:057
274502190,0sleep00-21swapper/022:45:480
264292190,0sleep50-21swapper/521:56:225
264292190,0sleep50-21swapper/521:56:215
17723991911,1cyclictest26150-21sshd00:35:512
1771799190,1cyclictest0-21swapper/122:13:211
17711991915,2cyclictest718-21avahi-daemon21:48:440
17711991915,2cyclictest718-21avahi-daemon21:48:430
119602190,0sleep70-21swapper/722:53:077
48632180,0sleep70-21swapper/721:41:017
48632180,0sleep70-21swapper/721:41:007
47222180,1sleep30-21swapper/300:32:533
318632180,0sleep50-21swapper/523:09:335
312602180,1sleep60-21swapper/623:29:466
253662180,1sleep30-21swapper/323:41:543
178712180,1sleep617870-21sshd22:05:056
17746991816,1cyclictest666-21dbus-daemon22:15:106
1771799189,7cyclictest1226-21sshd21:55:301
1771799189,7cyclictest1226-21sshd21:55:301
1771799184,10cyclictest664-21polkitd21:40:531
1771799184,10cyclictest664-21polkitd21:40:521
1771799180,1cyclictest666-21dbus-daemon21:26:591
1771799180,1cyclictest0-21swapper/121:32:291
99502170,0sleep20-21swapper/221:46:492
99502170,0sleep20-21swapper/221:46:482
75622170,0sleep17566-21id21:47:531
75622170,0sleep17566-21id21:47:521
317882170,1sleep431790-21grep22:54:574
311132170,0sleep60-21swapper/621:49:506
311132170,0sleep60-21swapper/621:49:496
294042170,1sleep00-21swapper/022:35:450
27232170,0sleep0121rcuc/021:21:530
269802170,4sleep61774699cyclictest22:48:026
198162170,1sleep00-21swapper/022:30:570
195492170,1sleep07-21ksoftirqd/023:24:520
17746991715,1cyclictest8386-21bash22:31:406
17746991714,1cyclictest666-21dbus-daemon22:41:536
17746991712,4cyclictest666-21dbus-daemon21:36:106
17746991712,1cyclictest666-21dbus-daemon23:11:246
17736991714,2cyclictest17704-21cyclictest22:09:424
1773699170,15cyclictest1-21systemd23:00:224
17723991711,4cyclictest15925-21grep23:52:502
17723991711,4cyclictest15925-21grep23:52:502
17717991710,6cyclictest3120-21grepconf.sh00:28:191
1771799170,15cyclictest7961-21sshd00:00:261
1771799170,15cyclictest7961-21sshd00:00:261
166412170,0sleep70-21swapper/723:26:597
156482170,0sleep30-21swapper/322:55:293
156482170,0sleep30-21swapper/322:55:283
245422160,2sleep21095-21in:imjournal23:02:332
221002160,1sleep022096-21sshd22:17:330
17746991613,2cyclictest30852-21sshd21:32:576
17746991611,1cyclictest666-21dbus-daemon22:52:346
17746991611,1cyclictest666-21dbus-daemon21:18:366
17740991612,2cyclictest0-21swapper/522:03:015
17736991613,1cyclictest27141-21bash23:15:014
1772999162,12cyclictest0-21swapper/321:24:323
1772399160,14cyclictest0-21swapper/219:50:142
174652160,1sleep2311rcuc/221:35:512
74762150,0sleep70-21swapper/723:18:497
276762150,0sleep50-21swapper/520:35:205
271932150,1sleep31043-21runrttasks22:06:313
266662150,0sleep60-21swapper/622:10:586
207762150,0sleep00-21swapper/000:06:280
17753991512,2cyclictest13892-21bash23:34:487
1775399150,2cyclictest29943-21sshd23:03:527
1775399150,13cyclictest17489-21sshd23:36:007
17746991512,2cyclictest702-21gdbus23:15:126
17746991510,1cyclictest666-21dbus-daemon23:58:026
1773699150,13cyclictest0-21swapper/400:08:164
17729991513,1cyclictest1612-21bash22:10:083
17729991512,2cyclictest13843-21wc23:50:293
17729991512,2cyclictest13843-21wc23:50:283
17729991512,1cyclictest0-21swapper/321:35:163
1772999150,13cyclictest21776-21bash22:25:253
1771799153,7cyclictest29183-21cut20:40:001
1771799150,2cyclictest778-21gdbus23:44:541
1771799150,13cyclictest6845-21sshd00:35:131
17711991512,2cyclictest718-21avahi-daemon22:22:450
63732140,1sleep36365-21sshd22:23:453
1775399140,1cyclictest7666-21sshd21:49:017
1775399140,1cyclictest7666-21sshd21:49:007
17746991411,2cyclictest718-21avahi-daemon21:25:056
17746991411,2cyclictest666-21dbus-daemon23:54:546
17746991411,2cyclictest666-21dbus-daemon23:54:546
17740991411,2cyclictest666-21dbus-daemon22:39:585
1773699148,2cyclictest51-21ksoftirqd/422:39:344
1773699140,13cyclictest702-21gdbus21:13:154
1773699140,12cyclictest9943-21cp21:51:194
1773699140,12cyclictest9943-21cp21:51:184
17729991411,2cyclictest19242-21sshd23:25:563
17729991411,2cyclictest0-21swapper/321:32:303
1772999140,1cyclictest0-21swapper/322:45:023
1772999140,12cyclictest29183-21bash22:44:463
17723991410,2cyclictest1-21systemd22:24:402
1772399140,2cyclictest17590-21bash23:05:392
1771799144,8cyclictest19369-21sshd22:00:361
1771799144,8cyclictest13651-21sshd23:58:231
1771799143,9cyclictest778-21gdbus23:47:421
1771799143,9cyclictest778-21gdbus23:47:421
1771799143,9cyclictest679-21gdbus00:30:501
1771799143,9cyclictest666-21dbus-daemon22:28:071
1771799143,9cyclictest664-21polkitd23:27:051
1771799142,10cyclictest0-21swapper/122:55:101
1771799142,10cyclictest0-21swapper/122:55:101
1771799140,2cyclictest30833-21sshd21:52:021
1771799140,2cyclictest30833-21sshd21:52:011
17711991412,1cyclictest0-21swapper/000:15:400
17711991411,2cyclictest1-21systemd21:19:360
1771199140,1cyclictest0-21swapper/021:31:010
104372140,1sleep310434-21sshd23:38:013
28122130,0sleep00-21swapper/022:51:410
1775399130,12cyclictest2101-21sshd21:34:147
1775399130,12cyclictest0-21swapper/721:23:217
1775399130,12cyclictest0-21swapper/721:17:377
17746991311,1cyclictest666-21dbus-daemon00:19:186
17746991310,1cyclictest666-21dbus-daemon00:31:546
1774099130,7cyclictest0-21swapper/522:54:135
1774099130,12cyclictest21844-21sshd21:21:265
1774099130,12cyclictest0-21swapper/522:26:215
1774099130,12cyclictest0-21swapper/519:36:115
17736991311,1cyclictest0-21swapper/422:28:574
1772999133,5cyclictest0-21swapper/320:40:393
17723991311,1cyclictest0-21swapper/222:43:132
1772399130,12cyclictest0-21swapper/221:00:222
1771799133,8cyclictest679-21gdbus00:12:021
1771799132,9cyclictest711-21systemd-logind22:52:461
1771799132,9cyclictest664-21polkitd23:50:161
1771799132,9cyclictest664-21polkitd23:50:151
1771799130,11cyclictest23065-21sshd22:05:161
1771199130,1cyclictest2483-21sshd22:03:240
1771199130,11cyclictest666-21dbus-daemon23:03:480
305312120,1sleep5591ktimersoftd/523:38:435
281242120,0sleep3401rcuc/300:04:313
281242120,0sleep3401rcuc/300:04:313
251262120,0sleep30-21swapper/322:51:203
1774699128,2cyclictest664-21polkitd00:21:386
1773699129,2cyclictest718-21avahi-daemon00:02:014
1773699129,2cyclictest718-21avahi-daemon00:02:014
1773699129,1cyclictest51-21ksoftirqd/421:55:204
1773699129,1cyclictest51-21ksoftirqd/421:55:204
1773699120,1cyclictest101rcu_sched21:26:234
1772999129,2cyclictest8250-21sshd21:45:383
1772999129,2cyclictest8250-21sshd21:45:373
1772999120,1cyclictest0-21swapper/321:00:193
1772399120,1cyclictest0-21swapper/221:26:032
1772399120,1cyclictest0-21swapper/220:25:182
1772399120,11cyclictest80550irq/25-eno1-rx-21:32:192
1771799123,7cyclictest10247-21expr20:00:131
1771199129,2cyclictest718-21avahi-daemon00:02:280
1771199129,2cyclictest718-21avahi-daemon00:02:280
311772110,1sleep631179-21bash00:06:506
24152110,0sleep20-21swapper/221:40:562
24152110,0sleep20-21swapper/221:40:552
1775399118,2cyclictest0-21swapper/719:10:417
1775399117,1cyclictest13008-21bash21:36:507
1774699118,2cyclictest666-21dbus-daemon23:23:046
1774699110,1cyclictest0-21swapper/619:16:406
1774699110,10cyclictest0-21swapper/619:10:306
1774099118,2cyclictest5208-21cpuspeed_turbos19:50:125
1773699119,1cyclictest718-21avahi-daemon22:18:574
1773699119,1cyclictest51-21ksoftirqd/423:20:174
1773699118,1cyclictest51-21ksoftirqd/423:47:204
1773699118,1cyclictest51-21ksoftirqd/423:47:204
1773699117,1cyclictest51-21ksoftirqd/423:35:164
1773699117,1cyclictest51-21ksoftirqd/421:49:114
1773699117,1cyclictest51-21ksoftirqd/421:49:114
1773699110,1cyclictest0-21swapper/420:50:174
1773699110,10cyclictest21641-21sshd22:02:574
1773699110,10cyclictest14687-21kworker/4:223:33:564
1772999119,1cyclictest0-21swapper/320:59:563
1772999118,2cyclictest5400-21sshd23:58:063
1772999118,2cyclictest42-21ksoftirqd/300:21:303
1772999114,5cyclictest31347-21sshd21:15:103
1772399116,3cyclictest728-21NetworkManager23:31:562
1772399116,3cyclictest30180-21kworker/2:122:50:412
1772399115,4cyclictest666-21dbus-daemon22:12:102
1772399110,6cyclictest0-21swapper/221:06:332
1772399110,1cyclictest0-21swapper/223:13:082
1772399110,10cyclictest18516-21sshd00:06:242
1772399110,10cyclictest0-21swapper/222:30:282
1771799113,7cyclictest724-21nscd20:25:181
1771799113,7cyclictest1010-21snmpd21:06:171
1771799113,7cyclictest1010-21snmpd21:02:361
1771799113,7cyclictest1010-21snmpd20:52:471
1771799113,7cyclictest1010-21snmpd20:40:321
1771799113,7cyclictest1010-21snmpd20:31:501
1771799113,7cyclictest1010-21snmpd20:14:201
1771799113,7cyclictest1010-21snmpd19:54:541
1771799113,7cyclictest1010-21snmpd19:33:391
1771799113,7cyclictest1010-21snmpd19:27:241
1771799113,7cyclictest1010-21snmpd19:24:371
1771799113,7cyclictest1010-21snmpd19:12:361
1771799112,7cyclictest702-21gdbus21:00:001
1771799112,7cyclictest32245-21cat20:45:171
1771799110,9cyclictest0-21swapper/120:05:191
1771199118,2cyclictest718-21avahi-daemon23:42:580
1771199115,5cyclictest702-21gdbus23:25:320
281492100,2sleep30-21swapper/300:28:043
252232100,0sleep525225-21id22:05:205
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional