You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-21 - 11:51

x86 Intel Core i3-2100T @2500 MHz, Linux 4.14.28-rt23 (Profile)

Latency plot of system in rack #0, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Sat May 21, 2022 00:45:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
920121590,1sleep520887-21nscd22:23:075
2073721470,0sleep00-21swapper/021:45:490
956721430,1sleep09558-21bash22:30:230
387221430,5sleep01009999cyclictest21:57:200
387221430,5sleep01009999cyclictest21:57:190
1682621350,1sleep4501ktimersoftd/421:56:364
1682621350,1sleep4501ktimersoftd/421:56:354
799221320,4sleep31011999cyclictest00:30:103
2405121290,0sleep30-21swapper/321:26:283
2197621290,0sleep40-21swapper/423:17:084
3181021170,1sleep531809-21bash21:53:335
2389321140,1sleep723894-21bash21:45:577
847521130,0sleep00-21swapper/023:59:290
2717521130,0sleep50-21swapper/500:32:035
132232970,0sleep10-21swapper/123:42:291
48492930,2sleep30-21swapper/300:06:373
235492930,1sleep40-21swapper/421:31:194
187482920,0sleep30-21swapper/323:29:183
225702880,0sleep60-21swapper/622:57:386
118352870,1sleep50-21swapper/523:16:455
10382870,0sleep70-21swapper/721:19:357
65302860,0sleep50-21swapper/522:18:095
149912860,0sleep20-21swapper/222:23:192
80232850,1sleep10-21swapper/122:25:261
321842850,1sleep4501ktimersoftd/422:05:414
55112840,1sleep5698-21polkitd21:29:285
98662830,1sleep20-21swapper/221:36:542
44072830,1sleep50-21swapper/500:16:255
323302830,1sleep30-21swapper/321:51:053
244262830,0sleep00-21swapper/022:55:160
234252830,0sleep60-21swapper/622:09:056
65342820,0sleep10-21swapper/121:59:541
65342820,0sleep10-21swapper/121:59:531
271572820,1sleep30-21swapper/321:38:483
268442820,0sleep70-21swapper/721:33:547
285432810,1sleep00-21swapper/022:26:130
97422800,1sleep40-21swapper/423:55:484
4312800,0sleep10-21swapper/100:05:141
310362800,0sleep10-21swapper/100:34:401
295722800,0sleep60-21swapper/621:25:286
254692800,1sleep6671rcuc/623:27:046
248972800,1sleep124893-21bash22:55:171
32142790,1sleep60-21swapper/600:05:196
267422790,1sleep020894-21nscd22:03:060
267422790,1sleep020894-21nscd22:03:050
56892780,1sleep21-21systemd21:50:092
288972780,0sleep70-21swapper/721:10:547
263622780,1sleep4684-21dbus-daemon22:43:094
234382780,2sleep10-21swapper/122:32:081
186842780,1sleep40-21swapper/423:23:084
13452780,1sleep30-21swapper/321:31:423
56832770,0sleep50-21swapper/523:05:315
56832770,0sleep50-21swapper/523:05:305
279142770,0sleep5581rcuc/500:39:255
213642770,1sleep60-21swapper/600:30:376
121442770,0sleep00-21swapper/023:43:420
112212770,0sleep00-21swapper/021:24:490
84222760,0sleep70-21swapper/723:45:577
41002760,1sleep34096-21sshd23:50:423
300902760,1sleep530087-21sshd22:27:315
189542760,1sleep70-21swapper/700:08:247
113912760,0sleep20-21swapper/200:19:102
109272760,0sleep10-21swapper/122:10:591
78982750,1sleep1684-21dbus-daemon23:21:301
323922750,0sleep70-21swapper/700:11:227
323922750,0sleep70-21swapper/700:11:227
285262750,2sleep00-21swapper/000:32:070
260272750,0sleep10-21swapper/123:56:251
110792750,0sleep70-21swapper/721:40:357
17472740,0sleep50-21swapper/521:15:575
13162740,4sleep61014099cyclictest21:20:466
104212740,0sleep70-21swapper/721:39:247
100062740,1sleep70-21swapper/721:29:387
255762730,0sleep625553-21sshd00:17:136
255132730,5sleep31011999cyclictest21:14:263
254242730,0sleep60-21swapper/623:44:116
243342730,0sleep10-21swapper/121:18:011
202242730,1sleep6732-21gdbus21:32:256
92882720,3sleep1231ktimersoftd/123:25:151
5712720,0sleep60-21swapper/623:00:276
5712720,0sleep60-21swapper/623:00:276
45132720,0sleep10-21swapper/122:35:041
285532720,0sleep00-21swapper/000:29:430
283162710,0sleep40-21swapper/422:32:184
225192710,0sleep40-21swapper/421:45:544
21522710,0sleep0121rcuc/023:33:310
180292710,0sleep20-21swapper/222:00:192
180292710,0sleep20-21swapper/222:00:182
157882710,1sleep415718-21sshd21:29:504
15382710,1sleep30-21swapper/323:38:223
134482710,0sleep30-21swapper/300:02:033
213332700,0sleep40-21swapper/400:17:044
212732700,0sleep30-21swapper/322:57:343
261082690,1sleep426104-21sshd21:16:524
21512690,1sleep1221rcuc/100:37:131
292902670,0sleep60-21swapper/600:22:196
94642640,0sleep20-21swapper/200:01:552
157082640,0sleep70-21swapper/721:51:427
968326141,6sleep60-21swapper/619:07:406
282392610,1sleep628237-21sshd21:54:386
13942600,0sleep10-21swapper/122:40:581
112742600,0sleep50-21swapper/523:33:525
154572590,4sleep01009999cyclictest21:52:560
783225848,6sleep00-21swapper/019:05:010
123412580,1sleep012280-21sshd00:14:190
123412580,1sleep012280-21sshd00:14:190
974625646,6sleep30-21swapper/319:08:263
980425039,7sleep70-21swapper/719:09:097
34232490,0sleep40-21swapper/422:16:474
963524634,8sleep50-21swapper/519:06:595
988124535,6sleep10-21swapper/119:09:591
293922450,0sleep70-21swapper/722:37:107
100092450,1sleep09999-21cp23:22:490
958624130,7sleep20-21swapper/219:06:242
943924129,7sleep40-21swapper/419:05:214
292462380,0sleep729247-21grep00:28:287
171202320,1sleep317052-21sshd23:18:123
10119993113,1cyclictest21275-21tty22:44:123
156842300,12sleep278850irq/25-eno1-rx-23:02:152
156842300,12sleep278850irq/25-eno1-rx-23:02:152
46122270,0sleep70-21swapper/700:01:447
1014599273,18cyclictest0-21swapper/720:10:527
1014599260,24cyclictest0-21swapper/719:22:217
84852250,1sleep10-21swapper/100:17:491
281042250,1sleep728099-21sshd00:32:067
27712250,1sleep0684-21dbus-daemon21:32:590
228532250,1sleep322849-21sshd21:15:303
22302250,1sleep32223-21sshd22:04:373
22302250,1sleep32223-21sshd22:04:363
1014599252,21cyclictest0-21swapper/720:42:477
1014599250,1cyclictest30334-21sshd23:13:497
1014099257,4cyclictest10552-21sshd00:00:446
35142240,0sleep60-21swapper/622:41:036
318972240,1sleep10-21swapper/121:46:151
151262240,1sleep20-21swapper/200:25:282
112172240,1sleep60-21swapper/622:03:446
112172240,1sleep60-21swapper/622:03:436
1014599242,2cyclictest683-21systemd-logind22:50:427
1014599241,1cyclictest0-21swapper/723:21:167
1014599240,22cyclictest0-21swapper/723:55:147
1014099243,19cyclictest698-21polkitd21:45:076
1014099241,21cyclictest0-21swapper/620:10:506
236722230,1sleep40-21swapper/423:28:154
220942230,1sleep622095-21grepconf.sh00:14:426
220942230,1sleep622095-21grepconf.sh00:14:426
195632230,1sleep2684-21dbus-daemon21:56:422
195632230,1sleep2684-21dbus-daemon21:56:412
109422230,1sleep70-21swapper/723:27:447
1011999230,21cyclictest0-21swapper/320:10:463
1011299233,4cyclictest0-21swapper/222:47:502
1010699230,22cyclictest0-21swapper/119:22:451
31252220,0sleep30-21swapper/321:48:503
300662220,0sleep50-21swapper/521:59:345
300662220,0sleep50-21swapper/521:59:335
161512220,1sleep516104-21sshd23:29:125
160612220,1sleep3401rcuc/322:22:073
1014599220,1cyclictest0-21swapper/723:34:317
1014099223,18cyclictest0-21swapper/619:36:436
1014099222,1cyclictest0-21swapper/620:25:196
1014099222,18cyclictest0-21swapper/619:49:226
1014099222,18cyclictest0-21swapper/619:49:216
1011299223,18cyclictest0-21swapper/219:39:102
1011299222,18cyclictest0-21swapper/219:34:272
1011299222,18cyclictest0-21swapper/219:28:112
1011299220,19cyclictest0-21swapper/219:20:572
1010699223,18cyclictest0-21swapper/119:26:181
1010699221,20cyclictest0-21swapper/121:07:591
1010699221,20cyclictest0-21swapper/120:50:131
1010699220,21cyclictest0-21swapper/120:30:291
92692210,0sleep20-21swapper/222:36:262
39292210,1sleep7777-21gdbus22:04:417
39292210,1sleep7777-21gdbus22:04:407
312472210,1sleep1667-21rngd21:34:041
294102210,1sleep40-21swapper/423:41:534
242922210,0sleep40-21swapper/421:24:064
236332210,2sleep10-21swapper/121:52:001
209702210,1sleep20-21swapper/200:13:252
209702210,1sleep20-21swapper/200:13:242
208632210,0sleep1231ktimersoftd/121:43:261
1014099210,1cyclictest0-21swapper/623:49:536
1013299210,19cyclictest0-21swapper/520:59:175
1011999210,19cyclictest0-21swapper/320:42:333
1011999210,19cyclictest0-21swapper/320:15:023
1011999210,19cyclictest0-21swapper/319:50:433
1011299211,1cyclictest78850irq/25-eno1-rx-22:18:532
1011299211,1cyclictest1-21systemd00:07:502
1010699212,18cyclictest0-21swapper/120:08:351
8732200,1sleep1221rcuc/121:28:041
297332200,4sleep51013299cyclictest22:01:585
297332200,4sleep51013299cyclictest22:01:585
286822200,0sleep00-21swapper/000:23:330
274422200,1sleep127433-21sshd21:21:461
233412200,1sleep023340-21seq22:51:300
228722200,1sleep7667-21rngd22:49:057
21982200,0sleep20-21swapper/222:51:572
201152200,1sleep30-21swapper/322:38:043
160052200,0sleep40-21swapper/423:54:524
159232200,0sleep50-21swapper/521:45:385
11522200,1sleep081ktimersoftd/023:46:540
1014599200,3cyclictest683-21systemd-logind00:19:357
1014599200,17cyclictest0-21swapper/720:46:547
1014099203,2cyclictest0-21swapper/622:18:326
1014099200,4cyclictest12389-21sshd22:30:296
1014099200,19cyclictest30224-21sshd21:41:206
1014099200,19cyclictest0-21swapper/620:21:356
1013299202,2cyclictest16862-21bash21:44:315
1013299200,1cyclictest732-21gdbus23:50:175
1013299200,19cyclictest0-21swapper/519:55:245
1011999200,4cyclictest9584-21sshd00:37:303
1011299202,2cyclictest0-21swapper/222:58:512
1011299201,18cyclictest0-21swapper/219:52:062
1011299200,1cyclictest12182-21sshd23:48:352
1011299200,18cyclictest2679-21sshd23:10:202
1011299200,17cyclictest0-21swapper/220:48:032
10106992015,1cyclictest11618-21turbostat20:20:001
1010699200,1cyclictest0-21swapper/120:00:161
1010699200,19cyclictest0-21swapper/121:04:031
217842190,1sleep521740-21sshd21:37:215
141822190,1sleep614039-21sshd21:55:186
141822190,1sleep614039-21sshd21:55:186
1014599190,2cyclictest0-21swapper/719:16:417
1014599190,18cyclictest0-21swapper/719:26:597
1014099192,1cyclictest0-21swapper/622:28:136
1014099190,18cyclictest0-21swapper/620:46:426
1014099190,18cyclictest0-21swapper/620:32:376
1014099190,18cyclictest0-21swapper/619:27:426
1014099190,17cyclictest0-21swapper/621:36:586
1014099190,17cyclictest0-21swapper/619:55:346
1013299190,1cyclictest0-21swapper/522:13:295
1011999190,1cyclictest850-21bash00:21:113
1011999190,1cyclictest0-21swapper/323:59:533
1011999190,17cyclictest0-21swapper/319:14:233
1011299190,4cyclictest463-21systemd-journal23:36:372
1011299190,4cyclictest3492-21sshd00:38:292
1011299190,18cyclictest0-21swapper/220:40:402
1011299190,16cyclictest0-21swapper/219:13:232
1010699192,1cyclictest26897-21sshd23:38:071
1010699190,4cyclictest26187-21perf20:50:001
79452180,1sleep27891-21sshd23:15:222
25562180,1sleep00-21swapper/023:39:410
223912180,1sleep4684-21dbus-daemon22:46:384
139522180,0sleep30-21swapper/323:33:593
1014599181,1cyclictest1011-21sshd22:57:187
1014599180,1cyclictest698-21polkitd00:21:357
1014599180,1cyclictest0-21swapper/723:35:077
1014099180,1cyclictest32222-21systemd-cgroups23:10:146
1014099180,1cyclictest29003-21sshd23:05:126
1014099180,1cyclictest29003-21sshd23:05:116
1014099180,1cyclictest0-21swapper/623:30:546
1014099180,1cyclictest0-21swapper/622:23:536
1013299182,15cyclictest0-21swapper/520:49:205
1013299181,1cyclictest13040-21sshd22:37:485
1013299180,1cyclictest29093-21sshd22:40:475
1013299180,1cyclictest1011-21sshd23:40:005
1012399182,15cyclictest698-21polkitd00:08:364
1011999180,1cyclictest27577-21bash23:21:013
1011999180,1cyclictest0-21swapper/321:22:223
1011999180,16cyclictest0-21swapper/321:05:093
1011299180,1cyclictest0-21swapper/223:52:552
1011299180,1cyclictest0-21swapper/221:30:192
1010699180,4cyclictest25466-21bash22:06:411
1010699180,1cyclictest0-21swapper/123:16:361
1010699180,16cyclictest0-21swapper/120:44:051
21692170,0sleep40-21swapper/400:39:404
137072170,0sleep10-21swapper/122:00:101
137072170,0sleep10-21swapper/122:00:091
129652170,1sleep4501ktimersoftd/423:02:094
129652170,1sleep4501ktimersoftd/423:02:084
1014599172,14cyclictest0-21swapper/720:52:387
1014599170,2cyclictest28775-21sshd22:20:127
1014599170,1cyclictest0-21swapper/722:41:097
1014599170,1cyclictest0-21swapper/722:13:107
1014099173,2cyclictest0-21swapper/619:10:546
1014099173,1cyclictest0-21swapper/621:18:516
1014099173,13cyclictest0-21swapper/623:52:226
1014099173,13cyclictest0-21swapper/621:08:176
1014099173,13cyclictest0-21swapper/620:40:136
1014099173,13cyclictest0-21swapper/620:39:326
1014099173,13cyclictest0-21swapper/619:44:596
1014099173,13cyclictest0-21swapper/619:20:016
1014099171,15cyclictest0-21swapper/619:32:326
1014099170,16cyclictest0-21swapper/620:05:226
1013299170,2cyclictest9572-21sshd00:20:185
1013299170,2cyclictest0-21swapper/523:44:465
1011999172,2cyclictest0-21swapper/322:46:293
1011999170,1cyclictest17721-21systemd-cgroups22:06:223
1011999170,16cyclictest0-21swapper/320:55:273
1011299173,1cyclictest684-21dbus-daemon00:23:052
1011299172,1cyclictest684-21dbus-daemon22:33:292
1010699170,2cyclictest0-21swapper/123:32:101
47422160,1sleep51-21systemd23:58:045
22822160,0sleep0121rcuc/000:00:250
202042160,0sleep00-21swapper/021:36:040
135582160,0sleep3401rcuc/300:27:533
113742160,0sleep00-21swapper/022:41:210
1014599163,1cyclictest0-21swapper/723:50:197
10145991612,2cyclictest0-21swapper/722:27:557
1014599160,15cyclictest0-21swapper/719:13:397
1014099163,7cyclictest0-21swapper/623:35:446
1014099163,12cyclictest0-21swapper/622:10:246
1014099163,12cyclictest0-21swapper/620:57:076
1014099163,12cyclictest0-21swapper/619:54:256
1014099163,12cyclictest0-21swapper/619:17:116
1014099160,1cyclictest3081-21sshd21:13:366
1014099160,15cyclictest0-21swapper/622:35:216
1014099160,13cyclictest0-21swapper/621:00:446
1014099160,13cyclictest0-21swapper/600:39:586
1013299160,1cyclictest0-21swapper/523:24:485
1013299160,15cyclictest0-21swapper/519:45:195
1013299160,15cyclictest0-21swapper/519:45:185
10119991614,1cyclictest1-21systemd22:26:053
1011999160,1cyclictest31224-21sshd22:32:253
1011999160,15cyclictest0-21swapper/320:31:503
1011299160,15cyclictest0-21swapper/220:08:262
1010699163,4cyclictest0-21swapper/122:46:511
1010699160,4cyclictest16645-21sshd00:14:291
1010699160,4cyclictest16645-21sshd00:14:291
1010699160,1cyclictest29982-21sshd21:37:401
1010699160,15cyclictest0-21swapper/119:38:161
76582150,0sleep10-21swapper/122:53:251
212702150,0sleep50-21swapper/522:06:315
189312150,3sleep31011999cyclictest23:13:223
1014599150,3cyclictest0-21swapper/723:43:097
1014599150,2cyclictest18129-21sshd22:33:107
1014099155,6cyclictest684-21dbus-daemon00:26:186
1014099152,12cyclictest0-21swapper/623:15:516
1014099152,12cyclictest0-21swapper/620:03:196
1014099150,1cyclictest0-21swapper/622:51:266
1014099150,13cyclictest0-21swapper/623:24:436
1014099150,13cyclictest0-21swapper/620:17:216
1013299151,12cyclictest0-21swapper/520:20:405
1013299150,2cyclictest0-21swapper/523:04:315
1013299150,2cyclictest0-21swapper/523:04:305
1013299150,1cyclictest0-21swapper/500:27:185
1013299150,13cyclictest30423-21bash23:11:225
1013299150,10cyclictest0-21swapper/520:10:325
1012399150,13cyclictest0-21swapper/400:23:304
10119991511,2cyclictest0-21swapper/300:11:583
10119991511,2cyclictest0-21swapper/300:11:583
1011999150,13cyclictest0-21swapper/322:50:223
1011299152,12cyclictest0-21swapper/219:42:302
10112991511,3cyclictest0-21swapper/223:28:572
1011299150,3cyclictest0-21swapper/200:31:542
1011299150,1cyclictest683-21systemd-logind22:28:442
1011299150,1cyclictest27689-21bash23:22:162
1011299150,1cyclictest0-21swapper/223:32:222
1010699153,11cyclictest0-21swapper/119:53:301
1010699150,4cyclictest18559-21sshd22:24:411
1010699150,1cyclictest0-21swapper/122:16:021
72902140,0sleep00-21swapper/023:54:320
1014599140,13cyclictest16911-21sshd00:35:217
1014599140,12cyclictest0-21swapper/723:00:517
1014599140,12cyclictest0-21swapper/723:00:507
1014099140,2cyclictest2917-21sshd23:55:326
1014099140,13cyclictest0-21swapper/622:48:206
1014099140,13cyclictest0-21swapper/620:50:026
1013299140,1cyclictest11907-21sshd21:24:515
10123991411,2cyclictest6575-21sshd00:10:234
10123991411,2cyclictest6575-21sshd00:10:224
1012399140,1cyclictest29836-21bash22:01:594
1012399140,1cyclictest29836-21bash22:01:594
1012399140,1cyclictest18808-21sshd00:02:174
1012399140,1cyclictest0-21swapper/422:58:574
1012399140,13cyclictest22525-21sshd23:08:394
1012399140,13cyclictest22525-21sshd23:08:394
10119991411,2cyclictest1-21systemd22:12:233
1011999140,12cyclictest0-21swapper/321:40:453
1011299142,11cyclictest0-21swapper/220:24:382
10112991411,2cyclictest19072-21sshd22:41:392
1011299140,1cyclictest1-21systemd21:18:082
1011299140,1cyclictest0-21swapper/221:05:132
10106991411,2cyclictest9947-21sshd00:26:301
1010699140,2cyclictest1-21systemd23:54:131
1009999141,3cyclictest101rcu_sched22:45:210
10099991412,1cyclictest7-21ksoftirqd/000:38:410
1009999140,2cyclictest26019-21sshd22:35:510
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional