You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-05 - 02:13

x86 Intel Core i7-3632QM @2200 MHz, Linux 4.19.1-rt3 (Profile)

Latency plot of system in rack #6, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack6slot3.osadl.org (updated Mon Dec 05, 2022 00:46:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2575526734,0sleep70-21swapper/719:07:127
2565525934,0sleep10-21swapper/119:05:451
2584725740,0sleep30-21swapper/319:08:293
2393425741,0sleep50-21swapper/519:05:015
2593325336,0sleep40-21swapper/419:09:414
2561425336,0sleep60-21swapper/619:05:276
2583425235,0sleep00-21swapper/019:08:180
2577025134,0sleep20-21swapper/219:07:232
391330,0ktimersoftd/30-21swapper/323:44:343
391330,0ktimersoftd/30-21swapper/323:28:173
391330,0ktimersoftd/30-21swapper/322:57:573
391330,0ktimersoftd/30-21swapper/321:39:553
391330,0ktimersoftd/30-21swapper/321:19:283
391330,0ktimersoftd/30-21swapper/321:14:393
391330,0ktimersoftd/30-21swapper/321:04:593
391330,0ktimersoftd/30-21swapper/320:34:013
391330,0ktimersoftd/30-21swapper/319:38:113
391330,0ktimersoftd/30-21swapper/300:01:313
231330,0ktimersoftd/10-21swapper/100:01:311
391320,0ktimersoftd/325353-21sh21:54:023
391320,0ktimersoftd/30-21swapper/323:48:283
391320,0ktimersoftd/30-21swapper/323:39:443
391320,0ktimersoftd/30-21swapper/323:20:263
391320,0ktimersoftd/30-21swapper/323:10:243
391320,0ktimersoftd/30-21swapper/323:06:393
391320,0ktimersoftd/30-21swapper/322:51:383
391320,0ktimersoftd/30-21swapper/322:46:053
391320,0ktimersoftd/30-21swapper/322:35:573
391320,0ktimersoftd/30-21swapper/321:44:193
391320,0ktimersoftd/30-21swapper/321:29:523
391320,0ktimersoftd/30-21swapper/320:37:413
391320,0ktimersoftd/30-21swapper/320:08:213
391320,0ktimersoftd/30-21swapper/319:10:183
391320,0ktimersoftd/30-21swapper/300:35:393
391320,0ktimersoftd/30-21swapper/300:35:383
391320,0ktimersoftd/30-21swapper/300:22:083
391320,0ktimersoftd/30-21swapper/300:10:253
391320,0ktimersoftd/30-21swapper/300:05:053
231320,0ktimersoftd/16902-21ssh22:47:081
391310,0ktimersoftd/30-21swapper/321:21:233
26294992828,0cyclictest311ktimersoftd/222:19:242
26294992222,0cyclictest311ktimersoftd/221:39:472
26294992120,0cyclictest311ktimersoftd/219:15:142
26294992020,0cyclictest311ktimersoftd/219:52:462
26294992019,0cyclictest311ktimersoftd/200:00:132
26294991919,0cyclictest311ktimersoftd/223:40:162
26294991919,0cyclictest311ktimersoftd/223:27:592
26294991919,0cyclictest311ktimersoftd/221:15:212
26294991919,0cyclictest311ktimersoftd/220:10:212
26294991919,0cyclictest311ktimersoftd/200:20:212
26294991919,0cyclictest311ktimersoftd/200:09:532
26294991918,0cyclictest311ktimersoftd/223:55:122
26294991918,0cyclictest311ktimersoftd/223:30:122
26294991918,0cyclictest311ktimersoftd/220:35:212
26294991818,0cyclictest311ktimersoftd/223:55:002
26294991818,0cyclictest311ktimersoftd/222:26:082
26294991818,0cyclictest311ktimersoftd/222:21:182
26294991818,0cyclictest311ktimersoftd/221:55:132
26294991818,0cyclictest311ktimersoftd/221:50:142
26294991818,0cyclictest311ktimersoftd/221:00:162
26294991818,0cyclictest311ktimersoftd/220:00:122
26294991818,0cyclictest311ktimersoftd/219:30:132
26294991817,0cyclictest311ktimersoftd/222:05:272
26294991717,0cyclictest311ktimersoftd/223:46:262
26294991717,0cyclictest311ktimersoftd/223:36:142
26294991717,0cyclictest311ktimersoftd/223:16:402
26294991717,0cyclictest311ktimersoftd/223:10:242
26294991717,0cyclictest311ktimersoftd/223:05:212
26294991717,0cyclictest311ktimersoftd/222:55:252
26294991717,0cyclictest311ktimersoftd/222:50:172
26294991717,0cyclictest311ktimersoftd/222:35:242
26294991717,0cyclictest311ktimersoftd/222:33:012
26294991717,0cyclictest311ktimersoftd/222:01:232
26294991717,0cyclictest311ktimersoftd/221:30:312
26294991717,0cyclictest311ktimersoftd/221:30:302
26294991717,0cyclictest311ktimersoftd/221:22:242
26294991717,0cyclictest311ktimersoftd/221:11:462
26294991717,0cyclictest311ktimersoftd/221:05:232
26294991717,0cyclictest311ktimersoftd/220:25:212
26294991717,0cyclictest311ktimersoftd/220:20:152
26294991717,0cyclictest311ktimersoftd/220:18:492
26294991717,0cyclictest311ktimersoftd/219:25:152
26294991717,0cyclictest311ktimersoftd/219:10:132
26294991717,0cyclictest311ktimersoftd/200:35:202
26294991717,0cyclictest311ktimersoftd/200:35:202
26294991717,0cyclictest311ktimersoftd/200:25:062
26294991717,0cyclictest311ktimersoftd/200:15:222
26294991716,0cyclictest311ktimersoftd/223:00:212
26294991716,0cyclictest311ktimersoftd/222:13:082
26294991716,0cyclictest311ktimersoftd/220:45:112
26294991716,0cyclictest311ktimersoftd/219:35:222
26294991716,0cyclictest311ktimersoftd/200:30:202
26282991716,0cyclictest9-21ksoftirqd/022:43:300
26294991616,0cyclictest311ktimersoftd/223:20:182
26294991616,0cyclictest311ktimersoftd/222:45:162
26294991616,0cyclictest311ktimersoftd/222:44:212
26294991616,0cyclictest311ktimersoftd/221:40:242
26294991616,0cyclictest311ktimersoftd/220:55:172
26294991616,0cyclictest311ktimersoftd/220:50:152
26294991616,0cyclictest311ktimersoftd/220:30:212
26294991616,0cyclictest311ktimersoftd/219:49:592
26294991616,0cyclictest311ktimersoftd/219:40:192
26294991616,0cyclictest311ktimersoftd/200:11:192
26294991615,0cyclictest311ktimersoftd/221:45:242
26294991615,0cyclictest311ktimersoftd/221:25:172
26294991615,0cyclictest311ktimersoftd/220:05:222
26294991615,0cyclictest311ktimersoftd/219:56:362
26294991615,0cyclictest311ktimersoftd/219:20:192
26282991615,0cyclictest11-21rcuc/022:47:110
26282991615,0cyclictest11-21rcuc/021:32:390
26282991615,0cyclictest11-21rcuc/021:32:390
26282991615,0cyclictest101ktimersoftd/000:30:190
26294991515,0cyclictest311ktimersoftd/220:40:152
26282991515,0cyclictest101ktimersoftd/021:53:270
26282991514,0cyclictest9-21ksoftirqd/021:39:560
26282991514,0cyclictest11-21rcuc/023:44:200
26282991514,0cyclictest11-21rcuc/021:29:150
26282991514,0cyclictest11-21rcuc/021:19:380
26282991514,0cyclictest11-21rcuc/000:18:150
26282991514,0cyclictest101ktimersoftd/022:28:080
26282991414,0cyclictest101ktimersoftd/023:26:110
26282991414,0cyclictest101ktimersoftd/023:21:510
26282991414,0cyclictest101ktimersoftd/022:53:150
26282991414,0cyclictest101ktimersoftd/022:37:390
26282991414,0cyclictest101ktimersoftd/021:20:320
26282991413,0cyclictest9-21ksoftirqd/000:36:410
26282991413,0cyclictest9-21ksoftirqd/000:36:410
26282991413,0cyclictest12-21rcu_preempt00:22:190
26282991413,0cyclictest11-21rcuc/023:39:540
26282991413,0cyclictest11-21rcuc/023:18:270
26282991413,0cyclictest11-21rcuc/000:00:580
26282991413,0cyclictest101ktimersoftd/023:53:040
26282991413,0cyclictest101ktimersoftd/023:32:020
26282991413,0cyclictest101ktimersoftd/021:12:440
26282991313,0cyclictest101ktimersoftd/023:55:390
26282991313,0cyclictest101ktimersoftd/023:12:200
26282991313,0cyclictest101ktimersoftd/022:57:360
26282991313,0cyclictest101ktimersoftd/022:10:480
26282991313,0cyclictest101ktimersoftd/022:01:160
26282991313,0cyclictest101ktimersoftd/021:55:110
26282991313,0cyclictest101ktimersoftd/021:40:280
26282991313,0cyclictest101ktimersoftd/021:06:390
26282991313,0cyclictest101ktimersoftd/020:32:510
26282991313,0cyclictest101ktimersoftd/020:23:190
26282991313,0cyclictest101ktimersoftd/019:49:310
26282991313,0cyclictest101ktimersoftd/019:37:240
26282991313,0cyclictest101ktimersoftd/019:34:480
26282991313,0cyclictest101ktimersoftd/019:25:160
26282991312,0cyclictest11-21rcuc/023:49:330
26282991312,0cyclictest11-21rcuc/019:17:450
26282991312,0cyclictest101ktimersoftd/022:06:280
26282991212,0cyclictest9-21ksoftirqd/023:06:290
26282991212,0cyclictest101ktimersoftd/023:04:320
26282991212,0cyclictest101ktimersoftd/022:32:270
26282991212,0cyclictest101ktimersoftd/022:22:550
26282991212,0cyclictest101ktimersoftd/022:16:520
26282991212,0cyclictest101ktimersoftd/020:53:400
26282991212,0cyclictest101ktimersoftd/020:45:520
26282991212,0cyclictest101ktimersoftd/020:42:240
26282991212,0cyclictest101ktimersoftd/020:29:230
26282991212,0cyclictest101ktimersoftd/020:15:320
26282991212,0cyclictest101ktimersoftd/020:10:200
26282991212,0cyclictest101ktimersoftd/020:07:440
26282991212,0cyclictest101ktimersoftd/020:03:230
26282991212,0cyclictest101ktimersoftd/019:51:150
26282991212,0cyclictest101ktimersoftd/019:41:430
26282991212,0cyclictest101ktimersoftd/019:20:560
26282991212,0cyclictest101ktimersoftd/019:10:310
26282991212,0cyclictest101ktimersoftd/000:13:000
26282991212,0cyclictest101ktimersoftd/000:09:320
26282991111,0cyclictest101ktimersoftd/021:48:160
26282991111,0cyclictest101ktimersoftd/021:04:030
26282991111,0cyclictest101ktimersoftd/020:58:510
26282991111,0cyclictest101ktimersoftd/000:28:350
71180,0ktimersoftd/70-21swapper/700:35:287
71180,0ktimersoftd/70-21swapper/700:35:277
71180,0ktimersoftd/70-21swapper/700:15:287
55180,0ktimersoftd/50-21swapper/500:15:285
262889988,0cyclictest0-21swapper/122:00:201
262889980,0cyclictest0-21swapper/119:15:471
23180,0ktimersoftd/10-21swapper/100:35:271
23180,0ktimersoftd/10-21swapper/100:35:271
23180,0ktimersoftd/10-21swapper/100:15:291
199985080,0irq/32-enp2s0f00-21swapper/400:10:414
199955080,0irq/30-enp2s0f031724-21sed23:55:015
199955080,0irq/30-enp2s0f029695-21/usr/sbin/munin21:20:195
199955080,0irq/30-enp2s0f025327-21df00:25:135
199955080,0irq/30-enp2s0f00-21swapper/522:51:465
199955080,0irq/30-enp2s0f00-21swapper/522:08:565
63170,0ktimersoftd/619372-21diskmemload22:11:006
63170,0ktimersoftd/60-21swapper/623:26:226
609970,0migration/63105-21cpuspeed_turbos20:35:156
529970,0migration/520230-21gltestperf22:25:165
47170,0ktimersoftd/40-21swapper/423:26:234
39170,0ktimersoftd/30-21swapper/300:15:293
263249975,0cyclictest22630-21ssh23:44:347
263179976,0cyclictest238662sleep621:50:446
263179976,0cyclictest0-21swapper/621:35:176
263179976,0cyclictest0-21swapper/600:04:366
263179970,0cyclictest0-21swapper/623:33:456
263179970,0cyclictest0-21swapper/622:36:366
263179970,0cyclictest0-21swapper/622:31:206
263179970,0cyclictest0-21swapper/621:47:416
263119970,0cyclictest0-21swapper/519:27:095
263069976,0cyclictest0-21swapper/421:26:554
263069970,0cyclictest0-21swapper/422:39:544
263069970,0cyclictest0-21swapper/421:22:544
263009975,0cyclictest32465-21grep23:55:143
23170,0ktimersoftd/10-21swapper/122:58:591
209970,0migration/112028-21taskset22:54:081
199985070,0irq/32-enp2s0f04132-21forks00:00:144
199985070,0irq/32-enp2s0f00-21swapper/423:50:054
199985070,0irq/32-enp2s0f00-21swapper/423:02:344
199985070,0irq/32-enp2s0f00-21swapper/422:25:164
199985070,0irq/32-enp2s0f00-21swapper/421:51:524
199975070,0irq/31-enp2s0f031944-21taskset00:32:391
199975070,0irq/31-enp2s0f029172-21rm23:14:101
199975070,0irq/31-enp2s0f026141-21sed21:55:011
199975070,0irq/31-enp2s0f025616-21taskset21:54:371
199975070,0irq/31-enp2s0f00-21swapper/122:21:061
199975070,0irq/31-enp2s0f00-21swapper/122:19:101
199975070,0irq/31-enp2s0f00-21swapper/122:10:181
199975070,0irq/31-enp2s0f00-21swapper/122:08:451
199975070,0irq/31-enp2s0f00-21swapper/121:30:431
199975070,0irq/31-enp2s0f00-21swapper/121:30:431
199955070,0irq/30-enp2s0f018308-21sed21:45:145
199955070,0irq/30-enp2s0f00-21swapper/523:45:125
199955070,0irq/30-enp2s0f00-21swapper/523:40:135
199955070,0irq/30-enp2s0f00-21swapper/523:35:545
199955070,0irq/30-enp2s0f00-21swapper/523:33:185
199955070,0irq/30-enp2s0f00-21swapper/523:26:245
199955070,0irq/30-enp2s0f00-21swapper/523:23:595
199955070,0irq/30-enp2s0f00-21swapper/523:15:225
199955070,0irq/30-enp2s0f00-21swapper/523:13:365
199955070,0irq/30-enp2s0f00-21swapper/523:05:205
199955070,0irq/30-enp2s0f00-21swapper/523:03:435
199955070,0irq/30-enp2s0f00-21swapper/522:58:245
199955070,0irq/30-enp2s0f00-21swapper/522:40:235
199955070,0irq/30-enp2s0f00-21swapper/522:35:135
199955070,0irq/30-enp2s0f00-21swapper/522:30:175
199955070,0irq/30-enp2s0f00-21swapper/522:21:525
199955070,0irq/30-enp2s0f00-21swapper/522:15:135
199955070,0irq/30-enp2s0f00-21swapper/522:13:075
199955070,0irq/30-enp2s0f00-21swapper/522:02:085
199955070,0irq/30-enp2s0f00-21swapper/521:57:375
199955070,0irq/30-enp2s0f00-21swapper/521:53:255
199955070,0irq/30-enp2s0f00-21swapper/521:40:145
199955070,0irq/30-enp2s0f00-21swapper/521:34:185
199955070,0irq/30-enp2s0f00-21swapper/521:34:175
199955070,0irq/30-enp2s0f00-21swapper/521:29:575
199955070,0irq/30-enp2s0f00-21swapper/500:30:345
199955070,0irq/30-enp2s0f00-21swapper/500:20:575
199955070,0irq/30-enp2s0f00-21swapper/500:12:405
199955070,0irq/30-enp2s0f00-21swapper/500:01:125
199945070,0irq/29-enp2s0f04109-21df_inode00:00:137
199945070,0irq/29-enp2s0f00-21swapper/722:24:267
199945070,0irq/29-enp2s0f00-21swapper/700:27:277
199935070,0irq/28-enp2s0f08583-21ssh22:10:343
199935070,0irq/28-enp2s0f04897-21ssh22:06:513
199935070,0irq/28-enp2s0f029774-21ssh23:51:273
199935070,0irq/28-enp2s0f027795-21ssh00:27:483
199935070,0irq/28-enp2s0f00-21swapper/322:33:363
199935070,0irq/28-enp2s0f00-21swapper/322:18:583
199935070,0irq/28-enp2s0f00-21swapper/322:01:303
199935070,0irq/28-enp2s0f00-21swapper/321:50:013
71160,0ktimersoftd/70-21swapper/722:05:227
71160,0ktimersoftd/70-21swapper/721:00:097
71160,0ktimersoftd/70-21swapper/720:57:347
71160,0ktimersoftd/70-21swapper/720:06:207
71160,0ktimersoftd/70-21swapper/719:11:177
689960,0migration/732614-21cpuspeed_turbos22:40:147
689960,0migration/715572-21taskset19:50:547
63160,0ktimersoftd/619940-21ssh23:02:416
63160,0ktimersoftd/60-21swapper/623:56:316
63160,0ktimersoftd/60-21swapper/623:22:386
63160,0ktimersoftd/60-21swapper/622:01:056
63160,0ktimersoftd/60-21swapper/621:00:086
63160,0ktimersoftd/60-21swapper/619:55:536
63160,0ktimersoftd/60-21swapper/619:11:166
609960,0migration/618757-21sh22:24:116
609960,0migration/613696-21cstates21:40:146
529960,0migration/59711-21taskset20:48:525
47160,0ktimersoftd/40-21swapper/423:43:334
263249965,0cyclictest30447-21ntp_states00:30:227
263249965,0cyclictest28893-21/usr/sbin/munin20:20:177
263249960,0cyclictest0-21swapper/723:36:387
263249960,0cyclictest0-21swapper/723:25:557
263249960,0cyclictest0-21swapper/723:00:277
263249960,0cyclictest0-21swapper/722:47:067
263249960,0cyclictest0-21swapper/722:31:317
263249960,0cyclictest0-21swapper/721:25:197
263249960,0cyclictest0-21swapper/721:24:527
263249960,0cyclictest0-21swapper/720:46:017
263249960,0cyclictest0-21swapper/720:36:307
263249960,0cyclictest0-21swapper/719:37:507
263249960,0cyclictest0-21swapper/719:31:107
263249960,0cyclictest0-21swapper/719:28:427
263249960,0cyclictest0-21swapper/719:16:047
263179966,0cyclictest0-21swapper/622:05:236
263179966,0cyclictest0-21swapper/621:26:276
263179966,0cyclictest0-21swapper/621:21:316
263179966,0cyclictest0-21swapper/600:10:186
263179965,0cyclictest0-21swapper/622:55:576
263179964,0cyclictest831-21runrttasks00:34:156
263179964,0cyclictest549-21systemd-journal23:50:006
263179964,0cyclictest27807-21sh23:11:036
263179964,0cyclictest19372-21diskmemload22:48:276
263179960,0cyclictest13707-21ssh22:17:286
263179960,0cyclictest0-21swapper/623:19:446
263179960,0cyclictest0-21swapper/600:05:526
263069966,0cyclictest0-21swapper/422:54:054
263069966,0cyclictest0-21swapper/421:15:194
263069966,0cyclictest0-21swapper/420:33:144
263069965,0cyclictest0-21swapper/421:38:584
263069965,0cyclictest0-21swapper/400:30:284
263069964,0cyclictest831-21runrttasks19:57:274
263069964,0cyclictest30196-21cstates23:15:134
263069964,0cyclictest19372-21diskmemload00:18:574
263069960,0cyclictest0-21swapper/422:22:164
263009964,0cyclictest32583-21hwlatdetect19:20:173
262889966,0cyclictest0-21swapper/119:47:561
262889965,0cyclictest15280-21sh21:40:541
262889964,0cyclictest32254-21ssh23:16:281
262889964,0cyclictest20937-21sh21:48:491
262889960,0cyclictest0-21swapper/123:51:381
262889960,0cyclictest0-21swapper/123:30:021
262889960,0cyclictest0-21swapper/120:53:411
262889960,0cyclictest0-21swapper/120:49:191
262889960,0cyclictest0-21swapper/120:30:491
23160,0ktimersoftd/10-21swapper/123:26:231
23160,0ktimersoftd/10-21swapper/121:36:551
209960,0migration/129250-21if_wlp3s021:20:161
209960,0migration/118118-21taskset19:58:051
199985060,0irq/32-enp2s0f09619-21timerwakeupswit00:05:264
199985060,0irq/32-enp2s0f00-21swapper/423:47:534
199985060,0irq/32-enp2s0f00-21swapper/423:36:274
199985060,0irq/32-enp2s0f00-21swapper/423:30:164
199985060,0irq/32-enp2s0f00-21swapper/423:20:024
199985060,0irq/32-enp2s0f00-21swapper/423:12:074
199985060,0irq/32-enp2s0f00-21swapper/423:05:344
199985060,0irq/32-enp2s0f00-21swapper/422:56:494
199985060,0irq/32-enp2s0f00-21swapper/422:43:364
199985060,0irq/32-enp2s0f00-21swapper/422:13:574
199985060,0irq/32-enp2s0f00-21swapper/422:07:514
199985060,0irq/32-enp2s0f00-21swapper/422:04:104
199985060,0irq/32-enp2s0f00-21swapper/421:57:074
199985060,0irq/32-enp2s0f00-21swapper/421:48:164
199985060,0irq/32-enp2s0f00-21swapper/421:33:064
199985060,0irq/32-enp2s0f00-21swapper/421:33:064
199985060,0irq/32-enp2s0f00-21swapper/400:36:254
199985060,0irq/32-enp2s0f00-21swapper/400:36:244
199985060,0irq/32-enp2s0f00-21swapper/400:26:134
199985060,0irq/32-enp2s0f00-21swapper/400:20:224
199975060,0irq/31-enp2s0f00-21swapper/123:56:481
199975060,0irq/31-enp2s0f00-21swapper/123:40:151
199975060,0irq/31-enp2s0f00-21swapper/123:38:071
199975060,0irq/31-enp2s0f00-21swapper/123:20:191
199975060,0irq/31-enp2s0f00-21swapper/123:05:341
199975060,0irq/31-enp2s0f00-21swapper/123:00:531
199975060,0irq/31-enp2s0f00-21swapper/122:44:531
199975060,0irq/31-enp2s0f00-21swapper/122:33:551
199975060,0irq/31-enp2s0f00-21swapper/122:27:451
199975060,0irq/31-enp2s0f00-21swapper/121:25:461
199975060,0irq/31-enp2s0f00-21swapper/121:17:031
199975060,0irq/31-enp2s0f00-21swapper/100:25:251
199955060,0irq/30-enp2s0f026510-21cpuspeed_turbos19:10:135
199955060,0irq/30-enp2s0f00-21swapper/523:50:245
199955060,0irq/30-enp2s0f00-21swapper/522:45:285
199955060,0irq/30-enp2s0f00-21swapper/521:36:555
199955060,0irq/30-enp2s0f00-21swapper/521:15:025
199955060,0irq/30-enp2s0f00-21swapper/521:10:035
199955060,0irq/30-enp2s0f00-21swapper/500:35:085
199955060,0irq/30-enp2s0f00-21swapper/500:35:085
199955060,0irq/30-enp2s0f00-21swapper/500:05:245
199945060,0irq/29-enp2s0f0284512chrt23:12:327
199945060,0irq/29-enp2s0f00-21swapper/723:55:127
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional