You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-16 - 05:50

x86 Intel Core i7-3770K @3500 MHz, Linux 5.4.102-rt53 (Profile)

Latency plot of system in rack #c, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h200 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Tue Aug 16, 2022 00:46:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14718682132114,17sleep30-21swapper/319:05:243
1472595210256,11sleep60-21swapper/619:07:206
147258929456,12sleep00-21swapper/019:07:140
147090429374,17sleep20-21swapper/219:05:152
17100742890,1sleep228-21ksoftirqd/223:41:502
1472980998918,39cyclictest0-21swapper/323:11:333
147254428956,11sleep50-21swapper/519:06:395
1472980998817,39cyclictest0-21swapper/322:11:333
1472980998817,38cyclictest0-21swapper/300:21:333
1472980998816,38cyclictest0-21swapper/320:51:333
1472980998617,38cyclictest0-21swapper/300:31:333
17556912830,0sleep00-21swapper/000:24:010
147247228158,11sleep10-21swapper/119:05:381
147277628054,20sleep70-21swapper/719:09:557
147246627963,11sleep40-21swapper/419:05:344
17448122780,0sleep30-21swapper/300:14:193
147299999738,34cyclictest0-21swapper/523:46:335
1472980997216,39cyclictest0-21swapper/321:36:343
1472964997014,39cyclictest0-21swapper/123:56:331
16360072690,0sleep00-21swapper/022:35:150
15894242680,1sleep442-21ksoftirqd/421:53:474
15894242680,1sleep442-21ksoftirqd/421:53:464
147300499664,32cyclictest0-21swapper/622:56:336
1472964996411,48cyclictest21-21ksoftirqd/119:31:331
1472958995815,35cyclictest0-21swapper/019:16:340
1472958995626,30cyclictest0-21swapper/022:46:330
1472958995314,39cyclictest0-21swapper/021:46:330
1472958995215,35cyclictest0-21swapper/020:16:340
1472991995118,33cyclictest0-21swapper/421:11:334
1472958995111,40cyclictest1540330-21diskmemload22:21:330
1472999994215,27cyclictest0-21swapper/500:06:335
1473004994016,13cyclictest0-21swapper/620:01:346
1472999993919,6cyclictest0-21swapper/521:26:335
1472999993914,25cyclictest0-21swapper/522:01:335
1473004993814,24cyclictest0-21swapper/619:51:336
147301299379,16cyclictest1637903-21diskmemload22:36:337
1472999993513,12cyclictest0-21swapper/521:01:335
15792322330,2sleep763-21ksoftirqd/721:45:017
1473004993014,15cyclictest0-21swapper/619:36:336
1472991993014,15cyclictest0-21swapper/422:31:334
1472972993014,15cyclictest0-21swapper/220:11:342
1472958993014,15cyclictest0-21swapper/019:26:340
1473012992913,15cyclictest0-21swapper/723:51:347
1473004992915,6cyclictest0-21swapper/620:26:336
1472999992914,10cyclictest0-21swapper/520:36:335
1472999992913,15cyclictest0-21swapper/500:16:335
1473012992812,15cyclictest0-21swapper/721:51:347
1473012992812,15cyclictest0-21swapper/721:51:337
1473012992812,15cyclictest0-21swapper/720:21:337
1473012992812,15cyclictest0-21swapper/720:21:337
1473012992812,15cyclictest0-21swapper/719:41:347
1472999992812,15cyclictest0-21swapper/523:01:335
1472964992812,15cyclictest0-21swapper/121:16:331
1473012992711,15cyclictest0-21swapper/723:21:337
1472999992710,16cyclictest0-21swapper/523:36:345
17256532260,1sleep71725655-21unixbench-2d23:55:247
1472999992510,15cyclictest0-21swapper/522:41:335
147298099259,15cyclictest0-21swapper/322:26:333
147298099248,15cyclictest0-21swapper/320:06:333
147295899248,15cyclictest0-21swapper/023:16:340
147295899248,15cyclictest0-21swapper/023:16:330
147295899248,15cyclictest0-21swapper/023:06:330
147295899248,15cyclictest0-21swapper/020:56:330
147295899248,15cyclictest0-21swapper/000:26:340
17596512230,0sleep50-21swapper/500:26:305
147301299239,1cyclictest0-21swapper/721:31:337
147301299237,15cyclictest0-21swapper/719:56:337
147300499237,15cyclictest0-21swapper/600:11:336
147296499238,14cyclictest0-21swapper/120:46:341
147301299226,15cyclictest0-21swapper/723:31:337
147300499226,15cyclictest0-21swapper/621:06:336
147300499216,14cyclictest0-21swapper/622:16:336
147300499215,15cyclictest0-21swapper/600:01:336
147298099215,15cyclictest0-21swapper/321:56:333
17342262200,0sleep50-21swapper/500:05:005
17378962190,0sleep30-21swapper/300:07:073
15489042190,0sleep70-21swapper/721:16:007
147300499194,14cyclictest0-21swapper/600:36:336
147298099194,14cyclictest0-21swapper/319:46:333
147295899197,1cyclictest0-21swapper/020:31:330
147301299182,15cyclictest0-21swapper/722:51:337
147295899181,8cyclictest0-21swapper/020:41:330
15499942170,0sleep60-21swapper/621:17:446
15474272170,1sleep51547432-21hwlatdetect21:15:185
215199160,1rtkit-daemon2150-21rtkit-daemon23:56:444
215199160,1rtkit-daemon2150-21rtkit-daemon21:57:480
17258452160,1sleep549-21ksoftirqd/523:55:305
147300499162,11cyclictest0-21swapper/623:26:336
147298099160,4cyclictest0-21swapper/319:11:333
215199150,1rtkit-daemon818-21earlyoom22:09:204
215199150,1rtkit-daemon2150-21rtkit-daemon20:29:110
147299999151,11cyclictest0-21swapper/521:41:335
1472991991512,2cyclictest1526439-21munin-plugin-st20:45:004
215199140,1rtkit-daemon2150-21rtkit-daemon19:15:454
1473012991413,1cyclictest0-21swapper/721:58:557
147299999142,11cyclictest0-21swapper/519:21:335
147299999140,13cyclictest1475204-21unixbench-2d19:10:305
147299199140,13cyclictest0-21swapper/400:24:314
147296499140,1cyclictest0-21swapper/122:42:171
215199130,1rtkit-daemon1708364-21memory23:40:224
215199130,0rtkit-daemon0-21swapper/000:30:014
1473012991313,0cyclictest0-21swapper/723:43:387
147301299130,13cyclictest0-21swapper/723:38:557
147301299130,13cyclictest0-21swapper/722:45:457
147301299130,13cyclictest0-21swapper/722:40:247
147301299130,13cyclictest0-21swapper/722:27:517
147301299130,13cyclictest0-21swapper/722:15:517
147301299130,13cyclictest0-21swapper/700:14:327
147300499131,11cyclictest0-21swapper/621:21:346
147300499130,13cyclictest0-21swapper/623:53:346
147300499130,13cyclictest0-21swapper/623:40:436
147300499130,13cyclictest0-21swapper/622:08:026
147300499130,13cyclictest0-21swapper/621:51:466
147300499130,13cyclictest0-21swapper/621:51:466
147300499130,13cyclictest0-21swapper/600:33:356
147300499130,0cyclictest0-21swapper/621:25:556
1472999991313,0cyclictest0-21swapper/522:06:555
1472999991312,1cyclictest0-21swapper/523:27:245
147299999130,13cyclictest0-21swapper/522:24:385
147299999130,13cyclictest0-21swapper/522:17:005
147299999130,13cyclictest0-21swapper/521:53:255
147299999130,13cyclictest0-21swapper/521:53:255
147299999130,0cyclictest0-21swapper/522:30:395
147299999130,0cyclictest0-21swapper/521:47:155
1472991991312,1cyclictest0-21swapper/423:03:524
1472991991312,1cyclictest0-21swapper/422:52:114
1472991991312,1cyclictest0-21swapper/421:32:104
1472991991312,1cyclictest0-21swapper/421:15:054
147299199130,13cyclictest0-21swapper/422:46:184
147299199130,13cyclictest0-21swapper/422:17:034
147299199130,13cyclictest0-21swapper/421:55:444
147299199130,13cyclictest0-21swapper/421:45:394
147299199130,13cyclictest0-21swapper/400:28:064
147299199130,0cyclictest0-21swapper/423:38:044
1472980991313,0cyclictest0-21swapper/322:51:313
1472980991312,1cyclictest0-21swapper/323:31:513
1472980991312,1cyclictest0-21swapper/323:18:223
1472980991312,1cyclictest0-21swapper/323:18:213
147298099130,13cyclictest0-21swapper/323:45:213
147298099130,13cyclictest0-21swapper/323:42:153
147298099130,13cyclictest0-21swapper/322:31:423
1472972991312,1cyclictest0-21swapper/223:34:062
1472972991312,1cyclictest0-21swapper/200:29:232
147297299130,1cyclictest0-21swapper/222:36:222
147297299130,1cyclictest0-21swapper/222:14:052
147297299130,13cyclictest0-21swapper/221:30:322
1472964991312,1cyclictest0-21swapper/123:32:511
1472964991312,1cyclictest0-21swapper/121:13:301
1472964991312,1cyclictest0-21swapper/100:31:041
1472964991312,1cyclictest0-21swapper/100:14:391
147296499130,13cyclictest0-21swapper/123:35:271
147296499130,13cyclictest0-21swapper/123:12:031
147296499130,13cyclictest0-21swapper/122:49:461
147296499130,13cyclictest0-21swapper/120:00:001
147296499130,13cyclictest0-21swapper/100:24:241
147296499130,0cyclictest0-21swapper/121:42:281
147296499130,0cyclictest0-21swapper/100:05:521
1472958991312,1cyclictest0-21swapper/022:50:110
147295899130,13cyclictest0-21swapper/023:04:000
147295899130,13cyclictest0-21swapper/022:11:390
147295899130,13cyclictest0-21swapper/021:29:320
147295899130,13cyclictest0-21swapper/021:15:530
215199120,1rtkit-daemon845-21in:imjournal22:23:254
215199120,1rtkit-daemon2150-21rtkit-daemon19:51:420
215199120,0rtkit-daemon0-21swapper/400:10:570
215199120,0rtkit-daemon0-21swapper/023:20:434
17208212120,1sleep335-21ksoftirqd/323:51:203
1473012991212,0cyclictest0-21swapper/723:29:017
1473012991211,1cyclictest0-21swapper/722:32:157
1473004991212,0cyclictest0-21swapper/623:30:186
1473004991212,0cyclictest0-21swapper/623:16:496
1473004991212,0cyclictest0-21swapper/623:16:496
1473004991212,0cyclictest0-21swapper/623:04:186
1473004991212,0cyclictest0-21swapper/622:50:186
1473004991212,0cyclictest0-21swapper/622:44:376
1473004991212,0cyclictest0-21swapper/621:35:316
1473004991212,0cyclictest0-21swapper/600:16:106
1473004991212,0cyclictest0-21swapper/600:10:006
147300499120,11cyclictest0-21swapper/620:40:296
147300499120,0cyclictest0-21swapper/622:01:516
147300499120,0cyclictest0-21swapper/621:46:446
1472999991212,0cyclictest0-21swapper/523:24:485
1472999991212,0cyclictest0-21swapper/522:49:315
1472999991212,0cyclictest0-21swapper/522:13:065
1472999991212,0cyclictest0-21swapper/520:10:005
1472999991212,0cyclictest0-21swapper/519:30:005
1472999991212,0cyclictest0-21swapper/500:30:205
1472999991212,0cyclictest0-21swapper/500:13:555
147299999120,0cyclictest0-21swapper/523:52:175
147299999120,0cyclictest0-21swapper/521:31:295
1472991991212,0cyclictest0-21swapper/422:35:354
147299199120,12cyclictest0-21swapper/421:39:294
147299199120,0cyclictest0-21swapper/423:13:184
147299199120,0cyclictest0-21swapper/422:26:194
1472980991212,0cyclictest0-21swapper/323:39:393
1472980991211,1cyclictest0-21swapper/322:57:233
1472980991211,1cyclictest0-21swapper/321:44:313
147298099120,12cyclictest0-21swapper/323:29:153
147298099120,12cyclictest0-21swapper/323:07:273
147298099120,12cyclictest0-21swapper/322:19:103
147298099120,12cyclictest0-21swapper/321:53:283
147298099120,12cyclictest0-21swapper/321:53:283
147298099120,12cyclictest0-21swapper/319:35:153
147298099120,12cyclictest0-21swapper/300:02:443
147298099120,0cyclictest0-21swapper/322:03:333
147298099120,0cyclictest0-21swapper/321:10:323
1472972991212,0cyclictest0-21swapper/222:20:072
147297299120,12cyclictest0-21swapper/223:49:322
147297299120,12cyclictest0-21swapper/223:25:482
147297299120,12cyclictest0-21swapper/222:47:352
147297299120,12cyclictest0-21swapper/221:49:332
147297299120,12cyclictest0-21swapper/221:20:552
147297299120,12cyclictest0-21swapper/221:19:472
147297299120,0cyclictest0-21swapper/200:00:462
147296499120,12cyclictest0-21swapper/120:41:481
147296499120,12cyclictest0-21swapper/100:17:441
147296499120,0cyclictest0-21swapper/122:55:371
1472958991212,0cyclictest0-21swapper/023:45:090
1472958991212,0cyclictest0-21swapper/022:29:130
1472958991211,1cyclictest0-21swapper/021:14:440
147295899120,0cyclictest0-21swapper/021:36:520
147295899120,0cyclictest0-21swapper/000:38:290
215199110,0rtkit-daemon10-21ksoftirqd/021:21:054
215199110,0rtkit-daemon0-21swapper/423:23:290
215199110,0rtkit-daemon0-21swapper/422:00:180
215199110,0rtkit-daemon0-21swapper/421:04:460
215199110,0rtkit-daemon0-21swapper/419:56:100
215199110,0rtkit-daemon0-21swapper/419:45:480
215199110,0rtkit-daemon0-21swapper/419:11:420
215199110,0rtkit-daemon0-21swapper/022:43:274
215199110,0rtkit-daemon0-21swapper/022:42:550
215199110,0rtkit-daemon0-21swapper/019:46:104
1473012991111,0cyclictest0-21swapper/723:00:427
1473012991111,0cyclictest0-21swapper/722:56:587
1473012991111,0cyclictest0-21swapper/722:20:137
1473012991111,0cyclictest0-21swapper/722:09:397
1473012991111,0cyclictest0-21swapper/721:46:337
1473012991111,0cyclictest0-21swapper/700:36:397
1473012991110,1cyclictest0-21swapper/723:46:437
1473012991110,1cyclictest0-21swapper/722:00:037
1473012991110,1cyclictest0-21swapper/721:22:497
1473012991110,1cyclictest0-21swapper/720:53:137
1473012991110,1cyclictest0-21swapper/720:11:457
1473012991110,1cyclictest0-21swapper/719:25:447
147301299110,11cyclictest0-21swapper/719:46:047
147301299110,0cyclictest0-21swapper/719:36:597
1473004991111,0cyclictest0-21swapper/623:35:316
1473004991111,0cyclictest0-21swapper/622:14:126
147300499110,11cyclictest0-21swapper/620:53:046
147300499110,11cyclictest0-21swapper/620:09:106
147300499110,11cyclictest0-21swapper/619:45:456
1472999991111,0cyclictest0-21swapper/523:17:005
1472999991111,0cyclictest0-21swapper/523:17:005
147299999110,11cyclictest0-21swapper/519:49:125
147299999110,11cyclictest0-21swapper/519:43:205
147299999110,0cyclictest0-21swapper/520:20:055
147299999110,0cyclictest0-21swapper/520:20:055
147299199112,5cyclictest42-21ksoftirqd/423:30:274
1472991991111,0cyclictest0-21swapper/400:01:554
147299199110,11cyclictest0-21swapper/421:01:064
147299199110,11cyclictest0-21swapper/420:52:004
1472980991111,0cyclictest0-21swapper/321:49:343
147298099110,11cyclictest0-21swapper/320:18:503
147298099110,11cyclictest0-21swapper/320:02:553
147298099110,0cyclictest0-21swapper/322:20:473
1472972991111,0cyclictest0-21swapper/223:01:542
1472972991111,0cyclictest0-21swapper/222:59:472
1472972991111,0cyclictest0-21swapper/222:16:512
1472972991111,0cyclictest0-21swapper/221:57:212
1472972991111,0cyclictest0-21swapper/221:53:262
1472972991111,0cyclictest0-21swapper/221:53:262
147297299110,1cyclictest0-21swapper/220:32:382
147297299110,11cyclictest0-21swapper/220:48:242
147297299110,11cyclictest0-21swapper/220:38:382
147297299110,0cyclictest0-21swapper/200:21:442
1472964991111,0cyclictest0-21swapper/123:42:461
1472964991111,0cyclictest0-21swapper/122:15:381
1472964991111,0cyclictest0-21swapper/119:50:251
1472964991110,1cyclictest0-21swapper/122:06:331
1472964991110,1cyclictest0-21swapper/100:37:161
147296499110,11cyclictest0-21swapper/120:31:231
1472958991111,0cyclictest0-21swapper/022:56:020
1472958991111,0cyclictest0-21swapper/022:05:290
1472958991111,0cyclictest0-21swapper/021:54:150
1472958991111,0cyclictest0-21swapper/021:54:150
1472958991111,0cyclictest0-21swapper/021:44:100
147295899110,11cyclictest0-21swapper/020:53:160
147295899110,11cyclictest0-21swapper/020:36:310
147295899110,11cyclictest0-21swapper/019:32:080
147295899110,11cyclictest0-21swapper/019:24:400
215199100,0rtkit-daemon0-21swapper/420:46:520
215199100,0rtkit-daemon0-21swapper/020:49:124
215199100,0rtkit-daemon0-21swapper/019:59:284
147301299109,1cyclictest0-21swapper/720:40:137
147301299109,1cyclictest0-21swapper/719:20:227
147301299109,1cyclictest0-21swapper/700:05:457
147301299109,1cyclictest0-21swapper/700:02:397
1473012991010,0cyclictest0-21swapper/723:08:127
1473012991010,0cyclictest0-21swapper/721:39:147
1473012991010,0cyclictest0-21swapper/721:25:077
1473012991010,0cyclictest0-21swapper/700:30:287
1473012991010,0cyclictest0-21swapper/700:23:487
147300499109,1cyclictest836-21nscd22:26:146
147300499101,5cyclictest0-21swapper/622:45:556
1473004991010,0cyclictest0-21swapper/623:46:256
1473004991010,0cyclictest0-21swapper/621:56:486
1473004991010,0cyclictest0-21swapper/620:21:226
1473004991010,0cyclictest0-21swapper/620:21:226
1473004991010,0cyclictest0-21swapper/619:55:506
1473004991010,0cyclictest0-21swapper/619:34:026
147300499100,10cyclictest0-21swapper/620:36:196
147300499100,10cyclictest0-21swapper/620:19:156
147299999109,1cyclictest0-21swapper/523:08:425
147299999109,1cyclictest0-21swapper/520:44:195
147299999102,5cyclictest0-21swapper/521:24:195
1472999991010,0cyclictest0-21swapper/522:29:025
1472999991010,0cyclictest0-21swapper/519:58:475
1472999991010,0cyclictest0-21swapper/519:26:165
1472999991010,0cyclictest0-21swapper/519:18:475
1472999991010,0cyclictest0-21swapper/500:36:315
1472991991010,0cyclictest0-21swapper/423:51:424
1472991991010,0cyclictest0-21swapper/423:15:544
1472991991010,0cyclictest0-21swapper/423:15:544
1472991991010,0cyclictest0-21swapper/422:03:034
1472991991010,0cyclictest0-21swapper/420:12:194
1472991991010,0cyclictest0-21swapper/419:29:434
1472991991010,0cyclictest0-21swapper/400:17:224
147299199100,0cyclictest0-21swapper/420:08:364
147299199100,0cyclictest0-21swapper/419:37:424
1472980991010,0cyclictest0-21swapper/322:49:243
1472980991010,0cyclictest0-21swapper/322:43:333
1472980991010,0cyclictest0-21swapper/322:38:113
1472980991010,0cyclictest0-21swapper/300:39:103
147298099100,10cyclictest0-21swapper/321:09:243
147298099100,0cyclictest0-21swapper/319:33:083
147297299109,1cyclictest0-21swapper/219:58:382
147297299104,5cyclictest1485166-21/usr/sbin/munin19:30:232
1472972991010,0cyclictest0-21swapper/223:53:072
1472972991010,0cyclictest0-21swapper/221:36:412
1472972991010,0cyclictest0-21swapper/220:57:302
1472972991010,0cyclictest0-21swapper/220:08:142
1472972991010,0cyclictest0-21swapper/219:15:042
1472972991010,0cyclictest0-21swapper/219:11:592
147297299100,10cyclictest0-21swapper/219:37:202
147297299100,10cyclictest0-21swapper/219:21:532
147297299100,0cyclictest0-21swapper/220:40:162
147296499108,1cyclictest1559720-21sh21:25:331
147296499108,1cyclictest1506049-21ntp_states20:05:231
1472964991010,0cyclictest0-21swapper/123:45:521
1472964991010,0cyclictest0-21swapper/123:25:041
1472964991010,0cyclictest0-21swapper/123:17:151
1472964991010,0cyclictest0-21swapper/123:17:151
1472964991010,0cyclictest0-21swapper/122:02:071
1472964991010,0cyclictest0-21swapper/121:23:151
1472964991010,0cyclictest0-21swapper/121:00:391
1472964991010,0cyclictest0-21swapper/119:39:121
147296499100,0cyclictest0-21swapper/120:14:581
1472958991010,0cyclictest0-21swapper/023:55:230
1472958991010,0cyclictest0-21swapper/022:19:560
1472958991010,0cyclictest0-21swapper/021:30:400
1472958991010,0cyclictest0-21swapper/020:09:220
1472958991010,0cyclictest0-21swapper/019:40:060
1472958991010,0cyclictest0-21swapper/000:34:540
21519990,0rtkit-daemon0-21swapper/020:29:254
1480835290,2sleep656-21ksoftirqd/619:20:176
14730129999,0cyclictest0-21swapper/721:14:127
14730129999,0cyclictest0-21swapper/719:34:517
14730049999,0cyclictest0-21swapper/623:56:396
14730049999,0cyclictest0-21swapper/619:28:126
14730049999,0cyclictest0-21swapper/619:18:356
14730049999,0cyclictest0-21swapper/600:29:596
14729999999,0cyclictest0-21swapper/521:59:375
14729999999,0cyclictest0-21swapper/519:39:365
14729919999,0cyclictest0-21swapper/421:40:384
14729919999,0cyclictest0-21swapper/420:34:074
14729919999,0cyclictest0-21swapper/420:02:444
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional