You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-22 - 03:41

x86 Intel Core i7-3770K @3500 MHz, Linux 5.4.102-rt53 (Profile)

Latency plot of system in rack #c, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h200 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Wed Mar 22, 2023 00:46:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1910083210359,11sleep00-21swapper/019:06:450
20965012960,0sleep6551rcuc/622:53:196
1910527999420,45cyclictest56-21ksoftirqd/619:47:186
191030629356,11sleep50-21swapper/519:09:565
215199920,77rtkit-daemon0-21swapper/219:06:552
1910527998915,38cyclictest0-21swapper/621:42:186
1910501998817,38cyclictest0-21swapper/322:37:183
1910527998318,38cyclictest0-21swapper/619:57:176
1910527998315,35cyclictest0-21swapper/623:02:176
1910527998015,36cyclictest0-21swapper/620:32:186
1910527998015,34cyclictest0-21swapper/621:17:186
1910479998016,36cyclictest0-21swapper/022:02:170
1910527997916,34cyclictest0-21swapper/620:42:176
191010327957,11sleep10-21swapper/119:07:031
191003327955,12sleep60-21swapper/619:06:036
191000127861,12sleep40-21swapper/419:05:364
190843627760,11sleep70-21swapper/719:05:157
190898427657,12sleep30-21swapper/319:05:193
21912312750,0sleep656-21ksoftirqd/600:17:156
1910527997215,37cyclictest0-21swapper/620:22:176
20516402710,0sleep10-21swapper/122:13:021
21601752690,0sleep10-21swapper/123:50:171
20142352690,2sleep228-21ksoftirqd/221:40:102
1910520996915,38cyclictest0-21swapper/520:57:175
1910501996311,16cyclictest0-21swapper/320:12:173
191049499556,30cyclictest0-21swapper/200:22:172
1910479994915,3cyclictest0-21swapper/019:37:180
1910479994915,3cyclictest0-21swapper/019:37:170
21061162330,1sleep228-21ksoftirqd/223:00:442
1910486993322,11cyclictest21-21ksoftirqd/122:27:171
19974422320,2sleep656-21ksoftirqd/621:25:086
21098722310,0sleep00-21swapper/023:05:160
1910501993115,15cyclictest0-21swapper/323:52:173
21406972300,3sleep010-21ksoftirqd/023:32:220
1910494993014,15cyclictest0-21swapper/221:07:182
1910494993014,15cyclictest0-21swapper/221:07:182
1910527992914,15cyclictest0-21swapper/623:17:176
1910494992913,15cyclictest0-21swapper/222:22:172
1910494992913,15cyclictest0-21swapper/222:12:172
1910494992913,15cyclictest0-21swapper/219:22:172
1910527992812,15cyclictest0-21swapper/619:32:176
1910494992812,15cyclictest0-21swapper/222:52:172
19223352270,0sleep50-21swapper/519:25:255
1910527992711,15cyclictest0-21swapper/621:57:186
1910527992610,15cyclictest0-21swapper/622:32:176
1910527992610,15cyclictest0-21swapper/622:32:176
1910527992610,15cyclictest0-21swapper/620:52:176
191049499259,15cyclictest0-21swapper/223:12:172
1910494992524,1cyclictest0-21swapper/223:27:172
191052799248,15cyclictest0-21swapper/623:42:176
191052099248,15cyclictest0-21swapper/521:12:175
1910511992423,1cyclictest0-21swapper/400:32:174
21577402230,1sleep228-21ksoftirqd/223:47:472
20375322230,1sleep22037534-21fschecks_time22:00:202
191052799237,15cyclictest0-21swapper/600:07:176
191051199238,14cyclictest0-21swapper/422:42:174
191050199237,15cyclictest0-21swapper/323:22:173
191047999237,10cyclictest0-21swapper/021:22:170
21165882220,1sleep32116590-21wc23:10:223
19654002220,0sleep00-21swapper/020:40:240
191049499225,16cyclictest0-21swapper/220:07:172
1910535992120,1cyclictest0-21swapper/721:32:177
191051199218,9cyclictest0-21swapper/423:07:174
191051199218,13cyclictest0-21swapper/423:47:174
191051199217,14cyclictest0-21swapper/419:27:174
1910511992113,8cyclictest0-21swapper/422:07:174
1910511992112,9cyclictest0-21swapper/420:17:184
21760982200,0sleep20-21swapper/200:05:002
21641542200,0sleep40-21swapper/423:54:054
19830822200,0sleep10-21swapper/121:10:371
191052099204,15cyclictest0-21swapper/520:02:185
191051199204,15cyclictest0-21swapper/419:12:174
1910511992013,7cyclictest0-21swapper/420:37:184
191049499205,14cyclictest0-21swapper/200:12:182
21196842190,0sleep60-21swapper/623:14:346
1910535991912,7cyclictest0-21swapper/700:02:187
1910535991911,8cyclictest0-21swapper/720:27:177
1910535991910,9cyclictest0-21swapper/700:27:187
21906232180,0sleep50-21swapper/500:16:175
215199180,1rtkit-daemon2150-21rtkit-daemon22:01:333
21243032180,0sleep40-21swapper/423:18:004
20090112180,0sleep20-21swapper/221:35:132
191053599189,9cyclictest0-21swapper/721:02:177
1910535991814,4cyclictest0-21swapper/722:17:177
1910535991814,4cyclictest0-21swapper/721:52:177
1910535991813,5cyclictest0-21swapper/723:32:177
191050199181,16cyclictest0-21swapper/321:37:183
191048699182,15cyclictest0-21swapper/119:52:181
191051199175,12cyclictest0-21swapper/421:27:184
191051199172,14cyclictest0-21swapper/423:57:174
191051199172,14cyclictest0-21swapper/423:57:174
191050199171,9cyclictest0-21swapper/319:42:173
1910501991713,4cyclictest0-21swapper/322:47:173
191050199171,15cyclictest0-21swapper/321:47:173
191049499173,13cyclictest0-21swapper/223:37:172
215199160,1rtkit-daemon2150-21rtkit-daemon00:27:323
215199160,1rtkit-daemon2150-21rtkit-daemon00:24:133
215199160,1rtkit-daemon2150-21rtkit-daemon00:11:473
19435002160,0sleep5481rcuc/520:05:135
19387972160,0sleep20-21swapper/219:55:182
215199150,1rtkit-daemon2150-21rtkit-daemon23:04:537
215199150,1rtkit-daemon2150-21rtkit-daemon00:03:563
191052799140,7cyclictest0-21swapper/619:17:186
191052099146,5cyclictest0-21swapper/522:45:235
191051199140,1cyclictest0-21swapper/400:38:034
191050199149,0cyclictest0-21swapper/323:46:483
1910501991412,2cyclictest0-21swapper/321:56:053
191050199141,12cyclictest0-21swapper/300:37:173
20976992130,0sleep3341rcuc/322:55:003
1910535991311,1cyclictest0-21swapper/723:16:097
191053599130,13cyclictest0-21swapper/722:21:527
191053599130,13cyclictest0-21swapper/721:56:587
191053599130,0cyclictest0-21swapper/721:48:417
1910527991312,1cyclictest0-21swapper/623:52:546
191052799130,1cyclictest0-21swapper/623:06:156
191052799130,13cyclictest0-21swapper/621:53:536
191052099130,12cyclictest2156439-21ssh23:45:405
191052099130,12cyclictest0-21swapper/521:31:425
191051199130,1cyclictest0-21swapper/423:33:204
191051199130,1cyclictest0-21swapper/421:50:544
191051199130,13cyclictest0-21swapper/423:40:404
191051199130,13cyclictest0-21swapper/423:38:144
191051199130,13cyclictest0-21swapper/421:35:274
191051199130,0cyclictest0-21swapper/421:17:344
191050199134,3cyclictest1960086-21munin-plugin-st20:34:593
1910501991311,2cyclictest0-21swapper/323:55:173
1910501991311,2cyclictest0-21swapper/323:55:163
1910501991311,2cyclictest0-21swapper/323:02:443
1910501991310,3cyclictest0-21swapper/319:51:023
191050199130,13cyclictest0-21swapper/323:27:193
191050199130,13cyclictest0-21swapper/323:16:533
191050199130,13cyclictest0-21swapper/322:42:543
191050199130,13cyclictest0-21swapper/300:19:113
1910494991312,1cyclictest0-21swapper/221:54:112
191049499130,13cyclictest0-21swapper/222:31:452
191049499130,13cyclictest0-21swapper/222:31:442
191049499130,13cyclictest0-21swapper/222:25:252
191049499130,13cyclictest0-21swapper/200:15:092
191049499130,0cyclictest0-21swapper/223:58:342
191049499130,0cyclictest0-21swapper/223:58:342
191049499130,0cyclictest0-21swapper/223:16:282
1910486991312,1cyclictest0-21swapper/100:22:521
1910486991311,1cyclictest0-21swapper/121:28:121
191048699130,13cyclictest0-21swapper/123:16:501
191048699130,13cyclictest0-21swapper/120:25:171
191048699130,13cyclictest0-21swapper/100:05:371
191048699130,0cyclictest0-21swapper/123:24:481
191048699130,0cyclictest0-21swapper/100:35:021
1910479991312,1cyclictest0-21swapper/023:10:420
1910479991312,1cyclictest0-21swapper/022:34:460
1910479991312,1cyclictest0-21swapper/022:34:460
191047999130,13cyclictest0-21swapper/023:26:390
191047999130,13cyclictest0-21swapper/023:16:140
191047999130,13cyclictest0-21swapper/022:42:150
191047999130,12cyclictest0-21swapper/019:15:340
191047999130,0cyclictest0-21swapper/023:52:110
215199120,1rtkit-daemon790-21rpcbind23:09:053
215199120,0rtkit-daemon0-21swapper/722:20:023
215199120,0rtkit-daemon0-21swapper/722:17:283
215199120,0rtkit-daemon0-21swapper/721:44:173
215199120,0rtkit-daemon0-21swapper/620:35:222
215199120,0rtkit-daemon0-21swapper/322:02:447
1910535991212,0cyclictest0-21swapper/723:49:107
1910535991212,0cyclictest0-21swapper/700:34:337
1910535991212,0cyclictest0-21swapper/700:18:367
1910535991212,0cyclictest0-21swapper/700:12:257
191053599120,12cyclictest0-21swapper/720:45:547
191053599120,0cyclictest0-21swapper/719:40:237
1910527991212,0cyclictest0-21swapper/621:22:596
191052799120,12cyclictest0-21swapper/622:15:506
191052799120,12cyclictest0-21swapper/622:13:146
191052799120,12cyclictest0-21swapper/600:36:396
191052799120,0cyclictest0-21swapper/623:20:526
1910520991211,1cyclictest0-21swapper/522:12:305
191052099120,1cyclictest0-21swapper/500:04:515
191052099120,12cyclictest0-21swapper/523:52:515
1910511991212,0cyclictest0-21swapper/423:28:284
1910511991212,0cyclictest0-21swapper/423:03:544
1910511991212,0cyclictest0-21swapper/421:40:394
191051199120,0cyclictest0-21swapper/421:10:054
191051199120,0cyclictest0-21swapper/420:27:094
1910501991212,0cyclictest0-21swapper/322:10:233
1910501991212,0cyclictest0-21swapper/300:34:273
191050199120,0cyclictest0-21swapper/323:41:563
1910494991212,0cyclictest0-21swapper/221:32:142
1910494991212,0cyclictest0-21swapper/221:22:572
1910494991212,0cyclictest0-21swapper/200:34:112
1910494991211,1cyclictest0-21swapper/200:09:372
191049499120,0cyclictest0-21swapper/223:21:592
1910486991212,0cyclictest0-21swapper/122:45:561
1910486991212,0cyclictest0-21swapper/122:34:441
1910486991212,0cyclictest0-21swapper/122:34:431
1910486991212,0cyclictest0-21swapper/119:30:191
1910486991212,0cyclictest0-21swapper/100:32:361
1910486991211,1cyclictest0-21swapper/122:52:461
1910486991211,1cyclictest0-21swapper/122:23:201
1910486991211,1cyclictest0-21swapper/100:27:441
191048699120,0cyclictest0-21swapper/122:42:121
1910479991210,1cyclictest0-21swapper/020:00:180
191047999120,12cyclictest0-21swapper/000:12:200
191047999120,0cyclictest0-21swapper/023:41:160
191047999120,0cyclictest0-21swapper/021:55:260
191047999120,0cyclictest0-21swapper/021:48:250
191047999120,0cyclictest0-21swapper/020:29:340
191047999120,0cyclictest0-21swapper/000:04:220
21587032110,0sleep0111rcuc/023:49:200
215199110,0rtkit-daemon0-21swapper/621:15:042
215199110,0rtkit-daemon0-21swapper/620:24:372
215199110,0rtkit-daemon0-21swapper/323:14:377
215199110,0rtkit-daemon0-21swapper/322:07:327
215199110,0rtkit-daemon0-21swapper/321:40:167
215199110,0rtkit-daemon0-21swapper/300:23:347
215199110,0rtkit-daemon0-21swapper/219:20:576
215199110,0rtkit-daemon0-21swapper/219:11:186
191053599119,1cyclictest0-21swapper/722:35:117
1910535991111,0cyclictest0-21swapper/721:21:127
1910535991111,0cyclictest0-21swapper/720:55:117
1910535991110,1cyclictest0-21swapper/721:27:537
191053599110,11cyclictest0-21swapper/720:34:317
191053599110,11cyclictest0-21swapper/719:50:487
1910527991111,0cyclictest0-21swapper/623:57:086
1910527991111,0cyclictest0-21swapper/623:57:086
1910527991111,0cyclictest0-21swapper/622:49:396
1910527991111,0cyclictest0-21swapper/622:25:276
191052799110,11cyclictest0-21swapper/620:04:466
191052799110,11cyclictest0-21swapper/600:29:596
191052799110,0cyclictest0-21swapper/623:36:396
1910520991111,0cyclictest0-21swapper/523:31:515
1910520991111,0cyclictest0-21swapper/523:05:505
1910520991110,1cyclictest0-21swapper/523:00:585
1910520991110,1cyclictest0-21swapper/522:34:385
1910520991110,1cyclictest0-21swapper/522:34:375
191052099110,11cyclictest0-21swapper/523:23:245
191052099110,11cyclictest0-21swapper/522:37:425
191052099110,11cyclictest0-21swapper/521:52:415
191052099110,11cyclictest0-21swapper/520:36:145
191052099110,11cyclictest0-21swapper/520:24:425
191052099110,11cyclictest0-21swapper/519:15:545
191052099110,0cyclictest0-21swapper/523:27:375
191052099110,0cyclictest0-21swapper/521:23:535
1910511991111,0cyclictest0-21swapper/423:12:324
1910511991111,0cyclictest0-21swapper/422:37:144
1910511991111,0cyclictest0-21swapper/422:32:134
1910511991111,0cyclictest0-21swapper/422:32:124
1910511991111,0cyclictest0-21swapper/421:34:094
1910511991111,0cyclictest0-21swapper/400:23:264
1910511991111,0cyclictest0-21swapper/400:14:484
1910511991110,1cyclictest0-21swapper/419:43:154
191051199110,1cyclictest0-21swapper/420:55:364
191051199110,11cyclictest0-21swapper/421:02:164
191051199110,11cyclictest0-21swapper/420:24:434
191051199110,11cyclictest0-21swapper/420:01:374
191051199110,11cyclictest0-21swapper/419:47:194
191051199110,11cyclictest0-21swapper/419:33:104
1910501991111,0cyclictest0-21swapper/322:30:233
1910501991111,0cyclictest0-21swapper/322:30:233
1910501991111,0cyclictest0-21swapper/321:10:143
191050199110,11cyclictest0-21swapper/319:31:123
1910494991111,0cyclictest0-21swapper/221:45:142
1910494991111,0cyclictest0-21swapper/221:13:312
1910494991111,0cyclictest0-21swapper/219:31:532
191049499110,11cyclictest0-21swapper/220:51:542
191049499110,0cyclictest0-21swapper/221:01:392
191049499110,0cyclictest0-21swapper/219:13:212
1910486991111,0cyclictest0-21swapper/122:04:181
1910486991111,0cyclictest0-21swapper/121:54:041
1910486991111,0cyclictest0-21swapper/121:45:471
1910486991111,0cyclictest0-21swapper/121:20:541
191048699110,11cyclictest0-21swapper/120:15:031
1910479991111,0cyclictest0-21swapper/023:24:120
1910479991111,0cyclictest0-21swapper/023:02:050
1910479991111,0cyclictest0-21swapper/022:24:030
1910479991111,0cyclictest0-21swapper/020:05:300
1910479991111,0cyclictest0-21swapper/019:44:410
191047999110,11cyclictest0-21swapper/020:59:200
191047999110,11cyclictest0-21swapper/019:29:040
191047999110,0cyclictest0-21swapper/020:39:280
215199100,0rtkit-daemon0-21swapper/722:28:123
215199100,0rtkit-daemon0-21swapper/619:49:082
215199100,0rtkit-daemon0-21swapper/323:07:537
215199100,0rtkit-daemon0-21swapper/220:16:396
191053599109,1cyclictest0-21swapper/722:29:297
1910535991010,0cyclictest0-21swapper/723:21:417
1910535991010,0cyclictest0-21swapper/719:32:347
1910535991010,0cyclictest0-21swapper/719:11:457
1910535991010,0cyclictest0-21swapper/700:06:537
191053599100,0cyclictest0-21swapper/720:22:597
191052799109,1cyclictest0-21swapper/623:25:466
191052799109,1cyclictest0-21swapper/622:41:026
1910527991010,0cyclictest0-21swapper/623:32:256
1910527991010,0cyclictest0-21swapper/622:20:236
1910527991010,0cyclictest0-21swapper/621:48:506
1910527991010,0cyclictest0-21swapper/621:10:576
1910527991010,0cyclictest0-21swapper/620:26:156
1910527991010,0cyclictest0-21swapper/620:09:506
191052799100,0cyclictest0-21swapper/620:39:446
191052099109,1cyclictest0-21swapper/500:30:535
191052099109,1cyclictest0-21swapper/500:24:525
191052099105,5cyclictest0-21swapper/519:53:265
191052099105,5cyclictest0-21swapper/519:30:265
191052099105,5cyclictest0-21swapper/500:05:405
1910520991010,0cyclictest0-21swapper/522:23:235
191052099100,0cyclictest0-21swapper/521:02:445
191052099100,0cyclictest0-21swapper/519:37:425
191052099100,0cyclictest0-21swapper/519:37:425
1910511991010,0cyclictest0-21swapper/422:47:494
1910511991010,0cyclictest0-21swapper/422:19:314
1910511991010,0cyclictest0-21swapper/421:57:534
1910511991010,0cyclictest0-21swapper/420:50:054
1910511991010,0cyclictest0-21swapper/400:25:534
1910511991010,0cyclictest0-21swapper/400:09:164
191051199100,6cyclictest0-21swapper/400:17:174
191051199100,0cyclictest0-21swapper/420:08:564
191051199100,0cyclictest0-21swapper/419:37:054
191051199100,0cyclictest0-21swapper/419:37:044
191051199100,0cyclictest0-21swapper/419:20:494
1910501991010,0cyclictest0-21swapper/322:09:443
1910501991010,0cyclictest0-21swapper/320:40:183
1910501991010,0cyclictest0-21swapper/320:09:453
1910501991010,0cyclictest0-21swapper/320:03:343
1910501991010,0cyclictest0-21swapper/319:39:013
1910501991010,0cyclictest0-21swapper/319:39:003
191050199100,0cyclictest0-21swapper/320:55:463
1910494991010,0cyclictest0-21swapper/222:58:352
1910494991010,0cyclictest0-21swapper/222:41:112
1910494991010,0cyclictest0-21swapper/222:37:262
1910494991010,0cyclictest0-21swapper/220:48:492
1910494991010,0cyclictest0-21swapper/220:16:072
1910494991010,0cyclictest0-21swapper/220:04:542
1910494991010,0cyclictest0-21swapper/219:53:312
1910494991010,0cyclictest0-21swapper/200:39:432
191049499100,10cyclictest0-21swapper/219:39:422
191049499100,10cyclictest0-21swapper/219:39:422
191049499100,0cyclictest0-21swapper/220:40:412
1910486991010,0cyclictest0-21swapper/123:05:461
1910486991010,0cyclictest0-21swapper/122:39:061
1910486991010,0cyclictest0-21swapper/121:15:311
1910486991010,0cyclictest0-21swapper/120:58:371
1910486991010,0cyclictest0-21swapper/119:35:221
1910486991010,0cyclictest0-21swapper/119:35:211
1910486991010,0cyclictest0-21swapper/119:19:071
1910486991010,0cyclictest0-21swapper/100:03:101
191048699100,0cyclictest0-21swapper/121:02:511
191048699100,0cyclictest0-21swapper/120:39:261
1910479991010,0cyclictest0-21swapper/022:58:590
1910479991010,0cyclictest0-21swapper/022:46:000
1910479991010,0cyclictest0-21swapper/022:29:430
1910479991010,0cyclictest0-21swapper/021:07:460
1910479991010,0cyclictest0-21swapper/021:07:460
1910479991010,0cyclictest0-21swapper/020:54:270
1910479991010,0cyclictest0-21swapper/020:48:150
1910479991010,0cyclictest0-21swapper/020:32:000
1910479991010,0cyclictest0-21swapper/020:16:430
21519990,3rtkit-daemon0-21swapper/722:40:407
2057253290,0sleep00-21swapper/022:18:050
19105359999,0cyclictest0-21swapper/723:42:317
19105359999,0cyclictest0-21swapper/722:57:377
19105359999,0cyclictest0-21swapper/722:47:047
19105359999,0cyclictest0-21swapper/722:14:427
19105359999,0cyclictest0-21swapper/720:15:117
19105359999,0cyclictest0-21swapper/720:10:097
19105279998,1cyclictest0-21swapper/622:37:586
19105279998,1cyclictest0-21swapper/600:13:346
19105279992,4cyclictest0-21swapper/620:11:086
19105209999,0cyclictest0-21swapper/523:43:535
19105209999,0cyclictest0-21swapper/522:56:055
19105209999,0cyclictest0-21swapper/522:43:155
19105209999,0cyclictest0-21swapper/522:15:065
19105209999,0cyclictest0-21swapper/522:09:545
19105209999,0cyclictest0-21swapper/521:57:035
19105209999,0cyclictest0-21swapper/520:45:415
19105209999,0cyclictest0-21swapper/520:27:085
19105209999,0cyclictest0-21swapper/520:11:125
19105209995,4cyclictest0-21swapper/521:36:385
19105119999,0cyclictest0-21swapper/422:20:104
19105119999,0cyclictest0-21swapper/420:13:594
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional