You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-05 - 01:49

x86 Intel Core i7-3770K @3500 MHz, Linux 5.4.102-rt53 (Profile)

Latency plot of system in rack #c, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h200 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Sun Dec 04, 2022 00:46:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20552672139117,20sleep50-21swapper/519:05:135
20550112118100,16sleep40-21swapper/419:05:134
205585221040,5sleep228-21ksoftirqd/219:05:172
20574019910116,52cyclictest0-21swapper/722:36:527
22662412880,0sleep10-21swapper/123:15:171
2057385998818,43cyclictest49-21ksoftirqd/519:26:525
2057393998716,39cyclictest0-21swapper/600:01:526
2057385998716,40cyclictest0-21swapper/521:16:525
2057349998516,37cyclictest0-21swapper/020:26:520
2057385998416,38cyclictest0-21swapper/500:36:525
2057385998415,39cyclictest0-21swapper/523:46:525
205702128461,11sleep70-21swapper/719:08:137
2057385998315,37cyclictest0-21swapper/519:16:535
23041382820,2sleep335-21ksoftirqd/323:49:313
2057385998215,39cyclictest0-21swapper/523:11:525
205698628259,12sleep10-21swapper/119:07:431
2057349998116,34cyclictest0-21swapper/021:26:520
2057385998015,35cyclictest0-21swapper/522:01:525
2057349997915,36cyclictest0-21swapper/020:01:520
2057349997831,38cyclictest0-21swapper/023:36:520
205688927860,12sleep00-21swapper/019:06:210
205683727861,12sleep60-21swapper/619:05:386
2057401997717,35cyclictest0-21swapper/720:51:527
205701727759,12sleep30-21swapper/319:08:093
23052272760,2sleep549-21ksoftirqd/523:50:135
22704422760,0sleep70-21swapper/723:19:167
2057393997516,40cyclictest0-21swapper/623:01:536
22828562730,0sleep50-21swapper/523:30:195
21702942730,0sleep228-21ksoftirqd/221:49:552
2057385997315,35cyclictest0-21swapper/521:51:525
2057385997215,36cyclictest0-21swapper/500:26:535
23426042700,0sleep70-21swapper/700:23:327
22045052680,0sleep2271rcuc/222:20:152
2057401996816,17cyclictest0-21swapper/722:51:527
2057401996815,18cyclictest0-21swapper/720:41:527
2057401996615,19cyclictest0-21swapper/720:16:527
21954172650,0sleep00-21swapper/022:10:280
2057401995516,12cyclictest0-21swapper/722:11:527
2057349994814,28cyclictest0-21swapper/019:41:520
2057349994614,25cyclictest0-21swapper/022:26:520
2057349994315,24cyclictest0-21swapper/000:11:530
205737299368,12cyclictest2190728-21ssh22:06:533
2057356993416,12cyclictest0-21swapper/119:51:521
2057372993115,15cyclictest0-21swapper/322:16:523
2057401993014,15cyclictest0-21swapper/723:41:527
2057372993014,15cyclictest0-21swapper/323:26:523
2057372993014,15cyclictest0-21swapper/321:01:523
2057356993014,15cyclictest0-21swapper/122:41:521
2057364992913,15cyclictest0-21swapper/221:36:532
2057364992913,15cyclictest0-21swapper/221:36:522
2057364992913,15cyclictest0-21swapper/219:31:522
2057356992913,15cyclictest0-21swapper/122:21:521
2057372992812,15cyclictest0-21swapper/322:56:523
21723822270,1sleep228-21ksoftirqd/221:50:192
2057364992711,15cyclictest0-21swapper/223:56:522
2057356992711,15cyclictest0-21swapper/121:21:531
2057401992610,15cyclictest0-21swapper/721:41:527
2057393992610,15cyclictest0-21swapper/623:51:536
2057393992610,15cyclictest0-21swapper/621:31:536
2057372992610,15cyclictest0-21swapper/320:31:523
2057364992610,15cyclictest0-21swapper/223:06:522
2057356992610,15cyclictest0-21swapper/100:16:521
21547442250,1sleep549-21ksoftirqd/521:35:175
21547442250,1sleep549-21ksoftirqd/521:35:165
205740199259,15cyclictest0-21swapper/721:56:527
205735699259,15cyclictest0-21swapper/120:21:531
205735699259,15cyclictest0-21swapper/100:31:521
205735699259,15cyclictest0-21swapper/100:31:521
20740982240,0sleep20-21swapper/219:35:232
205740199248,15cyclictest0-21swapper/719:11:537
205737299248,15cyclictest0-21swapper/320:46:533
2057401992314,8cyclictest0-21swapper/721:06:527
205739399237,15cyclictest0-21swapper/620:56:526
2057356992311,6cyclictest0-21swapper/122:31:531
205739399226,9cyclictest0-21swapper/620:06:526
205738599226,15cyclictest0-21swapper/519:46:535
23138952210,2sleep549-21ksoftirqd/523:57:185
205739399215,15cyclictest0-21swapper/623:16:526
205739399215,15cyclictest0-21swapper/621:11:526
205737899215,15cyclictest0-21swapper/420:11:524
205737899215,15cyclictest0-21swapper/400:06:524
205739399208,5cyclictest0-21swapper/619:36:526
205738599204,16cyclictest49-21ksoftirqd/520:36:535
205736499204,15cyclictest0-21swapper/219:56:522
205739399193,15cyclictest0-21swapper/621:46:536
22628122180,1sleep335-21ksoftirqd/323:11:023
22214972180,0sleep50-21swapper/522:35:165
205736499182,15cyclictest0-21swapper/219:21:532
215199170,0rtkit-daemon0-21swapper/019:34:590
205740199160,1cyclictest0-21swapper/723:31:527
205739399160,0cyclictest0-21swapper/621:38:106
205739399160,0cyclictest0-21swapper/621:38:106
205734999165,10cyclictest0-21swapper/022:46:520
205734999164,5cyclictest2315702-40updatedb00:00:270
22806782150,0sleep60-21swapper/623:27:476
215199150,1rtkit-daemon818-21earlyoom20:13:390
215199150,1rtkit-daemon2150-21rtkit-daemon23:14:030
215199150,1rtkit-daemon2150-21rtkit-daemon20:28:424
205737899150,15cyclictest2060054-21kworker/4:219:15:004
205735699150,14cyclictest2210567-21sed22:25:161
205734999151,13cyclictest0-21swapper/023:21:520
205740199140,13cyclictest2102491-21dnf20:28:167
205737899140,13cyclictest0-21swapper/421:27:174
205735699140,1cyclictest2152202-21ssh21:32:541
22608932130,2sleep656-21ksoftirqd/623:10:176
215199130,8rtkit-daemon0-21swapper/422:10:124
215199130,0rtkit-daemon0-21swapper/019:48:190
2057401991312,1cyclictest0-21swapper/722:25:217
2057401991312,1cyclictest0-21swapper/722:16:357
205740199130,13cyclictest0-21swapper/722:02:457
205740199130,13cyclictest0-21swapper/721:27:477
205740199130,13cyclictest0-21swapper/700:19:407
205740199130,0cyclictest0-21swapper/719:15:167
205740199130,0cyclictest0-21swapper/700:02:557
2057393991312,1cyclictest0-21swapper/623:45:296
205739399130,13cyclictest2297189-21ssh23:42:246
205739399130,13cyclictest0-21swapper/623:57:126
205739399130,13cyclictest0-21swapper/622:14:466
205739399130,13cyclictest0-21swapper/621:16:226
205739399130,13cyclictest0-21swapper/600:16:246
205739399130,0cyclictest0-21swapper/622:01:356
2057385991313,0cyclictest0-21swapper/523:08:195
205738599130,13cyclictest0-21swapper/523:17:355
205738599130,13cyclictest0-21swapper/522:49:085
205738599130,13cyclictest0-21swapper/522:28:595
205738599130,13cyclictest0-21swapper/522:18:535
205737899130,1cyclictest0-21swapper/422:22:444
205737899130,1cyclictest0-21swapper/421:42:344
205737899130,13cyclictest0-21swapper/423:53:084
205737899130,13cyclictest0-21swapper/422:47:174
205737899130,13cyclictest0-21swapper/422:19:004
205737899130,13cyclictest0-21swapper/400:31:314
205737899130,13cyclictest0-21swapper/400:31:314
2057372991312,1cyclictest0-21swapper/322:48:593
2057372991312,1cyclictest0-21swapper/300:06:033
205737299130,13cyclictest0-21swapper/323:24:453
205737299130,13cyclictest0-21swapper/322:30:073
205737299130,13cyclictest0-21swapper/321:41:403
205737299130,13cyclictest0-21swapper/321:34:023
205737299130,13cyclictest0-21swapper/300:39:043
205736499130,13cyclictest0-21swapper/200:29:152
2057356991312,1cyclictest0-21swapper/123:13:241
2057356991312,1cyclictest0-21swapper/100:00:521
205735699130,13cyclictest0-21swapper/122:39:541
205735699130,13cyclictest0-21swapper/121:53:531
205735699130,13cyclictest0-21swapper/121:48:111
205735699130,0cyclictest0-21swapper/123:36:101
2057349991312,1cyclictest0-21swapper/021:52:310
205734999130,13cyclictest0-21swapper/022:01:580
205734999130,13cyclictest0-21swapper/021:46:500
205734999130,13cyclictest0-21swapper/021:23:150
205734999130,13cyclictest0-21swapper/021:13:000
22465282120,0sleep70-21swapper/722:56:487
21793602120,1sleep335-21ksoftirqd/321:56:373
215199120,1rtkit-daemon845-21in:imjournal19:25:270
215199120,1rtkit-daemon845-21in:imjournal00:15:180
215199120,1rtkit-daemon2150-21rtkit-daemon22:40:474
2057401991212,0cyclictest0-21swapper/722:33:007
2057401991212,0cyclictest0-21swapper/721:45:407
2057401991212,0cyclictest0-21swapper/700:37:147
2057401991212,0cyclictest0-21swapper/700:12:507
2057401991211,1cyclictest0-21swapper/723:53:397
205740199120,0cyclictest0-21swapper/721:52:027
205740199120,0cyclictest0-21swapper/720:35:257
2057393991211,1cyclictest0-21swapper/623:07:566
205739399120,0cyclictest0-21swapper/623:39:186
205739399120,0cyclictest0-21swapper/622:41:546
205739399120,0cyclictest0-21swapper/622:22:546
205739399120,0cyclictest0-21swapper/621:51:306
205739399120,0cyclictest0-21swapper/621:29:526
205739399120,0cyclictest0-21swapper/619:26:386
2057385991212,0cyclictest0-21swapper/523:28:395
2057385991212,0cyclictest0-21swapper/523:23:085
2057385991212,0cyclictest0-21swapper/520:48:095
2057385991212,0cyclictest0-21swapper/520:28:095
2057385991212,0cyclictest0-21swapper/500:24:545
2057385991211,1cyclictest0-21swapper/521:56:185
205738599120,12cyclictest0-21swapper/500:33:415
205738599120,12cyclictest0-21swapper/500:33:415
205738599120,0cyclictest0-21swapper/523:37:165
205738599120,0cyclictest0-21swapper/519:36:365
2057378991212,0cyclictest0-21swapper/422:34:074
2057378991212,0cyclictest0-21swapper/421:48:544
2057378991212,0cyclictest0-21swapper/421:15:444
2057378991212,0cyclictest0-21swapper/419:55:244
2057378991211,1cyclictest0-21swapper/423:56:144
205737899120,0cyclictest0-21swapper/421:11:204
2057372991212,0cyclictest0-21swapper/322:36:283
2057372991212,0cyclictest0-21swapper/321:53:413
205737299120,12cyclictest0-21swapper/323:38:543
205737299120,0cyclictest0-21swapper/323:53:433
205737299120,0cyclictest0-21swapper/323:07:313
205737299120,0cyclictest0-21swapper/322:23:473
205737299120,0cyclictest0-21swapper/321:13:323
205737299120,0cyclictest0-21swapper/320:05:243
2057364991212,0cyclictest0-21swapper/222:28:062
2057364991212,0cyclictest0-21swapper/221:30:132
2057364991212,0cyclictest0-21swapper/221:11:312
2057364991212,0cyclictest0-21swapper/200:34:172
2057364991212,0cyclictest0-21swapper/200:34:172
205736499120,12cyclictest0-21swapper/222:03:032
205736499120,0cyclictest0-21swapper/221:19:192
205736499120,0cyclictest0-21swapper/221:06:102
205736499120,0cyclictest0-21swapper/200:16:142
2057356991212,0cyclictest0-21swapper/123:51:361
2057356991212,0cyclictest0-21swapper/123:45:251
2057356991211,1cyclictest0-21swapper/100:26:531
205735699120,12cyclictest0-21swapper/119:36:101
205735699120,0cyclictest0-21swapper/123:42:201
205735699120,0cyclictest0-21swapper/123:22:001
205735699120,0cyclictest0-21swapper/123:07:131
205735699120,0cyclictest0-21swapper/122:51:081
205735699120,0cyclictest0-21swapper/122:03:571
2057349991212,0cyclictest0-21swapper/023:18:030
2057349991212,0cyclictest0-21swapper/023:06:210
2057349991212,0cyclictest0-21swapper/022:50:540
2057349991212,0cyclictest0-21swapper/022:40:200
2057349991212,0cyclictest0-21swapper/022:06:210
2057349991212,0cyclictest0-21swapper/021:57:340
2057349991212,0cyclictest0-21swapper/000:39:410
205734999120,12cyclictest0-21swapper/023:28:280
205734999120,12cyclictest0-21swapper/021:40:300
205734999120,0cyclictest0-21swapper/000:29:360
205734999120,0cyclictest0-21swapper/000:06:400
215199110,0rtkit-daemon0-21swapper/422:33:330
215199110,0rtkit-daemon0-21swapper/421:15:030
215199110,0rtkit-daemon0-21swapper/421:04:160
215199110,0rtkit-daemon0-21swapper/420:07:040
215199110,0rtkit-daemon0-21swapper/419:56:260
215199110,0rtkit-daemon0-21swapper/419:17:360
215199110,0rtkit-daemon0-21swapper/023:23:164
215199110,0rtkit-daemon0-21swapper/021:07:584
215199110,0rtkit-daemon0-21swapper/020:32:264
215199110,0rtkit-daemon0-21swapper/020:18:464
2057401991111,0cyclictest0-21swapper/723:59:497
2057401991111,0cyclictest0-21swapper/722:40:387
2057401991110,1cyclictest2302834-21ssh23:47:287
2057401991110,1cyclictest0-21swapper/722:07:477
205740199110,4cyclictest0-21swapper/700:09:387
205740199110,11cyclictest0-21swapper/719:49:247
2057393991111,0cyclictest0-21swapper/623:30:426
2057393991111,0cyclictest0-21swapper/622:55:346
2057393991111,0cyclictest0-21swapper/622:36:136
2057393991111,0cyclictest0-21swapper/621:57:116
2057393991111,0cyclictest0-21swapper/620:01:166
2057393991111,0cyclictest0-21swapper/619:16:426
2057393991111,0cyclictest0-21swapper/600:13:176
205739399110,0cyclictest0-21swapper/619:42:526
2057385991111,0cyclictest0-21swapper/522:59:435
2057385991111,0cyclictest0-21swapper/522:23:165
2057385991111,0cyclictest0-21swapper/500:08:495
2057385991110,1cyclictest0-21swapper/521:13:315
2057385991110,1cyclictest0-21swapper/521:06:425
205738599110,5cyclictest581-21systemd-journal22:10:185
205737899111,9cyclictest0-21swapper/421:04:364
2057378991111,0cyclictest0-21swapper/423:38:594
2057378991111,0cyclictest0-21swapper/423:17:324
2057378991111,0cyclictest0-21swapper/420:01:064
205737899110,11cyclictest0-21swapper/419:28:544
205737899110,11cyclictest0-21swapper/419:22:334
2057372991111,0cyclictest0-21swapper/323:59:523
2057372991111,0cyclictest0-21swapper/323:02:003
2057372991111,0cyclictest0-21swapper/322:11:543
2057372991111,0cyclictest0-21swapper/322:03:073
2057372991111,0cyclictest0-21swapper/321:25:433
2057372991111,0cyclictest0-21swapper/300:22:093
2057372991110,1cyclictest0-21swapper/320:55:383
205737299110,11cyclictest0-21swapper/319:35:383
205737299110,11cyclictest0-21swapper/319:20:023
205737299110,0cyclictest0-21swapper/322:52:043
205737299110,0cyclictest0-21swapper/319:31:353
205736499111,9cyclictest0-21swapper/219:29:242
2057364991111,0cyclictest0-21swapper/223:19:392
2057364991111,0cyclictest0-21swapper/223:14:072
2057364991111,0cyclictest0-21swapper/222:59:592
2057364991111,0cyclictest0-21swapper/222:34:262
2057364991111,0cyclictest0-21swapper/222:07:272
205736499110,5cyclictest581-21systemd-journal20:37:202
205736499110,11cyclictest0-21swapper/220:24:412
205736499110,0cyclictest0-21swapper/221:43:332
2057356991111,0cyclictest0-21swapper/123:57:471
2057356991111,0cyclictest0-21swapper/122:48:011
2057356991111,0cyclictest0-21swapper/121:41:501
2057356991111,0cyclictest0-21swapper/121:12:251
205735699110,11cyclictest0-21swapper/119:41:211
2057349991111,0cyclictest0-21swapper/023:51:520
2057349991111,0cyclictest0-21swapper/023:40:100
2057349991111,0cyclictest0-21swapper/022:18:520
2057349991111,0cyclictest0-21swapper/021:33:310
23515162100,1sleep02351518-21threads00:30:290
23515162100,1sleep02351518-21threads00:30:290
215199100,0rtkit-daemon0-21swapper/420:36:150
215199100,0rtkit-daemon0-21swapper/022:51:534
215199100,0rtkit-daemon0-21swapper/021:24:254
215199100,0rtkit-daemon0-21swapper/000:19:014
2057401991010,0cyclictest0-21swapper/723:35:067
2057401991010,0cyclictest0-21swapper/723:23:247
2057401991010,0cyclictest0-21swapper/723:02:257
2057401991010,0cyclictest0-21swapper/720:24:427
205740199100,0cyclictest0-21swapper/720:12:407
205740199100,0cyclictest0-21swapper/719:26:197
2057393991010,0cyclictest0-21swapper/622:45:406
2057393991010,0cyclictest0-21swapper/622:29:136
2057393991010,0cyclictest0-21swapper/620:28:556
2057393991010,0cyclictest0-21swapper/619:46:566
2057393991010,0cyclictest0-21swapper/600:36:236
2057393991010,0cyclictest0-21swapper/600:26:186
205739399100,0cyclictest0-21swapper/619:22:336
205738599109,1cyclictest0-21swapper/523:02:475
2057385991010,0cyclictest0-21swapper/521:44:155
2057385991010,0cyclictest0-21swapper/521:27:025
2057385991010,0cyclictest0-21swapper/520:44:245
2057385991010,0cyclictest0-21swapper/520:24:345
2057385991010,0cyclictest0-21swapper/520:05:525
2057385991010,0cyclictest0-21swapper/500:11:545
205738599100,10cyclictest0-21swapper/520:16:465
205738599100,10cyclictest0-21swapper/519:41:485
2057378991010,0cyclictest0-21swapper/423:00:174
2057378991010,0cyclictest0-21swapper/422:28:254
2057378991010,0cyclictest0-21swapper/421:58:594
2057378991010,0cyclictest0-21swapper/420:47:174
2057378991010,0cyclictest0-21swapper/420:35:054
2057378991010,0cyclictest0-21swapper/420:22:344
2057378991010,0cyclictest0-21swapper/419:44:324
2057378991010,0cyclictest0-21swapper/400:02:244
205737899100,10cyclictest0-21swapper/420:08:064
205737299101,3cyclictest581-21systemd-journal19:55:163
2057372991010,0cyclictest0-21swapper/323:33:233
2057372991010,0cyclictest0-21swapper/300:34:403
2057372991010,0cyclictest0-21swapper/300:34:403
205737299100,10cyclictest0-21swapper/320:01:593
205737299100,10cyclictest0-21swapper/319:51:443
205737299100,0cyclictest0-21swapper/321:09:473
205737299100,0cyclictest0-21swapper/319:14:103
205736499109,1cyclictest0-21swapper/220:48:152
205736499109,1cyclictest0-21swapper/220:40:472
205736499109,1cyclictest0-21swapper/219:15:552
2057364991010,0cyclictest0-21swapper/223:35:352
2057364991010,0cyclictest0-21swapper/222:40:082
2057364991010,0cyclictest0-21swapper/221:20:372
205736499100,10cyclictest0-21swapper/220:15:052
205736499100,0cyclictest0-21swapper/220:57:322
205736499100,0cyclictest0-21swapper/220:51:212
205736499100,0cyclictest0-21swapper/219:46:002
2057356991010,0cyclictest0-21swapper/121:59:341
2057356991010,0cyclictest0-21swapper/121:03:081
2057356991010,0cyclictest0-21swapper/120:33:051
2057356991010,0cyclictest0-21swapper/120:18:061
2057356991010,0cyclictest0-21swapper/119:32:051
2057356991010,0cyclictest0-21swapper/119:12:551
2057356991010,0cyclictest0-21swapper/100:37:371
2057356991010,0cyclictest0-21swapper/100:23:491
2057356991010,0cyclictest0-21swapper/100:13:531
205735699100,0cyclictest0-21swapper/119:48:501
205735699100,0cyclictest0-21swapper/119:18:451
2057349991010,0cyclictest0-21swapper/019:39:110
205734999100,9cyclictest0-21swapper/022:55:240
205734999100,10cyclictest0-21swapper/019:23:340
205734999100,10cyclictest0-21swapper/019:13:390
205734999100,0cyclictest0-21swapper/020:41:290
20574019999,0cyclictest0-21swapper/723:05:317
20574019999,0cyclictest0-21swapper/722:45:017
20574019999,0cyclictest0-21swapper/722:20:577
20574019999,0cyclictest0-21swapper/721:38:037
20574019999,0cyclictest0-21swapper/721:38:027
20574019999,0cyclictest0-21swapper/720:06:017
20574019999,0cyclictest0-21swapper/719:40:487
20574019998,1cyclictest0-21swapper/721:01:187
20574019998,1cyclictest0-21swapper/720:55:067
20573939999,0cyclictest0-21swapper/622:19:086
20573939999,0cyclictest0-21swapper/620:47:466
20573939999,0cyclictest0-21swapper/620:21:066
20573939999,0cyclictest0-21swapper/620:16:536
20573939999,0cyclictest0-21swapper/619:53:176
20573939999,0cyclictest0-21swapper/600:07:076
20573859999,0cyclictest0-21swapper/522:52:525
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional