You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-08 - 23:56

x86 Intel Core i7-X990 @3467 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #c, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot1.osadl.org (updated Mon Aug 08, 2022 12:48:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3954991050,95rtkit-daemon0-21swapper/507:08:117
1942021050,1sleep100-21swapper/1012:06:392
1737928776,7sleep80-21swapper/807:07:0110
1747028474,7sleep20-21swapper/207:08:184
1756128161,6sleep110-21swapper/1107:09:393
1748428171,7sleep30-21swapper/307:08:325
1742227768,6sleep90-21swapper/907:07:3711
1747427162,6sleep60-21swapper/607:08:228
1741727162,6sleep40-21swapper/407:07:326
47272670,1sleep60-21swapper/612:28:268
1752926756,8sleep70-21swapper/707:09:119
1738426757,7sleep00-21swapper/007:07:040
228082660,0sleep10-21swapper/109:40:261
1738526553,8sleep10-21swapper/107:07:051
1597025950,6sleep100-21swapper/1007:05:262
152512580,1sleep10-21swapper/112:02:071
1803899320,9cyclictest0-21swapper/312:14:445
18067993122,8cyclictest0-21swapper/812:36:0110
18024993027,2cyclictest81rcu_preempt10:04:461
1806799290,27cyclictest105550irq/40-p5p1-TxR10:50:2210
18061992925,3cyclictest0-21swapper/711:59:119
1804399290,28cyclictest0-21swapper/410:49:566
1803899290,27cyclictest0-21swapper/311:48:155
18078992723,3cyclictest0-21swapper/1009:58:312
1807499265,14cyclictest0-21swapper/908:15:0111
1807499265,14cyclictest0-21swapper/908:15:0011
1807499260,3cyclictest0-21swapper/912:18:5611
18061992623,2cyclictest0-21swapper/712:01:469
1803899264,17cyclictest0-21swapper/311:35:005
18024992623,2cyclictest0-21swapper/112:13:421
18074992522,2cyclictest0-21swapper/910:34:1111
18043992521,3cyclictest0-21swapper/411:35:016
1803599253,15cyclictest0-21swapper/210:50:004
18074992420,3cyclictest0-21swapper/911:09:1811
18067992420,3cyclictest0-21swapper/811:10:1210
1806199243,14cyclictest0-21swapper/710:35:009
18061992420,3cyclictest0-21swapper/711:07:109
1803899246,13cyclictest0-21swapper/312:25:015
18038992420,3cyclictest0-21swapper/312:05:565
1806799230,22cyclictest0-21swapper/812:34:3610
1806799230,22cyclictest0-21swapper/811:57:3810
18061992319,3cyclictest0-21swapper/711:44:259
18043992319,3cyclictest0-21swapper/412:19:226
18043992319,3cyclictest0-21swapper/412:03:356
1804399230,22cyclictest0-21swapper/407:44:336
1803899234,13cyclictest0-21swapper/310:45:005
1808499220,21cyclictest0-21swapper/1111:00:143
1807899223,10cyclictest0-21swapper/1008:35:002
1807499220,21cyclictest0-21swapper/910:21:4011
18067992218,3cyclictest0-21swapper/810:32:2410
1806799220,21cyclictest0-21swapper/811:00:4210
18061992218,3cyclictest0-21swapper/712:23:049
18061992218,3cyclictest0-21swapper/710:56:019
18061992218,3cyclictest0-21swapper/710:38:049
18043992218,3cyclictest0-21swapper/411:52:466
18043992218,3cyclictest0-21swapper/411:37:336
18043992218,3cyclictest0-21swapper/411:11:386
1803899224,13cyclictest0-21swapper/309:15:015
18038992218,3cyclictest0-21swapper/312:25:105
18035992218,3cyclictest0-21swapper/211:41:034
1802499224,13cyclictest0-21swapper/111:40:011
18007992218,3cyclictest0-21swapper/012:12:550
18007992218,3cyclictest0-21swapper/010:50:030
1800799220,21cyclictest0-21swapper/008:25:380
18084992117,3cyclictest0-21swapper/1112:04:183
18078992119,1cyclictest11020-1kworker/10:1H09:36:132
1807899210,12cyclictest0-21swapper/1009:45:112
1806799213,13cyclictest0-21swapper/809:25:0210
1806799213,13cyclictest0-21swapper/808:55:0010
18067992117,3cyclictest0-21swapper/811:07:0010
18067992117,3cyclictest0-21swapper/810:56:4610
1806199214,13cyclictest0-21swapper/711:25:019
18061992117,3cyclictest0-21swapper/712:38:259
18061992117,3cyclictest0-21swapper/711:28:449
18054992117,3cyclictest0-21swapper/611:38:228
1805499210,20cyclictest0-21swapper/611:58:208
18043992117,3cyclictest0-21swapper/412:28:456
1804399210,3cyclictest0-21swapper/412:13:156
18038992118,2cyclictest5860-21ssh12:30:225
18038992117,3cyclictest0-21swapper/312:39:065
18038992117,3cyclictest0-21swapper/311:53:065
18024992118,2cyclictest20491-21ssh12:10:001
18024992117,3cyclictest0-21swapper/111:39:321
1800799210,20cyclictest0-21swapper/008:09:330
1800799210,20cyclictest0-21swapper/008:09:320
25012200,5sleep9113-21ksoftirqd/912:25:1811
1808499200,19cyclictest0-21swapper/1110:40:173
18078992017,2cyclictest0-21swapper/1009:17:592
18078992016,3cyclictest0-21swapper/1008:22:492
1807899200,19cyclictest0-21swapper/1010:04:072
1807899200,19cyclictest0-21swapper/1008:13:382
1807899200,19cyclictest0-21swapper/1008:13:382
1806799203,11cyclictest0-21swapper/808:30:0110
1806799200,2cyclictest0-21swapper/810:47:5010
1806199204,11cyclictest0-21swapper/711:50:019
1806199200,19cyclictest0-21swapper/710:40:049
18054992016,3cyclictest0-21swapper/610:54:248
1805499200,19cyclictest0-21swapper/610:41:078
18043992016,3cyclictest0-21swapper/412:34:586
18043992016,3cyclictest0-21swapper/412:07:196
18038992016,3cyclictest0-21swapper/312:17:355
18035992017,2cyclictest0-21swapper/212:27:044
18024992017,2cyclictest0-21swapper/112:24:561
1802499201,18cyclictest0-21swapper/112:37:291
18007992018,2cyclictest0-21swapper/012:27:280
18007992016,3cyclictest0-21swapper/012:31:060
1807899193,10cyclictest0-21swapper/1007:20:012
18078991916,2cyclictest0-21swapper/1008:39:432
18078991915,3cyclictest0-21swapper/1012:29:072
18078991915,3cyclictest0-21swapper/1011:22:512
18078991915,3cyclictest0-21swapper/1010:20:332
1807499194,11cyclictest0-21swapper/909:15:0011
1807499194,10cyclictest0-21swapper/907:15:0011
18074991916,2cyclictest50-21rcuop/310:59:2511
18074991915,3cyclictest0-21swapper/911:12:0811
1807499190,18cyclictest0-21swapper/912:00:4811
1806199194,11cyclictest0-21swapper/709:45:019
1806199194,10cyclictest0-21swapper/707:35:009
1806199193,12cyclictest0-21swapper/708:30:009
1806199193,11cyclictest0-21swapper/707:50:019
18061991915,3cyclictest0-21swapper/712:31:019
18061991915,3cyclictest0-21swapper/712:19:039
18061991915,3cyclictest0-21swapper/711:13:489
1806199191,17cyclictest0-21swapper/712:05:099
18054991915,3cyclictest0-21swapper/610:59:348
18054991915,3cyclictest0-21swapper/610:30:598
1805499190,18cyclictest0-21swapper/612:22:048
18043991915,3cyclictest0-21swapper/411:17:206
18035991915,3cyclictest0-21swapper/212:36:324
1802499191,17cyclictest0-21swapper/111:16:561
18007991916,3cyclictest0-21swapper/012:36:590
18007991915,3cyclictest0-21swapper/012:04:460
1808499180,17cyclictest0-21swapper/1111:25:213
1808499180,17cyclictest0-21swapper/1111:06:443
1808499180,17cyclictest0-21swapper/1110:58:363
1808499180,17cyclictest0-21swapper/1110:50:023
18078991815,2cyclictest102350irq/29-p34p110:56:382
18078991814,3cyclictest0-21swapper/1011:39:522
1807899180,17cyclictest0-21swapper/1011:56:042
1807899180,17cyclictest0-21swapper/1009:53:362
1807899180,17cyclictest0-21swapper/1009:21:242
1807499180,3cyclictest0-21swapper/911:40:1411
1806799184,10cyclictest0-21swapper/807:30:0110
1806799183,11cyclictest0-21swapper/808:20:0110
1806799183,11cyclictest0-21swapper/808:05:0110
18067991814,3cyclictest0-21swapper/812:14:2310
18067991814,3cyclictest0-21swapper/812:02:2310
1806799180,17cyclictest0-21swapper/810:40:0610
1806199184,9cyclictest0-21swapper/708:05:009
1806199183,11cyclictest0-21swapper/710:54:599
1806199183,11cyclictest0-21swapper/709:50:009
1806199180,17cyclictest0-21swapper/711:45:439
18054991814,3cyclictest0-21swapper/611:28:128
1805499180,17cyclictest0-21swapper/612:31:018
1805499180,17cyclictest0-21swapper/611:46:168
1804399183,11cyclictest0-21swapper/410:05:006
1804399183,10cyclictest0-21swapper/408:30:006
1804399180,17cyclictest0-21swapper/411:58:086
1804399180,17cyclictest0-21swapper/410:57:516
1804399180,17cyclictest0-21swapper/410:41:376
1803899183,11cyclictest0-21swapper/309:00:015
18038991814,3cyclictest0-21swapper/312:02:105
1803899180,17cyclictest0-21swapper/311:57:265
1803599183,12cyclictest0-21swapper/210:30:004
1803599183,11cyclictest0-21swapper/209:45:004
18035991814,3cyclictest0-21swapper/212:15:384
1803599180,3cyclictest0-21swapper/212:12:464
1802499180,17cyclictest0-21swapper/112:30:411
1800799188,9cyclictest0-21swapper/011:54:590
18007991814,3cyclictest0-21swapper/012:15:090
7902170,1sleep791-21ksoftirqd/709:54:469
1808499170,16cyclictest0-21swapper/1112:37:563
1807899178,2cyclictest0-21swapper/1009:00:392
1807899173,10cyclictest0-21swapper/1011:50:012
18078991714,2cyclictest102350irq/29-p34p110:10:402
18078991714,2cyclictest0-21swapper/1009:11:312
18078991713,3cyclictest0-21swapper/1012:17:002
1807899170,10cyclictest0-21swapper/1009:26:542
18074991714,2cyclictest1121ktimersoftd/909:15:1511
18074991713,3cyclictest0-21swapper/912:22:0711
1807499171,15cyclictest0-21swapper/911:15:4911
18067991713,3cyclictest0-21swapper/812:20:5010
1806199173,13cyclictest0-21swapper/711:20:009
1806199173,10cyclictest0-21swapper/709:20:019
1806199173,10cyclictest0-21swapper/708:35:019
18061991713,3cyclictest0-21swapper/711:36:159
1806199171,10cyclictest0-21swapper/709:00:009
18054991713,3cyclictest0-21swapper/612:01:058
1805499170,16cyclictest0-21swapper/611:44:528
18049991713,3cyclictest0-21swapper/512:02:437
1804399173,10cyclictest0-21swapper/408:00:016
18043991713,3cyclictest0-21swapper/412:22:336
18043991713,3cyclictest0-21swapper/411:43:356
1803899173,11cyclictest0-21swapper/310:34:595
1803899173,11cyclictest0-21swapper/307:20:015
18038991713,3cyclictest0-21swapper/311:36:245
1803899170,16cyclictest0-21swapper/311:21:235
1803599173,10cyclictest0-21swapper/210:05:014
1803599170,16cyclictest0-21swapper/210:37:194
1802499173,10cyclictest0-21swapper/110:40:001
18007991713,3cyclictest0-21swapper/012:05:450
18007991713,3cyclictest0-21swapper/011:01:200
1800799170,16cyclictest0-21swapper/009:12:520
1808499162,10cyclictest0-21swapper/1110:35:003
18084991613,2cyclictest0-21swapper/1111:12:303
18084991613,2cyclictest0-21swapper/1110:47:053
1808499160,15cyclictest0-21swapper/1112:11:103
18078991612,3cyclictest0-21swapper/1010:48:252
18078991612,3cyclictest0-21swapper/1010:07:522
18078991612,3cyclictest0-21swapper/1007:26:042
18078991612,3cyclictest0-21swapper/1007:13:162
18074991612,3cyclictest0-21swapper/912:35:0911
18074991612,3cyclictest0-21swapper/911:57:5211
1807499160,3cyclictest0-21swapper/911:36:5011
1807499160,15cyclictest0-21swapper/912:31:5011
1807499160,15cyclictest0-21swapper/911:34:4511
1807499160,15cyclictest0-21swapper/910:11:1511
18067991612,3cyclictest0-21swapper/810:03:4110
1806799160,15cyclictest0-21swapper/810:39:3510
18061991612,3cyclictest0-21swapper/712:26:499
18061991612,3cyclictest0-21swapper/710:49:599
18054991613,2cyclictest0-21swapper/611:33:038
18049991613,3cyclictest0-21swapper/512:35:397
18049991613,3cyclictest0-21swapper/511:07:187
18043991613,2cyclictest0-21swapper/411:09:246
18043991612,3cyclictest0-21swapper/411:24:426
18043991612,3cyclictest0-21swapper/410:36:316
18043991612,3cyclictest0-21swapper/410:30:586
18038991612,3cyclictest0-21swapper/311:18:585
1803599161,10cyclictest0-21swapper/209:00:004
1803599160,15cyclictest0-21swapper/212:33:544
1803599160,15cyclictest0-21swapper/211:48:154
1803599160,15cyclictest0-21swapper/211:00:594
1803599160,15cyclictest0-21swapper/210:40:574
18024991614,1cyclictest81rcu_preempt09:54:141
18024991614,1cyclictest50-21rcuop/311:56:511
18024991613,2cyclictest0-21swapper/110:55:351
18024991612,3cyclictest0-21swapper/111:31:031
18024991612,3cyclictest0-21swapper/111:28:391
1802499161,10cyclictest0-21swapper/108:15:011
1802499161,10cyclictest0-21swapper/108:15:001
18007991612,3cyclictest0-21swapper/012:20:430
18007991612,3cyclictest0-21swapper/011:10:520
18007991612,3cyclictest0-21swapper/010:45:300
226482150,0sleep101221rcuc/1011:35:002
1808499151,3cyclictest0-21swapper/1112:26:343
18084991512,2cyclictest0-21swapper/1112:23:453
18084991511,3cyclictest0-21swapper/1112:08:133
18078991512,2cyclictest102350irq/29-p34p111:11:112
18078991512,2cyclictest0-21swapper/1007:56:572
18078991511,3cyclictest0-21swapper/1011:27:002
18078991511,3cyclictest0-21swapper/1011:05:162
1807899150,14cyclictest0-21swapper/1010:36:312
18074991513,1cyclictest19165-21ssh10:51:2911
18074991512,2cyclictest0-21swapper/912:05:5511
18074991511,3cyclictest0-21swapper/911:45:4711
18074991511,3cyclictest0-21swapper/910:36:2811
1807499150,3cyclictest0-21swapper/911:04:4411
1807499150,2cyclictest0-21swapper/912:14:1311
1807499150,14cyclictest0-21swapper/911:54:2811
1807499150,14cyclictest0-21swapper/911:20:3611
1807499150,14cyclictest0-21swapper/910:47:0511
1807499150,14cyclictest0-21swapper/910:40:1111
1806799151,13cyclictest0-21swapper/811:50:1610
18067991511,3cyclictest0-21swapper/811:20:5710
18067991511,3cyclictest0-21swapper/809:30:1510
1806799151,13cyclictest0-21swapper/807:50:1610
1806799150,14cyclictest0-21swapper/812:18:4010
1806799150,14cyclictest0-21swapper/811:15:1710
1806199151,8cyclictest0-21swapper/709:59:599
1806199150,2cyclictest0-21swapper/711:30:459
1805499150,14cyclictest0-21swapper/611:16:418
18049991513,2cyclictest0-21swapper/511:33:257
18049991513,2cyclictest0-21swapper/511:04:267
18049991513,2cyclictest0-21swapper/510:46:427
18049991512,3cyclictest0-21swapper/511:14:287
18049991511,3cyclictest0-21swapper/510:41:497
1804999151,13cyclictest0-21swapper/508:40:227
18043991511,3cyclictest0-21swapper/411:26:086
18043991511,3cyclictest0-21swapper/411:02:396
18043991511,3cyclictest0-21swapper/409:39:076
1803899153,9cyclictest0-21swapper/311:27:075
1803899152,8cyclictest0-21swapper/310:57:385
1803599153,9cyclictest0-21swapper/208:30:004
1803599153,9cyclictest0-21swapper/207:55:004
1803599152,10cyclictest0-21swapper/210:20:004
18035991512,2cyclictest0-21swapper/210:56:234
1803599150,15cyclictest0-21swapper/211:50:224
1803599150,14cyclictest0-21swapper/212:20:194
1803599150,14cyclictest0-21swapper/212:06:414
1803599150,14cyclictest0-21swapper/212:01:234
1803599150,14cyclictest0-21swapper/211:59:564
1803599150,14cyclictest0-21swapper/211:31:534
1803599150,14cyclictest0-21swapper/211:20:494
1803599150,14cyclictest0-21swapper/211:14:034
18024991513,1cyclictest116-21rcuop/910:23:461
18024991511,3cyclictest0-21swapper/111:10:081
18024991511,3cyclictest0-21swapper/110:53:181
18007991511,3cyclictest0-21swapper/011:59:420
18007991511,3cyclictest0-21swapper/008:15:140
18084991411,2cyclictest0-21swapper/1112:30:113
1808499140,2cyclictest0-21swapper/1111:59:023
1808499140,13cyclictest0-21swapper/1111:46:583
18078991411,2cyclictest102350irq/29-p34p110:42:442
18078991411,2cyclictest0-21swapper/1012:31:052
18078991410,3cyclictest0-21swapper/1012:36:212
18078991410,3cyclictest0-21swapper/1012:02:252
18078991410,3cyclictest0-21swapper/1011:16:542
1807899140,13cyclictest0-21swapper/1011:52:092
1807899140,13cyclictest0-21swapper/1008:43:552
1807899140,13cyclictest0-21swapper/1007:47:152
1807499140,13cyclictest0-21swapper/911:25:0411
18067991410,3cyclictest0-21swapper/811:48:0910
1806799140,3cyclictest0-21swapper/811:41:5810
1806799140,3cyclictest0-21swapper/811:31:2410
1806799140,3cyclictest0-21swapper/807:24:2810
1806799140,13cyclictest0-21swapper/808:12:1610
1806799140,13cyclictest0-21swapper/808:12:1510
1806199140,13cyclictest20582-21munin-run09:40:019
1805499143,8cyclictest0-21swapper/611:55:008
1805499141,12cyclictest0-21swapper/610:49:198
18054991410,3cyclictest0-21swapper/612:10:378
1805499140,3cyclictest0-21swapper/611:01:028
1805499140,13cyclictest0-21swapper/612:17:228
1805499140,13cyclictest0-21swapper/612:09:128
1805499140,13cyclictest0-21swapper/607:35:298
1804999149,4cyclictest0-21swapper/512:13:517
1804999142,1cyclictest69-21ksoftirqd/512:25:377
1804999141,12cyclictest0-21swapper/508:15:097
18049991410,3cyclictest0-21swapper/512:17:287
18049991410,3cyclictest0-21swapper/511:19:017
1804999140,13cyclictest0-21swapper/512:30:167
1804999140,13cyclictest0-21swapper/510:58:187
1804999140,13cyclictest0-21swapper/510:53:217
1804999140,13cyclictest0-21swapper/510:08:497
1804999140,13cyclictest0-21swapper/509:34:287
1804999140,13cyclictest0-21swapper/508:34:207
1804399142,11cyclictest0-21swapper/409:30:206
18043991410,3cyclictest0-21swapper/411:45:216
1803899143,8cyclictest0-21swapper/311:08:445
1803899140,13cyclictest0-21swapper/309:57:435
1803899140,13cyclictest0-21swapper/309:04:185
1803599143,9cyclictest0-21swapper/208:15:014
1803599143,9cyclictest0-21swapper/208:15:004
1803599143,8cyclictest0-21swapper/208:10:014
1803599143,8cyclictest0-21swapper/208:10:004
1803599142,9cyclictest0-21swapper/207:40:014
1803599142,8cyclictest0-21swapper/209:55:004
18035991412,1cyclictest5961-21ssh11:15:204
18035991410,3cyclictest0-21swapper/210:30:374
1803599140,13cyclictest0-21swapper/211:35:054
18024991410,4cyclictest0-21swapper/112:15:151
1802499140,13cyclictest0-21swapper/112:26:471
1802499140,13cyclictest0-21swapper/110:09:141
18007991411,3cyclictest0-21swapper/010:31:330
1800799141,10cyclictest0-21swapper/007:46:410
18007991410,3cyclictest0-21swapper/011:35:080
18007991410,3cyclictest0-21swapper/011:29:540
18007991410,3cyclictest0-21swapper/011:20:590
1800799140,5cyclictest0-21swapper/007:58:470
1800799140,13cyclictest0-21swapper/009:43:060
145122140,1sleep20-21swapper/211:25:034
1808499131,9cyclictest0-21swapper/1109:30:013
18084991312,1cyclictest135-21ksoftirqd/1108:37:403
18084991311,2cyclictest0-21swapper/1111:15:403
18084991310,2cyclictest0-21swapper/1110:38:393
18084991310,2cyclictest0-21swapper/1108:00:473
1808499130,2cyclictest0-21swapper/1109:50:323
1808499130,12cyclictest0-21swapper/1111:51:513
1808499130,12cyclictest0-21swapper/1111:22:353
1808499130,12cyclictest0-21swapper/1110:09:593
1808499130,12cyclictest0-21swapper/1109:01:503
1808499130,12cyclictest0-21swapper/1107:21:013
1807899131,3cyclictest0-21swapper/1007:42:402
1807899130,12cyclictest0-21swapper/1011:01:012
1807499130,12cyclictest0-21swapper/910:06:5211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional