You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-21 - 04:47

x86 Intel Core i7-X990 @3467 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #c, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot1.osadl.org (updated Tue Mar 21, 2023 00:48:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
390799970,74rtkit-daemon0-21swapper/619:05:308
390799860,72rtkit-daemon0-21swapper/019:08:580
2099727563,8sleep10-21swapper/119:09:251
2092026946,7sleep70-21swapper/719:08:199
1854226948,6sleep110-21swapper/1119:05:103
2084826860,6sleep20-21swapper/219:07:134
101672660,0sleep00-21swapper/022:30:330
2085026555,7sleep40-21swapper/419:07:166
2084326556,6sleep100-21swapper/1019:07:092
2024326557,5sleep30-21swapper/319:05:255
2084226455,6sleep90-21swapper/919:07:0911
2073626253,6sleep50-21swapper/519:05:397
2089325646,7sleep80-21swapper/819:07:5510
293962530,0sleep00-21swapper/021:41:520
301922500,0sleep041ktimersoftd/000:38:130
310752490,1sleep100-21swapper/1000:05:062
2149899304,19cyclictest0-21swapper/220:30:004
2155599290,27cyclictest0-21swapper/1121:59:333
2153899290,28cyclictest0-21swapper/822:01:4610
2149899295,17cyclictest0-21swapper/200:35:014
2155599280,27cyclictest0-21swapper/1122:30:343
2155599280,27cyclictest0-21swapper/1122:26:063
2155599280,27cyclictest0-21swapper/1122:15:453
2155599280,26cyclictest0-21swapper/1122:00:033
2155199280,27cyclictest0-21swapper/1022:00:442
21538992812,15cyclictest0-21swapper/822:21:5810
2155599270,26cyclictest0-21swapper/1122:11:523
2155199270,26cyclictest0-21swapper/1022:19:142
2153899270,26cyclictest0-21swapper/822:29:2110
21516992711,15cyclictest0-21swapper/522:28:297
21516992711,15cyclictest0-21swapper/522:21:317
21510992710,16cyclictest0-21swapper/422:25:376
21538992610,15cyclictest0-21swapper/822:15:3410
2150499265,15cyclictest0-21swapper/300:20:015
2153899250,24cyclictest0-21swapper/822:30:2410
21516992511,14cyclictest0-21swapper/522:12:247
2149899254,16cyclictest0-21swapper/223:10:014
2151699249,14cyclictest0-21swapper/522:18:177
2149899241,15cyclictest0-21swapper/200:00:024
2153899230,22cyclictest0-21swapper/822:09:1410
2151699235,13cyclictest0-21swapper/522:55:017
2151099237,15cyclictest0-21swapper/422:17:016
2149899233,15cyclictest0-21swapper/222:15:014
2149299230,22cyclictest0-21swapper/122:23:331
2149299230,22cyclictest0-21swapper/122:10:551
2154499224,14cyclictest0-21swapper/921:50:0111
2154499224,13cyclictest0-21swapper/919:55:0111
2153899223,13cyclictest0-21swapper/823:20:0210
92162210,2sleep100-21swapper/1000:15:192
2155199213,13cyclictest0-21swapper/1023:05:012
2154499214,13cyclictest0-21swapper/920:45:0011
2154499214,12cyclictest0-21swapper/922:55:0111
2149899214,12cyclictest0-21swapper/219:45:014
2149899213,13cyclictest0-21swapper/221:05:014
2149299210,21cyclictest0-21swapper/122:17:581
2155599204,11cyclictest0-21swapper/1100:00:023
2155199203,12cyclictest0-21swapper/1022:10:012
2154499204,11cyclictest0-21swapper/923:40:0211
2154499204,11cyclictest0-21swapper/923:40:0111
2154499203,12cyclictest0-21swapper/920:50:0111
2151099203,13cyclictest0-21swapper/419:55:016
2151099200,19cyclictest0-21swapper/422:10:116
2150499204,11cyclictest0-21swapper/321:10:015
2150499204,11cyclictest0-21swapper/321:00:015
2149899204,11cyclictest0-21swapper/220:15:014
2154499193,12cyclictest0-21swapper/920:05:0011
2154499193,11cyclictest0-21swapper/922:20:0111
2154499193,11cyclictest0-21swapper/900:20:0211
2154499191,12cyclictest0-21swapper/922:30:0111
2153899193,12cyclictest0-21swapper/821:45:0210
2153899193,11cyclictest0-21swapper/820:05:0110
2151699194,13cyclictest0-21swapper/523:30:027
2151699194,13cyclictest0-21swapper/523:30:017
2151699193,12cyclictest0-21swapper/523:25:027
2151699193,12cyclictest0-21swapper/523:25:017
2151699193,11cyclictest0-21swapper/523:00:027
2151099193,11cyclictest0-21swapper/421:20:016
2149899194,9cyclictest0-21swapper/220:20:004
2155599187,7cyclictest13401-1kworker/11:2H22:25:013
2155599183,11cyclictest0-21swapper/1122:42:053
2155199183,11cyclictest0-21swapper/1022:35:012
2155199183,10cyclictest0-21swapper/1020:25:012
2153899180,17cyclictest0-21swapper/822:13:3410
2153899180,17cyclictest0-21swapper/821:59:4310
21527991811,6cyclictest0-21swapper/722:32:329
2152799181,16cyclictest0-21swapper/722:27:589
2152799181,16cyclictest0-21swapper/722:20:519
2152799181,16cyclictest0-21swapper/722:16:189
2152799181,16cyclictest0-21swapper/722:05:109
2152799181,16cyclictest0-21swapper/721:58:259
2151699183,11cyclictest0-21swapper/520:40:007
2151699183,11cyclictest0-21swapper/519:15:027
2151099183,11cyclictest0-21swapper/421:40:026
2151099183,11cyclictest0-21swapper/420:10:016
2151099180,17cyclictest0-21swapper/422:06:166
2151099180,17cyclictest0-21swapper/422:02:066
2149899184,9cyclictest0-21swapper/223:35:024
2149899184,9cyclictest0-21swapper/223:35:014
2149299184,11cyclictest0-21swapper/100:40:011
2149299183,11cyclictest0-21swapper/123:05:021
2149299180,16cyclictest0-21swapper/122:04:081
2155599170,16cyclictest0-21swapper/1122:07:143
2155199173,10cyclictest0-21swapper/1020:50:002
2155199170,16cyclictest0-21swapper/1022:21:522
2155199170,16cyclictest0-21swapper/1022:11:112
2153899174,10cyclictest0-21swapper/800:10:0110
2152799171,16cyclictest0-21swapper/722:04:169
2152799170,16cyclictest0-21swapper/722:11:089
2152399171,15cyclictest0-21swapper/600:35:358
2151699171,15cyclictest0-21swapper/522:03:137
2151699170,16cyclictest0-21swapper/522:31:567
2151099173,10cyclictest0-21swapper/423:20:026
2151099173,10cyclictest0-21swapper/423:20:016
2151099173,10cyclictest0-21swapper/419:41:496
2151099170,16cyclictest0-21swapper/422:31:536
2150499170,12cyclictest0-21swapper/323:20:025
2149299170,15cyclictest0-21swapper/122:33:561
2155599162,10cyclictest0-21swapper/1121:35:013
2155599162,10cyclictest0-21swapper/1120:40:013
2155199164,9cyclictest0-21swapper/1021:05:012
2155199160,15cyclictest0-21swapper/1022:26:012
2152399160,15cyclictest0-21swapper/600:26:358
2152399160,15cyclictest0-21swapper/600:14:148
2151699160,15cyclictest0-21swapper/522:05:027
2151699160,15cyclictest0-21swapper/521:58:197
2151099160,15cyclictest0-21swapper/422:24:336
2150499162,2cyclictest0-21swapper/300:09:265
2150499161,14cyclictest0-21swapper/300:29:005
2149899164,11cyclictest0-21swapper/221:50:014
2149299163,10cyclictest0-21swapper/120:25:001
2149299163,10cyclictest0-21swapper/119:55:011
2149299163,10cyclictest0-21swapper/119:45:011
2149299160,15cyclictest0-21swapper/122:46:291
2149299160,15cyclictest0-21swapper/122:27:051
2149299160,15cyclictest0-21swapper/122:05:351
390799150,2rtkit-daemon7482-21ssh23:40:001
390799150,2rtkit-daemon7482-21ssh23:40:001
2155599154,8cyclictest0-21swapper/1100:35:013
2155599150,14cyclictest0-21swapper/1121:53:023
2155599150,14cyclictest0-21swapper/1100:03:303
2155199150,14cyclictest0-21swapper/1022:44:552
2155199150,14cyclictest0-21swapper/1022:37:142
2155199150,14cyclictest0-21swapper/1021:59:572
2154499151,9cyclictest0-21swapper/920:25:0011
2154499151,13cyclictest0-21swapper/923:01:1711
21544991511,3cyclictest0-21swapper/922:48:1411
2154499151,13cyclictest0-21swapper/900:39:1011
2153899153,10cyclictest0-21swapper/819:30:0210
2153899152,9cyclictest0-21swapper/821:30:0110
21527991511,3cyclictest0-21swapper/723:59:269
21527991511,3cyclictest0-21swapper/723:29:519
21527991511,3cyclictest0-21swapper/723:29:509
21527991510,3cyclictest0-21swapper/723:00:209
2152399150,14cyclictest0-21swapper/623:58:408
2152399150,14cyclictest0-21swapper/600:30:288
2152399150,14cyclictest0-21swapper/600:17:008
2151099153,11cyclictest0-21swapper/421:30:016
2150499152,10cyclictest0-21swapper/321:45:015
2150499151,13cyclictest0-21swapper/323:04:055
2150499151,13cyclictest0-21swapper/322:05:005
2150499150,14cyclictest0-21swapper/323:57:135
2150499150,14cyclictest0-21swapper/322:41:305
2150499150,14cyclictest0-21swapper/300:32:235
2150499150,14cyclictest0-21swapper/300:12:475
2149899153,11cyclictest0-21swapper/222:25:024
21498991513,1cyclictest7649-21turbostat21:59:554
2149899150,14cyclictest0-21swapper/200:05:034
2149299153,9cyclictest0-21swapper/120:45:011
2149299150,14cyclictest0-21swapper/100:33:321
2155599142,9cyclictest0-21swapper/1123:50:023
21555991410,3cyclictest0-21swapper/1100:22:063
2155599140,13cyclictest0-21swapper/1100:05:363
2155199141,7cyclictest30498-21scp00:05:022
21544991410,3cyclictest0-21swapper/923:34:5911
21544991410,3cyclictest0-21swapper/923:34:5811
21544991410,3cyclictest0-21swapper/923:24:3311
21544991410,3cyclictest0-21swapper/923:24:3211
21544991410,3cyclictest0-21swapper/923:08:0011
21544991410,3cyclictest0-21swapper/922:51:2711
2154499140,13cyclictest0-21swapper/923:56:2011
2154499140,13cyclictest0-21swapper/900:32:0511
2154499140,13cyclictest0-21swapper/900:23:5311
2154499140,13cyclictest0-21swapper/900:10:0911
2154499140,13cyclictest0-21swapper/900:01:4611
2153899143,8cyclictest0-21swapper/823:00:0210
21538991411,2cyclictest102-21ksoftirqd/823:14:5910
2153899140,13cyclictest0-21swapper/821:11:3710
2152799141,12cyclictest0-21swapper/700:10:339
21527991410,3cyclictest0-21swapper/700:29:019
21527991410,3cyclictest0-21swapper/700:17:269
2152799140,13cyclictest0-21swapper/723:53:109
2152799140,13cyclictest0-21swapper/700:30:079
2152799140,13cyclictest0-21swapper/700:09:209
21523991412,2cyclictest0-21swapper/600:21:288
2152399141,12cyclictest0-21swapper/622:56:558
2152399140,2cyclictest0-21swapper/600:05:558
2152399140,14cyclictest0-21swapper/600:03:098
2152399140,13cyclictest0-21swapper/623:45:398
2152399140,13cyclictest0-21swapper/623:42:098
2152399140,13cyclictest0-21swapper/623:42:098
2152399140,13cyclictest0-21swapper/623:39:168
2152399140,13cyclictest0-21swapper/623:39:158
2152399140,13cyclictest0-21swapper/623:02:248
2152399140,13cyclictest0-21swapper/622:31:288
2151699141,8cyclictest0-21swapper/500:25:027
2151099140,13cyclictest0-21swapper/423:57:526
2151099140,13cyclictest0-21swapper/423:40:216
2151099140,13cyclictest0-21swapper/423:40:206
2151099140,13cyclictest0-21swapper/422:54:586
2150499143,8cyclictest0-21swapper/322:20:025
21504991412,2cyclictest0-21swapper/300:21:095
21504991410,3cyclictest0-21swapper/323:23:045
21504991410,3cyclictest0-21swapper/323:23:035
21504991410,3cyclictest0-21swapper/319:10:545
2150499140,2cyclictest0-21swapper/323:38:265
2150499140,2cyclictest0-21swapper/323:38:265
2150499140,13cyclictest30462-21rm00:38:505
2150499140,13cyclictest0-21swapper/323:44:505
2150499140,13cyclictest0-21swapper/323:44:505
2149899141,3cyclictest0-21swapper/200:16:524
21498991410,3cyclictest0-21swapper/223:54:494
21498991410,3cyclictest0-21swapper/223:15:134
2149899140,13cyclictest0-21swapper/223:59:354
2149899140,13cyclictest0-21swapper/220:05:014
2149899140,13cyclictest0-21swapper/200:13:244
2149299142,9cyclictest0-21swapper/119:15:011
21492991411,2cyclictest26101-21turbostat21:40:001
21492991410,3cyclictest0-21swapper/100:12:501
2149299140,13cyclictest0-21swapper/120:08:281
2149299140,13cyclictest0-21swapper/100:01:551
2148599140,13cyclictest0-21swapper/023:57:030
2148599140,13cyclictest0-21swapper/020:55:090
2155599139,3cyclictest0-21swapper/1122:39:513
2155599139,3cyclictest0-21swapper/1100:38:123
2155599136,6cyclictest0-21swapper/1123:17:413
21555991310,2cyclictest0-21swapper/1119:14:563
2155599130,12cyclictest0-21swapper/1123:11:523
2155599130,12cyclictest0-21swapper/1100:25:413
2155599130,12cyclictest0-21swapper/1100:15:593
2155599130,12cyclictest0-21swapper/1100:13:173
2155199130,12cyclictest0-21swapper/1023:56:082
2155199130,12cyclictest0-21swapper/1023:13:112
2154499139,3cyclictest0-21swapper/923:16:3811
2154499139,3cyclictest0-21swapper/922:42:1311
2154499134,8cyclictest0-21swapper/923:50:0211
21544991310,2cyclictest0-21swapper/919:45:0111
2154499130,12cyclictest0-21swapper/922:38:3211
2154499130,12cyclictest0-21swapper/922:30:0611
2154499130,12cyclictest0-21swapper/921:16:2211
2154499130,12cyclictest0-21swapper/919:38:4511
2154499130,12cyclictest0-21swapper/919:26:5011
2154499130,12cyclictest0-21swapper/900:05:3111
2153899139,3cyclictest0-21swapper/800:30:2810
2153899139,3cyclictest0-21swapper/800:17:3810
21538991310,2cyclictest0-21swapper/820:46:5110
2153899130,12cyclictest0-21swapper/823:51:2810
2153899130,12cyclictest0-21swapper/823:43:5810
2153899130,12cyclictest0-21swapper/823:43:5710
2153899130,12cyclictest0-21swapper/823:27:2310
2153899130,12cyclictest0-21swapper/823:27:2210
2153899130,12cyclictest0-21swapper/822:51:1710
2153899130,12cyclictest0-21swapper/821:17:2810
2153899130,12cyclictest0-21swapper/800:20:3310
2153899130,10cyclictest0-21swapper/822:36:0810
2152799139,3cyclictest0-21swapper/722:39:009
2152799139,3cyclictest0-21swapper/700:35:209
2152799139,3cyclictest0-21swapper/700:21:319
2152799131,3cyclictest0-21swapper/722:57:039
2152799130,2cyclictest13530-21fw_conntrack21:25:179
2152799130,12cyclictest0-21swapper/723:37:289
2152799130,12cyclictest0-21swapper/723:37:289
2152799130,12cyclictest0-21swapper/723:18:439
2152799130,12cyclictest0-21swapper/722:46:039
2152799130,12cyclictest0-21swapper/719:20:249
2152399131,11cyclictest0-21swapper/622:10:228
2152399130,3cyclictest0-21swapper/622:52:268
2152399130,3cyclictest0-21swapper/621:05:188
2152399130,12cyclictest0-21swapper/623:34:128
2152399130,12cyclictest0-21swapper/623:34:128
2152399130,12cyclictest0-21swapper/623:05:268
2152399130,12cyclictest0-21swapper/622:49:538
2152399130,12cyclictest0-21swapper/622:37:548
2152399130,12cyclictest0-21swapper/621:57:078
2152399130,12cyclictest0-21swapper/621:30:478
2152399130,12cyclictest0-21swapper/620:30:248
2151699139,3cyclictest0-21swapper/523:03:517
2151699139,3cyclictest0-21swapper/521:35:197
2151699139,3cyclictest0-21swapper/500:05:087
2151699132,10cyclictest0-21swapper/521:30:007
21516991310,2cyclictest0-21swapper/523:44:307
21516991310,2cyclictest0-21swapper/523:44:297
2151699130,3cyclictest0-21swapper/500:35:527
2151699130,12cyclictest0-21swapper/523:57:597
2151699130,12cyclictest0-21swapper/523:54:257
2151099139,3cyclictest0-21swapper/400:27:306
2151099138,4cyclictest0-21swapper/420:40:226
2151099137,5cyclictest0-21swapper/422:56:186
2151099131,11cyclictest0-21swapper/423:02:286
2151099131,11cyclictest0-21swapper/400:05:446
2151099130,3cyclictest0-21swapper/423:36:456
2151099130,3cyclictest0-21swapper/423:36:446
2151099130,12cyclictest0-21swapper/421:01:516
2151099130,12cyclictest0-21swapper/400:16:016
2151099130,12cyclictest0-21swapper/400:01:326
2150499134,7cyclictest0-21swapper/320:35:005
21504991311,2cyclictest0-21swapper/323:52:435
21504991311,2cyclictest0-21swapper/323:47:465
21504991311,2cyclictest0-21swapper/320:45:275
2150499131,11cyclictest0-21swapper/323:07:165
2150499130,13cyclictest0-21swapper/300:02:125
2150499130,12cyclictest0-21swapper/323:29:365
2150499130,12cyclictest0-21swapper/323:29:355
2150499130,12cyclictest0-21swapper/322:35:415
2150499130,12cyclictest0-21swapper/320:00:515
2149899139,3cyclictest0-21swapper/223:38:364
2149899139,3cyclictest0-21swapper/223:38:354
2149899139,3cyclictest0-21swapper/222:42:454
2149899139,3cyclictest0-21swapper/200:27:194
21498991311,2cyclictest0-21swapper/221:30:454
21498991311,2cyclictest0-21swapper/220:45:344
2149899130,3cyclictest0-21swapper/200:21:264
2149899130,2cyclictest0-21swapper/222:54:524
2149899130,12cyclictest0-21swapper/223:25:154
2149899130,12cyclictest0-21swapper/223:25:154
2149899130,12cyclictest0-21swapper/223:22:434
2149899130,12cyclictest0-21swapper/223:22:434
2149899130,12cyclictest0-21swapper/223:02:054
2149899130,12cyclictest0-21swapper/222:12:254
2149899130,12cyclictest0-21swapper/220:03:074
2149899130,12cyclictest0-21swapper/219:32:024
2149899130,12cyclictest0-21swapper/200:31:594
2149299139,3cyclictest0-21swapper/123:22:351
2149299139,3cyclictest0-21swapper/123:22:341
2149299132,7cyclictest106950irq/34-p5p1-TxR23:10:021
21492991311,2cyclictest0-21swapper/123:52:031
2149299130,2cyclictest0-21swapper/100:08:401
2149299130,12cyclictest0-21swapper/123:55:191
2149299130,12cyclictest0-21swapper/100:28:021
2149299130,12cyclictest0-21swapper/100:20:111
2148599139,3cyclictest0-21swapper/022:37:160
2148599139,3cyclictest0-21swapper/000:30:140
21485991311,2cyclictest0-21swapper/022:14:490
21485991311,2cyclictest0-21swapper/000:13:550
21485991310,2cyclictest0-21swapper/019:15:020
2148599130,3cyclictest0-21swapper/023:10:200
2148599130,3cyclictest0-21swapper/000:20:540
2148599130,12cyclictest16610-21ssh23:49:410
2148599130,12cyclictest0-21swapper/023:37:490
2148599130,12cyclictest0-21swapper/023:37:490
2148599130,12cyclictest0-21swapper/023:16:570
2148599130,12cyclictest0-21swapper/021:38:380
2148599130,12cyclictest0-21swapper/020:05:220
2148599130,12cyclictest0-21swapper/019:42:480
2148599130,12cyclictest0-21swapper/000:25:160
2148599130,12cyclictest0-21swapper/000:06:450
2148599130,12cyclictest0-21swapper/000:01:530
86242120,1sleep111341ktimersoftd/1123:40:173
86242120,1sleep111341ktimersoftd/1123:40:163
390799120,1rtkit-daemon0-21swapper/123:40:479
390799120,1rtkit-daemon0-21swapper/123:40:479
316472120,0sleep30-21swapper/323:30:195
316472120,0sleep30-21swapper/323:30:195
2155599129,3cyclictest0-21swapper/1119:30:183
2155599128,3cyclictest0-21swapper/1123:09:123
2155599127,3cyclictest0-21swapper/1120:06:533
21555991210,2cyclictest0-21swapper/1120:55:183
21555991210,2cyclictest0-21swapper/1119:58:483
21555991210,2cyclictest0-21swapper/1119:46:013
21555991210,1cyclictest24939-21ssh23:22:433
21555991210,1cyclictest24939-21ssh23:22:423
2155599120,2cyclictest0-21swapper/1121:14:143
2155599120,11cyclictest0-21swapper/1123:31:333
2155599120,11cyclictest0-21swapper/1123:31:323
2155599120,11cyclictest0-21swapper/1123:26:193
2155599120,11cyclictest0-21swapper/1123:26:183
2155599120,11cyclictest0-21swapper/1121:40:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional