You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-04-02 - 11:25

x86 Intel Core i9-9900K @3600 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot4.osadl.org (updated Sun Apr 02, 2023 00:45:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24753642379361,10sleep30-21swapper/319:05:379
24754032363357,3sleep50-21swapper/519:06:1111
24754882362341,12sleep40-21swapper/419:07:1410
24754592361342,10sleep20-21swapper/219:06:568
24754992358340,9sleep150-21swapper/1519:07:257
24754962356338,10sleep120-21swapper/1219:07:224
24754902356339,8sleep60-21swapper/619:07:1712
24754642356335,12sleep70-21swapper/719:07:0213
24754972355335,11sleep130-21swapper/1319:07:245
24754942353334,9sleep100-21swapper/1019:07:202
24754122348308,11sleep80-21swapper/819:06:1414
24753752337319,10sleep140-21swapper/1419:05:496
24756102335317,10sleep110-21swapper/1119:08:583
24753792335316,11sleep10-21swapper/119:05:511
24754212334315,10sleep00-21swapper/019:06:220
24753892334316,10sleep90-21swapper/919:05:5915
247611899475,21cyclictest0-21swapper/1420:19:096
247612199349,25cyclictest0-21swapper/1519:47:147
247612199328,11cyclictest0-21swapper/1520:53:097
247612199328,11cyclictest0-21swapper/1519:14:177
247609199299,20cyclictest0-21swapper/720:49:2013
247607899254,0cyclictest0-21swapper/420:49:1910
247612199239,14cyclictest0-21swapper/1522:42:597
247606799230,13cyclictest0-21swapper/120:35:581
247612199229,0cyclictest0-21swapper/1521:48:047
247608699220,22cyclictest0-21swapper/619:25:2312
247612199218,0cyclictest0-21swapper/1523:26:537
247612199209,11cyclictest0-21swapper/1523:59:517
247612199209,11cyclictest0-21swapper/1523:48:527
247612199209,11cyclictest0-21swapper/1523:37:537
247612199209,11cyclictest0-21swapper/1523:04:557
247612199209,11cyclictest0-21swapper/1522:53:577
247612199209,11cyclictest0-21swapper/1522:31:597
247612199209,11cyclictest0-21swapper/1522:21:017
247612199209,11cyclictest0-21swapper/1522:10:027
247612199209,11cyclictest0-21swapper/1521:59:027
247612199209,11cyclictest0-21swapper/1521:26:067
247612199209,11cyclictest0-21swapper/1521:15:077
247612199209,11cyclictest0-21swapper/1521:04:077
247612199209,11cyclictest0-21swapper/1520:31:107
247612199209,11cyclictest0-21swapper/1520:20:127
247612199209,11cyclictest0-21swapper/1520:09:127
247612199209,11cyclictest0-21swapper/1500:21:497
247612199200,0cyclictest0-21swapper/1520:40:237
2476105992010,10cyclictest0-21swapper/1122:26:593
2476102992010,10cyclictest0-21swapper/1019:17:592
247610299200,17cyclictest0-21swapper/1023:27:052
247607899200,17cyclictest0-21swapper/419:11:5310
247606399200,17cyclictest0-21swapper/022:54:540
247606399200,17cyclictest0-21swapper/020:24:290
247612199199,10cyclictest0-21swapper/1523:15:547
247612199199,10cyclictest0-21swapper/1500:32:487
247612199199,10cyclictest0-21swapper/1500:10:507
247612199198,11cyclictest0-21swapper/1519:58:147
247612199198,11cyclictest0-21swapper/1519:36:157
247612199198,11cyclictest0-21swapper/1519:25:177
247611099190,17cyclictest0-21swapper/1222:12:374
2476105991919,0cyclictest2496874-21nodedev-init19:30:223
247610299199,0cyclictest0-21swapper/1022:47:582
247609599190,16cyclictest0-21swapper/820:56:4514
247609599190,16cyclictest0-21swapper/800:14:4114
247608699190,4cyclictest0-21swapper/623:00:2812
247608699190,16cyclictest0-21swapper/620:55:2012
247607899190,17cyclictest0-21swapper/421:05:1210
247612199187,11cyclictest0-21swapper/1521:37:047
247612199180,18cyclictest0-21swapper/1500:25:307
2476110991818,0cyclictest2519660-21kworker/12:020:49:194
247610299188,10cyclictest0-21swapper/1022:39:592
247609899180,15cyclictest0-21swapper/922:26:3215
247609599180,16cyclictest0-21swapper/820:07:1814
247608699180,3cyclictest0-21swapper/619:40:2412
247607499180,15cyclictest0-21swapper/322:08:329
247606799188,10cyclictest0-21swapper/100:16:591
247606399188,0cyclictest0-21swapper/021:25:580
2476118991716,1cyclictest1697-21snmpd00:11:446
247611499170,15cyclictest0-21swapper/1321:55:215
2476110991717,0cyclictest2758882-21nodedev-init00:35:284
2476110991716,1cyclictest1697-21snmpd23:35:294
247610599170,14cyclictest0-21swapper/1119:35:513
247610599170,0cyclictest0-21swapper/1100:05:563
247610299178,0cyclictest0-21swapper/1019:21:582
247609599170,17cyclictest0-21swapper/822:00:0714
247609599170,16cyclictest0-21swapper/823:50:2414
247609599170,14cyclictest0-21swapper/822:47:3414
247609599170,0cyclictest0-21swapper/820:03:4514
247609199170,14cyclictest0-21swapper/722:03:1013
247608699170,2cyclictest0-21swapper/621:20:5612
247608699170,14cyclictest0-21swapper/620:00:2112
247608399170,14cyclictest0-21swapper/519:12:4111
247607899170,15cyclictest0-21swapper/421:11:0310
247607499170,14cyclictest0-21swapper/321:15:219
247607299170,14cyclictest0-21swapper/223:45:548
247606799170,14cyclictest0-21swapper/122:50:331
247606799170,14cyclictest0-21swapper/120:29:371
247606799170,0cyclictest0-21swapper/119:18:031
247606399177,10cyclictest0-21swapper/023:40:590
247606399177,0cyclictest0-21swapper/021:11:580
2476063991716,1cyclictest1697-21snmpd22:41:540
247606399170,14cyclictest0-21swapper/019:20:220
2476114991616,0cyclictest2539814-21nodedev-init20:20:265
247611499160,0cyclictest0-21swapper/1319:40:335
2476110991616,0cyclictest2519660-21kworker/12:023:43:354
2476110991616,0cyclictest2519660-21kworker/12:023:33:204
2476110991616,0cyclictest2519660-21kworker/12:023:17:044
2476110991616,0cyclictest2519660-21kworker/12:022:48:354
2476110991616,0cyclictest2519660-21kworker/12:021:53:054
2476110991616,0cyclictest2519660-21kworker/12:021:45:114
2476110991616,0cyclictest2519660-21kworker/12:021:35:544
2476110991616,0cyclictest2519660-21kworker/12:020:36:284
2476110991616,0cyclictest2519660-21kworker/12:000:14:394
2476110991616,0cyclictest2395872-21kworker/12:219:54:294
2476110991616,0cyclictest2395872-21kworker/12:219:48:054
2476110991616,0cyclictest2395872-21kworker/12:219:36:244
2476110991610,3cyclictest0-21swapper/1200:08:414
247611099160,16cyclictest0-21swapper/1223:21:474
247611099160,16cyclictest0-21swapper/1219:40:454
247611099160,14cyclictest0-21swapper/1223:29:554
2476105991614,1cyclictest1205-21lldpd21:45:553
247610599160,16cyclictest0-21swapper/1119:25:173
247610599160,16cyclictest0-21swapper/1100:29:093
247610599160,13cyclictest0-21swapper/1122:35:183
2476102991616,0cyclictest1697-21snmpd22:08:232
2476102991611,3cyclictest0-21swapper/1021:15:212
247610299160,13cyclictest0-21swapper/1022:30:272
247610299160,0cyclictest0-21swapper/1000:31:272
2476098991614,2cyclictest1697-21snmpd21:25:0315
2476098991610,3cyclictest0-21swapper/923:57:5615
2476095991610,3cyclictest0-21swapper/821:54:3514
247609599160,14cyclictest0-21swapper/821:18:3414
247609599160,13cyclictest0-21swapper/823:10:2214
247609199160,16cyclictest0-21swapper/723:59:2013
247609199160,14cyclictest0-21swapper/721:35:2113
247609199160,13cyclictest0-21swapper/721:58:4413
247609199160,0cyclictest0-21swapper/721:23:5513
2476086991615,1cyclictest1697-21snmpd00:38:1312
2476086991610,3cyclictest0-21swapper/622:55:2012
247608699160,16cyclictest0-21swapper/621:55:2112
247608699160,16cyclictest0-21swapper/621:48:4912
247608699160,16cyclictest0-21swapper/620:48:1912
2476083991616,0cyclictest2693987-21mii-tool23:20:2211
2476083991616,0cyclictest1697-21snmpd00:09:4711
2476083991615,1cyclictest1697-21snmpd23:28:2311
247608399160,16cyclictest0-21swapper/519:45:5711
247607899160,16cyclictest0-21swapper/420:17:4510
247607899160,16cyclictest0-21swapper/419:27:0810
2476074991616,0cyclictest1697-21snmpd21:03:359
2476074991615,1cyclictest1697-21snmpd20:59:539
2476074991610,3cyclictest0-21swapper/321:43:209
2476074991610,3cyclictest0-21swapper/319:23:369
247607499160,14cyclictest0-21swapper/321:10:459
247607499160,14cyclictest0-21swapper/321:07:369
247607499160,13cyclictest0-21swapper/322:22:329
247607299160,14cyclictest0-21swapper/222:57:548
2476067991616,0cyclictest1697-21snmpd23:56:171
2476067991616,0cyclictest1697-21snmpd00:25:071
2476067991615,1cyclictest1697-21snmpd00:07:121
2476067991615,1cyclictest1697-21snmpd00:00:571
247606799160,0cyclictest0-21swapper/121:43:441
247606399166,10cyclictest0-21swapper/000:30:590
2476063991616,0cyclictest1697-21snmpd20:03:480
2476063991610,3cyclictest0-21swapper/023:12:320
2476063991610,3cyclictest0-21swapper/020:30:400
247606399160,16cyclictest0-21swapper/022:05:240
2476121991515,0cyclictest2608156-21mii-tool21:40:247
2476121991515,0cyclictest1697-21snmpd23:05:347
2476121991514,1cyclictest2672855-21nodedev-init22:55:237
2476121991514,1cyclictest1697-21snmpd21:34:097
2476121991514,1cyclictest1697-21snmpd00:16:197
247612199150,1cyclictest0-21swapper/1519:15:007
247612199150,13cyclictest0-21swapper/1522:16:157
2476118991515,0cyclictest2556621-21ethtool20:40:226
2476118991515,0cyclictest1697-21snmpd23:01:516
2476118991515,0cyclictest1697-21snmpd20:46:206
2476118991515,0cyclictest1697-21snmpd00:09:546
2476118991514,1cyclictest2655340-21ethtool22:35:196
2476118991514,1cyclictest1697-21snmpd21:47:146
2476118991514,1cyclictest1697-21snmpd19:59:076
2476118991514,1cyclictest1697-21snmpd19:53:526
2476114991515,0cyclictest1697-21snmpd19:47:185
2476114991514,1cyclictest2629618-21cat22:05:255
2476114991512,3cyclictest0-21swapper/1323:45:245
2476114991510,2cyclictest0-21swapper/1322:34:595
247611499150,15cyclictest0-21swapper/1319:52:395
247611499150,13cyclictest0-21swapper/1320:18:005
2476110991515,0cyclictest2519660-21kworker/12:023:00:494
2476110991515,0cyclictest2519660-21kworker/12:022:57:184
2476110991515,0cyclictest2519660-21kworker/12:022:42:494
2476110991515,0cyclictest2519660-21kworker/12:022:31:104
2476110991515,0cyclictest2519660-21kworker/12:022:00:064
2476110991515,0cyclictest2519660-21kworker/12:021:06:124
2476110991515,0cyclictest2519660-21kworker/12:020:19:554
2476110991515,0cyclictest2519660-21kworker/12:020:08:084
2476110991515,0cyclictest2519660-21kworker/12:020:00:354
2476110991515,0cyclictest2519660-21kworker/12:000:33:164
2476110991515,0cyclictest2519660-21kworker/12:000:23:434
2476110991515,0cyclictest2395872-21kworker/12:219:15:414
2476110991515,0cyclictest1697-21snmpd19:26:504
2476110991515,0cyclictest0-21swapper/1222:05:334
247611099150,0cyclictest0-21swapper/1220:40:304
2476105991515,0cyclictest1697-21snmpd22:23:593
2476105991515,0cyclictest1697-21snmpd21:09:453
2476105991515,0cyclictest0-21swapper/1121:30:203
247610599150,13cyclictest0-21swapper/1120:45:223
247610599150,0cyclictest0-21swapper/1123:05:323
2476102991515,0cyclictest1697-21snmpd23:45:262
2476102991515,0cyclictest1697-21snmpd22:19:052
2476102991515,0cyclictest1697-21snmpd21:40:012
2476102991514,1cyclictest1697-21snmpd19:11:282
247610299150,15cyclictest0-21swapper/1023:07:402
247610299150,15cyclictest0-21swapper/1022:28:112
247610299150,13cyclictest0-21swapper/1020:34:402
247610299150,0cyclictest0-21swapper/1023:30:242
247609899159,3cyclictest0-21swapper/923:42:3215
2476098991515,0cyclictest2633925-21mii-tool22:10:2615
2476098991514,1cyclictest1697-21snmpd21:57:2215
2476098991514,1cyclictest1697-21snmpd21:24:5515
2476098991513,2cyclictest1697-21snmpd22:20:1515
2476098991513,2cyclictest1697-21snmpd22:19:1215
2476098991513,2cyclictest1697-21snmpd19:18:5015
2476098991512,3cyclictest1697-21snmpd20:29:2515
247609899150,15cyclictest0-21swapper/922:30:2215
247609899150,15cyclictest0-21swapper/921:32:0615
247609899150,12cyclictest0-21swapper/920:58:1415
247609899150,0cyclictest0-21swapper/922:45:3615
247609899150,0cyclictest0-21swapper/919:30:3815
2476095991515,0cyclictest2638187-21mii-tool22:15:2314
2476095991515,0cyclictest1697-21snmpd21:38:4514
2476095991515,0cyclictest1697-21snmpd20:11:4214
2476095991515,0cyclictest0-21swapper/819:50:2314
2476095991514,1cyclictest1697-21snmpd23:43:1414
247609599150,1cyclictest0-21swapper/823:48:5914
247609599150,15cyclictest0-21swapper/822:38:1114
247609599150,15cyclictest0-21swapper/821:55:4614
247609599150,15cyclictest0-21swapper/819:32:4114
247609599150,15cyclictest0-21swapper/800:15:3614
247609599150,0cyclictest0-21swapper/821:33:1814
2476091991515,0cyclictest0-21swapper/722:10:0013
2476091991515,0cyclictest0-21swapper/721:40:2713
2476091991514,1cyclictest1697-21snmpd22:17:1513
2476091991510,2cyclictest0-21swapper/723:10:2513
247609199150,15cyclictest0-21swapper/721:13:2313
247609199150,15cyclictest0-21swapper/720:51:5613
247609199150,13cyclictest0-21swapper/721:16:3013
247609199150,0cyclictest0-21swapper/721:31:5213
247609199150,0cyclictest0-21swapper/720:57:0613
247609199150,0cyclictest0-21swapper/700:30:2513
2476086991515,0cyclictest0-21swapper/622:50:3112
247608699150,15cyclictest0-21swapper/622:38:5312
247608699150,15cyclictest0-21swapper/619:56:3912
247608699150,13cyclictest0-21swapper/623:52:3012
247608699150,12cyclictest0-21swapper/621:15:2412
247608399159,3cyclictest0-21swapper/523:53:4811
2476083991515,0cyclictest1697-21snmpd22:35:1411
2476083991515,0cyclictest1697-21snmpd22:12:3111
247608399150,15cyclictest0-21swapper/519:50:1911
2476078991515,0cyclictest1697-21snmpd23:27:4410
2476078991514,1cyclictest2646765-21ethtool22:25:2510
2476078991514,1cyclictest1697-21snmpd19:48:3910
2476078991512,3cyclictest0-21swapper/420:50:1810
2476078991510,3cyclictest0-21swapper/423:50:5010
247607899150,15cyclictest0-21swapper/423:34:0110
247607899150,15cyclictest0-21swapper/421:15:2110
247607899150,15cyclictest0-21swapper/419:30:2410
247607899150,15cyclictest0-21swapper/400:36:4910
247607899150,12cyclictest0-21swapper/422:11:1910
247607899150,12cyclictest0-21swapper/419:43:1810
2476074991515,0cyclictest1697-21snmpd19:38:179
2476074991515,0cyclictest1697-21snmpd19:25:149
2476074991514,1cyclictest1697-21snmpd00:00:539
2476072991515,0cyclictest2599564-21ethtool21:30:208
2476072991515,0cyclictest1697-21snmpd23:06:318
2476072991515,0cyclictest1697-21snmpd22:28:448
2476072991515,0cyclictest1697-21snmpd20:37:348
2476072991515,0cyclictest1697-21snmpd00:20:498
2476072991514,1cyclictest2573751-21cat21:00:218
2476072991514,1cyclictest2478252-21cat19:10:188
2476072991514,1cyclictest1697-21snmpd23:22:498
2476072991510,3cyclictest0-21swapper/223:19:468
2476072991510,3cyclictest0-21swapper/222:19:518
247607299150,15cyclictest0-21swapper/223:00:228
247607299150,15cyclictest0-21swapper/222:09:358
247607299150,15cyclictest0-21swapper/219:55:228
247607299150,12cyclictest0-21swapper/219:20:278
2476067991515,0cyclictest1697-21snmpd22:24:591
2476067991514,1cyclictest1697-21snmpd23:41:591
2476067991514,1cyclictest1697-21snmpd22:41:451
2476067991514,1cyclictest1697-21snmpd21:30:391
2476067991514,1cyclictest1697-21snmpd20:54:111
2476067991512,3cyclictest0-21swapper/121:45:221
247606799150,0cyclictest0-21swapper/121:24:331
247606399155,0cyclictest0-21swapper/021:03:580
2476063991515,0cyclictest1697-21snmpd21:35:510
2476063991515,0cyclictest1697-21snmpd00:13:240
2476063991514,1cyclictest1697-21snmpd22:47:070
2476063991514,1cyclictest1697-21snmpd22:04:490
2476063991514,1cyclictest1697-21snmpd00:22:190
247606399150,0cyclictest0-21swapper/020:28:470
2476121991413,1cyclictest1697-21snmpd22:03:437
2476121991413,1cyclictest1697-21snmpd21:24:137
2476121991413,1cyclictest1697-21snmpd20:49:207
2476121991410,2cyclictest0-21swapper/1520:26:297
247612199140,14cyclictest0-21swapper/1521:10:237
247612199140,0cyclictest0-21swapper/1520:10:047
2476118991413,1cyclictest1697-21snmpd23:38:086
2476118991413,1cyclictest1697-21snmpd19:43:086
247611499143,7cyclictest0-21swapper/1322:48:275
2476114991413,1cyclictest2496562-21cat19:30:205
247611499140,0cyclictest0-21swapper/1319:55:195
2476110991414,0cyclictest2519660-21kworker/12:023:55:114
2476110991414,0cyclictest2519660-21kworker/12:022:15:594
2476110991414,0cyclictest2519660-21kworker/12:021:57:284
2476110991414,0cyclictest2519660-21kworker/12:021:26:084
2476110991414,0cyclictest2519660-21kworker/12:000:27:554
2476110991414,0cyclictest2519660-21kworker/12:000:01:284
2476110991413,1cyclictest2487986-21cat19:20:214
2476110991413,1cyclictest1697-21snmpd21:02:004
2476105991414,0cyclictest2758556-21ethtool00:35:253
2476105991414,0cyclictest1697-21snmpd22:57:523
2476105991413,1cyclictest2487950-21cat19:20:203
247610599140,14cyclictest0-21swapper/1120:38:023
247610599140,14cyclictest0-21swapper/1120:04:423
2476102991414,0cyclictest0-21swapper/1000:15:212
2476102991413,1cyclictest1697-21snmpd22:10:052
2476102991412,2cyclictest1697-21snmpd23:44:202
247610299140,14cyclictest0-21swapper/1020:43:442
247610299140,0cyclictest0-21swapper/1023:23:082
247610299140,0cyclictest0-21swapper/1022:00:232
247610299140,0cyclictest0-21swapper/1000:27:512
247609899149,3cyclictest0-21swapper/922:03:3115
2476098991413,1cyclictest1697-21snmpd22:55:3015
2476098991413,1cyclictest1697-21snmpd21:39:5715
2476098991413,1cyclictest0-21swapper/921:04:0115
247609899140,14cyclictest0-21swapper/920:09:5415
247609899140,14cyclictest0-21swapper/900:27:0115
247609899140,14cyclictest0-21swapper/900:18:5515
247609899140,0cyclictest0-21swapper/922:50:0615
247609899140,0cyclictest0-21swapper/919:38:2315
2476095991414,0cyclictest1697-21snmpd20:28:3814
2476095991414,0cyclictest1697-21snmpd19:18:2914
2476095991413,1cyclictest1697-21snmpd22:52:3714
247609599140,14cyclictest0-21swapper/821:10:4714
247609599140,14cyclictest0-21swapper/819:59:5514
247609599140,14cyclictest0-21swapper/819:10:0714
247609599140,0cyclictest0-21swapper/800:25:3414
2476091991414,0cyclictest0-21swapper/723:40:2213
2476091991414,0cyclictest0-21swapper/700:20:3513
2476091991413,1cyclictest2741407-21cat00:15:2213
2476091991413,1cyclictest1697-21snmpd21:48:5213
2476091991413,1cyclictest1697-21snmpd19:16:5013
2476091991411,3cyclictest0-21swapper/720:30:2013
247609199140,14cyclictest0-21swapper/721:54:0513
247609199140,14cyclictest0-21swapper/700:10:0813
247608699149,2cyclictest0-21swapper/623:05:1812
2476086991412,2cyclictest0-21swapper/619:54:1212
2476086991410,1cyclictest0-21swapper/620:10:2412
247608699140,1cyclictest0-21swapper/622:33:3712
247608699140,14cyclictest0-21swapper/623:38:0412
247608699140,14cyclictest0-21swapper/623:10:2612
247608699140,14cyclictest0-21swapper/622:26:4512
247608699140,12cyclictest0-21swapper/623:40:1112
2476083991414,0cyclictest1697-21snmpd22:34:3911
2476083991414,0cyclictest1697-21snmpd19:58:3911
2476083991414,0cyclictest0-21swapper/500:25:2011
2476083991413,1cyclictest1697-21snmpd20:18:4811
2476078991414,0cyclictest431irq_work/421:56:5810
2476078991414,0cyclictest1697-21snmpd22:32:4210
2476078991414,0cyclictest1697-21snmpd21:00:2910
2476078991414,0cyclictest0-21swapper/421:20:2410
2476078991413,1cyclictest2741394-21mii-tool00:15:2310
2476078991413,1cyclictest1697-21snmpd23:19:1310
247607499148,3cyclictest0-21swapper/322:50:209
2476074991414,0cyclictest1697-21snmpd00:06:369
2476074991413,1cyclictest1697-21snmpd20:33:259
2476074991413,1cyclictest1697-21snmpd20:03:069
247607499140,14cyclictest0-21swapper/323:51:029
247607499140,14cyclictest0-21swapper/322:55:569
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional