You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-10 - 17:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3 (updated Sun Dec 10, 2023 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2914434996864,2cyclictest0-21swapper/110:27:251
291443499650,63cyclictest0-21swapper/109:37:371
2914434996359,2cyclictest0-21swapper/110:20:221
2914434996359,2cyclictest0-21swapper/110:20:221
2914434996334,28cyclictest3007015-21kworker/1:110:40:211
2914434996258,2cyclictest0-21swapper/110:15:211
2914434996141,18cyclictest2941990-21kworker/1:209:15:251
2914434995944,14cyclictest2941990-21kworker/1:208:55:211
2914434995942,16cyclictest3097716-21kworker/1:212:08:381
2914434995938,18cyclictest2932831-21kworker/1:108:05:261
291443499593,55cyclictest0-21swapper/110:38:081
2914434995843,14cyclictest3069651-21kworker/1:211:33:401
2914434995843,14cyclictest2941990-21kworker/1:209:10:221
2914434995842,15cyclictest3007015-21kworker/1:111:00:201
2914434995842,14cyclictest2941990-21kworker/1:209:20:211
2914434995841,16cyclictest3077350-21kworker/1:111:45:191
2914434995841,16cyclictest2915458-21kworker/1:007:50:231
2914434995840,17cyclictest3110049-21kworker/1:312:30:241
2914434995742,14cyclictest3069651-21kworker/1:211:35:241
2914434995742,14cyclictest3069651-21kworker/1:211:35:241
2914434995742,14cyclictest2973644-21kworker/1:310:04:551
2914434995742,14cyclictest2973644-21kworker/1:309:49:471
2914434995742,14cyclictest2941990-21kworker/1:209:00:211
2914434995742,14cyclictest2941990-21kworker/1:209:00:211
2914434995742,14cyclictest2941990-21kworker/1:208:35:221
2914434995742,14cyclictest2932831-21kworker/1:108:25:051
2914434995742,14cyclictest2915458-21kworker/1:007:40:341
2914434995741,15cyclictest3064921-21kworker/1:011:25:071
2914434995741,15cyclictest2973644-21kworker/1:310:10:011
2914434995741,15cyclictest2915458-21kworker/1:007:20:221
2914439995650,4cyclictest40-21ksoftirqd/310:27:253
2914437995653,2cyclictest2966803-21kworker/2:009:33:372
2914434995641,14cyclictest3110049-21kworker/1:312:25:201
2914434995641,14cyclictest2932831-21kworker/1:108:15:021
2914434995641,14cyclictest2915458-21kworker/1:008:05:001
2914434995640,15cyclictest4192161-1kworker/1:1H11:41:371
2914434995640,15cyclictest2973644-21kworker/1:309:50:061
2914434995640,15cyclictest2932831-21kworker/1:108:20:011
2914434995540,14cyclictest3110049-21kworker/1:312:35:211
2914434995540,14cyclictest3077350-21kworker/1:112:00:231
2914434995540,14cyclictest3007015-21kworker/1:111:20:171
2914434995540,14cyclictest3007015-21kworker/1:111:05:181
2914434995540,14cyclictest2941990-21kworker/1:208:40:001
2914434995540,14cyclictest2932831-21kworker/1:108:10:011
2914434995540,14cyclictest2915458-21kworker/1:007:30:291
2914434995540,14cyclictest2907610-21kworker/1:207:10:011
2914434995538,16cyclictest4192161-1kworker/1:1H10:49:371
2914432995551,2cyclictest2912793-21kworker/0:108:24:350
2914432995550,3cyclictest51150irq/160-enp0s2911:22:080
2914439995440,2cyclictest3209943-1kworker/3:2H08:05:263
2914434995451,2cyclictest0-21swapper/107:36:361
2914434995439,14cyclictest3077350-21kworker/1:111:50:011
2914434995439,14cyclictest3007015-21kworker/1:110:50:021
2914434995439,14cyclictest3007015-21kworker/1:110:34:371
2914434995439,14cyclictest2973644-21kworker/1:310:10:451
2914434995439,14cyclictest2941990-21kworker/1:209:30:231
2914434995438,15cyclictest4192161-1kworker/1:1H11:55:191
2914434995438,15cyclictest4192161-1kworker/1:1H09:05:361
2914434995437,16cyclictest2941990-21kworker/1:208:50:011
2914434995437,15cyclictest3110049-21kworker/1:312:20:081
2914434995436,17cyclictest3102530-21kworker/1:012:10:211
2914434995436,17cyclictest2915458-21kworker/1:007:50:001
2914432995448,4cyclictest3041382-1kworker/0:1H10:07:380
2914437995348,3cyclictest64099-1kworker/2:1H12:38:122
2914434995338,14cyclictest2973644-21kworker/1:309:56:421
2914434995338,14cyclictest2941990-21kworker/1:208:50:191
2914434995338,14cyclictest2941990-21kworker/1:208:50:191
2914434995337,15cyclictest3102530-21kworker/1:012:15:251
2914439995247,3cyclictest3001019-21kworker/3:212:20:483
2914434995237,14cyclictest3007015-21kworker/1:111:10:041
2914434995237,14cyclictest2915458-21kworker/1:007:55:321
2914434995236,15cyclictest4192161-1kworker/1:1H10:58:021
2914434995236,15cyclictest2973644-21kworker/1:309:40:081
2914434995236,15cyclictest2941990-21kworker/1:209:25:221
2914434995236,15cyclictest2915458-21kworker/1:007:15:081
291443499520,51cyclictest3057064-21fschecks_count11:15:221
2914432995248,2cyclictest2910003-21kworker/0:508:00:240
2914432995247,3cyclictest2944835-21kworker/0:210:02:020
2914437995146,3cyclictest2924573-21kworker/2:109:15:002
2914437995145,3cyclictest64099-1kworker/2:1H08:40:242
2914434995136,14cyclictest2915458-21kworker/1:007:25:031
291443499510,49cyclictest0-21swapper/108:30:271
2914432995147,2cyclictest3041382-1kworker/0:1H09:59:500
2914432995145,5cyclictest2899737-21kworker/0:407:29:240
2914432995145,4cyclictest3041382-1kworker/0:1H11:30:230
2914432995145,3cyclictest3041382-1kworker/0:1H10:45:220
2914432995145,3cyclictest3041382-1kworker/0:1H09:34:440
2914439995046,2cyclictest3209943-1kworker/3:2H09:01:383
2914439995046,2cyclictest3209943-1kworker/3:2H09:01:373
2914437995046,3cyclictest64099-1kworker/2:1H08:31:362
2914437995045,3cyclictest2924573-21kworker/2:108:29:302
2914432995047,2cyclictest2997668-21kworker/0:312:15:220
2914432995047,2cyclictest2943275-21kworker/0:009:06:580
2914432995046,3cyclictest3041382-1kworker/0:1H11:14:030
2914432995046,3cyclictest3017046-21kworker/0:011:17:330
2914432995045,3cyclictest2944835-21kworker/0:209:19:080
2914439994946,2cyclictest3209943-1kworker/3:2H08:44:123
2914439994944,3cyclictest3209943-1kworker/3:2H10:50:003
2914437994945,2cyclictest1452604-21kworker/2:207:21:102
2914437994944,3cyclictest2966803-21kworker/2:010:59:072
2914432994946,2cyclictest2899737-21kworker/0:407:14:200
2914432994944,3cyclictest2944835-21kworker/0:209:20:170
2914439994845,2cyclictest2901344-21kworker/3:109:37:373
2914439994844,2cyclictest3209943-1kworker/3:2H08:38:063
2914439994843,3cyclictest3209943-1kworker/3:2H08:25:253
2914432994844,2cyclictest2997668-21kworker/0:311:49:370
2914432994843,3cyclictest3041382-1kworker/0:1H08:50:180
2914432994843,3cyclictest3041382-1kworker/0:1H08:50:180
2914432994843,3cyclictest2912793-21kworker/0:107:53:420
2914432994843,3cyclictest2899737-21kworker/0:407:19:530
2914432994842,4cyclictest3041382-1kworker/0:1H09:28:030
2914432994840,4cyclictest3041382-1kworker/0:1H08:55:220
2914439994743,2cyclictest3001019-21kworker/3:211:18:383
2914439994742,4cyclictest3209943-1kworker/3:2H11:24:543
2914439994742,3cyclictest3209943-1kworker/3:2H07:20:223
2914437994744,2cyclictest64099-1kworker/2:1H11:42:062
2914437994744,2cyclictest64099-1kworker/2:1H10:04:592
2914437994743,2cyclictest1452604-21kworker/2:207:29:372
2914432994743,3cyclictest2997668-21kworker/0:311:58:030
2914432994742,4cyclictest3035166-21kworker/0:112:38:020
2914432994742,3cyclictest2899737-21kworker/0:408:47:420
2914439994642,3cyclictest2901344-21kworker/3:109:50:003
2914439994642,2cyclictest3209943-1kworker/3:2H08:14:073
2914439994642,2cyclictest2901344-21kworker/3:109:50:513
2914439994641,3cyclictest3209943-1kworker/3:2H07:50:493
2914437994643,2cyclictest64099-1kworker/2:1H09:50:062
2914437994643,2cyclictest64099-1kworker/2:1H08:07:372
2914437994643,2cyclictest2966803-21kworker/2:009:41:112
2914437994643,2cyclictest2924573-21kworker/2:109:24:362
2914437994643,2cyclictest2924573-21kworker/2:108:55:582
2914437994642,3cyclictest3051676-21kworker/2:111:57:072
2914432994643,2cyclictest2910003-21kworker/0:508:06:540
2914432994642,3cyclictest3035166-21kworker/0:112:32:070
2914432994641,3cyclictest3017046-21kworker/0:011:54:070
2914432994641,3cyclictest2944835-21kworker/0:209:03:020
2914432994641,3cyclictest2944835-21kworker/0:209:03:020
2914439994541,2cyclictest3001019-21kworker/3:211:30:343
2914439994540,3cyclictest3209943-1kworker/3:2H09:29:443
2914439994540,3cyclictest3209943-1kworker/3:2H08:20:233
2914439994540,3cyclictest3001019-21kworker/3:210:44:553
2914439994540,3cyclictest2901344-21kworker/3:109:55:293
2914439994539,4cyclictest2901344-21kworker/3:109:20:003
2914439994538,4cyclictest2901344-21kworker/3:108:35:013
2914437994542,2cyclictest64099-1kworker/2:1H08:16:422
2914437994542,2cyclictest64099-1kworker/2:1H08:10:112
2914437994541,2cyclictest2924573-21kworker/2:107:56:372
2914437994540,3cyclictest64099-1kworker/2:1H11:40:002
2914437994540,3cyclictest64099-1kworker/2:1H11:40:002
2914437994540,3cyclictest3051676-21kworker/2:112:20:372
2914432994542,2cyclictest2997668-21kworker/0:312:12:070
2914432994540,3cyclictest3035166-21kworker/0:112:20:590
2914432994540,3cyclictest2910003-21kworker/0:507:38:020
2914432994539,3cyclictest2936857-21kworker/0:308:40:210
2914439994440,3cyclictest3209943-1kworker/3:2H11:29:023
2914439994440,3cyclictest3209943-1kworker/3:2H09:22:343
2914439994439,3cyclictest3209943-1kworker/3:2H10:20:223
2914439994439,3cyclictest3209943-1kworker/3:2H10:20:223
2914439994438,3cyclictest3209943-1kworker/3:2H11:40:203
2914437994441,2cyclictest64099-1kworker/2:1H11:27:072
2914437994441,2cyclictest2924573-21kworker/2:108:46:482
2914437994440,3cyclictest64099-1kworker/2:1H10:47:072
2914437994440,3cyclictest3051676-21kworker/2:111:53:032
2914437994440,2cyclictest64099-1kworker/2:1H07:52:372
2914437994440,2cyclictest2924573-21kworker/2:109:19:362
2914432994439,3cyclictest2899737-21kworker/0:408:14:260
2914432994439,3cyclictest2899737-21kworker/0:407:44:370
2914439994339,2cyclictest3001019-21kworker/3:212:05:373
2914439994338,3cyclictest3209943-1kworker/3:2H11:05:173
2914439994338,3cyclictest3001019-21kworker/3:210:50:133
2914437994340,2cyclictest64099-1kworker/2:1H07:35:212
2914437994340,2cyclictest3051676-21kworker/2:111:15:312
2914437994339,3cyclictest2966803-21kworker/2:010:50:552
2914437994339,2cyclictest64099-1kworker/2:1H12:00:242
2914437994339,2cyclictest3111842-21kworker/2:212:27:092
2914437994338,3cyclictest64099-1kworker/2:1H07:19:372
2914432994340,2cyclictest3017046-21kworker/0:011:25:430
2914432994339,3cyclictest2899737-21kworker/0:407:30:060
2914432994339,2cyclictest2912793-21kworker/0:108:16:030
2914439994239,2cyclictest3001019-21kworker/3:210:30:373
2914439994238,3cyclictest3209943-1kworker/3:2H12:32:023
2914439994238,3cyclictest3001019-21kworker/3:211:45:273
2914439994237,3cyclictest3209943-1kworker/3:2H09:05:243
2914439994237,3cyclictest3001019-21kworker/3:211:59:363
2914439994237,3cyclictest3001019-21kworker/3:211:52:083
2914437994239,2cyclictest2924573-21kworker/2:109:29:022
2914437994238,3cyclictest3051676-21kworker/2:112:07:162
2914437994237,3cyclictest64099-1kworker/2:1H11:14:592
2914432994238,3cyclictest3041382-1kworker/0:1H12:01:350
2914432994237,3cyclictest3041382-1kworker/0:1H11:00:200
2914432994237,3cyclictest3041382-1kworker/0:1H10:51:360
2914432994237,3cyclictest3041382-1kworker/0:1H10:25:120
2914432994237,3cyclictest3041382-1kworker/0:1H09:40:020
2914432994237,3cyclictest3041382-1kworker/0:1H07:45:480
2914432994236,3cyclictest3041382-1kworker/0:1H09:50:230
2914439994138,2cyclictest2901344-21kworker/3:108:59:553
2914439994137,2cyclictest3209943-1kworker/3:2H10:15:223
2914439994137,2cyclictest3209943-1kworker/3:2H08:02:073
2914439994137,2cyclictest2901344-21kworker/3:107:44:523
2914437994138,2cyclictest64099-1kworker/2:1H10:12:072
2914437994138,2cyclictest2966803-21kworker/2:010:41:352
2914437994138,2cyclictest1452604-21kworker/2:207:14:152
2914437994137,2cyclictest2966803-21kworker/2:010:37:362
2914437994137,2cyclictest2966803-21kworker/2:010:29:552
2914432994136,3cyclictest3041382-1kworker/0:1H09:45:070
2914432994136,3cyclictest2936857-21kworker/0:308:39:090
2914432994134,4cyclictest3041382-1kworker/0:1H08:34:310
2914439994038,1cyclictest3001019-21kworker/3:212:14:553
2914439994037,2cyclictest3001019-21kworker/3:210:58:373
2914439994036,3cyclictest3209943-1kworker/3:2H12:15:263
2914439994036,2cyclictest3001019-21kworker/3:211:14:543
2914439994035,3cyclictest3209943-1kworker/3:2H09:40:223
2914437994037,2cyclictest64099-1kworker/2:1H12:13:122
2914437994037,2cyclictest3111842-21kworker/2:212:33:082
2914437994036,2cyclictest64099-1kworker/2:1H07:34:072
2914437994035,3cyclictest64099-1kworker/2:1H12:16:012
2914432994037,2cyclictest2944835-21kworker/0:209:39:070
2914432994035,3cyclictest3041382-1kworker/0:1H09:13:020
2914432994035,3cyclictest2997668-21kworker/0:310:13:060
2914439993936,2cyclictest3001019-21kworker/3:210:40:013
2914439993935,2cyclictest2901344-21kworker/3:109:12:023
2914439993934,3cyclictest3209943-1kworker/3:2H09:34:553
2914437993936,2cyclictest2924573-21kworker/2:109:09:362
2914437993935,3cyclictest2966803-21kworker/2:010:34:372
2914437993934,3cyclictest64099-1kworker/2:1H08:03:422
2914439993836,1cyclictest2901344-21kworker/3:108:45:213
2914439993835,2cyclictest3209943-1kworker/3:2H08:50:553
2914439993835,2cyclictest3209943-1kworker/3:2H08:50:543
2914439993835,2cyclictest3209943-1kworker/3:2H08:15:313
2914439993834,3cyclictest3209943-1kworker/3:2H10:10:303
2914439993833,3cyclictest3209943-1kworker/3:2H11:35:253
2914439993833,3cyclictest3209943-1kworker/3:2H11:35:243
2914437993835,2cyclictest64099-1kworker/2:1H11:23:122
2914437993834,3cyclictest64099-1kworker/2:1H11:45:422
2914437993834,3cyclictest64099-1kworker/2:1H10:22:082
2914437993834,3cyclictest64099-1kworker/2:1H10:22:082
2914437993834,3cyclictest2966803-21kworker/2:010:00:002
2914437993834,3cyclictest2924573-21kworker/2:108:24:282
2914437993833,3cyclictest64099-1kworker/2:1H09:04:082
2914437993833,3cyclictest64099-1kworker/2:1H09:04:072
2914432993834,2cyclictest2997668-21kworker/0:312:25:360
2914432993833,3cyclictest3041382-1kworker/0:1H11:06:340
2914432993831,4cyclictest3041382-1kworker/0:1H10:35:210
2914439993734,2cyclictest3209943-1kworker/3:2H07:16:423
2914439993734,2cyclictest3117251-21kworker/3:012:38:373
2914439993734,2cyclictest3001019-21kworker/3:211:04:563
2914439993734,2cyclictest2901344-21kworker/3:107:45:333
2914432993734,2cyclictest2910003-21kworker/0:507:23:020
2914432993731,4cyclictest3035166-21kworker/0:112:06:370
2914432993730,4cyclictest3041382-1kworker/0:1H10:15:210
2914437993633,2cyclictest64099-1kworker/2:1H07:48:372
2914432993632,3cyclictest3041382-1kworker/0:1H11:35:270
2914432993632,3cyclictest3041382-1kworker/0:1H11:35:270
2914432993632,2cyclictest2936857-21kworker/0:308:29:020
2914439993532,2cyclictest3001019-21kworker/3:212:29:553
2914439993532,2cyclictest2901344-21kworker/3:110:04:553
2914439993531,3cyclictest2901344-21kworker/3:107:30:263
2914439993530,3cyclictest3001019-21kworker/3:212:04:563
2914432993532,2cyclictest2993387-21kworker/0:410:41:420
2914432993532,2cyclictest2912793-21kworker/0:107:57:360
2914432993528,5cyclictest3041382-1kworker/0:1H10:31:040
2914437993430,3cyclictest64099-1kworker/2:1H08:35:272
2914437993429,3cyclictest64099-1kworker/2:1H10:05:062
291443499344,28cyclictest2914201-21latency_hist07:10:001
2914439993330,2cyclictest2901344-21kworker/3:107:36:363
2914439993328,3cyclictest3209943-1kworker/3:2H07:27:083
2914432993229,2cyclictest2993387-21kworker/0:410:20:550
2914432993229,2cyclictest2993387-21kworker/0:410:20:540
2914432993228,3cyclictest3035166-21kworker/0:111:40:370
2914432993219,3cyclictest0-21swapper/010:57:320
2914439993128,2cyclictest3209943-1kworker/3:2H10:05:073
2914437993128,2cyclictest64099-1kworker/2:1H11:02:082
2914437992824,2cyclictest2966803-21kworker/2:011:09:362
2914437992823,3cyclictest3051676-21kworker/2:111:33:032
291443799281,24cyclictest2983475-21/usr/sbin/munin09:45:292
2914439992723,3cyclictest3209943-1kworker/3:2H07:10:363
2914437992723,3cyclictest64099-1kworker/2:1H08:50:212
2914437992723,3cyclictest64099-1kworker/2:1H08:50:212
2914437992623,2cyclictest2924573-21kworker/2:107:40:402
291443999251,3cyclictest2930442-21/usr/sbin/munin07:55:323
291443799252,21cyclictest3010793-21diskmemload10:19:542
2914437992319,2cyclictest2974026-21apt-get09:35:192
291443799230,21cyclictest0-21swapper/207:10:002
2914439991610,4cyclictest2914455-21grep07:10:003
291443299160,13cyclictest2914518-21latency_hist07:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional