You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-30 - 08:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3 (updated Sat Sep 30, 2023 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1001617997742,34cyclictest460891-1kworker/1:1H22:30:011
100161799670,3cyclictest1027771-21kworker/1:020:35:231
1001617996645,19cyclictest460891-1kworker/1:1H23:20:331
100161799630,62cyclictest0-21swapper/120:25:341
1001617996243,18cyclictest1037041-21kworker/1:121:10:211
1001617996144,16cyclictest460891-1kworker/1:1H19:26:421
1001617996144,16cyclictest1057148-21kworker/1:021:38:431
1001617996142,18cyclictest460891-1kworker/1:1H22:00:001
1001617996142,18cyclictest460891-1kworker/1:1H21:59:591
1001617996142,18cyclictest460891-1kworker/1:1H21:20:011
1001617996142,17cyclictest1072812-21kworker/1:122:00:231
1001617996141,19cyclictest1108481-21kworker/1:222:40:221
1001617996141,18cyclictest460891-1kworker/1:1H22:20:211
1001617996136,23cyclictest1184816-21kworker/1:200:10:211
1001617996057,2cyclictest0-21swapper/120:05:301
1001617996044,15cyclictest1052250-21kworker/1:121:25:381
1001617996044,15cyclictest1034940-21kworker/1:221:00:021
1001617996044,15cyclictest1016363-21kworker/1:219:55:211
1001617996043,16cyclictest1113754-21kworker/1:122:54:361
1001617995955,2cyclictest0-21swapper/120:57:161
1001617995943,15cyclictest460891-1kworker/1:1H20:32:111
1001617995943,15cyclictest1169042-21kworker/1:223:50:371
1001617995943,15cyclictest1169042-21kworker/1:223:47:491
1001617995943,15cyclictest1072812-21kworker/1:122:05:191
1001617995943,15cyclictest1027771-21kworker/1:020:42:071
1001617995943,15cyclictest1000102-21kworker/1:019:30:221
1001617995943,15cyclictest1000102-21kworker/1:019:20:251
1001617995942,16cyclictest1189927-21kworker/1:100:23:361
1001617995942,16cyclictest1184816-21kworker/1:200:05:351
1001617995941,17cyclictest1093195-21kworker/1:022:30:191
1001617995941,17cyclictest1072812-21kworker/1:121:50:231
1001617995941,17cyclictest1000102-21kworker/1:019:10:221
1001617995941,16cyclictest1047874-21kworker/1:321:30:211
1001617995940,18cyclictest1037041-21kworker/1:121:05:271
1001617995939,18cyclictest1133053-21kworker/1:023:05:231
1001617995936,21cyclictest1133053-21kworker/1:023:30:001
1001615995948,9cyclictest3019692-1kworker/0:0H22:32:250
1001617995842,15cyclictest460891-1kworker/1:1H00:30:271
1001617995842,15cyclictest1108481-21kworker/1:222:45:211
1001617995841,16cyclictest1189927-21kworker/1:100:15:311
1001617995841,16cyclictest1057148-21kworker/1:021:45:191
1001617995841,16cyclictest1027771-21kworker/1:020:45:081
1001617995841,16cyclictest1018266-21kworker/1:120:10:231
1001617995840,17cyclictest1108481-21kworker/1:222:35:251
1001617995840,17cyclictest1047874-21kworker/1:321:20:191
1001617995840,17cyclictest1018266-21kworker/1:120:15:071
1001617995840,17cyclictest1010285-21kworker/1:219:40:201
1001617995840,17cyclictest1000102-21kworker/1:019:20:011
1001617995839,18cyclictest1133053-21kworker/1:023:35:221
1001617995838,18cyclictest460891-1kworker/1:1H19:37:221
1001617995838,18cyclictest1205408-21kworker/1:000:35:191
1001617995740,16cyclictest1200541-21kworker/1:200:25:211
1001617995740,16cyclictest1133053-21kworker/1:023:40:011
1001617995740,16cyclictest1113754-21kworker/1:122:55:311
1001617995740,16cyclictest1072812-21kworker/1:122:12:221
1001617995740,16cyclictest1014577-21kworker/1:019:50:001
1001617995739,17cyclictest1133053-21kworker/1:023:25:231
1001617995739,17cyclictest1133053-21kworker/1:023:15:211
1001617995739,17cyclictest1133053-21kworker/1:023:15:211
1001617995739,17cyclictest1133053-21kworker/1:023:10:281
1001617995739,16cyclictest1174745-21kworker/1:000:03:361
1001617995739,16cyclictest1027771-21kworker/1:020:50:281
1001617995638,17cyclictest1018266-21kworker/1:120:00:211
1001617995538,16cyclictest1113754-21kworker/1:123:00:301
1001617995537,17cyclictest460891-1kworker/1:1H23:55:321
1001617995537,17cyclictest1093195-21kworker/1:022:15:241
1001617995537,17cyclictest1018266-21kworker/1:120:20:221
1001617995537,16cyclictest1013035-21kworker/1:119:45:011
1001615995550,3cyclictest1067683-21kworker/0:022:45:550
1001615995550,3cyclictest1067683-21kworker/0:022:37:310
1001620995449,3cyclictest3882218-1kworker/2:0H20:17:072
1001617995436,17cyclictest1057148-21kworker/1:021:40:061
1001615995348,3cyclictest3019692-1kworker/0:0H00:30:580
1001615995343,7cyclictest3019692-1kworker/0:0H23:30:190
1001622995245,4cyclictest21838-1kworker/3:1H00:15:343
1001620995247,3cyclictest3882218-1kworker/2:0H19:52:072
1001620995247,3cyclictest3882218-1kworker/2:0H19:21:452
1001620995240,9cyclictest1093398-1kworker/2:2H22:40:192
1001622995145,3cyclictest979723-21kworker/3:019:10:193
1001620995147,3cyclictest1195457-21kworker/2:200:21:052
1001620995147,3cyclictest1105703-21kworker/2:022:53:042
1001620995147,2cyclictest3882218-1kworker/2:0H20:32:382
1001620995146,3cyclictest3882218-1kworker/2:0H20:39:382
1001620995135,13cyclictest3882218-1kworker/2:0H21:50:002
1001615995147,3cyclictest3019692-1kworker/0:0H00:25:230
1001622995046,2cyclictest979723-21kworker/3:020:19:543
1001622995045,3cyclictest21838-1kworker/3:1H23:55:283
1001620995046,2cyclictest1093398-1kworker/2:2H23:31:302
1001620995045,3cyclictest3882218-1kworker/2:0H21:02:372
1001620995045,3cyclictest3882218-1kworker/2:0H20:25:272
1001620995045,3cyclictest1093398-1kworker/2:2H00:06:012
1001615995045,3cyclictest3019692-1kworker/0:0H20:00:000
1001622994944,3cyclictest21838-1kworker/3:1H23:10:193
1001620994945,2cyclictest3882218-1kworker/2:0H19:46:422
1001620994944,3cyclictest3882218-1kworker/2:0H21:38:372
1001620994944,3cyclictest3882218-1kworker/2:0H19:39:012
1001620994943,4cyclictest3882218-1kworker/2:0H20:48:022
1001620994941,6cyclictest1093398-1kworker/2:2H00:00:012
1001620994940,7cyclictest3882218-1kworker/2:0H21:25:242
1001615994944,3cyclictest3019692-1kworker/0:0H23:12:060
1001622994845,2cyclictest979723-21kworker/3:020:29:543
1001622994844,3cyclictest1080844-21kworker/3:200:13:423
1001622994843,3cyclictest21838-1kworker/3:1H19:55:213
1001622994843,3cyclictest21838-1kworker/3:1H19:29:073
1001620994844,3cyclictest1105703-21kworker/2:023:02:362
1001620994844,3cyclictest1093398-1kworker/2:2H22:46:312
1001620994844,2cyclictest1105703-21kworker/2:023:17:362
1001620994844,2cyclictest1105703-21kworker/2:023:17:352
1001620994843,3cyclictest1105703-21kworker/2:023:55:222
1001622994744,2cyclictest1080844-21kworker/3:223:34:553
1001622994742,3cyclictest21838-1kworker/3:1H22:40:233
1001620994744,2cyclictest985500-21kworker/2:019:35:012
1001620994744,2cyclictest3882218-1kworker/2:0H21:32:202
1001620994744,1cyclictest985500-21kworker/2:020:15:002
1001620994743,3cyclictest3882218-1kworker/2:0H19:14:362
1001620994743,3cyclictest1105703-21kworker/2:023:26:142
1001620994742,3cyclictest3882218-1kworker/2:0H19:40:212
1001620994742,3cyclictest1195457-21kworker/2:200:34:362
1001620994742,3cyclictest1093398-1kworker/2:2H22:56:062
1001615994744,2cyclictest1080706-21kworker/0:222:21:360
1001615994741,4cyclictest3019692-1kworker/0:0H21:30:230
1001615994735,10cyclictest3019692-1kworker/0:0H23:07:300
1001622994643,2cyclictest979723-21kworker/3:020:05:303
1001622994643,2cyclictest1080844-21kworker/3:223:19:383
1001622994643,2cyclictest1080844-21kworker/3:223:19:373
1001622994643,2cyclictest1036434-21kworker/3:021:31:363
1001622994643,2cyclictest1036434-21kworker/3:021:19:553
1001622994642,3cyclictest21838-1kworker/3:1H23:46:023
1001622994642,2cyclictest21838-1kworker/3:1H22:15:233
1001622994641,3cyclictest21838-1kworker/3:1H20:55:223
1001620994643,2cyclictest1105703-21kworker/2:023:10:232
1001620994642,3cyclictest1093398-1kworker/2:2H00:15:082
1001622994542,2cyclictest1080844-21kworker/3:222:34:553
1001622994542,2cyclictest1036434-21kworker/3:021:59:553
1001622994542,2cyclictest1036434-21kworker/3:021:59:543
1001622994541,2cyclictest21838-1kworker/3:1H21:39:553
1001622994540,4cyclictest21838-1kworker/3:1H00:10:003
1001622994540,3cyclictest21838-1kworker/3:1H00:20:213
1001620994542,2cyclictest3882218-1kworker/2:0H21:56:042
1001620994542,2cyclictest3882218-1kworker/2:0H21:56:042
1001620994542,2cyclictest1093398-1kworker/2:2H22:16:362
1001615994540,3cyclictest1036431-21kworker/0:321:25:580
1001615994536,7cyclictest1167215-21kworker/0:100:10:210
1001622994442,2cyclictest21838-1kworker/3:1H19:30:583
1001622994442,1cyclictest979723-21kworker/3:020:11:083
1001622994442,1cyclictest1080844-21kworker/3:222:02:083
1001622994441,2cyclictest21838-1kworker/3:1H20:33:383
1001622994441,2cyclictest21838-1kworker/3:1H19:44:553
1001622994440,3cyclictest21838-1kworker/3:1H23:05:053
1001622994440,2cyclictest21838-1kworker/3:1H20:42:063
1001622994440,2cyclictest21838-1kworker/3:1H19:20:013
1001620994441,2cyclictest3882218-1kworker/2:0H20:24:022
1001620994441,2cyclictest1062924-21kworker/2:222:21:302
1001620994440,3cyclictest3882218-1kworker/2:0H19:29:022
1001620994439,3cyclictest1093398-1kworker/2:2H00:36:012
1001620994438,3cyclictest1093398-1kworker/2:2H23:37:322
1001622994340,2cyclictest1080844-21kworker/3:223:29:553
1001622994340,2cyclictest1080844-21kworker/3:223:20:213
1001622994340,2cyclictest1080844-21kworker/3:222:37:563
1001622994340,2cyclictest1080844-21kworker/3:222:27:243
1001622994340,2cyclictest1080844-21kworker/3:222:24:563
1001622994340,2cyclictest1036434-21kworker/3:021:54:553
1001622994339,3cyclictest1080844-21kworker/3:200:34:133
1001620994340,2cyclictest985500-21kworker/2:019:57:372
1001615994338,3cyclictest3019692-1kworker/0:0H21:15:220
1001615994338,3cyclictest3019692-1kworker/0:0H19:50:220
1001622994239,2cyclictest979723-21kworker/3:019:36:023
1001622994239,2cyclictest1080844-21kworker/3:223:42:063
1001622994239,2cyclictest1080844-21kworker/3:200:25:183
1001622994239,2cyclictest1080844-21kworker/3:200:02:423
1001622994239,2cyclictest1028763-21kworker/3:220:54:553
1001622994238,2cyclictest1080844-21kworker/3:223:52:143
1001622994237,3cyclictest21838-1kworker/3:1H20:37:433
1001620994237,3cyclictest1093398-1kworker/2:2H22:37:032
1001620994237,3cyclictest1062924-21kworker/2:221:42:552
1001620994236,4cyclictest1093398-1kworker/2:2H23:05:362
1001620994236,3cyclictest3882218-1kworker/2:0H20:40:232
1001620994228,5cyclictest1093398-1kworker/2:2H22:25:242
1001615994237,3cyclictest3019692-1kworker/0:0H23:20:050
1001615994232,8cyclictest3019692-1kworker/0:0H21:45:000
1001615994219,13cyclictest1031246-21grep20:40:270
1001622994138,2cyclictest1080844-21kworker/3:223:04:083
1001622994138,2cyclictest1080844-21kworker/3:222:50:243
1001622994138,2cyclictest1080844-21kworker/3:222:12:373
1001622994138,2cyclictest1080844-21kworker/3:222:06:363
1001622994136,4cyclictest21838-1kworker/3:1H19:50:333
1001620994138,2cyclictest985500-21kworker/2:019:15:322
1001620994137,3cyclictest3882218-1kworker/2:0H21:16:042
1001620994137,3cyclictest3882218-1kworker/2:0H20:07:132
1001620994136,3cyclictest3882218-1kworker/2:0H20:02:062
1001620994136,3cyclictest1093398-1kworker/2:2H00:10:062
1001615994139,1cyclictest1067683-21kworker/0:022:42:070
1001615994138,2cyclictest3019692-1kworker/0:0H21:59:430
1001615994138,2cyclictest3019692-1kworker/0:0H21:59:420
1001615994138,2cyclictest1080706-21kworker/0:223:43:020
1001615994136,3cyclictest3019692-1kworker/0:0H21:50:210
1001615994136,3cyclictest3019692-1kworker/0:0H20:27:040
1001615994136,3cyclictest3019692-1kworker/0:0H19:35:010
1001615994136,3cyclictest3019692-1kworker/0:0H00:35:190
1001622994038,1cyclictest1080844-21kworker/3:222:56:013
1001622994037,2cyclictest979723-21kworker/3:020:00:553
1001622994037,2cyclictest979723-21kworker/3:019:46:563
1001622994037,2cyclictest1080844-21kworker/3:223:35:063
1001622994037,2cyclictest1080844-21kworker/3:200:39:553
1001622994035,3cyclictest21838-1kworker/3:1H21:40:363
1001620994036,2cyclictest1105703-21kworker/2:023:22:422
1001620994035,3cyclictest3882218-1kworker/2:0H21:10:082
1001620994035,3cyclictest1093398-1kworker/2:2H23:41:352
1001620994034,4cyclictest1062924-21kworker/2:222:11:372
1001615994038,1cyclictest1067683-21kworker/0:022:59:020
1001615994033,6cyclictest3019692-1kworker/0:0H19:40:010
1001622993936,2cyclictest1028763-21kworker/3:220:45:143
1001620993936,2cyclictest1195457-21kworker/2:200:28:082
1001620993934,3cyclictest3882218-1kworker/2:0H22:05:522
1001620993934,3cyclictest3882218-1kworker/2:0H20:50:542
1001615993936,2cyclictest3019692-1kworker/0:0H19:26:520
100161599391,36cyclictest1194296-21ntp_kernel_pll_00:15:280
100161599391,36cyclictest1081630-21fschecks_time22:00:230
100161599390,2cyclictest0-21swapper/000:06:390
1001622993836,1cyclictest979723-21kworker/3:019:22:183
1001622993835,2cyclictest979723-21kworker/3:020:24:553
1001622993835,2cyclictest1080844-21kworker/3:222:47:353
1001622993833,3cyclictest21838-1kworker/3:1H21:10:213
1001620993833,3cyclictest1062924-21kworker/2:221:50:282
1001615993833,3cyclictest3019692-1kworker/0:0H22:25:210
1001615993833,3cyclictest3019692-1kworker/0:0H21:21:360
100161599380,36cyclictest1025443-21expr20:20:290
1001622993734,2cyclictest1036434-21kworker/3:021:05:323
1001620993732,3cyclictest1093398-1kworker/2:2H23:51:362
1001620993732,3cyclictest1093398-1kworker/2:2H23:46:072
1001615993735,1cyclictest988941-21kworker/0:019:21:090
1001615993735,1cyclictest1167215-21kworker/0:123:47:490
1001615993734,2cyclictest3019692-1kworker/0:0H20:54:070
1001615993733,2cyclictest3019692-1kworker/0:0H20:35:230
1001615993732,4cyclictest3019692-1kworker/0:0H21:00:270
1001615993732,3cyclictest3019692-1kworker/0:0H00:05:010
1001615993730,5cyclictest3019692-1kworker/0:0H23:50:220
100161599371,33cyclictest0-21swapper/021:35:570
100161599370,34cyclictest1144090-21uniq23:15:220
100161599370,34cyclictest1144090-21uniq23:15:220
100161599370,34cyclictest1020045-21fschecks_count20:05:200
1001622993633,2cyclictest1036434-21kworker/3:021:04:563
1001620993632,3cyclictest33-21ksoftirqd/222:00:232
1001620993631,3cyclictest3882218-1kworker/2:0H21:07:472
100161599369,26cyclictest1080706-21kworker/0:223:36:020
100161599362,32cyclictest0-21swapper/020:00:220
100161599361,33cyclictest1093394-21idleruntime-cro22:15:000
100161599360,34cyclictest1021714-21idleruntime20:10:240
1001620993530,3cyclictest1093398-1kworker/2:2H22:30:292
100161599357,8cyclictest1080706-21kworker/0:222:07:440
1001615993531,2cyclictest3019692-1kworker/0:0H23:25:220
1001615993531,2cyclictest3019692-1kworker/0:0H20:17:010
100161599351,32cyclictest1003224-21cat19:15:000
100161599351,31cyclictest1198420-21/usr/sbin/munin00:20:250
100161599350,33cyclictest1011029-21timerwakeupswit19:35:280
100161599350,32cyclictest1096131-21sh22:17:260
100161599350,32cyclictest1042272-21sh21:12:190
100161599350,15cyclictest1177350-21sh23:55:220
100161599350,14cyclictest0-21swapper/020:30:270
1001622993431,2cyclictest1036434-21kworker/3:021:46:363
1001622993431,2cyclictest1036434-21kworker/3:021:27:143
1001615993431,2cyclictest1001433-21kworker/0:219:46:500
1001615993429,3cyclictest3019692-1kworker/0:0H19:15:240
100161599341,31cyclictest0-21swapper/021:49:450
100161599341,31cyclictest0-21swapper/020:45:220
100161599341,12cyclictest1039551-21diskmemload22:52:010
100161599340,32cyclictest0-21swapper/023:04:480
1001620993329,3cyclictest3882218-1kworker/2:0H21:22:352
1001622993229,2cyclictest1036434-21kworker/3:021:24:563
100161599310,29cyclictest1001625-21latency_hist19:10:010
1001615992923,3cyclictest3019692-1kworker/0:0H21:10:010
100161799270,25cyclictest251rcuc/119:10:011
1001615992515,8cyclictest1036090-21sensors20:55:270
100162099240,4cyclictest1035918-21/usr/sbin/munin20:55:262
1001620991612,2cyclictest0-21swapper/219:10:012
100162299118,2cyclictest1001675-21cat19:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional