You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-04 - 03:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3 (updated Sun Dec 03, 2023 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
339277099661,1cyclictest3430433-21diskmemload12:13:081
3392770996562,2cyclictest0-21swapper/107:50:411
3392770996462,1cyclictest0-21swapper/112:23:071
3392770996459,3cyclictest3429745-21latency09:05:251
3392770996360,2cyclictest0-21swapper/109:25:281
3392770996360,2cyclictest0-21swapper/108:46:051
3392770996259,2cyclictest0-21swapper/109:15:061
3392770996241,20cyclictest503182-1kworker/1:0H12:40:001
3392770996157,3cyclictest0-21swapper/110:03:381
3392770996041,17cyclictest3397004-21kworker/1:007:25:251
3392770995855,2cyclictest0-21swapper/111:05:391
3392770995855,2cyclictest0-21swapper/111:05:391
3392770995842,14cyclictest503182-1kworker/1:0H07:10:271
3392770995841,16cyclictest3525998-21kworker/1:311:30:271
3392770995841,16cyclictest3525998-21kworker/1:311:20:011
3392770995755,1cyclictest0-21swapper/111:36:061
3392770995754,2cyclictest0-21swapper/109:53:031
3392770995741,15cyclictest3546330-21kworker/1:111:40:011
3392770995741,15cyclictest3418093-21kworker/1:108:40:251
3392770995741,15cyclictest3418093-21kworker/1:108:30:251
3392770995741,15cyclictest3406288-21kworker/1:107:55:321
3392770995738,18cyclictest3397004-21kworker/1:007:40:261
339277099571,54cyclictest3397955-21cron07:25:001
339277099570,54cyclictest251rcuc/109:20:171
3392778995650,4cyclictest1957309-1kworker/3:1H11:56:013
3392770995653,2cyclictest0-21swapper/108:50:181
3392770995641,14cyclictest3575922-21kworker/1:212:25:231
3392770995641,14cyclictest3561542-21kworker/1:012:00:211
3392770995641,14cyclictest3556311-21kworker/1:211:45:271
3392770995641,14cyclictest3450584-21kworker/1:109:49:551
3392770995641,14cyclictest3427575-21kworker/1:209:10:231
3392770995641,14cyclictest3397004-21kworker/1:007:35:211
3392770995640,15cyclictest3561542-21kworker/1:012:05:331
3392770995640,15cyclictest3493552-21kworker/1:110:40:251
3392770995639,16cyclictest3450584-21kworker/1:110:10:161
3392770995638,17cyclictest3493552-21kworker/1:110:30:261
3392770995540,14cyclictest3592874-21kworker/1:112:34:091
3392770995540,14cyclictest3556311-21kworker/1:211:50:291
3392770995540,14cyclictest3493552-21kworker/1:110:50:081
3392770995540,14cyclictest3493552-21kworker/1:110:45:081
3392770995540,14cyclictest3410381-21kworker/1:008:20:361
3392770995540,14cyclictest3410381-21kworker/1:008:05:031
3392770995540,14cyclictest3406288-21kworker/1:108:03:371
3392770995540,14cyclictest3397004-21kworker/1:007:45:221
3392770995539,15cyclictest3418093-21kworker/1:108:55:011
3392770995539,15cyclictest3410381-21kworker/1:008:16:381
3392770995538,16cyclictest3525998-21kworker/1:311:15:171
3392770995538,16cyclictest3427575-21kworker/1:209:00:451
3392778995447,5cyclictest3415029-21kworker/3:008:26:013
3392774995449,3cyclictest3509467-21kworker/2:111:04:382
3392774995449,3cyclictest3509467-21kworker/2:111:04:382
3392774995449,3cyclictest3461006-21kworker/2:110:14:372
3392770995451,2cyclictest0-21swapper/111:56:431
3392770995439,14cyclictest3483054-21kworker/1:210:20:201
3392770995439,14cyclictest3450584-21kworker/1:110:15:011
3392770995439,14cyclictest3445709-21kworker/1:009:35:011
3392770995439,14cyclictest3445709-21kworker/1:009:35:011
3392770995438,15cyclictest3450584-21kworker/1:109:40:501
3392770995438,15cyclictest3394408-21kworker/1:307:15:341
3392770995437,16cyclictest503182-1kworker/1:0H10:55:341
3392770995437,15cyclictest503182-1kworker/1:0H09:30:201
3392778995349,2cyclictest3415029-21kworker/3:008:36:383
3392778995348,3cyclictest1957309-1kworker/3:1H07:24:553
3392778995347,4cyclictest1957309-1kworker/3:1H09:34:383
3392774995349,2cyclictest3372092-21kworker/2:008:26:052
3392774995349,2cyclictest3372092-21kworker/2:007:14:242
3392770995337,15cyclictest3525998-21kworker/1:311:27:401
3392770995336,16cyclictest3418093-21kworker/1:108:35:261
3392770995336,16cyclictest3410381-21kworker/1:008:25:271
3392770995335,16cyclictest503182-1kworker/1:0H09:55:091
3392770995334,17cyclictest3512875-21kworker/1:211:00:231
3392770995334,17cyclictest3512875-21kworker/1:211:00:231
339277099531,3cyclictest251rcuc/110:35:191
3392765995349,2cyclictest3041382-1kworker/0:1H11:40:210
3392765995348,3cyclictest3404151-21kworker/0:008:21:370
3392778995246,4cyclictest1957309-1kworker/3:1H09:57:033
3392774995248,3cyclictest3430411-21kworker/2:009:11:382
3392774995248,3cyclictest3372092-21kworker/2:007:37:322
3392774995247,3cyclictest3424236-21kworker/2:208:58:082
3392770995237,14cyclictest3410381-21kworker/1:008:10:011
3392770995236,15cyclictest3488615-21kworker/1:010:25:191
3392770995235,16cyclictest3397004-21kworker/1:007:30:231
3392778995148,2cyclictest3386969-21kworker/3:207:28:393
3392778995146,3cyclictest3386969-21kworker/3:207:19:183
3392778995145,4cyclictest1957309-1kworker/3:1H11:42:383
3392778995145,4cyclictest1957309-1kworker/3:1H11:16:053
3392774995147,3cyclictest3372092-21kworker/2:007:40:242
3392774995146,3cyclictest3461006-21kworker/2:109:59:032
3392770995136,14cyclictest3525998-21kworker/1:311:10:251
3392770995135,15cyclictest3575922-21kworker/1:212:15:091
3392765995147,2cyclictest3499864-21kworker/0:311:12:370
3392765995145,5cyclictest3426016-21kworker/0:309:34:030
3392778995047,2cyclictest3432272-21kworker/3:109:26:043
3392778995047,2cyclictest3386969-21kworker/3:207:44:033
3392778995046,3cyclictest1957309-1kworker/3:1H08:45:243
3392778995046,2cyclictest3386969-21kworker/3:207:47:373
3392778995045,3cyclictest3469403-21kworker/3:110:05:383
3392774995046,2cyclictest3372092-21kworker/2:008:10:552
3392774995045,3cyclictest3461006-21kworker/2:110:03:382
3392770995035,14cyclictest3450584-21kworker/1:110:09:581
3392765995047,2cyclictest3448840-21kworker/0:209:45:210
3392765995046,3cyclictest3580597-21kworker/0:112:32:040
3392765995045,3cyclictest3041382-1kworker/0:1H10:20:250
3392765995045,3cyclictest3041382-1kworker/0:1H08:50:210
3392778994946,2cyclictest3469403-21kworker/3:111:10:373
3392778994946,2cyclictest3415029-21kworker/3:008:53:033
3392778994945,2cyclictest3469403-21kworker/3:110:37:083
3392778994945,2cyclictest3457070-21kworker/3:009:51:373
3392774994946,2cyclictest3568181-21kworker/2:012:23:072
3392774994946,2cyclictest2693083-1kworker/2:2H07:50:412
3392774994945,2cyclictest3424236-21kworker/2:208:52:082
3392774994944,3cyclictest3521884-21kworker/2:211:35:052
3392774994944,3cyclictest3372092-21kworker/2:008:23:032
3392778994845,2cyclictest3469403-21kworker/3:110:47:383
3392778994845,2cyclictest3386969-21kworker/3:208:06:053
3392778994845,2cyclictest1957309-1kworker/3:1H12:31:383
3392778994844,3cyclictest1957309-1kworker/3:1H07:10:593
3392778994843,3cyclictest1957309-1kworker/3:1H09:45:593
3392778994842,4cyclictest1957309-1kworker/3:1H12:25:503
3392774994844,2cyclictest3521884-21kworker/2:211:13:092
3392774994844,2cyclictest3430411-21kworker/2:009:23:082
3392774994843,3cyclictest3568181-21kworker/2:012:09:032
3392765994845,2cyclictest3558810-21kworker/0:011:58:030
3392765994845,2cyclictest3408770-21kworker/0:109:25:540
3392765994845,2cyclictest3399480-21kworker/0:307:26:380
3392765994844,2cyclictest3448840-21kworker/0:209:40:390
3392765994843,4cyclictest3041382-1kworker/0:1H12:25:000
3392765994843,3cyclictest3408770-21kworker/0:108:12:040
3392778994744,2cyclictest1957309-1kworker/3:1H08:20:243
3392778994742,3cyclictest1957309-1kworker/3:1H10:43:043
3392778994742,3cyclictest1957309-1kworker/3:1H10:10:153
3392774994743,3cyclictest3372092-21kworker/2:007:15:512
3392774994743,2cyclictest3372092-21kworker/2:008:45:342
3392774994743,2cyclictest3372092-21kworker/2:008:35:172
3392774994742,3cyclictest3488707-21kworker/2:210:30:222
3392774994742,3cyclictest2693083-1kworker/2:2H10:25:192
3392765994743,2cyclictest3473946-21kworker/0:210:35:060
3392765994743,2cyclictest3419585-21kworker/0:008:47:080
3392765994743,2cyclictest3041382-1kworker/0:1H08:05:240
3392765994742,2cyclictest3041382-1kworker/0:1H11:05:260
3392765994742,2cyclictest3041382-1kworker/0:1H11:05:250
3392765994741,3cyclictest3041382-1kworker/0:1H07:30:230
3392778994643,2cyclictest3469403-21kworker/3:110:23:383
3392778994643,2cyclictest3386969-21kworker/3:207:30:423
3392778994641,3cyclictest1957309-1kworker/3:1H08:45:013
3392774994643,2cyclictest3521884-21kworker/2:211:40:372
3392774994643,2cyclictest3430411-21kworker/2:009:35:292
3392774994643,2cyclictest3430411-21kworker/2:009:35:292
3392774994643,2cyclictest2693083-1kworker/2:2H11:30:322
3392774994642,3cyclictest2693083-1kworker/2:2H09:15:062
3392774994642,2cyclictest3461006-21kworker/2:109:54:142
3392774994642,2cyclictest2693083-1kworker/2:2H12:30:232
3392774994641,3cyclictest3372092-21kworker/2:007:26:432
3392774994641,3cyclictest2693083-1kworker/2:2H09:00:292
3392765994643,2cyclictest3576363-21kworker/0:312:14:080
3392765994643,2cyclictest3473946-21kworker/0:210:09:510
3392765994642,3cyclictest3041382-1kworker/0:1H11:03:050
3392765994642,3cyclictest3041382-1kworker/0:1H11:03:050
3392778994542,2cyclictest3415029-21kworker/3:008:30:363
3392778994541,2cyclictest1957309-1kworker/3:1H10:29:553
3392778994540,4cyclictest3469403-21kworker/3:110:50:433
3392778994540,3cyclictest1957309-1kworker/3:1H11:05:033
3392778994540,3cyclictest1957309-1kworker/3:1H11:05:033
3392774994542,2cyclictest3568181-21kworker/2:012:29:042
3392774994542,2cyclictest3372092-21kworker/2:007:55:372
3392774994542,2cyclictest3372092-21kworker/2:007:20:292
3392774994541,2cyclictest3521884-21kworker/2:211:50:492
3392774994541,2cyclictest3372092-21kworker/2:008:05:242
3392774994541,2cyclictest3372092-21kworker/2:007:30:112
3392774994540,3cyclictest3488707-21kworker/2:210:48:032
3392765994541,3cyclictest3525749-21kworker/0:211:30:540
3392765994541,2cyclictest3041382-1kworker/0:1H12:35:240
3392765994540,3cyclictest3499864-21kworker/0:310:51:370
3392765994540,3cyclictest3408770-21kworker/0:109:21:410
3392765994539,4cyclictest3041382-1kworker/0:1H10:40:280
3392778994441,2cyclictest3469403-21kworker/3:111:39:433
3392778994440,2cyclictest1957309-1kworker/3:1H11:24:553
3392778994440,2cyclictest1957309-1kworker/3:1H09:20:043
3392774994440,3cyclictest3509467-21kworker/2:110:50:382
3392774994440,2cyclictest3424236-21kworker/2:209:05:472
3392774994440,2cyclictest3372092-21kworker/2:008:01:032
3392765994441,2cyclictest3499864-21kworker/0:310:49:390
3392765994441,2cyclictest3456198-21kworker/0:109:54:540
3392765994441,2cyclictest3448840-21kworker/0:209:35:250
3392765994441,2cyclictest3448840-21kworker/0:209:35:250
3392765994441,2cyclictest3404151-21kworker/0:007:54:260
3392765994440,2cyclictest3391130-21kworker/0:207:12:370
3392765994440,2cyclictest3041382-1kworker/0:1H07:40:240
3392765994437,4cyclictest3041382-1kworker/0:1H10:25:190
3392778994340,2cyclictest3386969-21kworker/3:208:18:373
3392778994340,2cyclictest1957309-1kworker/3:1H12:08:373
3392778994339,2cyclictest3386969-21kworker/3:207:36:423
3392778994335,5cyclictest1957309-1kworker/3:1H11:27:093
339277899431,39cyclictest0-21swapper/312:00:343
3392774994340,2cyclictest3596789-21kworker/2:112:35:202
3392774994340,2cyclictest3568181-21kworker/2:012:16:382
3392774994340,2cyclictest3488707-21kworker/2:210:35:562
3392774994340,2cyclictest3430411-21kworker/2:009:29:032
3392765994340,2cyclictest3558810-21kworker/0:012:04:080
3392765994340,2cyclictest3408770-21kworker/0:108:33:380
3392765994339,2cyclictest3391130-21kworker/0:207:49:310
3392765994338,3cyclictest3558810-21kworker/0:012:06:090
3392778994239,2cyclictest3469403-21kworker/3:110:59:433
3392778994239,2cyclictest3415029-21kworker/3:009:05:383
3392778994239,2cyclictest3386969-21kworker/3:207:59:033
3392778994238,3cyclictest1957309-1kworker/3:1H11:50:323
3392778994238,3cyclictest1957309-1kworker/3:1H10:17:063
3392774994239,2cyclictest3521884-21kworker/2:211:47:132
3392774994238,2cyclictest2693083-1kworker/2:2H08:40:242
3392765994238,3cyclictest3490930-21kworker/0:010:34:130
3392765994237,3cyclictest3499864-21kworker/0:311:51:380
3392765994237,3cyclictest3041382-1kworker/0:1H12:26:190
3392765994237,3cyclictest3041382-1kworker/0:1H09:11:000
3392765994236,4cyclictest3041382-1kworker/0:1H11:16:380
3392778994138,2cyclictest3432272-21kworker/3:109:19:083
3392778994138,2cyclictest3415029-21kworker/3:009:10:383
3392778994138,2cyclictest1957309-1kworker/3:1H08:00:243
3392778994137,3cyclictest1957309-1kworker/3:1H12:17:343
3392778994137,3cyclictest1957309-1kworker/3:1H10:34:553
3392774994138,2cyclictest3461006-21kworker/2:110:20:382
3392774994138,2cyclictest3461006-21kworker/2:110:06:422
3392774994137,3cyclictest3521884-21kworker/2:212:02:082
3392774994137,3cyclictest3521884-21kworker/2:211:05:392
3392774994137,3cyclictest3521884-21kworker/2:211:05:392
3392774994137,3cyclictest2693083-1kworker/2:2H10:55:512
3392774994137,3cyclictest2693083-1kworker/2:2H09:40:292
3392774994136,3cyclictest2693083-1kworker/2:2H10:20:022
3392765994138,2cyclictest3558810-21kworker/0:012:19:040
3392765994138,2cyclictest3408770-21kworker/0:108:00:010
3392765994137,3cyclictest3473946-21kworker/0:210:14:520
3392765994137,3cyclictest3408770-21kworker/0:108:39:090
3392778994036,3cyclictest3415029-21kworker/3:009:00:003
3392778994035,3cyclictest1957309-1kworker/3:1H09:40:083
3392778994034,4cyclictest3386969-21kworker/3:207:54:383
3392765994038,1cyclictest3499864-21kworker/0:311:23:030
3392765994037,2cyclictest3490930-21kworker/0:010:55:050
3392765994037,2cyclictest3408770-21kworker/0:108:28:480
3392765994036,3cyclictest3465186-21kworker/0:309:59:490
3392778993934,4cyclictest1957309-1kworker/3:1H11:49:083
3392778993934,3cyclictest1957309-1kworker/3:1H12:35:263
3392774993936,2cyclictest3430411-21kworker/2:009:30:402
3392774993935,3cyclictest2693083-1kworker/2:2H11:25:282
3392774993933,4cyclictest2693083-1kworker/2:2H11:15:172
3392765993936,2cyclictest3525749-21kworker/0:211:25:150
3392765993935,3cyclictest3456198-21kworker/0:110:04:500
3392765993935,3cyclictest3386959-21kworker/0:107:15:380
3392765993935,2cyclictest3041382-1kworker/0:1H07:40:000
3392778993833,4cyclictest1957309-1kworker/3:1H11:01:033
3392778993833,4cyclictest1957309-1kworker/3:1H11:01:033
3392778993832,3cyclictest1957309-1kworker/3:1H08:12:373
3392774993835,2cyclictest3521884-21kworker/2:211:56:432
3392765993834,3cyclictest3041382-1kworker/0:1H07:20:220
3392778993731,4cyclictest1957309-1kworker/3:1H10:00:253
3392774993733,3cyclictest2693083-1kworker/2:2H08:30:252
3392774993732,3cyclictest2693083-1kworker/2:2H08:19:292
3392765993734,2cyclictest3419585-21kworker/0:008:43:370
3392778993630,3cyclictest1957309-1kworker/3:1H11:30:253
3392774993633,2cyclictest2693083-1kworker/2:2H07:45:262
3392765993632,2cyclictest3404151-21kworker/0:008:17:090
3392778993528,4cyclictest1957309-1kworker/3:1H09:04:383
3392774993532,2cyclictest2693083-1kworker/2:2H10:40:082
3392774993531,3cyclictest2693083-1kworker/2:2H11:20:062
3392765993532,2cyclictest3408770-21kworker/0:109:17:340
3392778993427,4cyclictest3432272-21kworker/3:109:36:053
3392778993427,4cyclictest3432272-21kworker/3:109:36:053
3392765993430,3cyclictest3041382-1kworker/0:1H08:55:210
3392774993226,4cyclictest2693083-1kworker/2:2H09:49:472
3392765993229,2cyclictest3473946-21kworker/0:210:19:590
3392765993126,3cyclictest3041382-1kworker/0:1H09:02:380
3392778992722,3cyclictest1957309-1kworker/3:1H12:10:293
339277099270,25cyclictest3392787-21sort07:10:011
3392774992621,3cyclictest2693083-1kworker/2:2H12:10:242
339276599261,22cyclictest3556637-21/usr/sbin/munin11:45:300
339276599260,23cyclictest3407912-21/usr/sbin/munin07:55:250
339277899251,21cyclictest0-21swapper/312:20:323
3392765992519,4cyclictest0-21swapper/011:39:380
339276599250,22cyclictest0-21swapper/007:10:010
3392765992419,3cyclictest0-21swapper/009:05:320
339277899150,5cyclictest3392784-21apt-config07:10:013
339277499157,5cyclictest3392870-21cmp07:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional