You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-17 - 16:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot3.osadl.org (updated Mon Jun 17, 2024 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3387084996761,5cyclictest0-21swapper/120:50:161
3387084996734,32cyclictest3530417-21kworker/1:223:55:111
3387084996634,30cyclictest3545494-21kworker/1:100:10:171
3387084996517,47cyclictest3386914-21kworker/1:219:30:171
3387084996242,19cyclictest3403327-21kworker/1:120:00:181
338708499620,60cyclictest0-21swapper/123:20:071
3387084996144,16cyclictest3440682-21kworker/1:221:37:491
3387084996048,10cyclictest0-21swapper/123:40:141
338708499593,55cyclictest0-21swapper/122:03:071
3387084995927,30cyclictest1306556-1kworker/1:0H19:40:011
3387084995855,2cyclictest0-21swapper/121:40:281
338708499583,54cyclictest3398696-21kworker/1:019:45:171
3387084995829,28cyclictest3409763-21kworker/1:220:40:141
338708499580,57cyclictest636-21sshd23:28:001
3387084995742,14cyclictest3545494-21kworker/1:100:00:031
3387084995742,14cyclictest3545494-21kworker/1:100:00:021
3387084995741,15cyclictest3426171-1kworker/1:2H22:30:131
3387084995741,15cyclictest3386914-21kworker/1:219:17:341
3387084995738,18cyclictest3479722-1kworker/1:1H23:05:011
3387084995729,27cyclictest3479722-1kworker/1:1H22:50:161
3387084995727,29cyclictest3445175-21kworker/1:021:55:121
338708499571,2cyclictest3464245-21cron22:14:591
3387088995651,3cyclictest3368625-1kworker/2:0H19:20:492
3387084995647,7cyclictest3419040-21timerwakeupswit20:45:251
3387084995641,14cyclictest3403327-21kworker/1:120:15:171
3387084995640,15cyclictest3426171-1kworker/1:2H21:20:141
3387084995640,15cyclictest3409763-21kworker/1:220:29:431
3387084995639,16cyclictest3545494-21kworker/1:100:05:141
3387084995639,16cyclictest3461724-21kworker/1:122:15:001
3387084995637,18cyclictest3397091-21kworker/1:119:40:161
3387084995635,19cyclictest1306556-1kworker/1:0H19:20:151
3387084995631,23cyclictest3479722-1kworker/1:1H00:25:001
338708499561,53cyclictest0-21swapper/122:55:241
3387084995540,14cyclictest3558269-21kworker/1:000:25:141
3387084995540,14cyclictest3545494-21kworker/1:100:15:061
3387084995540,14cyclictest3516529-21kworker/1:023:30:271
3387084995540,14cyclictest3511764-21kworker/1:123:15:131
3387084995540,14cyclictest3433533-21kworker/1:121:31:411
3387084995539,15cyclictest3573712-21kworker/1:200:35:261
3387084995539,15cyclictest3507269-21kworker/1:323:10:161
3387084995539,15cyclictest3470448-21kworker/1:022:35:141
3387084995539,15cyclictest3461724-21kworker/1:122:20:181
3387084995539,15cyclictest3422285-21kworker/1:221:17:141
3387084995538,16cyclictest3470448-21kworker/1:022:40:151
3387088995449,3cyclictest3368625-1kworker/2:0H20:03:432
3387088995444,8cyclictest3368625-1kworker/2:0H23:40:232
3387084995451,1cyclictest0-21swapper/121:10:241
3387084995439,14cyclictest3422285-21kworker/1:221:02:441
3387084995439,14cyclictest3422285-21kworker/1:221:02:441
3387084995439,14cyclictest3409763-21kworker/1:220:30:131
3387084995438,15cyclictest3568733-21kworker/1:100:30:171
3387084995438,15cyclictest3479722-1kworker/1:1H23:37:421
3387084995438,15cyclictest3417730-21kworker/1:120:55:291
3387084995438,15cyclictest3398696-21kworker/1:019:50:151
3387084995438,15cyclictest3386914-21kworker/1:219:25:141
338708499541,3cyclictest377-21systemd-journal22:30:001
3387090995347,3cyclictest3412791-21kworker/3:120:30:013
3387090995344,7cyclictest4136088-1kworker/3:0H19:40:003
3387084995343,9cyclictest26250irq/16-i801_smb21:07:451
3387084995343,9cyclictest26250irq/16-i801_smb21:07:451
3387084995339,14cyclictest3445175-21kworker/1:021:51:421
3387084995338,14cyclictest3386914-21kworker/1:219:10:191
3387084995337,15cyclictest3445175-21kworker/1:022:05:331
3387084995337,15cyclictest3445175-21kworker/1:021:45:281
3387084995337,15cyclictest3409763-21kworker/1:220:35:001
3387084995337,15cyclictest3409763-21kworker/1:220:20:011
338708499531,1cyclictest0-21swapper/121:27:131
3387081995349,2cyclictest3519456-21kworker/0:123:35:050
3387090995247,3cyclictest4136088-1kworker/3:0H21:51:423
3387090995247,3cyclictest4136088-1kworker/3:0H20:05:183
3387090995246,4cyclictest4136088-1kworker/3:0H21:19:553
3387090995240,9cyclictest4136088-1kworker/3:0H23:00:213
3387088995247,3cyclictest3368625-1kworker/2:0H19:39:082
3387088995246,4cyclictest3454697-21kworker/2:122:45:232
3387084995237,14cyclictest3398696-21kworker/1:019:55:141
3387084995236,15cyclictest3500219-21kworker/1:023:05:141
3387084995236,15cyclictest3403327-21kworker/1:120:10:011
338708499521,1cyclictest0-21swapper/122:46:321
3387090995143,6cyclictest4136088-1kworker/3:0H22:19:553
3387088995147,2cyclictest3368625-1kworker/2:0H19:47:122
3387088995145,3cyclictest3409762-21kworker/2:020:45:012
3387084995136,14cyclictest3403327-21kworker/1:120:05:121
3387084995134,16cyclictest3530417-21kworker/1:223:50:161
338708499510,2cyclictest0-21swapper/123:45:511
3387081995147,2cyclictest3569508-21kworker/0:000:35:230
3387081995146,3cyclictest3548787-21kworker/0:200:33:340
3387081995146,3cyclictest3529129-21kworker/0:023:41:120
3387081995146,3cyclictest3491177-21kworker/0:223:14:170
3387081995146,3cyclictest3464499-21kworker/0:222:20:170
3387090995045,3cyclictest3476768-21kworker/3:122:46:423
3387090995045,3cyclictest3400730-21kworker/3:020:24:553
3387090995044,3cyclictest4136088-1kworker/3:0H23:38:013
3387088995045,3cyclictest3541270-21kworker/2:200:10:002
3387088995045,3cyclictest3381289-21kworker/2:319:30:212
3387088995038,2cyclictest3368625-1kworker/2:0H23:30:272
3387081995045,3cyclictest3250163-1kworker/0:2H00:26:420
3387090994946,2cyclictest3419209-21kworker/3:221:12:523
3387090994944,3cyclictest4136088-1kworker/3:0H21:07:423
3387090994944,3cyclictest4136088-1kworker/3:0H21:07:423
3387090994944,3cyclictest3567348-21kworker/3:000:30:353
3387090994944,3cyclictest3514636-21kworker/3:223:49:073
3387090994944,3cyclictest3476768-21kworker/3:123:06:423
3387088994946,2cyclictest3423899-21kworker/2:221:15:062
3387088994944,3cyclictest3368625-1kworker/2:0H20:59:132
3387088994936,3cyclictest3368625-1kworker/2:0H23:48:362
3387081994945,2cyclictest3404822-21kworker/0:020:08:120
3387081994944,3cyclictest3548787-21kworker/0:200:05:200
3387081994944,3cyclictest3495873-21kworker/0:023:00:110
3387081994944,3cyclictest3439766-21kworker/0:121:42:430
3387090994843,3cyclictest3567348-21kworker/3:000:38:533
3387090994843,3cyclictest3419209-21kworker/3:221:55:063
3387090994837,9cyclictest4136088-1kworker/3:0H21:40:013
3387088994845,2cyclictest3454697-21kworker/2:123:10:272
3387088994845,2cyclictest3409762-21kworker/2:020:50:142
3387088994844,3cyclictest3368625-1kworker/2:0H23:15:182
3387088994843,3cyclictest3447934-21kworker/2:021:46:412
3387088994843,3cyclictest3368625-1kworker/2:0H21:03:122
3387088994843,3cyclictest3368625-1kworker/2:0H21:03:122
3387088994843,3cyclictest3368625-1kworker/2:0H19:53:412
3387088994842,4cyclictest3541270-21kworker/2:200:30:302
3387088994842,3cyclictest3368625-1kworker/2:0H19:40:162
3387081994845,2cyclictest3491177-21kworker/0:223:20:320
3387081994844,2cyclictest3250163-1kworker/0:2H23:31:170
3387081994844,2cyclictest3250163-1kworker/0:2H23:20:010
3387081994843,3cyclictest3529129-21kworker/0:023:50:410
3387081994843,3cyclictest3404822-21kworker/0:020:20:260
3387090994743,2cyclictest3514636-21kworker/3:200:09:553
3387090994742,3cyclictest3419209-21kworker/3:222:30:003
3387088994742,3cyclictest3454697-21kworker/2:123:05:182
3387081994744,2cyclictest3389371-21kworker/0:019:20:120
3387081994743,3cyclictest3445205-21kworker/0:022:07:570
3387090994643,2cyclictest4136088-1kworker/3:0H20:40:053
3387090994643,2cyclictest3419209-21kworker/3:220:54:123
3387090994642,2cyclictest3419209-21kworker/3:221:23:123
3387090994641,3cyclictest4136088-1kworker/3:0H00:18:493
3387090994641,3cyclictest3388615-21kworker/3:019:29:553
3387088994643,2cyclictest3454697-21kworker/2:122:25:442
3387088994643,2cyclictest3454697-21kworker/2:122:20:472
3387088994642,3cyclictest3423899-21kworker/2:221:40:002
3387088994641,3cyclictest3541270-21kworker/2:200:10:162
3387081994643,2cyclictest3491177-21kworker/0:222:53:120
3387081994641,3cyclictest3250163-1kworker/0:2H22:25:080
3387081994640,4cyclictest3250163-1kworker/0:2H22:13:420
3387090994542,2cyclictest3388615-21kworker/3:019:12:163
3387090994541,2cyclictest4136088-1kworker/3:0H19:32:423
3387090994540,3cyclictest4136088-1kworker/3:0H00:25:143
3387090994540,3cyclictest3514636-21kworker/3:223:20:263
3387090994540,3cyclictest3476768-21kworker/3:122:41:413
3387090994540,3cyclictest3476768-21kworker/3:122:35:313
3387090994539,4cyclictest4136088-1kworker/3:0H22:35:013
3387088994540,3cyclictest3368625-1kworker/2:0H19:27:422
3387088994538,5cyclictest3368625-1kworker/2:0H00:03:412
3387088994538,5cyclictest3368625-1kworker/2:0H00:03:412
3387081994542,2cyclictest3491177-21kworker/0:223:08:010
3387081994540,3cyclictest3250163-1kworker/0:2H00:17:320
3387081994540,2cyclictest3250163-1kworker/0:2H22:45:140
3387090994441,2cyclictest4136088-1kworker/3:0H20:01:493
3387090994440,2cyclictest3419209-21kworker/3:221:47:123
3387090994439,3cyclictest4136088-1kworker/3:0H23:15:133
3387090994439,3cyclictest3514636-21kworker/3:223:50:223
3387088994441,2cyclictest3368625-1kworker/2:0H00:15:322
3387088994439,3cyclictest3409762-21kworker/2:020:35:132
3387088994439,3cyclictest3368625-1kworker/2:0H23:36:102
3387081994440,3cyclictest3250163-1kworker/0:2H19:56:410
3387081994440,2cyclictest3404822-21kworker/0:020:15:060
3387081994440,2cyclictest3382800-21kworker/0:119:25:140
3387081994440,2cyclictest3250163-1kworker/0:2H20:29:420
3387081994439,3cyclictest3529129-21kworker/0:023:45:200
3387090994338,3cyclictest4136088-1kworker/3:0H22:20:323
3387090994338,3cyclictest4136088-1kworker/3:0H21:31:413
3387090994338,3cyclictest4136088-1kworker/3:0H20:17:413
3387090994338,3cyclictest4136088-1kworker/3:0H19:47:403
3387090994338,3cyclictest3388615-21kworker/3:019:19:413
3387090994337,4cyclictest4136088-1kworker/3:0H20:30:133
3387088994340,2cyclictest3454697-21kworker/2:122:43:072
3387088994340,2cyclictest3454697-21kworker/2:122:00:322
3387088994339,2cyclictest3541270-21kworker/2:223:57:342
3387088994339,2cyclictest3541270-21kworker/2:200:23:232
3387088994338,3cyclictest3454697-21kworker/2:122:34:422
3387088994338,3cyclictest3368625-1kworker/2:0H21:08:072
3387088994338,3cyclictest3368625-1kworker/2:0H21:08:072
3387088994337,3cyclictest3423899-21kworker/2:221:40:062
3387081994340,2cyclictest3548787-21kworker/0:200:20:110
3387081994339,3cyclictest3445205-21kworker/0:021:52:120
3387081994339,2cyclictest3250163-1kworker/0:2H20:55:270
3387081994338,3cyclictest3445205-21kworker/0:021:59:410
3387081994336,4cyclictest3250163-1kworker/0:2H22:35:160
3387081994336,4cyclictest3250163-1kworker/0:2H20:37:380
3387090994239,2cyclictest4136088-1kworker/3:0H20:48:413
3387090994236,4cyclictest4136088-1kworker/3:0H23:55:053
3387090994229,10cyclictest4136088-1kworker/3:0H21:27:483
3387090994225,14cyclictest4136088-1kworker/3:0H19:20:143
3387088994239,2cyclictest3368625-1kworker/2:0H23:52:412
3387088994239,2cyclictest3368625-1kworker/2:0H22:09:082
3387088994238,3cyclictest3368625-1kworker/2:0H23:03:012
3387088994237,3cyclictest3368625-1kworker/2:0H21:22:472
3387088994235,4cyclictest3368625-1kworker/2:0H20:47:402
3387081994238,2cyclictest3439766-21kworker/0:121:38:420
3387081994238,2cyclictest3382800-21kworker/0:119:46:410
3387081994237,3cyclictest3250163-1kworker/0:2H19:15:360
3387081994236,4cyclictest3422360-21kworker/0:321:27:480
3387081994235,4cyclictest3404822-21kworker/0:020:15:000
3387088994138,2cyclictest3368625-1kworker/2:0H20:30:192
3387088994137,3cyclictest3368625-1kworker/2:0H22:56:112
3387088994136,3cyclictest3381289-21kworker/2:320:20:122
3387081994137,2cyclictest3250163-1kworker/0:2H22:17:510
3387081994136,3cyclictest3417677-21kworker/0:120:45:430
3387081994135,4cyclictest3250163-1kworker/0:2H21:20:340
3387081994134,5cyclictest3491177-21kworker/0:222:55:350
3387081994134,4cyclictest3250163-1kworker/0:2H21:05:170
3387081994134,4cyclictest3250163-1kworker/0:2H21:05:160
3387081994134,4cyclictest3250163-1kworker/0:2H20:30:140
3387090994037,2cyclictest4136088-1kworker/3:0H21:00:023
3387090994037,2cyclictest4136088-1kworker/3:0H21:00:013
3387090994036,3cyclictest3419209-21kworker/3:220:55:193
3387090994036,2cyclictest4136088-1kworker/3:0H22:55:133
3387090994036,2cyclictest3514636-21kworker/3:223:29:593
3387090994036,2cyclictest3419209-21kworker/3:222:04:543
3387088994037,2cyclictest3454697-21kworker/2:122:12:512
3387088994037,2cyclictest3368625-1kworker/2:0H20:29:432
3387088994037,2cyclictest3368625-1kworker/2:0H20:14:072
3387088994036,2cyclictest3368625-1kworker/2:0H20:05:122
3387088994035,3cyclictest3368625-1kworker/2:0H22:20:002
3387088994035,3cyclictest3368625-1kworker/2:0H00:25:482
338708499400,37cyclictest3387148-21grep19:10:001
3387081994037,2cyclictest3422360-21kworker/0:321:16:180
3387090993936,2cyclictest4136088-1kworker/3:0H23:40:113
3387090993936,2cyclictest4136088-1kworker/3:0H00:04:133
3387090993936,2cyclictest4136088-1kworker/3:0H00:04:123
3387090993935,2cyclictest3400730-21kworker/3:019:50:193
338709099390,3cyclictest377-21systemd-journal22:14:593
3387088993936,2cyclictest3423899-21kworker/2:221:30:122
3387088993936,2cyclictest3420801-21kworker/2:121:11:102
3387088993934,3cyclictest3368625-1kworker/2:0H21:53:082
3387090993835,2cyclictest4136088-1kworker/3:0H20:35:423
3387090993833,3cyclictest3514636-21kworker/3:200:11:143
3387090993832,4cyclictest3419209-21kworker/3:222:09:593
3387090993818,7cyclictest377-21systemd-journal20:00:003
3387088993835,2cyclictest3368625-1kworker/2:0H23:28:082
3387088993834,3cyclictest3541270-21kworker/2:200:35:312
3387081993834,2cyclictest3483019-21kworker/0:122:43:420
3387081993833,3cyclictest3250163-1kworker/0:2H20:00:060
3387090993733,3cyclictest4136088-1kworker/3:0H19:43:083
3387088993733,3cyclictest3368625-1kworker/2:0H22:54:062
3387088993733,3cyclictest3368625-1kworker/2:0H19:10:322
3387088993733,2cyclictest3368625-1kworker/2:0H21:55:282
3387088993732,3cyclictest3368625-1kworker/2:0H20:15:312
3387081993733,2cyclictest3416120-21kworker/0:020:40:210
3387081993732,3cyclictest3250163-1kworker/0:2H23:56:130
3387081993731,4cyclictest3250163-1kworker/0:2H22:03:070
3387081993730,4cyclictest3250163-1kworker/0:2H19:40:140
3387081993728,7cyclictest3250163-1kworker/0:2H21:47:500
338709099364,21cyclictest40-21ksoftirqd/322:52:513
3387090993632,3cyclictest3562798-21kworker/3:100:24:423
3387090993632,2cyclictest4136088-1kworker/3:0H20:10:123
3387081993632,3cyclictest3422360-21kworker/0:321:32:120
3387081993632,2cyclictest3395541-21kworker/0:019:34:410
3387081993632,2cyclictest3382800-21kworker/0:119:50:440
3387081993631,3cyclictest3250163-1kworker/0:2H22:30:110
3387090993531,3cyclictest4136088-1kworker/3:0H23:13:083
3387081993531,3cyclictest3250163-1kworker/0:2H00:10:110
3387081993530,4cyclictest3250163-1kworker/0:2H23:28:000
3387088993429,3cyclictest3368625-1kworker/2:0H22:39:072
3387081993430,2cyclictest3382800-21kworker/0:119:35:360
3387081993430,2cyclictest3382800-21kworker/0:119:10:430
338709099331,20cyclictest3425416-21diskmemload23:33:133
3387088993330,2cyclictest3423899-21kworker/2:221:25:362
3387088993328,3cyclictest3381289-21kworker/2:319:57:402
3387081993328,3cyclictest3250163-1kworker/0:2H21:10:410
3387088993228,2cyclictest3381289-21kworker/2:319:15:052
3387081993227,3cyclictest3250163-1kworker/0:2H00:00:170
3387081993227,3cyclictest3250163-1kworker/0:2H00:00:160
3387088993127,3cyclictest3368625-1kworker/2:0H23:22:412
3387090992924,3cyclictest3419209-21kworker/3:221:41:413
3387081992924,3cyclictest3250163-1kworker/0:2H20:50:090
338708199251,21cyclictest3422589-21apt-get21:00:130
338708199251,21cyclictest3422589-21apt-get21:00:130
338709099230,21cyclictest3387015-21apt-key19:10:003
338708899122,2cyclictest151rcu_preempt19:10:002
3387081991210,1cyclictest3387015-21apt-key19:10:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional