You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-03 - 18:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3.osadl.org (updated Wed Sep 03, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
409638996642,22cyclictest464314-21kworker/1:110:35:121
409638996340,20cyclictest500027-21kworker/1:112:05:151
40963899630,62cyclictest0-21swapper/108:30:431
409638996260,1cyclictest0-21swapper/109:48:371
409638996239,22cyclictest480284-21kworker/1:210:55:151
409638996143,17cyclictest450049-1kworker/1:0H11:15:161
409638996142,17cyclictest480284-21kworker/1:211:00:151
409638996142,17cyclictest4083290-1kworker/1:2H08:35:161
409638996141,19cyclictest450049-1kworker/1:0H11:55:011
409638996057,2cyclictest0-21swapper/111:40:221
409638996043,16cyclictest459702-21kworker/1:209:54:381
409638996043,16cyclictest407945-21kworker/1:107:20:131
409638996040,19cyclictest450049-1kworker/1:0H10:05:001
409638996040,19cyclictest450049-1kworker/1:0H10:04:591
409638996037,20cyclictest450049-1kworker/1:0H10:09:101
409638995956,2cyclictest0-21swapper/108:08:371
409638995944,14cyclictest509762-21kworker/1:012:10:171
409638995944,14cyclictest407945-21kworker/1:107:25:081
409638995943,14cyclictest450049-1kworker/1:0H10:44:131
409638995942,16cyclictest500027-21kworker/1:112:00:151
409638995942,16cyclictest500027-21kworker/1:111:45:481
409638995940,18cyclictest509762-21kworker/1:012:35:131
409638995940,18cyclictest447636-21kworker/1:009:25:141
409638995843,14cyclictest509762-21kworker/1:012:20:161
409638995843,14cyclictest509762-21kworker/1:012:20:161
409638995843,14cyclictest500027-21kworker/1:111:59:271
409638995843,14cyclictest464314-21kworker/1:110:15:161
409638995843,14cyclictest450049-1kworker/1:0H10:30:161
409638995843,14cyclictest447636-21kworker/1:009:14:031
409638995843,14cyclictest432948-21kworker/1:208:59:021
409638995843,14cyclictest421580-21kworker/1:207:45:011
409638995842,15cyclictest509762-21kworker/1:012:25:161
409638995842,15cyclictest480284-21kworker/1:211:10:011
409638995842,15cyclictest4083290-1kworker/1:2H08:15:071
409638995842,15cyclictest4083290-1kworker/1:2H07:53:541
409638995841,16cyclictest450049-1kworker/1:0H10:10:111
409638995841,16cyclictest447636-21kworker/1:009:05:141
409638995836,21cyclictest450049-1kworker/1:0H10:50:001
409638995742,14cyclictest509762-21kworker/1:012:15:181
409638995742,14cyclictest490271-21kworker/1:011:25:001
409638995742,14cyclictest480284-21kworker/1:210:50:231
409638995742,14cyclictest464314-21kworker/1:109:59:081
409638995742,14cyclictest447636-21kworker/1:009:15:011
409638995742,14cyclictest432948-21kworker/1:208:55:001
409638995742,14cyclictest425078-21kworker/1:008:14:371
409638995741,15cyclictest490271-21kworker/1:011:31:361
409638995741,15cyclictest464314-21kworker/1:110:20:131
409638995741,15cyclictest432948-21kworker/1:208:20:011
409638995741,15cyclictest425078-21kworker/1:007:58:481
409638995741,15cyclictest407945-21kworker/1:107:10:311
409638995641,14cyclictest490271-21kworker/1:011:20:161
409638995641,14cyclictest480284-21kworker/1:211:07:081
409638995641,14cyclictest480284-21kworker/1:211:07:071
409638995641,14cyclictest418556-21kworker/1:007:40:161
409638995640,15cyclictest447636-21kworker/1:009:30:341
409638995640,15cyclictest432948-21kworker/1:209:00:181
409638995640,15cyclictest432948-21kworker/1:208:45:141
409638995640,15cyclictest432948-21kworker/1:208:40:261
409638995639,16cyclictest464314-21kworker/1:110:25:011
409634995651,3cyclictest3839258-1kworker/0:1H12:29:370
409634995647,7cyclictest3839258-1kworker/0:1H11:35:010
409645995551,2cyclictest491292-21kworker/3:211:20:223
409638995540,14cyclictest432948-21kworker/1:208:25:151
409638995539,15cyclictest450049-1kworker/1:0H09:35:231
409638995539,15cyclictest407945-21kworker/1:107:15:131
409638995538,16cyclictest425078-21kworker/1:008:03:551
409638995534,19cyclictest407945-21kworker/1:107:30:151
409645995450,2cyclictest472423-21kworker/3:110:19:423
409638995450,2cyclictest419247-21latency07:35:141
409645995350,2cyclictest449440-21kworker/3:109:14:543
409638995336,16cyclictest450049-1kworker/1:0H09:41:031
409638995336,16cyclictest447636-21kworker/1:009:20:221
409638995334,18cyclictest497838-21kworker/1:211:35:181
409645995249,2cyclictest451062-21kworker/3:009:24:423
409645995247,3cyclictest455950-21kworker/3:209:55:153
409645995247,3cyclictest172859-1kworker/3:2H09:50:003
409643995248,2cyclictest2569080-1kworker/2:2H11:00:002
409645995147,2cyclictest418310-21kworker/3:007:47:083
409645995146,3cyclictest172859-1kworker/3:2H07:25:013
409634995146,3cyclictest407886-21kworker/0:007:33:360
409634995146,3cyclictest3839258-1kworker/0:1H11:13:370
409645995047,2cyclictest510790-21kworker/3:112:27:383
409638995034,15cyclictest509762-21kworker/1:012:30:151
409634995045,3cyclictest3839258-1kworker/0:1H10:40:240
409634995045,3cyclictest3839258-1kworker/0:1H09:17:360
409645994945,2cyclictest472423-21kworker/3:110:26:113
409643994944,3cyclictest507611-21kworker/2:212:05:142
409643994944,3cyclictest476057-21kworker/2:010:42:072
409634994944,3cyclictest3839258-1kworker/0:1H07:25:140
409645994842,3cyclictest172859-1kworker/3:2H07:30:163
409643994844,3cyclictest476057-21kworker/2:010:36:372
409634994845,2cyclictest510780-21kworker/0:012:31:380
409634994844,3cyclictest509162-21kworker/0:112:20:000
409634994844,2cyclictest491286-21kworker/0:011:20:130
409634994840,6cyclictest3839258-1kworker/0:1H07:10:140
409645994744,2cyclictest507546-21kworker/3:212:04:273
409645994743,3cyclictest172859-1kworker/3:2H11:35:373
409645994743,2cyclictest172859-1kworker/3:2H11:59:273
409645994742,3cyclictest472423-21kworker/3:111:07:373
409645994742,3cyclictest472423-21kworker/3:111:07:373
409643994744,2cyclictest4159163-21kworker/2:107:18:362
409643994743,3cyclictest4159163-21kworker/2:107:38:082
409643994743,2cyclictest2569080-1kworker/2:2H09:03:082
409643994742,3cyclictest2569080-1kworker/2:2H11:00:232
409643994742,3cyclictest2569080-1kworker/2:2H10:00:162
409643994742,3cyclictest2569080-1kworker/2:2H10:00:162
409634994744,2cyclictest461067-21kworker/0:009:52:370
409634994744,2cyclictest437816-21kworker/0:108:45:330
409634994743,2cyclictest488046-21kworker/0:111:10:000
409634994743,2cyclictest488046-21kworker/0:111:10:000
409634994740,4cyclictest3839258-1kworker/0:1H09:05:000
409634994737,7cyclictest3839258-1kworker/0:1H08:45:000
409645994643,2cyclictest418310-21kworker/3:007:40:013
409645994643,2cyclictest172859-1kworker/3:2H10:44:563
409645994642,3cyclictest472423-21kworker/3:110:34:443
409645994642,2cyclictest455950-21kworker/3:209:32:083
409645994640,3cyclictest172859-1kworker/3:2H11:30:013
409643994643,2cyclictest476057-21kworker/2:010:34:502
409643994642,3cyclictest439485-21kworker/2:008:50:312
409643994642,3cyclictest2569080-1kworker/2:2H12:20:212
409643994642,3cyclictest2569080-1kworker/2:2H12:20:212
409643994642,2cyclictest507611-21kworker/2:212:35:492
409643994642,2cyclictest451115-21kworker/2:109:30:072
409643994642,2cyclictest432932-21kworker/2:108:34:012
409643994641,3cyclictest451115-21kworker/2:109:59:022
409634994643,2cyclictest428076-21kworker/0:008:05:220
409634994642,3cyclictest407886-21kworker/0:007:39:020
409634994640,4cyclictest3839258-1kworker/0:1H07:54:080
409645994541,2cyclictest409352-21kworker/3:107:10:313
409645994540,3cyclictest426438-21kworker/3:007:59:193
409645994540,3cyclictest172859-1kworker/3:2H10:59:163
409643994542,2cyclictest4159163-21kworker/2:107:25:372
409643994541,2cyclictest476057-21kworker/2:011:28:012
409643994541,2cyclictest432932-21kworker/2:108:36:432
409643994540,3cyclictest4159163-21kworker/2:107:32:082
409634994542,2cyclictest461067-21kworker/0:009:48:020
409634994541,3cyclictest3839258-1kworker/0:1H08:25:020
409634994540,3cyclictest3839258-1kworker/0:1H12:02:440
409645994441,2cyclictest455950-21kworker/3:210:04:153
409645994441,2cyclictest455950-21kworker/3:210:04:153
409645994440,3cyclictest510790-21kworker/3:112:22:383
409645994440,3cyclictest510790-21kworker/3:112:22:383
409645994440,2cyclictest472423-21kworker/3:110:52:363
409643994440,3cyclictest429763-21kworker/2:208:15:142
409643994440,3cyclictest2569080-1kworker/2:2H07:20:172
409643994440,2cyclictest476057-21kworker/2:011:11:362
409643994440,2cyclictest451115-21kworker/2:109:43:382
409643994440,2cyclictest439485-21kworker/2:008:59:082
409643994439,3cyclictest2569080-1kworker/2:2H10:29:122
409643994438,3cyclictest2569080-1kworker/2:2H11:35:182
409634994441,2cyclictest455935-21kworker/0:109:30:330
409634994439,3cyclictest3839258-1kworker/0:1H09:35:320
409634994438,4cyclictest3839258-1kworker/0:1H08:54:360
409634994438,4cyclictest3839258-1kworker/0:1H07:16:370
409634994438,3cyclictest3839258-1kworker/0:1H10:00:140
409634994438,3cyclictest3839258-1kworker/0:1H10:00:140
409634994436,5cyclictest3839258-1kworker/0:1H08:14:060
409634994434,7cyclictest3839258-1kworker/0:1H10:54:160
409634994430,9cyclictest461067-21kworker/0:010:05:430
409645994340,2cyclictest489673-21kworker/3:011:14:243
409645994340,2cyclictest409352-21kworker/3:107:26:203
409645994339,2cyclictest426438-21kworker/3:008:02:383
409645994339,2cyclictest418310-21kworker/3:007:44:063
409645994338,3cyclictest172859-1kworker/3:2H09:05:063
409643994340,2cyclictest439485-21kworker/2:008:46:022
409643994340,2cyclictest432932-21kworker/2:108:27:372
409643994340,2cyclictest4159163-21kworker/2:107:12:372
409643994338,3cyclictest2569080-1kworker/2:2H12:04:282
409634994341,1cyclictest505901-21kworker/0:212:05:220
409634994337,3cyclictest3839258-1kworker/0:1H07:20:120
409645994239,2cyclictest455950-21kworker/3:209:53:013
409645994239,2cyclictest428079-21kworker/3:108:10:223
409645994238,3cyclictest172859-1kworker/3:2H08:29:553
409645994238,2cyclictest172859-1kworker/3:2H11:45:143
409645994236,3cyclictest172859-1kworker/3:2H11:54:273
409643994239,2cyclictest476057-21kworker/2:011:58:072
409643994239,2cyclictest426472-21kworker/2:008:05:112
409643994239,2cyclictest2569080-1kworker/2:2H09:13:362
409643994237,3cyclictest476057-21kworker/2:011:22:132
409643994237,3cyclictest2569080-1kworker/2:2H11:05:162
409643994237,3cyclictest2569080-1kworker/2:2H11:05:162
409643994237,3cyclictest2569080-1kworker/2:2H09:35:142
409634994239,2cyclictest515669-21kworker/0:112:38:030
409634994238,2cyclictest437816-21kworker/0:108:57:370
409634994237,3cyclictest3839258-1kworker/0:1H09:40:270
409634994237,3cyclictest3839258-1kworker/0:1H08:31:080
409634994237,3cyclictest3839258-1kworker/0:1H07:49:360
409634994236,3cyclictest3839258-1kworker/0:1H11:27:070
409645994138,2cyclictest499402-21kworker/3:011:40:433
409645994138,2cyclictest472423-21kworker/3:110:39:453
409645994138,2cyclictest455950-21kworker/3:210:12:363
409645994137,2cyclictest432942-21kworker/3:208:45:213
409645994137,2cyclictest432942-21kworker/3:208:38:553
409645994137,2cyclictest172859-1kworker/3:2H07:15:133
409645994136,3cyclictest172859-1kworker/3:2H08:59:023
409643994138,2cyclictest507611-21kworker/2:212:15:172
409643994138,2cyclictest476057-21kworker/2:011:47:362
409643994138,2cyclictest465964-21kworker/2:210:11:372
409643994138,2cyclictest451115-21kworker/2:109:25:222
409643994138,2cyclictest439485-21kworker/2:008:43:072
409634994138,2cyclictest3839258-1kworker/0:1H10:15:420
409634994137,2cyclictest447579-21kworker/0:009:10:230
409645994037,2cyclictest472423-21kworker/3:110:24:123
409645994036,2cyclictest428079-21kworker/3:108:17:363
409645994036,2cyclictest172859-1kworker/3:2H08:54:073
409643994037,2cyclictest507611-21kworker/2:212:30:382
409643994037,2cyclictest476057-21kworker/2:011:15:372
409643994037,2cyclictest2569080-1kworker/2:2H07:50:172
409643994036,2cyclictest4159163-21kworker/2:107:55:432
409643994036,2cyclictest2569080-1kworker/2:2H10:50:222
409643994036,2cyclictest2569080-1kworker/2:2H10:20:002
409643994036,2cyclictest2569080-1kworker/2:2H08:00:172
409634994037,2cyclictest481305-21kworker/0:011:03:360
409634994036,3cyclictest491286-21kworker/0:011:20:000
409634994034,3cyclictest3839258-1kworker/0:1H09:29:040
409645993936,2cyclictest455950-21kworker/3:209:38:013
409645993936,2cyclictest172859-1kworker/3:2H12:10:313
409645993935,3cyclictest432942-21kworker/3:209:04:023
409645993933,3cyclictest172859-1kworker/3:2H09:26:203
409643993936,2cyclictest2569080-1kworker/2:2H10:45:012
409643993934,3cyclictest2569080-1kworker/2:2H11:30:142
409634993936,2cyclictest481305-21kworker/0:010:47:090
409634993936,2cyclictest432931-21kworker/0:208:22:020
409634993936,2cyclictest3839258-1kworker/0:1H11:52:370
409634993935,3cyclictest3839258-1kworker/0:1H07:55:130
409634993934,3cyclictest3839258-1kworker/0:1H12:10:320
409634993933,3cyclictest3839258-1kworker/0:1H10:59:170
409645993835,2cyclictest517271-21kworker/3:012:35:543
409643993834,3cyclictest2569080-1kworker/2:2H10:20:062
409643993834,2cyclictest451115-21kworker/2:109:19:482
409643993834,2cyclictest432932-21kworker/2:108:23:512
409634993835,2cyclictest3839258-1kworker/0:1H09:56:080
409634993834,2cyclictest3839258-1kworker/0:1H10:26:420
409634993831,4cyclictest3839258-1kworker/0:1H11:45:140
409634993827,8cyclictest3839258-1kworker/0:1H10:15:000
40963499380,1cyclictest0-21swapper/012:00:000
409645993734,2cyclictest507546-21kworker/3:212:05:383
409645993734,2cyclictest432942-21kworker/3:208:44:373
409645993734,2cyclictest432942-21kworker/3:208:32:373
409645993733,2cyclictest491292-21kworker/3:211:16:023
409643993733,2cyclictest2569080-1kworker/2:2H11:54:242
409634993734,2cyclictest407886-21kworker/0:007:43:460
409634993733,2cyclictest498043-21kworker/0:211:44:550
409645993633,2cyclictest472423-21kworker/3:111:01:363
409645993633,2cyclictest472423-21kworker/3:110:46:083
409645993633,2cyclictest432942-21kworker/3:208:20:063
409643993633,2cyclictest2569080-1kworker/2:2H09:22:372
409634993633,2cyclictest444316-21kworker/0:209:20:220
409634993631,3cyclictest3839258-1kworker/0:1H10:30:350
409634993619,14cyclictest479080-21sensors10:35:170
409634993613,20cyclictest498578-21hwlatdetect11:35:190
409645993532,2cyclictest491292-21kworker/3:211:30:253
409643993531,2cyclictest2569080-1kworker/2:2H12:29:312
409643993530,3cyclictest451115-21kworker/2:109:46:372
409643993530,3cyclictest4159163-21kworker/2:107:47:022
409645993431,2cyclictest451062-21kworker/3:009:17:333
409645993431,2cyclictest428079-21kworker/3:108:08:553
409645993430,2cyclictest510790-21kworker/3:112:19:083
409643993430,2cyclictest2569080-1kworker/2:2H07:40:152
409634993431,2cyclictest510780-21kworker/0:012:24:080
409634993431,2cyclictest510780-21kworker/0:012:24:080
409634993431,2cyclictest437816-21kworker/0:108:38:110
409634993430,3cyclictest53250irq/160-enp0s2909:09:550
409645993330,2cyclictest423191-21kworker/3:207:50:373
409645993329,3cyclictest172859-1kworker/3:2H09:44:563
409645993329,2cyclictest510790-21kworker/3:112:30:283
409643993330,2cyclictest439485-21kworker/2:009:05:502
409643993328,3cyclictest2569080-1kworker/2:2H11:40:142
40963499333,7cyclictest432006-21tail08:15:150
40963499331,5cyclictest428321-21latency_hist08:05:010
409645993128,2cyclictest455950-21kworker/3:210:09:083
409643993027,2cyclictest465964-21kworker/2:210:05:432
40963499301,13cyclictest0-21swapper/010:20:190
409643992824,3cyclictest507611-21kworker/2:212:14:362
40963899271,4cyclictest409773-21latency_hist07:10:001
409643992623,2cyclictest451115-21kworker/2:109:54:132
409634992610,4cyclictest3839258-1kworker/0:1H07:10:000
409643992522,2cyclictest429763-21kworker/2:208:12:022
40964599133,3cyclictest151rcu_preempt07:10:013
40964399113,2cyclictest151rcu_preempt07:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional