You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-19 - 06:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3.osadl.org (updated Sat Jul 19, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
736257996462,1cyclictest0-21swapper/120:59:131
736257996461,2cyclictest0-21swapper/120:40:531
736257996361,1cyclictest0-21swapper/121:10:411
736257996361,1cyclictest0-21swapper/119:50:451
73625799620,61cyclictest0-21swapper/119:55:061
736257996058,1cyclictest0-21swapper/122:29:131
736257996038,20cyclictest796190-21kworker/1:222:55:181
736257995855,2cyclictest0-21swapper/120:35:261
736257995855,2cyclictest0-21swapper/100:29:351
736257995843,14cyclictest830499-21kworker/1:200:04:541
736257995841,16cyclictest767970-21kworker/1:020:45:171
736257995840,16cyclictest793982-21kworker/1:122:05:141
736257995838,18cyclictest835051-21kworker/1:000:15:141
73625799580,57cyclictest0-21swapper/121:40:001
736257995754,2cyclictest0-21swapper/122:32:141
736257995743,14cyclictest733125-21kworker/1:020:05:171
736257995742,14cyclictest818358-21kworker/1:023:50:211
736257995742,14cyclictest818358-21kworker/1:023:24:391
736257995742,14cyclictest796190-21kworker/1:222:45:151
736257995742,14cyclictest786442-21kworker/1:021:45:171
736257995742,14cyclictest776379-21kworker/1:121:30:001
736257995742,14cyclictest756952-21kworker/1:220:15:001
736257995742,14cyclictest2850952-1kworker/1:2H22:35:161
736257995742,14cyclictest2850952-1kworker/1:2H20:30:061
736257995741,15cyclictest786442-21kworker/1:021:50:171
736257995740,16cyclictest2850952-1kworker/1:2H20:14:481
736257995739,17cyclictest767970-21kworker/1:021:00:151
736257995718,33cyclictest774251-21kworker/1:221:10:001
736254995751,4cyclictest2879081-1kworker/0:2H22:31:380
736257995642,14cyclictest830499-21kworker/1:223:55:181
736257995642,14cyclictest756952-21kworker/1:220:25:001
736257995641,14cyclictest830499-21kworker/1:200:05:211
736257995641,14cyclictest818358-21kworker/1:023:45:011
736257995641,14cyclictest818358-21kworker/1:023:40:011
736257995641,14cyclictest818358-21kworker/1:023:35:071
736257995641,14cyclictest815061-21kworker/1:223:10:001
736257995641,14cyclictest796190-21kworker/1:222:51:251
736257995641,14cyclictest796190-21kworker/1:222:15:001
736257995641,14cyclictest776379-21kworker/1:121:20:161
736257995641,14cyclictest767970-21kworker/1:020:50:181
736257995641,14cyclictest733125-21kworker/1:019:35:171
736257995640,15cyclictest796190-21kworker/1:222:40:181
736257995636,18cyclictest2850952-1kworker/1:2H22:00:001
736257995553,1cyclictest0-21swapper/121:44:131
736257995540,14cyclictest2850952-1kworker/1:2H20:20:561
736257995538,16cyclictest733125-21kworker/1:019:45:191
736261995450,2cyclictest789104-21kworker/2:222:56:032
736261995448,4cyclictest1501592-1kworker/2:2H20:20:002
736257995439,14cyclictest815061-21kworker/1:223:15:181
736257995439,14cyclictest786442-21kworker/1:022:00:151
736257995439,14cyclictest733125-21kworker/1:020:00:011
736257995439,14cyclictest733125-21kworker/1:019:40:181
736257995439,14cyclictest733125-21kworker/1:019:30:151
736257995438,15cyclictest835051-21kworker/1:000:10:161
736257995436,17cyclictest733125-21kworker/1:019:25:001
73625799540,52cyclictest0-21swapper/122:15:191
73625799540,52cyclictest0-21swapper/119:15:401
736261995349,2cyclictest789104-21kworker/2:222:13:132
736257995339,14cyclictest835051-21kworker/1:000:24:031
736257995339,14cyclictest796190-21kworker/1:222:20:161
736257995338,14cyclictest811855-21kworker/1:023:05:151
736257995338,14cyclictest776379-21kworker/1:121:25:151
736257995337,15cyclictest835051-21kworker/1:000:30:151
736257995335,16cyclictest835051-21kworker/1:000:35:151
736264995245,5cyclictest2672433-1kworker/3:2H19:45:133
736264995245,5cyclictest2672433-1kworker/3:2H00:39:243
736264995244,5cyclictest2672433-1kworker/3:2H20:17:063
736261995249,2cyclictest789104-21kworker/2:223:25:062
736261995249,2cyclictest789104-21kworker/2:200:15:002
736261995247,3cyclictest841587-21kworker/2:000:37:492
736261995247,3cyclictest831857-21kworker/2:100:04:472
736261995247,3cyclictest789104-21kworker/2:223:21:142
736257995237,14cyclictest818358-21kworker/1:023:28:441
736257995237,14cyclictest776379-21kworker/1:121:15:141
736257995237,14cyclictest733125-21kworker/1:019:25:151
736254995247,3cyclictest2879081-1kworker/0:2H22:53:380
736254995246,3cyclictest2879081-1kworker/0:2H21:50:150
736261995148,2cyclictest723180-21kworker/2:120:32:432
736257995135,15cyclictest818358-21kworker/1:023:34:441
736257995135,15cyclictest811855-21kworker/1:023:01:271
73625799511,49cyclictest0-21swapper/119:12:121
736254995148,2cyclictest733318-21kworker/0:119:15:310
736264995042,5cyclictest2672433-1kworker/3:2H00:08:163
736261995047,2cyclictest766163-21kworker/2:220:55:412
736261995046,2cyclictest789104-21kworker/2:223:34:372
736261995046,2cyclictest772571-21kworker/2:121:41:492
736254995047,2cyclictest815054-21kworker/0:123:43:120
736254995047,2cyclictest792562-21kworker/0:022:24:120
736254995047,2cyclictest776076-21kworker/0:121:12:060
736254995046,2cyclictest733318-21kworker/0:120:13:440
736254995045,3cyclictest2879081-1kworker/0:2H22:11:120
736264994944,3cyclictest2672433-1kworker/3:2H23:15:303
736264994942,4cyclictest2672433-1kworker/3:2H20:00:153
736261994946,2cyclictest789104-21kworker/2:223:50:052
736261994945,2cyclictest789104-21kworker/2:222:34:382
736261994944,3cyclictest789104-21kworker/2:200:28:542
736261994944,3cyclictest723180-21kworker/2:119:56:172
736261994944,3cyclictest723180-21kworker/2:119:51:272
736261994943,3cyclictest1501592-1kworker/2:2H20:26:202
736261994943,3cyclictest1501592-1kworker/2:2H19:20:002
736254994946,2cyclictest733318-21kworker/0:119:45:120
736254994945,2cyclictest833409-21kworker/0:000:19:080
736254994945,2cyclictest792562-21kworker/0:022:57:040
736254994945,2cyclictest772564-21kworker/0:221:02:390
736254994945,2cyclictest761220-21kworker/0:220:35:060
736264994842,4cyclictest2672433-1kworker/3:2H23:35:003
736264994842,3cyclictest2672433-1kworker/3:2H21:15:023
736261994845,2cyclictest789104-21kworker/2:223:40:462
736261994845,2cyclictest789104-21kworker/2:222:26:442
736261994845,2cyclictest772571-21kworker/2:121:13:382
736261994844,3cyclictest723180-21kworker/2:120:39:122
736261994843,3cyclictest789104-21kworker/2:221:56:082
736261994843,3cyclictest723180-21kworker/2:120:06:182
736261994842,4cyclictest1501592-1kworker/2:2H21:45:152
736261994840,2cyclictest1501592-1kworker/2:2H23:10:002
736254994845,2cyclictest833409-21kworker/0:000:25:430
736254994845,2cyclictest785551-21kworker/0:021:38:430
736254994845,2cyclictest780695-21kworker/0:221:29:130
736254994845,2cyclictest761220-21kworker/0:220:26:250
736254994844,2cyclictest733318-21kworker/0:119:40:550
736264994741,3cyclictest2672433-1kworker/3:2H22:01:093
736261994744,2cyclictest789104-21kworker/2:223:01:272
736261994743,3cyclictest789104-21kworker/2:222:20:382
736261994742,3cyclictest772571-21kworker/2:121:16:082
736254994742,3cyclictest2879081-1kworker/0:2H20:59:380
736264994640,3cyclictest2672433-1kworker/3:2H19:50:453
736261994643,2cyclictest841587-21kworker/2:000:30:412
736261994643,2cyclictest789104-21kworker/2:200:22:232
736261994643,2cyclictest723180-21kworker/2:119:25:232
736261994643,2cyclictest723180-21kworker/2:119:22:432
736261994642,2cyclictest789104-21kworker/2:222:35:582
736254994643,2cyclictest833409-21kworker/0:000:21:270
736254994643,2cyclictest830152-21kworker/0:200:03:480
736254994642,2cyclictest780695-21kworker/0:222:03:400
736264994541,3cyclictest2672433-1kworker/3:2H22:25:233
736264994540,3cyclictest782316-21kworker/3:221:29:553
736261994542,2cyclictest772571-21kworker/2:121:07:432
736261994540,3cyclictest789104-21kworker/2:222:47:442
736261994540,2cyclictest1501592-1kworker/2:2H21:35:162
736254994541,2cyclictest2879081-1kworker/0:2H23:03:400
736254994540,3cyclictest2879081-1kworker/0:2H21:34:590
736264994438,4cyclictest829896-21kworker/3:123:54:553
736264994438,3cyclictest2672433-1kworker/3:2H20:40:153
736261994441,2cyclictest789104-21kworker/2:223:38:382
736261994441,2cyclictest723180-21kworker/2:120:41:272
736261994441,2cyclictest723180-21kworker/2:120:24:132
736261994439,3cyclictest723180-21kworker/2:119:14:122
736254994441,2cyclictest835048-21kworker/0:100:10:300
736254994439,3cyclictest2879081-1kworker/0:2H19:20:180
736264994338,3cyclictest2672433-1kworker/3:2H21:55:053
736261994340,2cyclictest789104-21kworker/2:223:45:262
736261994340,2cyclictest789104-21kworker/2:222:09:122
736261994340,2cyclictest789104-21kworker/2:221:54:132
736261994340,2cyclictest772571-21kworker/2:121:01:292
736261994340,2cyclictest766163-21kworker/2:220:50:112
736261994340,2cyclictest766163-21kworker/2:220:49:442
736261994339,3cyclictest789104-21kworker/2:222:02:432
736261994339,3cyclictest1501592-1kworker/2:2H00:15:302
736261994339,2cyclictest723180-21kworker/2:119:49:432
736254994340,2cyclictest733318-21kworker/0:120:22:400
736254994340,2cyclictest2879081-1kworker/0:2H20:40:130
736254994338,3cyclictest2879081-1kworker/0:2H21:16:020
736264994239,2cyclictest803958-21kworker/3:023:24:563
736264994239,2cyclictest2672433-1kworker/3:2H21:38:133
736264994238,3cyclictest770957-21kworker/3:121:04:553
736264994238,2cyclictest2672433-1kworker/3:2H23:00:063
736264994238,2cyclictest2672433-1kworker/3:2H21:20:123
736264994238,2cyclictest2672433-1kworker/3:2H20:20:173
736264994237,3cyclictest2672433-1kworker/3:2H22:35:323
736261994239,2cyclictest772571-21kworker/2:121:32:432
736261994239,2cyclictest723180-21kworker/2:120:03:432
736254994240,1cyclictest733318-21kworker/0:119:39:490
736254994238,3cyclictest2879081-1kworker/0:2H23:20:250
736254994238,2cyclictest2879081-1kworker/0:2H20:00:060
736254994237,3cyclictest2879081-1kworker/0:2H20:45:150
736254994237,3cyclictest2879081-1kworker/0:2H00:35:150
736254994236,3cyclictest2879081-1kworker/0:2H23:30:140
736264994137,2cyclictest2672433-1kworker/3:2H23:06:283
736264994136,3cyclictest2672433-1kworker/3:2H19:39:553
736261994136,3cyclictest789104-21kworker/2:222:51:382
736254994138,2cyclictest2879081-1kworker/0:2H19:55:380
736254994137,3cyclictest2879081-1kworker/0:2H22:41:190
736264994037,2cyclictest736349-21kworker/3:119:24:553
736264994037,2cyclictest2672433-1kworker/3:2H21:34:543
736264994037,2cyclictest2672433-1kworker/3:2H20:36:273
736264994037,2cyclictest2672433-1kworker/3:2H00:10:263
736264994036,2cyclictest2672433-1kworker/3:2H20:34:123
736264994036,2cyclictest2672433-1kworker/3:2H19:40:113
736261994035,3cyclictest1501592-1kworker/2:2H00:00:022
736261994034,4cyclictest1501592-1kworker/2:2H22:19:392
736254994037,2cyclictest733318-21kworker/0:119:15:000
736254994036,2cyclictest1-21systemd00:00:010
736254994035,3cyclictest2879081-1kworker/0:2H19:50:140
736264993934,3cyclictest2672433-1kworker/3:2H20:50:183
736264993934,3cyclictest2672433-1kworker/3:2H19:55:133
736254993936,2cyclictest2879081-1kworker/0:2H23:47:380
736254993935,3cyclictest2879081-1kworker/0:2H00:33:470
736264993835,2cyclictest821555-21kworker/3:223:39:553
736264993835,2cyclictest803958-21kworker/3:022:49:553
736264993833,3cyclictest2672433-1kworker/3:2H21:15:133
736264993833,3cyclictest2672433-1kworker/3:2H20:05:323
736264993833,3cyclictest2672433-1kworker/3:2H00:32:233
736264993833,3cyclictest2672433-1kworker/3:2H00:15:143
736261993835,2cyclictest789104-21kworker/2:223:11:342
736261993835,2cyclictest789104-21kworker/2:222:44:442
736254993834,3cyclictest2879081-1kworker/0:2H23:15:150
736254993833,3cyclictest2879081-1kworker/0:2H21:46:070
736264993734,2cyclictest787442-21kworker/3:121:49:553
736264993734,2cyclictest785554-21kworker/3:021:44:553
736264993734,2cyclictest770957-21kworker/3:121:05:123
736264993734,2cyclictest736349-21kworker/3:119:29:553
736264993734,2cyclictest2672433-1kworker/3:2H23:10:233
736264993732,3cyclictest2672433-1kworker/3:2H22:50:183
736254993734,2cyclictest2879081-1kworker/0:2H20:50:260
736254993732,3cyclictest2879081-1kworker/0:2H22:48:380
736254993732,3cyclictest2879081-1kworker/0:2H21:55:100
73626499363,5cyclictest151rcu_preempt20:10:113
736264993633,2cyclictest2672433-1kworker/3:2H22:55:193
736264993632,3cyclictest795585-21kworker/3:022:09:553
736261993632,3cyclictest723180-21kworker/2:120:13:192
736261993631,3cyclictest1501592-1kworker/2:2H19:30:262
736254993632,2cyclictest2879081-1kworker/0:2H22:26:370
736264993532,2cyclictest2672433-1kworker/3:2H22:17:123
736264993530,3cyclictest2672433-1kworker/3:2H23:49:563
736264993530,3cyclictest2672433-1kworker/3:2H19:17:413
73626499350,4cyclictest799544-21tail22:20:163
736261993532,2cyclictest1501592-1kworker/2:2H21:24:382
736254993431,2cyclictest733318-21kworker/0:119:25:150
736254993430,2cyclictest2879081-1kworker/0:2H23:28:370
736254993428,3cyclictest2879081-1kworker/0:2H21:05:140
73626499332,19cyclictest0-21swapper/320:30:003
73625499330,4cyclictest744333-21uname19:30:190
73625499330,3cyclictest0-21swapper/023:05:160
736264993227,3cyclictest2672433-1kworker/3:2H21:50:173
736264993227,3cyclictest2672433-1kworker/3:2H20:55:353
736264993226,4cyclictest2672433-1kworker/3:2H23:55:263
736261993229,2cyclictest789104-21kworker/2:223:17:062
736254993229,2cyclictest2879081-1kworker/0:2H22:16:380
736264993127,3cyclictest2672433-1kworker/3:2H19:14:553
73626499311,4cyclictest0-21swapper/319:30:133
736254993127,3cyclictest2879081-1kworker/0:2H20:15:200
736254993127,2cyclictest792562-21kworker/0:022:38:130
736264993026,3cyclictest2672433-1kworker/3:2H00:20:103
736264993024,4cyclictest2672433-1kworker/3:2H23:26:363
73626499300,2cyclictest0-21swapper/300:25:173
736261993027,2cyclictest723180-21kworker/2:119:42:132
73625499300,3cyclictest0-21swapper/023:10:190
736264992924,3cyclictest2672433-1kworker/3:2H22:30:173
73626499290,3cyclictest833437-21munin-run00:04:593
736254992925,3cyclictest2879081-1kworker/0:2H21:25:000
736254992925,2cyclictest2879081-1kworker/0:2H21:40:060
73625799280,27cyclictest0-21swapper/119:10:001
736254992824,2cyclictest815054-21kworker/0:123:39:470
736261992723,3cyclictest1501592-1kworker/2:2H00:06:482
736254992724,2cyclictest2879081-1kworker/0:2H22:09:390
736254992721,3cyclictest2879081-1kworker/0:2H20:30:150
736264992620,4cyclictest2672433-1kworker/3:2H22:42:133
736254992521,3cyclictest2879081-1kworker/0:2H20:06:020
73626499242,11cyclictest795870-21apt-get22:10:163
73626199244,3cyclictest151rcu_preempt21:25:182
736254992418,3cyclictest2879081-1kworker/0:2H00:05:190
73625499241,11cyclictest828561-21apt-get23:50:160
736264992319,3cyclictest2672433-1kworker/3:2H20:45:323
736264992313,7cyclictest826484-21systemd-run23:45:003
73626199221,6cyclictest151rcu_preempt19:35:222
73626499170,6cyclictest736346-21cat19:10:003
73626199143,4cyclictest151rcu_preempt19:10:002
73625499140,3cyclictest0-21swapper/019:09:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional