You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-13 - 02:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Mon May 12, 2025 12:45:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9832230163,23sleep00-21swapper/007:06:070
11352207172,23sleep20-21swapper/207:08:062
137191206173,22phc2sys0-21swapper/307:08:433
11292201169,21sleep10-21swapper/107:08:021
2473921520,2sleep20-21swapper/212:05:182
136991800,1ptp4l391rcuc/312:35:263
59298640,21rtkit-daemon5998-21users07:15:260
1670996431,3cyclictest41-21ksoftirqd/308:35:003
1669996429,4cyclictest33-21ksoftirqd/212:15:202
1670996322,8cyclictest41-21ksoftirqd/307:24:343
1669996231,4cyclictest33-21ksoftirqd/210:05:002
1669996229,7cyclictest33-21ksoftirqd/211:25:282
1669996128,7cyclictest33-21ksoftirqd/212:10:172
1670996031,4cyclictest41-21ksoftirqd/310:55:213
1670995932,4cyclictest41-21ksoftirqd/309:55:013
1669995928,4cyclictest33-21ksoftirqd/211:30:142
8602580,2sleep10-21swapper/108:15:171
315382580,2sleep20-21swapper/208:10:212
1670995829,4cyclictest41-21ksoftirqd/310:15:213
1670995819,9cyclictest41-21ksoftirqd/307:55:223
1670995819,4cyclictest41-21ksoftirqd/309:30:183
1669995831,4cyclictest33-21ksoftirqd/208:45:262
1669995830,4cyclictest33-21ksoftirqd/208:35:142
1669995829,7cyclictest33-21ksoftirqd/207:10:302
1669995828,4cyclictest33-21ksoftirqd/210:35:012
1670995726,4cyclictest41-21ksoftirqd/309:55:153
1670995725,9cyclictest41-21ksoftirqd/311:25:183
1669995730,4cyclictest33-21ksoftirqd/209:55:142
1669995728,4cyclictest33-21ksoftirqd/211:25:002
1669995727,3cyclictest33-21ksoftirqd/209:20:232
1670995626,9cyclictest41-21ksoftirqd/308:40:153
1670995625,8cyclictest41-21ksoftirqd/308:50:243
1669995628,8cyclictest33-21ksoftirqd/210:15:182
1669995628,4cyclictest33-21ksoftirqd/209:45:272
1669995627,4cyclictest33-21ksoftirqd/212:00:152
1669995626,7cyclictest33-21ksoftirqd/207:45:112
1669995626,4cyclictest33-21ksoftirqd/207:35:292
1669995621,9cyclictest33-21ksoftirqd/209:30:182
1669995529,4cyclictest33-21ksoftirqd/212:30:152
1669995528,4cyclictest33-21ksoftirqd/208:32:382
1669995525,5cyclictest33-21ksoftirqd/208:25:162
1669995522,4cyclictest33-21ksoftirqd/208:20:002
1670995423,9cyclictest41-21ksoftirqd/309:15:163
1670995422,9cyclictest41-21ksoftirqd/307:15:123
1670995421,4cyclictest41-21ksoftirqd/310:08:273
1669995423,4cyclictest33-21ksoftirqd/211:35:152
1669995327,4cyclictest33-21ksoftirqd/209:36:532
1669995325,5cyclictest33-21ksoftirqd/208:05:282
1669995322,4cyclictest33-21ksoftirqd/208:00:142
1669995318,8cyclictest33-21ksoftirqd/209:05:002
1670995222,4cyclictest41-21ksoftirqd/311:50:203
1670995131,5cyclictest41-21ksoftirqd/312:00:203
1670995120,9cyclictest41-21ksoftirqd/311:45:163
1669995125,4cyclictest33-21ksoftirqd/208:44:432
1669995121,3cyclictest33-21ksoftirqd/207:30:012
128372510,2sleep10-21swapper/108:40:161
167099503,2cyclictest121rcu_preempt11:35:133
1670995018,9cyclictest41-21ksoftirqd/312:15:163
1670995017,9cyclictest41-21ksoftirqd/308:20:013
1670995016,7cyclictest41-21ksoftirqd/308:25:153
1670995013,10cyclictest41-21ksoftirqd/307:30:003
1669995026,4cyclictest33-21ksoftirqd/208:50:252
1669995023,4cyclictest33-21ksoftirqd/211:45:192
1669995023,4cyclictest33-21ksoftirqd/209:40:162
1669995019,4cyclictest33-21ksoftirqd/207:30:252
1669995018,3cyclictest33-21ksoftirqd/207:20:152
1669995013,5cyclictest33-21ksoftirqd/209:10:192
1670994916,8cyclictest41-21ksoftirqd/312:10:233
166999492,8cyclictest33-21ksoftirqd/208:20:282
1669994924,3cyclictest33-21ksoftirqd/207:50:262
1669994921,4cyclictest33-21ksoftirqd/209:25:152
1670994812,9cyclictest41-21ksoftirqd/311:15:193
167099474,6cyclictest41-21ksoftirqd/307:50:013
1670994731,3cyclictest41-21ksoftirqd/308:14:593
1670994727,10cyclictest41-21ksoftirqd/310:05:003
1670994715,9cyclictest41-21ksoftirqd/308:00:143
1670994715,8cyclictest41-21ksoftirqd/310:50:013
1669994737,3cyclictest33-21ksoftirqd/210:30:002
1669994736,4cyclictest33-21ksoftirqd/210:15:002
1669994725,10cyclictest33-21ksoftirqd/212:00:002
167099466,3cyclictest223-21systemd-journal09:14:353
1670994636,3cyclictest41-21ksoftirqd/309:00:163
167099463,2cyclictest121rcu_preempt10:35:013
167099461,7cyclictest41-21ksoftirqd/311:30:143
167099461,3cyclictest121rcu_preempt11:55:173
167099460,9cyclictest401ktimersoftd/307:50:203
1669994637,2cyclictest33-21ksoftirqd/209:20:002
166999463,5cyclictest121rcu_preempt11:15:222
1669994629,8cyclictest33-21ksoftirqd/209:50:162
1669994615,9cyclictest33-21ksoftirqd/212:25:002
1669994612,10cyclictest33-21ksoftirqd/210:09:592
167099456,4cyclictest41-21ksoftirqd/309:28:433
167099455,7cyclictest41-21ksoftirqd/311:40:173
1670994536,3cyclictest41-21ksoftirqd/308:45:133
1670994536,2cyclictest41-21ksoftirqd/308:35:263
167099453,2cyclictest121rcu_preempt12:30:263
167099451,6cyclictest41-21ksoftirqd/312:05:273
167099450,7cyclictest41-21ksoftirqd/307:40:003
167099450,6cyclictest41-21ksoftirqd/311:25:003
1669994514,9cyclictest33-21ksoftirqd/212:25:172
59298440,10rtkit-daemon0-21swapper/112:05:251
167099442,2cyclictest121rcu_preempt08:25:013
1669994436,3cyclictest33-21ksoftirqd/207:20:012
1669994432,4cyclictest33-21ksoftirqd/212:35:232
1669994431,4cyclictest33-21ksoftirqd/209:05:152
1669994431,3cyclictest33-21ksoftirqd/210:55:002
167099433,2cyclictest121rcu_preempt08:05:263
1670994329,3cyclictest41-21ksoftirqd/312:20:173
1670994325,9cyclictest41-21ksoftirqd/309:40:203
167099431,6cyclictest41-21ksoftirqd/307:45:003
167099430,8cyclictest121rcu_preempt10:35:203
1669994329,4cyclictest33-21ksoftirqd/210:35:202
1669994316,4cyclictest33-21ksoftirqd/211:50:262
166899430,1cyclictest0-21swapper/108:57:261
167099426,6cyclictest41-21ksoftirqd/307:30:143
167099422,3cyclictest121rcu_preempt09:39:593
167099422,2cyclictest121rcu_preempt09:45:223
167099422,2cyclictest121rcu_preempt07:10:203
1669994230,9cyclictest33-21ksoftirqd/207:55:302
1669994210,5cyclictest33-21ksoftirqd/207:40:192
59298410,8rtkit-daemon0-21swapper/008:47:160
59298410,4rtkit-daemon13893-21uniq09:50:160
167099413,2cyclictest121rcu_preempt10:55:003
167099412,9cyclictest41-21ksoftirqd/310:45:013
167099412,2cyclictest121rcu_preempt12:25:183
167099410,2cyclictest121rcu_preempt09:20:253
1669994135,3cyclictest33-21ksoftirqd/210:50:002
166999413,2cyclictest33-21ksoftirqd/210:55:152
167099403,2cyclictest121rcu_preempt09:05:163
167099402,2cyclictest121rcu_preempt10:30:003
1669994027,4cyclictest33-21ksoftirqd/208:55:192
1669994026,8cyclictest33-21ksoftirqd/211:13:572
1669994025,4cyclictest33-21ksoftirqd/211:40:252
1668994034,4cyclictest10831-21cron09:45:011
1667994033,5cyclictest12345-21cron08:40:000
167099393,3cyclictest121rcu_preempt08:55:173
167099393,2cyclictest121rcu_preempt11:03:193
1669993934,3cyclictest33-21ksoftirqd/210:25:012
1669993926,11cyclictest33-21ksoftirqd/211:10:012
166999392,3cyclictest33-21ksoftirqd/210:45:002
1669993923,5cyclictest33-21ksoftirqd/211:03:192
167099381,6cyclictest41-21ksoftirqd/311:09:113
1670993732,3cyclictest41-21ksoftirqd/311:15:003
167099362,2cyclictest121rcu_preempt10:12:233
1668993630,4cyclictest25-21ksoftirqd/111:27:341
1667993529,4cyclictest9-21ksoftirqd/009:36:030
1667993529,4cyclictest9-21ksoftirqd/009:23:160
59298340,2rtkit-daemon0-21swapper/009:45:170
1668993428,4cyclictest25-21ksoftirqd/111:19:581
1668993428,4cyclictest25-21ksoftirqd/109:54:421
1668993428,4cyclictest25-21ksoftirqd/108:28:571
1668993428,4cyclictest25-21ksoftirqd/107:38:421
1667993428,4cyclictest9-21ksoftirqd/010:38:010
1667993428,4cyclictest9-21ksoftirqd/007:43:540
1667993427,4cyclictest9-21ksoftirqd/010:20:210
59298330,2rtkit-daemon0-21swapper/007:50:200
167099330,2cyclictest121rcu_preempt10:24:023
1668993327,4cyclictest25-21ksoftirqd/112:26:061
1668993327,4cyclictest25-21ksoftirqd/111:31:421
1668993327,4cyclictest25-21ksoftirqd/110:41:231
1668993327,4cyclictest25-21ksoftirqd/110:27:271
1668993327,4cyclictest25-21ksoftirqd/110:04:521
1668993327,4cyclictest25-21ksoftirqd/107:48:211
1668993327,3cyclictest25-21ksoftirqd/111:00:241
1668993326,5cyclictest25-21ksoftirqd/112:16:071
1668993326,4cyclictest25-21ksoftirqd/112:02:511
1667993328,3cyclictest9-21ksoftirqd/011:25:000
1668993226,4cyclictest25-21ksoftirqd/109:09:351
1668993226,4cyclictest25-21ksoftirqd/107:52:151
1668993226,4cyclictest25-21ksoftirqd/107:31:361
1668993225,5cyclictest25-21ksoftirqd/110:58:281
1668993225,4cyclictest25-21ksoftirqd/112:11:131
1667993228,3cyclictest9-21ksoftirqd/009:30:010
1667993226,4cyclictest9-21ksoftirqd/011:10:070
1667993226,4cyclictest9-21ksoftirqd/010:12:060
1667993226,4cyclictest9-21ksoftirqd/009:56:010
1667993226,4cyclictest9-21ksoftirqd/009:42:290
1667993226,4cyclictest9-21ksoftirqd/009:07:350
1668993125,4cyclictest25-21ksoftirqd/112:32:281
1668993125,4cyclictest25-21ksoftirqd/110:35:331
1668993125,4cyclictest25-21ksoftirqd/109:58:111
1668993125,4cyclictest25-21ksoftirqd/109:10:051
1668993125,4cyclictest25-21ksoftirqd/107:56:201
1668993125,3cyclictest25-21ksoftirqd/111:58:401
1668993125,3cyclictest25-21ksoftirqd/110:14:581
166899310,1cyclictest0-21swapper/107:17:161
1667993126,3cyclictest9-21ksoftirqd/011:26:270
1667993126,3cyclictest9-21ksoftirqd/010:43:430
1667993126,3cyclictest9-21ksoftirqd/009:34:440
1667993126,3cyclictest9-21ksoftirqd/008:28:390
1667993126,3cyclictest9-21ksoftirqd/008:21:010
1667993126,3cyclictest9-21ksoftirqd/008:10:000
1667993125,4cyclictest9-21ksoftirqd/009:16:290
1667993125,4cyclictest32666-21ls08:15:000
1667993125,3cyclictest9-21ksoftirqd/012:25:130
59298300,2rtkit-daemon0-21swapper/008:03:460
1668993025,3cyclictest25-21ksoftirqd/111:24:201
1668993024,4cyclictest25-21ksoftirqd/111:36:231
1668993024,4cyclictest25-21ksoftirqd/111:14:531
1668993024,4cyclictest25-21ksoftirqd/111:05:461
1668993024,4cyclictest25-21ksoftirqd/108:20:471
1668993024,3cyclictest25-21ksoftirqd/109:24:081
1667993025,3cyclictest9-21ksoftirqd/012:20:030
1667993025,3cyclictest9-21ksoftirqd/012:09:120
1667993025,3cyclictest9-21ksoftirqd/011:57:080
1667993025,3cyclictest9-21ksoftirqd/009:13:320
1667993025,3cyclictest9-21ksoftirqd/008:50:390
1667993024,4cyclictest9-21ksoftirqd/010:30:030
1667993024,4cyclictest9-21ksoftirqd/010:06:000
59298290,2rtkit-daemon0-21swapper/011:37:250
1668992924,3cyclictest25-21ksoftirqd/109:16:251
1668992924,3cyclictest25-21ksoftirqd/107:26:531
1668992924,3cyclictest25-21ksoftirqd/107:14:441
1668992923,4cyclictest25-21ksoftirqd/112:37:171
1668992923,4cyclictest25-21ksoftirqd/112:24:171
1668992923,4cyclictest25-21ksoftirqd/111:41:331
1668992923,4cyclictest25-21ksoftirqd/110:45:131
1668992923,4cyclictest25-21ksoftirqd/110:18:411
1668992922,5cyclictest25-21ksoftirqd/108:38:111
1668992922,4cyclictest25-21ksoftirqd/111:50:521
1667992923,4cyclictest9-21ksoftirqd/008:15:350
1667992923,4cyclictest9-21ksoftirqd/007:47:470
1667992923,3cyclictest9-21ksoftirqd/011:48:500
1667992923,3cyclictest9-21ksoftirqd/010:20:010
1667992922,4cyclictest9-21ksoftirqd/008:40:120
59298280,10rtkit-daemon0-21swapper/011:32:250
1668992825,2cyclictest4479-21kworker/2:209:30:161
1668992823,3cyclictest25-21ksoftirqd/108:50:541
1668992822,4cyclictest25-21ksoftirqd/110:09:261
1668992822,4cyclictest25-21ksoftirqd/107:41:111
1668992821,5cyclictest25-21ksoftirqd/107:25:001
1667992823,3cyclictest9-21ksoftirqd/011:08:130
1667992823,3cyclictest9-21ksoftirqd/010:47:120
1667992823,3cyclictest9-21ksoftirqd/008:32:280
1667992823,3cyclictest9-21ksoftirqd/007:22:360
1667992822,4cyclictest9-21ksoftirqd/012:36:320
1667992822,4cyclictest9-21ksoftirqd/010:59:230
1667992822,4cyclictest9-21ksoftirqd/010:02:470
1667992822,3cyclictest9-21ksoftirqd/012:15:130
1667992821,4cyclictest9-21ksoftirqd/007:55:130
1668992721,4cyclictest25-21ksoftirqd/110:23:501
1668992721,4cyclictest25-21ksoftirqd/108:12:151
1667992722,3cyclictest9-21ksoftirqd/011:00:480
1667992722,3cyclictest9-21ksoftirqd/010:50:050
1667992722,3cyclictest9-21ksoftirqd/008:58:360
1667992722,3cyclictest19274-21idleruntime-cro11:55:000
1667992721,4cyclictest9-21ksoftirqd/012:33:360
1667992721,4cyclictest9-21ksoftirqd/011:43:400
1667992721,3cyclictest9-21ksoftirqd/012:10:360
1668992620,4cyclictest25-21ksoftirqd/108:48:021
1668992620,4cyclictest25-21ksoftirqd/108:01:161
1667992621,3cyclictest9-21ksoftirqd/007:25:200
1667992621,3cyclictest9-21ksoftirqd/007:10:440
1667992620,4cyclictest9-21ksoftirqd/007:31:070
1667992620,3cyclictest9-21ksoftirqd/009:02:030
1667992619,4cyclictest9-21ksoftirqd/010:27:190
59298250,2rtkit-daemon0-21swapper/011:17:350
1668992520,3cyclictest25-21ksoftirqd/110:54:461
1668992520,3cyclictest25-21ksoftirqd/110:30:111
1668992520,3cyclictest25-21ksoftirqd/109:03:111
1667992519,4cyclictest9-21ksoftirqd/007:38:090
1668992419,3cyclictest25-21ksoftirqd/108:34:511
1668992318,3cyclictest25-21ksoftirqd/109:45:041
1668992318,3cyclictest25-21ksoftirqd/109:27:381
1668992318,3cyclictest25-21ksoftirqd/108:08:251
1668992014,4cyclictest25-21ksoftirqd/111:46:341
1668991913,3cyclictest7445-21tail09:35:241
1667991811,4cyclictest22264-21sed12:00:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional