You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-01 - 08:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot4.osadl.org (updated Mon Jun 30, 2025 12:45:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
175792203169,22sleep30-21swapper/307:05:473
178422202167,23sleep20-21swapper/207:09:112
176862202167,23sleep00-21swapper/007:07:080
175822201167,23sleep10-21swapper/107:05:481
305821410,7sleep11834199cyclictest11:00:011
2087721350,1sleep00-21swapper/009:25:160
3185021340,1sleep10-21swapper/107:35:211
134991960,0ptp4l391rcuc/307:15:293
134991790,1ptp4l391rcuc/309:15:253
134991720,0ptp4l391rcuc/312:05:263
254232700,5sleep325397-21idleruntime-cro10:40:013
18344996229,7cyclictest41-21ksoftirqd/307:20:193
18344995926,9cyclictest41-21ksoftirqd/308:25:253
18344995926,9cyclictest41-21ksoftirqd/308:25:253
18344995827,4cyclictest41-21ksoftirqd/308:00:233
18344995825,5cyclictest41-21ksoftirqd/308:10:193
18344995824,9cyclictest41-21ksoftirqd/310:50:233
18344995821,8cyclictest41-21ksoftirqd/312:16:353
18344995726,6cyclictest41-21ksoftirqd/309:25:213
18344995721,7cyclictest41-21ksoftirqd/312:37:013
18344995721,7cyclictest41-21ksoftirqd/311:02:413
18344995721,7cyclictest41-21ksoftirqd/310:27:553
18344995720,8cyclictest41-21ksoftirqd/310:12:353
18344995622,8cyclictest41-21ksoftirqd/310:20:283
18344995622,6cyclictest41-21ksoftirqd/309:35:173
18344995620,7cyclictest41-21ksoftirqd/308:07:503
18344995521,8cyclictest41-21ksoftirqd/307:50:533
131912550,3sleep10-21swapper/108:05:131
18344995424,4cyclictest41-21ksoftirqd/312:20:193
18344995422,7cyclictest41-21ksoftirqd/311:23:313
18344995420,8cyclictest41-21ksoftirqd/309:11:253
18344995418,7cyclictest41-21ksoftirqd/307:33:163
35742530,4sleep13119-21/usr/sbin/munin11:00:171
18344995321,7cyclictest41-21ksoftirqd/309:50:183
18344995319,7cyclictest41-21ksoftirqd/309:35:003
1834499523,6cyclictest41-21ksoftirqd/309:45:003
18344995226,7cyclictest41-21ksoftirqd/307:45:213
18344995220,9cyclictest41-21ksoftirqd/309:20:563
18344995219,8cyclictest41-21ksoftirqd/310:16:003
200952510,2sleep00-21swapper/010:25:340
1834499515,8cyclictest41-21ksoftirqd/310:05:113
18344995122,7cyclictest41-21ksoftirqd/311:50:273
18344995017,6cyclictest41-21ksoftirqd/308:30:153
1834499495,7cyclictest41-21ksoftirqd/310:55:193
1834499494,10cyclictest41-21ksoftirqd/311:45:163
1834499493,8cyclictest41-21ksoftirqd/312:10:203
1834499485,9cyclictest41-21ksoftirqd/311:15:193
1834499485,7cyclictest41-21ksoftirqd/310:05:013
1834499485,6cyclictest41-21ksoftirqd/312:30:003
1834499485,10cyclictest41-21ksoftirqd/307:25:133
18344994816,7cyclictest41-21ksoftirqd/309:00:273
1834499476,8cyclictest41-21ksoftirqd/311:14:593
1834499475,7cyclictest41-21ksoftirqd/311:55:293
1834499474,8cyclictest41-21ksoftirqd/308:20:303
1834499474,7cyclictest41-21ksoftirqd/308:35:183
1834499472,9cyclictest41-21ksoftirqd/312:00:233
1834499466,7cyclictest41-21ksoftirqd/311:05:153
1834499465,8cyclictest41-21ksoftirqd/312:35:003
1834499465,8cyclictest41-21ksoftirqd/309:45:203
1834499465,7cyclictest41-21ksoftirqd/308:50:303
1834499465,7cyclictest41-21ksoftirqd/308:45:003
1834499465,10cyclictest41-21ksoftirqd/308:55:323
18344994616,8cyclictest41-21ksoftirqd/309:56:223
1834499455,7cyclictest41-21ksoftirqd/311:40:223
1834499454,8cyclictest41-21ksoftirqd/308:15:253
1834499454,8cyclictest41-21ksoftirqd/307:35:143
1834499453,7cyclictest41-21ksoftirqd/307:55:243
1834499453,7cyclictest41-21ksoftirqd/307:55:243
1834499452,5cyclictest41-21ksoftirqd/307:40:293
1834499451,6cyclictest41-21ksoftirqd/308:45:263
1834499446,7cyclictest41-21ksoftirqd/307:10:183
1834499445,8cyclictest41-21ksoftirqd/311:35:183
1834499445,8cyclictest41-21ksoftirqd/309:05:303
1834499445,7cyclictest41-21ksoftirqd/311:30:173
1834499444,9cyclictest41-21ksoftirqd/311:25:163
18344994414,8cyclictest41-21ksoftirqd/310:33:333
1834499431,7cyclictest41-21ksoftirqd/310:42:163
1834499422,8cyclictest41-21ksoftirqd/310:45:303
18343994125,3cyclictest10322-21cron10:10:012
36998380,5rtkit-daemon11085-21fschecks_count10:10:201
18341993833,3cyclictest25-21ksoftirqd/110:00:001
18340993831,4cyclictest9-21ksoftirqd/009:54:040
36998370,2rtkit-daemon0-21swapper/109:15:101
18343993731,4cyclictest33-21ksoftirqd/208:56:092
18343993719,16cyclictest5336-21cron11:05:012
18341993731,4cyclictest25-21ksoftirqd/110:48:251
18341993731,4cyclictest25-21ksoftirqd/110:33:331
18341993729,5cyclictest25-21ksoftirqd/107:10:141
18340993731,4cyclictest9-21ksoftirqd/011:19:380
36998360,2rtkit-daemon0-21swapper/110:05:021
36998360,2rtkit-daemon0-21swapper/107:47:031
18343993629,4cyclictest33-21ksoftirqd/211:57:542
18343993629,4cyclictest33-21ksoftirqd/208:25:122
18343993629,4cyclictest33-21ksoftirqd/208:25:122
18341993632,3cyclictest25-21ksoftirqd/108:00:011
18341993632,3cyclictest25-21ksoftirqd/108:00:001
18341993631,3cyclictest25-21ksoftirqd/107:25:461
18341993630,4cyclictest25-21ksoftirqd/112:24:221
18341993630,4cyclictest25-21ksoftirqd/111:58:181
18341993630,4cyclictest25-21ksoftirqd/110:04:281
18341993630,4cyclictest25-21ksoftirqd/108:52:391
18341993630,4cyclictest25-21ksoftirqd/108:15:401
18341993630,4cyclictest25-21ksoftirqd/107:43:591
18340993630,4cyclictest9-21ksoftirqd/008:02:560
18340993613,20cyclictest13715-21diskstats11:20:180
18340993612,21cyclictest27902-21sed10:45:000
18340993610,23cyclictest3949-21ls07:45:190
36998350,2rtkit-daemon0-21swapper/112:31:521
36998350,2rtkit-daemon0-21swapper/109:04:501
36998350,2rtkit-daemon0-21swapper/108:47:501
36998350,2rtkit-daemon0-21swapper/108:43:511
18343993529,4cyclictest33-21ksoftirqd/212:09:582
18343993529,4cyclictest33-21ksoftirqd/209:22:492
18343993529,4cyclictest33-21ksoftirqd/209:09:292
18343993529,4cyclictest33-21ksoftirqd/207:38:262
18343993529,3cyclictest33-21ksoftirqd/211:24:592
18341993529,4cyclictest25-21ksoftirqd/110:51:261
18341993529,4cyclictest25-21ksoftirqd/109:10:371
18341993528,5cyclictest25-21ksoftirqd/108:56:121
18340993529,4cyclictest9-21ksoftirqd/011:41:560
18340993529,4cyclictest9-21ksoftirqd/010:46:000
18340993529,4cyclictest9-21ksoftirqd/009:14:250
18340993529,4cyclictest9-21ksoftirqd/007:28:300
18340993529,4cyclictest9-21ksoftirqd/007:20:350
18340993529,4cyclictest9-21ksoftirqd/007:11:490
18340993528,4cyclictest9-21ksoftirqd/010:32:470
18340993514,19cyclictest8619-21/usr/sbin/munin07:55:180
18340993514,19cyclictest8619-21/usr/sbin/munin07:55:180
18340993511,21cyclictest8527-21expr12:15:150
18343993428,4cyclictest33-21ksoftirqd/211:09:252
18343993427,4cyclictest33-21ksoftirqd/210:34:462
18343993425,7cyclictest33-21ksoftirqd/211:10:442
18343993416,15cyclictest33-21ksoftirqd/212:19:592
18341993430,3cyclictest25-21ksoftirqd/108:20:371
18341993428,4cyclictest25-21ksoftirqd/111:51:561
18341993428,4cyclictest25-21ksoftirqd/111:23:311
18341993428,4cyclictest25-21ksoftirqd/110:15:351
1834099349,22cyclictest8780-21df09:00:180
1834099349,22cyclictest18926-21sed12:35:220
1834099349,22cyclictest13247-21grep12:25:140
18340993428,4cyclictest9-21ksoftirqd/011:02:290
18340993428,4cyclictest9-21ksoftirqd/008:54:430
18340993428,4cyclictest9-21ksoftirqd/008:36:540
18340993427,5cyclictest9-21ksoftirqd/012:32:510
18340993427,4cyclictest9-21ksoftirqd/009:19:300
18340993412,19cyclictest17923-21sh11:30:010
18340993410,21cyclictest32238-21cat11:55:260
18340993410,21cyclictest13508-21df_abs10:15:190
18343993328,3cyclictest33-21ksoftirqd/211:40:362
18343993327,4cyclictest33-21ksoftirqd/211:45:592
18343993327,4cyclictest33-21ksoftirqd/210:12:282
18343993327,4cyclictest33-21ksoftirqd/209:51:182
18343993327,4cyclictest33-21ksoftirqd/208:38:562
18343993327,4cyclictest33-21ksoftirqd/207:34:372
18343993326,5cyclictest33-21ksoftirqd/211:15:102
18343993326,4cyclictest33-21ksoftirqd/209:27:222
1834399330,2cyclictest121rcu_preempt09:11:072
18341993328,3cyclictest25-21ksoftirqd/111:41:471
18341993328,3cyclictest25-21ksoftirqd/108:28:151
18341993328,3cyclictest25-21ksoftirqd/108:28:151
18341993327,4cyclictest25-21ksoftirqd/112:04:201
18341993327,4cyclictest25-21ksoftirqd/110:42:431
18341993327,4cyclictest25-21ksoftirqd/109:37:451
18341993327,4cyclictest25-21ksoftirqd/109:34:441
18341993327,4cyclictest25-21ksoftirqd/109:29:581
18341993327,4cyclictest25-21ksoftirqd/109:05:391
18341993327,4cyclictest25-21ksoftirqd/108:39:311
1834099339,22cyclictest26305-21cut11:45:200
1834099339,21cyclictest23104-21seq07:19:590
1834099339,21cyclictest23048-21seq08:22:090
18340993328,3cyclictest9-21ksoftirqd/010:53:540
18340993328,3cyclictest9-21ksoftirqd/009:36:230
18340993328,3cyclictest9-21ksoftirqd/008:59:280
18340993327,4cyclictest9-21ksoftirqd/010:37:570
18340993327,4cyclictest9-21ksoftirqd/008:18:320
18340993327,3cyclictest9-21ksoftirqd/009:56:440
18340993326,4cyclictest9-21ksoftirqd/010:59:110
18340993310,20cyclictest6156-21sed12:10:170
18340993310,20cyclictest2760-21grep08:45:290
18340993310,20cyclictest26171-21cstates08:30:140
18343993227,3cyclictest33-21ksoftirqd/209:43:272
18343993226,4cyclictest33-21ksoftirqd/211:33:002
18343993225,4cyclictest33-21ksoftirqd/210:43:342
18343993225,4cyclictest33-21ksoftirqd/209:04:002
18343993225,4cyclictest33-21ksoftirqd/207:25:582
18341993227,3cyclictest25-21ksoftirqd/109:44:471
18341993227,3cyclictest25-21ksoftirqd/107:15:201
18341993226,4cyclictest25-21ksoftirqd/111:32:371
18341993226,4cyclictest25-21ksoftirqd/111:07:421
18341993226,4cyclictest25-21ksoftirqd/110:36:341
18341993226,4cyclictest25-21ksoftirqd/110:27:351
18341993226,4cyclictest25-21ksoftirqd/109:52:441
18341993226,4cyclictest25-21ksoftirqd/108:12:151
18341993226,4cyclictest25-21ksoftirqd/108:01:121
18340993227,3cyclictest9-21ksoftirqd/010:03:350
18340993226,4cyclictest9-21ksoftirqd/010:08:160
18340993226,4cyclictest9-21ksoftirqd/007:32:270
18340993211,18cyclictest11166-21sh10:10:200
18343993126,3cyclictest33-21ksoftirqd/208:31:582
18343993126,3cyclictest33-21ksoftirqd/208:01:432
18343993126,3cyclictest33-21ksoftirqd/207:13:172
18343993125,4cyclictest33-21ksoftirqd/208:53:112
18343993125,4cyclictest33-21ksoftirqd/208:25:002
18343993125,4cyclictest33-21ksoftirqd/208:14:292
18341993125,4cyclictest25-21ksoftirqd/112:15:471
18341993125,3cyclictest25-21ksoftirqd/107:53:351
1834099318,21cyclictest18218-21apt-config08:15:000
1834099316,22cyclictest3212chrt08:40:510
18340993125,3cyclictest9-21ksoftirqd/011:07:080
18340993125,3cyclictest9-21ksoftirqd/007:43:560
1834099311,4cyclictest10486-21sh11:15:000
18340993110,18cyclictest23972-21irqrtprio09:30:260
18343993025,3cyclictest33-21ksoftirqd/211:51:172
18343993025,3cyclictest33-21ksoftirqd/210:50:242
18343993025,3cyclictest33-21ksoftirqd/209:37:272
18343993025,3cyclictest33-21ksoftirqd/207:56:212
18343993025,3cyclictest33-21ksoftirqd/207:56:212
18343993025,3cyclictest33-21ksoftirqd/207:18:392
18343993024,4cyclictest33-21ksoftirqd/212:37:272
18343993024,4cyclictest33-21ksoftirqd/210:46:382
18343993024,4cyclictest33-21ksoftirqd/210:17:342
18343993024,3cyclictest33-21ksoftirqd/208:16:112
18341993024,4cyclictest25-21ksoftirqd/111:26:201
18341993024,3cyclictest25-21ksoftirqd/109:21:151
1834099308,20cyclictest19036-21cat09:20:240
1834099307,20cyclictest3237-21cut12:05:000
1834099306,4cyclictest16346-21fschecks_time10:20:200
18340993024,4cyclictest9-21ksoftirqd/012:22:510
18340993024,4cyclictest9-21ksoftirqd/008:07:450
18343992924,3cyclictest33-21ksoftirqd/210:59:542
18343992924,3cyclictest33-21ksoftirqd/209:58:402
18343992924,3cyclictest33-21ksoftirqd/207:47:582
18343992923,4cyclictest33-21ksoftirqd/212:32:052
18343992923,4cyclictest33-21ksoftirqd/212:24:302
18343992923,4cyclictest33-21ksoftirqd/211:39:052
18343992923,4cyclictest33-21ksoftirqd/209:45:482
18343992923,4cyclictest33-21ksoftirqd/208:44:542
18343992923,4cyclictest33-21ksoftirqd/207:51:142
1834399291,3cyclictest2056-21ls07:40:232
18341992924,3cyclictest25-21ksoftirqd/111:45:171
18341992923,4cyclictest25-21ksoftirqd/111:38:551
1834099297,3cyclictest29093-21irqrtprio11:50:230
18340992924,3cyclictest9-21ksoftirqd/011:40:010
18340992924,3cyclictest9-21ksoftirqd/009:48:070
18340992924,3cyclictest9-21ksoftirqd/008:29:190
18340992924,3cyclictest9-21ksoftirqd/008:29:190
18340992923,4cyclictest9-21ksoftirqd/009:44:570
18343992823,3cyclictest33-21ksoftirqd/212:27:322
18343992823,3cyclictest33-21ksoftirqd/210:25:542
18343992823,3cyclictest33-21ksoftirqd/210:02:122
18341992823,3cyclictest25-21ksoftirqd/112:05:321
18341992823,3cyclictest25-21ksoftirqd/109:45:171
18341992823,3cyclictest25-21ksoftirqd/107:32:431
18341992823,3cyclictest25-21ksoftirqd/107:22:571
18341992822,4cyclictest25-21ksoftirqd/112:27:231
1834099284,4cyclictest202562chrt11:33:340
18340992823,3cyclictest9-21ksoftirqd/009:08:470
1834099281,4cyclictest524-21perf07:40:010
18343992722,3cyclictest33-21ksoftirqd/212:12:462
18343992722,3cyclictest33-21ksoftirqd/212:03:332
18343992722,3cyclictest33-21ksoftirqd/208:08:302
18341992722,3cyclictest25-21ksoftirqd/112:35:251
18341992722,3cyclictest25-21ksoftirqd/111:16:101
18341992722,3cyclictest25-21ksoftirqd/110:22:061
1834099277,3cyclictest3555-21expr12:05:200
1834099271,5cyclictest6298-21fschecks_count07:50:200
18343992621,3cyclictest33-21ksoftirqd/209:30:472
18343992620,4cyclictest33-21ksoftirqd/210:37:312
18343992620,4cyclictest33-21ksoftirqd/209:18:122
1834399251,22cyclictest0-21swapper/207:23:032
18341992520,3cyclictest25-21ksoftirqd/111:14:231
18343992419,3cyclictest33-21ksoftirqd/210:22:312
18343992419,3cyclictest33-21ksoftirqd/208:46:042
18341992318,3cyclictest25-21ksoftirqd/112:12:041
1834399220,2cyclictest0-21swapper/211:28:562
18341991913,3cyclictest25-21ksoftirqd/108:30:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional