You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 05:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot2.osadl.org (updated Mon May 05, 2025 00:45:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27952235168,23sleep30-21swapper/319:09:503
27112206174,21sleep20-21swapper/219:08:442
26322204171,22sleep10-21swapper/119:07:431
26012204172,21sleep00-21swapper/019:07:170
2948621600,5sleep2310299cyclictest00:35:102
2935121300,3sleep2311rcuc/222:20:152
294632610,4sleep329465-21rt-features21:10:243
137291610,1ptp4l401ktimersoftd/320:40:193
3102995922,4cyclictest33-21ksoftirqd/222:10:562
3102995918,8cyclictest33-21ksoftirqd/223:20:012
137291580,1ptp4l401ktimersoftd/321:05:293
3102995722,4cyclictest33-21ksoftirqd/221:29:242
3102995722,4cyclictest33-21ksoftirqd/220:36:322
3102995720,4cyclictest33-21ksoftirqd/222:01:012
137291570,1ptp4l401ktimersoftd/300:10:243
3102995620,4cyclictest33-21ksoftirqd/223:00:282
3102995520,8cyclictest33-21ksoftirqd/223:30:212
3102995519,4cyclictest33-21ksoftirqd/200:27:392
3102995322,9cyclictest33-21ksoftirqd/222:50:142
3102995321,9cyclictest33-21ksoftirqd/220:15:002
3102995318,4cyclictest33-21ksoftirqd/220:15:332
3102995315,9cyclictest33-21ksoftirqd/221:10:142
308542530,2sleep30-21swapper/323:30:163
3102995215,10cyclictest33-21ksoftirqd/220:30:282
128032520,1sleep30-21swapper/322:50:253
178582510,2sleep20-21swapper/200:10:162
137291510,1ptp4l401ktimersoftd/320:37:033
310299502,3cyclictest33-21ksoftirqd/219:45:212
3102995019,3cyclictest33-21ksoftirqd/219:15:282
3102995017,8cyclictest33-21ksoftirqd/221:55:282
3102995017,11cyclictest33-21ksoftirqd/200:20:272
3102995016,4cyclictest33-21ksoftirqd/221:45:132
310299494,2cyclictest33-21ksoftirqd/222:40:232
310299493,2cyclictest33-21ksoftirqd/223:40:002
3102994921,5cyclictest33-21ksoftirqd/223:10:552
3102994920,4cyclictest33-21ksoftirqd/219:35:152
3102994917,7cyclictest33-21ksoftirqd/222:30:222
3102994911,7cyclictest33-21ksoftirqd/220:55:182
310299489,7cyclictest33-21ksoftirqd/222:45:242
310299483,3cyclictest33-21ksoftirqd/220:30:012
3102994819,9cyclictest33-21ksoftirqd/220:50:242
3102994817,4cyclictest33-21ksoftirqd/221:05:182
137291480,1ptp4l401ktimersoftd/321:43:163
3103994740,4cyclictest22184-21wc00:20:013
3102994735,3cyclictest33-21ksoftirqd/200:00:242
310299468,7cyclictest33-21ksoftirqd/222:15:242
310299468,3cyclictest33-21ksoftirqd/222:25:162
310299467,2cyclictest33-21ksoftirqd/219:25:272
310299464,6cyclictest33-21ksoftirqd/223:30:012
310299464,6cyclictest33-21ksoftirqd/223:20:162
3102994616,4cyclictest33-21ksoftirqd/221:40:202
310299461,3cyclictest33-21ksoftirqd/219:10:242
3102994613,3cyclictest33-21ksoftirqd/221:20:282
3102994613,3cyclictest33-21ksoftirqd/220:21:522
3102994517,4cyclictest33-21ksoftirqd/221:15:222
3102994514,6cyclictest33-21ksoftirqd/223:55:172
310299451,2cyclictest121rcu_preempt19:55:152
310299443,3cyclictest33-21ksoftirqd/219:30:252
3102994432,10cyclictest33-21ksoftirqd/219:50:142
3102994419,7cyclictest33-21ksoftirqd/223:05:232
310299441,3cyclictest33-21ksoftirqd/221:30:302
310299435,3cyclictest33-21ksoftirqd/221:35:262
310299434,5cyclictest22905-21ls22:05:222
310299433,2cyclictest33-21ksoftirqd/200:10:002
3102994330,4cyclictest33-21ksoftirqd/222:55:222
310299431,6cyclictest33-21ksoftirqd/221:55:012
310299431,4cyclictest33-21ksoftirqd/221:05:002
3102994314,5cyclictest33-21ksoftirqd/223:45:172
3102994314,5cyclictest33-21ksoftirqd/223:45:162
3102994312,3cyclictest33-21ksoftirqd/220:40:152
3101994327,13cyclictest25-21ksoftirqd/119:50:121
137291430,0ptp4l401ktimersoftd/321:53:103
137291430,0ptp4l401ktimersoftd/321:35:373
310299428,5cyclictest33-21ksoftirqd/220:05:222
310299427,5cyclictest33-21ksoftirqd/220:00:192
310299423,7cyclictest33-21ksoftirqd/220:45:162
310299423,2cyclictest33-21ksoftirqd/200:15:152
310299421,3cyclictest33-21ksoftirqd/219:40:262
137291420,0ptp4l401ktimersoftd/319:30:293
137291420,0ptp4l401ktimersoftd/300:23:133
310299411,2cyclictest33-21ksoftirqd/223:40:192
310399407,4cyclictest41-21ksoftirqd/319:40:003
3103994035,3cyclictest41-21ksoftirqd/300:10:003
310299401,2cyclictest121rcu_preempt23:55:002
310299400,3cyclictest33-21ksoftirqd/200:30:262
310299400,2cyclictest33-21ksoftirqd/222:35:292
137291400,1ptp4l401ktimersoftd/322:11:343
137291400,1ptp4l401ktimersoftd/321:57:353
137291400,0ptp4l401ktimersoftd/323:05:213
310399395,2cyclictest41-21ksoftirqd/322:25:013
3103993936,2cyclictest41-21ksoftirqd/319:25:013
3103993934,3cyclictest41-21ksoftirqd/320:05:003
3102993934,3cyclictest33-21ksoftirqd/219:25:012
3100993934,3cyclictest9-21ksoftirqd/019:20:000
310399383,3cyclictest41-21ksoftirqd/319:10:283
3103993832,3cyclictest41-21ksoftirqd/300:35:013
3103993832,3cyclictest41-21ksoftirqd/300:05:013
3103993732,3cyclictest41-21ksoftirqd/323:30:003
3103993732,3cyclictest41-21ksoftirqd/323:20:003
3103993731,4cyclictest41-21ksoftirqd/322:09:593
137291370,0ptp4l401ktimersoftd/321:45:163
3103993632,3cyclictest41-21ksoftirqd/323:00:013
3103993631,3cyclictest41-21ksoftirqd/319:50:003
3103993631,3cyclictest41-21ksoftirqd/319:40:193
310399361,3cyclictest121rcu_preempt21:20:003
3101993630,4cyclictest25-21ksoftirqd/122:19:251
3100993630,4cyclictest9-21ksoftirqd/000:21:130
3100993630,4cyclictest9-21ksoftirqd/000:05:040
137291360,0ptp4l401ktimersoftd/320:20:313
3103993530,3cyclictest41-21ksoftirqd/323:35:143
3103993530,3cyclictest41-21ksoftirqd/322:20:193
3103993530,3cyclictest41-21ksoftirqd/321:04:593
3103993529,4cyclictest41-21ksoftirqd/322:01:153
3103993529,4cyclictest41-21ksoftirqd/320:48:053
3103993529,4cyclictest41-21ksoftirqd/320:31:093
3103993529,3cyclictest41-21ksoftirqd/320:55:233
3103993529,3cyclictest41-21ksoftirqd/319:50:123
3101993529,4cyclictest25-21ksoftirqd/123:39:451
3101993529,4cyclictest25-21ksoftirqd/122:24:391
3101993529,4cyclictest25-21ksoftirqd/122:03:341
3101993529,4cyclictest25-21ksoftirqd/121:03:331
3101993529,4cyclictest25-21ksoftirqd/100:21:341
3101993529,4cyclictest25-21ksoftirqd/100:12:191
3101993514,4cyclictest8169-21perl21:35:181
3100993529,4cyclictest9-21ksoftirqd/021:26:380
3100993529,4cyclictest9-21ksoftirqd/019:48:250
310399345,3cyclictest41-21ksoftirqd/322:15:173
310399343,3cyclictest41-21ksoftirqd/322:35:003
3103993429,3cyclictest41-21ksoftirqd/323:55:133
3103993429,3cyclictest41-21ksoftirqd/323:00:143
3103993429,3cyclictest41-21ksoftirqd/322:50:013
3103993429,3cyclictest41-21ksoftirqd/322:40:203
3103993429,3cyclictest41-21ksoftirqd/319:25:213
3103993429,3cyclictest41-21ksoftirqd/300:35:213
3103993429,3cyclictest41-21ksoftirqd/300:25:203
3103993428,3cyclictest41-21ksoftirqd/320:10:173
3101993429,3cyclictest25-21ksoftirqd/120:51:161
3101993429,3cyclictest25-21ksoftirqd/119:30:121
3101993428,4cyclictest25-21ksoftirqd/121:47:571
3100993430,2cyclictest9-21ksoftirqd/022:25:200
3100993429,3cyclictest9-21ksoftirqd/023:00:010
3100993429,3cyclictest9-21ksoftirqd/021:00:250
3100993429,3cyclictest9-21ksoftirqd/021:00:010
310399334,3cyclictest41-21ksoftirqd/321:25:163
3103993328,3cyclictest41-21ksoftirqd/323:14:593
3103993328,2cyclictest41-21ksoftirqd/321:25:013
3103993327,4cyclictest41-21ksoftirqd/319:15:463
3103993326,4cyclictest41-21ksoftirqd/323:55:013
310399332,3cyclictest41-21ksoftirqd/323:45:163
310399332,3cyclictest41-21ksoftirqd/323:45:163
3101993328,3cyclictest25-21ksoftirqd/119:55:121
3101993327,4cyclictest25-21ksoftirqd/123:43:141
3101993327,4cyclictest25-21ksoftirqd/123:16:261
3101993327,4cyclictest25-21ksoftirqd/123:04:351
3101993327,4cyclictest25-21ksoftirqd/122:14:361
3101993327,4cyclictest25-21ksoftirqd/121:40:111
3101993327,4cyclictest25-21ksoftirqd/120:16:381
3101993327,4cyclictest25-21ksoftirqd/100:02:241
3100993327,4cyclictest9-21ksoftirqd/022:44:520
3100993327,4cyclictest9-21ksoftirqd/020:53:120
3100993327,4cyclictest9-21ksoftirqd/020:16:490
3100993327,4cyclictest9-21ksoftirqd/000:20:010
3103993227,3cyclictest41-21ksoftirqd/323:25:003
3103993227,3cyclictest41-21ksoftirqd/322:35:173
3103993227,3cyclictest41-21ksoftirqd/321:30:173
3103993227,3cyclictest41-21ksoftirqd/320:05:323
3101993226,4cyclictest25-21ksoftirqd/122:06:461
3101993226,4cyclictest25-21ksoftirqd/120:29:501
3101993226,4cyclictest25-21ksoftirqd/119:21:101
3101993225,4cyclictest25-21ksoftirqd/122:25:441
3101993214,3cyclictest4638-21grep20:20:201
3100993227,3cyclictest9-21ksoftirqd/021:19:440
3100993227,3cyclictest9-21ksoftirqd/020:30:230
3100993227,3cyclictest9-21ksoftirqd/000:11:220
3100993226,4cyclictest9-21ksoftirqd/023:47:030
3100993226,4cyclictest9-21ksoftirqd/023:47:030
3100993226,4cyclictest9-21ksoftirqd/023:06:270
3100993226,4cyclictest9-21ksoftirqd/023:02:260
3100993226,4cyclictest9-21ksoftirqd/022:24:470
3100993226,4cyclictest9-21ksoftirqd/021:52:330
3100993226,4cyclictest9-21ksoftirqd/021:14:060
137291320,0ptp4l401ktimersoftd/319:57:123
310399314,2cyclictest41-21ksoftirqd/320:50:153
3103993127,3cyclictest41-21ksoftirqd/323:40:123
3101993126,3cyclictest25-21ksoftirqd/121:24:141
3101993125,4cyclictest25-21ksoftirqd/123:21:311
3101993125,4cyclictest25-21ksoftirqd/123:12:091
3101993125,4cyclictest25-21ksoftirqd/121:16:241
3101993125,4cyclictest25-21ksoftirqd/121:07:361
3101993125,4cyclictest25-21ksoftirqd/120:46:151
3101993125,4cyclictest25-21ksoftirqd/119:14:441
3101993125,4cyclictest25-21ksoftirqd/100:25:311
3100993126,3cyclictest9-21ksoftirqd/023:35:120
3100993126,3cyclictest9-21ksoftirqd/020:47:110
3100993126,3cyclictest9-21ksoftirqd/019:34:050
3100993126,3cyclictest9-21ksoftirqd/019:26:190
3100993126,3cyclictest9-21ksoftirqd/000:26:370
3100993125,4cyclictest9-21ksoftirqd/023:57:290
3100993125,4cyclictest9-21ksoftirqd/023:31:100
3100993125,4cyclictest9-21ksoftirqd/022:04:530
3103993024,4cyclictest41-21ksoftirqd/320:16:113
3101993025,3cyclictest25-21ksoftirqd/122:52:561
3101993025,3cyclictest25-21ksoftirqd/100:16:061
3101993024,4cyclictest25-21ksoftirqd/121:32:041
3101993024,4cyclictest25-21ksoftirqd/120:39:531
3101993024,4cyclictest25-21ksoftirqd/120:07:071
310199302,26cyclictest0-21swapper/121:25:591
3100993026,3cyclictest9-21ksoftirqd/022:35:020
3100993026,3cyclictest9-21ksoftirqd/019:10:200
3100993025,3cyclictest9-21ksoftirqd/023:42:350
3100993025,3cyclictest9-21ksoftirqd/023:28:050
3100993025,3cyclictest9-21ksoftirqd/023:24:240
3100993025,3cyclictest9-21ksoftirqd/022:30:120
3100993025,3cyclictest9-21ksoftirqd/021:05:070
3100993025,3cyclictest9-21ksoftirqd/020:21:230
3100993025,3cyclictest9-21ksoftirqd/020:15:000
3100993025,3cyclictest9-21ksoftirqd/019:21:130
3100993024,4cyclictest9-21ksoftirqd/023:10:400
3100993024,4cyclictest9-21ksoftirqd/022:11:470
3100993024,4cyclictest9-21ksoftirqd/019:44:160
3103992924,3cyclictest41-21ksoftirqd/320:25:183
3101992924,3cyclictest25-21ksoftirqd/119:18:161
3101992924,3cyclictest25-21ksoftirqd/100:30:491
3101992924,3cyclictest25-21ksoftirqd/100:06:281
3101992923,4cyclictest25-21ksoftirqd/123:52:171
3101992923,4cyclictest25-21ksoftirqd/123:27:491
3101992923,4cyclictest25-21ksoftirqd/121:11:181
3101992923,4cyclictest25-21ksoftirqd/120:41:011
3100992924,3cyclictest9-21ksoftirqd/023:53:040
3100992924,3cyclictest9-21ksoftirqd/021:20:560
3100992924,3cyclictest9-21ksoftirqd/020:00:250
3100992923,4cyclictest9-21ksoftirqd/022:47:080
3100992923,4cyclictest9-21ksoftirqd/021:47:040
3100992923,4cyclictest9-21ksoftirqd/020:27:530
3100992923,4cyclictest9-21ksoftirqd/019:51:500
3100992923,4cyclictest9-21ksoftirqd/000:33:430
3101992823,3cyclictest25-21ksoftirqd/123:55:131
3101992823,3cyclictest25-21ksoftirqd/120:57:541
3101992822,3cyclictest25-21ksoftirqd/122:49:121
3100992823,3cyclictest9-21ksoftirqd/023:19:520
3100992823,3cyclictest9-21ksoftirqd/021:58:350
3100992823,3cyclictest9-21ksoftirqd/020:44:590
3100992823,3cyclictest9-21ksoftirqd/020:36:470
3100992823,3cyclictest9-21ksoftirqd/019:40:000
3100992822,4cyclictest9-21ksoftirqd/000:38:330
3101992722,3cyclictest25-21ksoftirqd/121:57:401
3101992722,3cyclictest25-21ksoftirqd/119:43:331
3101992721,4cyclictest25-21ksoftirqd/120:31:551
3101992721,4cyclictest25-21ksoftirqd/120:14:421
3100992722,3cyclictest9-21ksoftirqd/021:40:410
3100992722,3cyclictest9-21ksoftirqd/021:35:120
3100992722,3cyclictest9-21ksoftirqd/021:33:230
3100992721,4cyclictest9-21ksoftirqd/020:07:060
3101992620,4cyclictest25-21ksoftirqd/123:09:131
3100992621,3cyclictest9-21ksoftirqd/022:06:430
3101992520,3cyclictest25-21ksoftirqd/122:58:081
3101992519,4cyclictest25-21ksoftirqd/122:44:011
3101992519,4cyclictest25-21ksoftirqd/119:39:311
3100992520,3cyclictest9-21ksoftirqd/022:15:140
3100992520,3cyclictest27020-21latency_hist20:00:000
3101992418,4cyclictest25-21ksoftirqd/122:37:591
3100992419,3cyclictest9-21ksoftirqd/000:00:200
3101992318,3cyclictest25-21ksoftirqd/123:48:471
3101992318,3cyclictest25-21ksoftirqd/123:48:471
3100992318,3cyclictest9-21ksoftirqd/022:50:270
310199220,2cyclictest0-21swapper/122:30:221
3101992116,3cyclictest25-21ksoftirqd/119:26:131
3101992015,3cyclictest25-21ksoftirqd/100:39:591
3101992014,4cyclictest32157-21uptime23:30:281
3101991813,3cyclictest21617-21awk19:45:291
3101991712,3cyclictest25-21ksoftirqd/120:03:541
3101991712,3cyclictest15150-21df_inode21:50:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional