You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-13 - 04:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Tue May 13, 2025 00:45:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
266762234168,22sleep30-21swapper/319:09:583
265872213180,22sleep20-21swapper/219:08:482
264982207173,23sleep00-21swapper/019:07:370
264722203170,22sleep10-21swapper/119:07:181
507421610,2sleep12697399cyclictest22:55:121
136991690,13ptp4l401ktimersoftd/323:45:263
136991650,1ptp4l401ktimersoftd/300:26:413
136991620,0ptp4l401ktimersoftd/321:10:203
26974996036,3cyclictest33-21ksoftirqd/200:10:192
26974995534,3cyclictest33-21ksoftirqd/221:00:262
26974995427,4cyclictest33-21ksoftirqd/221:05:282
26974995425,3cyclictest33-21ksoftirqd/223:10:292
26972995417,6cyclictest9-21ksoftirqd/023:26:380
26974995325,7cyclictest33-21ksoftirqd/223:40:002
26974995325,7cyclictest33-21ksoftirqd/223:40:002
26974995322,5cyclictest33-21ksoftirqd/221:35:002
26974995319,5cyclictest33-21ksoftirqd/221:45:002
2697399532,7cyclictest25-21ksoftirqd/123:35:001
26972995316,3cyclictest9-21ksoftirqd/020:57:510
26974995225,7cyclictest33-21ksoftirqd/222:20:002
26974995224,7cyclictest33-21ksoftirqd/219:20:012
26974995224,4cyclictest33-21ksoftirqd/220:15:092
26974995224,4cyclictest33-21ksoftirqd/220:15:092
26974995221,8cyclictest33-21ksoftirqd/219:25:212
26974995126,7cyclictest33-21ksoftirqd/222:45:012
26974995123,8cyclictest33-21ksoftirqd/220:25:162
26974995119,7cyclictest33-21ksoftirqd/222:20:152
26974995119,7cyclictest33-21ksoftirqd/222:20:142
26974995118,4cyclictest33-21ksoftirqd/221:20:222
26972995112,6cyclictest9-21ksoftirqd/022:15:270
257282510,2sleep00-21swapper/023:35:230
257282510,2sleep00-21swapper/023:35:230
26974995023,7cyclictest33-21ksoftirqd/223:00:262
26974995022,7cyclictest33-21ksoftirqd/223:00:002
26974995021,7cyclictest33-21ksoftirqd/221:15:002
26974995016,5cyclictest33-21ksoftirqd/220:02:282
26974995016,4cyclictest33-21ksoftirqd/221:50:132
2697399504,8cyclictest25-21ksoftirqd/123:25:271
2697399502,6cyclictest25-21ksoftirqd/119:20:001
2697399501,6cyclictest25-21ksoftirqd/119:40:011
2697299509,6cyclictest9-21ksoftirqd/022:47:330
2697299508,5cyclictest9-21ksoftirqd/023:00:210
2697299507,6cyclictest9-21ksoftirqd/021:15:060
2697299503,7cyclictest22529-21/usr/sbin/munin00:35:260
26974994924,6cyclictest33-21ksoftirqd/219:45:162
26974994922,7cyclictest33-21ksoftirqd/223:20:002
26974994920,8cyclictest33-21ksoftirqd/200:20:272
26974994916,6cyclictest33-21ksoftirqd/223:55:012
2697399496,6cyclictest25-21ksoftirqd/100:20:271
2697299499,5cyclictest9-21ksoftirqd/000:01:470
2697299495,6cyclictest29518-21cat20:20:220
2697299494,7cyclictest27503-21/usr/sbin/munin19:10:160
26974994822,7cyclictest33-21ksoftirqd/222:05:152
26974994822,7cyclictest33-21ksoftirqd/219:55:252
26974994820,10cyclictest33-21ksoftirqd/220:55:012
26974994819,7cyclictest33-21ksoftirqd/200:35:192
26974994817,7cyclictest33-21ksoftirqd/222:50:272
26974994815,4cyclictest33-21ksoftirqd/220:45:272
26974994812,5cyclictest33-21ksoftirqd/221:55:232
2697399488,6cyclictest25-21ksoftirqd/123:40:191
2697399485,8cyclictest25-21ksoftirqd/122:25:201
2697399484,9cyclictest25-21ksoftirqd/121:55:161
2697399483,6cyclictest25-21ksoftirqd/100:10:181
2697299484,6cyclictest7656-21irqrtprio19:35:190
26974994723,7cyclictest33-21ksoftirqd/223:05:002
26974994722,7cyclictest33-21ksoftirqd/219:40:282
26974994721,7cyclictest33-21ksoftirqd/200:05:212
26974994720,7cyclictest33-21ksoftirqd/219:35:252
26974994719,7cyclictest33-21ksoftirqd/200:30:002
26974994718,4cyclictest33-21ksoftirqd/220:40:242
2697399472,9cyclictest25-21ksoftirqd/123:10:201
26973994723,9cyclictest25-21ksoftirqd/122:11:451
26973994711,6cyclictest25-21ksoftirqd/123:05:171
2697299479,6cyclictest9-21ksoftirqd/019:40:280
2697299478,5cyclictest9-21ksoftirqd/000:31:140
2697299478,4cyclictest9-21ksoftirqd/019:34:050
2697299477,6cyclictest9-21ksoftirqd/022:04:200
2697299477,5cyclictest9-21ksoftirqd/020:26:400
26972994711,6cyclictest9-21ksoftirqd/021:50:150
2697299470,9cyclictest6156-21cat22:55:220
26974994624,3cyclictest33-21ksoftirqd/220:35:312
26974994622,7cyclictest33-21ksoftirqd/220:30:262
26974994619,6cyclictest33-21ksoftirqd/222:26:472
26974994619,3cyclictest33-21ksoftirqd/221:45:152
26974994618,3cyclictest33-21ksoftirqd/222:10:102
26974994617,7cyclictest33-21ksoftirqd/223:25:002
26974994616,6cyclictest33-21ksoftirqd/219:50:012
26974994616,6cyclictest33-21ksoftirqd/219:50:002
26974994611,8cyclictest33-21ksoftirqd/223:30:142
2697399466,5cyclictest25-21ksoftirqd/119:50:161
2697399466,5cyclictest25-21ksoftirqd/119:50:161
2697399465,5cyclictest25-21ksoftirqd/100:29:471
2697399463,6cyclictest25-21ksoftirqd/122:40:201
2697399463,6cyclictest25-21ksoftirqd/120:40:181
2697399462,5cyclictest25-21ksoftirqd/122:20:491
2697399462,5cyclictest25-21ksoftirqd/122:20:491
2697399462,5cyclictest25-21ksoftirqd/100:15:201
26973994615,6cyclictest25-21ksoftirqd/123:50:191
2697299468,5cyclictest9-21ksoftirqd/019:50:260
2697299468,5cyclictest9-21ksoftirqd/019:50:260
26972994622,4cyclictest9-21ksoftirqd/022:10:260
2697499459,5cyclictest33-21ksoftirqd/222:50:012
26974994519,4cyclictest33-21ksoftirqd/222:00:212
26974994518,7cyclictest33-21ksoftirqd/219:30:202
26974994518,3cyclictest33-21ksoftirqd/221:25:222
26974994517,4cyclictest33-21ksoftirqd/223:29:562
26974994514,4cyclictest33-21ksoftirqd/220:20:012
2697399456,8cyclictest25-21ksoftirqd/121:30:241
2697399453,6cyclictest25-21ksoftirqd/120:35:201
2697399453,5cyclictest25-21ksoftirqd/100:05:001
2697399451,5cyclictest25-21ksoftirqd/100:35:011
2697299459,5cyclictest9-21ksoftirqd/022:42:220
26972994523,4cyclictest9-21ksoftirqd/021:05:230
26972994522,7cyclictest9-21ksoftirqd/023:30:170
26972994518,6cyclictest9-21ksoftirqd/000:20:130
26972994517,6cyclictest9-21ksoftirqd/021:20:240
26974994439,3cyclictest33-21ksoftirqd/200:20:012
26974994433,3cyclictest33-21ksoftirqd/200:05:012
26974994419,7cyclictest33-21ksoftirqd/221:15:222
26974994417,7cyclictest33-21ksoftirqd/223:55:152
26974994417,7cyclictest33-21ksoftirqd/219:10:282
26974994416,7cyclictest33-21ksoftirqd/222:30:182
2697399445,10cyclictest25-21ksoftirqd/119:25:251
2697399443,6cyclictest25-21ksoftirqd/121:53:171
2697399443,6cyclictest25-21ksoftirqd/121:05:171
2697399443,6cyclictest25-21ksoftirqd/120:05:141
2697399441,5cyclictest25-21ksoftirqd/123:50:001
26973994413,9cyclictest25-21ksoftirqd/122:05:181
26973994413,3cyclictest25-21ksoftirqd/121:41:561
2697399440,6cyclictest215322chrt21:10:341
2697299448,5cyclictest9-21ksoftirqd/022:40:010
2697299444,5cyclictest9-21ksoftirqd/023:08:340
202512440,2sleep30-21swapper/323:25:193
26974994320,4cyclictest33-21ksoftirqd/219:20:282
26974994319,7cyclictest33-21ksoftirqd/220:05:202
26974994315,4cyclictest33-21ksoftirqd/200:30:262
26974994315,3cyclictest33-21ksoftirqd/220:55:262
2697499430,7cyclictest29445-21ls23:45:002
2697399433,9cyclictest25-21ksoftirqd/123:20:241
2697399433,6cyclictest25-21ksoftirqd/120:30:161
2697399432,6cyclictest25-21ksoftirqd/120:15:011
2697399432,6cyclictest25-21ksoftirqd/120:15:001
2697399432,6cyclictest25-21ksoftirqd/120:00:201
2697399432,6cyclictest25-21ksoftirqd/119:55:201
2697399431,6cyclictest25-21ksoftirqd/121:35:181
2697299437,6cyclictest9-21ksoftirqd/020:35:230
2697299437,5cyclictest9-21ksoftirqd/021:10:170
2697299436,5cyclictest9-21ksoftirqd/022:06:450
2697299436,5cyclictest9-21ksoftirqd/021:30:260
26972994328,4cyclictest9-21ksoftirqd/021:40:140
26972994317,4cyclictest9-21ksoftirqd/023:57:120
26974994213,7cyclictest33-21ksoftirqd/222:35:162
2697399424,5cyclictest25-21ksoftirqd/121:04:431
26973994224,8cyclictest25-21ksoftirqd/122:35:231
26973994212,3cyclictest25-21ksoftirqd/121:26:121
2697399420,5cyclictest131852chrt22:01:251
2697299427,5cyclictest9-21ksoftirqd/019:45:270
2697299426,6cyclictest9-21ksoftirqd/021:00:210
26972994218,6cyclictest9-21ksoftirqd/022:50:400
26972994218,6cyclictest9-21ksoftirqd/020:14:100
26972994217,7cyclictest9-21ksoftirqd/023:45:050
26974994114,8cyclictest33-21ksoftirqd/223:45:282
26974994110,3cyclictest33-21ksoftirqd/220:10:252
2697399413,4cyclictest25-21ksoftirqd/100:35:161
2697399412,6cyclictest25-21ksoftirqd/122:50:271
2697399412,5cyclictest25-21ksoftirqd/119:20:311
2697399411,6cyclictest241ktimersoftd/122:45:251
2697399410,6cyclictest25-21ksoftirqd/119:40:261
26972994119,5cyclictest9-21ksoftirqd/023:12:300
2697299410,7cyclictest101ktimersoftd/023:50:220
136991410,0ptp4l401ktimersoftd/323:43:453
2697399407,5cyclictest25-21ksoftirqd/100:05:261
2697399403,5cyclictest25-21ksoftirqd/121:45:211
2697399402,6cyclictest25-21ksoftirqd/123:35:281
2697399402,6cyclictest25-21ksoftirqd/123:35:281
26973994013,5cyclictest25-21ksoftirqd/120:25:311
2697299409,5cyclictest9-21ksoftirqd/020:30:290
2697299409,3cyclictest9-21ksoftirqd/023:20:300
136991400,0ptp4l401ktimersoftd/323:55:193
136991400,0ptp4l401ktimersoftd/321:44:553
136991400,0ptp4l401ktimersoftd/320:09:373
136991400,0ptp4l401ktimersoftd/319:35:303
2697399395,8cyclictest25-21ksoftirqd/120:55:251
2697399394,5cyclictest25-21ksoftirqd/122:17:391
2697399391,6cyclictest25-21ksoftirqd/120:20:151
2697299396,5cyclictest9-21ksoftirqd/000:25:290
2697299395,5cyclictest9-21ksoftirqd/021:45:270
2697299394,6cyclictest29679-21sort19:15:170
26972993935,3cyclictest111rcuc/022:31:300
2697299391,5cyclictest101ktimersoftd/021:55:170
2697499381,6cyclictest33-21ksoftirqd/221:35:172
2697399382,6cyclictest25-21ksoftirqd/120:52:191
2697399382,6cyclictest25-21ksoftirqd/119:12:231
2697399381,5cyclictest25-21ksoftirqd/122:30:181
2697299387,5cyclictest9-21ksoftirqd/020:15:130
2697299387,5cyclictest9-21ksoftirqd/020:15:130
2697299386,6cyclictest9-21ksoftirqd/023:40:250
2697299385,6cyclictest9-21ksoftirqd/000:15:320
136991380,1ptp4l401ktimersoftd/323:05:023
2697399378,5cyclictest25-21ksoftirqd/120:45:171
2697399375,9cyclictest25-21ksoftirqd/123:00:171
2697399374,3cyclictest25-21ksoftirqd/123:55:121
26973993713,8cyclictest25-21ksoftirqd/119:33:281
2697299376,6cyclictest9-21ksoftirqd/020:05:220
2697299373,5cyclictest29002-21runrttasks21:26:440
26972993710,3cyclictest9-21ksoftirqd/019:55:310
2697399367,6cyclictest25-21ksoftirqd/119:45:141
26973993624,3cyclictest25-21ksoftirqd/121:17:401
2697299366,5cyclictest9-21ksoftirqd/020:40:210
2697299363,4cyclictest9-21ksoftirqd/000:05:140
26972993633,2cyclictest111rcuc/020:54:140
2697299360,1cyclictest121rcu_preempt22:20:280
2697299360,1cyclictest121rcu_preempt22:20:280
26975993529,4cyclictest41-21ksoftirqd/323:19:453
26975993529,4cyclictest41-21ksoftirqd/322:53:063
26975993529,4cyclictest41-21ksoftirqd/321:34:393
26975993529,3cyclictest41-21ksoftirqd/320:20:013
26975993529,3cyclictest41-21ksoftirqd/320:20:003
2697399356,1cyclictest25-21ksoftirqd/123:15:191
2697299356,6cyclictest9-21ksoftirqd/020:45:190
2697299355,5cyclictest9-21ksoftirqd/022:25:270
2697299350,1cyclictest121rcu_preempt21:35:220
26975993428,4cyclictest41-21ksoftirqd/323:33:003
26975993428,4cyclictest41-21ksoftirqd/322:18:033
26975993428,4cyclictest41-21ksoftirqd/320:54:073
26975993428,4cyclictest41-21ksoftirqd/320:45:373
26975993428,4cyclictest41-21ksoftirqd/320:34:573
26975993428,4cyclictest41-21ksoftirqd/320:20:533
26975993428,4cyclictest41-21ksoftirqd/319:17:113
26975993428,4cyclictest41-21ksoftirqd/319:12:013
26975993427,5cyclictest41-21ksoftirqd/319:25:293
26972993429,3cyclictest9-21ksoftirqd/019:30:000
26972993428,4cyclictest9-21ksoftirqd/019:23:430
136991340,0ptp4l401ktimersoftd/322:05:203
26975993328,3cyclictest41-21ksoftirqd/320:02:403
26975993327,4cyclictest41-21ksoftirqd/322:20:123
26975993327,4cyclictest41-21ksoftirqd/322:20:123
26975993327,4cyclictest41-21ksoftirqd/321:17:303
26975993327,4cyclictest41-21ksoftirqd/319:41:383
26975993327,4cyclictest41-21ksoftirqd/319:33:003
26975993327,4cyclictest41-21ksoftirqd/319:24:173
26975993327,4cyclictest41-21ksoftirqd/300:24:093
26975993327,4cyclictest41-21ksoftirqd/300:00:563
2697399338,2cyclictest25-21ksoftirqd/121:20:221
26973993315,5cyclictest25-21ksoftirqd/120:12:111
321952320,5sleep32697599cyclictest20:25:273
26975993227,3cyclictest41-21ksoftirqd/322:39:453
26975993227,3cyclictest41-21ksoftirqd/322:31:353
26975993227,3cyclictest41-21ksoftirqd/321:26:263
26975993227,3cyclictest41-21ksoftirqd/300:10:003
26975993226,4cyclictest41-21ksoftirqd/323:23:393
26975993226,4cyclictest41-21ksoftirqd/322:27:463
26975993226,4cyclictest41-21ksoftirqd/319:46:153
26975993225,5cyclictest41-21ksoftirqd/322:45:393
26975993126,3cyclictest41-21ksoftirqd/323:03:093
26975993126,3cyclictest41-21ksoftirqd/322:12:593
26975993126,3cyclictest41-21ksoftirqd/321:04:273
26975993125,4cyclictest41-21ksoftirqd/322:58:153
26975993125,4cyclictest41-21ksoftirqd/321:36:593
26975993125,4cyclictest41-21ksoftirqd/321:08:473
26972993125,4cyclictest9-21ksoftirqd/023:17:060
2697299310,1cyclictest121rcu_preempt20:00:160
26975993027,2cyclictest41-21ksoftirqd/322:00:183
26975993025,3cyclictest41-21ksoftirqd/320:35:103
26975993025,3cyclictest41-21ksoftirqd/300:38:573
26975993024,4cyclictest41-21ksoftirqd/320:44:123
26975993024,4cyclictest41-21ksoftirqd/319:56:583
26975993023,4cyclictest41-21ksoftirqd/321:45:143
136991300,10ptp4l0-21swapper/300:12:333
136991300,0ptp4l401ktimersoftd/323:35:203
136991300,0ptp4l401ktimersoftd/323:35:203
136991300,0ptp4l401ktimersoftd/322:40:583
136991300,0ptp4l401ktimersoftd/321:50:473
26975992924,3cyclictest41-21ksoftirqd/323:50:173
136991290,0ptp4l401ktimersoftd/300:17:583
26975992823,3cyclictest41-21ksoftirqd/321:23:273
26975992823,3cyclictest41-21ksoftirqd/319:50:133
26975992823,3cyclictest41-21ksoftirqd/319:50:133
26975992822,4cyclictest41-21ksoftirqd/321:56:373
26972992816,6cyclictest9-21ksoftirqd/000:14:540
136991280,0ptp4l401ktimersoftd/320:57:383
136991280,0ptp4l401ktimersoftd/300:33:043
26975992722,3cyclictest41-21ksoftirqd/323:14:413
26975992721,4cyclictest41-21ksoftirqd/320:11:513
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional