You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-05 - 15:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot3.osadl.org (updated Mon Sep 23, 2024 00:46:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8255911840,6ptp4l401ktimersoftd/319:09:223
29194210684,10sleep10-21swapper/119:06:131
29784998874,7cyclictest33-21ksoftirqd/220:45:112
29784998771,8cyclictest33-21ksoftirqd/222:05:142
29784998668,9cyclictest33-21ksoftirqd/223:20:132
29784998571,7cyclictest33-21ksoftirqd/200:15:102
29784998568,9cyclictest33-21ksoftirqd/221:45:132
29784998568,9cyclictest33-21ksoftirqd/221:45:122
29784998066,8cyclictest33-21ksoftirqd/222:50:112
29784997965,8cyclictest33-21ksoftirqd/220:35:112
29784997964,8cyclictest33-21ksoftirqd/220:50:112
29784997962,8cyclictest33-21ksoftirqd/222:55:122
29784997866,6cyclictest33-21ksoftirqd/220:20:122
29784997764,7cyclictest33-21ksoftirqd/221:25:132
29784997764,7cyclictest33-21ksoftirqd/200:00:132
29784997763,7cyclictest33-21ksoftirqd/222:45:112
29784997662,9cyclictest33-21ksoftirqd/221:10:132
29784997560,9cyclictest33-21ksoftirqd/220:05:112
825591740,1ptp4l401ktimersoftd/322:09:083
29784997261,7cyclictest33-21ksoftirqd/220:00:122
29784997155,9cyclictest33-21ksoftirqd/220:15:142
29784997155,9cyclictest33-21ksoftirqd/220:15:142
825591700,1ptp4l401ktimersoftd/319:32:203
825591660,5ptp4l401ktimersoftd/319:10:023
29784996651,8cyclictest33-21ksoftirqd/219:15:132
29784996551,9cyclictest33-21ksoftirqd/223:50:122
29784996450,7cyclictest33-21ksoftirqd/220:10:132
29782996146,9cyclictest9-21ksoftirqd/022:40:120
165072590,9sleep12978399cyclictest19:50:141
29782995843,8cyclictest9-21ksoftirqd/022:20:120
825791570,9getstats2978599cyclictest19:17:173
29784995751,3cyclictest33-21ksoftirqd/219:39:592
29782995642,8cyclictest9-21ksoftirqd/021:30:130
29784995432,14cyclictest33-21ksoftirqd/220:25:282
29784995319,4cyclictest33-21ksoftirqd/223:59:592
29784995243,5cyclictest33-21ksoftirqd/223:10:142
29784995243,5cyclictest33-21ksoftirqd/223:10:132
29782995246,3cyclictest9-21ksoftirqd/000:40:010
29784995144,4cyclictest33-21ksoftirqd/200:30:122
29784995144,4cyclictest33-21ksoftirqd/200:30:122
29782995139,6cyclictest9-21ksoftirqd/019:35:120
29782995138,7cyclictest9-21ksoftirqd/022:35:140
29782995137,8cyclictest9-21ksoftirqd/021:20:110
29784995044,3cyclictest33-21ksoftirqd/221:40:002
29784995041,5cyclictest33-21ksoftirqd/219:25:122
29782995037,7cyclictest9-21ksoftirqd/022:10:150
29785994928,18cyclictest41-21ksoftirqd/320:17:223
29785994928,18cyclictest41-21ksoftirqd/320:17:213
29784994935,4cyclictest33-21ksoftirqd/221:05:302
29782994934,8cyclictest9-21ksoftirqd/023:00:120
29782994934,8cyclictest9-21ksoftirqd/020:55:120
2918524914,21sleep20-21swapper/219:06:052
29784994815,4cyclictest33-21ksoftirqd/220:55:252
29784994741,3cyclictest33-21ksoftirqd/223:09:592
29784994714,4cyclictest33-21ksoftirqd/222:30:132
29783994729,15cyclictest25-21ksoftirqd/123:44:091
29784994640,3cyclictest33-21ksoftirqd/223:05:002
29784994639,4cyclictest33-21ksoftirqd/223:35:052
29784994639,4cyclictest33-21ksoftirqd/222:00:002
29784994639,4cyclictest33-21ksoftirqd/221:35:002
29784994634,10cyclictest33-21ksoftirqd/219:20:202
29782994640,3cyclictest9-21ksoftirqd/023:55:000
29785994526,16cyclictest41-21ksoftirqd/300:16:393
29784994539,4cyclictest33-21ksoftirqd/219:55:002
29784994539,4cyclictest33-21ksoftirqd/200:10:212
29784994537,4cyclictest33-21ksoftirqd/221:25:002
29784994531,4cyclictest33-21ksoftirqd/222:10:162
2978499444,9cyclictest33-21ksoftirqd/222:20:302
29784994437,5cyclictest33-21ksoftirqd/200:20:322
2978499442,9cyclictest121rcu_preempt20:34:272
29782994438,3cyclictest9-21ksoftirqd/022:50:000
29782994438,3cyclictest9-21ksoftirqd/021:10:000
2931724415,18sleep00-21swapper/019:07:400
29785994322,4cyclictest41-21ksoftirqd/319:39:043
29785994317,4cyclictest31856-21cron23:50:013
29784994338,3cyclictest33-21ksoftirqd/219:40:302
29784994331,10cyclictest33-21ksoftirqd/223:30:132
29784994330,4cyclictest33-21ksoftirqd/221:00:132
29783994324,4cyclictest25-21ksoftirqd/123:32:571
29782994338,3cyclictest9-21ksoftirqd/022:55:000
29782994337,4cyclictest9-21ksoftirqd/022:20:010
29782994337,4cyclictest9-21ksoftirqd/020:40:000
29782994337,4cyclictest9-21ksoftirqd/000:09:590
29782994337,3cyclictest9-21ksoftirqd/000:20:000
29785994223,4cyclictest41-21ksoftirqd/321:23:593
29784994236,4cyclictest33-21ksoftirqd/223:20:002
29784994236,3cyclictest33-21ksoftirqd/223:25:162
29784994236,3cyclictest33-21ksoftirqd/221:55:012
29784994236,3cyclictest33-21ksoftirqd/221:40:252
29784994236,3cyclictest33-21ksoftirqd/221:40:252
29784994234,4cyclictest33-21ksoftirqd/222:39:592
29784994228,11cyclictest33-21ksoftirqd/200:05:162
2978499421,8cyclictest33-21ksoftirqd/219:30:212
29782994236,4cyclictest9-21ksoftirqd/023:40:000
29782994236,3cyclictest9-21ksoftirqd/022:30:000
29782994236,3cyclictest9-21ksoftirqd/000:35:000
29782994236,3cyclictest9-21ksoftirqd/000:34:590
2978299422,4cyclictest121rcu_preempt22:00:000
2978499413,9cyclictest33-21ksoftirqd/200:35:232
29784994136,3cyclictest33-21ksoftirqd/222:20:012
29784994135,3cyclictest33-21ksoftirqd/223:50:012
29784994135,3cyclictest33-21ksoftirqd/222:00:162
29784994134,4cyclictest33-21ksoftirqd/222:40:252
29784994134,4cyclictest33-21ksoftirqd/222:25:162
29784994134,4cyclictest33-21ksoftirqd/221:19:592
29784994133,4cyclictest33-21ksoftirqd/219:55:172
29784994133,4cyclictest33-21ksoftirqd/200:25:132
29783994122,4cyclictest25-21ksoftirqd/122:09:501
29783994121,4cyclictest25-21ksoftirqd/120:17:321
29783994121,4cyclictest25-21ksoftirqd/120:17:311
29782994135,3cyclictest9-21ksoftirqd/020:00:000
29784994035,3cyclictest33-21ksoftirqd/223:40:242
29784994032,4cyclictest33-21ksoftirqd/219:10:222
29782994035,3cyclictest9-21ksoftirqd/021:14:590
29782994034,4cyclictest9-21ksoftirqd/021:15:190
29782994034,3cyclictest9-21ksoftirqd/020:30:010
29782994034,3cyclictest9-21ksoftirqd/020:20:000
29782994034,3cyclictest9-21ksoftirqd/020:19:590
29782994034,3cyclictest9-21ksoftirqd/020:05:000
29782994034,3cyclictest9-21ksoftirqd/019:55:010
29782994033,4cyclictest9-21ksoftirqd/020:11:340
29782994033,4cyclictest9-21ksoftirqd/019:15:150
29782994031,3cyclictest9-21ksoftirqd/023:32:030
29785993933,4cyclictest41-21ksoftirqd/320:32:483
29785993920,3cyclictest41-21ksoftirqd/321:17:493
29784993934,3cyclictest33-21ksoftirqd/219:49:592
29784993933,3cyclictest33-21ksoftirqd/220:40:202
29783993933,4cyclictest25-21ksoftirqd/120:40:001
29783993933,3cyclictest25-21ksoftirqd/123:39:161
29782993934,3cyclictest9-21ksoftirqd/021:55:000
29782993934,3cyclictest9-21ksoftirqd/021:45:000
29782993934,3cyclictest9-21ksoftirqd/021:44:590
29782993934,3cyclictest9-21ksoftirqd/019:35:000
29782993933,3cyclictest9-21ksoftirqd/019:44:590
29782993932,4cyclictest9-21ksoftirqd/000:20:210
29782993923,5cyclictest9-21ksoftirqd/020:34:260
29785993832,4cyclictest41-21ksoftirqd/321:31:203
29783993831,4cyclictest25-21ksoftirqd/122:05:001
29783993830,5cyclictest25-21ksoftirqd/121:16:431
29782993833,3cyclictest9-21ksoftirqd/022:00:210
29782993833,3cyclictest9-21ksoftirqd/000:05:000
29782993831,4cyclictest9-21ksoftirqd/020:50:160
2978299380,6cyclictest0-21swapper/023:55:160
825591370,1ptp4l401ktimersoftd/323:05:153
29785993731,3cyclictest41-21ksoftirqd/320:36:463
29785993730,4cyclictest41-21ksoftirqd/321:56:233
29785993730,4cyclictest41-21ksoftirqd/321:28:213
29783993731,3cyclictest25-21ksoftirqd/120:45:581
29783993730,4cyclictest25-21ksoftirqd/123:09:371
29783993730,4cyclictest25-21ksoftirqd/120:10:131
29782993731,4cyclictest9-21ksoftirqd/023:15:280
29782993731,3cyclictest9-21ksoftirqd/023:40:130
29782993730,4cyclictest9-21ksoftirqd/023:47:090
29782993730,4cyclictest9-21ksoftirqd/022:05:180
29782993730,4cyclictest9-21ksoftirqd/021:50:010
29782993730,4cyclictest9-21ksoftirqd/021:50:000
29782993730,4cyclictest9-21ksoftirqd/020:10:000
29782993730,4cyclictest9-21ksoftirqd/019:25:110
29782993730,3cyclictest9-21ksoftirqd/023:25:130
29782993725,5cyclictest9-21ksoftirqd/020:40:200
29785993630,4cyclictest41-21ksoftirqd/321:08:223
29785993629,4cyclictest41-21ksoftirqd/323:42:143
29783993630,4cyclictest25-21ksoftirqd/119:11:591
29783993629,5cyclictest25-21ksoftirqd/122:20:541
29783993629,4cyclictest25-21ksoftirqd/123:20:321
29783993629,4cyclictest25-21ksoftirqd/122:40:061
29783993629,4cyclictest25-21ksoftirqd/122:38:091
29783993629,4cyclictest25-21ksoftirqd/122:30:491
29783993629,4cyclictest25-21ksoftirqd/122:17:201
29783993629,4cyclictest25-21ksoftirqd/121:52:581
29783993629,4cyclictest25-21ksoftirqd/121:07:461
29783993629,4cyclictest25-21ksoftirqd/119:44:231
29783993629,4cyclictest25-21ksoftirqd/100:02:351
29783993614,20cyclictest0-21swapper/100:10:421
29782993631,3cyclictest9-21ksoftirqd/022:56:190
29782993631,3cyclictest9-21ksoftirqd/019:20:220
29782993629,4cyclictest9-21ksoftirqd/021:37:280
29782993629,4cyclictest9-21ksoftirqd/020:49:230
2978299361,8cyclictest9-21ksoftirqd/000:25:210
825591350,1ptp4l401ktimersoftd/320:13:563
29785993529,3cyclictest41-21ksoftirqd/321:42:353
29785993529,3cyclictest41-21ksoftirqd/321:42:343
29785993529,3cyclictest41-21ksoftirqd/320:24:183
29785993528,4cyclictest41-21ksoftirqd/322:53:443
29785993528,4cyclictest41-21ksoftirqd/320:25:383
29785993528,4cyclictest41-21ksoftirqd/300:36:083
29783993529,3cyclictest25-21ksoftirqd/123:15:371
29783993529,3cyclictest25-21ksoftirqd/121:21:391
29783993529,3cyclictest25-21ksoftirqd/120:41:581
29783993529,3cyclictest25-21ksoftirqd/100:26:081
29783993528,4cyclictest25-21ksoftirqd/121:56:581
29783993528,4cyclictest25-21ksoftirqd/121:00:441
29783993528,4cyclictest25-21ksoftirqd/120:00:521
29782993529,4cyclictest9-21ksoftirqd/019:45:270
29782993528,4cyclictest9-21ksoftirqd/023:15:010
29782993528,4cyclictest9-21ksoftirqd/023:15:000
825591340,1ptp4l401ktimersoftd/321:53:193
29785993429,3cyclictest41-21ksoftirqd/319:42:163
29785993428,3cyclictest41-21ksoftirqd/322:59:193
29785993427,4cyclictest41-21ksoftirqd/323:34:193
29785993427,4cyclictest41-21ksoftirqd/323:28:383
29785993427,4cyclictest41-21ksoftirqd/321:46:373
29785993427,4cyclictest41-21ksoftirqd/321:46:373
29785993427,4cyclictest41-21ksoftirqd/320:07:433
29785993427,4cyclictest41-21ksoftirqd/319:53:503
29785993427,4cyclictest41-21ksoftirqd/300:24:183
29785993427,4cyclictest41-21ksoftirqd/300:12:423
29783993428,4cyclictest25-21ksoftirqd/123:27:471
29783993428,4cyclictest25-21ksoftirqd/120:30:321
29783993428,4cyclictest25-21ksoftirqd/120:06:521
29783993428,4cyclictest25-21ksoftirqd/119:55:431
29783993428,3cyclictest25-21ksoftirqd/119:19:271
29783993427,5cyclictest25-21ksoftirqd/123:45:501
29783993427,4cyclictest25-21ksoftirqd/122:27:131
29783993427,4cyclictest25-21ksoftirqd/121:37:421
29783993427,4cyclictest25-21ksoftirqd/120:27:311
29783993427,4cyclictest25-21ksoftirqd/120:20:341
29783993427,4cyclictest25-21ksoftirqd/119:45:251
29783993427,4cyclictest25-21ksoftirqd/119:34:281
29783993427,4cyclictest25-21ksoftirqd/119:23:441
29782993429,3cyclictest9-21ksoftirqd/023:20:290
29782993429,3cyclictest9-21ksoftirqd/000:15:000
29782993428,4cyclictest9-21ksoftirqd/019:10:300
29782993428,3cyclictest9-21ksoftirqd/022:30:290
29782993428,3cyclictest9-21ksoftirqd/021:05:010
29782993427,4cyclictest9-21ksoftirqd/021:26:040
825591330,19ptp4l34992irq/88-enp1s0-T22:13:003
29785993327,4cyclictest41-21ksoftirqd/323:02:203
29785993327,3cyclictest41-21ksoftirqd/323:57:133
29785993327,3cyclictest41-21ksoftirqd/320:40:163
29785993326,4cyclictest41-21ksoftirqd/323:39:013
29785993326,4cyclictest41-21ksoftirqd/323:15:493
29785993326,4cyclictest41-21ksoftirqd/322:21:493
29785993326,4cyclictest41-21ksoftirqd/320:54:043
29785993326,4cyclictest41-21ksoftirqd/319:28:133
29783993327,3cyclictest25-21ksoftirqd/123:12:071
29783993327,3cyclictest25-21ksoftirqd/123:12:061
29783993327,3cyclictest25-21ksoftirqd/122:55:481
29783993327,3cyclictest25-21ksoftirqd/120:55:091
29783993327,3cyclictest25-21ksoftirqd/119:39:301
29782993325,5cyclictest9-21ksoftirqd/023:08:470
29785993227,3cyclictest41-21ksoftirqd/322:27:123
29785993226,4cyclictest41-21ksoftirqd/321:35:483
29785993226,4cyclictest41-21ksoftirqd/320:46:493
29785993226,3cyclictest41-21ksoftirqd/323:50:183
29785993226,3cyclictest41-21ksoftirqd/320:58:013
29785993226,3cyclictest41-21ksoftirqd/319:59:523
29785993225,4cyclictest41-21ksoftirqd/323:20:183
29785993225,4cyclictest41-21ksoftirqd/322:35:063
29785993225,4cyclictest41-21ksoftirqd/322:02:543
29785993225,4cyclictest41-21ksoftirqd/319:20:333
29785993225,4cyclictest41-21ksoftirqd/300:32:093
29785993225,4cyclictest41-21ksoftirqd/300:32:083
29785993225,4cyclictest41-21ksoftirqd/300:27:353
29783993227,3cyclictest25-21ksoftirqd/119:26:311
29783993227,3cyclictest25-21ksoftirqd/100:33:021
29783993227,3cyclictest25-21ksoftirqd/100:33:021
29783993226,3cyclictest25-21ksoftirqd/120:53:511
29783993225,4cyclictest25-21ksoftirqd/122:12:071
29783993225,4cyclictest25-21ksoftirqd/121:12:331
29783993225,4cyclictest25-21ksoftirqd/100:24:591
29785993125,4cyclictest41-21ksoftirqd/323:14:413
29785993125,4cyclictest41-21ksoftirqd/323:14:403
29785993124,4cyclictest41-21ksoftirqd/322:32:133
29783993126,3cyclictest25-21ksoftirqd/121:34:541
29783993125,4cyclictest25-21ksoftirqd/122:54:261
29783993125,3cyclictest25-21ksoftirqd/100:08:161
29783993124,4cyclictest25-21ksoftirqd/121:46:441
29783993124,4cyclictest25-21ksoftirqd/121:46:431
29782993125,4cyclictest9-21ksoftirqd/020:23:070
29785993024,3cyclictest41-21ksoftirqd/300:02:033
29783993024,3cyclictest25-21ksoftirqd/123:56:221
29783993023,4cyclictest25-21ksoftirqd/123:01:571
29783993023,4cyclictest25-21ksoftirqd/121:41:071
29783993023,4cyclictest25-21ksoftirqd/121:41:071
825591290,1ptp4l401ktimersoftd/319:45:223
825591290,10ptp4l401ktimersoftd/322:18:083
29785992923,4cyclictest41-21ksoftirqd/322:41:473
29783992923,3cyclictest25-21ksoftirqd/100:17:591
29785992822,4cyclictest41-21ksoftirqd/322:46:453
29785992821,4cyclictest41-21ksoftirqd/321:10:063
825591270,1ptp4l401ktimersoftd/320:00:473
29785992721,4cyclictest41-21ksoftirqd/321:05:003
29785992721,3cyclictest41-21ksoftirqd/300:07:543
29783992721,3cyclictest25-21ksoftirqd/121:28:391
29783992620,4cyclictest25-21ksoftirqd/100:36:001
29783992619,4cyclictest25-21ksoftirqd/122:48:471
29783992518,4cyclictest25-21ksoftirqd/123:54:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional