You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-09 - 08:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Sat Dec 09, 2023 00:46:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1210521760,8sleep21323299cyclictest21:25:172
825591980,2ptp4l1100-21runrttasks19:11:283
825591920,65ptp4l401ktimersoftd/319:08:143
825591700,2ptp4l401ktimersoftd/321:30:183
825591680,2ptp4l401ktimersoftd/300:31:413
825591670,2ptp4l401ktimersoftd/321:26:463
825591650,1ptp4l401ktimersoftd/321:38:053
13233996553,6cyclictest41-21ksoftirqd/320:55:183
825591640,2ptp4l401ktimersoftd/322:18:573
57698630,11rtkit-daemon0-21swapper/119:09:541
13232996356,4cyclictest33-21ksoftirqd/221:50:182
13232996255,4cyclictest33-21ksoftirqd/223:15:192
825591610,1ptp4l401ktimersoftd/323:16:053
13232996154,4cyclictest33-21ksoftirqd/220:15:192
13232995952,4cyclictest33-21ksoftirqd/220:05:182
13232995952,4cyclictest33-21ksoftirqd/220:05:182
13232995951,5cyclictest33-21ksoftirqd/222:25:192
13233995850,4cyclictest41-21ksoftirqd/322:10:203
13233995745,7cyclictest41-21ksoftirqd/300:15:233
13232995749,5cyclictest33-21ksoftirqd/220:45:202
13232995749,5cyclictest33-21ksoftirqd/200:05:192
1323199574,12cyclictest1123-21snmpd00:35:491
13232995649,4cyclictest33-21ksoftirqd/222:50:202
13232995346,4cyclictest33-21ksoftirqd/221:05:202
57698500,17rtkit-daemon0-21swapper/020:56:290
13232995044,3cyclictest33-21ksoftirqd/223:00:002
13232995044,3cyclictest33-21ksoftirqd/221:50:002
126652501,11sleep2206-21systemd-journal19:06:322
13232994942,4cyclictest33-21ksoftirqd/200:20:002
13233994842,3cyclictest41-21ksoftirqd/320:20:003
13232994843,3cyclictest33-21ksoftirqd/223:40:012
13232994842,4cyclictest33-21ksoftirqd/220:20:282
13232994842,4cyclictest33-21ksoftirqd/200:05:002
13232994841,4cyclictest33-21ksoftirqd/221:00:002
1323299474,4cyclictest121rcu_preempt21:59:362
13232994741,3cyclictest33-21ksoftirqd/222:40:002
13232994741,3cyclictest33-21ksoftirqd/220:15:002
13232994740,4cyclictest33-21ksoftirqd/223:55:192
13232994637,5cyclictest33-21ksoftirqd/222:05:182
13232994634,10cyclictest33-21ksoftirqd/200:10:242
1279824616,18sleep00-21swapper/019:08:070
13232994540,3cyclictest33-21ksoftirqd/221:40:192
13232994539,4cyclictest33-21ksoftirqd/222:40:242
13232994539,4cyclictest33-21ksoftirqd/220:35:012
13232994538,4cyclictest33-21ksoftirqd/219:59:592
825591440,1ptp4l401ktimersoftd/300:35:263
13232994439,3cyclictest33-21ksoftirqd/200:40:002
13232994438,4cyclictest33-21ksoftirqd/219:50:282
13232994438,3cyclictest33-21ksoftirqd/223:29:592
13232994438,3cyclictest33-21ksoftirqd/223:05:002
13232994437,4cyclictest33-21ksoftirqd/219:40:192
13232994437,4cyclictest33-21ksoftirqd/219:40:002
825591430,1ptp4l401ktimersoftd/320:40:263
13232994337,4cyclictest33-21ksoftirqd/223:50:282
13232994337,4cyclictest33-21ksoftirqd/222:20:212
13232994337,4cyclictest33-21ksoftirqd/219:45:172
13232994337,3cyclictest33-21ksoftirqd/223:50:002
13232994337,3cyclictest33-21ksoftirqd/223:50:002
13232994337,3cyclictest33-21ksoftirqd/220:40:282
13232994336,4cyclictest33-21ksoftirqd/221:20:262
13232994336,4cyclictest33-21ksoftirqd/221:20:252
13232994336,3cyclictest33-21ksoftirqd/219:10:182
13232994330,3cyclictest33-21ksoftirqd/220:35:372
825591420,3ptp4l2006-21kworker/3:221:13:073
825591420,3ptp4l1370-21kworker/3:023:33:533
825591420,1ptp4l401ktimersoftd/321:20:313
825591420,1ptp4l401ktimersoftd/321:20:303
13233994237,3cyclictest41-21ksoftirqd/323:50:003
13233994237,3cyclictest41-21ksoftirqd/323:50:003
13233994236,4cyclictest41-21ksoftirqd/320:00:213
13233994236,4cyclictest41-21ksoftirqd/300:25:213
1323299429,4cyclictest33-21ksoftirqd/221:35:352
13232994236,3cyclictest33-21ksoftirqd/222:10:252
13232994236,3cyclictest33-21ksoftirqd/200:25:012
13232994235,4cyclictest33-21ksoftirqd/223:20:242
13232994235,4cyclictest33-21ksoftirqd/221:35:002
13232994235,4cyclictest33-21ksoftirqd/220:05:002
13232994235,4cyclictest33-21ksoftirqd/219:30:222
13232994230,10cyclictest33-21ksoftirqd/219:30:012
13230994223,16cyclictest9-21ksoftirqd/022:58:510
13230994213,6cyclictest1131-21lldpd23:43:410
825591410,3ptp4l2006-21kworker/3:221:50:393
825591410,1ptp4l401ktimersoftd/323:59:233
825591410,1ptp4l401ktimersoftd/323:29:283
825591410,1ptp4l401ktimersoftd/322:32:203
825591410,1ptp4l401ktimersoftd/322:22:153
825591410,1ptp4l401ktimersoftd/320:27:503
825591410,1ptp4l401ktimersoftd/320:06:253
825591410,1ptp4l401ktimersoftd/320:06:253
825591410,1ptp4l401ktimersoftd/319:38:583
825591410,1ptp4l401ktimersoftd/300:05:383
13233994134,4cyclictest41-21ksoftirqd/321:15:193
13233994134,4cyclictest41-21ksoftirqd/321:15:193
13232994135,4cyclictest33-21ksoftirqd/221:00:212
13232994135,3cyclictest33-21ksoftirqd/223:45:002
13232994135,3cyclictest33-21ksoftirqd/200:30:172
13232994134,4cyclictest33-21ksoftirqd/222:35:002
13232994134,4cyclictest33-21ksoftirqd/222:15:252
13232994134,4cyclictest33-21ksoftirqd/221:20:002
13232994134,4cyclictest33-21ksoftirqd/221:20:002
13232994134,4cyclictest33-21ksoftirqd/220:25:292
13232994134,4cyclictest33-21ksoftirqd/219:20:002
13232994133,5cyclictest33-21ksoftirqd/223:05:192
13231994134,4cyclictest25-21ksoftirqd/100:33:281
13230994123,15cyclictest9-21ksoftirqd/021:17:490
13230994123,15cyclictest9-21ksoftirqd/021:17:480
1323099412,13cyclictest1131-21lldpd00:10:210
13230994111,6cyclictest1131-21lldpd20:00:210
825591400,1ptp4l401ktimersoftd/323:22:283
825591400,1ptp4l401ktimersoftd/322:26:423
825591400,1ptp4l401ktimersoftd/321:45:083
825591400,1ptp4l401ktimersoftd/320:50:323
825591400,1ptp4l401ktimersoftd/319:53:553
825591400,1ptp4l401ktimersoftd/319:42:283
825591400,1ptp4l401ktimersoftd/300:10:473
825591400,16ptp4l401ktimersoftd/319:45:583
13233994035,3cyclictest41-21ksoftirqd/322:35:333
13233994034,3cyclictest41-21ksoftirqd/323:10:003
13233994033,4cyclictest41-21ksoftirqd/322:50:233
13232994035,3cyclictest33-21ksoftirqd/222:50:012
13232994034,4cyclictest33-21ksoftirqd/223:13:592
13232994033,4cyclictest33-21ksoftirqd/222:00:402
13232994033,4cyclictest33-21ksoftirqd/221:10:312
13232994033,4cyclictest33-21ksoftirqd/219:20:332
13231994033,4cyclictest25-21ksoftirqd/121:23:351
13231994033,4cyclictest25-21ksoftirqd/121:23:351
13231994033,4cyclictest25-21ksoftirqd/119:12:061
1323199401,35cyclictest0-21swapper/121:31:331
825591390,1ptp4l401ktimersoftd/323:52:423
825591390,1ptp4l401ktimersoftd/322:46:253
825591390,1ptp4l401ktimersoftd/320:45:093
825591390,1ptp4l401ktimersoftd/320:20:283
825591390,1ptp4l401ktimersoftd/320:13:343
825591390,15ptp4l401ktimersoftd/323:00:053
825591390,14ptp4l401ktimersoftd/319:55:103
13233993933,4cyclictest41-21ksoftirqd/321:40:283
13233993933,3cyclictest41-21ksoftirqd/323:10:403
13233993932,4cyclictest41-21ksoftirqd/323:40:203
13233993932,4cyclictest41-21ksoftirqd/321:00:293
13233993932,4cyclictest41-21ksoftirqd/320:35:423
13232993933,4cyclictest33-21ksoftirqd/223:30:322
13231993933,3cyclictest25-21ksoftirqd/123:39:111
13231993932,4cyclictest25-21ksoftirqd/100:23:371
13230993915,4cyclictest18765-21sh21:40:000
13230993912,6cyclictest1131-21lldpd20:47:010
825591380,1ptp4l401ktimersoftd/323:35:073
825591380,1ptp4l401ktimersoftd/322:55:023
825591380,1ptp4l401ktimersoftd/320:30:023
825591380,1ptp4l401ktimersoftd/319:17:563
13233993832,4cyclictest41-21ksoftirqd/300:00:323
13233993832,3cyclictest41-21ksoftirqd/322:05:223
13233993832,3cyclictest41-21ksoftirqd/322:00:303
13232993831,4cyclictest33-21ksoftirqd/220:50:262
13232993831,4cyclictest33-21ksoftirqd/200:26:382
1323199384,10cyclictest1131-21lldpd22:40:591
1323199381,4cyclictest1131-21lldpd20:49:531
1323199381,12cyclictest1131-21lldpd20:35:121
13230993831,4cyclictest9-21ksoftirqd/023:26:520
13230993815,4cyclictest206-21systemd-journal19:28:090
13230993815,4cyclictest206-21systemd-journal00:02:050
825591370,1ptp4l401ktimersoftd/319:22:293
1323199374,14cyclictest13229-21cyclictest23:23:421
13231993731,3cyclictest25-21ksoftirqd/121:43:151
13231993730,4cyclictest25-21ksoftirqd/123:12:211
13231993730,4cyclictest25-21ksoftirqd/122:58:251
13231993730,4cyclictest25-21ksoftirqd/120:53:321
13231993730,4cyclictest25-21ksoftirqd/120:41:481
13231993730,4cyclictest25-21ksoftirqd/119:29:521
13231993730,4cyclictest25-21ksoftirqd/100:07:511
13230993730,4cyclictest9-21ksoftirqd/023:21:120
13230993730,4cyclictest9-21ksoftirqd/022:49:320
13230993714,6cyclictest9113-21cpuspeed_turbos23:35:220
13233993630,3cyclictest41-21ksoftirqd/319:25:243
13233993629,4cyclictest41-21ksoftirqd/300:23:583
1323199366,26cyclictest1131-21lldpd00:02:121
13231993631,3cyclictest25-21ksoftirqd/122:31:341
13231993629,4cyclictest25-21ksoftirqd/123:51:321
13231993629,4cyclictest25-21ksoftirqd/121:58:401
13230993629,4cyclictest9-21ksoftirqd/020:44:070
13230993629,4cyclictest9-21ksoftirqd/019:56:160
1323099362,10cyclictest206-21systemd-journal23:10:320
13230993614,5cyclictest206-21systemd-journal23:08:540
13233993530,3cyclictest41-21ksoftirqd/319:30:413
13233993528,4cyclictest41-21ksoftirqd/321:05:303
13231993528,4cyclictest25-21ksoftirqd/119:41:001
13231993528,4cyclictest25-21ksoftirqd/119:38:231
1323199351,31cyclictest0-21swapper/123:06:121
13230993528,4cyclictest9-21ksoftirqd/021:24:030
13230993528,4cyclictest9-21ksoftirqd/021:24:030
13230993527,5cyclictest9-21ksoftirqd/022:26:350
13230993513,6cyclictest6596-21apt-get23:30:190
49123426,4sleep09-21ksoftirqd/022:09:120
13233993429,3cyclictest41-21ksoftirqd/322:40:373
1323199345,25cyclictest1131-21lldpd19:17:221
1323199344,6cyclictest57698rtkit-daemon20:56:481
13231993428,3cyclictest25-21ksoftirqd/122:12:141
13231993427,4cyclictest25-21ksoftirqd/122:15:041
13231993427,4cyclictest25-21ksoftirqd/122:02:511
13231993427,4cyclictest25-21ksoftirqd/119:21:281
1323199340,11cyclictest1131-21lldpd23:30:521
1323199336,7cyclictest1123-21snmpd20:04:491
1323199335,11cyclictest1123-21snmpd21:29:211
13231993327,4cyclictest25-21ksoftirqd/119:50:191
13231993327,3cyclictest25-21ksoftirqd/100:28:021
13231993326,4cyclictest25-21ksoftirqd/121:48:051
13231993326,4cyclictest25-21ksoftirqd/121:09:581
13231993326,4cyclictest25-21ksoftirqd/120:07:551
13231993326,4cyclictest25-21ksoftirqd/120:07:541
1323199332,17cyclictest206-21systemd-journal20:11:461
13230993326,4cyclictest9-21ksoftirqd/023:49:400
13230993326,4cyclictest9-21ksoftirqd/023:49:400
13230993326,4cyclictest9-21ksoftirqd/019:48:420
13230993326,4cyclictest9-21ksoftirqd/019:36:460
13230993326,4cyclictest9-21ksoftirqd/019:34:530
13230993326,4cyclictest9-21ksoftirqd/019:14:330
13230993315,4cyclictest206-21systemd-journal23:59:200
13231993226,3cyclictest25-21ksoftirqd/122:36:561
13231993225,4cyclictest25-21ksoftirqd/123:16:101
13231993225,4cyclictest25-21ksoftirqd/121:02:031
13230993226,4cyclictest9-21ksoftirqd/021:41:170
13230993225,4cyclictest9-21ksoftirqd/021:59:160
13230993225,4cyclictest9-21ksoftirqd/021:10:380
13230993225,4cyclictest9-21ksoftirqd/000:06:040
13233993126,3cyclictest41-21ksoftirqd/321:56:033
13231993125,3cyclictest25-21ksoftirqd/123:40:241
13231993125,3cyclictest25-21ksoftirqd/120:30:071
13231993125,3cyclictest25-21ksoftirqd/119:58:391
13231993124,4cyclictest25-21ksoftirqd/122:47:291
13231993124,4cyclictest25-21ksoftirqd/120:23:281
13230993124,4cyclictest9-21ksoftirqd/021:26:350
13230993124,4cyclictest9-21ksoftirqd/020:52:380
13230993124,4cyclictest9-21ksoftirqd/020:22:590
2932323022,4sleep09-21ksoftirqd/019:42:240
13231993025,3cyclictest25-21ksoftirqd/122:51:321
13231993023,4cyclictest25-21ksoftirqd/123:55:221
13231993023,4cyclictest25-21ksoftirqd/121:38:371
1323199301,25cyclictest0-21swapper/121:10:121
13230993024,3cyclictest9-21ksoftirqd/020:29:210
13230993023,4cyclictest9-21ksoftirqd/022:30:280
13230993023,4cyclictest9-21ksoftirqd/022:20:080
13230993023,4cyclictest9-21ksoftirqd/020:13:250
13230993023,4cyclictest9-21ksoftirqd/019:17:060
13230993023,4cyclictest9-21ksoftirqd/000:27:210
1728222922,3sleep09-21ksoftirqd/022:40:480
13231992923,3cyclictest25-21ksoftirqd/122:23:031
13231992915,7cyclictest25433-21apt-get00:10:211
13231992913,13cyclictest0-21swapper/100:15:531
1323099293,8cyclictest20880-21apt-get20:35:200
13230992923,4cyclictest9-21ksoftirqd/022:50:380
13230992922,4cyclictest9-21ksoftirqd/023:52:070
13230992922,4cyclictest9-21ksoftirqd/022:16:140
13231992821,4cyclictest25-21ksoftirqd/122:08:521
13231992821,4cyclictest25-21ksoftirqd/121:52:401
13231992821,4cyclictest25-21ksoftirqd/120:28:511
1323199281,24cyclictest0-21swapper/120:15:031
13231992811,14cyclictest1123-21snmpd23:00:231
13230992822,4cyclictest9-21ksoftirqd/000:36:200
13231992721,4cyclictest25-21ksoftirqd/119:45:071
13231992720,4cyclictest25-21ksoftirqd/123:49:261
13231992720,4cyclictest25-21ksoftirqd/123:49:261
1323199267,15cyclictest1123-21snmpd19:30:291
13231992619,4cyclictest25-21ksoftirqd/123:26:171
1323199261,23cyclictest0-21swapper/122:25:531
13231992610,12cyclictest0-21swapper/121:15:171
13231992610,12cyclictest0-21swapper/121:15:171
13230992619,4cyclictest9-21ksoftirqd/021:51:300
13230992619,4cyclictest9-21ksoftirqd/021:03:500
13230992618,5cyclictest9-21ksoftirqd/023:16:340
754422517,4sleep09-21ksoftirqd/020:05:290
754422517,4sleep09-21ksoftirqd/020:05:290
13230992519,4cyclictest9-21ksoftirqd/021:32:360
13230992518,4cyclictest9-21ksoftirqd/020:33:460
1323099241,7cyclictest0-21swapper/000:34:080
13230992416,5cyclictest9-21ksoftirqd/019:22:010
13230992415,6cyclictest1131-21lldpd21:05:220
13230992318,3cyclictest9-21ksoftirqd/000:22:520
13230992317,4cyclictest9-21ksoftirqd/019:51:480
13230992316,4cyclictest206-21systemd-journal21:45:290
13230992315,5cyclictest206-21systemd-journal00:17:420
1323099229,10cyclictest206-21systemd-journal22:35:120
13230992216,3cyclictest9-21ksoftirqd/020:17:370
13230992214,5cyclictest206-21systemd-journal22:03:400
13230992114,4cyclictest206-21systemd-journal23:00:320
13230992113,5cyclictest206-21systemd-journal22:13:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional