You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 02:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot2.osadl.org (updated Wed Nov 19, 2025 12:45:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
44782206173,22sleep20-21swapper/207:07:142
136691206172,23phc2sys0-21swapper/307:06:023
46142205173,21sleep10-21swapper/107:08:551
46032205172,22sleep00-21swapper/007:08:450
687821870,6sleep3499699cyclictest11:40:253
43452740,1sleep10-21swapper/109:20:271
217142680,5sleep24992-21cyclictest11:05:232
77142590,2sleep10-21swapper/109:30:011
140552560,6sleep3499699cyclictest07:25:323
77782550,2sleep30-21swapper/307:15:173
136591530,1ptp4l401ktimersoftd/310:33:163
149592500,1sleep20-21swapper/208:35:272
248162470,2sleep00-21swapper/007:50:160
60882460,2sleep30-21swapper/308:20:003
136591430,0ptp4l401ktimersoftd/312:35:013
136591430,0ptp4l401ktimersoftd/311:55:443
136591420,0ptp4l401ktimersoftd/312:38:243
136591420,0ptp4l401ktimersoftd/312:21:153
136591410,0ptp4l401ktimersoftd/311:49:373
499499401,37cyclictest12424-21kworker/1:007:16:551
4994994010,18cyclictest1307-21runrttasks11:32:521
499499396,19cyclictest14409-21seq07:27:541
136591390,0ptp4l401ktimersoftd/307:46:343
499499374,20cyclictest0-21swapper/110:51:501
51698360,2rtkit-daemon0-21swapper/107:31:541
136591360,0ptp4l401ktimersoftd/311:00:303
136591350,0ptp4l401ktimersoftd/310:45:013
136591350,0ptp4l401ktimersoftd/309:45:213
136591350,0ptp4l401ktimersoftd/309:40:143
4995993427,4cyclictest33-21ksoftirqd/210:48:222
499499344,27cyclictest29334-21tr10:15:131
499499341,3cyclictest19708-21/usr/sbin/munin09:55:301
499499340,4cyclictest26351-21seq07:53:531
136591340,0ptp4l401ktimersoftd/307:55:213
133391340,1getstats2201-1kworker/3:1H11:05:393
4995993327,4cyclictest33-21ksoftirqd/211:56:222
4994993327,4cyclictest25-21ksoftirqd/111:42:241
4994993327,4cyclictest25-21ksoftirqd/110:44:561
4994993327,4cyclictest25-21ksoftirqd/110:09:581
4994993327,4cyclictest25-21ksoftirqd/109:47:471
4993993327,4cyclictest9-21ksoftirqd/012:00:570
136591330,0ptp4l401ktimersoftd/310:47:163
4996993227,3cyclictest41-21ksoftirqd/310:03:183
4996993227,3cyclictest41-21ksoftirqd/309:29:033
4996993226,4cyclictest41-21ksoftirqd/311:19:513
4995993227,3cyclictest33-21ksoftirqd/211:10:092
4995993226,4cyclictest33-21ksoftirqd/209:36:372
4995993226,4cyclictest33-21ksoftirqd/207:41:412
4995993226,4cyclictest33-21ksoftirqd/207:17:332
499499328,21cyclictest28273-21expr07:55:281
4994993227,3cyclictest25-21ksoftirqd/109:07:591
4994993226,4cyclictest25-21ksoftirqd/112:30:071
4994993226,4cyclictest25-21ksoftirqd/112:21:161
4994993226,4cyclictest25-21ksoftirqd/111:58:581
4994993226,4cyclictest25-21ksoftirqd/111:21:021
4994993226,4cyclictest25-21ksoftirqd/108:51:591
4994993226,4cyclictest25-21ksoftirqd/108:12:121
4994993226,4cyclictest25-21ksoftirqd/107:43:231
4994993213,16cyclictest31165-21sed09:10:221
4993993226,4cyclictest9-21ksoftirqd/010:42:100
4993993226,4cyclictest9-21ksoftirqd/009:43:090
4993993226,4cyclictest9-21ksoftirqd/008:31:040
4993993226,4cyclictest9-21ksoftirqd/007:47:510
4993993226,3cyclictest9-21ksoftirqd/008:37:540
4993993225,5cyclictest9-21ksoftirqd/010:56:070
4993993225,4cyclictest9-21ksoftirqd/011:14:280
499399320,2cyclictest121rcu_preempt08:25:230
4996993124,5cyclictest41-21ksoftirqd/310:15:043
4995993126,3cyclictest33-21ksoftirqd/211:54:082
4995993126,3cyclictest33-21ksoftirqd/210:31:332
4995993126,3cyclictest33-21ksoftirqd/210:07:092
4995993125,4cyclictest33-21ksoftirqd/211:33:352
4995993125,4cyclictest33-21ksoftirqd/210:13:282
4995993125,4cyclictest33-21ksoftirqd/209:47:282
4995993125,4cyclictest33-21ksoftirqd/208:09:242
4995993125,4cyclictest33-21ksoftirqd/207:56:282
4995993125,4cyclictest33-21ksoftirqd/207:26:112
4995993110,19cyclictest31001-21kworker/2:210:00:352
499499318,20cyclictest32264-21irqrtprio10:20:211
4994993126,3cyclictest25-21ksoftirqd/111:01:341
4994993125,4cyclictest25-21ksoftirqd/111:47:051
4994993125,4cyclictest25-21ksoftirqd/111:18:141
4994993125,4cyclictest25-21ksoftirqd/110:27:071
4994993125,4cyclictest25-21ksoftirqd/110:14:231
4994993125,4cyclictest25-21ksoftirqd/109:17:591
4994993125,4cyclictest25-21ksoftirqd/109:04:111
4994993125,4cyclictest25-21ksoftirqd/109:04:111
4994993125,4cyclictest25-21ksoftirqd/108:46:421
4994993125,4cyclictest25-21ksoftirqd/108:35:501
4994993125,4cyclictest25-21ksoftirqd/108:23:391
4994993114,15cyclictest13806-21phc2sys09:40:251
499499310,3cyclictest31128-21seq08:04:081
499499310,3cyclictest31128-21seq08:04:081
4993993126,3cyclictest9-21ksoftirqd/011:52:030
4993993126,3cyclictest9-21ksoftirqd/010:39:540
4993993125,4cyclictest9-21ksoftirqd/012:33:150
4993993125,4cyclictest9-21ksoftirqd/011:19:570
4993993125,4cyclictest9-21ksoftirqd/010:00:110
4993993125,4cyclictest9-21ksoftirqd/009:12:110
4993993125,4cyclictest9-21ksoftirqd/008:51:140
4993993125,4cyclictest9-21ksoftirqd/008:21:370
4993993125,4cyclictest9-21ksoftirqd/008:15:360
4993993125,4cyclictest9-21ksoftirqd/007:33:440
4993993124,4cyclictest9-21ksoftirqd/010:33:580
4996993025,3cyclictest41-21ksoftirqd/312:29:533
4996993025,3cyclictest41-21ksoftirqd/310:26:503
4996993025,3cyclictest41-21ksoftirqd/310:12:103
4996993025,3cyclictest41-21ksoftirqd/308:20:123
4996993024,4cyclictest41-21ksoftirqd/312:01:323
4996993024,4cyclictest41-21ksoftirqd/311:12:093
4996993024,4cyclictest41-21ksoftirqd/310:56:263
4995993025,3cyclictest33-21ksoftirqd/211:02:382
4995993025,3cyclictest33-21ksoftirqd/210:25:152
4995993024,4cyclictest33-21ksoftirqd/212:15:272
4995993024,4cyclictest33-21ksoftirqd/211:41:462
4995993024,4cyclictest33-21ksoftirqd/210:43:132
4995993023,5cyclictest33-21ksoftirqd/211:49:402
4995993016,5cyclictest33-21ksoftirqd/208:55:212
499499309,18cyclictest15159-21cat12:00:141
499499308,20cyclictest1585-21cut12:39:591
499499308,19cyclictest10448-21cat09:35:151
4994993025,3cyclictest25-21ksoftirqd/107:13:391
4994993024,4cyclictest25-21ksoftirqd/112:09:481
4994993024,4cyclictest25-21ksoftirqd/112:09:481
4994993024,4cyclictest25-21ksoftirqd/109:51:171
4994993024,4cyclictest25-21ksoftirqd/108:32:011
4994993024,4cyclictest25-21ksoftirqd/108:15:451
4994993012,15cyclictest4165-21awk11:35:221
499499300,4cyclictest8010-21chrt10:35:291
4993993025,3cyclictest9-21ksoftirqd/012:14:370
4993993025,3cyclictest9-21ksoftirqd/011:34:180
4993993025,3cyclictest9-21ksoftirqd/010:19:040
4993993025,3cyclictest9-21ksoftirqd/010:14:260
4993993024,4cyclictest9-21ksoftirqd/012:37:360
4993993024,4cyclictest9-21ksoftirqd/011:25:350
4993993024,4cyclictest9-21ksoftirqd/011:09:060
4993993024,4cyclictest9-21ksoftirqd/010:53:500
4993993024,4cyclictest9-21ksoftirqd/009:39:240
4993993024,4cyclictest9-21ksoftirqd/009:27:450
4993993024,4cyclictest9-21ksoftirqd/008:59:520
4993993024,4cyclictest9-21ksoftirqd/008:46:450
4993993023,5cyclictest9-21ksoftirqd/008:14:350
136591300,0ptp4l401ktimersoftd/312:11:283
136591300,0ptp4l401ktimersoftd/309:32:213
136591300,0ptp4l401ktimersoftd/309:21:243
136591300,0ptp4l401ktimersoftd/308:46:323
136591300,0ptp4l401ktimersoftd/308:44:203
136591300,0ptp4l401ktimersoftd/307:34:463
4996992923,4cyclictest41-21ksoftirqd/311:23:163
4996992923,4cyclictest41-21ksoftirqd/310:22:043
4996992923,4cyclictest41-21ksoftirqd/310:06:393
4996992923,4cyclictest41-21ksoftirqd/307:11:043
4995992924,3cyclictest33-21ksoftirqd/209:13:512
4995992924,3cyclictest33-21ksoftirqd/208:52:012
4995992923,4cyclictest33-21ksoftirqd/211:36:122
4995992923,4cyclictest33-21ksoftirqd/211:25:452
4995992923,4cyclictest33-21ksoftirqd/211:19:592
4995992923,4cyclictest33-21ksoftirqd/210:16:372
4995992923,4cyclictest33-21ksoftirqd/208:03:102
4995992923,4cyclictest33-21ksoftirqd/208:03:102
4995992923,4cyclictest33-21ksoftirqd/207:24:432
499499296,20cyclictest32435-21grep08:05:201
4994992923,4cyclictest25-21ksoftirqd/108:25:031
4994992913,13cyclictest23180-21pluginstate07:45:251
499499290,3cyclictest32252-21taskset11:27:011
499499290,3cyclictest27997-21phc2sys12:25:261
499499290,3cyclictest21923-21memory11:05:261
499499290,3cyclictest12724-21run-parts10:45:251
499499290,2cyclictest0-21swapper/107:35:211
4993992924,3cyclictest9-21ksoftirqd/009:01:370
4993992924,3cyclictest9-21ksoftirqd/009:01:370
4993992923,4cyclictest9-21ksoftirqd/010:06:500
4993992923,4cyclictest9-21ksoftirqd/009:22:550
4993992923,4cyclictest9-21ksoftirqd/009:09:150
4993992923,3cyclictest9-21ksoftirqd/007:28:580
4993992922,4cyclictest9-21ksoftirqd/009:15:110
4993992922,4cyclictest9-21ksoftirqd/008:08:090
136591290,8ptp4l401ktimersoftd/308:39:363
136591290,4ptp4l401ktimersoftd/309:02:313
136591290,4ptp4l401ktimersoftd/309:02:313
136591290,0ptp4l401ktimersoftd/312:06:183
136591290,0ptp4l401ktimersoftd/312:06:183
136591290,0ptp4l401ktimersoftd/311:51:013
136591290,0ptp4l401ktimersoftd/311:25:183
136591290,0ptp4l401ktimersoftd/310:50:413
51698280,2rtkit-daemon0-21swapper/008:43:170
4996992823,3cyclictest41-21ksoftirqd/309:09:323
4996992823,3cyclictest41-21ksoftirqd/308:53:343
4996992823,3cyclictest41-21ksoftirqd/307:44:213
4996992822,4cyclictest41-21ksoftirqd/309:55:003
4996992822,4cyclictest41-21ksoftirqd/309:36:423
4996992822,4cyclictest41-21ksoftirqd/308:58:113
4995992824,3cyclictest33-21ksoftirqd/209:02:342
4995992824,3cyclictest33-21ksoftirqd/209:02:342
4995992823,3cyclictest33-21ksoftirqd/210:22:592
4995992823,3cyclictest33-21ksoftirqd/209:50:442
4995992823,3cyclictest33-21ksoftirqd/209:26:342
4995992822,4cyclictest33-21ksoftirqd/209:08:412
4995992822,4cyclictest33-21ksoftirqd/208:49:312
499499289,16cyclictest10249-21grep11:50:161
499499287,18cyclictest11404-21cat07:20:281
4994992823,3cyclictest25-21ksoftirqd/112:19:101
4994992823,3cyclictest25-21ksoftirqd/112:13:401
4994992822,4cyclictest25-21ksoftirqd/110:59:371
4994992822,4cyclictest25-21ksoftirqd/108:56:041
4994992822,4cyclictest25-21ksoftirqd/108:40:361
499499280,3cyclictest22612-21hddtemp_smartct10:00:171
499499280,2cyclictest24467-21phc2sys-jitter11:10:251
4993992823,3cyclictest9-21ksoftirqd/011:20:430
4993992823,3cyclictest9-21ksoftirqd/010:27:260
4993992822,4cyclictest9-21ksoftirqd/012:23:470
4993992822,4cyclictest9-21ksoftirqd/011:44:290
4993992822,4cyclictest9-21ksoftirqd/009:52:440
136591280,0ptp4l401ktimersoftd/311:37:053
136591280,0ptp4l401ktimersoftd/311:30:553
136591280,0ptp4l401ktimersoftd/309:17:313
4996992722,3cyclictest41-21ksoftirqd/308:28:123
4996992722,3cyclictest41-21ksoftirqd/308:09:053
4996992721,4cyclictest41-21ksoftirqd/308:01:143
4996992721,4cyclictest41-21ksoftirqd/308:01:143
4995992723,3cyclictest33-21ksoftirqd/210:38:342
4995992722,3cyclictest33-21ksoftirqd/212:21:412
4995992722,3cyclictest33-21ksoftirqd/208:41:452
4995992722,3cyclictest33-21ksoftirqd/208:33:392
4995992722,3cyclictest33-21ksoftirqd/207:33:312
4995992721,4cyclictest33-21ksoftirqd/209:57:502
499499270,3cyclictest5739-21hddtemp_smartct09:25:171
4993992722,3cyclictest9-21ksoftirqd/009:58:470
4993992722,3cyclictest9-21ksoftirqd/009:48:090
4993992721,4cyclictest9-21ksoftirqd/012:19:470
4993992721,4cyclictest9-21ksoftirqd/011:55:200
4993992721,4cyclictest9-21ksoftirqd/007:38:250
139382270,7sleep2499599cyclictest09:40:262
136591270,0ptp4l401ktimersoftd/309:13:573
136591270,0ptp4l401ktimersoftd/307:38:553
4996992621,3cyclictest41-21ksoftirqd/307:51:193
4995992621,3cyclictest33-21ksoftirqd/207:51:382
4995992620,4cyclictest33-21ksoftirqd/212:06:292
4995992620,4cyclictest33-21ksoftirqd/212:06:292
4995992620,4cyclictest33-21ksoftirqd/210:58:372
499499262,3cyclictest6426-21cat10:35:011
4993992621,3cyclictest9-21ksoftirqd/011:45:210
4993992621,3cyclictest9-21ksoftirqd/009:32:020
4993992621,3cyclictest9-21ksoftirqd/007:17:390
4993992620,4cyclictest9-21ksoftirqd/012:27:000
4993992620,4cyclictest9-21ksoftirqd/007:24:410
136591260,0ptp4l401ktimersoftd/307:21:223
51698250,7rtkit-daemon0-21swapper/011:36:000
4995992520,3cyclictest33-21ksoftirqd/212:29:502
4995992520,3cyclictest33-21ksoftirqd/209:33:522
4995992520,3cyclictest33-21ksoftirqd/209:21:552
4995992519,4cyclictest33-21ksoftirqd/212:39:072
4995992519,4cyclictest33-21ksoftirqd/208:26:332
4995992519,4cyclictest33-21ksoftirqd/208:23:042
4993992520,3cyclictest9-21ksoftirqd/008:04:510
4993992520,3cyclictest9-21ksoftirqd/008:04:500
4993992519,4cyclictest9-21ksoftirqd/012:07:590
4993992519,4cyclictest9-21ksoftirqd/012:07:590
4993992519,4cyclictest9-21ksoftirqd/011:02:400
4993992519,4cyclictest9-21ksoftirqd/010:24:090
136591250,0ptp4l401ktimersoftd/312:15:113
136591250,0ptp4l401ktimersoftd/308:34:363
4996992418,4cyclictest41-21ksoftirqd/308:10:373
4995992420,3cyclictest33-21ksoftirqd/207:38:332
4995992419,3cyclictest33-21ksoftirqd/212:30:132
4995992419,3cyclictest33-21ksoftirqd/212:14:042
4995992419,3cyclictest33-21ksoftirqd/210:54:092
4993992419,3cyclictest9-21ksoftirqd/010:45:370
136591240,0ptp4l401ktimersoftd/310:35:163
499599239,13cyclictest31001-21kworker/2:208:13:152
4995992318,3cyclictest33-21ksoftirqd/207:47:132
4995992317,4cyclictest33-21ksoftirqd/212:02:002
4995992317,4cyclictest33-21ksoftirqd/211:23:002
4993992317,4cyclictest9-21ksoftirqd/007:43:460
4995992217,3cyclictest33-21ksoftirqd/209:18:442
136591220,0ptp4l401ktimersoftd/309:55:203
51698210,2rtkit-daemon0-21swapper/007:10:420
4995992116,3cyclictest33-21ksoftirqd/208:19:352
4995991914,3cyclictest33-21ksoftirqd/207:11:352
4993991914,3cyclictest28383-21unixbench_singl07:55:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional