You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 03:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot2.osadl.org (updated Wed Nov 26, 2025 00:45:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
313292206172,23sleep20-21swapper/219:07:212
312752204170,23sleep10-21swapper/119:06:441
312552204170,23sleep30-21swapper/319:06:303
311662204172,22sleep00-21swapper/019:05:300
1365911340,1ptp4l1137-21/usr/sbin/munin22:35:233
1366918262,11phc2sys0-21swapper/319:10:013
62092640,4sleep16208-21proc_pri23:50:231
278902540,2sleep10-21swapper/122:20:271
136591460,1ptp4l391rcuc/322:32:223
51698450,8rtkit-daemon0-21swapper/122:33:291
136591420,0ptp4l401ktimersoftd/323:14:193
136591420,0ptp4l401ktimersoftd/319:53:113
136591410,0ptp4l401ktimersoftd/321:35:103
136591400,1ptp4l16486-21runrttasks00:11:193
51698380,4rtkit-daemon3201699cyclictest19:56:501
51698380,3rtkit-daemon226-21systemd-journal23:25:361
3201999381,17cyclictest18468-21latency_hist19:50:013
3201799380,36cyclictest0-21swapper/221:35:342
32014993833,3cyclictest14867-21cron20:49:590
193732380,6sleep019375-21ps19:50:190
32019993714,4cyclictest24147-21df22:15:133
51698360,3rtkit-daemon29264-21chrt21:18:461
3201999351,17cyclictest16230-21latency_hist22:00:003
3201999349,8cyclictest226-21systemd-journal21:25:123
3201999349,7cyclictest22819-21unixbench_multi19:55:263
32019993427,4cyclictest41-21ksoftirqd/300:29:563
3201999340,3cyclictest30377-1kworker/3:1H00:20:003
32016993428,4cyclictest25-21ksoftirqd/120:09:141
32016993413,18cyclictest4498-21ls21:35:181
32019993327,4cyclictest41-21ksoftirqd/323:38:453
32019993327,4cyclictest41-21ksoftirqd/320:47:193
32019993315,2cyclictest8273-21cat22:50:003
32017993327,4cyclictest33-21ksoftirqd/222:59:422
32017993327,4cyclictest33-21ksoftirqd/222:32:362
32017993327,4cyclictest33-21ksoftirqd/221:03:152
32016993327,4cyclictest25-21ksoftirqd/122:51:081
32016993327,4cyclictest25-21ksoftirqd/122:02:241
32014993328,3cyclictest9-21ksoftirqd/020:20:120
32014993328,3cyclictest9-21ksoftirqd/000:27:490
32014993327,4cyclictest9-21ksoftirqd/023:51:010
32014993327,4cyclictest9-21ksoftirqd/021:00:360
32014993327,4cyclictest9-21ksoftirqd/019:12:030
32014993326,4cyclictest9-21ksoftirqd/023:02:590
32019993226,4cyclictest41-21ksoftirqd/320:16:583
32019993225,5cyclictest41-21ksoftirqd/322:56:443
32019993214,3cyclictest4750-21wc23:50:013
32017993227,3cyclictest33-21ksoftirqd/222:48:292
32017993227,3cyclictest33-21ksoftirqd/219:31:582
32017993226,4cyclictest33-21ksoftirqd/222:10:492
32017993226,4cyclictest33-21ksoftirqd/221:18:422
32017993226,4cyclictest33-21ksoftirqd/220:47:452
32017993226,4cyclictest33-21ksoftirqd/220:03:412
32017993226,4cyclictest33-21ksoftirqd/200:08:012
32017993225,5cyclictest33-21ksoftirqd/221:41:292
32016993226,4cyclictest25-21ksoftirqd/122:07:081
32016993226,4cyclictest25-21ksoftirqd/120:03:551
32016993226,4cyclictest25-21ksoftirqd/119:44:431
32016993226,4cyclictest25-21ksoftirqd/100:37:151
3201699321,29cyclictest19620-21wc21:00:001
32016993211,19cyclictest30399-21grep23:35:161
32016993211,18cyclictest10926-21ls20:40:171
32016993210,19cyclictest18752-21sed23:10:191
32014993226,4cyclictest9-21ksoftirqd/023:21:440
32014993226,4cyclictest9-21ksoftirqd/021:54:440
32014993226,4cyclictest9-21ksoftirqd/019:44:490
32014993226,4cyclictest9-21ksoftirqd/019:25:320
32014993225,4cyclictest9-21ksoftirqd/021:10:010
32019993126,3cyclictest41-21ksoftirqd/319:23:143
32019993125,4cyclictest41-21ksoftirqd/323:51:573
32019993125,4cyclictest41-21ksoftirqd/323:22:043
32019993125,4cyclictest41-21ksoftirqd/323:07:003
32019993125,4cyclictest41-21ksoftirqd/322:51:343
32019993125,4cyclictest41-21ksoftirqd/321:40:593
32019993125,4cyclictest41-21ksoftirqd/321:10:063
32019993125,4cyclictest41-21ksoftirqd/319:36:463
32019993125,4cyclictest41-21ksoftirqd/300:03:113
32019993113,2cyclictest27228-21/usr/sbin/munin21:15:193
32017993126,3cyclictest33-21ksoftirqd/221:20:322
32017993125,4cyclictest33-21ksoftirqd/221:52:492
32017993125,4cyclictest33-21ksoftirqd/220:33:302
32017993125,4cyclictest33-21ksoftirqd/220:24:312
32017993125,4cyclictest33-21ksoftirqd/220:18:122
32017993125,4cyclictest33-21ksoftirqd/219:16:182
32017993119,10cyclictest33-21ksoftirqd/223:20:152
32016993125,4cyclictest25-21ksoftirqd/121:53:151
32016993125,4cyclictest25-21ksoftirqd/121:49:431
32016993125,4cyclictest25-21ksoftirqd/121:49:421
32016993125,4cyclictest25-21ksoftirqd/120:22:101
32016993113,15cyclictest24551-21forks00:30:141
32016993111,17cyclictest29859-21expr21:20:151
32016993111,16cyclictest10069-21df_abs00:00:191
32016993110,19cyclictest32334-21expr19:10:161
32016993110,18cyclictest24419-21sh21:10:001
32014993127,3cyclictest9-21ksoftirqd/020:14:590
32014993126,3cyclictest9-21ksoftirqd/020:00:210
32014993125,4cyclictest9-21ksoftirqd/022:33:390
32014993125,4cyclictest9-21ksoftirqd/021:14:350
32014993125,4cyclictest9-21ksoftirqd/020:05:560
32014993125,3cyclictest9-21ksoftirqd/019:30:370
136591310,0ptp4l401ktimersoftd/321:30:233
136591310,0ptp4l401ktimersoftd/321:06:183
136591310,0ptp4l401ktimersoftd/300:21:303
32019993025,3cyclictest41-21ksoftirqd/322:05:543
32019993025,3cyclictest41-21ksoftirqd/319:28:593
32019993025,3cyclictest41-21ksoftirqd/319:16:033
32019993025,3cyclictest23397-21cron22:15:003
32019993024,4cyclictest41-21ksoftirqd/320:07:433
32019993024,4cyclictest41-21ksoftirqd/300:38:343
32019993023,5cyclictest41-21ksoftirqd/300:32:483
32017993025,3cyclictest33-21ksoftirqd/223:09:492
32017993025,3cyclictest33-21ksoftirqd/221:14:112
32017993025,3cyclictest33-21ksoftirqd/219:56:062
32017993024,4cyclictest33-21ksoftirqd/223:49:062
32017993024,4cyclictest33-21ksoftirqd/223:44:252
32017993024,4cyclictest33-21ksoftirqd/223:15:522
32017993024,4cyclictest33-21ksoftirqd/221:48:442
32017993024,4cyclictest33-21ksoftirqd/221:48:432
32017993024,4cyclictest33-21ksoftirqd/221:05:462
32017993024,4cyclictest33-21ksoftirqd/220:44:202
32017993024,4cyclictest33-21ksoftirqd/220:25:322
32017993024,4cyclictest33-21ksoftirqd/219:12:332
32017993024,4cyclictest33-21ksoftirqd/200:31:592
32017993024,4cyclictest33-21ksoftirqd/200:03:432
32016993025,3cyclictest25-21ksoftirqd/123:17:361
32016993025,3cyclictest25-21ksoftirqd/122:40:491
32016993025,3cyclictest25-21ksoftirqd/121:55:511
32016993025,3cyclictest25-21ksoftirqd/120:39:301
32016993025,3cyclictest25-21ksoftirqd/119:33:451
32016993024,4cyclictest25-21ksoftirqd/120:34:591
32016993024,4cyclictest25-21ksoftirqd/100:15:531
32016993014,13cyclictest17325-21latency19:45:201
32016993013,15cyclictest21906-21cpuspeed_turbos00:25:151
32016993011,17cyclictest4994-21hddtemp_smartct19:20:171
3201699300,3cyclictest51698rtkit-daemon19:15:251
3201699300,3cyclictest21529-21df_abs22:10:181
32014993025,3cyclictest9-21ksoftirqd/019:37:390
32014993024,4cyclictest9-21ksoftirqd/023:33:120
32014993024,4cyclictest9-21ksoftirqd/022:58:180
32014993024,4cyclictest9-21ksoftirqd/022:52:410
32014993024,4cyclictest9-21ksoftirqd/019:49:460
32014993024,4cyclictest9-21ksoftirqd/000:08:140
136591300,0ptp4l401ktimersoftd/320:52:033
32019992924,3cyclictest41-21ksoftirqd/323:57:423
32019992923,4cyclictest41-21ksoftirqd/323:04:503
32017992924,3cyclictest33-21ksoftirqd/223:50:172
32017992924,3cyclictest33-21ksoftirqd/222:25:112
32017992924,3cyclictest33-21ksoftirqd/220:54:362
32017992924,3cyclictest33-21ksoftirqd/219:54:362
32017992924,3cyclictest33-21ksoftirqd/200:28:202
32017992924,3cyclictest33-21ksoftirqd/200:20:122
32017992923,4cyclictest33-21ksoftirqd/223:59:052
32017992923,4cyclictest33-21ksoftirqd/221:57:392
32017992923,4cyclictest33-21ksoftirqd/200:13:342
32016992924,3cyclictest25-21ksoftirqd/123:06:391
32016992924,3cyclictest25-21ksoftirqd/121:30:531
32016992924,3cyclictest25-21ksoftirqd/120:14:551
32016992923,4cyclictest25-21ksoftirqd/123:48:141
32016992923,4cyclictest25-21ksoftirqd/120:47:371
32016992923,4cyclictest25-21ksoftirqd/120:25:581
32016992923,4cyclictest25-21ksoftirqd/100:05:581
32016992911,15cyclictest7934-21kernelversion21:40:211
32014992925,3cyclictest9-21ksoftirqd/019:20:190
32014992924,3cyclictest9-21ksoftirqd/023:17:110
32014992924,3cyclictest9-21ksoftirqd/022:40:430
32014992924,3cyclictest9-21ksoftirqd/000:35:020
32014992923,4cyclictest9-21ksoftirqd/023:42:220
32014992923,4cyclictest9-21ksoftirqd/023:08:440
32014992923,4cyclictest9-21ksoftirqd/022:37:590
32014992923,4cyclictest9-21ksoftirqd/022:11:360
32014992923,4cyclictest9-21ksoftirqd/021:21:340
32014992923,4cyclictest9-21ksoftirqd/021:19:280
32014992923,4cyclictest9-21ksoftirqd/020:16:540
32014992923,3cyclictest9-21ksoftirqd/000:17:080
136591290,6ptp4l3201999cyclictest20:40:283
136591290,1ptp4l0-21swapper/320:00:283
32019992823,3cyclictest41-21ksoftirqd/323:33:533
32019992823,3cyclictest41-21ksoftirqd/322:40:523
32019992823,3cyclictest41-21ksoftirqd/320:24:473
32019992822,4cyclictest41-21ksoftirqd/323:43:073
32019992822,4cyclictest41-21ksoftirqd/322:29:363
32019992822,4cyclictest41-21ksoftirqd/321:49:493
32019992822,4cyclictest41-21ksoftirqd/321:49:483
32019992822,4cyclictest41-21ksoftirqd/320:55:483
32019992822,4cyclictest41-21ksoftirqd/320:37:163
32017992823,3cyclictest33-21ksoftirqd/221:32:202
32017992823,3cyclictest33-21ksoftirqd/220:57:012
32017992823,3cyclictest33-21ksoftirqd/220:37:152
32017992823,3cyclictest33-21ksoftirqd/219:35:542
32017992822,4cyclictest33-21ksoftirqd/223:11:352
32017992822,4cyclictest33-21ksoftirqd/222:01:402
32017992816,9cyclictest33-21ksoftirqd/222:50:262
3201699289,3cyclictest16633-21timerandwakeup20:50:271
3201699287,5cyclictest13322-21unixbench_singl19:35:291
3201699286,3cyclictest27983-21sed23:30:151
32016992823,3cyclictest25-21ksoftirqd/123:03:431
32016992823,3cyclictest25-21ksoftirqd/121:13:441
32016992823,3cyclictest25-21ksoftirqd/121:01:151
32016992822,4cyclictest25-21ksoftirqd/120:18:321
32016992822,4cyclictest25-21ksoftirqd/100:20:561
32016992822,4cyclictest25-21ksoftirqd/100:12:361
32014992823,3cyclictest9-21ksoftirqd/022:03:100
32014992823,3cyclictest9-21ksoftirqd/020:53:440
32014992822,4cyclictest9-21ksoftirqd/022:09:230
32014992822,4cyclictest9-21ksoftirqd/019:16:080
32019992722,3cyclictest41-21ksoftirqd/321:50:493
32019992722,3cyclictest41-21ksoftirqd/320:32:393
32019992721,4cyclictest41-21ksoftirqd/323:25:053
32019992721,4cyclictest41-21ksoftirqd/322:04:223
32019992721,4cyclictest41-21ksoftirqd/320:12:453
32017992722,3cyclictest33-21ksoftirqd/223:04:292
32017992721,4cyclictest33-21ksoftirqd/223:37:312
3201699278,3cyclictest7722-21cut19:25:201
3201699275,3cyclictest2198-21apt-key23:45:011
3201699274,2cyclictest121rcu_preempt22:36:161
32016992721,4cyclictest25-21ksoftirqd/123:56:121
32016992721,4cyclictest25-21ksoftirqd/122:19:041
32014992722,3cyclictest9-21ksoftirqd/023:36:290
32014992722,3cyclictest9-21ksoftirqd/021:49:410
32014992722,3cyclictest9-21ksoftirqd/021:49:410
32014992722,3cyclictest9-21ksoftirqd/000:15:010
32014992721,4cyclictest9-21ksoftirqd/023:49:080
32014992721,4cyclictest9-21ksoftirqd/021:57:330
32014992720,4cyclictest9-21ksoftirqd/020:58:110
32014992720,4cyclictest9-21ksoftirqd/000:30:080
291502270,4sleep00-21swapper/022:25:170
51698260,2rtkit-daemon0-21swapper/022:48:300
32019992621,3cyclictest41-21ksoftirqd/321:22:173
32019992621,3cyclictest41-21ksoftirqd/319:40:113
32019992619,5cyclictest41-21ksoftirqd/322:24:263
32017992621,3cyclictest33-21ksoftirqd/222:38:302
32017992621,3cyclictest33-21ksoftirqd/222:09:292
32017992621,3cyclictest33-21ksoftirqd/221:26:112
32017992620,4cyclictest33-21ksoftirqd/223:32:252
32017992620,4cyclictest33-21ksoftirqd/222:44:072
32017992620,4cyclictest33-21ksoftirqd/200:36:132
32017992620,3cyclictest33-21ksoftirqd/222:15:182
32016992621,3cyclictest25-21ksoftirqd/122:27:211
32016992620,4cyclictest25-21ksoftirqd/123:20:061
32016992620,4cyclictest25-21ksoftirqd/122:59:551
32014992621,3cyclictest9-21ksoftirqd/023:59:260
32014992620,4cyclictest9-21ksoftirqd/022:20:030
136591260,0ptp4l401ktimersoftd/320:25:133
32019992520,3cyclictest41-21ksoftirqd/300:05:403
32017992520,3cyclictest33-21ksoftirqd/200:18:392
32017992519,4cyclictest33-21ksoftirqd/222:22:222
32017992514,9cyclictest33-21ksoftirqd/219:45:282
3201699255,3cyclictest19872-21open_files19:50:221
32014992521,3cyclictest9-21ksoftirqd/021:35:230
32014992521,2cyclictest9-21ksoftirqd/021:31:590
136591250,0ptp4l401ktimersoftd/319:30:143
32019992419,3cyclictest41-21ksoftirqd/323:15:133
32017992420,3cyclictest33-21ksoftirqd/219:44:392
32017992419,3cyclictest33-21ksoftirqd/223:25:122
32017992419,3cyclictest33-21ksoftirqd/220:14:352
32017992418,4cyclictest33-21ksoftirqd/220:07:132
32014992420,3cyclictest9-21ksoftirqd/019:55:190
32014992419,3cyclictest9-21ksoftirqd/020:39:290
32014992418,3cyclictest9-21ksoftirqd/022:15:180
32014992418,3cyclictest9-21ksoftirqd/020:40:140
32017992318,3cyclictest33-21ksoftirqd/219:26:552
3201699235,3cyclictest32665-21irqrtprio21:25:171
3201699231,5cyclictest7183-21phc2sys22:45:221
32014992319,3cyclictest9-21ksoftirqd/021:30:010
32014992317,4cyclictest9-21ksoftirqd/000:03:370
32014992316,4cyclictest9-21ksoftirqd/023:10:110
136591230,0ptp4l401ktimersoftd/321:00:203
32014992217,3cyclictest9-21ksoftirqd/021:40:140
32014992216,3cyclictest9-21ksoftirqd/023:25:200
32014992114,4cyclictest9-21ksoftirqd/020:25:150
32014992015,3cyclictest9-21ksoftirqd/000:20:190
32014992015,3cyclictest6137-21hddtemp_smartct20:30:180
32017991914,3cyclictest33-21ksoftirqd/219:20:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional