You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 07:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot2.osadl.org (updated Mon Nov 17, 2025 00:45:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
136691235169,22phc2sys0-21swapper/319:07:363
255462233169,22sleep00-21swapper/019:09:560
254742206170,24sleep20-21swapper/219:09:012
254732206173,22sleep10-21swapper/119:08:591
292702650,5sleep233-21ksoftirqd/219:15:212
218132620,2sleep10-21swapper/122:20:271
149722560,2sleep214970-21turbostat00:25:002
314122540,2sleep20-21swapper/221:35:222
136591530,1ptp4l401ktimersoftd/322:49:023
136591530,1ptp4l391rcuc/300:02:543
136591520,1ptp4l401ktimersoftd/319:30:283
136591450,0ptp4l401ktimersoftd/323:19:163
136591430,1ptp4l401ktimersoftd/300:33:123
136591430,0ptp4l401ktimersoftd/321:00:233
136591420,0ptp4l401ktimersoftd/320:52:533
136591410,0ptp4l401ktimersoftd/323:45:073
136591410,0ptp4l401ktimersoftd/300:24:063
136591400,0ptp4l401ktimersoftd/320:03:463
136591400,0ptp4l401ktimersoftd/320:03:463
136591390,0ptp4l401ktimersoftd/323:29:553
136591380,1ptp4l401ktimersoftd/300:17:583
133391370,1getstats18204-1kworker/3:2H20:30:023
136591360,0ptp4l401ktimersoftd/321:40:143
136591360,0ptp4l401ktimersoftd/321:40:143
136591350,0ptp4l401ktimersoftd/323:30:153
136591350,0ptp4l401ktimersoftd/322:55:173
25846993429,3cyclictest33-21ksoftirqd/222:05:222
25846993427,4cyclictest33-21ksoftirqd/220:00:022
25846993427,4cyclictest33-21ksoftirqd/220:00:022
25846993328,3cyclictest33-21ksoftirqd/222:45:202
25846993328,3cyclictest33-21ksoftirqd/219:45:162
25846993328,3cyclictest33-21ksoftirqd/219:41:462
25846993327,4cyclictest33-21ksoftirqd/222:32:152
25846993327,4cyclictest33-21ksoftirqd/221:25:212
25846993327,3cyclictest33-21ksoftirqd/221:30:202
25845993327,4cyclictest25-21ksoftirqd/121:09:541
25845993327,4cyclictest25-21ksoftirqd/120:48:411
25845993327,3cyclictest12478-21cron19:50:001
25844993327,4cyclictest9-21ksoftirqd/022:00:120
25844993327,4cyclictest9-21ksoftirqd/000:13:430
25847993227,3cyclictest41-21ksoftirqd/321:55:243
25847993226,4cyclictest41-21ksoftirqd/323:43:333
25847993226,4cyclictest41-21ksoftirqd/320:47:383
25847993226,4cyclictest41-21ksoftirqd/319:52:023
25846993226,4cyclictest33-21ksoftirqd/223:04:092
25846993226,4cyclictest33-21ksoftirqd/223:04:092
25846993226,4cyclictest33-21ksoftirqd/222:42:142
25846993226,4cyclictest33-21ksoftirqd/219:53:452
25846993226,4cyclictest33-21ksoftirqd/200:33:272
25846993225,4cyclictest33-21ksoftirqd/223:27:482
25846993220,10cyclictest33-21ksoftirqd/220:45:242
25844993227,3cyclictest9-21ksoftirqd/000:21:170
25844993226,4cyclictest9-21ksoftirqd/022:08:340
25844993226,4cyclictest9-21ksoftirqd/021:58:110
25844993226,4cyclictest9-21ksoftirqd/020:58:100
25844993226,4cyclictest9-21ksoftirqd/020:05:150
25844993226,4cyclictest9-21ksoftirqd/019:58:440
25844993225,4cyclictest9-21ksoftirqd/021:16:110
25847993127,2cyclictest41-21ksoftirqd/320:24:453
25847993125,4cyclictest41-21ksoftirqd/320:13:523
25847993125,3cyclictest41-21ksoftirqd/320:25:153
25847993124,4cyclictest41-21ksoftirqd/319:25:063
25847993124,3cyclictest41-21ksoftirqd/322:40:133
25846993126,3cyclictest33-21ksoftirqd/222:01:062
25846993126,3cyclictest33-21ksoftirqd/200:35:232
25846993125,4cyclictest33-21ksoftirqd/220:36:492
25846993125,4cyclictest33-21ksoftirqd/220:22:342
25846993125,4cyclictest33-21ksoftirqd/219:34:562
25846993125,3cyclictest33-21ksoftirqd/223:09:522
25846993125,3cyclictest33-21ksoftirqd/220:15:212
25846993116,4cyclictest33-21ksoftirqd/200:05:212
25845993125,4cyclictest25-21ksoftirqd/121:44:481
25845993125,4cyclictest25-21ksoftirqd/121:44:481
25845993125,4cyclictest25-21ksoftirqd/121:01:321
25845993125,4cyclictest25-21ksoftirqd/120:32:231
25845993125,4cyclictest25-21ksoftirqd/120:25:571
25845993125,4cyclictest25-21ksoftirqd/100:04:251
25844993126,3cyclictest9-21ksoftirqd/023:40:010
25844993126,3cyclictest9-21ksoftirqd/021:40:000
25844993126,3cyclictest9-21ksoftirqd/020:20:010
25844993125,4cyclictest9-21ksoftirqd/021:45:000
25844993125,4cyclictest9-21ksoftirqd/021:44:590
25844993125,4cyclictest9-21ksoftirqd/020:48:550
25844993125,4cyclictest9-21ksoftirqd/019:30:520
25844993125,4cyclictest9-21ksoftirqd/000:35:370
25844993125,4cyclictest9-21ksoftirqd/000:34:370
136591310,8ptp4l401ktimersoftd/322:15:563
136591310,8ptp4l401ktimersoftd/322:15:563
25847993026,2cyclictest41-21ksoftirqd/323:00:163
25847993026,2cyclictest41-21ksoftirqd/323:00:153
25847993025,3cyclictest41-21ksoftirqd/322:30:113
25847993025,3cyclictest41-21ksoftirqd/321:23:373
25847993025,2cyclictest41-21ksoftirqd/323:10:173
25847993025,2cyclictest41-21ksoftirqd/300:05:223
25847993024,4cyclictest41-21ksoftirqd/321:17:143
25847993024,4cyclictest41-21ksoftirqd/319:17:323
25846993025,3cyclictest33-21ksoftirqd/223:20:192
25846993025,3cyclictest33-21ksoftirqd/222:50:222
25846993025,3cyclictest33-21ksoftirqd/221:49:142
25846993024,4cyclictest33-21ksoftirqd/221:51:112
25846993024,4cyclictest33-21ksoftirqd/220:32:002
25846993024,4cyclictest33-21ksoftirqd/200:03:542
25846993019,9cyclictest33-21ksoftirqd/221:15:222
25845993025,3cyclictest25-21ksoftirqd/100:12:041
25845993024,4cyclictest25-21ksoftirqd/122:46:381
25845993024,4cyclictest25-21ksoftirqd/122:04:271
25845993024,4cyclictest25-21ksoftirqd/121:22:351
25844993025,3cyclictest9-21ksoftirqd/021:23:520
25844993025,3cyclictest9-21ksoftirqd/019:38:150
25844993025,3cyclictest9-21ksoftirqd/000:00:150
25844993024,4cyclictest9-21ksoftirqd/023:57:420
25844993024,4cyclictest9-21ksoftirqd/023:54:050
25844993024,4cyclictest9-21ksoftirqd/023:31:070
25844993024,4cyclictest9-21ksoftirqd/023:23:200
25844993024,4cyclictest9-21ksoftirqd/022:57:300
25844993024,4cyclictest9-21ksoftirqd/021:27:420
25844993024,4cyclictest9-21ksoftirqd/021:06:090
25844993024,4cyclictest9-21ksoftirqd/020:43:410
25844993024,4cyclictest9-21ksoftirqd/020:03:420
25844993024,4cyclictest9-21ksoftirqd/020:03:420
25844993024,4cyclictest9-21ksoftirqd/019:54:320
136591300,0ptp4l401ktimersoftd/323:35:523
136591300,0ptp4l401ktimersoftd/323:06:403
136591300,0ptp4l401ktimersoftd/320:38:533
25847992925,2cyclictest41-21ksoftirqd/321:37:273
25847992924,3cyclictest41-21ksoftirqd/319:38:533
25847992924,3cyclictest41-21ksoftirqd/300:11:333
25847992923,4cyclictest41-21ksoftirqd/321:29:233
25847992923,4cyclictest41-21ksoftirqd/320:56:443
25846992924,3cyclictest33-21ksoftirqd/223:50:142
25846992924,3cyclictest33-21ksoftirqd/222:35:142
25846992924,3cyclictest33-21ksoftirqd/221:25:002
25846992924,3cyclictest33-21ksoftirqd/220:43:042
25846992924,3cyclictest33-21ksoftirqd/219:23:562
25846992923,4cyclictest33-21ksoftirqd/223:33:102
25846992923,4cyclictest33-21ksoftirqd/221:56:532
25846992923,4cyclictest33-21ksoftirqd/221:15:012
25846992923,4cyclictest33-21ksoftirqd/219:11:202
25846992923,3cyclictest33-21ksoftirqd/222:24:032
25846992923,3cyclictest33-21ksoftirqd/220:25:222
25846992917,10cyclictest33-21ksoftirqd/223:40:252
25845992925,2cyclictest25-21ksoftirqd/122:00:011
25845992924,3cyclictest25-21ksoftirqd/123:50:111
25845992924,3cyclictest25-21ksoftirqd/123:40:191
25845992924,3cyclictest25-21ksoftirqd/122:10:201
25845992923,4cyclictest25-21ksoftirqd/123:26:061
25845992923,4cyclictest25-21ksoftirqd/123:15:431
25845992923,4cyclictest25-21ksoftirqd/122:55:011
25844992925,3cyclictest9-21ksoftirqd/019:10:220
25844992924,3cyclictest9-21ksoftirqd/023:07:590
25844992924,3cyclictest9-21ksoftirqd/021:33:150
25844992924,3cyclictest9-21ksoftirqd/021:00:140
25844992924,3cyclictest9-21ksoftirqd/020:20:130
25844992923,4cyclictest9-21ksoftirqd/023:27:500
25844992923,4cyclictest9-21ksoftirqd/022:44:090
25844992923,4cyclictest9-21ksoftirqd/022:29:530
25844992923,4cyclictest9-21ksoftirqd/021:54:060
25844992923,4cyclictest9-21ksoftirqd/021:12:390
25844992923,4cyclictest9-21ksoftirqd/020:27:340
25844992923,4cyclictest9-21ksoftirqd/020:10:080
25844992923,4cyclictest9-21ksoftirqd/019:27:310
25844992923,4cyclictest9-21ksoftirqd/000:17:440
136591290,1ptp4l401ktimersoftd/300:27:053
136591290,0ptp4l401ktimersoftd/323:58:373
136591290,0ptp4l401ktimersoftd/323:50:393
136591290,0ptp4l401ktimersoftd/322:13:433
136591290,0ptp4l401ktimersoftd/321:12:253
136591290,0ptp4l401ktimersoftd/300:35:263
118802290,8sleep22584699cyclictest20:55:152
25847992822,4cyclictest41-21ksoftirqd/322:23:343
25847992822,4cyclictest41-21ksoftirqd/319:44:273
25847992822,3cyclictest41-21ksoftirqd/322:55:003
25847992821,5cyclictest41-21ksoftirqd/319:10:583
25846992823,3cyclictest33-21ksoftirqd/221:03:142
25846992822,4cyclictest33-21ksoftirqd/219:29:132
25846992817,9cyclictest33-21ksoftirqd/222:15:172
25846992817,9cyclictest33-21ksoftirqd/222:15:172
25846992816,10cyclictest33-21ksoftirqd/223:45:292
25846992816,10cyclictest33-21ksoftirqd/222:25:272
25845992824,2cyclictest25-21ksoftirqd/119:40:001
25845992823,3cyclictest25-21ksoftirqd/123:40:001
25845992823,3cyclictest25-21ksoftirqd/123:06:131
25845992823,3cyclictest25-21ksoftirqd/100:36:501
25845992823,3cyclictest25-21ksoftirqd/100:06:241
25845992822,4cyclictest25-21ksoftirqd/122:15:371
25845992822,4cyclictest25-21ksoftirqd/122:15:371
25845992822,4cyclictest25-21ksoftirqd/120:08:321
25845992822,4cyclictest25-21ksoftirqd/119:15:091
25845992822,4cyclictest25-21ksoftirqd/119:14:251
25845992822,3cyclictest25-21ksoftirqd/122:51:551
25844992822,4cyclictest9-21ksoftirqd/023:10:320
25844992822,4cyclictest9-21ksoftirqd/022:47:540
25844992822,4cyclictest9-21ksoftirqd/022:37:550
25844992822,4cyclictest9-21ksoftirqd/020:51:240
25844992822,4cyclictest9-21ksoftirqd/020:34:440
25844992822,4cyclictest9-21ksoftirqd/019:42:120
25844992822,4cyclictest9-21ksoftirqd/000:28:150
25844992822,4cyclictest9-21ksoftirqd/000:08:340
136591280,0ptp4l401ktimersoftd/321:33:533
136591280,0ptp4l401ktimersoftd/320:15:563
25847992722,3cyclictest41-21ksoftirqd/323:23:083
25847992722,3cyclictest41-21ksoftirqd/320:40:223
25847992721,4cyclictest41-21ksoftirqd/322:25:343
25847992721,4cyclictest41-21ksoftirqd/321:45:343
25846992722,3cyclictest33-21ksoftirqd/223:55:572
25846992722,3cyclictest33-21ksoftirqd/223:15:272
25846992722,3cyclictest33-21ksoftirqd/221:40:012
25846992722,3cyclictest33-21ksoftirqd/221:40:002
25846992722,3cyclictest33-21ksoftirqd/200:25:192
25846992721,4cyclictest33-21ksoftirqd/220:05:132
25845992721,4cyclictest25-21ksoftirqd/123:24:581
25845992721,4cyclictest25-21ksoftirqd/120:23:201
25845992721,4cyclictest25-21ksoftirqd/100:28:321
25844992722,3cyclictest9-21ksoftirqd/022:50:060
25844992721,4cyclictest9-21ksoftirqd/019:20:410
25844992721,4cyclictest9-21ksoftirqd/019:15:310
25847992621,3cyclictest41-21ksoftirqd/322:38:173
25847992621,3cyclictest41-21ksoftirqd/322:05:053
25847992621,3cyclictest41-21ksoftirqd/322:01:293
25847992620,4cyclictest41-21ksoftirqd/319:45:473
25846992621,3cyclictest33-21ksoftirqd/222:11:552
25846992621,3cyclictest33-21ksoftirqd/220:00:002
25846992621,3cyclictest33-21ksoftirqd/200:16:562
25846992620,3cyclictest33-21ksoftirqd/223:10:002
25846992620,3cyclictest33-21ksoftirqd/221:05:442
25846992614,10cyclictest33-21ksoftirqd/223:35:292
25845992621,3cyclictest25-21ksoftirqd/123:34:001
25845992620,4cyclictest25-21ksoftirqd/122:36:041
25845992620,4cyclictest25-21ksoftirqd/120:17:191
25845992620,4cyclictest25-21ksoftirqd/119:44:211
25844992621,3cyclictest9-21ksoftirqd/023:03:580
25844992621,3cyclictest9-21ksoftirqd/023:03:580
25844992621,3cyclictest9-21ksoftirqd/022:34:440
25844992621,3cyclictest9-21ksoftirqd/021:45:280
25844992620,4cyclictest9-21ksoftirqd/023:15:100
51698250,4rtkit-daemon1532-21apache223:45:521
25847992519,4cyclictest41-21ksoftirqd/321:50:193
25847992519,4cyclictest41-21ksoftirqd/319:20:493
25846992520,3cyclictest33-21ksoftirqd/220:13:132
25845992520,3cyclictest25-21ksoftirqd/121:52:461
25845992520,3cyclictest25-21ksoftirqd/120:11:371
25845992520,3cyclictest25-21ksoftirqd/120:04:411
25845992520,3cyclictest25-21ksoftirqd/120:04:411
25845992520,3cyclictest25-21ksoftirqd/100:24:511
25845992520,3cyclictest25-21ksoftirqd/100:17:351
25845992519,4cyclictest25-21ksoftirqd/122:29:291
25845992519,4cyclictest25-21ksoftirqd/121:15:001
25845992519,3cyclictest25-21ksoftirqd/100:30:181
25845992518,5cyclictest25-21ksoftirqd/122:32:191
25844992520,3cyclictest9-21ksoftirqd/022:18:140
25844992520,3cyclictest9-21ksoftirqd/022:18:140
25846992419,3cyclictest33-21ksoftirqd/200:10:222
25845992420,2cyclictest25-21ksoftirqd/123:00:171
25845992420,2cyclictest25-21ksoftirqd/123:00:171
25845992419,3cyclictest25-21ksoftirqd/121:15:221
25845992419,3cyclictest25-21ksoftirqd/120:40:221
25845992419,3cyclictest25-21ksoftirqd/119:20:191
25845992418,4cyclictest25-21ksoftirqd/123:56:231
25844992419,3cyclictest9-21ksoftirqd/023:45:160
25844992419,3cyclictest9-21ksoftirqd/023:44:350
25844992419,3cyclictest9-21ksoftirqd/022:20:180
25844992419,3cyclictest9-21ksoftirqd/022:10:350
25844992419,3cyclictest9-21ksoftirqd/019:45:280
136591240,1ptp4l401ktimersoftd/319:55:143
136591240,0ptp4l401ktimersoftd/320:08:523
25847992318,3cyclictest41-21ksoftirqd/321:05:233
25846992319,2cyclictest33-21ksoftirqd/219:35:162
25845992318,3cyclictest25-21ksoftirqd/121:45:151
25845992318,3cyclictest25-21ksoftirqd/119:30:271
25845992318,3cyclictest25-21ksoftirqd/119:30:011
25845992317,4cyclictest13629-21sendmail21:00:011
2584599231,2cyclictest121rcu_preempt19:58:291
25844992317,4cyclictest9-21ksoftirqd/020:39:000
25846992217,3cyclictest33-21ksoftirqd/220:50:262
25845992217,3cyclictest25-21ksoftirqd/122:05:231
25845992217,3cyclictest25-21ksoftirqd/120:52:481
25845992217,3cyclictest25-21ksoftirqd/120:35:291
25845992216,4cyclictest25-21ksoftirqd/123:10:011
25845992216,4cyclictest25-21ksoftirqd/121:26:161
25846992116,3cyclictest33-21ksoftirqd/222:57:412
25845992116,3cyclictest25-21ksoftirqd/122:40:191
25845992015,3cyclictest25-21ksoftirqd/121:30:281
25845992015,3cyclictest25-21ksoftirqd/119:50:171
25845992014,3cyclictest25-21ksoftirqd/121:35:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional