You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 11:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot3.osadl.org (updated Sat Dec 27, 2025 00:45:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
233992232167,22sleep00-21swapper/019:07:500
139491209175,23phc2sys0-21swapper/319:07:513
235442203170,22sleep10-21swapper/119:09:431
232832202168,23sleep20-21swapper/219:06:202
1253921620,6sleep12386099cyclictest19:50:271
1139921410,5sleep32386299cyclictest19:50:173
57898910,70rtkit-daemon0-21swapper/319:10:003
2356728362,11sleep20-21swapper/219:10:012
287072600,1sleep00-21swapper/019:20:120
237332600,7sleep02385999cyclictest22:30:230
124012560,2sleep10-21swapper/121:00:181
124012560,2sleep10-21swapper/121:00:181
26792540,1sleep30-21swapper/300:00:283
2386199480,3cyclictest9621-21ps22:00:232
23861994731,13cyclictest33-21ksoftirqd/200:25:122
139391450,0ptp4l401ktimersoftd/320:35:113
57898420,9rtkit-daemon0-21swapper/219:29:372
23861994235,3cyclictest8207-21wc19:45:012
139391420,0ptp4l401ktimersoftd/320:50:213
139391410,0ptp4l401ktimersoftd/320:15:223
134391410,1getstats0-21swapper/320:20:293
57898400,6rtkit-daemon0-21swapper/219:39:072
139391400,1ptp4l391rcuc/322:40:193
139391390,0ptp4l401ktimersoftd/322:19:553
57898380,7rtkit-daemon0-21swapper/222:44:102
23861993831,4cyclictest33-21ksoftirqd/220:37:592
23859993833,3cyclictest9-21ksoftirqd/019:26:180
139391380,0ptp4l401ktimersoftd/322:10:003
23862993732,3cyclictest41-21ksoftirqd/300:40:003
23862993732,3cyclictest41-21ksoftirqd/300:40:003
23862993730,4cyclictest41-21ksoftirqd/320:10:113
23862993713,21cyclictest3328-21latency_hist21:50:013
2386199377,28cyclictest0-21swapper/223:05:332
23860993730,5cyclictest25-21ksoftirqd/122:23:141
23862993631,3cyclictest41-21ksoftirqd/322:55:113
23861993629,4cyclictest33-21ksoftirqd/222:45:212
23860993630,4cyclictest25-21ksoftirqd/123:47:181
23860993630,4cyclictest25-21ksoftirqd/122:52:271
23860993630,4cyclictest25-21ksoftirqd/121:53:461
23860993630,4cyclictest25-21ksoftirqd/120:16:541
23860993630,4cyclictest25-21ksoftirqd/120:00:371
23859993630,4cyclictest9-21ksoftirqd/020:42:000
23859993629,5cyclictest9-21ksoftirqd/021:20:590
2386299359,3cyclictest8154-21latency_hist21:59:593
23862993530,3cyclictest41-21ksoftirqd/300:05:583
23862993529,4cyclictest41-21ksoftirqd/323:34:493
23862993529,4cyclictest41-21ksoftirqd/323:06:053
23862993529,4cyclictest41-21ksoftirqd/322:46:153
23862993529,4cyclictest41-21ksoftirqd/321:55:003
23862993529,4cyclictest41-21ksoftirqd/321:30:373
23862993529,4cyclictest41-21ksoftirqd/321:07:223
23861993530,3cyclictest33-21ksoftirqd/221:49:182
23861993529,4cyclictest33-21ksoftirqd/222:10:272
23860993529,4cyclictest25-21ksoftirqd/123:33:221
23860993529,4cyclictest25-21ksoftirqd/123:01:371
23860993529,4cyclictest25-21ksoftirqd/120:52:171
23860993529,4cyclictest25-21ksoftirqd/119:56:051
23860993529,4cyclictest25-21ksoftirqd/119:27:361
23860993529,4cyclictest25-21ksoftirqd/100:17:431
23860993528,5cyclictest25-21ksoftirqd/121:17:041
23860993528,5cyclictest25-21ksoftirqd/121:11:381
23860993528,4cyclictest25-21ksoftirqd/122:00:161
23862993429,3cyclictest41-21ksoftirqd/323:20:003
23862993429,3cyclictest41-21ksoftirqd/321:35:143
23862993429,3cyclictest41-21ksoftirqd/319:19:593
23862993429,3cyclictest41-21ksoftirqd/300:32:463
23862993428,4cyclictest41-21ksoftirqd/322:50:443
23862993428,4cyclictest41-21ksoftirqd/322:37:483
23862993428,4cyclictest41-21ksoftirqd/321:44:053
23862993428,4cyclictest41-21ksoftirqd/300:21:013
23862993412,20cyclictest28508-21/usr/sbin/munin23:50:203
23862993411,20cyclictest13056-21cat00:25:133
23861993429,3cyclictest6960-21wc20:50:132
23861993429,3cyclictest33-21ksoftirqd/220:30:152
23861993428,4cyclictest33-21ksoftirqd/223:47:032
23861993428,4cyclictest33-21ksoftirqd/220:55:382
23861993428,4cyclictest33-21ksoftirqd/220:13:342
23861993428,4cyclictest33-21ksoftirqd/220:07:572
23861993415,9cyclictest33-21ksoftirqd/200:05:252
23860993428,4cyclictest25-21ksoftirqd/123:50:111
23860993428,4cyclictest25-21ksoftirqd/122:26:191
23860993428,4cyclictest25-21ksoftirqd/121:08:241
23860993428,4cyclictest25-21ksoftirqd/120:42:091
23860993428,4cyclictest25-21ksoftirqd/120:21:481
23860993427,5cyclictest25-21ksoftirqd/120:57:131
23859993429,3cyclictest9-21ksoftirqd/020:30:130
23859993428,4cyclictest9-21ksoftirqd/022:27:020
23859993428,4cyclictest9-21ksoftirqd/021:07:350
23862993328,3cyclictest41-21ksoftirqd/320:45:293
23862993327,4cyclictest41-21ksoftirqd/323:56:473
23862993327,4cyclictest41-21ksoftirqd/323:56:473
23862993327,4cyclictest41-21ksoftirqd/323:13:113
23862993327,4cyclictest41-21ksoftirqd/321:29:453
2386299331,6cyclictest1300-21snmpd23:25:043
23862993311,20cyclictest31003-21/usr/sbin/munin19:25:163
23862993310,20cyclictest17320-21if_err_enp1s021:10:203
23861993328,3cyclictest33-21ksoftirqd/222:33:002
23861993327,4cyclictest33-21ksoftirqd/223:57:182
23861993327,4cyclictest33-21ksoftirqd/223:57:182
23861993327,4cyclictest33-21ksoftirqd/219:48:502
23861993327,4cyclictest33-21ksoftirqd/200:32:082
23861993327,4cyclictest33-21ksoftirqd/200:23:582
23860993327,4cyclictest25-21ksoftirqd/123:28:491
23860993327,4cyclictest25-21ksoftirqd/123:16:301
23860993327,4cyclictest25-21ksoftirqd/123:06:071
23860993327,4cyclictest25-21ksoftirqd/121:40:301
23860993327,4cyclictest25-21ksoftirqd/121:34:521
23859993328,3cyclictest9-21ksoftirqd/019:35:240
23859993327,4cyclictest9-21ksoftirqd/023:50:340
23859993327,4cyclictest9-21ksoftirqd/023:23:350
23859993327,4cyclictest9-21ksoftirqd/022:13:260
23859993327,4cyclictest9-21ksoftirqd/020:07:510
23859993327,4cyclictest9-21ksoftirqd/000:32:020
23859993327,4cyclictest9-21ksoftirqd/000:23:000
139391330,4ptp4l2386299cyclictest20:03:493
23862993227,3cyclictest41-21ksoftirqd/323:43:313
23862993227,3cyclictest41-21ksoftirqd/320:40:113
23862993227,3cyclictest41-21ksoftirqd/300:19:373
23862993225,4cyclictest41-21ksoftirqd/319:38:583
23862993211,19cyclictest14259-21sed19:55:223
23861993227,3cyclictest33-21ksoftirqd/223:28:062
23861993227,3cyclictest33-21ksoftirqd/220:19:582
23861993227,3cyclictest33-21ksoftirqd/200:01:442
23861993226,4cyclictest33-21ksoftirqd/222:23:592
23861993226,4cyclictest33-21ksoftirqd/222:17:372
23861993226,4cyclictest33-21ksoftirqd/222:09:112
23861993226,4cyclictest33-21ksoftirqd/221:53:432
23861993226,4cyclictest33-21ksoftirqd/220:45:512
23861993226,4cyclictest33-21ksoftirqd/219:31:212
23860993226,4cyclictest25-21ksoftirqd/122:14:321
23860993226,4cyclictest25-21ksoftirqd/121:20:081
23860993226,4cyclictest25-21ksoftirqd/119:45:331
23860993226,4cyclictest25-21ksoftirqd/119:42:561
23860993226,4cyclictest25-21ksoftirqd/100:29:191
23859993227,3cyclictest9-21ksoftirqd/023:29:280
23859993227,3cyclictest9-21ksoftirqd/022:05:140
23859993226,4cyclictest9-21ksoftirqd/022:52:300
23859993226,4cyclictest9-21ksoftirqd/021:26:290
23859993226,4cyclictest9-21ksoftirqd/021:17:580
23859993226,4cyclictest9-21ksoftirqd/020:46:290
23859993226,4cyclictest9-21ksoftirqd/019:58:510
23859993226,4cyclictest9-21ksoftirqd/019:49:530
23859993226,4cyclictest9-21ksoftirqd/019:34:480
23859993226,4cyclictest9-21ksoftirqd/019:19:160
23859993225,5cyclictest9-21ksoftirqd/023:14:200
23859993225,4cyclictest9-21ksoftirqd/020:02:040
2386299319,3cyclictest5859-21/usr/sbin/munin00:10:263
2386299319,3cyclictest23369-21unixbench_singl21:20:253
2386299319,3cyclictest21374-21/usr/sbin/munin23:35:133
2386299319,2cyclictest26141-21/usr/sbin/munin23:45:283
2386299318,3cyclictest6864-21sed19:40:183
23862993126,3cyclictest41-21ksoftirqd/321:15:083
23862993126,3cyclictest41-21ksoftirqd/320:05:563
23862993125,4cyclictest41-21ksoftirqd/322:04:433
23862993125,4cyclictest41-21ksoftirqd/321:04:253
23862993125,4cyclictest41-21ksoftirqd/321:04:253
23862993125,4cyclictest41-21ksoftirqd/319:31:143
2386299311,5cyclictest27432-21apt-get20:25:123
23861993126,3cyclictest33-21ksoftirqd/220:26:112
23861993125,4cyclictest33-21ksoftirqd/223:51:012
23861993125,4cyclictest33-21ksoftirqd/223:23:002
23861993125,4cyclictest33-21ksoftirqd/221:25:262
23861993125,4cyclictest33-21ksoftirqd/219:55:532
2386199312,28cyclictest16447-21kworker/2:222:57:252
2386199311,28cyclictest16447-21kworker/2:223:32:252
23860993126,3cyclictest25-21ksoftirqd/122:59:181
23860993126,3cyclictest25-21ksoftirqd/122:41:261
23860993126,3cyclictest25-21ksoftirqd/119:20:291
23860993125,4cyclictest25-21ksoftirqd/122:39:191
23860993125,4cyclictest25-21ksoftirqd/100:22:361
23859993125,4cyclictest9-21ksoftirqd/023:55:040
23859993125,4cyclictest9-21ksoftirqd/023:55:040
23859993125,4cyclictest9-21ksoftirqd/023:37:230
23859993125,4cyclictest9-21ksoftirqd/022:55:020
23859993125,4cyclictest9-21ksoftirqd/022:15:390
23859993125,4cyclictest9-21ksoftirqd/019:53:420
23859993125,4cyclictest9-21ksoftirqd/019:11:510
23859993125,4cyclictest9-21ksoftirqd/000:26:450
23859993125,3cyclictest9-21ksoftirqd/023:00:420
23859993125,3cyclictest9-21ksoftirqd/021:34:560
2386299309,3cyclictest22600-21/usr/sbin/munin22:30:153
2386299309,3cyclictest20232-21/usr/sbin/munin22:25:253
2386299306,3cyclictest14631-21cat22:10:263
23862993025,3cyclictest41-21ksoftirqd/320:32:243
23862993025,3cyclictest41-21ksoftirqd/319:45:113
23861993025,3cyclictest33-21ksoftirqd/221:13:432
23861993025,3cyclictest33-21ksoftirqd/200:38:042
23861993025,3cyclictest33-21ksoftirqd/200:38:032
23861993024,4cyclictest33-21ksoftirqd/223:36:082
23861993024,4cyclictest33-21ksoftirqd/223:13:262
23861993024,4cyclictest33-21ksoftirqd/223:02:302
23861993024,4cyclictest33-21ksoftirqd/221:30:372
23861993023,4cyclictest33-21ksoftirqd/219:16:572
23860993025,3cyclictest25-21ksoftirqd/100:31:171
23860993024,4cyclictest25-21ksoftirqd/123:41:291
23860993024,4cyclictest25-21ksoftirqd/120:37:111
23860993024,4cyclictest25-21ksoftirqd/120:32:461
23859993025,3cyclictest9-21ksoftirqd/023:08:580
23859993025,3cyclictest9-21ksoftirqd/021:45:110
23859993025,3cyclictest9-21ksoftirqd/021:44:370
23859993025,3cyclictest9-21ksoftirqd/021:35:140
23859993025,3cyclictest9-21ksoftirqd/021:12:050
23859993025,3cyclictest9-21ksoftirqd/000:38:330
23859993025,3cyclictest9-21ksoftirqd/000:38:320
23859993024,4cyclictest9-21ksoftirqd/023:34:020
23859993024,4cyclictest9-21ksoftirqd/023:19:170
23859993024,4cyclictest9-21ksoftirqd/022:47:440
23859993024,4cyclictest9-21ksoftirqd/022:41:060
23859993024,4cyclictest9-21ksoftirqd/020:29:320
23859993024,3cyclictest9-21ksoftirqd/020:11:390
2386299298,3cyclictest29599-21latency19:20:203
23862992923,4cyclictest41-21ksoftirqd/320:57:113
2386299291,5cyclictest1300-21snmpd23:20:113
23862992911,16cyclictest1317-21runrttasks23:00:423
23861992924,3cyclictest33-21ksoftirqd/220:20:102
23861992923,4cyclictest33-21ksoftirqd/222:39:202
23861992923,4cyclictest33-21ksoftirqd/222:27:452
23861992923,4cyclictest33-21ksoftirqd/200:16:482
23860992923,4cyclictest25-21ksoftirqd/123:21:271
23860992923,4cyclictest25-21ksoftirqd/120:09:441
23860992923,4cyclictest25-21ksoftirqd/100:05:481
23860992923,4cyclictest25-21ksoftirqd/100:00:501
23860992923,3cyclictest25-21ksoftirqd/122:46:121
23860992922,5cyclictest25-21ksoftirqd/122:19:491
23859992924,3cyclictest9-21ksoftirqd/023:41:280
23859992924,3cyclictest9-21ksoftirqd/022:01:550
23859992923,4cyclictest9-21ksoftirqd/000:09:070
23859992923,3cyclictest9-21ksoftirqd/023:45:030
2386299286,3cyclictest18238-21df_abs22:20:173
2386199285,21cyclictest31415-21kworker/2:021:01:142
2386199285,21cyclictest31415-21kworker/2:021:01:132
23861992822,4cyclictest33-21ksoftirqd/223:19:352
23861992822,4cyclictest33-21ksoftirqd/221:41:432
2386199281,26cyclictest31415-21kworker/2:021:06:372
23860992824,2cyclictest25-21ksoftirqd/120:15:001
23860992822,4cyclictest25-21ksoftirqd/123:57:171
23860992822,4cyclictest25-21ksoftirqd/123:57:171
23860992822,4cyclictest25-21ksoftirqd/122:31:001
23860992822,4cyclictest25-21ksoftirqd/121:56:461
23860992822,4cyclictest25-21ksoftirqd/121:35:441
23859992823,3cyclictest9-21ksoftirqd/022:37:400
23859992823,3cyclictest9-21ksoftirqd/021:53:130
23859992823,3cyclictest9-21ksoftirqd/000:18:510
23859992822,4cyclictest9-21ksoftirqd/020:53:110
23859992822,4cyclictest9-21ksoftirqd/020:35:070
23859992822,3cyclictest9-21ksoftirqd/021:04:000
23859992822,3cyclictest9-21ksoftirqd/021:03:590
2386199278,18cyclictest0-21swapper/219:20:232
23861992722,3cyclictest33-21ksoftirqd/223:42:382
23861992722,3cyclictest33-21ksoftirqd/200:13:072
23861992721,4cyclictest33-21ksoftirqd/221:58:122
23861992721,4cyclictest33-21ksoftirqd/221:35:452
23861992721,4cyclictest33-21ksoftirqd/220:00:382
2386199271,25cyclictest16447-21kworker/2:221:17:252
23860992722,3cyclictest25-21ksoftirqd/123:12:571
23860992721,4cyclictest25-21ksoftirqd/119:13:071
23859992722,3cyclictest9-21ksoftirqd/020:17:000
23859992722,3cyclictest9-21ksoftirqd/000:03:590
23859992721,4cyclictest9-21ksoftirqd/022:24:500
23859992721,4cyclictest9-21ksoftirqd/020:21:460
2386199263,21cyclictest16447-21kworker/2:221:24:092
23861992621,3cyclictest33-21ksoftirqd/220:42:272
23861992620,4cyclictest33-21ksoftirqd/219:52:242
23860992621,3cyclictest25-21ksoftirqd/121:47:441
23860992621,3cyclictest25-21ksoftirqd/100:14:531
23860992620,4cyclictest25-21ksoftirqd/100:35:481
23860992620,4cyclictest25-21ksoftirqd/100:35:481
23860992619,5cyclictest25-21ksoftirqd/121:26:261
23859992621,3cyclictest9-21ksoftirqd/021:57:200
23859992621,3cyclictest9-21ksoftirqd/019:41:070
23859992620,4cyclictest9-21ksoftirqd/000:13:170
23861992520,3cyclictest33-21ksoftirqd/222:54:022
23860992521,3cyclictest25-21ksoftirqd/120:25:191
23860992512,10cyclictest25-21ksoftirqd/119:35:501
23860992419,3cyclictest25-21ksoftirqd/120:48:471
23860992318,3cyclictest25-21ksoftirqd/122:07:121
23859992317,4cyclictest9-21ksoftirqd/020:58:370
23860992217,3cyclictest25-21ksoftirqd/119:30:271
23860992216,3cyclictest27988-21head19:15:261
23860992013,4cyclictest22608-21sed23:35:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional