You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 06:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot4.osadl.org (updated Mon Dec 15, 2025 00:45:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
112222213179,23sleep10-21swapper/119:05:101
132252209176,22sleep30-21swapper/319:07:173
132222208175,22sleep00-21swapper/019:07:140
133362200167,22sleep20-21swapper/219:08:452
138491790,1ptp4l401ktimersoftd/321:02:453
13725996411,12cyclictest11178-21awk00:25:431
13726996031,5cyclictest33-21ksoftirqd/220:40:012
13726996029,5cyclictest33-21ksoftirqd/219:25:302
13726996026,6cyclictest33-21ksoftirqd/223:40:302
13726996026,6cyclictest33-21ksoftirqd/222:55:302
13726995929,9cyclictest33-21ksoftirqd/219:35:002
13726995929,7cyclictest33-21ksoftirqd/200:10:302
13726995929,5cyclictest33-21ksoftirqd/222:15:392
13726995927,6cyclictest33-21ksoftirqd/221:45:012
13726995927,6cyclictest33-21ksoftirqd/221:15:302
13726995925,6cyclictest33-21ksoftirqd/220:20:402
138491580,39ptp4l0-21swapper/319:10:003
13726995827,5cyclictest33-21ksoftirqd/222:35:002
13726995823,5cyclictest33-21ksoftirqd/220:30:432
1372499589,12cyclictest18097-21/usr/sbin/munin22:30:400
13724995810,10cyclictest12100-21/usr/sbin/munin00:30:320
13726995729,9cyclictest33-21ksoftirqd/222:15:002
13726995727,6cyclictest33-21ksoftirqd/222:50:362
13726995727,5cyclictest33-21ksoftirqd/223:58:232
13726995727,5cyclictest33-21ksoftirqd/223:45:452
13726995727,5cyclictest33-21ksoftirqd/223:00:452
13726995726,8cyclictest33-21ksoftirqd/219:35:362
13726995725,5cyclictest33-21ksoftirqd/222:40:312
13726995725,5cyclictest33-21ksoftirqd/222:40:312
13726995723,5cyclictest33-21ksoftirqd/220:40:312
13726995723,5cyclictest33-21ksoftirqd/200:05:412
13726995628,7cyclictest33-21ksoftirqd/223:30:002
13726995628,7cyclictest33-21ksoftirqd/223:30:002
13726995625,5cyclictest33-21ksoftirqd/223:10:312
1372499566,18cyclictest20648-21ssh23:40:420
13726995527,6cyclictest33-21ksoftirqd/221:14:592
13726995526,6cyclictest33-21ksoftirqd/222:21:382
13726995522,6cyclictest33-21ksoftirqd/221:37:052
13726995521,6cyclictest33-21ksoftirqd/220:45:322
1372499559,12cyclictest13176-21/usr/sbin/munin21:15:400
13726995425,8cyclictest33-21ksoftirqd/221:25:072
13726995421,3cyclictest33-21ksoftirqd/223:30:442
13726995420,6cyclictest33-21ksoftirqd/220:10:322
13726995326,7cyclictest33-21ksoftirqd/220:05:332
13726995324,5cyclictest33-21ksoftirqd/222:00:342
13726995324,5cyclictest33-21ksoftirqd/221:30:442
13726995322,5cyclictest33-21ksoftirqd/220:55:382
13726995319,5cyclictest33-21ksoftirqd/221:45:402
13726995310,5cyclictest33-21ksoftirqd/222:45:342
106622530,5sleep31372799cyclictest22:15:433
13726995225,8cyclictest33-21ksoftirqd/222:05:312
13726995125,6cyclictest33-21ksoftirqd/221:55:392
13726995123,8cyclictest33-21ksoftirqd/220:15:422
13726995121,8cyclictest33-21ksoftirqd/220:50:362
13726995120,6cyclictest33-21ksoftirqd/221:20:422
13726995119,5cyclictest33-21ksoftirqd/221:05:342
1372699506,7cyclictest33-21ksoftirqd/221:50:442
13726995021,3cyclictest33-21ksoftirqd/200:25:302
1372699495,7cyclictest33-21ksoftirqd/222:35:342
1372699495,7cyclictest33-21ksoftirqd/200:35:012
1372699495,6cyclictest33-21ksoftirqd/219:45:352
1372699494,5cyclictest16720-21sendmail-msp00:40:012
13726994921,3cyclictest33-21ksoftirqd/219:15:272
1372699486,7cyclictest33-21ksoftirqd/220:05:012
1372699486,7cyclictest33-21ksoftirqd/200:20:472
13726994821,5cyclictest33-21ksoftirqd/223:10:012
13726994817,8cyclictest33-21ksoftirqd/219:20:312
1372699475,7cyclictest33-21ksoftirqd/222:25:302
1372699475,7cyclictest33-21ksoftirqd/221:05:002
1372699475,6cyclictest33-21ksoftirqd/200:00:432
1372699474,7cyclictest33-21ksoftirqd/219:55:392
1372699474,6cyclictest33-21ksoftirqd/223:15:362
1372699471,5cyclictest33-21ksoftirqd/223:35:302
1372699471,5cyclictest33-21ksoftirqd/219:50:302
1372699471,5cyclictest33-21ksoftirqd/200:15:392
138491460,0ptp4l401ktimersoftd/321:09:583
13727994625,18cyclictest23699-21cron23:50:003
1372699465,7cyclictest33-21ksoftirqd/220:25:332
1372599467,10cyclictest18179-21awk23:35:431
50798450,2rtkit-daemon506-21rtkit-daemon21:36:043
1372699454,6cyclictest33-21ksoftirqd/223:20:412
1372699450,6cyclictest33-21ksoftirqd/223:50:322
1372699443,7cyclictest33-21ksoftirqd/219:40:352
1372699440,6cyclictest33-21ksoftirqd/219:10:352
1372499449,11cyclictest6605-21grep22:10:300
1372499437,11cyclictest9340-21apt-get21:10:260
138491410,0ptp4l401ktimersoftd/320:20:373
1372599417,11cyclictest10632-21grep20:05:401
138491400,0ptp4l401ktimersoftd/323:18:573
138491390,0ptp4l401ktimersoftd/322:50:013
1372599398,19cyclictest28140-21sensors21:45:461
1372499396,10cyclictest16680-21sed21:25:000
1372599389,10cyclictest19969-21irqrtprio20:25:361
1372499386,18cyclictest0-21swapper/019:40:270
138491370,14ptp4l401ktimersoftd/300:30:013
1372599376,11cyclictest14233-21sed21:20:011
138491360,0ptp4l401ktimersoftd/320:40:393
13725993630,4cyclictest25-21ksoftirqd/120:02:591
13725993629,4cyclictest25-21ksoftirqd/122:15:291
13724993629,5cyclictest9-21ksoftirqd/021:27:270
13727993529,4cyclictest41-21ksoftirqd/323:02:413
13727993529,4cyclictest41-21ksoftirqd/322:45:483
1372799350,33cyclictest11412-21sh23:25:003
13725993530,3cyclictest25-21ksoftirqd/123:51:571
13725993530,3cyclictest25-21ksoftirqd/120:40:001
13725993529,4cyclictest25-21ksoftirqd/122:31:421
1372499357,17cyclictest6886-21apt-get21:05:290
1372499356,11cyclictest7785-21cat23:15:370
13724993529,4cyclictest9-21ksoftirqd/023:11:160
13724993529,4cyclictest9-21ksoftirqd/021:59:030
13724993529,4cyclictest9-21ksoftirqd/000:26:420
13724993529,4cyclictest9-21ksoftirqd/000:24:090
13724993529,4cyclictest9-21ksoftirqd/000:16:230
50798340,3rtkit-daemon9-21ksoftirqd/021:51:230
13727993429,3cyclictest41-21ksoftirqd/322:10:293
13727993429,3cyclictest41-21ksoftirqd/300:00:013
13727993428,4cyclictest41-21ksoftirqd/323:53:043
13727993428,4cyclictest41-21ksoftirqd/319:31:083
13727993428,4cyclictest41-21ksoftirqd/300:08:473
1372599347,14cyclictest1627-21apt-get22:00:291
1372599347,11cyclictest18941-21latency_hist21:30:001
13725993428,4cyclictest25-21ksoftirqd/123:01:381
13725993428,4cyclictest25-21ksoftirqd/120:20:131
13725993428,4cyclictest25-21ksoftirqd/100:05:371
13725993428,3cyclictest25-21ksoftirqd/119:20:001
13725993427,5cyclictest25-21ksoftirqd/121:37:261
13724993428,4cyclictest9-21ksoftirqd/023:39:320
13724993428,4cyclictest9-21ksoftirqd/023:01:010
13724993428,4cyclictest9-21ksoftirqd/021:42:390
13724993428,4cyclictest9-21ksoftirqd/021:03:190
13724993428,4cyclictest9-21ksoftirqd/020:11:480
13724993427,5cyclictest9-21ksoftirqd/000:04:230
138491330,0ptp4l401ktimersoftd/319:50:293
138491330,0ptp4l401ktimersoftd/319:20:013
13727993328,3cyclictest41-21ksoftirqd/323:13:403
13727993327,4cyclictest41-21ksoftirqd/323:37:183
13727993327,4cyclictest41-21ksoftirqd/320:37:023
13727993327,4cyclictest41-21ksoftirqd/320:03:333
13727993327,4cyclictest41-21ksoftirqd/300:20:273
13727993326,4cyclictest41-21ksoftirqd/320:16:573
1372599338,14cyclictest29893-21iostat_ios20:45:331
1372599336,16cyclictest0-21swapper/119:45:281
13725993328,3cyclictest25-21ksoftirqd/123:26:041
13725993328,3cyclictest25-21ksoftirqd/123:26:041
13725993328,3cyclictest25-21ksoftirqd/120:15:271
13725993328,3cyclictest25-21ksoftirqd/119:36:111
1372499336,7cyclictest26909-21df_abs23:55:330
13724993327,4cyclictest9-21ksoftirqd/023:49:350
13724993327,4cyclictest9-21ksoftirqd/022:35:300
13724993327,4cyclictest9-21ksoftirqd/022:09:260
13724993327,4cyclictest9-21ksoftirqd/020:43:300
13724993327,4cyclictest9-21ksoftirqd/020:30:010
13724993327,4cyclictest9-21ksoftirqd/000:37:130
13724993326,5cyclictest9-21ksoftirqd/023:52:360
138491320,0ptp4l401ktimersoftd/323:41:323
138491320,0ptp4l401ktimersoftd/321:17:293
138491320,0ptp4l401ktimersoftd/320:14:373
138491320,0ptp4l401ktimersoftd/319:46:583
13727993227,3cyclictest41-21ksoftirqd/322:05:293
13727993227,3cyclictest41-21ksoftirqd/300:39:073
13727993226,4cyclictest41-21ksoftirqd/321:47:193
13727993226,4cyclictest41-21ksoftirqd/320:30:493
13727993226,4cyclictest41-21ksoftirqd/300:12:403
1372599327,8cyclictest27501-21iostat_ios22:50:361
1372599327,14cyclictest31628-21apt-get20:50:281
1372599327,14cyclictest21515-21apt-get20:30:271
1372599326,14cyclictest23254-21ls19:25:421
1372599326,14cyclictest14477-21apt-get00:35:331
13725993227,3cyclictest25-21ksoftirqd/123:50:001
13725993227,3cyclictest25-21ksoftirqd/122:24:191
13725993227,3cyclictest25-21ksoftirqd/119:56:131
13725993226,4cyclictest25-21ksoftirqd/123:41:541
13725993226,4cyclictest25-21ksoftirqd/123:09:411
13725993226,4cyclictest25-21ksoftirqd/122:59:221
13725993226,4cyclictest25-21ksoftirqd/121:50:061
13725993226,4cyclictest25-21ksoftirqd/121:09:591
13725993226,4cyclictest25-21ksoftirqd/119:53:561
13725993226,4cyclictest25-21ksoftirqd/119:32:421
13725993226,4cyclictest25-21ksoftirqd/100:30:231
13725993224,5cyclictest25-21ksoftirqd/119:13:011
1372499327,7cyclictest30274-21memory20:45:360
1372499326,14cyclictest1548-21apt-get19:50:290
1372499325,9cyclictest0-21swapper/020:20:360
1372499324,10cyclictest0-21swapper/022:45:010
1372499324,10cyclictest0-21swapper/022:45:010
13724993227,3cyclictest9-21ksoftirqd/022:52:230
13724993227,3cyclictest9-21ksoftirqd/020:55:540
13724993227,3cyclictest9-21ksoftirqd/020:16:460
13724993226,4cyclictest9-21ksoftirqd/023:20:280
13724993226,4cyclictest9-21ksoftirqd/020:00:570
13724993226,4cyclictest9-21ksoftirqd/019:27:440
13724993226,4cyclictest9-21ksoftirqd/019:13:040
13724993226,3cyclictest9-21ksoftirqd/022:17:450
138491310,0ptp4l401ktimersoftd/323:25:593
138491310,0ptp4l401ktimersoftd/323:25:593
138491310,0ptp4l401ktimersoftd/321:51:463
138491310,0ptp4l401ktimersoftd/319:19:573
138491310,0ptp4l401ktimersoftd/300:15:203
13727993126,3cyclictest41-21ksoftirqd/322:56:123
13727993126,3cyclictest41-21ksoftirqd/322:28:323
13727993126,3cyclictest41-21ksoftirqd/321:26:323
13727993126,3cyclictest41-21ksoftirqd/321:13:023
13727993125,4cyclictest41-21ksoftirqd/322:30:273
13727993125,4cyclictest41-21ksoftirqd/321:44:133
13727993125,4cyclictest41-21ksoftirqd/319:39:463
13727993125,4cyclictest41-21ksoftirqd/300:03:393
13727993125,3cyclictest41-21ksoftirqd/321:31:243
13727993124,4cyclictest41-21ksoftirqd/321:23:073
1372599318,7cyclictest20300-21memory21:30:361
1372599317,7cyclictest19652-21iostat_ios19:20:361
1372599316,7cyclictest6664-21apt-get00:20:311
1372599314,16cyclictest0-21swapper/100:00:291
13725993126,3cyclictest420-21rs:main1
13725993126,3cyclictest420-21rs:main1
13725993126,3cyclictest25-21ksoftirqd/100:13:311
13725993125,4cyclictest25-21ksoftirqd/122:47:461
13725993125,4cyclictest25-21ksoftirqd/122:11:441
1372499317,10cyclictest25524-21sensors20:35:410
1372499315,15cyclictest25682-21ls19:30:400
13724993127,2cyclictest1394-21cron00:10:000
13724993125,4cyclictest9-21ksoftirqd/023:33:270
13724993125,4cyclictest9-21ksoftirqd/023:07:590
13724993125,4cyclictest9-21ksoftirqd/022:03:400
13724993124,4cyclictest9-21ksoftirqd/019:38:390
138491300,0ptp4l401ktimersoftd/319:27:183
13727993025,3cyclictest41-21ksoftirqd/319:40:593
13727993024,4cyclictest41-21ksoftirqd/320:54:513
13727993023,4cyclictest41-21ksoftirqd/320:25:593
1372599308,7cyclictest12029-21df20:10:311
1372599304,12cyclictest0-21swapper/120:40:311
13725993025,3cyclictest25-21ksoftirqd/123:31:021
13725993024,4cyclictest25-21ksoftirqd/121:21:341
13725993024,4cyclictest25-21ksoftirqd/121:11:111
13725993024,3cyclictest25-21ksoftirqd/122:39:541
13725993024,3cyclictest25-21ksoftirqd/122:09:301
13725993017,9cyclictest26489-21taskset23:55:311
1372499307,7cyclictest30337-21memory22:55:370
13724993025,3cyclictest9-21ksoftirqd/023:26:000
13724993025,3cyclictest9-21ksoftirqd/023:26:000
13724993025,3cyclictest9-21ksoftirqd/022:48:010
13724993025,3cyclictest9-21ksoftirqd/020:53:150
13724993025,3cyclictest9-21ksoftirqd/000:12:290
13724993024,4cyclictest9-21ksoftirqd/022:22:380
13724993024,4cyclictest9-21ksoftirqd/020:27:490
3200622923,3sleep125-21ksoftirqd/121:55:331
138491290,0ptp4l401ktimersoftd/321:55:203
13727992924,3cyclictest41-21ksoftirqd/323:06:313
13727992924,3cyclictest41-21ksoftirqd/320:06:053
13725992924,3cyclictest25-21ksoftirqd/123:15:381
1372499297,7cyclictest17890-21ls19:15:400
1372499295,10cyclictest0-21swapper/021:50:010
1372499294,9cyclictest0-21swapper/022:25:280
13724992923,4cyclictest9-21ksoftirqd/020:06:360
13724992923,4cyclictest9-21ksoftirqd/019:22:300
138491280,0ptp4l401ktimersoftd/322:44:163
138491280,0ptp4l401ktimersoftd/322:44:163
13727992823,3cyclictest41-21ksoftirqd/320:45:303
13725992823,3cyclictest25-21ksoftirqd/122:25:591
13725992822,4cyclictest25-21ksoftirqd/123:21:081
13725992822,4cyclictest25-21ksoftirqd/120:55:581
13724992823,3cyclictest9-21ksoftirqd/019:46:280
13724992822,4cyclictest9-21ksoftirqd/019:57:200
13727992722,3cyclictest41-21ksoftirqd/322:21:043
13727992721,4cyclictest41-21ksoftirqd/323:34:103
13725992722,3cyclictest25-21ksoftirqd/121:40:591
13725992722,3cyclictest25-21ksoftirqd/100:18:131
13725992721,4cyclictest25-21ksoftirqd/123:12:011
13725992721,4cyclictest25-21ksoftirqd/119:41:491
13724992722,3cyclictest9-21ksoftirqd/021:32:200
13724992721,4cyclictest9-21ksoftirqd/021:36:210
138491260,0ptp4l401ktimersoftd/322:35:303
13727992520,3cyclictest41-21ksoftirqd/319:55:263
13727992519,4cyclictest41-21ksoftirqd/320:55:203
13727992519,4cyclictest41-21ksoftirqd/300:27:573
13725992520,3cyclictest25-21ksoftirqd/121:00:331
13727992419,3cyclictest41-21ksoftirqd/322:04:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional