You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 05:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Sat Jan 10, 2026 00:45:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
139491206172,22phc2sys0-21swapper/319:09:223
281682202169,22sleep20-21swapper/219:06:182
281672201168,22sleep10-21swapper/119:06:161
283302195162,22sleep00-21swapper/019:08:250
28749996630,4cyclictest33-21ksoftirqd/219:30:002
28747996630,9cyclictest9-21ksoftirqd/000:10:000
28747996530,7cyclictest9-21ksoftirqd/020:10:150
28747996428,7cyclictest9-21ksoftirqd/020:50:230
28747996426,6cyclictest9-21ksoftirqd/021:05:130
28747996330,5cyclictest9-21ksoftirqd/022:20:000
28747996329,6cyclictest9-21ksoftirqd/023:01:290
28747996328,7cyclictest9-21ksoftirqd/023:15:270
28747996328,7cyclictest9-21ksoftirqd/023:15:260
28747996327,6cyclictest9-21ksoftirqd/020:05:130
28747996325,6cyclictest9-21ksoftirqd/020:30:530
28749996233,4cyclictest33-21ksoftirqd/221:55:172
28749996230,9cyclictest33-21ksoftirqd/219:15:132
2874899629,12cyclictest28798-21cat23:40:001
28747996229,6cyclictest9-21ksoftirqd/022:45:010
28747996229,6cyclictest9-21ksoftirqd/022:45:010
28747996229,6cyclictest9-21ksoftirqd/019:20:010
28747996229,5cyclictest9-21ksoftirqd/023:35:110
28747996229,5cyclictest9-21ksoftirqd/019:50:130
28747996228,6cyclictest9-21ksoftirqd/022:11:190
28747996228,11cyclictest9-21ksoftirqd/020:25:200
28747996227,6cyclictest9-21ksoftirqd/019:29:590
28747996226,6cyclictest9-21ksoftirqd/023:25:010
28749996131,7cyclictest33-21ksoftirqd/220:10:182
28749996127,4cyclictest33-21ksoftirqd/223:50:192
2874899619,17cyclictest0-21swapper/120:05:121
2874899619,10cyclictest28628-21ls20:15:191
28748996110,11cyclictest5213-21df_abs20:35:141
28747996130,7cyclictest9-21ksoftirqd/000:00:010
28747996128,6cyclictest9-21ksoftirqd/023:15:000
28747996128,6cyclictest9-21ksoftirqd/020:20:140
28747996128,5cyclictest9-21ksoftirqd/021:15:260
28747996127,6cyclictest9-21ksoftirqd/021:25:250
28747996127,6cyclictest9-21ksoftirqd/020:40:110
28747996126,6cyclictest9-21ksoftirqd/023:45:180
28747996124,7cyclictest9-21ksoftirqd/021:30:170
28749996031,4cyclictest33-21ksoftirqd/220:50:182
28749996029,7cyclictest33-21ksoftirqd/219:40:132
28749996029,5cyclictest33-21ksoftirqd/200:30:012
28749996028,6cyclictest33-21ksoftirqd/223:15:202
28749996028,6cyclictest33-21ksoftirqd/223:15:192
28749996028,6cyclictest33-21ksoftirqd/219:55:272
28749996028,4cyclictest33-21ksoftirqd/222:00:112
28749996027,4cyclictest33-21ksoftirqd/221:35:142
2874899608,11cyclictest30064-21egrep20:20:121
2874899608,11cyclictest0-21swapper/121:05:251
2874899606,17cyclictest0-21swapper/122:40:201
28748996011,9cyclictest10634-21/usr/sbin/munin20:45:211
28747996030,4cyclictest9-21ksoftirqd/022:30:230
28747996029,5cyclictest9-21ksoftirqd/019:35:000
28747996027,6cyclictest9-21ksoftirqd/020:35:120
28747996027,6cyclictest9-21ksoftirqd/020:05:010
28747996027,5cyclictest9-21ksoftirqd/021:35:230
28747996026,7cyclictest9-21ksoftirqd/021:45:000
28747996026,6cyclictest9-21ksoftirqd/022:00:200
28747996026,6cyclictest9-21ksoftirqd/000:30:130
28747996026,10cyclictest9-21ksoftirqd/022:20:220
28747996025,6cyclictest9-21ksoftirqd/021:10:200
28747996025,6cyclictest9-21ksoftirqd/000:10:120
28749995929,8cyclictest33-21ksoftirqd/220:25:002
28749995929,4cyclictest33-21ksoftirqd/222:30:012
28749995928,5cyclictest33-21ksoftirqd/219:45:172
28749995927,6cyclictest33-21ksoftirqd/223:55:252
28749995924,6cyclictest33-21ksoftirqd/219:10:132
28749995924,4cyclictest33-21ksoftirqd/221:40:132
28749995923,5cyclictest33-21ksoftirqd/220:00:252
2874899599,8cyclictest5841-21date21:45:011
2874899599,12cyclictest5813-21cat19:30:001
2874899599,12cyclictest17409-21sed23:15:151
2874899599,12cyclictest17409-21sed23:15:151
2874899599,11cyclictest14424-21latency22:00:181
2874899598,11cyclictest6778-21cat22:50:261
2874899598,11cyclictest28551-21cut22:30:171
2874899598,10cyclictest1015-21date19:20:001
2874899597,11cyclictest28934-21/usr/sbin/munin23:40:201
28748995910,9cyclictest26184-21taskset23:33:351
28747995928,6cyclictest9-21ksoftirqd/019:45:010
28747995927,6cyclictest9-21ksoftirqd/022:25:150
28747995927,5cyclictest9-21ksoftirqd/022:40:230
28747995926,7cyclictest9-21ksoftirqd/022:05:120
28747995926,7cyclictest9-21ksoftirqd/022:05:120
28747995925,8cyclictest9-21ksoftirqd/020:55:210
28747995925,6cyclictest9-21ksoftirqd/019:40:120
28747995925,6cyclictest9-21ksoftirqd/000:35:120
28747995924,7cyclictest9-21ksoftirqd/021:25:000
28747995924,6cyclictest9-21ksoftirqd/020:45:160
28747995924,10cyclictest9-21ksoftirqd/021:45:110
28749995830,4cyclictest33-21ksoftirqd/221:15:152
28749995822,4cyclictest33-21ksoftirqd/220:45:232
28749995821,18cyclictest33-21ksoftirqd/200:40:002
28749995818,3cyclictest26531-21/usr/sbin/munin23:35:192
2874899589,18cyclictest19526-21switchtime19:55:241
2874899589,17cyclictest20797-21df_abs20:00:141
2874899589,12cyclictest25176-21sed22:25:001
2874899588,11cyclictest16638-21irqrtprio22:05:171
2874899588,11cyclictest16638-21irqrtprio22:05:171
2874899588,11cyclictest1028-21latency_hist23:49:591
2874899587,16cyclictest0-21swapper/119:11:041
28748995810,18cyclictest6536-21df_abs00:00:141
28747995828,6cyclictest9-21ksoftirqd/023:40:180
28747995828,5cyclictest9-21ksoftirqd/000:00:190
28747995827,6cyclictest9-21ksoftirqd/023:30:170
28747995827,6cyclictest9-21ksoftirqd/021:50:130
28747995825,6cyclictest9-21ksoftirqd/023:50:240
28747995825,11cyclictest9-21ksoftirqd/000:20:170
28747995824,6cyclictest9-21ksoftirqd/023:10:000
28747995824,5cyclictest9-21ksoftirqd/000:20:000
28747995824,5cyclictest9-21ksoftirqd/000:20:000
28747995819,4cyclictest9-21ksoftirqd/019:20:160
28749995731,4cyclictest33-21ksoftirqd/221:25:172
28749995730,4cyclictest33-21ksoftirqd/222:40:122
28749995728,4cyclictest33-21ksoftirqd/219:30:102
28749995724,5cyclictest33-21ksoftirqd/219:25:012
28749995723,5cyclictest33-21ksoftirqd/223:30:242
28749995719,7cyclictest33-21ksoftirqd/200:30:142
2874899579,11cyclictest31002-21date21:30:001
2874899578,9cyclictest0-21swapper/120:30:011
2874899578,11cyclictest3640-21latency_hist23:55:011
28748995710,12cyclictest16400-21hwlatdetect00:20:161
28747995726,5cyclictest9-21ksoftirqd/020:15:160
28747995723,6cyclictest9-21ksoftirqd/023:25:240
74142560,4sleep17415-21cut20:40:111
28749995630,7cyclictest33-21ksoftirqd/221:50:012
28749995628,9cyclictest33-21ksoftirqd/223:10:222
28749995626,4cyclictest33-21ksoftirqd/222:45:132
28749995626,4cyclictest33-21ksoftirqd/222:45:132
28749995623,4cyclictest33-21ksoftirqd/222:15:132
28749995618,12cyclictest33-21ksoftirqd/221:20:162
2874899569,18cyclictest10681-21cat21:55:001
2874899569,17cyclictest28589-21date21:25:001
2874899569,16cyclictest25388-21cpuspeed22:25:111
2874899569,11cyclictest6112-21cat21:45:111
2874899568,17cyclictest3709-21latency22:45:201
2874899568,17cyclictest3709-21latency22:45:191
2874899568,11cyclictest8356-21/usr/sbin/munin19:35:241
2874899568,11cyclictest18569-21df_abs00:25:121
2874899567,9cyclictest0-21swapper/123:00:271
28747995626,6cyclictest9-21ksoftirqd/019:10:190
28747995624,6cyclictest9-21ksoftirqd/021:00:200
320752550,2sleep10-21swapper/121:30:211
28749995527,9cyclictest33-21ksoftirqd/223:05:232
28749995519,4cyclictest33-21ksoftirqd/223:20:132
28749995517,11cyclictest33-21ksoftirqd/200:20:232
2874899559,11cyclictest21611-21cat00:30:191
2874899558,11cyclictest25082-21phc2sys21:15:221
28748995510,11cyclictest31561-21cat22:35:251
28747995527,6cyclictest9-21ksoftirqd/019:55:180
28747995526,5cyclictest9-21ksoftirqd/021:55:120
28747995523,6cyclictest9-21ksoftirqd/022:55:190
2874899548,43cyclictest12990-21sh22:00:001
2874899548,11cyclictest13717-21cat00:15:131
2874899548,11cyclictest13717-21cat00:15:131
28749995326,10cyclictest33-21ksoftirqd/222:30:122
28749995324,5cyclictest33-21ksoftirqd/222:35:232
28749995319,4cyclictest33-21ksoftirqd/220:29:332
2874899537,10cyclictest0-21swapper/122:15:141
139391530,0ptp4l401ktimersoftd/321:01:563
134491530,3getstats0-21swapper/321:15:163
28749995220,6cyclictest33-21ksoftirqd/222:55:222
2874899529,10cyclictest23184-21mailstats23:25:231
2874899528,8cyclictest13699-21mailstats23:05:231
2874899528,11cyclictest19514-21cpuspeed23:20:121
28747995221,4cyclictest9-21ksoftirqd/022:50:150
134491520,2getstats0-21swapper/321:40:153
28749995121,5cyclictest33-21ksoftirqd/222:05:212
28749995121,5cyclictest33-21ksoftirqd/222:05:212
28749995110,6cyclictest20328-21turbostat22:15:002
2874899517,10cyclictest0-21swapper/120:15:001
28748995112,7cyclictest13265-21ptp4l20:50:221
28748995110,8cyclictest8102-21if_enp1s022:55:161
2874799517,2cyclictest9-21ksoftirqd/000:30:010
2874999502,5cyclictest33-21ksoftirqd/200:15:002
28749995024,5cyclictest33-21ksoftirqd/200:00:222
28749995021,6cyclictest33-21ksoftirqd/219:39:242
28747995012,3cyclictest9-21ksoftirqd/019:35:150
28749994918,4cyclictest33-21ksoftirqd/221:05:112
2874899498,9cyclictest24421-21sensors_temp00:35:231
28747994929,10cyclictest9-21ksoftirqd/022:35:130
2874999485,5cyclictest33-21ksoftirqd/220:55:142
28749994827,11cyclictest33-21ksoftirqd/221:30:162
28749994819,5cyclictest33-21ksoftirqd/223:45:122
2874899489,8cyclictest16643-21irqstats19:50:181
2874899489,15cyclictest22703-21awk21:10:221
134491480,1getstats0-21swapper/321:25:153
2874999475,5cyclictest33-21ksoftirqd/222:50:132
2874999474,4cyclictest33-21ksoftirqd/221:15:002
2874899479,8cyclictest1386-21diskstats21:35:141
28748994710,14cyclictest12826-21taskset19:44:121
28748994710,10cyclictest11648-21/usr/sbin/munin00:10:151
2874999465,5cyclictest33-21ksoftirqd/220:35:122
2874999463,4cyclictest33-21ksoftirqd/220:15:152
2874999462,7cyclictest33-21ksoftirqd/222:20:132
28749994615,5cyclictest33-21ksoftirqd/200:10:002
2874899469,15cyclictest15311-21iostat23:10:171
134491460,2getstats0-21swapper/300:00:163
2874999454,6cyclictest33-21ksoftirqd/221:45:222
28749994518,5cyclictest33-21ksoftirqd/219:50:252
2874999444,7cyclictest33-21ksoftirqd/221:00:192
2874999444,5cyclictest33-21ksoftirqd/200:15:142
2874999444,5cyclictest33-21ksoftirqd/200:15:132
2874999443,7cyclictest33-21ksoftirqd/223:25:212
2874999443,5cyclictest33-21ksoftirqd/220:05:172
28749994413,4cyclictest33-21ksoftirqd/223:40:132
134391440,1getstats0-21swapper/321:10:273
2874999432,5cyclictest33-21ksoftirqd/220:40:132
28749994316,5cyclictest33-21ksoftirqd/220:35:002
139391430,0ptp4l401ktimersoftd/320:45:263
2874999422,8cyclictest33-21ksoftirqd/223:00:272
2874899428,8cyclictest5715-21chrt23:57:391
139391420,0ptp4l401ktimersoftd/322:12:563
139391420,0ptp4l401ktimersoftd/321:35:383
2874899407,11cyclictest0-21swapper/119:50:001
134391400,6getstats2875099cyclictest20:35:063
134391400,1getstats0-21swapper/322:25:263
134391400,1getstats0-21swapper/321:20:263
139391390,0ptp4l401ktimersoftd/320:30:223
28748993812,11cyclictest1033-21sort20:25:211
139391380,0ptp4l401ktimersoftd/323:05:513
139391380,0ptp4l401ktimersoftd/300:25:103
134491380,1getstats0-21swapper/300:05:163
28750993732,3cyclictest41-21ksoftirqd/320:20:003
2874899375,10cyclictest0-21swapper/122:10:241
139391370,0ptp4l401ktimersoftd/323:35:143
139391370,0ptp4l401ktimersoftd/322:07:363
139391370,0ptp4l401ktimersoftd/322:07:363
134391370,1getstats0-21swapper/322:20:263
134391360,1getstats0-21swapper/322:15:263
28750993531,3cyclictest41-21ksoftirqd/319:59:553
28750993530,3cyclictest41-21ksoftirqd/323:15:003
28748993510,9cyclictest0-21swapper/120:55:191
28748993510,12cyclictest3157-21chrt19:22:521
28750993429,3cyclictest41-21ksoftirqd/323:22:283
28750993429,3cyclictest41-21ksoftirqd/320:42:253
28750993428,4cyclictest41-21ksoftirqd/323:44:423
2874899349,11cyclictest8170-21latency_hist19:35:011
28748993410,10cyclictest1-21systemd00:07:131
139391340,0ptp4l401ktimersoftd/323:45:133
28750993328,3cyclictest41-21ksoftirqd/319:31:103
28750993328,3cyclictest41-21ksoftirqd/319:20:103
28750993327,4cyclictest41-21ksoftirqd/322:43:053
28750993327,4cyclictest41-21ksoftirqd/321:59:413
28750993229,2cyclictest16571-21awk21:00:003
28750993227,3cyclictest41-21ksoftirqd/323:26:173
28750993227,3cyclictest41-21ksoftirqd/320:50:083
28750993227,3cyclictest41-21ksoftirqd/320:05:553
28750993226,4cyclictest41-21ksoftirqd/322:36:263
28750993226,4cyclictest41-21ksoftirqd/321:51:453
139391320,0ptp4l401ktimersoftd/323:01:403
28750993127,2cyclictest139391ptp4l23:30:203
28750993126,3cyclictest41-21ksoftirqd/319:37:153
28750993125,4cyclictest41-21ksoftirqd/321:32:363
28750993125,4cyclictest41-21ksoftirqd/320:04:463
28750993125,4cyclictest41-21ksoftirqd/319:18:573
139391310,0ptp4l401ktimersoftd/322:51:273
139391310,0ptp4l401ktimersoftd/322:47:013
139391310,0ptp4l401ktimersoftd/322:47:003
139391310,0ptp4l401ktimersoftd/322:32:253
139391310,0ptp4l401ktimersoftd/320:13:593
139391310,0ptp4l401ktimersoftd/300:23:593
139391310,0ptp4l401ktimersoftd/300:13:103
28750993025,3cyclictest41-21ksoftirqd/319:48:223
28750993024,4cyclictest41-21ksoftirqd/323:53:333
28750993024,4cyclictest41-21ksoftirqd/320:27:503
28750993024,4cyclictest41-21ksoftirqd/319:51:313
139391300,0ptp4l401ktimersoftd/321:06:073
28750992924,3cyclictest41-21ksoftirqd/322:57:293
28750992923,4cyclictest41-21ksoftirqd/322:04:183
28750992923,4cyclictest41-21ksoftirqd/300:32:243
28750992823,3cyclictest41-21ksoftirqd/323:58:473
2874899286,10cyclictest0-21swapper/121:00:161
139391280,0ptp4l401ktimersoftd/320:24:393
28750992722,3cyclictest41-21ksoftirqd/319:45:013
28750992721,4cyclictest41-21ksoftirqd/319:27:573
2875099270,25cyclictest139391ptp4l00:16:243
2875099270,25cyclictest139391ptp4l00:16:243
28750992621,3cyclictest41-21ksoftirqd/323:17:373
28750992621,3cyclictest41-21ksoftirqd/323:17:373
28750992621,3cyclictest41-21ksoftirqd/319:10:583
28750992621,3cyclictest41-21ksoftirqd/300:36:293
28750992520,3cyclictest41-21ksoftirqd/321:46:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional