You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 04:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot4.osadl.org (updated Mon Sep 07, 2026 00:45:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
138591206143,22phc2sys0-21swapper/319:09:273
248302202169,22sleep00-21swapper/019:08:170
246362201167,23sleep10-21swapper/119:05:531
248002200167,22sleep20-21swapper/219:07:552
2516421660,5sleep32527399cyclictest21:15:243
324962930,2sleep00-21swapper/023:40:200
2527099641,23cyclictest5374-21cat19:35:011
2527099634,20cyclictest24142-21cstates00:30:131
2527099630,21cyclictest3787-21latency_hist23:50:001
2527099629,24cyclictest15899-21sed22:05:001
2527099620,22cyclictest23820-21cat00:30:011
2527099620,22cyclictest15954-21latency_hist23:10:011
2527099620,21cyclictest8646-21grep22:55:121
2527099610,21cyclictest15527-21latency_hist19:55:011
2527099600,24cyclictest6312-21/usr/sbin/munin19:35:171
2527099600,22cyclictest1401-21expr22:40:141
25269996033,8cyclictest9-21ksoftirqd/019:35:010
25269996024,7cyclictest9-21ksoftirqd/022:10:180
2527099599,18cyclictest5956-21ls20:40:011
25269995932,4cyclictest9-21ksoftirqd/020:25:220
25269995926,6cyclictest9-21ksoftirqd/023:35:180
138491590,1ptp4l401ktimersoftd/321:55:243
269532580,6sleep12527099cyclictest00:35:171
25269995826,4cyclictest9-21ksoftirqd/020:00:010
25269995823,4cyclictest9-21ksoftirqd/022:19:590
65512560,7sleep22527199cyclictest19:35:192
25269995623,4cyclictest9-21ksoftirqd/021:05:230
138491560,1ptp4l401ktimersoftd/323:04:593
2527099551,18cyclictest8447-21latency_hist21:50:001
2527099550,20cyclictest223-21systemd-journal21:54:391
2527099550,20cyclictest19949-21cat23:15:211
25269995525,4cyclictest9-21ksoftirqd/000:00:190
25269995522,4cyclictest9-21ksoftirqd/000:35:000
25269995519,7cyclictest9-21ksoftirqd/019:15:150
25269995425,5cyclictest9-21ksoftirqd/021:50:300
25269995424,4cyclictest9-21ksoftirqd/020:15:170
25269995422,6cyclictest9-21ksoftirqd/022:35:280
25269995422,4cyclictest9-21ksoftirqd/023:20:190
25269995421,7cyclictest9-21ksoftirqd/020:50:250
25269995420,5cyclictest9-21ksoftirqd/021:55:180
25269995328,6cyclictest9-21ksoftirqd/023:30:240
25269995328,6cyclictest9-21ksoftirqd/021:15:240
25269995325,3cyclictest9-21ksoftirqd/021:30:150
25269995324,6cyclictest9-21ksoftirqd/023:45:170
25269995323,9cyclictest9-21ksoftirqd/021:25:190
25269995323,4cyclictest9-21ksoftirqd/022:25:000
25269995321,5cyclictest9-21ksoftirqd/022:45:190
25269995320,10cyclictest9-21ksoftirqd/000:10:140
25269995319,4cyclictest9-21ksoftirqd/023:04:590
138491530,0ptp4l401ktimersoftd/323:12:003
25269995225,3cyclictest9-21ksoftirqd/020:55:190
25269995224,3cyclictest9-21ksoftirqd/023:50:150
25269995224,3cyclictest9-21ksoftirqd/023:50:150
25269995223,4cyclictest9-21ksoftirqd/020:20:190
25269995221,6cyclictest9-21ksoftirqd/021:20:150
25269995220,3cyclictest9-21ksoftirqd/021:00:130
25269995218,9cyclictest9-21ksoftirqd/019:30:000
25269995217,5cyclictest9-21ksoftirqd/021:40:000
2527099510,26cyclictest30152-21cat22:30:251
25269995122,6cyclictest9-21ksoftirqd/022:50:190
25269995122,6cyclictest9-21ksoftirqd/000:15:130
25269995121,6cyclictest9-21ksoftirqd/021:10:160
25269995121,5cyclictest9-21ksoftirqd/000:25:140
25269995119,5cyclictest9-21ksoftirqd/022:40:200
25269995117,10cyclictest9-21ksoftirqd/020:45:130
25269995116,5cyclictest9-21ksoftirqd/019:15:000
25269995115,6cyclictest9-21ksoftirqd/000:20:190
25269995115,6cyclictest9-21ksoftirqd/000:20:190
25269995115,6cyclictest9-21ksoftirqd/000:05:160
25269995022,3cyclictest9-21ksoftirqd/019:35:230
25269995021,4cyclictest9-21ksoftirqd/020:40:250
25269995020,6cyclictest9-21ksoftirqd/022:30:220
25269995020,4cyclictest9-21ksoftirqd/023:55:150
25269995019,5cyclictest9-21ksoftirqd/023:25:140
25269995018,7cyclictest9-21ksoftirqd/022:25:130
25269995018,6cyclictest9-21ksoftirqd/022:05:140
25269995018,5cyclictest9-21ksoftirqd/020:05:000
25269995018,4cyclictest9-21ksoftirqd/019:50:190
25269995015,6cyclictest9-21ksoftirqd/020:05:130
210752500,2sleep10-21swapper/120:05:141
25269994923,6cyclictest9-21ksoftirqd/022:00:250
25269994920,5cyclictest9-21ksoftirqd/000:35:150
25269994919,6cyclictest9-21ksoftirqd/023:05:140
25269994919,6cyclictest9-21ksoftirqd/020:10:150
25269994916,6cyclictest9-21ksoftirqd/021:45:140
25269994916,6cyclictest9-21ksoftirqd/019:40:300
25271994842,4cyclictest3525-21latency_hist21:40:002
25269994832,8cyclictest9-21ksoftirqd/020:40:010
25269994818,5cyclictest9-21ksoftirqd/020:30:150
25269994816,6cyclictest9-21ksoftirqd/019:45:130
25269994813,6cyclictest9-21ksoftirqd/023:10:180
25269994717,5cyclictest9-21ksoftirqd/021:40:170
25269994618,3cyclictest9-21ksoftirqd/019:20:200
25269994617,6cyclictest9-21ksoftirqd/023:15:170
25269994516,5cyclictest9-21ksoftirqd/022:55:160
138491430,0ptp4l401ktimersoftd/322:32:523
138491430,0ptp4l401ktimersoftd/320:43:493
25271994237,3cyclictest30531-21cron20:25:002
25271994236,4cyclictest33-21ksoftirqd/223:35:002
2527099420,39cyclictest21226-21cron00:25:011
2527099420,39cyclictest21226-21cron00:25:011
138491410,0ptp4l401ktimersoftd/323:16:503
138491410,0ptp4l401ktimersoftd/320:04:073
25271994034,4cyclictest33-21ksoftirqd/222:37:562
138491400,2ptp4l401ktimersoftd/322:47:533
2527199390,2cyclictest0-21swapper/200:35:342
2527099390,19cyclictest26680-21forks21:20:141
25273993833,3cyclictest41-21ksoftirqd/320:35:013
25273993832,4cyclictest41-21ksoftirqd/319:31:153
25271993832,4cyclictest33-21ksoftirqd/219:53:362
25270993831,4cyclictest8930-21irqrtprio19:40:191
2527099381,15cyclictest0-21swapper/120:30:241
138491380,0ptp4l401ktimersoftd/300:00:123
25273993732,3cyclictest41-21ksoftirqd/319:54:073
25273993731,4cyclictest41-21ksoftirqd/321:29:533
25271993731,4cyclictest33-21ksoftirqd/222:11:072
25271993731,4cyclictest33-21ksoftirqd/220:54:012
25271993731,4cyclictest33-21ksoftirqd/219:57:532
25271993731,4cyclictest33-21ksoftirqd/200:03:132
2527099371,27cyclictest30924-21cut20:25:121
2527099371,17cyclictest20817-21latency_hist21:10:011
25273993631,3cyclictest41-21ksoftirqd/321:21:423
25273993630,4cyclictest41-21ksoftirqd/322:58:393
2527199367,27cyclictest0-21swapper/220:45:222
2527199367,27cyclictest0-21swapper/200:15:332
25271993630,4cyclictest33-21ksoftirqd/222:44:062
25271993630,4cyclictest33-21ksoftirqd/222:27:402
25271993630,4cyclictest33-21ksoftirqd/221:03:112
25270993631,3cyclictest25-21ksoftirqd/122:15:001
25270993630,4cyclictest25-21ksoftirqd/122:24:031
25270993630,3cyclictest25-21ksoftirqd/119:30:001
2527099360,18cyclictest18419-21latency_hist23:15:011
138491360,0ptp4l401ktimersoftd/321:50:193
25273993529,4cyclictest41-21ksoftirqd/323:34:103
25273993529,4cyclictest41-21ksoftirqd/320:53:353
25273993529,3cyclictest41-21ksoftirqd/322:45:003
25273993528,4cyclictest41-21ksoftirqd/322:05:043
2527199355,6cyclictest0-21swapper/200:10:242
25271993530,3cyclictest33-21ksoftirqd/220:39:242
25271993529,4cyclictest33-21ksoftirqd/223:50:302
25271993529,4cyclictest33-21ksoftirqd/223:50:302
25271993529,4cyclictest33-21ksoftirqd/223:43:552
25271993529,4cyclictest33-21ksoftirqd/222:05:392
25271993529,4cyclictest33-21ksoftirqd/222:04:302
25271993529,4cyclictest33-21ksoftirqd/200:32:252
25271993529,3cyclictest33-21ksoftirqd/222:22:332
25270993530,3cyclictest25-21ksoftirqd/123:50:131
25270993530,3cyclictest25-21ksoftirqd/123:50:131
25270993529,4cyclictest25-21ksoftirqd/123:26:541
25270993529,4cyclictest25-21ksoftirqd/121:39:461
2527099350,23cyclictest28916-21cstates23:35:131
2527099350,19cyclictest0-21swapper/122:05:191
138491350,0ptp4l401ktimersoftd/323:37:113
138491350,0ptp4l401ktimersoftd/319:25:003
50798340,1rtkit-daemon0-21swapper/121:55:271
25273993429,3cyclictest41-21ksoftirqd/321:49:383
25273993429,3cyclictest41-21ksoftirqd/321:32:103
25273993428,4cyclictest41-21ksoftirqd/323:46:203
25273993428,4cyclictest41-21ksoftirqd/322:19:003
25273993428,4cyclictest41-21ksoftirqd/322:01:063
25273993428,4cyclictest41-21ksoftirqd/321:02:093
25273993428,4cyclictest41-21ksoftirqd/320:10:423
25273993428,4cyclictest41-21ksoftirqd/300:30:493
25273993428,4cyclictest41-21ksoftirqd/300:29:183
25273993427,4cyclictest41-21ksoftirqd/321:09:393
25271993429,3cyclictest33-21ksoftirqd/223:20:002
25271993428,4cyclictest33-21ksoftirqd/221:30:362
25271993428,4cyclictest33-21ksoftirqd/219:32:222
25271993428,4cyclictest33-21ksoftirqd/200:07:172
25271993428,3cyclictest33-21ksoftirqd/219:47:592
25271993427,5cyclictest33-21ksoftirqd/223:26:342
25271993427,5cyclictest33-21ksoftirqd/221:10:512
25271993427,4cyclictest33-21ksoftirqd/200:27:522
25270993428,4cyclictest25-21ksoftirqd/121:14:031
25270993428,4cyclictest25-21ksoftirqd/100:06:441
2527099340,21cyclictest9340-21cut20:45:191
2527099340,15cyclictest0-21swapper/119:20:161
25273993328,3cyclictest41-21ksoftirqd/322:50:143
25273993327,4cyclictest41-21ksoftirqd/323:52:303
25273993327,4cyclictest41-21ksoftirqd/323:52:303
25273993327,4cyclictest41-21ksoftirqd/322:13:103
25273993327,4cyclictest41-21ksoftirqd/320:19:573
25273993327,4cyclictest41-21ksoftirqd/319:28:343
25271993328,3cyclictest33-21ksoftirqd/219:42:212
25271993327,4cyclictest33-21ksoftirqd/223:13:382
25271993327,4cyclictest33-21ksoftirqd/223:05:352
25271993327,4cyclictest33-21ksoftirqd/222:49:402
25271993327,4cyclictest33-21ksoftirqd/222:16:572
25271993327,4cyclictest33-21ksoftirqd/221:26:592
25271993327,4cyclictest33-21ksoftirqd/220:56:422
25271993327,4cyclictest33-21ksoftirqd/219:16:442
25271993327,4cyclictest33-21ksoftirqd/200:21:022
25271993327,4cyclictest33-21ksoftirqd/200:21:022
25271993327,3cyclictest33-21ksoftirqd/221:06:522
25271993326,4cyclictest33-21ksoftirqd/220:30:432
25270993328,3cyclictest25-21ksoftirqd/123:55:111
25270993328,3cyclictest25-21ksoftirqd/119:17:041
25270993328,3cyclictest17770-21cron20:00:001
25270993327,4cyclictest25-21ksoftirqd/122:28:201
25270993327,4cyclictest25-21ksoftirqd/120:03:071
25270993327,3cyclictest25-21ksoftirqd/123:01:521
25270993326,5cyclictest25-21ksoftirqd/119:46:141
2527099330,20cyclictest31237-21dpkg23:40:021
138491330,0ptp4l401ktimersoftd/320:20:183
138491330,0ptp4l401ktimersoftd/300:11:183
138491330,0ptp4l401ktimersoftd/300:05:503
25273993227,3cyclictest41-21ksoftirqd/323:43:103
25273993227,3cyclictest41-21ksoftirqd/323:09:393
25273993227,3cyclictest41-21ksoftirqd/300:35:123
25273993227,3cyclictest41-21ksoftirqd/300:16:063
2527199325,26cyclictest0-21swapper/221:50:232
25271993227,3cyclictest33-21ksoftirqd/222:50:372
25271993227,3cyclictest33-21ksoftirqd/219:13:312
25271993226,4cyclictest33-21ksoftirqd/223:58:042
25271993226,4cyclictest33-21ksoftirqd/223:39:452
25271993226,4cyclictest33-21ksoftirqd/223:23:382
25271993226,4cyclictest33-21ksoftirqd/223:02:542
25271993226,4cyclictest33-21ksoftirqd/221:49:222
25271993226,4cyclictest33-21ksoftirqd/221:19:372
25271993226,4cyclictest33-21ksoftirqd/219:27:532
25271993226,3cyclictest33-21ksoftirqd/220:02:262
25270993227,3cyclictest25-21ksoftirqd/119:10:291
25270993226,4cyclictest25-21ksoftirqd/123:23:051
25270993226,4cyclictest25-21ksoftirqd/122:49:061
25270993226,4cyclictest25-21ksoftirqd/120:52:201
25270993226,4cyclictest25-21ksoftirqd/120:43:101
2527099320,18cyclictest0-21swapper/121:25:141
2527099320,18cyclictest0-21swapper/120:20:211
138491320,9ptp4l401ktimersoftd/319:35:233
138491320,0ptp4l401ktimersoftd/320:29:503
25271993126,3cyclictest33-21ksoftirqd/223:45:402
25271993126,3cyclictest33-21ksoftirqd/222:59:502
25271993124,4cyclictest33-21ksoftirqd/222:34:472
25270993126,3cyclictest25-21ksoftirqd/121:19:391
25270993126,3cyclictest25-21ksoftirqd/100:15:151
25270993125,4cyclictest25-21ksoftirqd/121:40:471
25270993125,4cyclictest25-21ksoftirqd/121:03:201
2527099311,27cyclictest31669-21tune2fs21:30:181
138491310,0ptp4l401ktimersoftd/323:55:273
138491310,0ptp4l401ktimersoftd/323:21:343
138491310,0ptp4l401ktimersoftd/322:25:083
138491310,0ptp4l401ktimersoftd/321:35:283
138491310,0ptp4l401ktimersoftd/300:24:283
138491310,0ptp4l401ktimersoftd/300:24:283
25273993025,3cyclictest41-21ksoftirqd/321:41:383
25273993025,3cyclictest41-21ksoftirqd/319:57:373
25273993025,3cyclictest41-21ksoftirqd/319:44:563
25271993025,3cyclictest33-21ksoftirqd/220:19:082
25270993011,16cyclictest27968-21cat20:20:001
138491300,0ptp4l401ktimersoftd/323:25:123
138491300,0ptp4l401ktimersoftd/319:48:133
25273992925,3cyclictest41-21ksoftirqd/320:59:273
25271992923,4cyclictest33-21ksoftirqd/221:21:182
25271992923,4cyclictest33-21ksoftirqd/220:43:192
25270992923,4cyclictest25-21ksoftirqd/122:51:191
25270992923,4cyclictest25-21ksoftirqd/122:36:141
25270992923,4cyclictest25-21ksoftirqd/122:16:251
138491290,0ptp4l401ktimersoftd/322:36:413
25273992824,2cyclictest41-21ksoftirqd/320:45:423
25271992823,3cyclictest33-21ksoftirqd/220:25:072
25271992823,3cyclictest33-21ksoftirqd/220:06:002
25271992823,3cyclictest33-21ksoftirqd/219:20:262
25271992817,9cyclictest33-21ksoftirqd/221:55:262
2527099285,14cyclictest50798rtkit-daemon23:33:221
25270992823,3cyclictest25-21ksoftirqd/100:10:191
25270992812,14cyclictest1303-21runrttasks20:11:151
138491280,0ptp4l401ktimersoftd/321:13:023
138491280,0ptp4l401ktimersoftd/320:39:133
25273992722,3cyclictest41-21ksoftirqd/319:10:583
25271992722,3cyclictest33-21ksoftirqd/221:40:582
25273992620,4cyclictest41-21ksoftirqd/320:07:533
25270992621,3cyclictest25-21ksoftirqd/120:56:061
138491260,0ptp4l401ktimersoftd/322:24:183
25271992520,3cyclictest33-21ksoftirqd/220:10:412
2527099251,21cyclictest9418-21/usr/sbin/munin00:00:161
25273992419,3cyclictest41-21ksoftirqd/319:19:543
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional