You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-06 - 04:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot3.osadl.org (updated Sun Sep 06, 2026 00:45:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2532322650,27sleep20-21swapper/219:05:182
139491230162,23phc2sys0-21swapper/319:09:543
265342229164,22sleep10-21swapper/119:07:331
265432207174,22sleep00-21swapper/019:07:390
2213521510,5sleep32701999cyclictest20:05:223
1394918866,11phc2sys0-21swapper/319:10:003
1394918866,11phc2sys0-21swapper/319:10:003
23022570,5sleep125-21ksoftirqd/122:50:001
152822560,5sleep015286-21timerandwakeup19:50:270
269312510,2sleep30-21swapper/321:25:143
27019995028,10cyclictest41-21ksoftirqd/323:05:253
105632500,1sleep00-21swapper/020:50:200
2701999483,7cyclictest41-21ksoftirqd/320:19:593
27019994715,8cyclictest41-21ksoftirqd/320:00:003
27019994715,8cyclictest41-21ksoftirqd/320:00:003
27019994714,7cyclictest41-21ksoftirqd/320:50:183
27019994538,4cyclictest16735-21sh23:20:003
27019994433,9cyclictest41-21ksoftirqd/323:20:203
27019994415,3cyclictest41-21ksoftirqd/320:25:293
27019994410,7cyclictest41-21ksoftirqd/323:25:233
27019994410,7cyclictest41-21ksoftirqd/323:25:233
27017994436,5cyclictest26267-21cron23:40:001
27019994314,4cyclictest41-21ksoftirqd/322:30:293
27019994310,5cyclictest41-21ksoftirqd/321:55:153
27017994336,4cyclictest6080-21cron21:50:001
2701799432,38cyclictest13136-21dump-pmu-power00:20:001
139391430,0ptp4l401ktimersoftd/322:07:453
27019994237,3cyclictest41-21ksoftirqd/319:35:003
27019994230,4cyclictest41-21ksoftirqd/321:25:013
27019994214,7cyclictest41-21ksoftirqd/323:55:013
27019994213,6cyclictest41-21ksoftirqd/323:15:003
27019994211,3cyclictest41-21ksoftirqd/322:15:273
139391420,1ptp4l401ktimersoftd/321:36:423
27019994114,7cyclictest41-21ksoftirqd/322:45:173
27019994112,3cyclictest41-21ksoftirqd/320:30:263
27016994134,4cyclictest12247-21wc23:10:140
27019994035,2cyclictest41-21ksoftirqd/323:00:003
27019994035,2cyclictest41-21ksoftirqd/323:00:003
27019994030,8cyclictest41-21ksoftirqd/319:20:283
27019994011,7cyclictest41-21ksoftirqd/321:00:003
27018994034,3cyclictest9593-21seq20:49:042
27016994023,15cyclictest9-21ksoftirqd/021:03:050
2701999396,8cyclictest41-21ksoftirqd/322:40:013
2701999395,4cyclictest41-21ksoftirqd/320:10:253
27019993927,9cyclictest41-21ksoftirqd/319:35:243
2701999387,3cyclictest41-21ksoftirqd/320:45:123
2701999385,4cyclictest41-21ksoftirqd/321:15:013
27019993833,3cyclictest41-21ksoftirqd/321:10:013
27019993833,2cyclictest41-21ksoftirqd/300:05:193
27019993832,4cyclictest41-21ksoftirqd/322:43:043
27019993831,4cyclictest41-21ksoftirqd/321:35:003
139391380,0ptp4l401ktimersoftd/322:00:243
2701999375,4cyclictest41-21ksoftirqd/300:05:003
2701999373,2cyclictest121rcu_preempt00:28:593
27019993726,8cyclictest41-21ksoftirqd/321:00:263
27019993724,10cyclictest41-21ksoftirqd/319:15:243
27017993731,3cyclictest25-21ksoftirqd/120:00:181
27017993730,4cyclictest25-21ksoftirqd/119:35:001
27016993731,4cyclictest9-21ksoftirqd/023:26:250
27016993731,4cyclictest9-21ksoftirqd/023:26:250
27016993729,3cyclictest9-21ksoftirqd/019:40:110
2701699370,5cyclictest1228-21apt-get23:55:120
2701999369,3cyclictest41-21ksoftirqd/300:20:153
2701999367,8cyclictest41-21ksoftirqd/300:31:423
2701999366,3cyclictest41-21ksoftirqd/323:55:193
2701999363,2cyclictest121rcu_preempt19:28:583
27019993632,2cyclictest41-21ksoftirqd/322:25:263
27019993632,2cyclictest41-21ksoftirqd/320:00:173
27019993631,3cyclictest41-21ksoftirqd/320:20:183
27019993631,3cyclictest41-21ksoftirqd/319:55:013
2701999362,4cyclictest41-21ksoftirqd/323:30:213
2701999362,3cyclictest121rcu_preempt19:40:143
27018993630,4cyclictest33-21ksoftirqd/219:42:502
27017993630,4cyclictest25-21ksoftirqd/122:20:111
27017993630,4cyclictest25-21ksoftirqd/120:58:511
27017993630,4cyclictest25-21ksoftirqd/119:38:161
27017993630,3cyclictest25-21ksoftirqd/100:15:001
27016993630,4cyclictest9-21ksoftirqd/022:00:200
27016993630,4cyclictest9-21ksoftirqd/021:29:070
2701999359,7cyclictest41-21ksoftirqd/323:45:013
2701999357,10cyclictest41-21ksoftirqd/320:40:253
2701999356,3cyclictest41-21ksoftirqd/300:18:053
2701999355,2cyclictest121rcu_preempt22:10:173
27019993531,2cyclictest41-21ksoftirqd/321:40:123
27019993530,3cyclictest41-21ksoftirqd/323:35:263
27019993530,3cyclictest41-21ksoftirqd/322:20:203
27019993530,3cyclictest41-21ksoftirqd/321:45:133
27019993530,3cyclictest41-21ksoftirqd/300:35:163
27019993526,3cyclictest41-21ksoftirqd/321:50:203
2701999352,10cyclictest41-21ksoftirqd/320:35:143
2701899353,17cyclictest15612-21cat22:10:002
27018993529,4cyclictest33-21ksoftirqd/222:14:302
27018993529,4cyclictest33-21ksoftirqd/219:39:492
27018993529,3cyclictest33-21ksoftirqd/221:15:122
27018993528,5cyclictest33-21ksoftirqd/223:01:362
27017993530,3cyclictest25-21ksoftirqd/122:50:161
27017993529,4cyclictest25-21ksoftirqd/123:56:591
27017993529,4cyclictest25-21ksoftirqd/123:25:341
27017993529,4cyclictest25-21ksoftirqd/123:25:341
27017993529,4cyclictest25-21ksoftirqd/123:23:541
27017993529,4cyclictest25-21ksoftirqd/122:27:291
27017993529,4cyclictest25-21ksoftirqd/122:16:061
27017993529,4cyclictest25-21ksoftirqd/121:14:041
27017993529,4cyclictest25-21ksoftirqd/119:44:151
27017993529,4cyclictest25-21ksoftirqd/100:06:341
27016993530,2cyclictest11775-21sh23:10:010
27016993529,4cyclictest9-21ksoftirqd/000:32:130
27016993528,5cyclictest9-21ksoftirqd/020:34:190
27016993513,19cyclictest19129-21latency_hist23:25:000
57898340,4rtkit-daemon24500-21apache220:43:102
27019993430,2cyclictest41-21ksoftirqd/322:50:193
27019993429,2cyclictest41-21ksoftirqd/323:00:193
2701999340,3cyclictest41-21ksoftirqd/323:45:193
2701899345,28cyclictest6463-21kworker/2:100:30:332
27018993429,3cyclictest33-21ksoftirqd/223:05:122
27018993429,3cyclictest33-21ksoftirqd/222:51:532
27018993428,4cyclictest33-21ksoftirqd/223:32:442
27018993428,4cyclictest33-21ksoftirqd/223:19:172
27018993428,4cyclictest33-21ksoftirqd/221:13:132
27018993428,3cyclictest33-21ksoftirqd/221:30:362
27017993429,3cyclictest25-21ksoftirqd/122:02:411
27017993429,3cyclictest25-21ksoftirqd/121:35:501
27017993428,4cyclictest25-21ksoftirqd/123:04:161
27017993428,4cyclictest25-21ksoftirqd/122:32:391
27017993428,4cyclictest25-21ksoftirqd/121:44:571
27017993428,4cyclictest25-21ksoftirqd/121:04:291
27017993428,4cyclictest25-21ksoftirqd/120:46:481
27017993428,4cyclictest25-21ksoftirqd/120:17:151
27017993428,4cyclictest25-21ksoftirqd/120:10:411
27017993428,4cyclictest25-21ksoftirqd/120:05:281
27017993428,4cyclictest25-21ksoftirqd/119:47:041
27017993428,4cyclictest25-21ksoftirqd/100:21:391
27017993427,4cyclictest25-21ksoftirqd/120:53:041
2701699349,22cyclictest16768-21sendmail23:20:000
27016993428,4cyclictest9-21ksoftirqd/022:55:570
27016993428,4cyclictest9-21ksoftirqd/022:55:570
27016993428,4cyclictest9-21ksoftirqd/020:08:010
27016993428,4cyclictest9-21ksoftirqd/019:36:470
27016993428,4cyclictest9-21ksoftirqd/000:22:060
27016993413,18cyclictest31860-21if_enp4s023:50:170
27016993412,20cyclictest28110-21df_abs22:35:170
27016993411,20cyclictest5613-21grep20:40:150
27019993328,3cyclictest41-21ksoftirqd/319:45:173
27018993328,3cyclictest33-21ksoftirqd/222:55:462
27018993328,3cyclictest33-21ksoftirqd/222:55:462
27018993328,3cyclictest33-21ksoftirqd/222:27:062
27018993328,3cyclictest33-21ksoftirqd/220:58:112
27018993327,4cyclictest33-21ksoftirqd/223:47:012
27018993327,4cyclictest33-21ksoftirqd/223:20:022
27018993327,4cyclictest33-21ksoftirqd/222:49:572
27018993327,4cyclictest33-21ksoftirqd/220:16:522
27018993327,4cyclictest33-21ksoftirqd/200:09:472
27018993327,4cyclictest33-21ksoftirqd/200:04:432
2701899330,32cyclictest4727-21kworker/2:122:00:242
27017993328,3cyclictest25-21ksoftirqd/123:05:161
27017993328,3cyclictest25-21ksoftirqd/121:25:121
27017993327,4cyclictest25-21ksoftirqd/123:42:191
27017993327,4cyclictest25-21ksoftirqd/123:18:521
27017993327,4cyclictest25-21ksoftirqd/122:09:241
27017993327,4cyclictest25-21ksoftirqd/119:58:581
27017993327,4cyclictest25-21ksoftirqd/119:58:581
27016993328,3cyclictest9-21ksoftirqd/022:40:110
27016993328,3cyclictest9-21ksoftirqd/019:13:050
27016993328,3cyclictest9-21ksoftirqd/019:13:040
27016993327,4cyclictest9-21ksoftirqd/023:46:230
27016993327,4cyclictest9-21ksoftirqd/022:13:080
27016993327,4cyclictest9-21ksoftirqd/021:41:030
27016993313,18cyclictest869-21users21:35:280
27016993310,20cyclictest4530-21df_abs19:30:150
27016993310,20cyclictest25592-21expr22:30:170
2701999326,3cyclictest41-21ksoftirqd/300:11:533
27019993228,2cyclictest41-21ksoftirqd/321:20:003
27018993227,3cyclictest33-21ksoftirqd/223:52:072
27018993227,3cyclictest33-21ksoftirqd/221:00:062
27018993227,3cyclictest33-21ksoftirqd/219:47:042
27018993226,4cyclictest33-21ksoftirqd/222:32:202
27018993226,4cyclictest33-21ksoftirqd/221:35:592
27018993226,4cyclictest33-21ksoftirqd/221:09:362
27018993226,4cyclictest33-21ksoftirqd/220:06:382
27018993226,4cyclictest33-21ksoftirqd/219:50:492
27018993225,5cyclictest33-21ksoftirqd/223:25:072
27018993225,5cyclictest33-21ksoftirqd/223:25:072
27018993225,4cyclictest33-21ksoftirqd/200:15:432
27017993227,4cyclictest25-21ksoftirqd/121:54:041
27017993227,3cyclictest25-21ksoftirqd/121:22:181
27017993227,3cyclictest25-21ksoftirqd/119:51:491
27017993226,4cyclictest25-21ksoftirqd/120:30:321
27017993226,4cyclictest25-21ksoftirqd/120:20:561
27017993226,4cyclictest25-21ksoftirqd/119:27:211
27017993226,4cyclictest25-21ksoftirqd/100:35:551
27017993226,3cyclictest25-21ksoftirqd/123:46:231
2701699329,21cyclictest7627-21ptp4l21:50:270
2701699329,21cyclictest20997-21fschecks_count22:20:160
2701699329,20cyclictest31256-21sed20:25:200
27016993227,3cyclictest9-21ksoftirqd/023:35:080
27016993227,3cyclictest9-21ksoftirqd/022:29:250
27016993227,3cyclictest9-21ksoftirqd/021:34:290
27016993227,3cyclictest9-21ksoftirqd/019:48:040
27016993226,4cyclictest9-21ksoftirqd/023:30:590
27016993226,4cyclictest9-21ksoftirqd/022:45:580
27016993226,4cyclictest9-21ksoftirqd/000:36:140
27016993226,4cyclictest9-21ksoftirqd/000:29:080
27016993225,5cyclictest9-21ksoftirqd/019:15:290
27016993211,19cyclictest22285-21sh21:15:140
27016993210,19cyclictest1317-21runrttasks21:57:270
2701899317,23cyclictest4727-21kworker/2:121:44:572
27018993125,4cyclictest33-21ksoftirqd/223:38:152
27018993125,3cyclictest33-21ksoftirqd/219:11:242
27018993125,3cyclictest33-21ksoftirqd/219:11:232
27017993126,3cyclictest25-21ksoftirqd/123:12:311
27017993126,3cyclictest25-21ksoftirqd/119:18:531
27017993125,4cyclictest25-21ksoftirqd/122:59:351
27017993125,4cyclictest25-21ksoftirqd/122:59:351
2701699319,20cyclictest14786-21rt-features22:05:220
2701699319,19cyclictest17484-21expr21:05:150
2701699318,20cyclictest3954-21open_files20:35:220
27016993126,3cyclictest9-21ksoftirqd/020:22:520
27016993125,4cyclictest9-21ksoftirqd/022:51:430
27016993125,4cyclictest9-21ksoftirqd/021:47:130
27016993125,4cyclictest9-21ksoftirqd/020:56:230
27016993125,4cyclictest9-21ksoftirqd/020:01:310
2701899303,26cyclictest4727-21kworker/2:121:23:212
27018993025,3cyclictest33-21ksoftirqd/222:16:192
27018993025,3cyclictest33-21ksoftirqd/220:37:042
27018993025,3cyclictest33-21ksoftirqd/219:20:452
27018993025,3cyclictest33-21ksoftirqd/200:20:132
27018993025,3cyclictest33-21ksoftirqd/200:10:142
27018993024,4cyclictest33-21ksoftirqd/222:39:022
27018993024,4cyclictest33-21ksoftirqd/219:55:182
27018993024,4cyclictest33-21ksoftirqd/219:55:182
27018993024,3cyclictest33-21ksoftirqd/220:10:052
27018993024,3cyclictest28693-21latency_hist23:45:002
27018993024,3cyclictest12038-21cron20:55:012
27018993014,3cyclictest30539-21fschecks_count22:40:172
27017993024,4cyclictest25-21ksoftirqd/121:09:551
27017993024,4cyclictest25-21ksoftirqd/100:03:251
2701699308,3cyclictest5833-21latency_hist00:05:000
2701699308,3cyclictest3196-21tr19:25:250
2701699308,3cyclictest24701-21switchtime20:10:260
27016993025,3cyclictest9-21ksoftirqd/022:18:130
27016993025,3cyclictest9-21ksoftirqd/019:22:030
27016993025,3cyclictest9-21ksoftirqd/000:12:190
27016993023,4cyclictest9-21ksoftirqd/000:05:360
2701899296,12cyclictest25613-21kworker/2:020:30:042
2701899295,22cyclictest4727-21kworker/2:121:47:052
27018992924,3cyclictest33-21ksoftirqd/219:33:272
27018992923,4cyclictest33-21ksoftirqd/221:27:212
2701899292,26cyclictest5299-21kworker/2:119:28:062
2701899291,26cyclictest25613-21kworker/2:020:20:572
2701899291,25cyclictest18050-21kworker/2:220:00:062
2701899291,18cyclictest26737-21kworker/2:223:56:322
2701699299,18cyclictest1317-21runrttasks20:16:080
2701699297,3cyclictest7650-21df_abs23:00:150
2701699295,4cyclictest13126-21latency_hist00:20:000
27016992923,4cyclictest9-21ksoftirqd/023:44:030
27016992923,4cyclictest9-21ksoftirqd/021:12:470
27016992922,5cyclictest9-21ksoftirqd/019:56:560
27016992922,5cyclictest9-21ksoftirqd/019:56:560
2701899288,19cyclictest8021-21kworker/2:123:13:482
27018992823,3cyclictest33-21ksoftirqd/219:15:392
2701899282,25cyclictest4727-21kworker/2:121:59:092
2701899281,25cyclictest4727-21kworker/2:121:50:062
27017992823,3cyclictest25-21ksoftirqd/121:16:041
27017992821,4cyclictest31890-21vmstat22:40:281
2701699288,3cyclictest25724-21processes21:20:250
2701699281,6cyclictest7552-21apt-get20:45:110
2701899271,25cyclictest25613-21kworker/2:020:27:172
27017992722,3cyclictest25-21ksoftirqd/120:37:501
27017992722,3cyclictest25-21ksoftirqd/119:20:311
27017992722,3cyclictest25-21ksoftirqd/119:12:101
27017992722,3cyclictest25-21ksoftirqd/119:12:101
27018992621,3cyclictest33-21ksoftirqd/200:35:202
27017992621,3cyclictest25-21ksoftirqd/122:39:521
27017992621,3cyclictest25-21ksoftirqd/121:35:001
27018992520,3cyclictest33-21ksoftirqd/200:29:382
27017992520,3cyclictest25-21ksoftirqd/120:40:141
27017992520,3cyclictest25-21ksoftirqd/120:26:391
27017992419,3cyclictest25-21ksoftirqd/121:55:121
27017992419,3cyclictest25-21ksoftirqd/100:25:401
27017992418,3cyclictest25-21ksoftirqd/122:10:431
27018992318,3cyclictest33-21ksoftirqd/222:24:252
27017992116,3cyclictest25-21ksoftirqd/123:51:241
27017992115,4cyclictest25-21ksoftirqd/100:33:131
27017991914,3cyclictest23084-21sendmail_mailst23:30:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional