You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 11:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot3.osadl.org (updated Fri Dec 12, 2025 00:45:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137191207142,53phc2sys0-21swapper/319:07:523
203592203169,22sleep20-21swapper/219:07:152
184422202167,24sleep00-21swapper/019:05:080
202852199166,22sleep10-21swapper/119:06:211
680821150,2sleep00-21swapper/000:15:180
2087099731,70cyclictest13547-21kworker/2:100:30:272
20870996212,33cyclictest17297-21kworker/2:020:45:272
2087099613,56cyclictest17747-21kworker/2:122:35:472
281802520,2sleep00-21swapper/022:45:160
199542500,4sleep00-21swapper/020:15:000
20871994437,4cyclictest11661-21idleruntime-cro21:04:593
20870994313,28cyclictest0-21swapper/200:03:362
2087099422,38cyclictest17747-21kworker/2:122:31:072
136991420,0ptp4l401ktimersoftd/319:45:033
20870994112,27cyclictest0-21swapper/221:20:362
136991410,0ptp4l401ktimersoftd/319:40:173
136991410,0ptp4l401ktimersoftd/300:05:553
2087099402,36cyclictest25986-21kworker/2:223:22:272
20870994011,27cyclictest0-21swapper/222:40:062
2087099393,17cyclictest854-21latency_hist21:50:012
2087099392,35cyclictest13547-21kworker/2:123:49:512
2087099383,34cyclictest13547-21kworker/2:123:53:232
20870993832,4cyclictest33-21ksoftirqd/223:18:452
2087099383,17cyclictest421-21cat19:35:002
2087099382,35cyclictest13547-21kworker/2:123:36:032
2087099382,34cyclictest13547-21kworker/2:123:41:152
20870993815,21cyclictest0-21swapper/222:20:072
2087099381,35cyclictest25986-21kworker/2:223:27:152
20869993831,4cyclictest25-21ksoftirqd/100:10:011
20870993731,4cyclictest33-21ksoftirqd/222:04:502
20870993730,4cyclictest33-21ksoftirqd/219:22:032
2087099372,24cyclictest17297-21kworker/2:020:33:442
2087099371,35cyclictest13547-21kworker/2:123:57:112
20868993732,3cyclictest9-21ksoftirqd/019:20:010
136991370,0ptp4l401ktimersoftd/323:20:153
136991370,0ptp4l401ktimersoftd/321:45:203
20871993631,3cyclictest22574-21cron22:34:593
20870993630,4cyclictest33-21ksoftirqd/222:16:222
2087099362,24cyclictest17297-21kworker/2:021:13:522
2087099362,24cyclictest17297-21kworker/2:021:02:162
2087099362,24cyclictest17297-21kworker/2:020:51:192
2087099362,23cyclictest17297-21kworker/2:021:05:042
2087099362,17cyclictest15246-21cat20:05:012
2087099362,14cyclictest13547-21kworker/2:100:37:232
2087099361,33cyclictest13547-21kworker/2:123:32:232
20869993630,3cyclictest25-21ksoftirqd/120:20:041
136991360,0ptp4l401ktimersoftd/322:55:213
136991360,0ptp4l401ktimersoftd/319:20:013
20871993529,4cyclictest41-21ksoftirqd/323:08:303
20871993529,4cyclictest41-21ksoftirqd/320:04:093
20870993530,3cyclictest33-21ksoftirqd/222:07:312
20870993530,3cyclictest33-21ksoftirqd/222:07:312
20870993529,4cyclictest33-21ksoftirqd/223:10:372
20870993529,4cyclictest33-21ksoftirqd/223:09:052
20870993529,4cyclictest33-21ksoftirqd/220:41:512
20870993529,4cyclictest33-21ksoftirqd/220:38:022
2087099352,24cyclictest17297-21kworker/2:020:59:512
2087099352,23cyclictest17297-21kworker/2:020:27:162
20870993514,3cyclictest11175-21/usr/sbin/munin00:25:182
2087099351,33cyclictest13547-21kworker/2:100:24:432
20870993513,20cyclictest0-21swapper/222:57:362
20869993530,3cyclictest28503-21awk21:40:011
20869993530,3cyclictest28503-21awk21:40:001
20869993529,4cyclictest25-21ksoftirqd/122:56:011
20869993529,4cyclictest25-21ksoftirqd/121:04:081
20869993529,4cyclictest25-21ksoftirqd/119:27:161
20869993528,4cyclictest25-21ksoftirqd/121:45:121
2086999351,30cyclictest4802-21ls19:40:271
20868993529,4cyclictest9-21ksoftirqd/020:36:110
20868993529,4cyclictest9-21ksoftirqd/020:06:020
20868993529,4cyclictest9-21ksoftirqd/000:34:360
136991350,0ptp4l401ktimersoftd/300:30:223
136991350,0ptp4l401ktimersoftd/300:10:143
20871993428,4cyclictest41-21ksoftirqd/323:32:533
20871993428,3cyclictest41-21ksoftirqd/319:30:003
20871993427,5cyclictest41-21ksoftirqd/319:30:553
20870993429,3cyclictest33-21ksoftirqd/219:42:452
20870993428,4cyclictest33-21ksoftirqd/222:53:162
20870993428,4cyclictest33-21ksoftirqd/221:32:162
20870993428,4cyclictest33-21ksoftirqd/219:37:432
20870993428,4cyclictest33-21ksoftirqd/219:25:352
2087099340,24cyclictest9012-21kworker/2:219:59:282
2087099340,24cyclictest17297-21kworker/2:020:15:352
20869993429,3cyclictest25-21ksoftirqd/122:08:301
20869993429,3cyclictest25-21ksoftirqd/122:08:291
20869993429,3cyclictest25-21ksoftirqd/100:00:011
20869993428,4cyclictest25-21ksoftirqd/123:41:451
20869993427,5cyclictest25-21ksoftirqd/121:40:461
20869993427,5cyclictest25-21ksoftirqd/120:10:531
20868993430,2cyclictest9-21ksoftirqd/022:05:340
20868993430,2cyclictest9-21ksoftirqd/022:05:340
20868993428,4cyclictest9-21ksoftirqd/023:18:550
20868993427,5cyclictest9-21ksoftirqd/023:24:520
20868993427,5cyclictest9-21ksoftirqd/000:08:480
137191343,2phc2sys121rcu_preempt22:00:153
20871993327,4cyclictest41-21ksoftirqd/323:58:333
20871993327,4cyclictest41-21ksoftirqd/323:25:393
20871993327,4cyclictest41-21ksoftirqd/322:40:343
20871993327,4cyclictest41-21ksoftirqd/322:07:093
20871993327,4cyclictest41-21ksoftirqd/322:07:083
20871993327,4cyclictest41-21ksoftirqd/300:01:303
20871993326,5cyclictest41-21ksoftirqd/320:59:133
20871993326,5cyclictest41-21ksoftirqd/320:48:303
2087099333,17cyclictest2951-21kworker/2:019:11:512
20870993328,3cyclictest33-21ksoftirqd/220:14:162
20870993327,4cyclictest33-21ksoftirqd/223:03:192
20870993327,4cyclictest33-21ksoftirqd/222:10:412
20870993327,4cyclictest33-21ksoftirqd/219:18:262
20869993327,4cyclictest25-21ksoftirqd/122:43:491
20869993327,4cyclictest25-21ksoftirqd/122:38:471
20869993327,4cyclictest25-21ksoftirqd/122:34:221
20869993327,4cyclictest25-21ksoftirqd/120:50:011
20869993327,4cyclictest25-21ksoftirqd/120:09:321
20869993327,4cyclictest25-21ksoftirqd/100:13:311
20868993328,3cyclictest9-21ksoftirqd/022:56:350
20868993328,3cyclictest23020-21cron19:15:010
20868993327,4cyclictest9-21ksoftirqd/021:20:010
20868993327,4cyclictest9-21ksoftirqd/020:31:460
20868993327,4cyclictest9-21ksoftirqd/020:29:480
20868993327,4cyclictest9-21ksoftirqd/019:57:480
20868993327,4cyclictest9-21ksoftirqd/019:48:210
20868993327,4cyclictest9-21ksoftirqd/000:28:470
20868993326,5cyclictest9-21ksoftirqd/022:42:350
20868993326,4cyclictest9-21ksoftirqd/023:57:010
20871993227,3cyclictest41-21ksoftirqd/320:34:073
20871993227,3cyclictest41-21ksoftirqd/320:27:583
20871993227,3cyclictest41-21ksoftirqd/300:38:303
20871993226,4cyclictest41-21ksoftirqd/323:16:003
20871993226,4cyclictest41-21ksoftirqd/322:49:173
20871993226,4cyclictest41-21ksoftirqd/322:11:333
20871993226,4cyclictest41-21ksoftirqd/321:59:503
20871993226,4cyclictest41-21ksoftirqd/321:07:423
20871993226,4cyclictest41-21ksoftirqd/320:36:373
20871993226,4cyclictest41-21ksoftirqd/319:56:373
20871993226,4cyclictest41-21ksoftirqd/319:52:243
20871993226,4cyclictest41-21ksoftirqd/300:15:413
20870993226,4cyclictest33-21ksoftirqd/221:29:482
20869993226,4cyclictest25-21ksoftirqd/122:19:371
20869993226,4cyclictest25-21ksoftirqd/121:23:101
20869993226,4cyclictest25-21ksoftirqd/121:19:321
20869993226,4cyclictest25-21ksoftirqd/120:33:421
20869993226,4cyclictest25-21ksoftirqd/119:38:351
20869993226,4cyclictest25-21ksoftirqd/119:34:381
20869993225,5cyclictest25-21ksoftirqd/100:02:281
20869993225,4cyclictest25-21ksoftirqd/121:50:251
20868993227,3cyclictest9-21ksoftirqd/019:25:100
20868993226,4cyclictest9-21ksoftirqd/023:09:590
20868993226,4cyclictest9-21ksoftirqd/021:00:410
20868993226,4cyclictest9-21ksoftirqd/019:32:470
20868993226,4cyclictest9-21ksoftirqd/000:13:540
20868993226,4cyclictest9-21ksoftirqd/000:04:110
20868993226,3cyclictest9-21ksoftirqd/023:37:470
136991320,0ptp4l401ktimersoftd/321:40:593
136991320,0ptp4l401ktimersoftd/320:52:343
20871993126,3cyclictest41-21ksoftirqd/319:38:103
20871993125,4cyclictest41-21ksoftirqd/300:27:053
20871993125,3cyclictest41-21ksoftirqd/321:14:113
20871993125,3cyclictest41-21ksoftirqd/319:20:093
2087099313,2cyclictest9012-21kworker/2:219:53:402
20870993126,3cyclictest33-21ksoftirqd/221:37:342
20870993126,3cyclictest33-21ksoftirqd/221:37:332
20869993126,3cyclictest25-21ksoftirqd/123:28:491
20869993126,3cyclictest25-21ksoftirqd/121:57:101
20869993126,3cyclictest25-21ksoftirqd/120:54:001
20869993126,3cyclictest25-21ksoftirqd/120:42:521
20869993126,3cyclictest25-21ksoftirqd/119:57:551
20869993125,4cyclictest25-21ksoftirqd/123:22:441
20869993125,4cyclictest25-21ksoftirqd/122:25:371
20869993125,4cyclictest25-21ksoftirqd/122:22:581
20869993125,4cyclictest25-21ksoftirqd/121:14:461
20869993125,4cyclictest25-21ksoftirqd/120:39:361
20869993125,4cyclictest25-21ksoftirqd/120:02:411
20869993125,4cyclictest25-21ksoftirqd/119:52:141
20869993125,4cyclictest25-21ksoftirqd/119:22:021
20869993125,4cyclictest25-21ksoftirqd/100:30:141
20869993124,5cyclictest25-21ksoftirqd/122:13:191
20868993126,3cyclictest9-21ksoftirqd/022:15:150
20868993125,4cyclictest9-21ksoftirqd/023:52:520
20868993125,4cyclictest9-21ksoftirqd/023:03:010
20868993125,4cyclictest9-21ksoftirqd/021:09:450
20871993024,4cyclictest41-21ksoftirqd/322:19:393
20870993025,3cyclictest33-21ksoftirqd/222:29:242
20870993025,3cyclictest33-21ksoftirqd/221:44:432
20870993025,3cyclictest33-21ksoftirqd/219:45:102
2087099302,18cyclictest17297-21kworker/2:020:09:152
20869993024,4cyclictest25-21ksoftirqd/123:00:501
20869993024,4cyclictest25-21ksoftirqd/122:51:441
20869993024,4cyclictest25-21ksoftirqd/122:00:571
20869993024,4cyclictest25-21ksoftirqd/100:22:241
20868993026,2cyclictest9-21ksoftirqd/023:10:460
20868993025,3cyclictest9-21ksoftirqd/023:31:510
20868993025,3cyclictest9-21ksoftirqd/022:34:530
20868993025,3cyclictest9-21ksoftirqd/022:24:340
20868993025,3cyclictest9-21ksoftirqd/021:50:160
20868993025,3cyclictest9-21ksoftirqd/021:22:410
20868993025,3cyclictest9-21ksoftirqd/020:47:270
20868993025,3cyclictest9-21ksoftirqd/019:38:570
20868993024,4cyclictest9-21ksoftirqd/023:29:530
20868993024,4cyclictest9-21ksoftirqd/021:42:060
20868993024,4cyclictest9-21ksoftirqd/021:31:420
20868993024,4cyclictest9-21ksoftirqd/021:25:040
20868993023,5cyclictest9-21ksoftirqd/020:42:530
136991300,10ptp4l401ktimersoftd/323:42:313
136991300,0ptp4l401ktimersoftd/323:52:013
136991300,0ptp4l401ktimersoftd/320:18:003
136991300,0ptp4l401ktimersoftd/320:05:183
20871992924,3cyclictest41-21ksoftirqd/323:00:163
20871992923,4cyclictest41-21ksoftirqd/323:46:583
20871992923,3cyclictest41-21ksoftirqd/320:10:123
20871992922,4cyclictest41-21ksoftirqd/321:29:583
20871992922,4cyclictest41-21ksoftirqd/320:20:453
20871992920,4cyclictest41-21ksoftirqd/323:10:153
2087099293,24cyclictest17297-21kworker/2:021:18:042
20870992924,3cyclictest33-21ksoftirqd/221:56:352
20870992924,3cyclictest33-21ksoftirqd/200:10:562
20870992923,4cyclictest33-21ksoftirqd/221:54:362
20869992924,3cyclictest25-21ksoftirqd/123:12:131
20869992923,4cyclictest25-21ksoftirqd/123:30:061
20869992923,4cyclictest25-21ksoftirqd/123:06:071
20869992915,13cyclictest18011-21kworker/1:221:25:281
20868992924,3cyclictest9-21ksoftirqd/020:59:290
20868992924,3cyclictest9-21ksoftirqd/020:02:410
20868992924,3cyclictest9-21ksoftirqd/000:39:050
20868992923,4cyclictest9-21ksoftirqd/021:45:310
136991290,9ptp4l0-21swapper/322:27:163
20871992823,3cyclictest41-21ksoftirqd/323:36:183
20871992823,3cyclictest41-21ksoftirqd/322:54:433
20871992822,3cyclictest41-21ksoftirqd/321:24:013
20871992821,5cyclictest41-21ksoftirqd/300:21:393
20870992823,3cyclictest33-21ksoftirqd/200:07:302
20870992822,4cyclictest33-21ksoftirqd/220:20:392
20869992823,3cyclictest25-21ksoftirqd/123:38:561
20869992823,3cyclictest25-21ksoftirqd/122:47:281
20869992822,4cyclictest25-21ksoftirqd/120:56:461
20869992822,4cyclictest25-21ksoftirqd/120:27:141
20869992822,4cyclictest25-21ksoftirqd/100:19:531
20868992822,4cyclictest9-21ksoftirqd/021:11:170
20871992722,3cyclictest41-21ksoftirqd/321:51:423
20869992722,3cyclictest25-21ksoftirqd/123:51:011
20869992722,3cyclictest25-21ksoftirqd/119:17:271
20869992721,4cyclictest25-21ksoftirqd/121:06:401
20869992720,4cyclictest25-21ksoftirqd/100:39:101
20868992721,4cyclictest9-21ksoftirqd/019:51:140
20871992621,3cyclictest41-21ksoftirqd/321:36:273
20871992621,3cyclictest41-21ksoftirqd/321:36:263
20871992621,3cyclictest41-21ksoftirqd/320:43:083
20871992620,4cyclictest41-21ksoftirqd/322:36:293
20869992621,3cyclictest25-21ksoftirqd/120:16:381
20869992620,4cyclictest25-21ksoftirqd/119:11:341
20868992621,3cyclictest9-21ksoftirqd/023:48:360
20868992621,3cyclictest9-21ksoftirqd/000:23:410
20868992620,4cyclictest9-21ksoftirqd/021:39:160
20868992620,4cyclictest9-21ksoftirqd/021:39:160
20868992620,4cyclictest9-21ksoftirqd/020:24:590
20871992520,3cyclictest41-21ksoftirqd/321:16:523
20871992520,3cyclictest41-21ksoftirqd/319:10:113
20868992520,3cyclictest9-21ksoftirqd/023:42:270
20868992520,3cyclictest9-21ksoftirqd/020:19:040
20868992519,4cyclictest9-21ksoftirqd/021:55:460
136991250,0ptp4l401ktimersoftd/322:20:123
20868992419,3cyclictest9-21ksoftirqd/022:04:040
20870992318,3cyclictest33-21ksoftirqd/222:48:472
20870992318,3cyclictest33-21ksoftirqd/200:16:002
20869992319,3cyclictest25-21ksoftirqd/119:47:261
20869992318,3cyclictest25-21ksoftirqd/123:19:451
20868992319,2cyclictest9-21ksoftirqd/022:25:200
20868992317,4cyclictest9-21ksoftirqd/019:43:260
136991230,0ptp4l401ktimersoftd/321:30:153
20869992217,3cyclictest25-21ksoftirqd/121:33:121
20869992116,3cyclictest25-21ksoftirqd/123:48:361
20869991916,2cyclictest0-21swapper/100:25:571
20868991914,3cyclictest27417-21timerandwakeup19:20:280
20868991913,4cyclictest5345-21cat20:50:190
20868991813,3cyclictest29946-21/usr/sbin/munin22:50:210
20868991813,3cyclictest22808-21/usr/sbin/munin22:35:170
20868991813,3cyclictest10925-21/usr/sbin/munin22:10:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional