You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 15:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot2.osadl.org (updated Mon Mar 16, 2026 12:45:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
139591232166,23phc2sys0-21swapper/307:09:143
292482207174,22sleep20-21swapper/207:06:402
294412204170,23sleep00-21swapper/007:09:110
292152202169,22sleep10-21swapper/107:06:161
1392911250,1ptp4l26605-21if_enp4s008:10:183
2980199656,16cyclictest23003-21date12:35:000
2980299640,3cyclictest1557-21seq09:33:561
217862620,2sleep30-21swapper/308:00:163
2980199605,17cyclictest1199-21cat10:40:170
2980199596,20cyclictest27406-21cat09:20:140
2980199595,15cyclictest16403-21cat10:05:140
29804995832,5cyclictest41-21ksoftirqd/311:55:263
139291550,1ptp4l401ktimersoftd/309:24:303
29804995424,2cyclictest41-21ksoftirqd/308:35:173
29804995416,3cyclictest41-21ksoftirqd/308:30:143
29804995322,4cyclictest41-21ksoftirqd/309:05:013
139291530,1ptp4l401ktimersoftd/310:11:093
139291520,0ptp4l401ktimersoftd/312:31:123
29804995022,7cyclictest41-21ksoftirqd/312:25:123
29804995022,7cyclictest41-21ksoftirqd/307:45:253
2980199507,16cyclictest3075-21tr11:50:230
2980199506,17cyclictest6690-21/usr/sbin/munin09:45:280
2980199504,15cyclictest1312-21snmpd08:26:170
102942500,3sleep0111rcuc/012:05:250
29804994918,7cyclictest41-21ksoftirqd/310:35:003
29804994918,7cyclictest41-21ksoftirqd/309:15:003
182592490,1sleep30-21swapper/312:25:013
29804994816,4cyclictest41-21ksoftirqd/311:20:173
29804994811,8cyclictest41-21ksoftirqd/310:35:213
29804994733,10cyclictest41-21ksoftirqd/309:15:253
29804994718,4cyclictest41-21ksoftirqd/309:50:263
29804994718,4cyclictest41-21ksoftirqd/309:45:133
29804994717,7cyclictest41-21ksoftirqd/311:10:003
29804994717,7cyclictest41-21ksoftirqd/308:55:183
29804994714,4cyclictest41-21ksoftirqd/307:10:233
29804994711,4cyclictest41-21ksoftirqd/307:40:253
29804994614,4cyclictest41-21ksoftirqd/307:50:133
29804994614,3cyclictest41-21ksoftirqd/310:25:023
29804994610,4cyclictest41-21ksoftirqd/307:15:133
29802994641,3cyclictest19485-21grep11:20:001
29804994518,7cyclictest41-21ksoftirqd/312:15:003
29804994518,4cyclictest41-21ksoftirqd/310:53:333
29804994517,7cyclictest41-21ksoftirqd/310:05:273
29804994516,4cyclictest41-21ksoftirqd/308:50:283
29804994511,4cyclictest41-21ksoftirqd/307:35:253
139291450,1ptp4l401ktimersoftd/308:29:233
29804994439,3cyclictest41-21ksoftirqd/309:29:593
29804994416,7cyclictest41-21ksoftirqd/308:40:183
29804994415,4cyclictest41-21ksoftirqd/310:25:193
29804994412,3cyclictest41-21ksoftirqd/309:35:243
29804994411,10cyclictest41-21ksoftirqd/308:20:103
29802994413,17cyclictest27447-21awk10:25:271
2980199446,17cyclictest0-21swapper/008:10:260
2980199445,13cyclictest31288-21hddtemp_smartct08:20:160
139291440,1ptp4l401ktimersoftd/311:48:333
2980499437,8cyclictest41-21ksoftirqd/310:00:193
29804994332,3cyclictest41-21ksoftirqd/307:29:593
29804994315,3cyclictest41-21ksoftirqd/311:10:253
29804994313,7cyclictest41-21ksoftirqd/311:40:163
29804994311,5cyclictest41-21ksoftirqd/311:35:193
29804994311,5cyclictest41-21ksoftirqd/311:35:193
2980299437,19cyclictest6263-21seq09:42:361
2980199435,12cyclictest19224-21df_inode07:55:140
29804994234,3cyclictest41-21ksoftirqd/307:55:123
29804994230,9cyclictest41-21ksoftirqd/311:25:253
29804994210,7cyclictest41-21ksoftirqd/307:20:233
29804994135,3cyclictest41-21ksoftirqd/308:15:283
29804994115,6cyclictest41-21ksoftirqd/310:40:203
29804994114,7cyclictest41-21ksoftirqd/309:40:153
29804994113,4cyclictest41-21ksoftirqd/310:55:083
29804994113,4cyclictest41-21ksoftirqd/310:18:013
29804994113,3cyclictest41-21ksoftirqd/308:06:473
29804994113,3cyclictest41-21ksoftirqd/308:06:473
29804994112,3cyclictest41-21ksoftirqd/312:09:023
2980499410,3cyclictest121rcu_preempt11:00:193
139291410,0ptp4l401ktimersoftd/310:47:523
41298400,1rtkit-daemon0-21swapper/311:51:073
2980499407,9cyclictest41-21ksoftirqd/309:55:253
29804994035,3cyclictest41-21ksoftirqd/308:45:233
29804994016,7cyclictest41-21ksoftirqd/311:15:133
29804994014,6cyclictest41-21ksoftirqd/312:35:243
29804994014,6cyclictest41-21ksoftirqd/312:35:243
2980299404,21cyclictest9988-21seq07:35:181
2980199404,10cyclictest0-21swapper/010:45:200
29804993934,3cyclictest41-21ksoftirqd/309:30:203
29804993933,3cyclictest41-21ksoftirqd/311:30:263
2980499387,3cyclictest41-21ksoftirqd/309:05:243
29804993832,3cyclictest41-21ksoftirqd/312:15:143
29804993810,7cyclictest41-21ksoftirqd/312:00:133
2980199386,11cyclictest12058-21timerandwakeup08:45:270
29803993731,4cyclictest33-21ksoftirqd/211:58:562
29803993731,4cyclictest33-21ksoftirqd/210:39:092
29803993731,4cyclictest33-21ksoftirqd/208:57:282
29803993731,4cyclictest33-21ksoftirqd/208:22:462
29803993730,4cyclictest33-21ksoftirqd/210:33:562
29803993730,4cyclictest33-21ksoftirqd/208:05:422
29803993730,4cyclictest33-21ksoftirqd/208:05:422
2980299372,22cyclictest0-21swapper/112:19:331
29804993633,2cyclictest41-21ksoftirqd/307:30:123
29804993633,2cyclictest41-21ksoftirqd/307:30:123
29803993631,3cyclictest33-21ksoftirqd/211:50:542
29803993630,4cyclictest33-21ksoftirqd/210:57:382
29803993630,4cyclictest33-21ksoftirqd/209:44:372
29803993630,4cyclictest33-21ksoftirqd/207:56:262
29802993631,3cyclictest25-21ksoftirqd/111:32:281
29802993631,3cyclictest25-21ksoftirqd/108:20:201
29802993630,4cyclictest25-21ksoftirqd/110:45:501
29802993630,4cyclictest25-21ksoftirqd/110:18:261
29802993630,4cyclictest25-21ksoftirqd/109:52:021
29802993630,4cyclictest25-21ksoftirqd/107:29:051
2980199365,11cyclictest15114-21ps10:00:240
29801993629,4cyclictest9-21ksoftirqd/012:23:290
29801993629,4cyclictest9-21ksoftirqd/011:05:120
29803993530,3cyclictest33-21ksoftirqd/210:23:082
29803993530,3cyclictest33-21ksoftirqd/209:33:552
29803993529,4cyclictest33-21ksoftirqd/210:18:592
29803993529,4cyclictest33-21ksoftirqd/209:51:512
29803993529,3cyclictest33-21ksoftirqd/209:35:112
29802993530,3cyclictest25-21ksoftirqd/107:21:271
29802993529,4cyclictest25-21ksoftirqd/110:50:471
29802993529,4cyclictest25-21ksoftirqd/109:19:211
29802993529,4cyclictest25-21ksoftirqd/107:12:521
29802993528,4cyclictest25-21ksoftirqd/109:39:431
2980199355,9cyclictest0-21swapper/007:15:140
29801993530,3cyclictest9-21ksoftirqd/010:35:090
29801993529,4cyclictest9-21ksoftirqd/010:28:120
29801993529,4cyclictest9-21ksoftirqd/009:03:030
29801993528,4cyclictest9-21ksoftirqd/008:53:120
29803993429,3cyclictest33-21ksoftirqd/210:07:482
29803993429,3cyclictest33-21ksoftirqd/208:51:042
29803993428,4cyclictest33-21ksoftirqd/212:26:402
29803993428,4cyclictest33-21ksoftirqd/210:52:422
29803993428,4cyclictest33-21ksoftirqd/210:41:382
29803993428,4cyclictest33-21ksoftirqd/208:32:392
29803993428,4cyclictest33-21ksoftirqd/207:21:412
29803993428,3cyclictest33-21ksoftirqd/208:46:152
2980299345,18cyclictest9627-21runrttasks10:55:411
29802993429,3cyclictest32605-21fschecks_count07:15:141
29802993429,3cyclictest25-21ksoftirqd/112:26:431
29802993429,3cyclictest25-21ksoftirqd/111:59:151
29802993429,3cyclictest25-21ksoftirqd/109:29:591
29802993429,3cyclictest25-21ksoftirqd/108:13:301
29802993428,4cyclictest25-21ksoftirqd/111:50:291
29802993428,4cyclictest25-21ksoftirqd/111:36:091
29802993428,4cyclictest25-21ksoftirqd/111:36:091
29802993428,4cyclictest25-21ksoftirqd/110:14:371
29802993428,4cyclictest25-21ksoftirqd/110:05:021
29802993428,4cyclictest25-21ksoftirqd/109:47:381
29802993428,4cyclictest25-21ksoftirqd/109:06:581
29801993429,3cyclictest9-21ksoftirqd/010:32:340
29801993429,3cyclictest9-21ksoftirqd/009:40:110
29801993428,4cyclictest9-21ksoftirqd/012:18:120
29801993428,4cyclictest9-21ksoftirqd/012:03:400
29801993428,4cyclictest9-21ksoftirqd/009:31:490
29801993428,4cyclictest9-21ksoftirqd/009:11:500
29801993428,4cyclictest9-21ksoftirqd/007:12:520
29803993328,3cyclictest33-21ksoftirqd/212:08:132
29803993328,3cyclictest33-21ksoftirqd/211:47:342
29803993328,3cyclictest33-21ksoftirqd/211:08:372
29803993328,3cyclictest33-21ksoftirqd/211:02:522
29803993328,3cyclictest33-21ksoftirqd/210:03:042
29803993326,5cyclictest33-21ksoftirqd/210:48:062
29803993322,9cyclictest33-21ksoftirqd/209:08:232
29802993327,4cyclictest25-21ksoftirqd/112:14:281
29802993327,4cyclictest25-21ksoftirqd/112:08:261
29802993327,4cyclictest25-21ksoftirqd/111:48:481
29802993327,4cyclictest25-21ksoftirqd/111:20:401
29802993327,4cyclictest25-21ksoftirqd/110:35:351
29802993327,4cyclictest25-21ksoftirqd/109:58:321
29802993327,4cyclictest25-21ksoftirqd/108:56:071
29802993327,4cyclictest25-21ksoftirqd/108:43:431
29802993327,4cyclictest25-21ksoftirqd/107:49:161
2980199336,16cyclictest24776-21/usr/sbin/munin09:15:190
2980199334,9cyclictest0-21swapper/010:10:210
2980199333,21cyclictest0-21swapper/009:25:120
29801993328,3cyclictest9-21ksoftirqd/007:20:360
29801993327,4cyclictest9-21ksoftirqd/012:36:410
29801993327,4cyclictest9-21ksoftirqd/012:36:410
29801993327,4cyclictest9-21ksoftirqd/012:26:140
29801993327,4cyclictest9-21ksoftirqd/011:22:040
29801993327,4cyclictest9-21ksoftirqd/011:13:450
29801993327,4cyclictest9-21ksoftirqd/008:33:470
29801993327,4cyclictest9-21ksoftirqd/008:05:110
29801993327,4cyclictest9-21ksoftirqd/008:05:110
29801993327,4cyclictest9-21ksoftirqd/007:25:320
29803993227,3cyclictest33-21ksoftirqd/212:37:562
29803993227,3cyclictest33-21ksoftirqd/212:37:562
29803993227,3cyclictest33-21ksoftirqd/211:30:102
29803993227,3cyclictest33-21ksoftirqd/207:36:132
29803993227,3cyclictest33-21ksoftirqd/207:26:222
29803993227,3cyclictest33-21ksoftirqd/207:11:162
29803993226,4cyclictest33-21ksoftirqd/211:16:162
29803993226,4cyclictest33-21ksoftirqd/209:25:052
29803993226,4cyclictest33-21ksoftirqd/209:00:412
29803993226,4cyclictest33-21ksoftirqd/208:36:352
29802993227,3cyclictest25-21ksoftirqd/112:34:411
29802993227,3cyclictest25-21ksoftirqd/108:45:501
29802993227,3cyclictest25-21ksoftirqd/108:35:001
29802993226,4cyclictest25-21ksoftirqd/110:44:021
29802993226,4cyclictest25-21ksoftirqd/110:00:571
29802993226,4cyclictest25-21ksoftirqd/109:03:541
29802993226,4cyclictest25-21ksoftirqd/107:30:581
29802993226,4cyclictest25-21ksoftirqd/107:30:581
2980299321,30cyclictest0-21swapper/107:52:461
2980199327,10cyclictest16442-21phc2sys08:55:210
2980199326,16cyclictest20987-21/usr/sbin/munin10:15:100
29801993228,3cyclictest9-21ksoftirqd/011:00:340
29801993227,3cyclictest9-21ksoftirqd/011:18:220
29801993227,3cyclictest9-21ksoftirqd/009:55:510
29801993227,3cyclictest9-21ksoftirqd/009:50:170
29801993226,4cyclictest9-21ksoftirqd/010:51:360
29801993226,4cyclictest9-21ksoftirqd/007:31:220
29801993226,4cyclictest9-21ksoftirqd/007:31:220
297082320,2sleep20-21swapper/208:15:232
29803993125,4cyclictest33-21ksoftirqd/211:39:362
29803993125,4cyclictest33-21ksoftirqd/211:39:362
29803993125,4cyclictest33-21ksoftirqd/210:14:222
29803993125,4cyclictest33-21ksoftirqd/209:58:102
29803993125,4cyclictest33-21ksoftirqd/209:46:262
29803993125,4cyclictest33-21ksoftirqd/208:11:592
29802993126,3cyclictest25-21ksoftirqd/111:02:461
29802993126,3cyclictest25-21ksoftirqd/110:22:311
29802993126,3cyclictest25-21ksoftirqd/109:11:021
29802993125,4cyclictest25-21ksoftirqd/108:09:171
29802993125,4cyclictest25-21ksoftirqd/108:09:171
2980199316,16cyclictest12223-21missed_timers12:10:210
29801993126,3cyclictest9-21ksoftirqd/007:50:140
29801993125,4cyclictest9-21ksoftirqd/011:39:300
29801993125,4cyclictest9-21ksoftirqd/011:39:290
29801993125,4cyclictest9-21ksoftirqd/008:04:430
29803993025,3cyclictest33-21ksoftirqd/212:32:102
29803993025,3cyclictest33-21ksoftirqd/212:17:122
29803993025,3cyclictest33-21ksoftirqd/207:50:362
29803993025,3cyclictest33-21ksoftirqd/207:31:542
29803993025,3cyclictest33-21ksoftirqd/207:31:542
29803993024,4cyclictest33-21ksoftirqd/211:42:452
29803993023,4cyclictest33-21ksoftirqd/212:01:232
29802993025,3cyclictest25-21ksoftirqd/112:02:031
29802993025,3cyclictest25-21ksoftirqd/111:44:591
29802993025,3cyclictest25-21ksoftirqd/108:01:371
29802993025,3cyclictest25-21ksoftirqd/107:55:091
29802993014,14cyclictest30153-21vmstat08:15:281
29801993025,3cyclictest9-21ksoftirqd/008:40:010
29801993025,3cyclictest9-21ksoftirqd/008:17:540
29803992924,3cyclictest33-21ksoftirqd/209:19:312
29803992923,3cyclictest33-21ksoftirqd/211:11:532
2980299296,20cyclictest23298-21expr12:35:131
2980299296,20cyclictest23298-21expr12:35:131
29802992923,4cyclictest25-21ksoftirqd/111:29:471
29802992911,15cyclictest6029-21expr08:35:121
2980299290,3cyclictest12140-21/usr/sbin/munin07:40:171
29801992924,3cyclictest9-21ksoftirqd/010:22:100
29801992923,4cyclictest9-21ksoftirqd/011:58:300
29801992923,4cyclictest9-21ksoftirqd/007:42:080
29803992823,3cyclictest33-21ksoftirqd/210:29:592
29803992823,3cyclictest33-21ksoftirqd/209:24:412
29803992823,3cyclictest33-21ksoftirqd/207:47:292
29803992823,3cyclictest33-21ksoftirqd/207:15:132
29802992823,3cyclictest25-21ksoftirqd/110:34:471
29802992823,3cyclictest25-21ksoftirqd/109:23:131
29802992812,14cyclictest13531-21irqstats11:05:191
2980299280,4cyclictest13382-21hddtemp_smartct08:50:161
2980299280,3cyclictest17341-21python12:20:241
2980299280,3cyclictest16352-21grep11:10:241
29801992823,3cyclictest9-21ksoftirqd/009:39:500
29801992822,4cyclictest9-21ksoftirqd/011:50:010
29803992722,3cyclictest33-21ksoftirqd/212:14:092
29803992721,4cyclictest33-21ksoftirqd/211:22:502
2980299272,20cyclictest0-21swapper/108:25:131
29801992723,3cyclictest9-21ksoftirqd/011:30:530
29803992620,4cyclictest33-21ksoftirqd/207:41:222
29801992621,3cyclictest9-21ksoftirqd/010:56:480
29801992620,4cyclictest9-21ksoftirqd/007:38:560
29803992520,3cyclictest33-21ksoftirqd/211:25:122
2980199255,7cyclictest29866-21if_enp1s011:40:190
2980199252,10cyclictest0-21swapper/011:26:330
29801992519,4cyclictest9-21ksoftirqd/007:47:130
29803992318,3cyclictest33-21ksoftirqd/209:12:062
29801992311,9cyclictest10297-21perf08:45:010
29803992217,3cyclictest33-21ksoftirqd/212:24:232
29801992217,3cyclictest9-21ksoftirqd/009:09:430
29803992013,4cyclictest9262-21cut08:40:222
29803991813,3cyclictest717-21/usr/sbin/munin08:25:152
29803991813,3cyclictest21269-21/usr/sbin/munin08:00:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional