You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 19:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Mon Mar 16, 2026 12:45:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
139491229163,22phc2sys0-21swapper/307:06:193
92752206173,22sleep10-21swapper/107:07:251
92182206141,22sleep00-21swapper/007:06:380
94162205171,23sleep20-21swapper/207:09:142
1696221630,6sleep1977999cyclictest08:30:191
2749421420,6sleep2978099cyclictest07:45:192
2006221400,5sleep0977899cyclictest10:50:270
948627055,7sleep00-21swapper/007:10:000
70082610,6sleep0101ktimersoftd/011:30:260
977999555,18cyclictest5240-21sed10:20:261
238492530,3sleep223850-21latency_hist09:55:012
284832520,1sleep30-21swapper/312:15:263
9779995044,3cyclictest32687-21dump-pmu-power11:20:001
977999492,9cyclictest26901-21ssh08:50:251
977999491,45cyclictest0-21swapper/107:50:241
978099481,45cyclictest0-21swapper/208:10:242
977999483,9cyclictest4099-21/usr/sbin/munin12:35:141
977999483,8cyclictest15214-21df_inode11:50:141
977999482,9cyclictest887-21cat12:25:251
977999472,16cyclictest14450-21cut08:25:191
9780994640,3cyclictest13304-21idleruntime-cro08:25:012
977999453,8cyclictest4020-21python09:10:241
977999453,8cyclictest4020-21python09:10:241
977999453,7cyclictest18305-21mailstats07:25:241
9780994432,10cyclictest33-21ksoftirqd/212:00:152
977999443,7cyclictest22530-21users10:55:261
977999441,7cyclictest26344-21apt-get10:00:111
977999441,7cyclictest24605-21ls08:45:271
139391440,0ptp4l401ktimersoftd/307:48:153
9780994329,10cyclictest33-21ksoftirqd/209:15:252
977999434,8cyclictest9429-21iostat_ios08:15:171
977999433,8cyclictest23093-21irqstats12:05:181
977999432,8cyclictest30125-21python10:05:241
977999432,8cyclictest29108-21sendmail_mailqu08:55:231
978099423,3cyclictest121rcu_preempt09:10:132
978099423,3cyclictest121rcu_preempt09:10:132
977999423,8cyclictest8213-21hddtemp_smartct11:35:161
977999423,8cyclictest19198-21irqstats08:35:171
977999423,7cyclictest5610-21iostat09:15:171
977999423,7cyclictest19647-21fschecks_count09:45:161
977999422,8cyclictest30798-21iostat09:00:171
977999422,8cyclictest21420-21apt-get07:35:021
977999422,7cyclictest17459-21mailstats10:45:241
977999422,14cyclictest18424-21apt-get10:50:131
139391420,0ptp4l401ktimersoftd/308:30:543
978099417,5cyclictest33-21ksoftirqd/209:45:002
978099417,5cyclictest33-21ksoftirqd/209:45:002
9780994136,3cyclictest32287-21cron09:05:002
9780994112,6cyclictest33-21ksoftirqd/212:10:002
977999413,8cyclictest5978-21iostat11:30:171
977999413,7cyclictest908-21diskstats11:20:141
977999411,15cyclictest25638-21ls12:10:221
139391410,0ptp4l401ktimersoftd/308:50:133
9780994035,3cyclictest33-21ksoftirqd/211:20:002
9780994035,3cyclictest33-21ksoftirqd/208:10:012
9780994029,8cyclictest33-21ksoftirqd/212:10:242
9780994028,9cyclictest33-21ksoftirqd/209:45:242
977999404,7cyclictest13095-21irqstats07:15:181
977999402,7cyclictest3617-21iostat11:25:191
977999402,7cyclictest15886-21sshd09:35:241
977999402,7cyclictest12599-21python08:20:241
977999401,7cyclictest16857-21apt-get09:40:121
977999401,7cyclictest16857-21apt-get09:40:121
139391400,1ptp4l401ktimersoftd/311:34:543
9780993934,3cyclictest33-21ksoftirqd/211:40:002
9780993934,3cyclictest33-21ksoftirqd/210:25:002
9780993934,3cyclictest33-21ksoftirqd/209:10:012
9780993934,3cyclictest33-21ksoftirqd/207:20:002
977999391,7cyclictest15215-21irqrtprio07:20:181
9781993832,3cyclictest41-21ksoftirqd/309:20:013
9781993831,4cyclictest41-21ksoftirqd/310:29:123
9780993833,3cyclictest33-21ksoftirqd/208:50:002
9780993833,3cyclictest33-21ksoftirqd/208:15:022
9780993833,2cyclictest33-21ksoftirqd/212:20:002
9780993832,4cyclictest33-21ksoftirqd/210:40:002
9780993832,3cyclictest33-21ksoftirqd/211:20:132
9780993828,9cyclictest33-21ksoftirqd/207:10:202
9780993811,3cyclictest33-21ksoftirqd/207:20:222
9780993810,3cyclictest33-21ksoftirqd/212:30:202
977999383,13cyclictest11273-21open_inodes11:40:231
9781993730,4cyclictest41-21ksoftirqd/311:55:043
9780993733,2cyclictest33-21ksoftirqd/210:20:002
9780993732,3cyclictest33-21ksoftirqd/210:45:002
9780993732,3cyclictest33-21ksoftirqd/209:20:262
9780993732,3cyclictest33-21ksoftirqd/207:35:002
9780993727,4cyclictest33-21ksoftirqd/210:34:362
9780993726,8cyclictest33-21ksoftirqd/212:35:152
9779993730,4cyclictest25-21ksoftirqd/110:13:291
9779993730,4cyclictest25-21ksoftirqd/110:13:291
977999372,7cyclictest24460-21hddtemp_smartct09:55:161
977999372,15cyclictest20475-21open_inodes07:30:201
977999371,7cyclictest11382-21hddtemp_smartct10:35:151
977999370,7cyclictest21682-21ls08:40:201
977999370,35cyclictest0-21swapper/107:40:251
9778993729,4cyclictest9-21ksoftirqd/009:45:120
9781993631,3cyclictest41-21ksoftirqd/311:15:093
9781993631,3cyclictest41-21ksoftirqd/308:20:003
9781993630,4cyclictest41-21ksoftirqd/308:00:293
9781993630,4cyclictest41-21ksoftirqd/307:52:353
9780993631,3cyclictest33-21ksoftirqd/211:45:192
9780993631,3cyclictest33-21ksoftirqd/209:35:142
9780993631,3cyclictest33-21ksoftirqd/208:45:002
9780993631,2cyclictest33-21ksoftirqd/208:35:172
978099363,11cyclictest33-21ksoftirqd/208:50:192
9780993630,4cyclictest33-21ksoftirqd/207:56:342
9780993630,3cyclictest33-21ksoftirqd/211:10:002
978099361,3cyclictest121rcu_preempt11:50:162
9779993629,4cyclictest25-21ksoftirqd/109:52:001
977999361,8cyclictest737-21users07:55:271
977999361,8cyclictest5408-21ls08:05:251
977999361,7cyclictest10762-21meminfo09:25:191
9781993531,2cyclictest41-21ksoftirqd/308:59:593
9781993530,3cyclictest41-21ksoftirqd/311:35:423
9781993530,3cyclictest41-21ksoftirqd/311:25:413
9781993530,3cyclictest41-21ksoftirqd/307:35:203
9781993529,4cyclictest41-21ksoftirqd/307:19:093
9781993529,3cyclictest41-21ksoftirqd/310:10:193
9781993529,3cyclictest41-21ksoftirqd/310:10:193
978099356,4cyclictest33-21ksoftirqd/210:25:222
978099355,4cyclictest33-21ksoftirqd/207:35:222
9780993532,2cyclictest33-21ksoftirqd/207:45:002
9780993531,3cyclictest33-21ksoftirqd/211:55:132
978099351,4cyclictest33-21ksoftirqd/209:59:592
978099350,4cyclictest33-21ksoftirqd/209:25:122
9778993529,4cyclictest9-21ksoftirqd/012:09:330
9778993528,5cyclictest9-21ksoftirqd/009:25:420
9778993528,4cyclictest9-21ksoftirqd/011:13:410
139391350,0ptp4l401ktimersoftd/309:05:173
9781993429,3cyclictest41-21ksoftirqd/312:02:593
9781993429,3cyclictest41-21ksoftirqd/308:25:003
9781993429,3cyclictest41-21ksoftirqd/307:30:003
9781993429,3cyclictest3287-21kworker/3:108:10:143
9781993428,4cyclictest41-21ksoftirqd/311:45:503
9781993428,4cyclictest41-21ksoftirqd/310:46:443
9781993427,5cyclictest41-21ksoftirqd/310:30:053
9781993423,10cyclictest41-21ksoftirqd/311:00:003
9780993430,3cyclictest21495-21kworker/2:207:50:222
9780993429,3cyclictest33-21ksoftirqd/208:00:222
9780993428,4cyclictest33-21ksoftirqd/211:04:002
9780993428,4cyclictest33-21ksoftirqd/207:26:152
978099342,3cyclictest121rcu_preempt11:25:222
978099340,2cyclictest121rcu_preempt08:30:212
9779993429,3cyclictest25-21ksoftirqd/112:21:331
9779993429,3cyclictest25-21ksoftirqd/110:15:181
9779993428,4cyclictest25-21ksoftirqd/112:18:291
9779993428,4cyclictest25-21ksoftirqd/110:28:011
9778993429,3cyclictest9-21ksoftirqd/007:25:120
9778993428,4cyclictest9-21ksoftirqd/009:35:120
9778993428,4cyclictest9-21ksoftirqd/009:31:450
9778993428,4cyclictest9-21ksoftirqd/007:47:340
9778993428,4cyclictest9-21ksoftirqd/007:20:430
9778993428,4cyclictest12998-21cron10:40:000
9778993428,3cyclictest9-21ksoftirqd/010:45:000
9778993428,3cyclictest27515-21cron08:55:000
57898340,2rtkit-daemon577-21rtkit-daemon08:45:440
139391340,0ptp4l401ktimersoftd/312:08:173
139391340,0ptp4l401ktimersoftd/307:15:003
9781993329,3cyclictest41-21ksoftirqd/311:05:133
9781993329,3cyclictest41-21ksoftirqd/307:55:183
9781993328,3cyclictest41-21ksoftirqd/309:35:563
9781993327,4cyclictest41-21ksoftirqd/312:33:593
9781993327,4cyclictest41-21ksoftirqd/311:54:403
9781993327,4cyclictest41-21ksoftirqd/310:54:273
9781993327,4cyclictest41-21ksoftirqd/309:03:273
9781993327,4cyclictest41-21ksoftirqd/308:07:553
9781993327,3cyclictest41-21ksoftirqd/309:20:183
978099337,7cyclictest33-21ksoftirqd/211:45:002
9780993329,2cyclictest33-21ksoftirqd/212:25:102
9780993329,2cyclictest33-21ksoftirqd/211:15:002
9780993329,2cyclictest33-21ksoftirqd/210:50:142
9780993329,2cyclictest33-21ksoftirqd/209:00:002
9780993328,3cyclictest33-21ksoftirqd/211:35:012
9780993328,3cyclictest33-21ksoftirqd/210:55:132
978099331,3cyclictest33-21ksoftirqd/210:00:242
977999333,11cyclictest25927-21df_inode11:05:141
9779993327,4cyclictest25-21ksoftirqd/110:44:221
9778993328,3cyclictest9-21ksoftirqd/012:02:070
9778993328,3cyclictest9-21ksoftirqd/008:20:120
9778993327,4cyclictest9-21ksoftirqd/011:01:190
9778993327,4cyclictest9-21ksoftirqd/010:31:170
9778993327,4cyclictest9-21ksoftirqd/010:18:530
9778993327,4cyclictest9-21ksoftirqd/010:01:320
9778993327,4cyclictest9-21ksoftirqd/008:25:120
9778993326,4cyclictest9-21ksoftirqd/009:57:070
139391330,0ptp4l401ktimersoftd/310:36:033
9781993227,3cyclictest41-21ksoftirqd/311:20:383
9781993227,3cyclictest41-21ksoftirqd/309:10:133
9781993227,3cyclictest41-21ksoftirqd/309:10:123
9781993226,4cyclictest41-21ksoftirqd/312:36:003
9781993226,4cyclictest41-21ksoftirqd/312:11:333
9781993226,4cyclictest41-21ksoftirqd/310:15:523
9781993226,4cyclictest41-21ksoftirqd/308:50:013
9781993226,4cyclictest41-21ksoftirqd/307:24:223
9781993225,4cyclictest41-21ksoftirqd/308:25:133
978099324,2cyclictest121rcu_preempt12:20:222
9780993228,2cyclictest33-21ksoftirqd/210:15:012
9780993228,2cyclictest33-21ksoftirqd/210:15:002
9780993228,2cyclictest33-21ksoftirqd/209:30:262
9780993227,3cyclictest33-21ksoftirqd/208:29:132
9780993226,4cyclictest33-21ksoftirqd/210:45:592
9779993225,4cyclictest25-21ksoftirqd/111:46:281
9779993225,4cyclictest25-21ksoftirqd/109:32:131
9778993227,3cyclictest9-21ksoftirqd/011:17:460
9778993227,3cyclictest9-21ksoftirqd/008:12:220
9778993227,3cyclictest9-21ksoftirqd/008:03:420
9778993226,4cyclictest9-21ksoftirqd/011:39:170
9778993226,4cyclictest9-21ksoftirqd/009:15:430
9778993226,4cyclictest9-21ksoftirqd/009:08:500
9778993226,4cyclictest9-21ksoftirqd/008:42:300
9778993226,4cyclictest9-21ksoftirqd/008:15:470
9778993226,4cyclictest9-21ksoftirqd/007:57:370
9778993225,4cyclictest9-21ksoftirqd/012:15:550
139391320,0ptp4l401ktimersoftd/308:43:503
9781993126,3cyclictest41-21ksoftirqd/311:11:033
9781993126,3cyclictest41-21ksoftirqd/311:01:383
9781993126,3cyclictest41-21ksoftirqd/307:34:233
9781993125,4cyclictest41-21ksoftirqd/310:23:183
9780993126,3cyclictest33-21ksoftirqd/210:05:152
9779993126,3cyclictest25-21ksoftirqd/111:12:341
9779993125,4cyclictest25-21ksoftirqd/112:30:531
9779993125,4cyclictest25-21ksoftirqd/110:32:151
9779993125,4cyclictest25-21ksoftirqd/108:10:091
9778993126,3cyclictest9-21ksoftirqd/011:50:110
9778993126,3cyclictest9-21ksoftirqd/009:40:360
9778993126,3cyclictest9-21ksoftirqd/009:40:350
9778993125,4cyclictest9-21ksoftirqd/012:11:300
9778993125,4cyclictest9-21ksoftirqd/011:41:250
9778993125,4cyclictest9-21ksoftirqd/007:51:310
9778993125,4cyclictest9-21ksoftirqd/007:31:380
139391310,0ptp4l401ktimersoftd/311:42:043
139391310,0ptp4l401ktimersoftd/310:05:043
139391310,0ptp4l401ktimersoftd/309:32:553
9781993025,3cyclictest41-21ksoftirqd/309:40:193
9781993025,3cyclictest41-21ksoftirqd/309:40:193
9781993025,3cyclictest41-21ksoftirqd/309:27:053
9781993024,4cyclictest41-21ksoftirqd/312:24:453
9781993024,4cyclictest41-21ksoftirqd/310:41:313
9779993024,4cyclictest25-21ksoftirqd/109:05:171
9779993024,4cyclictest25-21ksoftirqd/107:46:231
9778993025,3cyclictest9-21ksoftirqd/012:30:520
9778993024,4cyclictest9-21ksoftirqd/012:29:070
9778993024,4cyclictest9-21ksoftirqd/011:56:010
9778993024,4cyclictest9-21ksoftirqd/011:26:010
9778993024,4cyclictest9-21ksoftirqd/011:24:280
9778993024,4cyclictest9-21ksoftirqd/010:28:080
9778993024,4cyclictest9-21ksoftirqd/009:00:110
139391300,0ptp4l401ktimersoftd/312:25:593
139391300,0ptp4l401ktimersoftd/309:50:203
139391300,0ptp4l401ktimersoftd/308:38:293
9781992925,2cyclictest41-21ksoftirqd/309:55:183
9781992924,3cyclictest41-21ksoftirqd/310:03:323
9781992924,3cyclictest41-21ksoftirqd/307:40:203
9779992923,4cyclictest25-21ksoftirqd/111:57:351
9779992923,4cyclictest25-21ksoftirqd/108:04:521
9778992924,3cyclictest9-21ksoftirqd/009:23:460
9778992923,4cyclictest9-21ksoftirqd/011:05:030
9778992923,4cyclictest9-21ksoftirqd/010:59:530
9778992923,4cyclictest9-21ksoftirqd/008:30:340
9778992923,4cyclictest9-21ksoftirqd/008:07:200
9781992823,3cyclictest41-21ksoftirqd/309:45:503
977999280,11cyclictest24814-21ls11:00:251
9778992823,3cyclictest9-21ksoftirqd/010:23:390
9778992823,3cyclictest9-21ksoftirqd/008:55:100
9778992822,4cyclictest9-21ksoftirqd/009:11:300
9778992822,4cyclictest9-21ksoftirqd/009:11:300
9778992721,4cyclictest9-21ksoftirqd/010:47:260
9778992721,4cyclictest9-21ksoftirqd/008:36:480
9778992721,4cyclictest9-21ksoftirqd/007:36:060
9779992620,4cyclictest25-21ksoftirqd/112:02:121
9779992619,4cyclictest25-21ksoftirqd/107:10:131
9778992621,3cyclictest9-21ksoftirqd/012:38:300
9778992621,3cyclictest9-21ksoftirqd/010:07:070
9778992621,3cyclictest9-21ksoftirqd/007:17:120
9778992520,3cyclictest9-21ksoftirqd/011:50:000
9778992520,3cyclictest9-21ksoftirqd/010:12:040
9778992520,3cyclictest9-21ksoftirqd/010:12:030
9778992419,3cyclictest9-21ksoftirqd/009:54:500
9778992418,4cyclictest9-21ksoftirqd/007:44:250
9778992318,3cyclictest9-21ksoftirqd/012:24:020
9779992216,4cyclictest25-21ksoftirqd/109:23:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional