You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-15 - 12:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot3.osadl.org (updated Wed Oct 15, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
329284199130,11cyclictest0-21swapper/321:15:123
3292841991211,0cyclictest0-21swapper/319:25:013
329284199120,1cyclictest0-21swapper/322:30:133
329284199120,11cyclictest0-21swapper/322:25:013
329284199120,11cyclictest0-21swapper/321:35:143
329284199120,11cyclictest0-21swapper/320:35:023
329284199120,11cyclictest0-21swapper/300:30:193
329284199120,0cyclictest0-21swapper/321:30:153
329284199118,2cyclictest0-21swapper/321:30:003
3292841991111,0cyclictest0-21swapper/322:00:163
3292841991110,0cyclictest0-21swapper/323:50:153
329284199110,8cyclictest0-21swapper/319:11:433
329284199110,10cyclictest69450irq/121-eno122:42:433
329284199110,10cyclictest69450irq/121-eno122:25:143
329284199110,10cyclictest69450irq/121-eno120:31:333
329284199110,10cyclictest69450irq/121-eno120:20:163
329284199110,10cyclictest0-21swapper/322:40:013
329284199110,10cyclictest0-21swapper/320:25:183
329284199110,10cyclictest0-21swapper/319:55:013
329284199110,10cyclictest0-21swapper/319:45:013
329284199109,0cyclictest0-21swapper/323:30:133
329284199109,0cyclictest0-21swapper/323:10:203
329284199108,1cyclictest69450irq/121-eno123:20:123
3292841991010,0cyclictest69450irq/121-eno122:45:203
3292841991010,0cyclictest69450irq/121-eno122:18:023
3292841991010,0cyclictest69450irq/121-eno121:57:103
3292841991010,0cyclictest0-21swapper/320:55:183
3292841991010,0cyclictest0-21swapper/320:20:013
3292841991010,0cyclictest0-21swapper/300:05:223
329284199100,9cyclictest69450irq/121-eno121:45:133
329284199100,9cyclictest69450irq/121-eno121:05:133
329284199100,9cyclictest0-21swapper/321:20:183
329284199100,9cyclictest0-21swapper/319:25:193
329284199100,8cyclictest69450irq/121-eno123:35:143
329284199100,0cyclictest0-21swapper/321:50:213
329284199100,0cyclictest0-21swapper/300:25:223
329284199100,0cyclictest0-21swapper/300:20:153
32928419999,0cyclictest69450irq/121-eno123:55:133
32928419999,0cyclictest69450irq/121-eno123:15:183
32928419999,0cyclictest69450irq/121-eno122:10:183
32928419999,0cyclictest69450irq/121-eno120:05:223
32928419999,0cyclictest69450irq/121-eno120:00:113
32928419999,0cyclictest69450irq/121-eno119:10:013
32928419999,0cyclictest0-21swapper/323:40:233
32928419999,0cyclictest0-21swapper/319:19:563
32928419999,0cyclictest0-21swapper/300:40:023
32928419999,0cyclictest0-21swapper/300:10:143
32928419997,2cyclictest69450irq/121-eno100:04:563
32928419990,8cyclictest69450irq/121-eno122:50:373
32928419988,0cyclictest69450irq/121-eno123:27:403
32928419988,0cyclictest69450irq/121-eno122:55:223
32928419988,0cyclictest0-21swapper/321:10:213
32928419988,0cyclictest0-21swapper/320:53:063
32928419988,0cyclictest0-21swapper/320:10:193
32928419980,7cyclictest69450irq/121-eno100:19:153
32928419980,7cyclictest0-21swapper/323:45:193
32928419980,0cyclictest0-21swapper/323:05:223
32928419977,0cyclictest69450irq/121-eno123:03:363
32928419977,0cyclictest69450irq/121-eno121:42:343
32928419977,0cyclictest69450irq/121-eno119:45:153
32928419977,0cyclictest0-21swapper/319:50:113
32928419977,0cyclictest0-21swapper/319:40:013
32928419966,0cyclictest69450irq/121-eno121:00:183
32928419966,0cyclictest0-21swapper/320:50:013
32928419950,0cyclictest0-21swapper/322:09:373
3415352240,3sleep03415356-21ssh00:11:470
32928419944,0cyclictest0-21swapper/319:30:193
32928419940,3cyclictest3327546-21chrt20:40:033
3292370242,1sleep10-21swapper/119:06:051
3292351242,1sleep20-21swapper/219:05:492
3291139241,1sleep00-21swapper/019:05:150
3383926230,1sleep13384192-21diskstats23:00:151
3379296230,1sleep13379324-21apt-get22:50:151
3373096230,2sleep03373295-21cpuspeed_turbos22:35:170
3331050230,2sleep13331272-21grep20:50:151
3325620230,1sleep23325646-21apt-get20:35:112
3313694230,2sleep13313802-21grep20:00:161
3304974230,1sleep03305000-21apt-get19:40:140
3303129230,2sleep13303309-21tr19:35:151
3422727220,1sleep23422885-21sed00:30:182
3422406220,0sleep00-21swapper/000:30:160
3420176220,1sleep00-21swapper/000:25:080
3418159220,1sleep03418285-21ssh00:20:150
3404269220,0sleep00-21swapper/023:46:050
3401664220,1sleep23401774-21python323:40:232
3399332220,1sleep20-21swapper/223:35:182
3398683220,0sleep10-21swapper/123:35:131
3390414220,1sleep03390675-21cat23:15:150
3382086220,1sleep23382172-21irqstats22:55:202
3358605220,1sleep23358815-21ntp_kernel_pll_22:00:202
3353882220,1sleep0328-21plymouthd21:50:140
3345813220,1sleep00-21swapper/021:30:170
3342393220,1sleep13342542-21ntp_states21:20:171
3335359220,1sleep13335360-21sshd21:01:521
3332009220,1sleep20-21swapper/220:55:122
3325113220,1sleep03325287-21dpkg20:35:010
3318719220,1sleep13318737-21munin-run20:15:011
3311771220,1sleep00-21swapper/019:55:190
3299208220,1sleep03299234-21apt-get19:25:130
3297295220,1sleep03297321-21apt-get19:20:130
3425345210,0sleep20-21swapper/200:35:222
3424641210,0sleep10-21swapper/100:35:171
3424353210,1sleep00-21swapper/000:35:040
3422701210,0sleep10-21swapper/100:30:171
3421593210,0sleep10-21swapper/100:26:171
3420379210,0sleep20-21swapper/200:25:182
3418535210,0sleep20-21swapper/200:20:172
3418286210,0sleep10-21swapper/100:20:161
3417302210,0sleep03417306-21ssh00:15:310
3415970210,0sleep10-21swapper/100:15:081
3414664210,0sleep10-21swapper/100:10:201
3412273210,0sleep00-21swapper/000:05:180
3411976210,0sleep20-21swapper/200:05:162
3411724210,0sleep10-21swapper/100:05:151
3410740210,0sleep10-21swapper/100:00:231
3409440210,0sleep20-21swapper/200:00:082
3408914210,0sleep00-21swapper/000:00:020
3408400210,0sleep00-21swapper/023:55:380
3408031210,0sleep20-21swapper/223:55:202
3407252210,0sleep13407502-21/usr/sbin/munin23:55:151
3405778210,0sleep20-21swapper/223:50:232
3404719210,0sleep00-21swapper/023:50:010
3402872210,0sleep20-21swapper/223:45:072
3402654210,0sleep10-21swapper/123:45:021
3401546210,0sleep10-21swapper/123:40:221
3400784210,1sleep00-21swapper/023:40:090
3399106210,0sleep00-21swapper/023:35:160
3398002210,0sleep00-21swapper/023:31:200
3397939210,0sleep20-21swapper/223:30:462
3397086210,0sleep10-21swapper/123:30:171
3395898210,1sleep20-21swapper/223:26:142
3394499210,0sleep10-21swapper/123:25:131
3394055210,0sleep00-21swapper/023:23:240
3393912210,0sleep20-21swapper/223:22:102
3392959210,0sleep10-21swapper/123:20:171
3391196210,0sleep10-21swapper/123:15:201
3390035210,0sleep20-21swapper/223:15:012
3388387210,0sleep20-21swapper/223:10:172
3388355210,0sleep10-21swapper/123:10:161
3388292210,0sleep00-21swapper/023:10:150
3387022210,0sleep00-21swapper/023:05:230
3386100210,0sleep10-21swapper/123:05:081
3385380210,0sleep00-21swapper/023:03:100
3384732210,0sleep20-21swapper/223:00:202
3382375210,0sleep00-21swapper/022:55:220
3381838210,0sleep10-21swapper/122:55:191
3381022210,0sleep00-21swapper/022:54:060
3379327210,0sleep20-21swapper/222:50:162
3377233210,0sleep20-21swapper/222:45:152
3377203210,0sleep10-21swapper/122:45:141
3376948210,0sleep00-21swapper/022:45:010
3375552210,0sleep00-21swapper/022:40:170
3375247210,0sleep20-21swapper/222:40:152
3375133210,0sleep10-21swapper/122:40:141
3374712210,0sleep20-21swapper/222:38:592
3374499210,0sleep10-21swapper/122:37:061
3372213210,0sleep00-21swapper/022:30:240
3371341210,0sleep10-21swapper/122:30:171
3370907210,0sleep20-21swapper/222:30:142
3369494210,0sleep10-21swapper/122:25:171
3368939210,0sleep20-21swapper/222:25:142
3368797210,1sleep00-21swapper/022:25:040
3368434210,0sleep10-21swapper/122:23:571
3367436210,0sleep20-21swapper/222:20:182
3366720210,0sleep00-21swapper/022:20:120
3365982210,0sleep10-21swapper/122:15:561
3365928210,0sleep00-21swapper/022:15:270
3364642210,0sleep20-21swapper/222:15:172
3364006210,0sleep00-21swapper/022:14:150
3363964210,0sleep10-21swapper/122:13:521
3362005210,0sleep20-21swapper/222:10:012
3361803210,0sleep10-21swapper/122:08:161
3361537210,0sleep20-21swapper/222:05:572
3360353210,0sleep00-21swapper/022:05:150
3359693210,0sleep00-21swapper/022:03:070
3358522210,0sleep10-21swapper/122:00:191
3357747210,0sleep00-21swapper/021:59:340
3357466210,0sleep10-21swapper/121:57:031
3356835210,0sleep23357006-21sed21:55:202
3354501210,0sleep10-21swapper/121:50:191
3354006210,0sleep20-21swapper/221:50:162
3352589210,0sleep10-21swapper/121:45:181
3352223210,0sleep20-21swapper/221:45:152
3351879210,0sleep00-21swapper/021:45:130
3351062210,0sleep20-21swapper/221:40:232
3350704210,0sleep00-21swapper/021:40:210
3348434210,0sleep20-21swapper/221:35:192
3348257210,0sleep10-21swapper/121:35:181
3347302210,0sleep20-21swapper/221:33:032
3345908210,0sleep10-21swapper/121:30:181
3344263210,0sleep00-21swapper/021:25:160
3343915210,0sleep20-21swapper/221:25:142
3342232210,0sleep00-21swapper/021:20:160
3340478210,0sleep20-21swapper/221:15:182
3340199210,0sleep00-21swapper/021:15:160
3339767210,0sleep10-21swapper/121:15:131
3339305210,0sleep10-21swapper/121:12:441
3338521210,0sleep00-21swapper/021:10:190
3338216210,0sleep20-21swapper/221:10:172
3337521210,0sleep10-21swapper/121:10:001
3334949210,0sleep20-21swapper/221:00:212
3334005210,0sleep00-21swapper/021:00:150
3332911210,0sleep00-21swapper/020:55:180
3330243210,0sleep00-21swapper/020:50:100
3330088210,0sleep20-21swapper/220:50:082
3329831210,1sleep00-21swapper/020:49:500
3328409210,0sleep20-21swapper/220:40:192
3328302210,0sleep10-21swapper/120:40:181
3327289210,0sleep00-21swapper/020:40:010
3325787210,0sleep00-21swapper/020:35:130
3325074210,0sleep10-21swapper/120:34:341
3324233210,0sleep20-21swapper/220:26:512
3323784210,0sleep00-21swapper/020:25:210
3322572210,0sleep10-21swapper/120:25:021
3321794210,0sleep20-21swapper/220:20:182
3321665210,0sleep10-21swapper/120:20:171
3319104210,0sleep00-21swapper/020:15:160
3318968210,0sleep20-21swapper/220:15:142
3317489210,0sleep00-21swapper/020:10:160
3316760210,1sleep00-21swapper/020:09:280
3314631210,0sleep20-21swapper/220:05:012
3312963210,0sleep00-21swapper/020:00:110
3312141210,0sleep20-21swapper/219:55:212
3309235210,0sleep10-21swapper/119:50:151
3308798210,0sleep20-21swapper/219:50:122
3307404210,0sleep20-21swapper/219:45:162
3307321210,0sleep10-21swapper/119:45:151
3307071210,0sleep00-21swapper/019:45:140
3305128210,0sleep20-21swapper/219:40:162
3304604210,0sleep20-21swapper/219:38:482
3302792210,0sleep00-21swapper/019:35:010
3302412210,0sleep1328-21plymouthd19:30:221
3301566210,0sleep00-21swapper/019:30:170
3301185210,0sleep20-21swapper/219:30:152
3300001210,0sleep20-21swapper/219:25:182
3297449210,0sleep20-21swapper/219:20:152
3297324210,0sleep10-21swapper/119:20:141
3295821210,0sleep00-21swapper/019:15:160
3295358210,0sleep10-21swapper/119:15:131
3293425210,0sleep00-21swapper/019:10:160
3293072210,0sleep20-21swapper/219:10:142
3292981210,0sleep10-21swapper/119:10:131
3415964200,0sleep20-21swapper/200:15:052
3413877200,0sleep20-21swapper/200:10:052
3404951200,0sleep10-21swapper/123:50:021
3394480200,0sleep00-21swapper/023:25:040
3386094200,0sleep20-21swapper/223:05:052
3349749200,0sleep10-21swapper/121:40:021
3347506200,0sleep00-21swapper/021:35:010
3343503200,0sleep10-21swapper/121:25:011
3341758200,0sleep20-21swapper/221:20:022
3335845200,0sleep00-21swapper/021:05:030
3335609200,0sleep20-21swapper/221:05:012
3331997200,0sleep10-21swapper/120:55:031
3329459200,0sleep20-21swapper/220:45:042
3329458200,0sleep10-21swapper/120:45:031
3325291200,0sleep10-21swapper/120:35:021
3324720200,0sleep20-21swapper/220:30:032
3320894200,0sleep00-21swapper/020:20:040
3318957200,0sleep10-21swapper/120:15:051
3316807200,0sleep20-21swapper/220:10:022
3315130200,0sleep10-21swapper/120:05:041
3312696200,0sleep20-21swapper/220:00:012
3310964200,0sleep10-21swapper/119:55:041
3308786200,0sleep00-21swapper/019:50:020
3304960200,0sleep10-21swapper/119:40:031
3299194200,0sleep10-21swapper/119:25:021
3295343200,0sleep20-21swapper/219:15:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional