You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 19:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot3.osadl.org (updated Fri Nov 21, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
279882991410,2cyclictest0-21swapper/312:10:133
279882991311,1cyclictest0-21swapper/311:05:133
27988299130,12cyclictest0-21swapper/311:00:143
279882991211,0cyclictest0-21swapper/309:50:113
27988299120,11cyclictest69450irq/121-eno111:17:363
27988299120,11cyclictest0-21swapper/309:45:123
27988299120,11cyclictest0-21swapper/307:25:093
27988299120,11cyclictest0-21swapper/307:10:003
27988299111,4cyclictest0-21swapper/307:40:153
279882991111,0cyclictest0-21swapper/312:15:193
279882991111,0cyclictest0-21swapper/311:50:013
279882991111,0cyclictest0-21swapper/311:10:103
279882991111,0cyclictest0-21swapper/308:35:193
279882991110,1cyclictest304469-21turbostat08:10:003
279882991110,0cyclictest0-21swapper/311:20:143
27988299110,11cyclictest0-21swapper/312:35:163
27988299110,11cyclictest0-21swapper/309:55:153
27988299110,10cyclictest0-21swapper/310:20:003
27988299110,10cyclictest0-21swapper/310:00:163
27988299110,10cyclictest0-21swapper/309:35:013
27988299110,10cyclictest0-21swapper/308:50:023
27988299110,10cyclictest0-21swapper/308:25:173
27988299110,0cyclictest0-21swapper/312:20:213
27988299110,0cyclictest0-21swapper/310:35:133
27988299110,0cyclictest0-21swapper/309:15:123
27988299110,0cyclictest0-21swapper/308:40:133
27988299110,0cyclictest0-21swapper/307:25:013
27988299109,0cyclictest69450irq/121-eno107:45:153
27988299108,1cyclictest0-21swapper/311:30:123
279882991010,0cyclictest69450irq/121-eno111:57:263
279882991010,0cyclictest69450irq/121-eno111:39:213
279882991010,0cyclictest69450irq/121-eno111:28:363
279882991010,0cyclictest69450irq/121-eno109:05:163
279882991010,0cyclictest0-21swapper/312:00:143
279882991010,0cyclictest0-21swapper/310:14:563
279882991010,0cyclictest0-21swapper/308:45:193
279882991010,0cyclictest0-21swapper/308:30:123
279882991010,0cyclictest0-21swapper/308:10:113
279882991010,0cyclictest0-21swapper/307:50:123
279882991010,0cyclictest0-21swapper/307:30:113
27988299100,9cyclictest69450irq/121-eno110:56:433
27988299100,9cyclictest69450irq/121-eno109:40:413
27988299100,9cyclictest69450irq/121-eno109:24:223
27988299100,9cyclictest69450irq/121-eno108:55:153
27988299100,0cyclictest0-21swapper/312:30:053
27988299100,0cyclictest0-21swapper/310:40:223
2798829999,0cyclictest69450irq/121-eno110:53:503
2798829999,0cyclictest69450irq/121-eno110:32:273
2798829999,0cyclictest69450irq/121-eno110:05:213
2798829999,0cyclictest69450irq/121-eno108:03:213
2798829999,0cyclictest0-21swapper/308:20:023
2798829990,8cyclictest69450irq/121-eno107:15:163
2798829990,8cyclictest0-21swapper/307:35:003
2798829990,0cyclictest0-21swapper/311:50:013
2798829988,0cyclictest69450irq/121-eno110:29:303
2798829988,0cyclictest69450irq/121-eno110:15:133
2798829980,8cyclictest0-21swapper/312:05:193
278852281,4sleep30-21swapper/307:05:213
2798829977,0cyclictest69450irq/121-eno109:37:473
2798829977,0cyclictest0-21swapper/308:15:133
2798829970,6cyclictest69450irq/121-eno112:27:223
2798829970,6cyclictest69450irq/121-eno110:48:573
2798829966,0cyclictest69450irq/121-eno109:25:173
2798829960,4cyclictest0-21swapper/311:40:123
2798829960,1cyclictest0-21swapper/309:00:123
2798829954,0cyclictest0-21swapper/307:56:203
2798829950,4cyclictest69450irq/121-eno109:10:093
414691240,3sleep2414693-21ssh12:33:412
352171240,3sleep0352338-21sed10:05:210
339843240,3sleep1339845-21ssh09:35:321
279554242,1sleep20-21swapper/207:09:082
279292242,1sleep10-21swapper/107:05:471
278455241,1sleep00-21swapper/007:05:180
400194230,1sleep1400220-21apt-get12:00:141
378998230,1sleep2379024-21apt-get11:10:112
378363230,2sleep0378367-21ssh11:06:410
372722230,1sleep0372748-21apt-get10:55:120
365073230,2sleep1365292-21grep10:35:191
353381230,1sleep2353411-21apt-get10:10:122
351304230,1sleep1351330-21apt-get10:05:131
343463230,1sleep2343634-21python309:45:182
320564230,1sleep0320590-21apt-get08:50:130
292659230,1sleep1292677-21apt-get07:40:001
285225230,2sleep1285326-21awk07:20:161
413016220,1sleep0413043-21apt-get12:30:150
403744220,1sleep2403748-21ssh12:06:462
390254220,1sleep0389454-21/usr/sbin/munin11:35:190
387821220,1sleep1387981-21memory11:30:151
370643220,1sleep2370673-21apt-get10:50:142
364109220,1sleep20-21swapper/210:35:122
363771220,1sleep2363776-21sshd10:34:212
355138220,0sleep00-21swapper/010:14:210
351920220,1sleep2352070-21ntp_states10:05:182
349958220,1sleep2350240-21users10:00:192
347586220,0sleep10-21swapper/109:55:171
337134220,1sleep0337284-21ntp_states09:30:300
334232220,1sleep2334434-21ls09:25:012
332930220,1sleep00-21swapper/009:20:140
330212220,0sleep2329985-21apt-get09:15:042
325937220,0sleep00-21swapper/009:03:160
309497220,1sleep2309067-21/usr/sbin/munin08:20:162
306043220,1sleep2754-21snmpd08:11:042
303531220,1sleep2303612-21pmu-power08:05:152
302532220,0sleep00-21swapper/008:05:010
299725220,1sleep0299893-21sensors07:55:160
298930220,1sleep2298956-21apt-get07:55:112
293348220,1sleep20-21swapper/207:40:172
290828220,0sleep1290854-21apt-get07:35:131
290319220,1sleep1290373-21apt-config07:35:011
288395220,0sleep10-21swapper/107:29:561
288293220,0sleep00-21swapper/007:28:390
416931210,0sleep20-21swapper/212:39:562
416495210,0sleep00-21swapper/012:36:060
415104210,0sleep10-21swapper/112:35:111
413992210,1sleep1414226-21sed12:30:241
411094210,0sleep10-21swapper/112:25:151
410844210,0sleep00-21swapper/012:25:130
409509210,0sleep00-21swapper/012:20:220
408664210,0sleep20-21swapper/212:20:152
406487210,0sleep10-21swapper/112:15:151
406456210,0sleep00-21swapper/012:15:140
404524210,0sleep20-21swapper/212:10:152
404367210,0sleep00-21swapper/012:10:120
404354210,0sleep10-21swapper/112:10:051
402665210,0sleep10-21swapper/112:05:181
402439210,0sleep00-21swapper/012:05:170
401162210,0sleep00-21swapper/012:00:210
400223210,0sleep20-21swapper/212:00:152
399526210,0sleep10-21swapper/111:56:361
399458210,0sleep20-21swapper/211:56:012
398117210,0sleep00-21swapper/011:55:110
396543210,0sleep10-21swapper/111:50:171
395988210,0sleep00-21swapper/011:50:120
395477210,0sleep20-21swapper/211:50:022
394405210,1sleep0394528-21processes11:45:200
393388210,0sleep20-21swapper/211:45:022
391942210,0sleep10-21swapper/111:40:151
391689210,0sleep00-21swapper/011:40:140
391562210,0sleep20-21swapper/211:40:122
391290210,0sleep20-21swapper/211:40:012
390425210,0sleep10-21swapper/111:35:201
388854210,0sleep20-21swapper/211:32:012
388696210,0sleep00-21swapper/011:30:340
385461210,0sleep10-21swapper/111:25:141
385336210,0sleep00-21swapper/011:25:140
384709210,0sleep20-21swapper/211:22:202
383188210,0sleep0383214-21apt-get11:20:140
381691210,0sleep00-21swapper/011:15:170
381071210,0sleep20-21swapper/211:15:112
380303210,0sleep00-21swapper/011:10:210
379184210,0sleep10-21swapper/111:10:141
377643210,0sleep20-21swapper/211:05:192
376141210,0sleep00-21swapper/011:00:320
375596210,0sleep10-21swapper/111:00:291
374834210,0sleep20-21swapper/211:00:142
374296210,0sleep20-21swapper/210:57:472
372471210,0sleep10-21swapper/110:55:011
370782210,0sleep00-21swapper/010:50:150
368743210,0sleep00-21swapper/010:45:160
368553210,0sleep10-21swapper/110:45:121
368304210,0sleep20-21swapper/210:45:012
368204210,0sleep2328003-21diskmemload10:44:142
367801210,0sleep10-21swapper/110:40:371
366477210,0sleep00-21swapper/010:40:160
364293210,0sleep00-21swapper/010:35:140
363412210,0sleep10-21swapper/110:31:081
362522210,0sleep00-21swapper/010:30:190
361176210,0sleep20-21swapper/210:25:212
360369210,0sleep10-21swapper/110:25:161
360121210,0sleep0360368-21diskstats10:25:150
359272210,0sleep10-21swapper/110:21:261
358645210,0sleep20-21swapper/210:20:192
357642210,0sleep00-21swapper/010:20:010
356781210,0sleep20-21swapper/210:15:242
356155210,0sleep00-21swapper/010:15:180
355625210,0sleep10-21swapper/110:15:151
349815210,0sleep10-21swapper/110:00:181
349052210,0sleep00-21swapper/010:00:130
346058210,0sleep20-21swapper/209:50:212
346047210,0sleep10-21swapper/109:50:211
345205210,0sleep00-21swapper/009:50:160
344213210,0sleep10-21swapper/109:47:331
344099210,0sleep00-21swapper/009:46:320
342080210,1sleep00-21swapper/009:42:070
341555210,0sleep20-21swapper/209:40:212
341383210,0sleep10-21swapper/109:40:201
339326210,0sleep0339497-21python309:35:190
339107210,0sleep20-21swapper/209:35:172
338108210,0sleep10-21swapper/109:33:201
337418210,0sleep20-21swapper/209:30:332
335819210,0sleep00-21swapper/009:25:430
335124210,0sleep20-21swapper/209:25:162
332505210,0sleep10-21swapper/109:20:111
331816210,0sleep00-21swapper/009:15:410
330719210,0sleep10-21swapper/109:15:141
328758210,0sleep10-21swapper/109:10:141
328673210,0sleep00-21swapper/009:10:140
328326210,0sleep20-21swapper/209:10:112
327700210,0sleep00-21swapper/009:06:220
326750210,0sleep20-21swapper/209:05:202
324843210,0sleep20-21swapper/209:00:142
323517210,0sleep00-21swapper/008:55:210
322231210,0sleep10-21swapper/108:55:021
322148210,0sleep20-21swapper/208:54:032
320593210,0sleep10-21swapper/108:50:141
319041210,0sleep00-21swapper/008:45:150
318663210,0sleep20-21swapper/208:45:132
318653210,0sleep10-21swapper/108:45:121
318330210,1sleep00-21swapper/008:44:040
317812210,0sleep10-21swapper/108:40:211
316764210,0sleep20-21swapper/208:40:142
316092210,0sleep20-21swapper/208:35:222
315650210,0sleep00-21swapper/008:35:190
315248210,0sleep10-21swapper/108:35:171
313825210,0sleep10-21swapper/108:30:191
311909210,0sleep00-21swapper/008:25:190
311596210,0sleep20-21swapper/208:25:172
311459210,0sleep10-21swapper/108:25:161
309777210,0sleep00-21swapper/008:20:180
309232210,0sleep10-21swapper/108:20:151
307051210,0sleep20-21swapper/208:15:162
306938210,0sleep10-21swapper/108:15:151
306851210,0sleep00-21swapper/008:15:020
306027210,1sleep10-21swapper/108:10:511
305662210,0sleep00-21swapper/008:10:180
301099210,0sleep20-21swapper/208:00:162
300956210,0sleep10-21swapper/108:00:151
300866210,0sleep00-21swapper/008:00:140
297085210,0sleep20-21swapper/207:50:182
297083210,0sleep00-21swapper/007:50:170
296775210,0sleep10-21swapper/107:50:011
296039210,0sleep10-21swapper/107:45:181
295261210,0sleep00-21swapper/007:45:130
295106210,0sleep20-21swapper/207:45:112
293222210,0sleep00-21swapper/007:40:150
291680210,0sleep00-21swapper/007:35:200
290374210,0sleep20-21swapper/207:35:022
289260210,0sleep00-21swapper/007:30:160
288268210,0sleep20-21swapper/207:28:212
284728210,0sleep20-21swapper/207:20:132
283692210,0sleep20-21swapper/207:15:212
282745210,0sleep00-21swapper/007:15:140
281431210,0sleep00-21swapper/007:10:230
281004210,0sleep20-21swapper/207:10:202
280339210,0sleep10-21swapper/107:10:151
410643200,0sleep20-21swapper/212:25:042
408551200,0sleep10-21swapper/112:20:021
406439200,0sleep20-21swapper/212:15:042
393624200,0sleep10-21swapper/111:45:051
385257200,0sleep20-21swapper/211:25:032
383170200,0sleep10-21swapper/111:20:031
381052200,0sleep10-21swapper/111:15:021
376659200,0sleep10-21swapper/111:05:021
370628200,0sleep10-21swapper/110:50:051
353365200,0sleep10-21swapper/110:10:031
346826200,0sleep00-21swapper/009:55:040
346823200,0sleep20-21swapper/209:55:032
334468200,0sleep10-21swapper/109:25:031
326107200,0sleep10-21swapper/109:05:031
324144200,0sleep10-21swapper/109:00:011
322464200,0sleep20-21swapper/208:55:032
312882200,0sleep20-21swapper/208:30:042
312880200,0sleep00-21swapper/008:30:030
302766200,0sleep10-21swapper/108:05:021
298904200,0sleep10-21swapper/107:55:021
288403200,0sleep20-21swapper/207:30:022
284485200,0sleep00-21swapper/007:20:030
282549200,0sleep10-21swapper/107:15:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional