You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 22:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Sat Nov 22, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29088499140,12cyclictest0-21swapper/307:20:163
290884991210,1cyclictest0-21swapper/312:10:143
29088499120,8cyclictest0-21swapper/312:20:133
29088499120,11cyclictest69450irq/121-eno112:29:273
29088499120,11cyclictest69450irq/121-eno108:55:183
29088499120,11cyclictest0-21swapper/311:55:143
29088499120,11cyclictest0-21swapper/311:30:133
29088499120,11cyclictest0-21swapper/311:10:133
29088499120,11cyclictest0-21swapper/307:30:013
2895262129,1sleep0289652-21awk07:05:200
29088499118,1cyclictest0-21swapper/312:00:123
290884991111,0cyclictest0-21swapper/309:00:143
290884991111,0cyclictest0-21swapper/307:45:173
290884991111,0cyclictest0-21swapper/307:45:173
290884991110,0cyclictest69450irq/121-eno108:30:413
29088499110,9cyclictest0-21swapper/309:10:123
29088499110,10cyclictest0-21swapper/310:30:013
29088499110,10cyclictest0-21swapper/310:00:223
29088499110,10cyclictest0-21swapper/307:30:213
29088499110,0cyclictest0-21swapper/312:15:143
29088499110,0cyclictest0-21swapper/309:45:173
29088499110,0cyclictest0-21swapper/307:35:133
29088499109,1cyclictest69450irq/121-eno110:45:153
29088499109,0cyclictest0-21swapper/307:15:013
290884991010,0cyclictest69450irq/121-eno110:40:183
290884991010,0cyclictest69450irq/121-eno110:18:153
290884991010,0cyclictest69450irq/121-eno109:50:373
290884991010,0cyclictest0-21swapper/309:25:003
29088499100,9cyclictest69450irq/121-eno110:52:073
29088499100,9cyclictest69450irq/121-eno109:55:503
29088499100,9cyclictest0-21swapper/308:00:183
29088499100,9cyclictest0-21swapper/307:15:423
29088499100,10cyclictest0-21swapper/311:15:173
29088499100,0cyclictest0-21swapper/308:45:133
29088499100,0cyclictest0-21swapper/308:35:213
2908849999,0cyclictest69450irq/121-eno110:10:213
2908849999,0cyclictest69450irq/121-eno108:15:203
2908849999,0cyclictest0-21swapper/312:30:153
2908849999,0cyclictest0-21swapper/311:35:193
2908849999,0cyclictest0-21swapper/310:20:173
2908849999,0cyclictest0-21swapper/309:15:213
2908849998,1cyclictest69450irq/121-eno107:50:163
2908849998,0cyclictest0-21swapper/312:05:143
2908849990,8cyclictest69450irq/121-eno112:36:583
2908849990,8cyclictest69450irq/121-eno111:45:563
2908849990,8cyclictest69450irq/121-eno110:31:443
2908849990,8cyclictest69450irq/121-eno108:50:193
2908849990,8cyclictest0-21swapper/311:00:133
2908849988,0cyclictest69450irq/121-eno110:58:043
2908849988,0cyclictest69450irq/121-eno110:35:273
2908849988,0cyclictest69450irq/121-eno109:27:423
2908849988,0cyclictest0-21swapper/311:50:143
2908849988,0cyclictest0-21swapper/311:05:143
2908849988,0cyclictest0-21swapper/309:40:143
2908849980,7cyclictest69450irq/121-eno108:40:253
2908849980,7cyclictest69450irq/121-eno107:55:203
2908849980,0cyclictest0-21swapper/311:20:193
2908849980,0cyclictest0-21swapper/308:05:193
2908849977,0cyclictest69450irq/121-eno109:30:153
2908849970,7cyclictest69450irq/121-eno108:13:433
2908849970,6cyclictest69450irq/121-eno111:41:263
2908849970,6cyclictest69450irq/121-eno109:35:193
2908849970,6cyclictest69450irq/121-eno109:05:363
2908849970,6cyclictest69450irq/121-eno108:25:163
2908849970,0cyclictest0-21swapper/310:10:013
331660264,2sleep1754-21snmpd08:51:561
2908849966,0cyclictest69450irq/121-eno111:25:163
290725261,2sleep30-21swapper/307:09:563
2908849955,0cyclictest0-21swapper/307:40:203
2908849951,2cyclictest0-21swapper/308:20:143
288746241,2sleep20-21swapper/207:05:142
288499242,1sleep10-21swapper/107:05:011
419607230,2sleep1419627-21apt-get12:25:021
328323230,2sleep2328367-21aten_r1power_cu08:45:132
294972230,1sleep00-21swapper/007:18:410
421958220,0sleep10-21swapper/112:30:021
406673220,0sleep00-21swapper/011:51:420
404764220,0sleep00-21swapper/011:48:140
396608220,1sleep0396622-21munin-run11:30:010
389291220,0sleep00-21swapper/011:10:200
388513220,1sleep10-21swapper/111:10:131
384545220,1sleep0384788-21df_inode11:00:150
376848220,0sleep20-21swapper/210:40:202
368137220,0sleep00-21swapper/010:20:170
365684221,0sleep10-21swapper/110:15:171
362664220,1sleep10-21swapper/110:10:011
358758220,1sleep20-21swapper/210:00:132
354314220,1sleep2354534-21latency_hist09:50:012
344369220,1sleep1344453-21irqstats09:25:181
339666220,1sleep0339891-21latency_hist09:15:000
336946220,1sleep2337161-21sed09:05:342
335593221,1sleep02645579-21kworker/0:1+events09:03:040
333456220,0sleep00-21swapper/008:55:270
328477220,1sleep0328745-21df08:45:150
318466220,1sleep0318521-21munin-run08:20:010
305041220,1sleep20-21swapper/207:45:172
305041220,1sleep20-21swapper/207:45:172
303741220,1sleep0303891-21ntp_states07:40:190
425862210,0sleep20-21swapper/212:35:232
424945210,0sleep00-21swapper/012:35:170
424569210,0sleep10-21swapper/112:35:141
423196210,0sleep00-21swapper/012:30:210
422453210,0sleep20-21swapper/212:30:032
421486210,0sleep0328-21plymouthd12:25:530
421425210,0sleep20-21swapper/212:25:232
417768210,0sleep10-21swapper/112:20:131
417758210,0sleep00-21swapper/012:20:080
417492210,0sleep20-21swapper/212:20:022
416379210,0sleep00-21swapper/012:15:200
416094210,0sleep2416176-21irqstats12:15:182
415844210,0sleep10-21swapper/112:15:171
414543210,0sleep20-21swapper/212:10:212
414368210,0sleep10-21swapper/112:10:211
413631210,0sleep00-21swapper/012:10:160
412904210,0sleep20-21swapper/212:06:172
412665210,0sleep00-21swapper/012:05:230
412218210,0sleep10-21swapper/112:05:201
410953210,0sleep10-21swapper/112:02:241
410235210,0sleep00-21swapper/012:00:190
409936210,0sleep20-21swapper/212:00:172
409024210,0sleep10-21swapper/111:59:001
408842210,0sleep20-21swapper/211:57:252
407924210,0sleep00-21swapper/011:55:190
405284210,0sleep10-21swapper/111:50:151
405213210,0sleep20-21swapper/211:50:082
403930210,0sleep20-21swapper/211:45:242
403821210,0sleep10-21swapper/111:45:221
401096210,0sleep10-21swapper/111:40:151
401067210,0sleep00-21swapper/011:40:140
400268210,0sleep00-21swapper/011:35:290
399215210,0sleep20-21swapper/211:35:152
399042210,0sleep10-21swapper/111:35:141
397000210,0sleep20-21swapper/211:30:152
396866210,0sleep00-21swapper/011:30:130
396635210,0sleep10-21swapper/111:30:021
395490210,0sleep20-21swapper/211:25:192
394522210,0sleep10-21swapper/111:25:021
394030210,0sleep10-21swapper/111:20:371
394017210,0sleep20-21swapper/211:20:302
393146210,1sleep00-21swapper/011:20:160
392024210,0sleep20-21swapper/211:16:262
390786210,0sleep10-21swapper/111:15:171
390692210,0sleep00-21swapper/011:15:160
388980210,0sleep20-21swapper/211:10:182
387303210,0sleep10-21swapper/111:05:201
387196210,0sleep00-21swapper/011:05:190
386190210,0sleep20-21swapper/211:05:012
385707210,0sleep10-21swapper/111:00:441
384084210,0sleep20-21swapper/211:00:012
383224210,0sleep2383450-21/usr/sbin/munin10:55:212
382441210,0sleep10-21swapper/110:55:161
382244210,0sleep00-21swapper/010:55:070
380853210,0sleep00-21swapper/010:50:190
379393210,0sleep20-21swapper/210:45:242
378090210,0sleep10-21swapper/110:45:151
378085210,0sleep00-21swapper/010:45:140
376084210,0sleep10-21swapper/110:40:151
376003210,0sleep00-21swapper/010:40:140
375126210,0sleep10-21swapper/110:35:231
374615210,0sleep2373887-21/usr/sbin/munin10:35:202
373629210,0sleep00-21swapper/010:35:020
372430210,0sleep20-21swapper/210:30:272
372285210,0sleep10-21swapper/110:30:261
371790210,0sleep00-21swapper/010:30:090
369973210,0sleep10-21swapper/110:25:141
369707210,0sleep20-21swapper/210:25:072
369465210,0sleep00-21swapper/010:25:010
368411210,0sleep20-21swapper/210:20:192
368339210,0sleep10-21swapper/110:20:181
365745210,0sleep20-21swapper/210:15:182
365387210,0sleep00-21swapper/010:15:160
363866210,0sleep20-21swapper/210:10:222
363170210,0sleep00-21swapper/010:10:080
362185210,0sleep10-21swapper/110:05:451
361371210,0sleep00-21swapper/010:05:200
361076210,0sleep20-21swapper/210:05:182
360273210,0sleep10-21swapper/110:02:201
360150210,0sleep00-21swapper/010:01:070
356785210,0sleep20-21swapper/209:55:172
356737210,0sleep10-21swapper/109:55:161
356651210,0sleep0356734-21aten2.4-expect09:55:150
355250210,0sleep20-21swapper/209:50:212
355069210,0sleep10-21swapper/109:50:201
354572210,0sleep00-21swapper/009:50:150
353245210,0sleep00-21swapper/009:45:220
352696210,0sleep10-21swapper/109:45:191
351429210,0sleep0351738-21awk09:40:220
351194210,0sleep20-21swapper/209:40:202
350510210,0sleep10-21swapper/109:40:151
349905210,0sleep20-21swapper/209:39:562
349744210,0sleep00-21swapper/009:38:180
348344210,0sleep10-21swapper/109:35:191
346101210,0sleep20-21swapper/209:30:152
345690210,0sleep00-21swapper/009:30:010
343992210,0sleep20-21swapper/209:25:152
343930210,0sleep00-21swapper/009:25:130
343601210,0sleep10-21swapper/109:24:051
342379210,0sleep20-21swapper/209:20:192
341960210,0sleep00-21swapper/009:20:130
341604210,0sleep00-21swapper/009:19:130
340344210,0sleep20-21swapper/209:15:182
337971210,0sleep10-21swapper/109:10:131
336022210,0sleep10-21swapper/109:05:131
335993210,0sleep00-21swapper/009:05:120
334926210,0sleep10-21swapper/109:00:211
333313210,0sleep20-21swapper/208:55:212
332147210,0sleep10-21swapper/108:55:121
331689210,0sleep00-21swapper/008:52:190
329815210,1sleep10-21swapper/108:47:481
327972210,0sleep00-21swapper/008:43:430
327948210,0sleep20-21swapper/208:43:252
326546210,0sleep10-21swapper/108:40:151
325762210,0sleep10-21swapper/108:35:231
325457210,0sleep00-21swapper/008:35:220
323856210,0sleep00-21swapper/008:30:220
322654210,0sleep10-21swapper/108:30:151
321424210,0sleep20-21swapper/208:25:192
320650210,0sleep00-21swapper/008:25:130
320140210,0sleep00-21swapper/008:21:410
319206210,0sleep20-21swapper/208:20:192
316952210,0sleep20-21swapper/208:15:152
316287210,0sleep10-21swapper/108:15:021
315959210,0sleep00-21swapper/008:10:490
315335210,0sleep20-21swapper/208:10:192
314616210,1sleep10-21swapper/108:10:101
312880210,0sleep00-21swapper/008:05:160
312714210,0sleep20-21swapper/208:05:142
312463210,0sleep10-21swapper/108:05:011
312420210,0sleep20-21swapper/208:04:302
311768210,0sleep00-21swapper/008:00:200
309295210,0sleep10-21swapper/107:55:171
309021210,0sleep00-21swapper/007:55:160
307113210,0sleep10-21swapper/107:50:201
307020210,0sleep00-21swapper/007:50:190
306703210,0sleep20-21swapper/207:50:012
305689210,0sleep00-21swapper/007:45:230
305689210,0sleep00-21swapper/007:45:230
305028210,0sleep10-21swapper/107:45:081
305028210,0sleep10-21swapper/107:45:081
304785210,0sleep20-21swapper/207:45:012
303228210,0sleep10-21swapper/107:40:161
302509210,0sleep00-21swapper/007:36:540
301533210,0sleep20-21swapper/207:35:162
300747210,0sleep20-21swapper/207:33:522
298862210,1sleep10-21swapper/107:29:151
298718210,0sleep20-21swapper/207:27:242
297292210,0sleep00-21swapper/007:25:140
296150210,0sleep20-21swapper/207:20:232
295538210,0sleep10-21swapper/107:20:181
295444210,0sleep00-21swapper/007:20:170
294209210,0sleep20-21swapper/207:15:192
293473210,0sleep10-21swapper/107:15:141
292527210,1sleep00-21swapper/007:12:490
292519210,0sleep20-21swapper/207:12:432
291567210,0sleep10-21swapper/107:10:181
401046200,0sleep20-21swapper/211:40:042
380155200,0sleep20-21swapper/210:50:042
380152200,0sleep10-21swapper/110:50:031
345898200,0sleep10-21swapper/109:30:021
339893200,0sleep10-21swapper/109:15:011
337895200,0sleep20-21swapper/209:10:022
334067200,0sleep20-21swapper/209:00:022
329988200,0sleep20-21swapper/208:50:012
324466200,0sleep20-21swapper/208:35:042
322551200,0sleep20-21swapper/208:30:042
320636200,0sleep10-21swapper/108:25:021
318522200,0sleep10-21swapper/108:20:021
310787200,0sleep10-21swapper/108:00:051
308615200,0sleep20-21swapper/207:55:022
301077200,0sleep10-21swapper/107:35:031
299163200,0sleep10-21swapper/107:30:031
299162200,0sleep00-21swapper/007:30:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional