You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 13:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Tue Jul 14, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
57896721520,2sleep20-21swapper/22
58958421510,2sleep072-21kcompactd00
237497211962,53sleep30-21swapper/33
23769528960,7sleep00-21swapper/00
23757128668,12sleep20-21swapper/22
23755528554,10sleep10-21swapper/11
5115402300,3sleep30-21swapper/33
23796599252,17cyclictest696126-21chrt3
23796599232,13cyclictest617883-21taskset3
23796599221,17cyclictest728544-21chrt3
23796599220,20cyclictest0-21swapper/33
4262442211,14sleep2365790-21diskmemload2
23796599211,3cyclictest0-21swapper/33
23796599211,16cyclictest0-21swapper/33
23796599207,2cyclictest0-21swapper/33
23796599201,15cyclictest0-21swapper/33
23796599199,7cyclictest400986-21taskset3
237965991913,4cyclictest0-21swapper/33
237965991911,5cyclictest0-21swapper/33
23796599191,15cyclictest0-21swapper/33
23796599191,15cyclictest0-21swapper/33
237965991911,4cyclictest0-21swapper/33
23796599191,14cyclictest0-21swapper/33
23796599191,14cyclictest0-21swapper/33
23796599191,14cyclictest0-21swapper/33
23796599191,13cyclictest318914-21chrt3
6782892181,12sleep1678322-21grep1
23796599187,8cyclictest313383-21turbostat3
23796599187,7cyclictest243014-21taskset3
23796599182,13cyclictest66950irq/132-enp1s0-TxRx-33
237965991815,1cyclictest0-21swapper/33
23796599181,4cyclictest0-21swapper/33
23796599181,4cyclictest0-21swapper/33
23796599181,14cyclictest0-21swapper/33
23796599181,14cyclictest0-21swapper/33
23796599181,14cyclictest0-21swapper/33
23796599181,14cyclictest0-21swapper/33
23796599181,14cyclictest0-21swapper/33
23796599181,14cyclictest0-21swapper/33
23796599181,14cyclictest0-21swapper/33
23796599181,14cyclictest0-21swapper/33
23796599181,14cyclictest0-21swapper/33
23796599181,13cyclictest0-21swapper/33
23796599181,13cyclictest0-21swapper/33
23796599181,13cyclictest0-21swapper/33
23796599181,13cyclictest0-21swapper/33
23796599180,15cyclictest0-21swapper/33
23796599180,14cyclictest0-21swapper/33
23796599180,13cyclictest0-21swapper/33
237965991713,3cyclictest66950irq/132-enp1s0-TxRx-33
237965991713,3cyclictest66950irq/132-enp1s0-TxRx-33
23796599171,13cyclictest0-21swapper/33
23796599171,12cyclictest0-21swapper/33
23796599171,12cyclictest0-21swapper/33
237965991710,5cyclictest0-21swapper/33
23796599170,14cyclictest0-21swapper/33
6861582161,3sleep0365790-21diskmemload0
6682082161,4sleep2668221-21ssh2
4413772161,4sleep2441390-21ssh2
4343842161,10sleep2434399-21sshd-auth2
3713232161,11sleep2371337-21ssh2
2758562161,2sleep00-21swapper/00
23796599161,13cyclictest0-21swapper/33
23796599161,12cyclictest0-21swapper/33
237965991610,4cyclictest0-21swapper/33
23796599160,14cyclictest0-21swapper/33
23796599160,13cyclictest0-21swapper/33
23796599160,13cyclictest0-21swapper/33
23796599160,13cyclictest0-21swapper/33
23796599160,13cyclictest0-21swapper/33
7286242150,2sleep10-21swapper/11
6326932150,2sleep00-21swapper/00
6177652151,1sleep00-21swapper/00
4066482150,3sleep1321rcuc/11
4054942151,3sleep20-21swapper/22
23796599158,4cyclictest360404-21chrt3
23796599152,8cyclictest287390-21taskset3
23796599150,12cyclictest0-21swapper/33
23796599150,12cyclictest0-21swapper/33
7211082141,3sleep0721122-21ssh0
5788102141,8sleep1578966-21/usr/sbin/munin1
5551392141,3sleep2365790-21diskmemload2
5545052141,3sleep0554507-21ssh0
4689402142,2sleep1171rcu_preempt1
4581532141,9sleep1458167-21ssh1
3722222140,2sleep10-21swapper/11
23796599149,3cyclictest0-21swapper/33
23796599141,9cyclictest276924-21chrt3
23796599141,2cyclictest0-21swapper/33
23796599141,2cyclictest0-21swapper/33
23796599140,12cyclictest0-21swapper/33
23796599140,12cyclictest0-21swapper/33
7105842131,8sleep2710598-21ssh2
6525622131,7sleep0652586-21apt-get0
6160842131,7sleep1616098-21ssh1
6091372130,2sleep2365790-21diskmemload2
5353902131,7sleep1535483-21ps1
5275452131,8sleep1527560-21ssh1
4686862131,6sleep20-21swapper/22
4495812130,3sleep1449583-21ssh1
4356122130,6sleep10-21swapper/11
4239642131,3sleep0365790-21diskmemload0
3024812130,1sleep10-21swapper/11
23796599130,2cyclictest0-21swapper/33
7191222121,7sleep1719136-21ssh1
7101622121,6sleep0365790-21diskmemload0
6960922122,4sleep2696116-21apt-get2
6704792121,6sleep0669972-21/usr/sbin/munin0
6701012121,5sleep2670295-21diskstats2
6679782120,3sleep0667991-21rm0
6679352121,7sleep1667949-21ssh1
6433662121,3sleep1643376-21ssh1
6010622121,3sleep00-21swapper/00
5984142121,6sleep2365790-21diskmemload2
5814362121,6sleep0365790-21diskmemload0
5738842121,3sleep00-21swapper/00
5661442121,7sleep2566369-21basename2
5653372121,5sleep2365790-21diskmemload2
5475312121,4sleep1547545-21ssh1
5474462121,4sleep20-21swapper/22
5246632121,7sleep0526404-21grep0
5138352121,5sleep2513850-21ssh2
5127302121,7sleep0512742-21ssh0
5007392121,7sleep0500893-21systemctl0
4941732121,6sleep2365790-21diskmemload2
4541162121,7sleep0455656-21tr0
4443142121,5sleep2365790-21diskmemload2
4149362120,8sleep1414950-21ssh1
3975092121,5sleep1365790-21diskmemload1
3900342121,4sleep10-21swapper/11
3806022121,7sleep0380614-21ssh0
3736812121,6sleep0365790-21diskmemload0
3608162121,7sleep0360835-21apt-get0
3454162121,5sleep2345625-21hddtemp_smartct2
3390242121,5sleep1339208-21users1
7177452110,7sleep2717887-21systemctl2
7114992111,4sleep1365790-21diskmemload1
7012482112,4sleep0365790-21diskmemload0
6949562110,2sleep1694970-21ssh1
6924612110,2sleep20-21swapper/22
6836952111,4sleep20-21swapper/22
6518562111,4sleep10-21swapper/11
6488022111,3sleep00-21swapper/00
6487732111,4sleep2365790-21diskmemload2
6178362110,2sleep10-21swapper/11
6079862111,4sleep2365790-21diskmemload2
6065372111,3sleep10-21swapper/11
5885282111,5sleep1365790-21diskmemload1
5657332110,5sleep10-21swapper/11
5639342111,6sleep0563948-21sh0
5285742113,2sleep20-21swapper/22
5214722111,6sleep0521485-21ssh0
5042142111,4sleep2365790-21diskmemload2
5020602110,7sleep1502064-21sh1
4861542111,5sleep0365790-21diskmemload0
4858802111,3sleep20-21swapper/22
4764032111,2sleep00-21swapper/00
4760732112,4sleep2365790-21diskmemload2
4494042111,6sleep0449416-21ssh0
4338402111,5sleep00-21swapper/00
4169412111,6sleep2365790-21diskmemload2
4066322111,7sleep0406647-21ssh0
3996012110,6sleep0365790-21diskmemload0
3984402111,3sleep20-21swapper/22
3908052111,5sleep2365790-21diskmemload2
3896542111,6sleep0389668-21ssh0
3814322111,6sleep1381445-21ssh1
3084702111,5sleep1308683-21df_inode1
2926992111,5sleep2292912-21df_inode2
2873842111,4sleep2287387-21apt-get2
2826172111,5sleep1282706-21irqstats1
2771942111,5sleep1277403-21hddtemp_smartct1
2663832111,5sleep1266642-21df_inode1
2559962111,5sleep0256199-21diskstats0
7221702101,4sleep2722172-21apt-get2
7014172100,2sleep10-21swapper/11
6922272101,4sleep0692241-21ssh0
6595932102,4sleep2659603-21ssh2
6416052100,1sleep00-21swapper/00
6352462101,5sleep2635465-21expr2
6326522101,5sleep1632664-21ssh1
6264112101,3sleep2365790-21diskmemload2
6090902101,4sleep0365790-21diskmemload0
5982482100,2sleep10-21swapper/11
5616862101,5sleep1561931-21/usr/sbin/munin1
5558422101,2sleep10-21swapper/11
5392182101,2sleep00-21swapper/00
5369412101,4sleep2365790-21diskmemload2
5195402101,3sleep10-21swapper/11
5128822101,2sleep10-21swapper/11
5051442101,2sleep20-21swapper/22
4670732101,2sleep00-21swapper/00
4586242101,3sleep2365790-21diskmemload2
4356962101,4sleep0435728-21ssh0
4234642101,2sleep10-21swapper/11
4145152101,4sleep0365790-21diskmemload0
3802702101,5sleep2380282-21ssh2
3556332101,4sleep1355636-21apt-get1
3336372101,5sleep0333868-21tail0
3191842101,4sleep1319393-21hddtemp_smartct1
3142602101,5sleep1315770-21tr1
3133622101,4sleep2313428-21sendmail-msp2
2926252101,3sleep0292645-21apt-get0
2663812101,2sleep00-21swapper/00
2559092101,3sleep20-21swapper/22
2556382100,1sleep20-21swapper/22
728914291,3sleep0365790-21diskmemload0
684039291,3sleep1365790-21diskmemload1
657442291,2sleep10-21swapper/11
623932291,3sleep2365790-21diskmemload2
591694291,4sleep0591391-21sendmail-msp0
583148291,4sleep2583384-21ssh2
544483290,1sleep00-21swapper/00
488179291,2sleep10-21swapper/11
487773291,2sleep00-21swapper/00
471084291,4sleep1472048-21ssh1
432679290,3sleep10-21swapper/11
354689291,4sleep2354934-21uptime2
350649291,4sleep1350746-21perl1
344840290,1sleep10-21swapper/11
344840290,1sleep10-21swapper/11
328775290,1sleep00-21swapper/00
328243291,4sleep2328374-21mailstats2
317726291,4sleep2317840-21/usr/sbin/munin2
260916290,1sleep20-21swapper/22
238791291,4sleep0240393-21cut0
479128281,3sleep1479142-21ssh1
359848281,4sleep0360049-21sed0
346917281,3sleep1348626-21cut1
345698281,3sleep0346915-21kthreadcore0
335191281,3sleep20-21swapper/22
334616280,4sleep00-21swapper/00
329081280,3sleep10-21swapper/11
323855281,3sleep0323874-21latency_hist0
318893280,2sleep20-21swapper/22
303120281,3sleep0303298-21expr0
302787280,1sleep20-21swapper/22
291242280,1sleep10-21swapper/11
286878280,1sleep20-21swapper/22
281614280,1sleep00-21swapper/00
276902280,2sleep20-21swapper/22
272213281,3sleep2272251-21kthreadcore2
271645280,2sleep10-21swapper/11
266040280,1sleep10-21swapper/11
265835280,1sleep00-21swapper/00
250374280,1sleep20-21swapper/22
243193281,3sleep1243574-21df1
360838270,2sleep10-21swapper/11
360492270,1sleep20-21swapper/22
355130270,1sleep00-21swapper/00
339903270,1sleep00-21swapper/00
339903270,1sleep00-21swapper/00
330104271,2sleep20-21swapper/22
329886271,2sleep1330102-21kthreadcore1
307841270,1sleep10-21swapper/11
302285271,3sleep0297862-21/usr/sbin/munin0
293176271,3sleep1293588-21kthreadcore1
271300270,1sleep20-21swapper/22
256200271,2sleep1256399-21gltestperf1
253608270,3sleep10-21swapper/11
251945270,3sleep0253607-21grep0
250065270,1sleep00-21swapper/00
243013270,1sleep20-21swapper/22
361400261,2sleep20-21swapper/22
344558260,1sleep20-21swapper/22
344558260,1sleep20-21swapper/22
313644261,2sleep00-21swapper/00
308419260,3sleep0221rcuc/00
289739261,1sleep00-21swapper/00
240394261,2sleep10-21swapper/11
303392250,1sleep20-21swapper/22
282427251,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional