You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 22:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sun Jun 14, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
313765211751,61sleep30-21swapper/33
77525621140,3sleep2775173-21ssh2
31371427955,7sleep00-21swapper/00
31364727758,11sleep10-21swapper/11
31368627559,10sleep20-21swapper/22
31412599231,18cyclictest763703-21chrt3
4696992220,6sleep0444398-21diskmemload0
31412599221,17cyclictest0-21swapper/33
314125992117,1cyclictest0-21swapper/33
314125992112,5cyclictest6564692chrt3
5298572201,14sleep0444398-21diskmemload0
31412599204,13cyclictest66950irq/132-enp1s0-TxRx-33
314125992018,1cyclictest0-21swapper/33
314125992018,1cyclictest0-21swapper/33
314125992016,2cyclictest0-21swapper/33
31412599201,16cyclictest0-21swapper/33
31412599201,15cyclictest0-21swapper/33
31412599201,15cyclictest0-21swapper/33
31412599200,17cyclictest66950irq/132-enp1s0-TxRx-33
5646462191,9sleep2564660-21apt-get2
314125991915,2cyclictest0-21swapper/33
314125991912,4cyclictest66950irq/132-enp1s0-TxRx-33
31412599191,14cyclictest0-21swapper/33
31412599191,14cyclictest0-21swapper/33
31412599191,14cyclictest0-21swapper/33
31412599191,14cyclictest0-21swapper/33
31412599191,14cyclictest0-21swapper/33
31412599191,14cyclictest0-21swapper/33
31412599191,14cyclictest0-21swapper/33
31412599190,16cyclictest0-21swapper/33
31412599190,16cyclictest0-21swapper/33
6637292181,2sleep10-21swapper/11
31412599189,6cyclictest581116-21turbostat3
31412599181,7cyclictest714236-21taskset3
314125991816,1cyclictest0-21swapper/33
31412599181,5cyclictest66950irq/132-enp1s0-TxRx-33
314125991812,3cyclictest0-21swapper/33
314125991812,3cyclictest0-21swapper/33
314125991812,3cyclictest0-21swapper/33
31412599181,14cyclictest358860-21taskset3
31412599181,14cyclictest0-21swapper/33
31412599181,14cyclictest0-21swapper/33
31412599181,14cyclictest0-21swapper/33
31412599181,14cyclictest0-21swapper/33
31412599181,14cyclictest0-21swapper/33
31412599181,13cyclictest0-21swapper/33
31412599181,13cyclictest0-21swapper/33
31412599180,15cyclictest66950irq/132-enp1s0-TxRx-33
31412599180,15cyclictest422853-21taskset3
31412599180,14cyclictest0-21swapper/33
7719232171,3sleep20-21swapper/22
7509442171,4sleep2752578-21cut2
6300222171,3sleep10-21swapper/11
5876492170,8sleep2444398-21diskmemload2
4932252171,3sleep00-21swapper/00
3967092171,3sleep00-21swapper/00
314125991714,1cyclictest0-21swapper/33
31412599171,13cyclictest0-21swapper/33
31412599171,13cyclictest0-21swapper/33
31412599171,13cyclictest0-21swapper/33
31412599171,13cyclictest0-21swapper/33
31412599171,12cyclictest0-21swapper/33
31412599170,14cyclictest66950irq/132-enp1s0-TxRx-33
31412599170,14cyclictest0-21swapper/33
31412599170,14cyclictest0-21swapper/33
7919892161,4sleep0792011-21apt-get0
7919892161,4sleep0792011-21apt-get0
7811892166,5sleep0151ktimers/00
7667792160,2sleep00-21swapper/00
7569432161,4sleep0444398-21diskmemload0
4922732161,5sleep1444398-21diskmemload1
4778112161,2sleep10-21swapper/11
4593592161,4sleep0444398-21diskmemload0
4593592161,4sleep0444398-21diskmemload0
31412599161,4cyclictest3535932chrt3
31412599161,3cyclictest0-21swapper/33
314125991613,1cyclictest0-21swapper/33
314125991610,4cyclictest0-21swapper/33
31412599160,13cyclictest0-21swapper/33
31412599160,13cyclictest0-21swapper/33
31412599160,13cyclictest0-21swapper/33
31412599160,13cyclictest0-21swapper/33
7997832151,2sleep10-21swapper/11
7997832151,2sleep10-21swapper/11
7014252151,2sleep20-21swapper/22
6745342151,8sleep1674795-21df_inode1
6378512150,6sleep10-21swapper/11
6378512150,6sleep10-21swapper/11
5195612152,9sleep1444398-21diskmemload1
3876922151,10sleep2389453-21cut2
314125991513,1cyclictest0-21swapper/33
314125991512,2cyclictest0-21swapper/33
314125991512,1cyclictest0-21swapper/33
314125991510,2cyclictest0-21swapper/33
314125991510,2cyclictest0-21swapper/33
31412599150,13cyclictest0-21swapper/33
31412599150,12cyclictest0-21swapper/33
31412599150,12cyclictest0-21swapper/33
31412599150,12cyclictest0-21swapper/33
31412599150,12cyclictest0-21swapper/33
7972162141,8sleep2444398-21diskmemload2
7972162141,8sleep2444398-21diskmemload2
6482102141,3sleep2444398-21diskmemload2
6251102141,9sleep2626762-21tr2
4871902141,9sleep2487201-21ssh2
4508712141,2sleep20-21swapper/22
3484962141,8sleep1348567-21munin-run1
31412599141,1cyclictest0-21swapper/33
7655592131,8sleep0444398-21diskmemload0
7327112131,7sleep0444398-21diskmemload0
7140582130,2sleep00-21swapper/00
7131442131,6sleep20-21swapper/22
7048992130,5sleep00-21swapper/00
6026552131,6sleep0602708-21ntpq0
5989882131,4sleep2599331-21grep2
5804212131,8sleep1580434-21sh1
5715422131,3sleep0571552-21ssh0
5368532131,8sleep2444398-21diskmemload2
4771122130,1sleep00-21swapper/00
3528232131,6sleep0352865-21ntpq0
314125991310,1cyclictest0-21swapper/33
31412599130,11cyclictest0-21swapper/33
7912332121,6sleep1444398-21diskmemload1
7819662121,6sleep1444398-21diskmemload1
7474032121,2sleep00-21swapper/00
7385772121,6sleep1444398-21diskmemload1
7384862120,8sleep2738500-21ssh2
7166622121,7sleep1716842-21ssh1
6891272121,7sleep1444398-21diskmemload1
6881872121,7sleep0444398-21diskmemload0
6542642121,2sleep20-21swapper/22
6380602121,6sleep00-21swapper/00
6380602121,6sleep00-21swapper/00
6222712121,6sleep0444398-21diskmemload0
6210612121,3sleep20-21swapper/22
6124352121,7sleep0612440-21ssh0
5359382121,3sleep1535949-21ssh1
5034692121,3sleep1503472-21ssh1
4233502121,5sleep2423369-21apt-get2
4114082121,6sleep1411457-21ntpq1
3594112121,6sleep1359429-21apt1
7908202111,4sleep2444398-21diskmemload2
7647502112,4sleep1444398-21diskmemload1
7625542111,6sleep2762613-21ntp_states2
7420472111,5sleep2742125-21irqstats2
7222662111,4sleep2444398-21diskmemload2
7156522111,7sleep1444398-21diskmemload1
6828462110,2sleep2444398-21diskmemload2
6732832111,6sleep1673293-21ssh1
6573272111,5sleep2657586-21df2
6543962112,4sleep0444398-21diskmemload0
6469732111,6sleep0646985-21ssh0
6323482111,5sleep2632481-21diskstats2
6323482111,5sleep2632481-21diskstats2
5959242111,6sleep2444398-21diskmemload2
5902602111,5sleep0590479-21hddtemp_smartct0
5641512111,4sleep20-21swapper/22
5579262111,5sleep1559626-21grep1
5204272111,4sleep20-21swapper/22
5117482111,4sleep0444398-21diskmemload0
4676772111,3sleep20-21swapper/22
4577252111,5sleep1457783-21ntpq1
4577252111,5sleep1457783-21ntpq1
4518842111,5sleep0444398-21diskmemload0
4510892111,7sleep1451099-21ssh1
4182922111,5sleep1418502-21hddtemp_smartct1
4073942111,4sleep2407627-21df_inode2
3957222111,7sleep0395724-21grep0
3484392111,6sleep0348359-31find0
3257672111,7sleep2325822-21ld2
3257672111,7sleep2325822-21ld2
7841842101,5sleep0785634-21cut0
7728962101,4sleep1444398-21diskmemload1
7561552101,4sleep1444398-21diskmemload1
7458072101,5sleep1745889-21proc_pri1
7297972101,3sleep2444398-21diskmemload2
7212232101,4sleep0444398-21diskmemload0
6957922101,5sleep0695995-21users0
6953282101,4sleep2695370-21ntpq2
6775002101,4sleep2678529-21memory2
6744002101,3sleep00-21swapper/00
6707532101,3sleep20-21swapper/22
6619442101,4sleep0662170-21users0
6546882100,1sleep10-21swapper/11
6454512101,4sleep1444398-21diskmemload1
6297692102,4sleep0629776-21ssh0
6203842100,5sleep10-21swapper/11
6137852101,4sleep2613795-21ssh2
6125262101,3sleep10-21swapper/11
5882452101,4sleep0444398-21diskmemload0
5863962100,1sleep10-21swapper/11
5799392101,2sleep20-21swapper/22
5772672101,5sleep0577320-21ssh0
5721612100,4sleep10-21swapper/11
5610802101,4sleep0444398-21diskmemload0
5532412100,1sleep00-21swapper/00
5532412100,1sleep00-21swapper/00
5468192101,4sleep1444398-21diskmemload1
5446212105,1sleep0221rcuc/00
5326312101,5sleep0534357-21kthreadcore0
5240992101,5sleep2525783-21tr2
5190202101,3sleep00-21swapper/00
5122442101,3sleep10-21swapper/11
5109012101,4sleep2444398-21diskmemload2
5014652101,6sleep0501574-21sed0
4937272101,3sleep20-21swapper/22
4843422101,4sleep10-21swapper/11
4762712101,3sleep20-21swapper/22
4673302101,5sleep1467340-21ssh1
4604502101,4sleep2444398-21diskmemload2
4604502101,4sleep2444398-21diskmemload2
4060382101,4sleep0406095-21ntpq0
3954742101,4sleep1395523-21ntpq1
3901132101,5sleep1390162-21ntpq1
3741652101,4sleep2374215-21ntpq2
3546542100,6sleep0355102-21grep0
3379802101,4sleep2337999-21apt-get2
3313832101,4sleep1331432-21ntpq1
737442291,3sleep0444398-21diskmemload0
729582291,2sleep10-21swapper/11
704667291,3sleep10-21swapper/11
696413291,3sleep1444398-21diskmemload1
671117290,3sleep00-21swapper/00
603779291,3sleep1444398-21diskmemload1
589934291,3sleep1589963-21apt-get1
553152290,5sleep1553166-21ssh1
553152290,5sleep1553166-21ssh1
547685290,1sleep20-21swapper/22
547685290,1sleep20-21swapper/22
539246291,2sleep20-21swapper/22
529776290,1sleep10-21swapper/11
504295291,3sleep2504306-21ssh2
484236290,1sleep00-21swapper/00
432762291,4sleep0432816-21ntpq0
420130291,4sleep0421862-21/usr/sbin/munin0
412778291,3sleep1412981-21diskstats1
402038291,3sleep2402057-21apt-get2
397975291,4sleep1399712-21grep1
376194290,5sleep2377856-21cut2
364502291,3sleep2364524-21munin-run2
327404291,4sleep2327617-21df_inode2
326604290,1sleep00-21swapper/00
326604290,1sleep00-21swapper/00
444382280,1sleep20-21swapper/22
443373281,4sleep0443427-21ntp_kernel_pll_0
428943280,1sleep10-21swapper/11
382931281,3sleep0384614-21sed0
374465281,3sleep0374600-21timerwakeupswit0
314864283,2sleep1314902-21kthreadcore1
444334270,1sleep10-21swapper/11
433691270,1sleep20-21swapper/22
428248270,1sleep10-21swapper/11
417998270,2sleep2418017-21apt-get2
413265271,3sleep0413298-21kthreadcore0
412174270,1sleep00-21swapper/00
396367270,1sleep20-21swapper/22
385532270,1sleep20-21swapper/22
380316272,2sleep1314119-21cyclictest1
374116271,3sleep1374164-21ld1
369796270,1sleep10-21swapper/11
353548270,1sleep10-21swapper/11
348441271,2sleep2348327-31sort2
342777270,2sleep00-21swapper/00
336778270,3sleep10-21swapper/11
333787271,3sleep0335510-21grep0
321679270,2sleep10-21swapper/11
321679270,2sleep10-21swapper/11
319243270,1sleep20-21swapper/22
438791260,1sleep00-21swapper/00
406097260,1sleep10-21swapper/11
401747260,1sleep20-21swapper/22
390018261,2sleep00-21swapper/00
380122260,4sleep00-21swapper/00
369487260,1sleep00-21swapper/00
365333261,2sleep20-21swapper/22
358177260,2sleep10-21swapper/11
353577260,1sleep20-21swapper/22
342117261,2sleep10-21swapper/11
331263260,2sleep00-21swapper/00
437833250,1sleep20-21swapper/22
436064250,1sleep10-21swapper/11
417610250,3sleep20-21swapper/22
381015250,2sleep10-21swapper/11
359405251,2sleep00-21swapper/00
336556250,1sleep2336664-21strings2
318236250,1sleep00-21swapper/00
423131240,1sleep00-21swapper/00
354389240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional