You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 05:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Aug 15, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2257291212862,61sleep30-21swapper/33
225740928563,12sleep20-21swapper/22
225712528455,10sleep10-21swapper/11
225716327656,14sleep00-21swapper/00
2257625992421,1cyclictest0-21swapper/33
2257625992410,2cyclictest0-21swapper/33
261272122310,4sleep2171rcu_preempt2
225762599239,2cyclictest0-21swapper/33
2257625992321,1cyclictest0-21swapper/33
2257625992320,1cyclictest0-21swapper/33
2257625992219,1cyclictest0-21swapper/33
2257625992219,1cyclictest0-21swapper/33
2257625992217,2cyclictest0-21swapper/33
225762599221,19cyclictest0-21swapper/33
2257625992118,1cyclictest0-21swapper/33
2257625992118,1cyclictest0-21swapper/33
2257625992117,2cyclictest0-21swapper/33
225762599211,16cyclictest25489372sleep33
27429082201,10sleep12742922-21ssh1
26996042201,3sleep20-21swapper/22
225762599209,1cyclictest0-21swapper/33
2257625992018,1cyclictest0-21swapper/33
2257625992018,1cyclictest0-21swapper/33
2257625992018,1cyclictest0-21swapper/33
2257625992018,1cyclictest0-21swapper/33
2257625992018,1cyclictest0-21swapper/33
2257625992017,1cyclictest0-21swapper/33
2257625992017,1cyclictest0-21swapper/33
2257625992012,5cyclictest0-21swapper/33
225762599201,15cyclictest2698379-21chrt3
225762599201,15cyclictest0-21swapper/33
225762599201,15cyclictest0-21swapper/33
225762599201,15cyclictest0-21swapper/33
225762599201,14cyclictest0-21swapper/33
225762599196,2cyclictest0-21swapper/33
225762599195,11cyclictest0-21swapper/33
225762599195,11cyclictest0-21swapper/33
2257625991917,1cyclictest0-21swapper/33
2257625991917,1cyclictest0-21swapper/33
2257625991917,1cyclictest0-21swapper/33
2257625991916,1cyclictest0-21swapper/33
2257625991915,2cyclictest0-21swapper/33
2257625991914,2cyclictest0-21swapper/33
2257625991913,3cyclictest2269916-21chrt3
2257625991913,3cyclictest2269916-21chrt3
225762599191,15cyclictest0-21swapper/33
225762599191,15cyclictest0-21swapper/33
225762599191,15cyclictest0-21swapper/33
24898722180,7sleep20-21swapper/22
2257625991813,3cyclictest0-21swapper/33
2257625991813,3cyclictest0-21swapper/33
225762599181,14cyclictest0-21swapper/33
225762599181,14cyclictest0-21swapper/33
225762599181,14cyclictest0-21swapper/33
225762599181,13cyclictest0-21swapper/33
26442402171,4sleep12385690-21diskmemload1
25496102171,3sleep00-21swapper/00
24177782171,7sleep12385690-21diskmemload1
225762599171,4cyclictest0-21swapper/33
2257625991714,1cyclictest0-21swapper/33
2257625991713,2cyclictest0-21swapper/33
2257625991713,2cyclictest0-21swapper/33
2257625991712,3cyclictest0-21swapper/33
225762599171,13cyclictest0-21swapper/33
225762599171,13cyclictest0-21swapper/33
225762599171,12cyclictest2317282-21taskset3
225762599171,12cyclictest0-21swapper/33
225762599171,12cyclictest0-21swapper/33
225762599170,14cyclictest0-21swapper/33
225762599170,14cyclictest0-21swapper/33
26558752161,10sleep12655942-21munin-run1
26022452161,2sleep20-21swapper/22
25752932161,7sleep22385690-21diskmemload2
25483562161,9sleep12548367-21ssh1
25332842161,2sleep00-21swapper/00
25146142161,4sleep12385690-21diskmemload1
24441492161,5sleep22385690-21diskmemload2
241830621611,2sleep22359139-21kworker/2:2+events_freezable2
225762599168,5cyclictest2384729-21taskset3
225762599164,8cyclictest2338682-21taskset3
2257625991613,1cyclictest0-21swapper/33
2257625991613,1cyclictest0-21swapper/33
2257625991612,2cyclictest0-21swapper/33
225762599160,13cyclictest0-21swapper/33
26577722151,9sleep22659362-21kthreadcore2
26437422151,3sleep20-21swapper/22
26277662151,2sleep10-21swapper/11
25241232152,8sleep22385690-21diskmemload2
24966812151,3sleep02385690-21diskmemload0
2257625991513,1cyclictest0-21swapper/33
2257625991511,2cyclictest0-21swapper/33
225762599150,12cyclictest0-21swapper/33
27091142141,8sleep12385690-21diskmemload1
26033052141,2sleep12385690-21diskmemload1
26001772141,8sleep02385690-21diskmemload0
25401372140,2sleep00-21swapper/00
25047462141,8sleep22504756-21ssh2
24800852141,7sleep12385690-21diskmemload1
23802222140,1sleep00-21swapper/00
23333602141,9sleep22333141-21sendmail-msp2
23246932141,2sleep00-21swapper/00
225762599147,3cyclictest0-21swapper/33
27507192131,8sleep22750733-21ssh2
27159752130,3sleep1321rcuc/11
27084532131,8sleep22385690-21diskmemload2
27017892131,5sleep00-21swapper/00
26725522131,3sleep12672564-21ssh1
26719802131,7sleep02385690-21diskmemload0
26363142131,8sleep22636329-21ssh2
25935582131,8sleep12385690-21diskmemload1
25927682130,1sleep20-21swapper/22
25656872131,7sleep22385690-21diskmemload2
24994392132,6sleep12499461-21apt-get1
24949582131,8sleep12495127-21systemctl1
24801142131,6sleep00-21swapper/00
24727822131,3sleep20-21swapper/22
24626962131,8sleep02385690-21diskmemload0
24521532131,5sleep12385690-21diskmemload1
27282632121,5sleep22385690-21diskmemload2
26789852121,5sleep00-21swapper/00
26201202121,7sleep02620134-21ssh0
25829522122,2sleep2171rcu_preempt2
25580922121,7sleep02385690-21diskmemload0
25571942121,7sleep12557205-21ssh1
25325692121,7sleep12532582-21ssh1
25230902121,3sleep12385690-21diskmemload1
24997692121,7sleep02499940-21ssh0
24085712121,7sleep22408583-21sh2
23900592121,7sleep12385690-21diskmemload1
23488652121,7sleep22349060-21date2
22954362121,7sleep12291333-21/usr/sbin/munin1
22861602121,5sleep22286363-21diskstats2
22814052121,7sleep12282282-21grep1
22718642121,7sleep22273318-21cut2
22718642121,7sleep22273318-21cut2
27382122111,6sleep22739798-21cut2
27270322111,4sleep22385690-21diskmemload2
27016952111,3sleep10-21swapper/11
26916002110,2sleep20-21swapper/22
26875252111,5sleep12688673-21sed1
26845232111,6sleep02682260-40find0
26722112110,7sleep22672222-21ssh2
26634932111,7sleep12385690-21diskmemload1
26384762111,5sleep02385690-21diskmemload0
26365652110,2sleep10-21swapper/11
26301772111,6sleep02630331-21expr0
26085472110,1sleep10-21swapper/11
25757992111,5sleep12385690-21diskmemload1
25676702111,3sleep10-21swapper/11
25572062111,5sleep22385690-21diskmemload2
25474542111,5sleep22542690-21sendmail-msp2
25410292111,3sleep20-21swapper/22
25316762112,3sleep22385690-21diskmemload2
25250802111,2sleep00-21swapper/00
24884122111,3sleep00-21swapper/00
24608142110,6sleep12385690-21diskmemload1
24452792111,6sleep12385690-21diskmemload1
24356512110,5sleep00-21swapper/00
24347992110,7sleep22434809-21ssh2
24084022110,5sleep12385690-21diskmemload1
23988672111,6sleep02398933-21/usr/sbin/munin0
23915502111,3sleep20-21swapper/22
23777542111,6sleep22379339-21latency2
23513512111,6sleep12349137-21/usr/sbin/munin1
23391712111,6sleep22339330-21kthreadcore2
23334872111,5sleep12333656-21diskstats1
23231292111,5sleep12323339-21hddtemp_smartct1
22651492111,5sleep12265360-21diskstats1
22651492111,5sleep12265360-21diskstats1
27539422101,2sleep10-21swapper/11
27510512100,1sleep00-21swapper/00
27336172101,4sleep02385690-21diskmemload0
27276772101,4sleep02385690-21diskmemload0
27195342101,5sleep12719805-21ssh1
27165132101,4sleep02385690-21diskmemload0
26765562101,4sleep22677608-21memory2
26633262101,2sleep00-21swapper/00
26481652101,6sleep22649091-21cut2
26267982100,1sleep20-21swapper/22
26159142101,4sleep12616777-21memory1
26121452100,1sleep20-21swapper/22
26043022101,4sleep02604522-21hddtemp_smartct0
25931452100,4sleep00-21swapper/00
25827182101,3sleep00-21swapper/00
25751712101,3sleep00-21swapper/00
25607772101,5sleep02560978-21sed0
25161202101,3sleep22385690-21diskmemload2
25151652100,6sleep02515179-21ssh0
24791172101,4sleep22385690-21diskmemload2
24716132101,4sleep02385690-21diskmemload0
24687502101,6sleep10-21swapper/11
24634472100,1sleep20-21swapper/22
24537032101,3sleep20-21swapper/22
24529062101,2sleep00-21swapper/00
24407512101,5sleep02442308-21grep0
24296742101,5sleep12429883-21cat1
24209232101,3sleep20-21swapper/22
24209232101,3sleep20-21swapper/22
24122172101,3sleep00-21swapper/00
24048192101,5sleep02406286-21cut0
23863912101,5sleep02386485-21ssh0
23807342100,2sleep10-21swapper/11
23690942101,4sleep02369241-21find0
23596922101,4sleep22359704-21apt-get2
23586482100,6sleep22358830-21sed2
23284002101,4sleep02328610-21hddtemp_smartct0
23123522101,6sleep20-21swapper/22
22913252101,5sleep22291106-21sendmail-msp2
22756022101,4sleep02275621-21apt-get0
22703402101,5sleep12270465-21cut1
22703402101,5sleep12270465-21cut1
22635032101,4sleep02264815-21df0
22635032101,4sleep02264815-21df0
22621702101,5sleep02262379-21head0
2741967291,2sleep00-21swapper/00
2717006291,2sleep20-21swapper/22
2699572291,2sleep00-21swapper/00
2678544291,5sleep12385690-21diskmemload1
2647864291,4sleep02648037-21ssh0
2622008291,4sleep02622160-21grep0
2534313291,3sleep12385690-21diskmemload1
2486842291,4sleep12486853-21ssh1
2425964291,2sleep10-21swapper/11
2425964291,2sleep10-21swapper/11
2420897291,3sleep02385690-21diskmemload0
2420897291,3sleep02385690-21diskmemload0
2401902290,1sleep20-21swapper/22
2395398291,4sleep12396833-21tr1
2376279291,4sleep12377753-21tr1
2375151292,3sleep02375423-21latency_hist0
2364004291,4sleep12364251-21uptime1
2333937291,4sleep02334672-21grep0
2328105291,3sleep12328124-21apt-get1
2328092291,3sleep22327816-21apt-get2
2327801291,3sleep2555-21dbus-daemon2
2315006291,4sleep02312102-21sendmail-msp0
2296645291,4sleep12296788-21cut1
2286074291,2sleep00-21swapper/00
2285805291,4sleep21-21systemd2
2728443281,3sleep12728662-21ssh1
2585905281,3sleep10-21swapper/11
2497787281,3sleep22497798-21ssh2
2385620280,1sleep20-21swapper/22
2370200280,2sleep20-21swapper/22
2344467281,3sleep02345573-21cat0
2318522281,4sleep12320143-21kthreadcore1
2312330281,2sleep12312349-21apt-get1
2306443281,4sleep12306444-21sshd-session1
2302127281,4sleep02302299-21sed0
2296623281,2sleep00-21swapper/00
2291334281,2sleep02291352-21apt-get0
2274248281,3sleep02270091-21sendmail-msp0
2274248281,3sleep02270091-21sendmail-msp0
2385314270,1sleep00-21swapper/00
2369818270,1sleep20-21swapper/22
2364267270,1sleep00-21swapper/00
2359367270,1sleep00-21swapper/00
2354000270,1sleep20-21swapper/22
2349751271,3sleep02351349-21kthreadcore0
2348675270,4sleep10-21swapper/11
2342851271,3sleep02343002-21grep0
2322492270,1sleep20-21swapper/22
2317626270,2sleep02317622-21apt-get0
2311857270,1sleep20-21swapper/22
2311124271,3sleep10-21swapper/11
2307071270,1sleep00-21swapper/00
2302409271,3sleep20-21swapper/22
2290819270,1sleep10-21swapper/11
2276242271,3sleep10-21swapper/11
2354383260,1sleep10-21swapper/11
2296789260,2sleep20-21swapper/22
2280837260,1sleep00-21swapper/00
2277746260,2sleep20-21swapper/22
2269782260,1sleep20-21swapper/22
2269782260,1sleep20-21swapper/22
2262679260,1sleep10-21swapper/11
2259339261,2sleep20-21swapper/22
2370199250,1sleep10-21swapper/11
2364899250,1sleep10-21swapper/11
2338960250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional