You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 08:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8s.osadl.org (updated Wed Dec 31, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21438919912920,1288cyclictest23721572sleep33
21438919912220,1218cyclictest22684792sleep33
21438919910711,1065cyclictest2442477-21sleep3
24677622210,1sleep00-21swapper/00
24677622210,1sleep00-21swapper/00
2143891991714,1cyclictest0-21swapper/33
2143891991714,1cyclictest0-21swapper/33
23000992161,5sleep22300319-21/usr/sbin/munin2
214389199168,4cyclictest2184580-21turbostat3
2143891991613,1cyclictest0-21swapper/33
2143891991612,2cyclictest2197407-21turbostat3
214389199161,11cyclictest2294437-21turbostat3
214389199156,5cyclictest2539262-21turbostat3
2143891991513,1cyclictest0-21swapper/33
2143891991512,1cyclictest0-21swapper/33
2143891991512,1cyclictest0-21swapper/33
2143891991512,1cyclictest0-21swapper/33
2143891991512,1cyclictest0-21swapper/33
214389199151,11cyclictest2552343-21taskset3
214389199151,11cyclictest2410678-21taskset3
214389199151,11cyclictest2271720-21taskset3
214389199151,10cyclictest2333441-21taskset3
214389199151,10cyclictest2280617-21taskset3
214389199151,10cyclictest2249275-21taskset3
214389199144,7cyclictest23790522sleep33
214389199141,9cyclictest22946762sleep33
214389199141,9cyclictest2159199-21taskset3
2143891991413,0cyclictest0-21swapper/33
2143891991413,0cyclictest0-21swapper/33
2143891991413,0cyclictest0-21swapper/33
2143891991412,1cyclictest0-21swapper/33
2143891991412,0cyclictest0-21swapper/33
2143891991411,1cyclictest0-21swapper/33
214389199141,10cyclictest2526832-21taskset3
214389199141,10cyclictest2497440-21taskset3
214389199141,10cyclictest2391376-21chrt3
214389199141,10cyclictest2342677-21taskset3
214389199141,10cyclictest2261813-21turbostat3
214389199141,10cyclictest2241458-21chrt3
214389199134,7cyclictest2474517-21turbostat3
214389199134,6cyclictest21724122sleep33
214389199132,9cyclictest2448921-21turbostat3
214389199131,9cyclictest2569643-21taskset3
214389199131,9cyclictest2454941-21taskset3
214389199131,9cyclictest2400276-21taskset3
214389199131,9cyclictest2365530-21turbostat3
214389199131,9cyclictest2229864-21taskset3
214389199131,9cyclictest2158188-21taskset3
214389199131,8cyclictest2487643-21taskset3
214389199131,8cyclictest2320125-21turbostat3
214389199131,8cyclictest21440552sleep33
2143891991312,0cyclictest0-21swapper/33
2143891991312,0cyclictest0-21swapper/33
2143891991311,1cyclictest0-21swapper/33
2143891991311,1cyclictest0-21swapper/33
2143891991311,1cyclictest0-21swapper/33
2143891991311,1cyclictest0-21swapper/33
2143891991311,1cyclictest0-21swapper/33
2143891991310,1cyclictest0-21swapper/33
214389199130,10cyclictest2550951-21taskset3
214389199130,10cyclictest2506234-21taskset3
301798120,3rtkit-daemon2150422-21munin-node2
25312672121,3sleep02531774-21memory0
214389199129,1cyclictest0-21swapper/33
214389199121,9cyclictest2539490-21taskset3
214389199121,9cyclictest2423068-21chrt3
214389199121,9cyclictest2222788-21taskset3
214389199121,9cyclictest2190891-21taskset3
214389199121,8cyclictest2404238-21taskset3
214389199120,9cyclictest2281816-21chrt3
214389199120,9cyclictest2281816-21chrt3
214389199120,10cyclictest2206378-21taskset3
301798110,7rtkit-daemon2150422-21munin-node0
301798110,6rtkit-daemon2389730-21cut2
25602372111,7sleep12562146-21cut1
24772262113,2sleep12479328-21kthreadcore1
23014422110,9sleep22301535-21irqcore2
214389199110,9cyclictest2171506-21taskset3
301798100,6rtkit-daemon2150422-21munin-node2
301798100,6rtkit-daemon2150422-21munin-node2
301798100,2rtkit-daemon0-21swapper/22
25459762100,7sleep02546122-21df0
23192852100,7sleep22313925-21/usr/sbin/munin2
21595102100,1sleep12159639-21irqcore1
30179890,5rtkit-daemon636-21snmpd2
30179890,5rtkit-daemon430-21avahi-daemon0
30179890,5rtkit-daemon317-21systemd-udevd0
30179890,5rtkit-daemon2156834-21kthreadcore0
30179890,4rtkit-daemon448-21wpa_supplicant2
30179890,4rtkit-daemon448-21wpa_supplicant0
30179890,4rtkit-daemon2519674-21apt-get2
30179890,4rtkit-daemon2216912-21apt-get2
30179890,4rtkit-daemon2216012-21/usr/sbin/munin2
30179890,3rtkit-daemon492-21gmain0
30179890,3rtkit-daemon2242314-21apt-get2
2547398291,5sleep12548900-21grep1
2429617290,1sleep12429727-21latency_hist1
2409470290,3sleep02409541-21ntp_states0
2327016291,4sleep02327049-21apt-get0
2268483291,5sleep22268484-21cron2
2231722291,5sleep22233795-21kthreadcore2
2230066291,5sleep02230648-21grep0
2197643291,4sleep02197676-21apt-get0
30179880,5rtkit-daemon636-21snmpd2
30179880,5rtkit-daemon413-21rpcbind0
30179880,4rtkit-daemon636-21snmpd2
30179880,4rtkit-daemon636-21snmpd2
30179880,4rtkit-daemon636-21snmpd2
30179880,4rtkit-daemon636-21snmpd2
30179880,4rtkit-daemon636-21snmpd2
30179880,4rtkit-daemon636-21snmpd2
30179880,4rtkit-daemon636-21snmpd2
30179880,4rtkit-daemon636-21snmpd2
30179880,4rtkit-daemon492-21gmain2
30179880,4rtkit-daemon448-21wpa_supplicant2
30179880,4rtkit-daemon448-21wpa_supplicant2
30179880,4rtkit-daemon448-21wpa_supplicant2
30179880,4rtkit-daemon448-21wpa_supplicant0
30179880,4rtkit-daemon2371908-21cat2
30179880,4rtkit-daemon2150422-21munin-node2
30179880,4rtkit-daemon2150422-21munin-node2
30179880,4rtkit-daemon2150422-21munin-node2
30179880,4rtkit-daemon2150422-21munin-node2
30179880,4rtkit-daemon2150422-21munin-node2
30179880,1rtkit-daemon0-21swapper/22
30179880,1rtkit-daemon0-21swapper/22
30179880,1rtkit-daemon0-21swapper/00
2566382280,5sleep12567561-21grep1
2565619281,4sleep02566381-21cut0
2514958281,5sleep12516659-21kthreadcore1
2507098280,5sleep22507287-21if_eno12
2490408280,1sleep02492556-21kthreadcore0
2442725281,4sleep02442757-21apt-get0
2430581281,4sleep22431496-21cat2
2403982281,4sleep02404003-21munin-run0
2392129280,5sleep22393076-21kthreadcore2
2369229281,4sleep12365781-21/usr/sbin/munin1
2363322281,4sleep22364468-21memory2
2339818281,3sleep12339850-21apt-get1
2269462284,2sleep12269006-21/usr/sbin/munin1
2248717280,6sleep12248720-21sshd1
2199982280,5sleep22202101-21kthreadcore2
2190131280,6sleep12190204-21uname1
2177254281,4sleep02177309-21ntp_states0
2140855281,4sleep30-21swapper/33
2139096280,5sleep22140854-21kthreadcore2
2137640281,2sleep10-21swapper/11
30179870,4rtkit-daemon638-21ntpd2
30179870,3rtkit-daemon638-21ntpd2
30179870,3rtkit-daemon638-21ntpd2
30179870,3rtkit-daemon636-21snmpd2
30179870,3rtkit-daemon636-21snmpd2
30179870,3rtkit-daemon636-21snmpd2
30179870,3rtkit-daemon636-21snmpd2
30179870,3rtkit-daemon3205-21sendmail-mta2
30179870,3rtkit-daemon3205-21sendmail-mta2
30179870,3rtkit-daemon3205-21sendmail-mta2
30179870,3rtkit-daemon3200908-21packagekitd2
30179870,3rtkit-daemon297-21systemd-journal2
30179870,3rtkit-daemon297-21systemd-journal2
30179870,3rtkit-daemon2150422-21munin-node2
30179870,3rtkit-daemon2150422-21munin-node2
30179870,2rtkit-daemon2436046-21latency_hist2
2541538270,4sleep22542647-21kthreadcore2
2493077270,4sleep12493282-21grep1
2469872271,3sleep02471888-21kthreadcore0
2449627270,4sleep02450614-21irqstats0
2444181271,3sleep10-21swapper/11
2377489270,4sleep02377612-21sensors_temp0
2320104270,4sleep02320529-21date0
2301085270,1sleep00-21swapper/00
2287286270,4sleep12287412-21sed1
2287286270,4sleep12287412-21sed1
2263785270,4sleep12265311-21cut1
2262329271,3sleep02262362-21apt-get0
2191229271,3sleep12191262-21apt-get1
2164426270,3sleep22164497-21ntp_states2
30179860,3rtkit-daemon492-21gmain2
2564023260,3sleep02564080-21ntp_states0
2539502261,2sleep02539535-21apt-get0
2513502261,2sleep00-21swapper/00
2512823260,1sleep00-21swapper/00
2461682260,4sleep12461864-21latency_hist1
2442140260,1sleep00-21swapper/00
2430269260,3sleep12430580-21sed1
2425311260,3sleep02427359-21grep0
2419250260,3sleep12421315-21cut1
2404276261,3sleep12404432-21diskstats1
2397285260,1sleep00-21swapper/00
2386465261,2sleep10-21swapper/11
2380034260,3sleep02381871-21grep0
2352390260,3sleep02352877-21gpgconf0
2344851260,3sleep02344948-21/usr/sbin/munin0
2296133260,4sleep02297679-21grep0
2293588260,1sleep10-21swapper/11
2288010261,2sleep00-21swapper/00
2288010261,2sleep00-21swapper/00
2255629261,2sleep00-21swapper/00
2236317260,4sleep02236481-21gltestperf0
2204475260,3sleep12205293-21cut1
2198800261,2sleep10-21swapper/11
2192227260,4sleep22192721-21kthreadcore2
2188062260,3sleep20-21swapper/22
2178417261,2sleep20-21swapper/22
2178401260,3sleep12178415-21find1
2177919260,1sleep20-21swapper/22
2158884261,3sleep12158950-21munin-run1
2558297250,1sleep10-21swapper/11
2539193250,1sleep00-21swapper/00
2527103251,2sleep10-21swapper/11
2506555250,1sleep10-21swapper/11
2499549251,2sleep00-21swapper/00
2486659250,3sleep12486820-21cat1
2484337251,2sleep00-21swapper/00
2455920250,2sleep00-21swapper/00
2436286251,1sleep12436319-21apt-get1
2430068250,3sleep02430268-21hddtemp_smartct0
2416670250,1sleep10-21swapper/11
2397824250,2sleep12397857-21apt-get1
2391807251,2sleep10-21swapper/11
2377613250,2sleep10-21swapper/11
2371679250,3sleep02371680-21sshd0
2361266251,2sleep10-21swapper/11
2351702250,2sleep10-21swapper/11
2346202250,1sleep00-21swapper/00
2332276250,3sleep10-21swapper/11
2321075251,2sleep00-21swapper/00
2307048250,1sleep10-21swapper/11
2300549250,1sleep10-21swapper/11
2281389250,1sleep00-21swapper/00
2281345250,1sleep10-21swapper/11
2255296250,1sleep10-21swapper/11
2229073250,1sleep00-21swapper/00
2222992250,2sleep00-21swapper/00
2216909251,2sleep10-21swapper/11
2167054250,3sleep12168759-21grep1
2149487250,3sleep12149572-21/usr/sbin/munin1
2554595240,1sleep00-21swapper/00
2534659241,1sleep10-21swapper/11
2506258240,3sleep00-21swapper/00
2461972240,2sleep12462034-21cpuspeed_turbos1
2461972240,2sleep12462034-21cpuspeed_turbos1
2449195240,1sleep10-21swapper/11
2412776240,1sleep00-21swapper/00
2384657240,1sleep10-21swapper/11
2360303241,1sleep00-21swapper/00
2352878240,1sleep10-21swapper/11
2339389240,3sleep00-21swapper/00
2322015240,2sleep12322114-21kthreadcore1
2315188240,2sleep10-21swapper/11
2313423240,3sleep00-21swapper/00
2289268240,2sleep00-21swapper/00
2274880240,3sleep00-21swapper/00
2255620240,3sleep10-21swapper/11
2249420240,1sleep00-21swapper/00
2230652240,2sleep10-21swapper/11
2223284240,1sleep10-21swapper/11
2216525240,3sleep00-21swapper/00
2173808240,2sleep10-21swapper/11
2165789240,1sleep20-21swapper/22
2155538240,2sleep22157681-21kthreadcore2
2539538230,1sleep10-21swapper/11
2523372230,1sleep10-21swapper/11
2520252230,1sleep00-21swapper/00
2509431230,1sleep10-21swapper/11
2499297230,1sleep10-21swapper/11
2474534230,1sleep00-21swapper/00
2418080230,1sleep00-21swapper/00
2384994230,1sleep00-21swapper/00
2338274230,1sleep10-21swapper/11
2313147230,1sleep10-21swapper/11
2248184230,1sleep00-21swapper/00
2236122230,1sleep10-21swapper/11
2210747230,1sleep10-21swapper/11
2150113230,1sleep20-21swapper/22
2468131220,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional