You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 19:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot8s.osadl.org (updated Thu Dec 11, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
288369911791,1173cyclictest198237-21sleep3
288369911730,1169cyclictest3198642sleep33
288369911350,1130cyclictest384570-21sleep3
28836994100,406cyclictest255143-21turbostat3
28836992522,1cyclictest0-21swapper/33
4813902211,7sleep0481557-21cat0
28836992118,1cyclictest0-21swapper/33
28836991916,1cyclictest0-21swapper/33
2363522181,13sleep2236482-21python32
2883699177,7cyclictest311811-21turbostat3
2883699176,8cyclictest106613-21turbostat3
28836991611,2cyclictest1559462sleep33
2475682161,12sleep0247774-21hddtemp_smartct0
4230442150,6sleep2423054-21ssh2
2883699155,8cyclictest144230-21turbostat3
2883699155,7cyclictest392584-21turbostat3
28836991513,1cyclictest0-21swapper/33
28836991513,1cyclictest0-21swapper/33
28836991513,1cyclictest0-21swapper/33
28836991513,0cyclictest0-21swapper/33
28836991512,1cyclictest0-21swapper/33
28836991512,1cyclictest0-21swapper/33
28836991512,1cyclictest0-21swapper/33
28836991512,1cyclictest0-21swapper/33
28836991512,1cyclictest0-21swapper/33
2883699151,11cyclictest94330-21taskset3
2883699151,11cyclictest497030-21taskset3
2883699151,11cyclictest497030-21taskset3
2883699151,11cyclictest28976-21taskset3
2883699150,12cyclictest119228-21taskset3
2883699150,11cyclictest367633-21taskset3
190898150,4rtkit-daemon511755-21ssh0
2883699144,7cyclictest4729792sleep33
28836991413,0cyclictest0-21swapper/33
28836991413,0cyclictest0-21swapper/33
28836991412,1cyclictest0-21swapper/33
28836991412,1cyclictest0-21swapper/33
28836991412,0cyclictest0-21swapper/33
28836991411,1cyclictest0-21swapper/33
28836991411,1cyclictest0-21swapper/33
28836991411,1cyclictest0-21swapper/33
28836991411,1cyclictest0-21swapper/33
2883699141,10cyclictest86885-21chrt3
2883699141,10cyclictest513855-21chrt3
2883699141,10cyclictest455678-21taskset3
2883699141,10cyclictest425054-21taskset3
2883699141,10cyclictest414950-21taskset3
2883699141,10cyclictest400823-21taskset3
2883699141,10cyclictest344519-21taskset3
2883699141,10cyclictest287801-21taskset3
2883699141,10cyclictest228736-21taskset3
2883699141,10cyclictest169949-21taskset3
190898140,9rtkit-daemon197432-21ssh0
190898140,10rtkit-daemon667-21snmpd2
2883699135,6cyclictest5130502sleep33
2883699131,9cyclictest462359-21taskset3
2883699131,9cyclictest298455-21taskset3
2883699131,9cyclictest169290-21taskset3
28836991312,0cyclictest0-21swapper/33
28836991311,1cyclictest0-21swapper/33
28836991310,1cyclictest0-21swapper/33
28836991310,1cyclictest0-21swapper/33
28836991310,1cyclictest0-21swapper/33
2883699130,10cyclictest93967-21taskset3
2883699130,10cyclictest68919-21taskset3
2883699130,10cyclictest441313-21taskset3
2883699130,10cyclictest368725-21taskset3
2883699130,10cyclictest328280-21taskset3
2883699130,10cyclictest276627-21taskset3
2883699130,10cyclictest253161-21chrt3
1183242131,8sleep1118449-21python31
756822120,5sleep076670-21kernelversion0
559482120,10sleep256037-21wc2
5207122121,3sleep1520718-21ssh1
4877262121,8sleep1487732-21ssh1
2883699121,9cyclictest176225-21taskset3
2883699120,9cyclictest416962-21taskset3
2883699120,9cyclictest342321-21chrt3
2883699120,10cyclictest61866-21taskset3
286822121,6sleep128703-21munin-run1
2798522120,4sleep2279889-21apt-get2
2946012111,7sleep1294609-21ssh1
228862111,7sleep00-21swapper/00
190898110,6rtkit-daemon175714-21chrt2
190898110,6rtkit-daemon132940-21irqrtprio2
190898110,4rtkit-daemon351643-21ssh1
689312100,3sleep00-21swapper/00
4415502101,2sleep10-21swapper/11
3997932100,8sleep2399801-21ssh2
3819792100,7sleep0382062-21ntp_states0
3358762100,7sleep2335884-21ssh2
226992101,4sleep20-21swapper/22
190898100,6rtkit-daemon489879-21cut1
190898100,6rtkit-daemon489879-21cut1
190898100,6rtkit-daemon449087-21ssh0
190898100,6rtkit-daemon286134-21ssh0
190898100,3rtkit-daemon667-21snmpd0
190898100,3rtkit-daemon35218-21munin-node1
1005902101,5sleep2100623-21apt-get2
521482290,1sleep0521489-21sh0
51813290,2sleep053913-21cut0
503237290,7sleep0503487-21users0
465345291,4sleep1465501-21diskstats1
325999290,1sleep00-21swapper/00
263678291,5sleep2263878-21grep2
19089890,5rtkit-daemon438-21wpa_supplicant0
19089890,5rtkit-daemon362176-21irqstats0
19089890,4rtkit-daemon448294-21ssh0
19089890,4rtkit-daemon226262-21cut1
19089890,4rtkit-daemon222655-21ssh1
19089890,3rtkit-daemon667-21snmpd2
19089890,3rtkit-daemon204494-21ssh0
145949291,5sleep1147770-21tr1
89887283,3sleep191968-21kthreadcore1
56399281,5sleep056599-21hddtemp_smartct0
480903280,5sleep1480911-21ssh1
459170281,4sleep1461180-21cut1
43835280,5sleep143892-21fschecks_count1
416267280,5sleep0416275-21ssh0
41028281,4sleep042337-21memory0
360092281,4sleep2360101-21ssh2
343939280,6sleep0343947-21ssh0
309335281,4sleep0309450-21/usr/sbin/munin0
263501280,1sleep00-21swapper/00
231029281,3sleep0231051-21apt-get0
212382280,6sleep2212515-21ssh2
19089880,5rtkit-daemon674-21lldpd2
19089880,5rtkit-daemon667-21snmpd2
19089880,5rtkit-daemon1928-21sendmail-mta0
19089880,5rtkit-daemon182244-21diskmemload1
19089880,4rtkit-daemon98197-21kthreadcore2
19089880,4rtkit-daemon81364-21packagekitd2
19089880,4rtkit-daemon81364-21packagekitd0
19089880,4rtkit-daemon81364-21packagekitd0
19089880,4rtkit-daemon667-21snmpd2
19089880,4rtkit-daemon667-21snmpd1
19089880,4rtkit-daemon667-21snmpd1
19089880,4rtkit-daemon667-21snmpd0
19089880,4rtkit-daemon423-21dbus-daemon0
19089880,4rtkit-daemon407297-21ssh1
19089880,4rtkit-daemon400312-21ssh1
19089880,4rtkit-daemon35218-21munin-node2
19089880,4rtkit-daemon35218-21munin-node2
19089880,3rtkit-daemon81781-21apt-get2
19089880,1rtkit-daemon0-21swapper/22
19089880,1rtkit-daemon0-21swapper/00
150983280,5sleep1151183-21idleruntime1
138205280,1sleep00-21swapper/00
113157281,4sleep0113242-21tr0
75398270,4sleep275549-21gltestperf2
56204270,4sleep156231-21basename1
511921270,1sleep10-21swapper/11
505413271,3sleep1505425-21cron1
487785270,1sleep00-21swapper/00
383725270,5sleep2383732-21diskmemload2
376521270,1sleep10-21swapper/11
376284271,3sleep2376292-21ssh2
367316270,4sleep2367324-21ssh2
343466270,4sleep2343474-21ssh2
318260270,5sleep0318265-21sh0
29978271,4sleep131090-21kthreadcore1
296402271,3sleep1297322-21sed1
293960270,5sleep2293968-21ssh2
24152270,4sleep30-21swapper/33
204412270,1sleep10-21swapper/11
19089870,4rtkit-daemon674-21lldpd0
19089870,4rtkit-daemon671-21ntpd2
19089870,4rtkit-daemon667-21snmpd2
19089870,4rtkit-daemon35218-21munin-node2
19089870,4rtkit-daemon35218-21munin-node2
19089870,4rtkit-daemon35218-21munin-node1
19089870,4rtkit-daemon1928-21sendmail-mta2
19089870,3rtkit-daemon671-21ntpd2
19089870,3rtkit-daemon671-21ntpd2
19089870,3rtkit-daemon671-21ntpd2
19089870,3rtkit-daemon671-21ntpd1
19089870,3rtkit-daemon667-21snmpd2
19089870,3rtkit-daemon667-21snmpd2
19089870,3rtkit-daemon667-21snmpd1
19089870,3rtkit-daemon473-21gmain0
19089870,3rtkit-daemon359157-21ssh1
19089870,3rtkit-daemon35218-21munin-node2
19089870,3rtkit-daemon35218-21munin-node0
19089870,3rtkit-daemon35218-21munin-node0
19089870,3rtkit-daemon320715-21ssh1
19089870,3rtkit-daemon319-21systemd-udevd0
19089870,3rtkit-daemon304442-21ssh2
19089870,3rtkit-daemon1928-21sendmail-mta1
153244270,4sleep0155402-21kthreadcore0
126045270,4sleep1126182-21sort1
513824260,4sleep2513852-21acpi2
505689260,1sleep20-21swapper/22
495996260,4sleep2496004-21ssh2
495996260,4sleep2496004-21ssh2
488041260,1sleep20-21swapper/22
475507262,2sleep2477520-21kthreadcore2
442176261,3sleep2443314-21kthreadcore2
43688260,3sleep043834-21df0
431003260,1sleep20-21swapper/22
360680260,2sleep1360721-21apt-get1
336440261,2sleep10-21swapper/11
333509260,3sleep1333594-21ssh1
326242260,1sleep20-21swapper/22
319427260,3sleep2319435-21ssh2
302247260,4sleep20-21swapper/22
285980260,3sleep1285988-21ssh1
279057260,3sleep2279064-21sh2
273235260,4sleep1274515-21kthreadcore1
264998260,3sleep1266991-21cut1
261737261,2sleep10-21swapper/11
254378260,3sleep2254386-21ssh2
240268260,4sleep1241449-21kthreadcore1
238286261,3sleep1238292-21ssh1
229163260,1sleep20-21swapper/22
222145260,1sleep20-21swapper/22
204754260,3sleep20-21swapper/22
19089860,3rtkit-daemon671-21ntpd0
19089860,3rtkit-daemon671-21ntpd0
19089860,2rtkit-daemon299-21systemd-journal0
182233260,3sleep1182288-21latency_hist1
112174260,4sleep1112342-21wc1
94344250,2sleep10-21swapper/11
93758250,1sleep00-21swapper/00
81641250,3sleep00-21swapper/00
76673251,2sleep10-21swapper/11
68486250,3sleep00-21swapper/00
55610250,1sleep10-21swapper/11
505293250,3sleep2182244-21diskmemload2
472593251,2sleep2472599-21ssh2
454990250,1sleep10-21swapper/11
435272250,3sleep1437308-21kthreadcore1
434139250,2sleep0435271-21grep0
410452250,3sleep2412098-21kthreadcore2
407573250,2sleep272-21kcompactd02
407377250,3sleep00-21swapper/00
387391251,2sleep1358498-21kworker/u16:0+rpciod1
349782250,3sleep00-21swapper/00
28988250,2sleep029021-21apt-get0
256855251,2sleep20-21swapper/22
254986250,3sleep10-21swapper/11
239032250,3sleep2239040-21ssh2
217369251,2sleep00-21swapper/00
190461252,1sleep20-21swapper/22
175630250,1sleep00-21swapper/00
165463250,2sleep1167528-21kthreadcore1
164568250,3sleep0165462-21grep0
163284250,1sleep00-21swapper/00
157317251,1sleep10-21swapper/11
150366250,1sleep00-21swapper/00
143949250,1sleep10-21swapper/11
137669250,1sleep10-21swapper/11
119726252,1sleep00-21swapper/00
112619250,3sleep00-21swapper/00
105772250,2sleep0105897-21python30
87033241,1sleep10-21swapper/11
464681240,2sleep2464689-21ssh2
449078240,1sleep20-21swapper/22
423962240,3sleep00-21swapper/00
384799240,2sleep2384807-21ssh2
374731240,2sleep1331ktimers/11
178474240,1sleep00-21swapper/00
132952240,2sleep0221rcuc/00
131402240,3sleep00-21swapper/00
125337240,3sleep10-21swapper/11
100893240,2sleep10-21swapper/11
100295240,2sleep00-21swapper/00
68655230,1sleep10-21swapper/11
62435230,1sleep10-21swapper/11
425029230,1sleep00-21swapper/00
35061230,1sleep10-21swapper/11
182492230,1sleep00-21swapper/00
174266230,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional