You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 14:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sat Mar 21, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4187229212060,56sleep30-21swapper/33
418718928556,11sleep10-21swapper/11
418749728262,10sleep20-21swapper/22
418728428051,6sleep00-21swapper/00
4187656992925,2cyclictest0-21swapper/33
4187656992413,7cyclictest66950irq/132-enp1s0-TxRx-33
4187656992320,1cyclictest0-21swapper/33
4187656992320,1cyclictest0-21swapper/33
418765699231,18cyclictest184825-21chrt3
4187656992219,1cyclictest0-21swapper/33
418765699221,17cyclictest226536-21taskset3
418765699220,18cyclictest80988-21taskset3
4187656992117,2cyclictest0-21swapper/33
4187656992114,4cyclictest368337-21taskset3
4187656992112,5cyclictest0-21swapper/33
418765699211,16cyclictest0-21swapper/33
418765699211,16cyclictest0-21swapper/33
418765699211,16cyclictest0-21swapper/33
418765699207,1cyclictest0-21swapper/33
4187656992016,2cyclictest0-21swapper/33
418765699201,16cyclictest66950irq/132-enp1s0-TxRx-33
418765699201,16cyclictest332024-21chrt3
4187656992011,5cyclictest4114362sleep33
418765699201,15cyclictest0-21swapper/33
418765699201,14cyclictest0-21swapper/33
4187656991917,1cyclictest0-21swapper/33
4187656991917,1cyclictest0-21swapper/33
4187656991917,1cyclictest0-21swapper/33
4187656991914,3cyclictest0-21swapper/33
4187656991912,4cyclictest0-21swapper/33
418765699191,15cyclictest0-21swapper/33
418765699191,15cyclictest0-21swapper/33
418765699191,14cyclictest0-21swapper/33
418765699191,14cyclictest0-21swapper/33
4187656991911,3cyclictest0-21swapper/33
418765699190,17cyclictest0-21swapper/33
418765699190,16cyclictest0-21swapper/33
4057512190,4sleep1405964-21diskstats1
3969282192,12sleep20-21swapper/22
4817362181,3sleep10-21swapper/11
418765699183,12cyclictest0-21swapper/33
418765699182,12cyclictest321684-21taskset3
4187656991816,1cyclictest0-21swapper/33
4187656991815,2cyclictest0-21swapper/33
4187656991815,1cyclictest0-21swapper/33
4187656991814,2cyclictest0-21swapper/33
4187656991814,2cyclictest0-21swapper/33
418765699181,14cyclictest0-21swapper/33
418765699181,14cyclictest0-21swapper/33
418765699181,14cyclictest0-21swapper/33
418765699181,14cyclictest0-21swapper/33
418765699181,13cyclictest0-21swapper/33
418765699181,13cyclictest0-21swapper/33
418765699181,13cyclictest0-21swapper/33
418765699181,12cyclictest124229-21sleep3
4187656991810,2cyclictest0-21swapper/33
418765699180,16cyclictest0-21swapper/33
418765699180,14cyclictest0-21swapper/33
418765699178,6cyclictest33128-21turbostat3
418765699178,6cyclictest2699842sleep33
4187656991713,2cyclictest0-21swapper/33
4187656991712,4cyclictest0-21swapper/33
418765699171,13cyclictest0-21swapper/33
418765699170,14cyclictest0-21swapper/33
4032582171,4sleep1124206-21diskmemload1
3763062171,3sleep10-21swapper/11
3596802171,8sleep0359692-21ssh0
1768972171,3sleep00-21swapper/00
1492332171,4sleep1124206-21diskmemload1
4462612161,4sleep1124206-21diskmemload1
4283562161,4sleep1124206-21diskmemload1
418765699165,8cyclictest16968-21turbostat3
418765699161,3cyclictest0-21swapper/33
418765699161,11cyclictest54101-21taskset3
418765699160,13cyclictest0-21swapper/33
418765699160,12cyclictest0-21swapper/33
3579992160,1sleep20-21swapper/22
3349202163,8sleep1335022-21tr1
3051552161,3sleep00-21swapper/00
3051552161,3sleep00-21swapper/00
2807102161,3sleep2124206-21diskmemload2
2114782161,2sleep20-21swapper/22
1764722160,4sleep20-21swapper/22
1566632161,4sleep2124206-21diskmemload2
1318932161,4sleep0124206-21diskmemload0
4639152150,2sleep10-21swapper/11
4187656991510,2cyclictest0-21swapper/33
418765699150,13cyclictest0-21swapper/33
418765699150,12cyclictest0-21swapper/33
3855022151,9sleep1124206-21diskmemload1
3092702151,8sleep1309350-21irqstats1
2884352151,9sleep1124206-21diskmemload1
2818472151,7sleep00-21swapper/00
1830112150,1sleep00-21swapper/00
1761982151,2sleep10-21swapper/11
4377292141,9sleep2437744-21ssh2
418765699146,5cyclictest11663-21sleep3
4187656991411,2cyclictest0-21swapper/33
4187656991410,2cyclictest0-21swapper/33
3237162140,4sleep00-21swapper/00
1417072141,9sleep2141722-21ssh2
4923972131,8sleep2492411-21ssh2
4382822131,8sleep1438293-21ssh1
4286202131,9sleep2428632-21rm2
3508952131,8sleep2350906-21ssh2
2892522131,2sleep2171rcu_preempt2
2739722131,7sleep1124206-21diskmemload1
2700822131,8sleep2270096-21ssh2
2430562131,6sleep2243116-21ntpq2
2342742132,5sleep1234331-21ntpq1
2202722131,7sleep00-21swapper/00
2194582131,7sleep1124206-21diskmemload1
2033172131,3sleep0203331-21ssh0
1950792130,2sleep2171rcu_preempt2
1862562130,5sleep0171rcu_preempt0
1856602131,7sleep1124206-21diskmemload1
973082121,7sleep097352-21systemd-run0
4844812121,5sleep1484513-21ssh1
4534962121,5sleep0453589-21ntpq0
4448552121,5sleep0444898-21ntpq0
41918582121,5sleep24191909-21ntpq2
4135972121,7sleep2413607-21rm2
3878912122,5sleep1387915-21apt-get1
3755202121,5sleep20-21swapper/22
3505552121,7sleep0124206-21diskmemload0
3324062126,3sleep14187651-21cyclictest1
2526942120,2sleep00-21swapper/00
2442382121,7sleep0244250-21ssh0
2265962121,7sleep0226610-21ssh0
1938412124,4sleep2193857-21ssh2
1658082121,7sleep1124206-21diskmemload1
1122272121,5sleep1112275-21ntpq1
963232111,5sleep296372-21ntpq2
815872111,6sleep281750-21cat2
68782111,5sleep27087-21hddtemp_smartct2
67052111,5sleep16877-21diskstats1
661362111,6sleep066433-21cut0
498332111,5sleep049948-21irqstats0
4838602110,2sleep0483874-21ssh0
4544812111,4sleep1124206-21diskmemload1
4218642111,5sleep1124206-21diskmemload1
41881202111,6sleep14188332-21smartctl1
3940982110,3sleep0394105-21ssh0
3579332111,4sleep1124206-21diskmemload1
3423882111,3sleep20-21swapper/22
336722111,5sleep233882-21hddtemp_smartct2
3319862111,5sleep0124206-21diskmemload0
3303802111,5sleep2330438-21ntpq2
3162782111,7sleep2316290-21rm2
3141392111,3sleep00-21swapper/00
3077642111,4sleep1124206-21diskmemload1
3077642111,4sleep1124206-21diskmemload1
3041382111,5sleep2304200-21ntpq2
3041382111,5sleep2304200-21ntpq2
2902952111,4sleep0124206-21diskmemload0
2691882111,5sleep1269250-21ntpq1
2621532111,4sleep1124206-21diskmemload1
2612722111,7sleep0261285-21ssh0
2476442111,6sleep1247737-21cpuspeed_turbos1
2445522111,4sleep1124206-21diskmemload1
2359782111,3sleep20-21swapper/22
2352132111,3sleep00-21swapper/00
213112111,5sleep121365-21ntpq1
2106362111,3sleep00-21swapper/00
2023742111,4sleep1124206-21diskmemload1
1666052111,4sleep0124206-21diskmemload0
1587842111,4sleep1124206-21diskmemload1
1392832111,4sleep10-21swapper/11
1240812110,1sleep20-21swapper/22
1238672110,1sleep10-21swapper/11
922442100,4sleep10-21swapper/11
919612101,4sleep292033-21munin-run2
910132101,5sleep091067-21ntpq0
815652101,3sleep181584-21apt-get1
709512101,3sleep072-21kcompactd00
552452101,5sleep056214-21kthreadcore0
4884952101,5sleep0484482-21/usr/sbin/munin0
4811442101,3sleep20-21swapper/22
4752352101,3sleep1124206-21diskmemload1
4748912101,2sleep20-21swapper/22
4728862101,3sleep00-21swapper/00
4650772101,2sleep00-21swapper/00
4635752101,2sleep20-21swapper/22
4562762101,3sleep20-21swapper/22
440272101,3sleep244046-21apt-get2
4315282100,2sleep0431542-21ssh0
4214422100,2sleep00-21swapper/00
4149112101,6sleep2415038-21/usr/sbin/munin2
4105802100,1sleep00-21swapper/00
3966252101,3sleep00-21swapper/00
3878522101,2sleep20-21swapper/22
3865742101,3sleep20-21swapper/22
3848772101,3sleep0124206-21diskmemload0
3683502101,3sleep00-21swapper/00
3675282101,3sleep20-21swapper/22
3669032101,4sleep1124206-21diskmemload1
3508302100,1sleep10-21swapper/11
3413512101,2sleep00-21swapper/00
3247572101,3sleep1124206-21diskmemload1
2986412101,4sleep1124206-21diskmemload1
2980992101,4sleep2124206-21diskmemload2
2976272101,3sleep00-21swapper/00
2276742101,3sleep1124206-21diskmemload1
2126222101,4sleep2212891-21df_inode2
1856212101,3sleep20-21swapper/22
1496482101,3sleep20-21swapper/22
1403452101,2sleep00-21swapper/00
1291552101,5sleep1124206-21diskmemload1
1078302100,1sleep20-21swapper/22
98668291,4sleep24032188-21kworker/2:0+events2
97570291,3sleep197589-21apt-get1
74998291,4sleep175049-21ld1
54706291,3sleep154963-21df_inode1
51063291,4sleep252868-21cut2
440979291,4sleep2441059-21fschecks_time2
371631291,4sleep0373303-21grep0
33402291,4sleep033567-21expr0
317462291,3sleep2317484-21apt-get2
27594291,4sleep027599-40gst-plugin-scan0
27512291,4sleep127498-31find1
265372291,5sleep0265616-21rm0
263791291,2sleep20-21swapper/22
254245290,2sleep20-21swapper/22
226418291,2sleep20-21swapper/22
209315291,3sleep1124206-21diskmemload1
191884291,4sleep1191898-21ssh1
1746291,4sleep22143-21grep2
165659290,1sleep20-21swapper/22
156228291,4sleep0156242-21ssh0
147446291,3sleep0147460-21ssh0
130149291,5sleep2130162-21rm2
124198291,4sleep0124616-21apt-config0
108789294,2sleep2110306-21kthreadcore2
81037280,1sleep20-21swapper/22
69686281,3sleep169733-21ntpq1
6611281,3sleep06701-21grep0
60280281,2sleep260299-21apt-get2
54149280,2sleep10-21swapper/11
49092281,3sleep149126-21perf1
43766281,3sleep243809-21true2
432538281,3sleep0433466-21grep0
42826281,3sleep142883-21/usr/sbin/munin1
32838280,1sleep20-21swapper/22
28603281,3sleep129945-21cut1
28031281,2sleep00-21swapper/00
27577280,3sleep227498-31find2
16834280,1sleep00-21swapper/00
114124281,3sleep00-21swapper/00
114124281,3sleep00-21swapper/00
104047281,4sleep0105774-21cut0
76266271,2sleep10-21swapper/11
6249270,1sleep10-21swapper/11
39320271,2sleep040969-21kthreadcore0
38184270,1sleep10-21swapper/11
22120270,1sleep20-21swapper/22
17795271,2sleep00-21swapper/00
16072271,3sleep216185-21ps2
107789270,1sleep10-21swapper/11
91782260,1sleep10-21swapper/11
86565260,1sleep00-21swapper/00
76752261,2sleep076849-21ps0
75688260,4sleep20-21swapper/22
65230260,4sleep00-21swapper/00
59525260,4sleep20-21swapper/22
48859260,4sleep00-21swapper/00
4193250261,2sleep00-21swapper/00
4190064261,2sleep00-21swapper/00
115099261,2sleep10-21swapper/11
115099261,2sleep10-21swapper/11
102468260,1sleep00-21swapper/00
69740250,1sleep20-21swapper/22
60250250,1sleep10-21swapper/11
13554250,2sleep1321rcuc/11
112048250,1sleep00-21swapper/00
113276240,1sleep20-21swapper/22
113276240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional