You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 07:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat May 09, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4004371211859,54sleep30-21swapper/33
20558821080,4sleep0221rcuc/00
399965928858,12sleep20-21swapper/22
400450728353,12sleep10-21swapper/11
400431827656,14sleep00-21swapper/00
825682300,1sleep20-21swapper/22
400481299252,20cyclictest66950irq/132-enp1s0-TxRx-33
400481299252,20cyclictest66950irq/132-enp1s0-TxRx-33
1924412242,12sleep244-21ksoftirqd/22
400481299233,15cyclictest260162-21taskset3
400481299232,17cyclictest0-21swapper/33
4004812992311,7cyclictest127319-21turbostat3
400481299222,8cyclictest0-21swapper/33
400481299222,18cyclictest0-21swapper/33
400481299222,17cyclictest0-21swapper/33
400481299222,17cyclictest0-21swapper/33
400481299222,17cyclictest0-21swapper/33
400481299221,17cyclictest4038764-21turbostat3
400481299212,17cyclictest0-21swapper/33
400481299212,17cyclictest0-21swapper/33
400481299212,15cyclictest66950irq/132-enp1s0-TxRx-33
400481299212,15cyclictest0-21swapper/33
4004812992113,5cyclictest0-21swapper/33
400481299211,15cyclictest0-21swapper/33
1860892211,15sleep14135265-21diskmemload1
400481299204,14cyclictest66950irq/132-enp1s0-TxRx-33
400481299204,14cyclictest66950irq/132-enp1s0-TxRx-33
400481299203,14cyclictest0-21swapper/33
400481299202,16cyclictest0-21swapper/33
400481299202,15cyclictest0-21swapper/33
400481299202,15cyclictest0-21swapper/33
400481299202,14cyclictest0-21swapper/33
400481299202,14cyclictest0-21swapper/33
4004812992014,3cyclictest0-21swapper/33
400481299201,17cyclictest0-21swapper/33
400481299201,16cyclictest0-21swapper/33
400481299201,15cyclictest66950irq/132-enp1s0-TxRx-33
400481299201,14cyclictest0-21swapper/33
400481299201,14cyclictest0-21swapper/33
329062201,3sleep20-21swapper/22
2339882201,3sleep20-21swapper/22
41413292191,4sleep00-21swapper/00
400481299193,13cyclictest0-21swapper/33
400481299192,14cyclictest0-21swapper/33
400481299192,12cyclictest4076188-21chrt3
4004812991913,4cyclictest0-21swapper/33
4004812991913,3cyclictest0-21swapper/33
4004812991913,3cyclictest0-21swapper/33
4004812991913,3cyclictest0-21swapper/33
400481299191,15cyclictest0-21swapper/33
400481299191,14cyclictest0-21swapper/33
400481299191,14cyclictest0-21swapper/33
400481299191,14cyclictest0-21swapper/33
400481299191,13cyclictest4092330-21turbostat3
400481299191,13cyclictest0-21swapper/33
400481299191,13cyclictest0-21swapper/33
1858482191,13sleep04135265-21diskmemload0
1100612191,3sleep20-21swapper/22
400481299183,3cyclictest0-21swapper/33
400481299182,13cyclictest66950irq/132-enp1s0-TxRx-33
400481299182,13cyclictest0-21swapper/33
4004812991816,1cyclictest0-21swapper/33
4004812991813,3cyclictest0-21swapper/33
400481299181,14cyclictest0-21swapper/33
2422692181,13sleep14135265-21diskmemload1
1330632181,3sleep00-21swapper/00
727902170,2sleep00-21swapper/00
400481299171,14cyclictest0-21swapper/33
400481299171,13cyclictest4022797-21turbostat3
400481299171,13cyclictest0-21swapper/33
2609172171,3sleep10-21swapper/11
2015872171,3sleep00-21swapper/00
1931692171,3sleep00-21swapper/00
1263522171,12sleep1126363-21ssh1
62772161,3sleep00-21swapper/00
605962161,8sleep060677-21irqstats0
4004812991613,2cyclictest0-21swapper/33
4004812991613,2cyclictest0-21swapper/33
400481299161,13cyclictest0-21swapper/33
400481299161,11cyclictest4010121-21turbostat3
400481299160,13cyclictest0-21swapper/33
2677952161,4sleep14135265-21diskmemload1
239412161,3sleep00-21swapper/00
1659462161,4sleep04135265-21diskmemload0
1524292161,10sleep14135265-21diskmemload1
1335102160,1sleep20-21swapper/22
41909102151,4sleep14135265-21diskmemload1
41842802151,7sleep04184291-21pool-udisksd0
41842802151,7sleep04184291-21pool-udisksd0
409982151,10sleep041009-21ssh0
400481299154,7cyclictest4081974-21taskset3
4004812991512,2cyclictest0-21swapper/33
400481299151,11cyclictest4071022-21turbostat3
4004812991510,4cyclictest0-21swapper/33
4004812991510,3cyclictest0-21swapper/33
400481299150,13cyclictest0-21swapper/33
400481299150,13cyclictest0-21swapper/33
400481299150,13cyclictest0-21swapper/33
2704552151,3sleep00-21swapper/00
2542172151,4sleep04135265-21diskmemload0
1114832151,10sleep2112486-21cut2
923272145,4sleep1331ktimers/11
41689542141,9sleep24135265-21diskmemload2
400481299140,12cyclictest0-21swapper/33
323972141,4sleep032407-21ssh0
1601182140,2sleep10-21swapper/11
940712131,7sleep24135265-21diskmemload2
846382131,8sleep184648-21ssh1
522082137,3sleep20-21swapper/22
41865452131,6sleep24186768-21df_inode2
41774802131,6sleep10-21swapper/11
40177192132,5sleep14017738-21apt-get1
234472130,1sleep20-21swapper/22
2121192131,8sleep1212130-21/usr/sbin/munin1
1403932131,8sleep0140453-21ntpq0
136722131,5sleep113735-21ntp_states1
41857692120,1sleep20-21swapper/22
41857692120,1sleep20-21swapper/22
41510852120,2sleep00-21swapper/00
41329562121,5sleep24134094-21memory2
40819522122,5sleep24081971-21apt-get2
40724612121,7sleep04074215-21cut0
40643482120,2sleep10-21swapper/11
2935422120,1sleep20-21swapper/22
2785692121,7sleep0802-21snmpd0
2702582121,6sleep24135265-21diskmemload2
2536792121,6sleep14135265-21diskmemload1
2258952121,7sleep0225906-21ssh0
2127182121,7sleep2213596-21cut2
1954832120,6sleep10-21swapper/11
1908972121,7sleep1190964-21ld1
1767732120,1sleep00-21swapper/00
1750242121,7sleep14135265-21diskmemload1
1680922121,7sleep1168094-21ssh1
165842121,7sleep04135265-21diskmemload0
1529952121,5sleep04135265-21diskmemload0
1404552121,6sleep1140514-21ntpq1
941592111,5sleep094417-21df_inode0
930312111,4sleep24135265-21diskmemload2
915022111,5sleep04135265-21diskmemload0
753272111,4sleep10-21swapper/11
70582111,3sleep20-21swapper/22
659602111,3sleep10-21swapper/11
602002111,5sleep260371-21diskstats2
492482111,5sleep04135265-21diskmemload0
41701622111,6sleep04170825-21cut0
41587252111,6sleep14158736-21ssh1
41429072111,3sleep20-21swapper/22
41301632112,4sleep04130182-21apt-get0
41032572111,5sleep24103433-21expr2
40913242111,6sleep14091381-21modprobe1
40810482111,4sleep14081292-21users1
40699652111,5sleep14070022-21ntpq1
40593992111,6sleep14059636-21/usr/sbin/munin1
40488372111,5sleep04049054-21users0
40443582111,4sleep14044377-21apt-get1
40430802111,5sleep14043118-21ntpq1
40430802111,5sleep14043118-21ntpq1
40390532111,5sleep24039305-21df2
40390532111,5sleep24039305-21df2
2838552111,5sleep2283906-21ntpq2
2789572111,3sleep10-21swapper/11
2615542111,6sleep24135265-21diskmemload2
2181282110,7sleep00-21swapper/00
2004662111,2sleep20-21swapper/22
1605572111,6sleep24135265-21diskmemload2
160042111,4sleep20-21swapper/22
1276732111,5sleep1127699-21apt-get1
1169482110,2sleep10-21swapper/11
1003412111,6sleep1100355-21ssh1
66142101,4sleep14135265-21diskmemload1
512312101,4sleep04135265-21diskmemload0
504232101,3sleep10-21swapper/11
439152101,5sleep244865-21cut2
41919942101,4sleep04135265-21diskmemload0
41836382101,3sleep10-21swapper/11
41836382101,3sleep10-21swapper/11
41698772101,5sleep24169953-21ssh2
41663042101,3sleep10-21swapper/11
41580612101,4sleep04135265-21diskmemload0
41576582101,3sleep20-21swapper/22
41407682101,6sleep10-21swapper/11
41185582100,2sleep1171rcu_preempt1
41088052101,4sleep04108287-21apt-get0
40933692101,5sleep14095073-21kthreadcore1
40768782101,4sleep04076981-21perl0
40653932101,4sleep24065411-21munin-run2
404112101,3sleep10-21swapper/11
40271182101,5sleep14027173-21ntpq1
40049932101,4sleep04005248-21df0
392672101,3sleep20-21swapper/22
304252101,4sleep130523-21ntpq1
2952662101,3sleep10-21swapper/11
2860712101,3sleep00-21swapper/00
2756992101,4sleep24135265-21diskmemload2
2510962101,4sleep24135265-21diskmemload2
2509082101,3sleep00-21swapper/00
2449662101,5sleep2244980-21ssh2
238112100,1sleep10-21swapper/11
2374302101,4sleep04135265-21diskmemload0
2346472101,4sleep14135265-21diskmemload1
2289322101,5sleep0229057-21grep0
2280622101,4sleep14135265-21diskmemload1
2272392101,3sleep20-21swapper/22
2087212101,4sleep14135265-21diskmemload1
2041802101,3sleep20-21swapper/22
1762702101,4sleep24135265-21diskmemload2
1509762101,3sleep00-21swapper/00
1447012101,5sleep2144964-21df2
1415692100,3sleep20-21swapper/22
1240832101,4sleep24135265-21diskmemload2
1231762101,6sleep0123316-21/usr/sbin/munin0
1111742101,5sleep0111323-21gltestperf0
1073642100,1sleep00-21swapper/00
1021042101,3sleep172-21kcompactd01
76588291,4sleep077034-21apt-config0
73595291,4sleep273609-21ssh2
57288291,2sleep10-21swapper/11
4166523291,3sleep04135265-21diskmemload0
4146064291,4sleep14146418-21kthreadcore1
4127701291,4sleep14128748-21memory1
4119286290,1sleep10-21swapper/11
4119251291,4sleep04119284-21awk0
4103746291,4sleep14103876-21grep1
4097527290,1sleep00-21swapper/00
4071549292,3sleep14071628-21fschecks_time1
4070679290,1sleep00-21swapper/00
4065950291,4sleep24066208-21df_inode2
4054460290,1sleep00-21swapper/00
4048439291,4sleep24048485-21ntpq2
4037650291,4sleep14037740-21gcc1
4032473291,4sleep14032522-21ntpq1
4027175291,4sleep24027228-21ntp_states2
4017741291,4sleep24017957-21expr2
288008291,3sleep04135265-21diskmemload0
286312291,3sleep14135265-21diskmemload1
183486291,3sleep20-21swapper/22
166700290,6sleep20-21swapper/22
4144061281,3sleep20-21swapper/22
4134893280,1sleep10-21swapper/11
4125954281,3sleep00-21swapper/00
4119835280,1sleep20-21swapper/22
4101823281,3sleep14101936-21ntpq1
4098445281,3sleep24099193-21cut2
4095075281,4sleep24096467-21memory2
4060011280,2sleep20-21swapper/22
4056346281,3sleep04058100-21cut0
4033987281,4sleep04034128-21expr0
4033709281,3sleep20-21swapper/22
4028946281,3sleep04029902-21kthreadcore0
4012913281,3sleep14012946-21kthreadcore1
4007857281,3sleep10-21swapper/11
4113707270,1sleep10-21swapper/11
4092094270,1sleep20-21swapper/22
4087275270,2sleep00-21swapper/00
4086950270,1sleep10-21swapper/11
4076597270,2sleep20-21swapper/22
4076216270,1sleep20-21swapper/22
4054701270,1sleep10-21swapper/11
4033121270,1sleep20-21swapper/22
4023046270,2sleep00-21swapper/00
4022622270,1sleep00-21swapper/00
4010603271,3sleep20-21swapper/22
4120550261,2sleep00-21swapper/00
4119215260,4sleep20-21swapper/22
4098166260,3sleep00-21swapper/00
4065339260,1sleep00-21swapper/00
4054487260,1sleep20-21swapper/22
4042940261,2sleep00-21swapper/00
4042940261,2sleep00-21swapper/00
4008933260,2sleep20-21swapper/22
4125203250,1sleep20-21swapper/22
4109003250,1sleep20-21swapper/22
4103053250,1sleep00-21swapper/00
4082184240,1sleep00-21swapper/00
4012342240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional