You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 13:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Mon May 04, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3905612212252,65sleep30-21swapper/33
390575928758,11sleep10-21swapper/11
390543828762,16sleep20-21swapper/22
390572727756,15sleep00-21swapper/00
278392300,3sleep10-21swapper/11
3905887992623,2cyclictest0-21swapper/33
390588799231,18cyclictest79102-21taskset3
390588799231,13cyclictest252782sleep33
390588799221,3cyclictest0-21swapper/33
390588799221,3cyclictest0-21swapper/33
390588799221,17cyclictest4042808-21taskset3
39606292211,15sleep13960873-21users1
390588799207,8cyclictest66950irq/132-enp1s0-TxRx-33
390588799203,13cyclictest0-21swapper/33
3905887992016,2cyclictest0-21swapper/33
390588799201,16cyclictest0-21swapper/33
390588799201,15cyclictest0-21swapper/33
1858552201,8sleep14036141-21diskmemload1
41316562191,7sleep14133326-21cut1
390588799199,7cyclictest0-21swapper/33
390588799191,5cyclictest0-21swapper/33
3905887991915,2cyclictest0-21swapper/33
390588799191,15cyclictest4024718-21taskset3
390588799191,15cyclictest0-21swapper/33
390588799191,15cyclictest0-21swapper/33
390588799191,14cyclictest3911118-21chrt3
390588799191,14cyclictest0-21swapper/33
390588799191,14cyclictest0-21swapper/33
390588799191,13cyclictest4031074-21chrt3
41623532181,6sleep24162364-21ssh2
3905887991812,5cyclictest0-21swapper/33
390588799181,14cyclictest0-21swapper/33
390588799181,14cyclictest0-21swapper/33
390588799181,14cyclictest0-21swapper/33
390588799181,14cyclictest0-21swapper/33
390588799181,14cyclictest0-21swapper/33
390588799181,14cyclictest0-21swapper/33
390588799181,14cyclictest0-21swapper/33
390588799181,13cyclictest3950267-21taskset3
390588799181,13cyclictest0-21swapper/33
390588799181,13cyclictest0-21swapper/33
390588799181,13cyclictest0-21swapper/33
390588799181,13cyclictest0-21swapper/33
390588799181,13cyclictest0-21swapper/33
390588799181,13cyclictest0-21swapper/33
390588799181,13cyclictest0-21swapper/33
3905887991810,5cyclictest66950irq/132-enp1s0-TxRx-33
390588799180,15cyclictest0-21swapper/33
390588799180,14cyclictest0-21swapper/33
390588799180,14cyclictest0-21swapper/33
3905887991713,1cyclictest0-21swapper/33
3905887991711,3cyclictest0-21swapper/33
390588799171,13cyclictest0-21swapper/33
390588799171,13cyclictest0-21swapper/33
390588799171,13cyclictest0-21swapper/33
390588799171,13cyclictest0-21swapper/33
390588799171,12cyclictest0-21swapper/33
390588799170,14cyclictest0-21swapper/33
390588799170,13cyclictest0-21swapper/33
1194472170,2sleep10-21swapper/11
41278052161,2sleep10-21swapper/11
41211452161,3sleep00-21swapper/00
41200242160,8sleep14036141-21diskmemload1
40614752162,9sleep14061505-21munin-run1
390588799169,5cyclictest0-21swapper/33
390588799161,12cyclictest0-21swapper/33
390588799161,12cyclictest0-21swapper/33
390588799160,13cyclictest0-21swapper/33
390588799160,13cyclictest0-21swapper/33
390588799160,13cyclictest0-21swapper/33
390588799160,13cyclictest0-21swapper/33
248362160,1sleep20-21swapper/22
935632151,3sleep24036141-21diskmemload2
91942151,8sleep24036141-21diskmemload2
507512150,1sleep10-21swapper/11
41353612151,2sleep20-21swapper/22
41108822151,2sleep20-21swapper/22
40415132151,3sleep04036141-21diskmemload0
39407482151,10sleep23942074-21cut2
3905887991512,1cyclictest0-21swapper/33
390588799150,13cyclictest0-21swapper/33
390588799150,13cyclictest0-21swapper/33
390588799150,12cyclictest0-21swapper/33
390588799150,12cyclictest0-21swapper/33
95922141,2sleep10-21swapper/11
87792141,3sleep04036141-21diskmemload0
440112141,9sleep044024-21rm0
41450122140,3sleep10-21swapper/11
41019592141,8sleep24036141-21diskmemload2
40844512140,1sleep10-21swapper/11
40525002141,6sleep00-21swapper/00
40138712141,9sleep04013927-21/usr/sbin/munin0
39952782141,9sleep10-21swapper/11
390588799144,7cyclictest0-21swapper/33
390588799141,2cyclictest0-21swapper/33
390588799141,1cyclictest0-21swapper/33
390588799140,12cyclictest0-21swapper/33
390588799140,11cyclictest0-21swapper/33
663362131,6sleep066391-21ntpq0
460362131,4sleep247207-21ssh2
425802131,4sleep142594-21ssh1
41940352135,3sleep04036141-21diskmemload0
41932802131,8sleep24193340-21ntpq2
41788672131,3sleep24178877-21ssh2
41445932131,7sleep00-21swapper/00
40759902131,8sleep14076000-21ssh1
40759902131,8sleep14076000-21ssh1
40696942131,8sleep24069705-21ssh2
40503912131,6sleep10-21swapper/11
39092342130,2sleep2401irq_work/22
1695802131,3sleep0169590-21ssh0
1436672131,6sleep00-21swapper/00
944412121,6sleep04036141-21diskmemload0
687332121,7sleep168747-21ssh1
680732121,7sleep268086-21ssh2
591712121,7sleep259182-21ssh2
41557532120,3sleep14155764-21ssh1
41114872121,3sleep04111498-21ssh0
40590892121,6sleep04036141-21diskmemload0
40500362120,7sleep24036141-21diskmemload2
39395632120,8sleep03939482-31find0
39394152120,1sleep10-21swapper/11
39243352121,7sleep23924068-21/usr/sbin/munin2
1969432120,2sleep24036141-21diskmemload2
1697132121,7sleep24036141-21diskmemload2
1540212121,5sleep20-21swapper/22
1526022121,6sleep134-21ksoftirqd/11
1264272120,6sleep20-21swapper/22
116422122,6sleep14036141-21diskmemload1
1100512121,6sleep04036141-21diskmemload0
1025102120,5sleep00-21swapper/00
794562111,5sleep079676-21hddtemp_smartct0
773392111,4sleep14036141-21diskmemload1
610202111,4sleep14036141-21diskmemload1
41847832111,5sleep14184842-21ntpq1
41796092111,4sleep14036141-21diskmemload1
41695912111,4sleep14036141-21diskmemload1
41021252115,2sleep04102137-21ssh0
40856052111,3sleep20-21swapper/22
40830102111,5sleep04083061-21ntpq0
40757572111,4sleep04036141-21diskmemload0
40757572111,4sleep04036141-21diskmemload0
40699602111,6sleep04070000-21munin-run0
40307892111,4sleep24030813-21munin-run2
40100172111,5sleep14010228-21hddtemp_smartct1
40091882111,7sleep24009473-21latency_hist2
39922372111,5sleep13992277-21ntpq1
39881512111,5sleep00-21swapper/00
39455482112,4sleep13945567-21apt-get1
39193112111,3sleep20-21swapper/22
39111802111,5sleep03911657-21ntpq0
283852111,4sleep00-21swapper/00
1945252110,7sleep1194539-21ssh1
1938512111,5sleep04036141-21diskmemload0
1884582111,6sleep2188472-21ssh2
1300382111,5sleep1130066-21apt-get1
1287722111,5sleep14036141-21diskmemload1
1206452112,4sleep24036141-21diskmemload2
1176632111,6sleep0117673-21ssh0
1008212111,4sleep24036141-21diskmemload2
875712101,3sleep10-21swapper/11
863812101,4sleep24036141-21diskmemload2
791302101,4sleep10-21swapper/11
760222101,3sleep20-21swapper/22
615392101,3sleep00-21swapper/00
427712101,2sleep20-21swapper/22
41871092101,2sleep20-21swapper/22
41809792101,4sleep04181199-21hddtemp_smartct0
41782462101,5sleep04036141-21diskmemload0
41703182100,5sleep04036141-21diskmemload0
41643992101,4sleep24036141-21diskmemload2
41541572101,4sleep04036141-21diskmemload0
41444732103,1sleep20-21swapper/22
41366212100,6sleep04036141-21diskmemload0
41224102101,5sleep24123058-21kthreadcore2
41172352101,4sleep24117281-21ntpq2
41113942101,2sleep10-21swapper/11
40933062101,3sleep04036141-21diskmemload0
40926702101,2sleep20-21swapper/22
40913772101,4sleep14091436-21ntpq1
40670032101,4sleep14036141-21diskmemload1
40407092101,4sleep24040774-21ntpq2
40301402101,5sleep04030343-21tail0
40156362101,5sleep24015669-21kthreadcore2
40082192101,4sleep04008268-21ntpq0
39992862101,5sleep23999538-21cut2
39909072101,4sleep23992049-21memory2
39668352100,5sleep10-21swapper/11
39618562101,6sleep13962072-21if_enp1s01
39184592101,6sleep23918525-21/usr/sbin/munin2
350972101,3sleep20-21swapper/22
325872101,5sleep128387-21/usr/sbin/munin1
277262101,4sleep04036141-21diskmemload0
1878372101,1sleep0187847-21ssh0
1794502100,1sleep20-21swapper/22
1789812101,3sleep04036141-21diskmemload0
1766942101,5sleep1802-21snmpd1
1687092101,3sleep10-21swapper/11
1623752101,4sleep20-21swapper/22
1618142101,4sleep04036141-21diskmemload0
1608322101,6sleep10-21swapper/11
1527812101,4sleep04036141-21diskmemload0
1426502101,5sleep1142698-21ntpq1
1352382101,3sleep00-21swapper/00
1089322100,5sleep24036141-21diskmemload2
1002592101,6sleep1100398-21mailstats1
77425291,2sleep00-21swapper/00
45394291,4sleep045404-21ssh0
4189686291,5sleep14190352-21kthreadcore1
4162855291,3sleep00-21swapper/00
4154751291,2sleep20-21swapper/22
4153387291,3sleep10-21swapper/11
4122122291,5sleep04122225-21fschecks_time0
4103870290,2sleep10-21swapper/11
4070720291,2sleep20-21swapper/22
4070720291,2sleep20-21swapper/22
4060223290,3sleep20-21swapper/22
4042407291,2sleep10-21swapper/11
4034962291,4sleep14035107-21ld1
4031617290,5sleep24032561-21tr2
4009725291,3sleep24009744-21apt-get2
4003312291,4sleep14003477-21vmstat1
3977754291,4sleep13977772-21entropy1
3977081291,2sleep00-21swapper/00
3976280291,4sleep23976333-21ntp_states2
3971249291,4sleep03971496-21grep0
3944158290,4sleep13944271-21ntpq1
3917567290,6sleep10-21swapper/11
3910153291,4sleep13910207-21ntpq1
18274291,4sleep218288-21ssh2
16654291,3sleep04036141-21diskmemload0
143693291,4sleep2143704-21ssh2
135475291,2sleep20-21swapper/22
126989291,3sleep04036141-21diskmemload0
3987761281,3sleep03987762-21sshd0
3983120281,3sleep13983238-21grep1
3962074281,3sleep23962527-21kthreadcore2
3960197281,3sleep23960245-21ntpq2
3959353281,3sleep03960113-21missed_timers0
3946369281,3sleep23948049-21kthreadcore2
3928123281,2sleep10-21swapper/11
3924584281,3sleep03924892-21kthreadcore0
3918742280,3sleep13918761-21apt-get1
109423281,2sleep14036141-21diskmemload1
4030438270,1sleep10-21swapper/11
4025361270,1sleep10-21swapper/11
4025217270,1sleep00-21swapper/00
4008875270,1sleep10-21swapper/11
3997860271,3sleep23998099-21unixbench_singl2
3977047270,1sleep10-21swapper/11
3955689270,1sleep20-21swapper/22
3950615270,4sleep10-21swapper/11
3950464270,1sleep00-21swapper/00
3934679270,2sleep20-21swapper/22
3934179270,1sleep20-21swapper/22
3933416270,2sleep00-21swapper/00
3922898271,2sleep03918743-21/usr/sbin/munin0
3906623271,3sleep03907516-21cut0
4035858260,1sleep00-21swapper/00
4024418260,2sleep20-21swapper/22
4019037260,2sleep10-21swapper/11
4015354262,1sleep00-21swapper/00
4003681260,1sleep00-21swapper/00
3998348260,4sleep00-21swapper/00
3986787260,2sleep20-21swapper/22
3982306260,1sleep20-21swapper/22
3981558261,1sleep00-21swapper/00
3968130261,2sleep20-21swapper/22
3961807261,2sleep00-21swapper/00
3944378261,2sleep00-21swapper/00
3950869250,1sleep00-21swapper/00
3929457250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional