You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 02:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Thu Apr 23, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3990374212753,69sleep30-21swapper/33
399018928960,10sleep20-21swapper/22
399005127952,7sleep00-21swapper/00
399013527760,11sleep10-21swapper/11
1794462230,2sleep20-21swapper/22
1794462230,2sleep20-21swapper/22
399054699221,17cyclictest0-21swapper/33
399054699220,18cyclictest0-21swapper/33
1014312221,9sleep04120675-21diskmemload0
3990546992118,1cyclictest0-21swapper/33
399054699211,16cyclictest0-21swapper/33
399054699201,15cyclictest0-21swapper/33
41866522192,11sleep14186703-21ntpq1
399054699192,14cyclictest66950irq/132-enp1s0-TxRx-33
3990546991916,1cyclictest0-21swapper/33
399054699191,15cyclictest66950irq/132-enp1s0-TxRx-33
399054699191,14cyclictest0-21swapper/33
399054699191,14cyclictest0-21swapper/33
399054699191,14cyclictest0-21swapper/33
399054699191,14cyclictest0-21swapper/33
399054699191,14cyclictest0-21swapper/33
399054699191,14cyclictest0-21swapper/33
3990546991910,6cyclictest4188982-21taskset3
3990546991910,5cyclictest0-21swapper/33
399054699188,6cyclictest4104672-21turbostat3
399054699187,8cyclictest4094052-21turbostat3
3990546991815,1cyclictest0-21swapper/33
3990546991814,2cyclictest0-21swapper/33
399054699181,3cyclictest0-21swapper/33
399054699181,14cyclictest66950irq/132-enp1s0-TxRx-33
399054699181,14cyclictest0-21swapper/33
399054699181,14cyclictest0-21swapper/33
399054699181,14cyclictest0-21swapper/33
399054699181,14cyclictest0-21swapper/33
399054699181,14cyclictest0-21swapper/33
399054699181,14cyclictest0-21swapper/33
399054699181,14cyclictest0-21swapper/33
399054699181,14cyclictest0-21swapper/33
399054699181,14cyclictest0-21swapper/33
399054699181,14cyclictest0-21swapper/33
399054699181,14cyclictest0-21swapper/33
399054699181,14cyclictest0-21swapper/33
399054699181,14cyclictest0-21swapper/33
399054699181,13cyclictest2924642sleep33
399054699181,13cyclictest0-21swapper/33
399054699180,14cyclictest0-21swapper/33
399054699180,14cyclictest0-21swapper/33
399054699180,14cyclictest0-21swapper/33
399054699180,14cyclictest0-21swapper/33
399054699180,14cyclictest0-21swapper/33
399054699180,14cyclictest0-21swapper/33
2470672187,7sleep24120675-21diskmemload2
399054699171,14cyclictest0-21swapper/33
399054699171,14cyclictest0-21swapper/33
399054699171,13cyclictest23451-21taskset3
399054699171,13cyclictest0-21swapper/33
399054699171,13cyclictest0-21swapper/33
399054699170,14cyclictest0-21swapper/33
399054699170,14cyclictest0-21swapper/33
399054699170,13cyclictest0-21swapper/33
399054699170,13cyclictest0-21swapper/33
2325952171,7sleep14120675-21diskmemload1
2040382171,11sleep1204052-21ssh1
1283982171,5sleep1128629-21df_inode1
765382161,11sleep078024-21cut0
765382161,11sleep078024-21cut0
40823492161,5sleep14082399-21ntpq1
399054699167,6cyclictest4078046-21turbostat3
399054699161,13cyclictest0-21swapper/33
399054699161,11cyclictest0-21swapper/33
399054699160,13cyclictest0-21swapper/33
399054699160,12cyclictest0-21swapper/33
2821552161,3sleep20-21swapper/22
2811702161,8sleep1281228-21ntpq1
3990546991512,2cyclictest0-21swapper/33
399054699150,13cyclictest0-21swapper/33
399054699150,13cyclictest0-21swapper/33
399054699150,13cyclictest0-21swapper/33
399054699150,12cyclictest0-21swapper/33
399054699150,11cyclictest4040211-21chrt3
292632150,2sleep20-21swapper/22
28712151,9sleep14120675-21diskmemload1
2406702150,2sleep20-21swapper/22
2240272150,2sleep00-21swapper/00
1207052151,5sleep1122341-21grep1
754282141,2sleep20-21swapper/22
713512142,6sleep071409-21ntpq0
41734662141,2sleep20-21swapper/22
41441412145,2sleep1171rcu_preempt1
41264422141,8sleep14120675-21diskmemload1
40500632141,9sleep04050111-21ld0
3990546991411,2cyclictest0-21swapper/33
399054699140,12cyclictest0-21swapper/33
399054699140,12cyclictest0-21swapper/33
2725602141,8sleep0272627-21ntp_states0
2725602141,8sleep0272627-21ntp_states0
2660442141,9sleep2266055-21ssh2
2334462141,9sleep0233687-21cat0
1788352141,3sleep1178849-21ssh1
1788352141,3sleep1178849-21ssh1
1421852141,8sleep24120675-21diskmemload2
1022452141,6sleep0102384-21diskstats0
1007542141,3sleep20-21swapper/22
564502130,8sleep24120675-21diskmemload2
488202131,7sleep04120675-21diskmemload0
41528982131,3sleep04152909-21ssh0
41218042131,8sleep24123330-21ssh2
41090342131,7sleep24109088-21ntpq2
40567292131,8sleep14056770-21cpu1
40247572131,7sleep04025014-21df_inode0
399054699139,2cyclictest0-21swapper/33
3990546991311,1cyclictest0-21swapper/33
399054699130,11cyclictest0-21swapper/33
288432131,8sleep14120675-21diskmemload1
2588262131,8sleep2258840-21ssh2
2463662131,7sleep0246434-21ntpq0
2064802131,2sleep24120675-21diskmemload2
1516332131,8sleep2151643-21ssh2
1084472131,8sleep1108458-21ssh1
925772120,5sleep00-21swapper/00
41669322120,3sleep04168621-21ssh0
41527642121,3sleep14152775-21ssh1
41479712121,7sleep24149560-21grep2
41426982121,5sleep24142755-21ntpq2
41265232120,1sleep00-21swapper/00
41102882121,7sleep04110336-21/usr/sbin/munin0
40877332120,2sleep10-21swapper/11
40740302121,7sleep24075740-21cut2
40457052121,4sleep172-21kcompactd01
367012121,7sleep036737-21ssh0
2764342120,8sleep2276436-21ssh2
2764342120,8sleep2276436-21ssh2
2508342121,7sleep0250856-21cpu0
231352121,5sleep223195-21munin-run2
2296852121,6sleep24120675-21diskmemload2
2130522121,7sleep0213066-21ssh0
1437352121,6sleep14120675-21diskmemload1
1360002121,7sleep24120675-21diskmemload2
108772121,7sleep210953-21ssh2
874712111,5sleep188649-21memory1
824962111,3sleep10-21swapper/11
824962111,3sleep10-21swapper/11
663732111,6sleep166386-21ssh1
635572111,4sleep00-21swapper/00
56402111,5sleep05697-21munin-run0
556302111,6sleep055640-21ssh0
41737982111,7sleep14174021-21hddtemp_smartct1
41617542111,4sleep00-21swapper/00
41447342111,5sleep04120675-21diskmemload0
41196432111,5sleep24119689-21ntpq2
41099312111,4sleep0151ktimers/00
40460602111,5sleep14046318-21df_inode1
40297442110,1sleep10-21swapper/11
40138112111,5sleep14013861-21munin-run1
40128242111,5sleep24012877-21ntpq2
379692111,5sleep24120675-21diskmemload2
322872111,5sleep132557-21df_inode1
2857632112,4sleep0285783-21apt-get0
2582602111,3sleep10-21swapper/11
2458302111,7sleep1246241-21grep1
2224872110,3sleep2222497-21ssh2
2159132111,5sleep1216173-21df1
2121202111,4sleep20-21swapper/22
1802392111,3sleep00-21swapper/00
1802392111,3sleep00-21swapper/00
1550492111,5sleep0155130-21irqstats0
1531722110,2sleep00-21swapper/00
141472111,5sleep04120675-21diskmemload0
1328412111,2sleep0171rcu_preempt0
1237122111,5sleep0123760-21ntpq0
1150722111,5sleep0115137-21ntpq0
636802101,3sleep20-21swapper/22
538822101,4sleep153945-21ntpq1
489292101,5sleep148942-21ssh1
41902822101,4sleep24120675-21diskmemload2
41823292101,4sleep04181807-21apt-get0
41724322101,3sleep20-21swapper/22
41618212101,4sleep14120675-21diskmemload1
41617812101,4sleep24120675-21diskmemload2
41347032101,2sleep20-21swapper/22
41337412101,5sleep04133896-21ssh0
40798142101,5sleep24081587-21kthreadcore2
40681372101,5sleep24068208-21irqstats2
40664052101,4sleep14066462-21ntp_states1
40564512101,5sleep24056465-21latency_hist2
40365172101,5sleep24038236-21kthreadcore2
40339622101,4sleep04034101-21ntp_192.168.1140
40297922101,5sleep24029795-21cron2
39993302101,2sleep00-21swapper/00
2927612101,4sleep24120675-21diskmemload2
289812102,3sleep04120675-21diskmemload0
2846422100,7sleep0284657-21ssh0
2686242100,4sleep1268845-21hddtemp_smartct1
2686242100,4sleep1268845-21hddtemp_smartct1
2655282101,3sleep10-21swapper/11
2357122101,5sleep1237369-21ssh1
2289812101,4sleep0229047-21ntpq0
2070392101,3sleep10-21swapper/11
2023722101,4sleep0202432-21ntpq0
1974572100,6sleep1197472-21ssh1
1969442100,1sleep00-21swapper/00
1863572100,1sleep10-21swapper/11
1858892101,5sleep04120675-21diskmemload0
1848232101,4sleep2184883-21ntpq2
1706952101,3sleep20-21swapper/22
1690792101,4sleep14120675-21diskmemload1
1632062101,4sleep0163473-21df0
1515622101,4sleep10-21swapper/11
1269742101,4sleep24120675-21diskmemload2
1174732100,7sleep14120675-21diskmemload1
1171382101,3sleep20-21swapper/22
1020602101,3sleep20-21swapper/22
1000402101,3sleep10-21swapper/11
90594291,2sleep20-21swapper/22
80940291,2sleep20-21swapper/22
80940291,2sleep20-21swapper/22
67392291,3sleep14120675-21diskmemload1
5698291,4sleep15909-21ssh1
44997291,2sleep20-21swapper/22
4173144291,3sleep04120675-21diskmemload0
4169913290,2sleep10-21swapper/11
4129709290,2sleep10-21swapper/11
4114383291,4sleep14114439-21ntpq1
4086252291,4sleep24087551-21memory2
4073510291,5sleep14074027-21kthreadcore1
4069437291,4sleep04071267-21tr0
4044793291,4sleep24044838-21ntpq2
4031089291,4sleep24032806-21cut2
4014656291,4sleep14016154-21cat1
4003104290,4sleep20-21swapper/22
4002180291,4sleep14002237-21ntpq1
3995214290,1sleep10-21swapper/11
291290291,3sleep10-21swapper/11
2883291,4sleep22897-21ssh2
266717291,4sleep04120675-21diskmemload0
20155291,3sleep14120675-21diskmemload1
195217290,2sleep20-21swapper/22
159736291,2sleep20-21swapper/22
158643291,3sleep10-21swapper/11
4114441281,4sleep24114530-21grep2
4104295280,1sleep00-21swapper/00
4094298280,2sleep10-21swapper/11
4093347280,1sleep10-21swapper/11
4090388281,3sleep04092151-21kthreadcore0
4061724280,1sleep00-21swapper/00
4045461280,1sleep00-21swapper/00
4035382280,2sleep10-21swapper/11
4020004282,3sleep00-21swapper/00
3990704280,2sleep20-21swapper/22
21194280,1sleep00-21swapper/00
137368281,3sleep04120675-21diskmemload0
4120394270,1sleep00-21swapper/00
4109781270,1sleep10-21swapper/11
4098468271,3sleep04098586-21grep0
4094879271,2sleep24096392-21ps2
4083624270,2sleep00-21swapper/00
4054884271,3sleep04055342-21cat0
4051362270,2sleep10-21swapper/11
4030055270,2sleep10-21swapper/11
4024117270,1sleep10-21swapper/11
4013654270,1sleep00-21swapper/00
4003417271,2sleep14003436-21apt-get1
4104416260,4sleep20-21swapper/22
4103706260,2sleep10-21swapper/11
4093920260,1sleep20-21swapper/22
4077863260,1sleep00-21swapper/00
4072407260,1sleep10-21swapper/11
4066183260,2sleep24066296-21strings2
4062880261,2sleep04062269-21/usr/sbin/munin0
4058399261,2sleep24060191-21kthreadcore2
4046319261,2sleep20-21swapper/22
4040110260,4sleep00-21swapper/00
4023889261,2sleep20-21swapper/22
4019073260,1sleep20-21swapper/22
4014075260,2sleep00-21swapper/00
4004220261,2sleep20-21swapper/22
4119501250,1sleep10-21swapper/11
4007614250,1sleep00-21swapper/00
4078294240,1sleep00-21swapper/00
3990938240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional