You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 21:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Tue Aug 11, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
52502224149,24sleep20-21swapper/207:08:482
51522224152,59sleep00-21swapper/007:07:340
45502203175,18sleep10-21swapper/107:05:211
50412202165,25sleep30-21swapper/307:06:073
543999105101,3cyclictest0-21swapper/211:19:512
5439996359,3cyclictest0-21swapper/212:08:172
87712550,1sleep10-21swapper/107:15:131
5439995450,3cyclictest0-21swapper/209:45:432
179112540,2sleep121-21rcuc/111:15:201
89202520,1sleep30-21swapper/307:15:153
212352510,1sleep30-21swapper/311:25:013
71382470,2sleep10-21swapper/110:50:241
23642470,3sleep20-21swapper/209:25:252
543499447,28cyclictest4832-40dnf10:45:231
5434994313,22cyclictest21773-21ntp_kernel_err10:10:201
5434994221,16cyclictest21414-40dnf07:44:251
5434994010,14cyclictest32668-21expr11:50:111
543499396,22cyclictest15109-21df11:10:141
543499396,16cyclictest28254-21memory10:25:201
543499396,16cyclictest28254-21memory10:25:201
5434993910,20cyclictest19187-21tail10:05:131
543499389,15cyclictest18052-21fschecks_count12:30:161
5434993817,12cyclictest31006-21irqstats11:45:191
5434993813,12cyclictest11330-21acpi08:35:121
5434993811,14cyclictest1303-21fschecks_count09:25:141
542999387,14cyclictest11727-21munin-run09:50:010
543499379,19cyclictest8477-21expr10:55:141
543499376,20cyclictest13396-21grep12:20:121
5429993711,12cyclictest2040-21awk11:55:010
543999364,8cyclictest3762-21/usr/sbin/munin10:45:262
543499369,15cyclictest11884-21/usr/sbin/munin12:15:181
543499368,15cyclictest16730-21smart_sda12:25:241
543499359,12cyclictest14158-21sendmail_mailst07:25:241
543499358,9cyclictest19270-21cpuspeed_turbos11:20:121
543499358,24cyclictest24472-21memory11:30:181
543499358,24cyclictest0-21swapper/112:00:161
543499357,18cyclictest14824-21hddtemp_smartct09:55:181
8602340,3sleep3401ktimersoftd/311:50:173
543999341,12cyclictest7154-21unixbench_multi07:10:252
543499348,18cyclictest0-21swapper/109:15:151
543499344,22cyclictest0-21swapper/109:24:261
543499344,22cyclictest0-21swapper/109:24:261
543999335,3cyclictest26495-21diskmemload10:30:262
5439993313,3cyclictest28670-21hddtemp_smartct11:40:162
5434993316,14cyclictest12299-21diskstats09:50:151
5434993315,16cyclictest11732-21awk09:50:011
5434993315,15cyclictest26449-21diskstats07:55:161
5434993314,5cyclictest7323-21munin-run09:40:011
543499325,17cyclictest0-21swapper/111:08:311
5434993214,15cyclictest30850-21diskstats08:05:141
5434993214,15cyclictest30850-21diskstats08:05:141
5434993212,6cyclictest26113-21df11:35:141
5434993212,17cyclictest27117-21perf10:25:011
543999311,6cyclictest14596-21ntp_states08:40:212
543499318,11cyclictest4316-21proc_pri09:30:231
5434993114,14cyclictest24584-21/usr/sbin/munin07:50:171
5434993114,14cyclictest15453-40dnf08:44:361
5434993113,15cyclictest8652-21munin-run12:10:011
5434993110,10cyclictest26990-21expr09:10:131
543999301,5cyclictest30193-21/usr/sbin/munin11:45:212
543499309,8cyclictest325-21ntp_states10:35:221
543499308,14cyclictest3793-21smart_sda08:15:241
543499308,11cyclictest9742-21cat12:10:201
543499307,20cyclictest9520-21sh09:45:011
5434993013,14cyclictest2927-21hddtemp_smartct11:55:181
5434993011,4cyclictest6325-21users08:20:261
543999291,3cyclictest0-21swapper/212:37:212
543999291,13cyclictest27138-21tune2fs09:10:152
543499298,18cyclictest19989-21tr12:35:121
5434992910,16cyclictest28107-21cpuspeed_turbos11:40:121
543999281,14cyclictest0-21swapper/211:34:032
543999281,13cyclictest0-21swapper/208:26:112
543999281,12cyclictest0-21swapper/210:50:172
543999281,12cyclictest0-21swapper/209:39:592
543999281,12cyclictest0-21swapper/208:33:312
543999281,11cyclictest26127-21diskstats11:35:152
543499289,16cyclictest8899-21latency_hist08:30:021
543499287,9cyclictest17388-21ntp_kernel_pll_10:00:221
543499284,9cyclictest21715-21entropy11:25:161
5434992820,5cyclictest1912-21diskstats10:40:141
5434992820,5cyclictest1594-21smart_sda08:10:241
5434992810,9cyclictest10367-21/usr/sbin/munin11:00:161
5429992811,14cyclictest81ktimersoftd/011:25:010
543999271,9cyclictest0-21swapper/210:36:032
5439992712,3cyclictest0-21swapper/209:30:292
543999271,13cyclictest0-21swapper/212:12:232
543999271,13cyclictest0-21swapper/209:06:232
543499277,7cyclictest9135-21/usr/sbin/munin08:30:181
543499275,17cyclictest87550irq/128-enp1s0-10:17:371
5434992718,6cyclictest25787-21smart_sda09:05:241
5434992711,8cyclictest8941-1kworker/1:1H07:49:561
5434992711,4cyclictest15938-21expr08:45:121
5434992710,14cyclictest20298-21cstates08:55:141
543999261,5cyclictest16526-21cstates10:00:142
543999261,13cyclictest0-21swapper/209:56:512
543999261,12cyclictest0-21swapper/207:59:152
543999261,11cyclictest0-21swapper/209:22:112
543999261,11cyclictest0-21swapper/209:22:112
543499267,11cyclictest30115-21/usr/sbin/munin10:30:161
5434992618,5cyclictest23235-21/usr/sbin/munin09:00:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional