You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 04:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Wed Dec 17, 2025 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
265422238163,24sleep20-21swapper/219:05:372
265132214183,21sleep00-21swapper/019:05:260
266882204167,24sleep10-21swapper/119:07:281
266032200164,24sleep30-21swapper/319:06:223
2237321620,3sleep12697399cyclictest21:25:021
338721550,4sleep12697399cyclictest20:40:191
1342121140,3sleep02696799cyclictest19:50:140
26973991070,105cyclictest0-21swapper/121:01:371
2696799579,13cyclictest6880-21munin-run20:50:010
295142300,4sleep229517-21fschecks_count21:40:162
2696799293,12cyclictest0-21swapper/019:30:000
118052280,2sleep07-21ksoftirqd/019:45:200
2698499271,10cyclictest28406-21tail21:35:273
26973992710,6cyclictest717-40dnf21:48:581
2697399261,17cyclictest23195-21chrt23:51:131
2697399261,17cyclictest10086-21pmu-power00:35:231
2696799261,12cyclictest32330-21munin-run00:15:010
2698499251,12cyclictest14317-21sshd22:20:093
2697899255,6cyclictest770-21rngd20:45:202
297832240,2sleep20-21swapper/222:55:122
2698499249,3cyclictest25888-21sshd20:18:083
2698499242,9cyclictest0-21swapper/323:41:103
2698499241,9cyclictest3106-21perf21:55:013
26973992416,5cyclictest30988-21switchtime22:55:241
2696799245,16cyclictest26662-21munin-run21:35:010
2696799242,12cyclictest800-21snmpd22:45:020
26984992314,7cyclictest22132-21kworker/u8:121:11:293
2698499231,11cyclictest4202-21sshd00:23:093
2698499231,11cyclictest29714-21/usr/sbin/munin22:55:193
2698499231,11cyclictest2323-21sshd20:38:083
2698499231,10cyclictest17518-21needreboot22:25:193
2698499231,10cyclictest12776-21sshd19:49:093
26973992317,3cyclictest28255-21munin-run20:25:021
26973992314,3cyclictest0-21swapper/123:55:291
26973992314,3cyclictest0-21swapper/123:15:181
26973992314,3cyclictest0-21swapper/123:15:171
26973992314,3cyclictest0-21swapper/122:05:161
26973992314,3cyclictest0-21swapper/122:05:161
2697399230,16cyclictest0-21swapper/122:20:261
2697399230,16cyclictest0-21swapper/119:30:311
2696799236,9cyclictest19409-21kworker/0:020:12:480
302942221,17sleep230408-21df_inode19:15:132
2698499221,10cyclictest31913-21/usr/sbin/munin23:00:143
2698499221,10cyclictest13401-21sshd21:04:083
2697399223,10cyclictest679-21cat20:35:111
2697399221,3cyclictest269152sleep100:00:201
26973992213,3cyclictest0-21swapper/123:46:181
26973992213,3cyclictest0-21swapper/119:55:191
26973992213,3cyclictest0-21swapper/119:20:181
2697399221,18cyclictest31058-21latency_hist21:45:001
2697399221,15cyclictest0-21swapper/122:41:271
2697399221,15cyclictest0-21swapper/121:57:401
2697399221,15cyclictest0-21swapper/121:35:051
26973992210,3cyclictest24415-21df20:15:151
2697399220,16cyclictest0-21swapper/123:36:551
2697399220,16cyclictest0-21swapper/119:11:091
12372221,3sleep21260-21ntp_states00:15:182
2698499218,3cyclictest0-21swapper/323:39:583
2698499218,1cyclictest0-21swapper/320:40:193
2698499211,18cyclictest0-21swapper/323:30:223
2698499211,17cyclictest6717-21sshd20:48:083
2698499211,10cyclictest21904-21needreboot22:35:193
2698499211,10cyclictest18723-21/usr/sbin/munin22:30:203
2698499211,10cyclictest10964-21sshd20:56:093
26984992110,3cyclictest32040-21awk19:20:013
2697899212,6cyclictest21885-21/usr/sbin/munin20:10:212
26978992110,3cyclictest26674-21awk21:35:022
2697399219,3cyclictest2266-21cstates19:25:141
2697399219,3cyclictest18439-21df21:15:131
2697399212,11cyclictest14091-21latency_hist22:20:021
2697399211,3cyclictest0-21swapper/121:25:141
26973992113,5cyclictest7449-21head00:30:171
26973992112,3cyclictest0-21swapper/123:06:011
2697399211,15cyclictest0-21swapper/121:06:071
2697399211,15cyclictest0-21swapper/120:30:421
2697399211,15cyclictest0-21swapper/120:13:191
2697399211,14cyclictest0-21swapper/121:31:281
2697399211,14cyclictest0-21swapper/120:51:121
2697399211,14cyclictest0-21swapper/120:25:461
2697399211,14cyclictest0-21swapper/119:40:021
2697399211,14cyclictest0-21swapper/119:35:121
26973992111,3cyclictest0-21swapper/123:29:341
2697399211,11cyclictest6871-21latency_hist20:50:011
2697399211,11cyclictest16588-21hddtemp_smartct21:10:161
2697399210,16cyclictest0-21swapper/123:10:571
2697399210,15cyclictest0-21swapper/122:51:081
2696799214,15cyclictest28268-21basename20:25:020
2696799212,11cyclictest9935-21/usr/sbin/munin22:10:180
2696799211,3cyclictest0-21swapper/021:20:010
26967992110,3cyclictest1579-21ntp_states20:35:200
2698499208,3cyclictest0-21swapper/300:00:563
2698499206,3cyclictest87450irq/129-enp1s0-23:13:103
2698499205,4cyclictest27127-21sshd22:48:093
2698499204,3cyclictest29278-21cstates21:40:143
2698499204,3cyclictest15049-21dump-pmu-power19:59:563
2698499203,3cyclictest19766-21cpuspeed_turbos20:05:123
2698499202,4cyclictest12432-21sshd23:29:093
2698499201,8cyclictest15232-21cat19:55:023
2698499201,6cyclictest3330-21/usr/sbin/munin21:55:203
2698499201,6cyclictest0-21swapper/322:00:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional