You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 14:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Mon Mar 30, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
323422238162,24sleep10-21swapper/107:06:061
325992203166,25sleep30-21swapper/307:09:263
324032201165,24sleep00-21swapper/007:06:530
322982200164,24sleep20-21swapper/207:05:302
593821790,4sleep03273399cyclictest09:45:250
2851521480,5sleep13273899cyclictest08:10:191
2591821330,4sleep33274999cyclictest08:05:153
3274999107104,2cyclictest0-21swapper/308:45:353
327499910092,3cyclictest0-21swapper/310:53:033
32749999793,3cyclictest0-21swapper/308:53:143
32749999591,3cyclictest0-21swapper/309:28:203
216002590,6sleep011-21rcuc/010:20:250
58672550,4sleep081ktimersoftd/007:20:130
236642520,1sleep20-21swapper/211:40:162
3273899421,12cyclictest13508-21missed_timers12:30:201
3273899394,6cyclictest26320-40dnf10:33:241
3273899391,3cyclictest15871-21cstates10:10:131
32749993734,2cyclictest0-21swapper/307:57:323
3273899362,3cyclictest31818-21munin-run08:20:011
32738993612,3cyclictest29637-21tr11:55:141
3273899353,7cyclictest21440-21diskmemload11:45:271
3273899353,13cyclictest0-21swapper/111:15:241
3273899351,13cyclictest28669-21awk10:40:011
3273899351,11cyclictest5046-21/usr/sbin/munin07:15:261
3273399352,18cyclictest18844-21missed_timers10:15:210
3273399352,18cyclictest18844-21missed_timers10:15:200
3273899345,6cyclictest0-21swapper/107:30:151
3273899342,13cyclictest22690-21munin-run11:40:011
3273899341,5cyclictest2580-21munin-node07:15:011
32738993411,4cyclictest8635-21/usr/sbin/munin11:05:231
32738993410,3cyclictest2215-21df08:25:111
3273399344,21cyclictest27017-21missed_timers09:20:190
3273899339,4cyclictest14604-21/usr/sbin/munin10:05:221
3273899339,4cyclictest0-21swapper/112:10:271
3273899339,3cyclictest6880-21processes07:20:241
3273899336,7cyclictest2705-21pmu-power12:05:241
3273899331,11cyclictest8763-21head12:20:151
3273899331,11cyclictest5105-21sleep11:00:021
3273899331,10cyclictest20811-21turbostat.cron07:55:011
3273899331,10cyclictest20811-21turbostat.cron07:55:011
32738993310,3cyclictest15518-21ntp_states07:40:211
197772330,2sleep33274999cyclictest11:30:223
3273899329,3cyclictest10441-21latency_hist08:45:011
3273899323,7cyclictest5838-40dnf08:32:231
3273899322,13cyclictest3035-21fschecks_time09:40:141
3273899321,6cyclictest1092-21irqstats09:35:171
3273899321,3cyclictest14197-21cpuspeed_turbos11:20:111
32738993212,2cyclictest16709-21sh12:40:011
32738993212,2cyclictest16709-21sh12:40:011
32738993210,3cyclictest15123-21cpu08:55:131
3273399325,12cyclictest24893-21awk11:45:010
3273899319,3cyclictest27417-21latency_hist08:10:011
3273899318,2cyclictest0-21swapper/107:55:131
3273899316,3cyclictest11636-21diskstats10:00:121
3273899316,3cyclictest0-21swapper/107:48:081
3273899311,2cyclictest11923-21uptime12:25:271
32738993112,3cyclictest23864-21/usr/sbin/munin09:15:231
32738993111,3cyclictest12333-21cat07:35:121
3273899311,12cyclictest23432-21tune2fs11:40:151
3273899311,12cyclictest17254-21taskset09:00:041
3273899311,12cyclictest10846-21sshd09:57:211
32738993110,3cyclictest30125-21expr10:40:221
32738993110,3cyclictest1581-21sed10:50:171
32738993012,3cyclictest8205-21diskstats07:25:121
3273899301,11cyclictest0-21swapper/108:35:121
3273899301,10cyclictest0-21swapper/109:25:161
32738993010,3cyclictest27554-21ls11:50:161
3273899300,5cyclictest0-21swapper/109:55:011
3273399305,13cyclictest23352-21ntp_states10:25:230
3273399304,5cyclictest26734-21wc08:05:240
3273399303,18cyclictest86550irq/126-enp1s0-12:35:160
3273399303,18cyclictest86550irq/126-enp1s0-12:35:160
3273899291,3cyclictest584-21cat10:49:571
3273899291,2cyclictest21440-21diskmemload11:00:211
3273899291,16cyclictest0-21swapper/112:03:531
3273899291,16cyclictest0-21swapper/109:49:291
3273899291,10cyclictest0-21swapper/110:25:191
32738992910,3cyclictest10601-21latency11:10:191
3273399297,10cyclictest25000-21pmu-power09:15:220
3273399293,15cyclictest29843-21/usr/sbin/munin08:15:200
3273399292,4cyclictest0-21swapper/011:28:520
3273399292,4cyclictest0-21swapper/011:28:520
3274999280,18cyclictest29874-21strings10:40:183
3273899281,6cyclictest12872-21/usr/sbin/munin08:50:251
3273899281,6cyclictest0-21swapper/110:22:591
3273899281,3cyclictest30808-21diskstats09:30:131
3273899281,16cyclictest0-21swapper/109:06:361
32738992810,3cyclictest20102-21users11:30:241
3273899280,4cyclictest27089-21netstat09:20:201
3273399288,12cyclictest11699-21munin-run11:15:010
3273399288,10cyclictest11922-21/usr/sbin/munin11:15:240
3273399286,14cyclictest32041-21/usr/sbin/munin08:20:170
3273399285,13cyclictest9836-21munin-run07:30:000
32749992714,5cyclictest13887-21latency_hist11:20:013
3274999271,10cyclictest11690-21latency_hist11:15:013
3273899271,9cyclictest0-21swapper/108:20:221
3273899271,15cyclictest0-21swapper/108:49:011
3273899271,10cyclictest0-21swapper/109:11:011
3273899270,6cyclictest0-21swapper/110:16:231
3273899270,6cyclictest0-21swapper/110:16:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional