You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-27 - 16:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Mon Jul 27, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
283890921410,3sleep20-21swapper/207:25:212
293024721240,6sleep342-21ksoftirqd/311:45:213
284585321200,8sleep3411rcuc/307:45:233
139099800,65rtkit-daemon0-21swapper/107:05:101
283187227739,14sleep30-21swapper/307:08:093
283169426545,14sleep00-21swapper/007:05:490
283178326141,14sleep20-21swapper/207:07:012
28566772420,4sleep22856674-21netstat08:15:162
283215499300,18cyclictest0-21swapper/311:37:563
2832154992913,14cyclictest2832804-21cat07:10:153
283215499290,18cyclictest0-21swapper/312:06:313
28743122280,4sleep13056-21PK-Backend09:05:211
2832154992813,13cyclictest2871793-21sed09:00:013
283215499280,16cyclictest0-21swapper/311:33:593
2832154992712,13cyclictest2844490-21seq07:41:383
2832143992715,7cyclictest1095-21runrttasks08:10:040
28829892260,4chrt3056-21PK-Backend09:30:210
28586282260,4sleep1251rcuc/108:20:171
283215499268,16cyclictest2869263-21cat08:50:213
283215499266,18cyclictest2866399-21unin-run08:44:593
2832154992614,10cyclictest2927969-21hddtemp_smartct11:40:173
2832154992614,10cyclictest2927969-21hddtemp_smartct11:40:163
283215499261,23cyclictest2932169-21users11:50:243
283215499260,15cyclictest0-21swapper/308:49:383
283215499260,14cyclictest0-21swapper/309:18:013
28460892250,2sleep10-21swapper/107:45:241
283215499258,15cyclictest2900296-21ntp_states10:20:183
283215499252,18cyclictest2863174-21apt08:35:113
283215499250,6cyclictest2921492-21python311:20:223
2832147992511,12cyclictest2869865-21unin-run08:55:001
28836892240,7chrt2883684-21cron09:35:001
283215499241,21cyclictest978-21snmpd08:22:353
2832154992410,12cyclictest2839510-21dump-pmu-power07:30:013
283215499240,9cyclictest2873442-21cat09:05:003
283215499240,22cyclictest2156-21gnome-shell11:11:593
283215499237,14cyclictest2906641-21wc10:40:003
283215499237,13cyclictest2898707-21switchtime10:15:223
283215499235,17cyclictest2862291-21gzip08:30:203
283215499234,17cyclictest2916180-21awk11:05:203
283215499234,17cyclictest2847832-21sed07:50:213
283215499232,18cyclictest0-21swapper/310:10:133
283215499231,20cyclictest2854945-21ntpq08:10:193
283215499230,21cyclictest0-21swapper/309:40:123
283215499230,20cyclictest2891633-21taskset09:55:193
2832143992314,6cyclictest883-21dbus-daemon08:20:010
283214399230,21cyclictest3056-21PK-Backend07:40:020
29212602220,3chrt0-21swapper/211:20:182
283215499229,12cyclictest28610332chrt08:28:303
283215499229,11cyclictest2936027-21latency_hist12:05:013
283215499229,11cyclictest2910588-21sh10:50:143
283215499229,11cyclictest2904678-21anacron10:34:133
283215499228,12cyclictest2840842-21sed07:30:223
283215499224,16cyclictest2919035-21expr11:15:143
283215499224,16cyclictest2849370-21swap07:55:213
283215499223,17cyclictest2945410-21expr12:30:133
283215499223,16cyclictest2948101-21/usr/sbin/munin12:35:233
283215499222,18cyclictest2888094-21tail09:45:193
283215499222,18cyclictest2856185-21cstates08:15:123
283215499222,15cyclictest2836317-21apt07:20:123
2832154992217,3cyclictest2938605-21memory12:10:183
283215499221,19cyclictest2922421-21sort11:25:133
283215499221,19cyclictest2913550-21latency_hist11:00:003
283215499221,19cyclictest2881365-21python309:25:223
283215499221,19cyclictest2875190-21latency_hist09:10:003
283215499221,18cyclictest2944090-21python312:25:213
283215499221,18cyclictest0-21swapper/311:55:153
2832154992211,10cyclictest978-21snmpd07:37:273
283215499220,20cyclictest2941495-21apt12:20:113
283215499220,20cyclictest2893004-21taskset10:00:143
2832149992218,2cyclictest2945973-21ntp_states12:30:192
2832149992215,6cyclictest2833097-21ntp_states07:10:192
283214999220,21cyclictest2889136-21/usr/sbin/munin09:50:192
2832143992220,1cyclictest3056-21PK-Backend12:30:350
2832143992220,1cyclictest0-21swapper/012:15:330
2832143992220,1cyclictest0-21swapper/011:06:260
2832143992213,6cyclictest2901031-21apt-get10:25:000
283214399220,21cyclictest0-21swapper/007:46:450
283214399220,21cyclictest0-21swapper/007:24:210
283214399220,21cyclictest0-21swapper/007:16:230
139099220,3rtkit-daemon0-21swapper/007:26:290
28803992210,4sleep10-21swapper/109:25:011
283215499217,12cyclictest2890259-21sshd09:50:293
283215499215,14cyclictest2914094-21sh11:00:143
283215499214,15cyclictest2940222-21cat12:15:183
283215499214,15cyclictest2909193-21ntpq10:45:193
283215499214,15cyclictest2907365-21missed_timers10:40:193
283215499214,15cyclictest2907365-21missed_timers10:40:183
283215499213,16cyclictest2882360-21cpuspeed_turbos09:30:143
2832154992112,8cyclictest42-21ksoftirqd/308:05:193
283215499211,18cyclictest1-21systemd07:15:013
283215499211,15cyclictest2894362-21apt10:05:123
283215499210,19cyclictest2903036-21turbostat10:30:003
283215499210,19cyclictest2878903-21grep09:20:133
283215499210,19cyclictest2851736-21apt-get08:05:003
283215499210,18cyclictest2875676-21diskstats09:10:153
2832149992119,1cyclictest0-21swapper/210:35:072
2832149992115,4cyclictest2156-21gnome-shell12:20:092
2832149992113,6cyclictest2868104-21cron08:49:592
2832143992119,1cyclictest3056-21PK-Backend11:16:390
2832143992119,1cyclictest0-21swapper/011:42:550
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional