You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-27 - 05:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon Jul 27, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
315439912461236,7cyclictest0-21swapper/019:25:050
315449911071079,24cyclictest2530-21strings19:30:231
310882646601,30sleep10-21swapper/119:20:471
313932467369,31sleep00-21swapper/019:24:020
3154399236225,8cyclictest0-21swapper/019:30:230
3154499112103,6cyclictest0-21swapper/119:25:061
31543996117,15cyclictest22655-21fschecks_time21:50:150
31543996117,15cyclictest22655-21fschecks_time21:50:150
157722580,8sleep03154399cyclictest21:30:270
320402540,2sleep132039-21fschecks_time22:15:171
93582460,7sleep13154499cyclictest22:40:231
66132381,4sleep16673-21ls22:35:011
31543993813,8cyclictest14266-21diskstats00:20:150
31543993711,13cyclictest5141-21iostat_ios23:55:200
264312361,31sleep126455-21smartctl22:00:181
145942361,5sleep114603-21diskstats22:55:151
31544993518,4cyclictest22-21ksoftirqd/120:55:291
318492341,29sleep131856-21iostat_ios23:40:221
3154499349,5cyclictest81rcu_preempt21:10:161
3154399347,14cyclictest0-21swapper/023:45:190
3154399341,13cyclictest19736-21fgrep20:15:270
109892341,4sleep111025-21ntp_states00:10:271
3154499325,9cyclictest2225-21dbus-daemon23:26:401
3154399321,6cyclictest7808-21sshd00:01:260
3154399321,19cyclictest27253-21runrttasks23:29:220
3154399321,16cyclictest3047-21grep22:25:120
31543993211,6cyclictest23457-21/usr/sbin/munin00:45:100
108782320,5sleep0111rcuc/022:45:150
3154499313,12cyclictest0-21swapper/121:01:231
31544993118,7cyclictest16846-21diskstats21:35:171
3154499311,4cyclictest81rcu_preempt20:31:371
3154399318,10cyclictest0-21swapper/022:20:100
3154399316,12cyclictest9448-21aten_r4power_po19:50:120
3154399316,11cyclictest21962-21cpu23:15:110
3154399311,19cyclictest31678-21fschecks_time23:40:170
3154399311,19cyclictest26981-21python22:00:280
182412311,26sleep118315-21iostat00:30:201
3154499306,4cyclictest81rcu_preempt20:44:201
3154499304,4cyclictest81rcu_preempt19:55:501
31544993021,5cyclictest18816-21tune2fs21:40:171
31544993020,6cyclictest15234-21cpuspeed_turbos20:05:131
3154499301,8cyclictest9384-21/usr/sbin/munin19:50:221
3154499301,4cyclictest81rcu_preempt20:17:441
3154499301,26cyclictest22507-21grep00:40:271
3154399302,4cyclictest81rcu_preempt20:38:360
3154399302,15cyclictest25035-21/usr/sbin/munin20:30:200
3154399302,13cyclictest14528-21munin-run21:30:010
3154399301,4cyclictest81rcu_preempt21:43:270
3154399301,4cyclictest81rcu_preempt20:50:350
3154399301,4cyclictest81rcu_preempt20:29:240
3154399301,4cyclictest81rcu_preempt20:29:240
31543993012,5cyclictest8972-21diskstats22:40:160
31543993011,7cyclictest3878-21hddtemp_smartct21:00:160
31543993011,6cyclictest30901-21ntpq20:45:230
3154399301,14cyclictest20188-21/usr/sbin/munin00:35:170
203182301,5sleep00-21swapper/021:45:100
173532301,5sleep10-21swapper/100:27:531
103562301,5sleep10-21swapper/121:16:061
76172291,5sleep00-21swapper/022:35:270
3154499295,4cyclictest81rcu_preempt23:24:171
3154499295,4cyclictest81rcu_preempt23:01:351
3154499295,4cyclictest81rcu_preempt00:38:011
31544992918,6cyclictest6580-21find19:40:261
3154499291,4cyclictest81rcu_preempt20:52:011
3154399298,7cyclictest7351-21pidof19:45:000
3154399294,18cyclictest8334-21ntp_states19:45:250
3154399293,13cyclictest0-21swapper/023:10:110
3154399291,7cyclictest23981-21ls23:20:130
31543992916,9cyclictest855-21latency_hist22:20:010
31543992912,5cyclictest27126-21sed00:55:000
31543992911,6cyclictest17895-21chrt23:04:480
31543992911,6cyclictest12085-21ntp_states19:55:230
31543992910,6cyclictest29645-21df_inode23:35:160
31543992910,5cyclictest4847-21sort19:35:300
31543992910,5cyclictest0-21swapper/021:09:340
31543992910,14cyclictest86272chrt21:12:390
3154399290,4cyclictest81rcu_preempt22:13:100
232232291,5sleep10-21swapper/100:45:021
171802291,5sleep00-21swapper/000:26:020
160102291,5sleep10-21swapper/121:31:061
125042291,5sleep10-21swapper/121:23:421
77602289,8sleep122-21ksoftirqd/100:00:581
43442281,5sleep00-21swapper/023:54:390
3154499287,4cyclictest40250irq/92-i91522:35:141
3154499285,4cyclictest81rcu_preempt20:22:421
3154499284,8cyclictest2951-21diskstats23:50:151
3154499283,19cyclictest13454-21diskstats20:00:161
3154499281,14cyclictest28312-21ntp_states23:30:251
3154499280,4cyclictest81rcu_preempt21:55:251
3154399284,12cyclictest21768-21timerandwakeup20:20:290
3154399282,14cyclictest28429-21iostat22:05:190
31543992819,5cyclictest3205-21turbostat.cron21:00:010
3154399281,4cyclictest81rcu_preempt21:56:000
3154399281,4cyclictest81rcu_preempt21:38:400
3154399281,4cyclictest81rcu_preempt20:03:160
3154399281,14cyclictest19115-21/usr/sbin/munin23:05:310
3154399281,13cyclictest9504-21fschecks_time21:15:180
3154399281,13cyclictest18122-21/usr/sbin/munin00:30:170
3154399281,13cyclictest15423-21timerandwakeup22:55:290
31543992810,5cyclictest5000-21aten_r4power_vo22:30:130
31543992810,5cyclictest14032-21runrttasks22:53:520
31543992810,5cyclictest11417-21hddtemp_smartct21:20:190
295222281,5sleep10-21swapper/122:09:451
279742281,5sleep10-21swapper/120:39:341
23752281,5sleep10-21swapper/123:49:401
140822281,5sleep10-21swapper/121:25:361
100042281,5sleep00-21swapper/000:09:460
66702271,5sleep10-21swapper/121:06:531
316222271,5sleep10-21swapper/120:48:151
3154499275,4cyclictest81rcu_preempt22:10:051
3154499275,4cyclictest81rcu_preempt20:13:221
3154499273,7cyclictest4839-21diskstats23:55:151
3154499273,18cyclictest23157-21iostat_ios20:25:201
3154499273,18cyclictest23157-21iostat_ios20:25:191
3154499273,17cyclictest13026-21iostat_ios22:50:181
3154499272,4cyclictest81rcu_preempt23:15:571
3154499272,10cyclictest0-21swapper/123:07:081
31544992714,10cyclictest22-21ksoftirqd/121:50:251
31544992714,10cyclictest22-21ksoftirqd/121:50:251
3154499271,13cyclictest81rcu_preempt22:20:291
3154399272,13cyclictest0-21swapper/000:14:410
3154399271,12cyclictest18254-21runrttasks20:11:100
3154399271,12cyclictest12296-21cstates00:15:140
30332271,22sleep10-21swapper/122:25:121
281992271,5sleep00-21swapper/020:40:110
268442271,5sleep10-21swapper/100:53:301
153542271,5sleep10-21swapper/100:21:371
3154499265,4cyclictest81rcu_preempt23:13:441
3154499264,7cyclictest11152-21iostat_ios22:45:201
3154499262,11cyclictest0-21swapper/121:46:081
3154499261,15cyclictest0-21swapper/123:36:531
3154399269,4cyclictest22632-21sort00:40:300
3154399263,3cyclictest81rcu_preempt23:31:350
135842261,4sleep10-21swapper/100:17:561
3154499259,12cyclictest0-21swapper/119:35:291
3154499254,19cyclictest0-21swapper/119:45:141
3154499253,20cyclictest0-21swapper/100:08:031
3154399251,11cyclictest15861-21grep20:05:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional