You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 11:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue May 19, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21289912901,1270cyclictest0-21swapper/019:25:150
21299911291102,22cyclictest0-21swapper/119:25:151
20062602500,31sleep10-21swapper/119:24:221
12902503455,32sleep00-21swapper/019:20:260
104172970,4sleep0212899cyclictest21:10:110
70212450,7sleep10-21swapper/121:00:221
42322410,6sleep10-21swapper/122:20:091
51222350,9sleep0212899cyclictest20:55:200
2128993512,4cyclictest3-21ksoftirqd/020:50:000
2128993512,4cyclictest3-21ksoftirqd/020:50:000
2129993424,6cyclictest11862-21which00:05:181
212899348,12cyclictest27984-21grep20:30:180
212899347,4cyclictest81rcu_preempt23:35:160
2128993424,6cyclictest30939-21sshd20:38:530
234692331,4sleep011565-21gdbus20:19:260
2129993315,15cyclictest22-21ksoftirqd/123:45:251
212899339,12cyclictest425-21taskset20:44:280
212899331,17cyclictest21314-21sh21:40:000
2128993310,4cyclictest3-21ksoftirqd/000:15:220
54472321,3sleep00-21swapper/019:30:210
2129993224,5cyclictest22-21ksoftirqd/121:34:591
2129993222,6cyclictest14150-21cat22:45:181
2129993217,12cyclictest22-21ksoftirqd/119:50:261
212999321,4cyclictest40250irq/92-i91521:40:011
2128993210,19cyclictest0-21swapper/023:30:240
267212311,26sleep126728-21df_inode00:45:151
231042311,26sleep12225-21dbus-daemon21:44:081
2129993123,5cyclictest32751-21pidof20:43:001
212999312,24cyclictest3225-21iostat20:50:191
2129993116,12cyclictest22-21ksoftirqd/122:35:161
212899319,4cyclictest3-21ksoftirqd/023:20:220
212899315,14cyclictest40250irq/92-i91500:15:010
2128993124,4cyclictest12683-21cut21:15:230
2128993114,4cyclictest20287-21switchtime23:00:290
190932310,3sleep041ktimersoftd/000:25:100
162972311,25sleep016465-21df20:00:120
2129993024,4cyclictest22-21ksoftirqd/123:54:591
2129993023,4cyclictest40250irq/92-i91500:10:431
2129993022,4cyclictest22-21ksoftirqd/123:55:121
2129993017,10cyclictest22-21ksoftirqd/123:25:281
2129993016,7cyclictest15768-21diskstats22:50:151
2129993016,11cyclictest22-21ksoftirqd/122:15:531
2129993016,11cyclictest22-21ksoftirqd/122:15:531
2129993016,11cyclictest11771-21unixbench_singl19:45:301
2129993016,10cyclictest22-21ksoftirqd/119:30:221
212899309,5cyclictest3-21ksoftirqd/023:40:160
2128993022,6cyclictest0-21swapper/023:10:190
212899302,14cyclictest16027-21munin-run20:00:010
212899301,8cyclictest0-21swapper/021:28:090
212899301,4cyclictest81rcu_preempt22:58:520
212899301,4cyclictest81rcu_preempt22:40:250
212899301,26cyclictest7422-21cron23:54:590
2128993011,5cyclictest13010-21iostat_ios19:50:200
194702301,5sleep00-21swapper/020:06:540
100252301,24sleep110075-21iostat00:00:201
77502291,3sleep10-21swapper/122:29:451
265442291,5sleep00-21swapper/021:50:540
24992291,24sleep02506-21diskstats22:15:160
24992291,24sleep02506-21diskstats22:15:150
215712291,5sleep00-21swapper/020:14:130
2129992924,3cyclictest14579-21cut21:20:211
2129992922,4cyclictest25880-21mailstats23:15:291
2129992920,5cyclictest17726-21tune2fs22:55:171
2129992917,7cyclictest24004-21diskstats20:20:131
2129992916,8cyclictest22090-21df20:15:111
2129992915,11cyclictest22-21ksoftirqd/122:05:141
2129992914,12cyclictest22-21ksoftirqd/121:10:151
212999291,24cyclictest9143-21tune2fs19:40:181
212899296,4cyclictest40250irq/92-i91500:45:290
212899296,20cyclictest30047-21sleep00:55:000
212899292,12cyclictest17179-21cpuspeed_turbos00:20:130
212899291,4cyclictest81rcu_preempt21:40:020
212899291,4cyclictest81rcu_preempt00:00:300
2128992912,14cyclictest24750-21cpuspeed_turbos00:40:130
2128992912,14cyclictest0-21swapper/021:30:310
212899291,14cyclictest25453-21chrt23:15:210
212899291,14cyclictest23956-21iostat_ios21:45:230
2128992911,15cyclictest0-21swapper/022:25:090
2128992910,6cyclictest22275-21kworker/0:200:34:430
2128992910,5cyclictest29834-21ntp_states22:00:260
196612291,5sleep10-21swapper/120:08:541
184252291,4sleep10-21swapper/100:21:561
169662291,5sleep00-21swapper/022:52:450
155872291,5sleep00-21swapper/021:24:130
149322291,5sleep00-21swapper/022:46:070
79642281,5sleep00-21swapper/021:03:160
57262281,5sleep00-21swapper/022:23:080
302962281,5sleep10-21swapper/122:00:431
287762281,5sleep00-21swapper/021:59:370
281232281,5sleep10-21swapper/123:21:181
272522281,5sleep00-21swapper/020:29:330
260662281,5sleep10-21swapper/100:43:111
250382281,5sleep10-21swapper/121:49:471
23002281,5sleep10-21swapper/120:49:071
23002281,5sleep10-21swapper/120:49:071
2129992821,5cyclictest22-21ksoftirqd/123:40:151
2129992821,4cyclictest22-21ksoftirqd/100:35:231
2129992821,4cyclictest22-21ksoftirqd/100:35:231
2129992820,5cyclictest137450irq/90-eth000:50:101
2129992815,9cyclictest22-21ksoftirqd/122:10:181
2129992815,10cyclictest22-21ksoftirqd/123:38:131
2129992815,10cyclictest22-21ksoftirqd/121:20:001
2129992815,10cyclictest22-21ksoftirqd/119:40:011
212999281,23cyclictest8122-21/usr/sbin/munin22:30:121
2129992810,14cyclictest29828-21hddtemp_smartct20:35:171
2128992821,4cyclictest10924-21wc22:35:290
212899282,13cyclictest8583-21df_inode21:05:150
212899282,12cyclictest23009-21fschecks_count00:35:160
212899282,12cyclictest23009-21fschecks_count00:35:150
212899281,18cyclictest0-21swapper/020:24:010
2128992810,5cyclictest7053-21df_inode19:35:170
211172281,5sleep10-21swapper/123:05:091
154162281,24sleep115556-21fschecks_time00:15:161
102402281,5sleep00-21swapper/019:43:430
95552271,4sleep00-21swapper/022:33:590
59972271,5sleep10-21swapper/120:57:331
290912271,5sleep10-21swapper/120:34:121
266502271,5sleep10-21swapper/121:52:001
212999274,18cyclictest28289-21tail21:55:281
2129992720,4cyclictest22-21ksoftirqd/123:10:141
2129992720,4cyclictest22-21ksoftirqd/120:00:161
2129992716,4cyclictest22-21ksoftirqd/123:30:121
2129992714,10cyclictest22-21ksoftirqd/100:25:221
2129992713,11cyclictest22-21ksoftirqd/122:41:531
2128992711,4cyclictest21712-21iostat23:05:180
2128992710,14cyclictest0-21swapper/020:51:270
158302271,5sleep10-21swapper/119:58:141
2129992618,5cyclictest22-21ksoftirqd/100:34:561
2129992612,11cyclictest22-21ksoftirqd/120:26:251
212899261,8cyclictest81rcu_preempt23:55:180
212899261,22cyclictest0-21swapper/022:14:140
212899261,12cyclictest4088-21cstates23:45:160
212899261,12cyclictest11761-21grep19:45:300
207692260,4sleep181rcu_preempt20:10:261
2129992517,5cyclictest20397-21sort23:00:301
2129992517,4cyclictest22-21ksoftirqd/121:25:221
2129992515,6cyclictest8829-21ls21:05:191
212899259,13cyclictest11822-21fschecks_time00:05:170
2128992517,5cyclictest29246-21irqstats23:25:210
2128992413,6cyclictest31169-21df_inode22:05:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional