You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-01 - 03:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon Jun 01, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39389911341124,7cyclictest0-21swapper/019:28:290
38592561517,29sleep00-21swapper/019:24:440
36862488399,30sleep10-21swapper/119:22:561
393999127119,6cyclictest0-21swapper/119:28:291
2391221170,2sleep023909-21grep20:15:160
2745621160,2sleep027457-21idleruntime21:50:170
292212890,3sleep10-21swapper/120:30:111
141172470,3sleep014114-21grep21:15:190
3939994024,13cyclictest17748-21cstates00:20:151
393899401,19cyclictest2504-21fschecks_time22:10:180
393899401,13cyclictest12809-21/usr/sbin/munin21:10:260
393899362,13cyclictest13420-21/usr/sbin/munin22:40:130
393899361,6cyclictest31750-21runrttasks23:26:480
393899356,10cyclictest24041-21unixbench_singl23:05:290
393899352,14cyclictest0-21swapper/023:01:110
393899351,6cyclictest6967-21runrttasks23:47:030
393899351,6cyclictest30892-21grep22:00:150
393899351,5cyclictest18579-21runrttasks22:51:520
207142351,5sleep120783-21sensors_temp20:05:301
70022341,29sleep07087-21hddtemp_smartct19:30:170
393899346,13cyclictest6440-21tr20:55:130
393899342,15cyclictest32505-21df23:30:130
393899341,13cyclictest26013-21swap00:40:280
393899341,13cyclictest22103-21wc00:30:250
21692341,9sleep10-21swapper/120:44:401
393899332,19cyclictest0-21swapper/022:35:230
393899332,14cyclictest1759-21/usr/sbin/munin20:40:310
393899332,13cyclictest4318-21latency_hist20:50:010
393899331,4cyclictest3951-21df_inode23:40:160
258322331,28sleep125908-21hddtemp_smartct20:20:181
142762331,4sleep114283-21iostat_ios00:10:161
3939993219,9cyclictest15278-21latency_hist22:45:011
393899323,20cyclictest0-21swapper/000:29:210
393899321,14cyclictest24041-21/usr/sbin/munin00:35:270
393899321,14cyclictest18086-21taskset00:20:230
393899321,12cyclictest12835-21iostat19:45:190
322062321,27sleep132301-21users20:35:291
40562311,5sleep10-21swapper/120:48:401
393899317,4cyclictest40250irq/92-i91520:05:120
393899317,10cyclictest0-21swapper/021:31:560
393899311,5cyclictest9790-21http_loadtime23:55:180
393899311,5cyclictest15302-21grep19:50:310
393899311,26cyclictest5251-21users22:15:280
393899311,26cyclictest20060-21python22:55:270
393899311,13cyclictest25707-21df_inode20:20:160
393899311,13cyclictest24857-21taskset21:44:400
393899311,12cyclictest9620-21sort19:35:280
3938993110,5cyclictest18493-21iostat_ios20:00:230
3938993110,5cyclictest18493-21iostat_ios20:00:230
272902311,5sleep10-21swapper/120:25:121
168972311,5sleep10-21swapper/122:48:541
45872301,4sleep14591-21irqstats22:15:211
3939993020,6cyclictest17614-21aten_r4power_po21:25:101
3939993020,6cyclictest17614-21aten_r4power_po21:25:101
3939993016,8cyclictest19705-21diskstats21:30:151
393899307,5cyclictest15027-21runrttasks00:11:040
3938993020,6cyclictest26248-21unixbench_multi21:45:290
393899301,4cyclictest30038-21users00:50:300
3938993012,14cyclictest28488-21cut23:20:110
393899301,16cyclictest0-21swapper/022:25:000
393899301,13cyclictest28772-21taskset20:27:360
393899301,13cyclictest11031-21taskset22:31:370
393899301,12cyclictest9444-21taskset21:00:560
393899301,12cyclictest445-21fschecks_count22:05:170
278562301,5sleep00-21swapper/023:15:360
241192301,5sleep10-21swapper/123:05:451
195662301,25sleep119628-21df00:25:141
187652301,5sleep10-21swapper/122:53:501
121792301,3sleep10-21swapper/121:10:161
99532291,5sleep10-21swapper/119:37:361
91462291,5sleep00-21swapper/022:26:330
77412291,5sleep10-21swapper/120:57:591
72922291,4sleep10-21swapper/122:21:471
56742291,5sleep00-21swapper/020:51:000
393999294,18cyclictest15955-21diskstats21:20:151
3939992911,14cyclictest112802chrt21:05:321
393899298,5cyclictest18797-21who21:25:300
393899298,5cyclictest18797-21who21:25:290
393899293,23cyclictest0-21swapper/000:00:080
285472291,5sleep10-21swapper/121:54:031
282102291,5sleep10-21swapper/100:45:531
262452291,5sleep10-21swapper/123:13:221
233142291,5sleep00-21swapper/020:14:370
18782291,5sleep00-21swapper/023:35:140
168552291,5sleep00-21swapper/022:48:280
15052291,5sleep10-21swapper/122:06:371
13982291,5sleep10-21swapper/123:34:151
111792291,5sleep10-21swapper/122:33:091
90162281,5sleep00-21swapper/023:53:540
50872281,5sleep10-21swapper/123:42:041
393899283,12cyclictest0-21swapper/020:34:030
393899281,15cyclictest0-21swapper/000:45:170
393899281,15cyclictest0-21swapper/000:17:210
393899281,13cyclictest0-21swapper/019:40:180
3938992811,13cyclictest16033-21aten_r4power_en19:55:100
316272281,5sleep10-21swapper/123:25:331
304092281,5sleep10-21swapper/100:54:131
302762281,5sleep00-21swapper/021:57:320
281312281,5sleep10-21swapper/123:18:251
265252281,5sleep10-21swapper/121:47:311
134592281,5sleep00-21swapper/000:09:180
131532281,4sleep10-21swapper/122:39:091
125462281,5sleep10-21swapper/100:01:211
393999276,16cyclictest0-21swapper/100:30:161
3939992714,7cyclictest12248-21/usr/sbin/munin19:45:321
3939992712,11cyclictest0-21swapper/122:10:251
320512271,4sleep10-21swapper/122:01:171
299842271,5sleep10-21swapper/123:23:011
226052271,4sleep00-21swapper/021:35:580
192222271,5sleep10-21swapper/120:01:031
192222271,5sleep10-21swapper/120:01:021
172302271,4sleep00-21swapper/021:23:340
156492271,5sleep10-21swapper/119:53:061
155552271,5sleep10-21swapper/100:15:021
59152261,4sleep10-21swapper/120:53:311
3939992617,5cyclictest22-21ksoftirqd/123:00:231
3939992616,6cyclictest24384-21grep21:40:301
3939992610,12cyclictest22-21ksoftirqd/119:30:121
393899264,15cyclictest24989-21diskstats23:10:130
393899261,22cyclictest0-21swapper/021:05:110
393899261,10cyclictest0-21swapper/020:39:020
393999258,13cyclictest14254-21fw_packets21:15:191
3939992517,4cyclictest10493-21unixbench_multi23:55:301
3939992516,6cyclictest24374-21vmstat00:35:301
3939992516,6cyclictest22-21ksoftirqd/122:55:571
3939992516,5cyclictest2221-21cron21:40:001
3939992515,6cyclictest9185-21sort21:00:281
3939992515,6cyclictest2695-21snmpd19:55:121
393999251,22cyclictest0-21swapper/122:28:171
393999251,20cyclictest0-21swapper/123:45:251
3939992510,3cyclictest0-21swapper/121:55:171
133612251,5sleep10-21swapper/100:08:171
3939992416,5cyclictest8160-21needreboot23:50:231
3939992416,5cyclictest22-21ksoftirqd/120:10:401
3939992414,6cyclictest26448-21runrttasks00:42:221
393999233,8cyclictest0-21swapper/123:35:121
393999232,16cyclictest10964-21iostat_ios19:40:191
3939992212,5cyclictest24349-21ntp_states20:15:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional