You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 11:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Sat Jun 20, 2026 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
185129912471222,21cyclictest0-21swapper/019:27:290
183482551450,30sleep00-21swapper/019:23:510
180632541495,29sleep10-21swapper/119:20:511
305602870,4sleep0111rcuc/022:45:220
1851299662,15cyclictest14658-21munin-run22:05:000
18513996557,5cyclictest0-21swapper/119:27:301
18412620,3sleep018868-21kworker/0:322:55:220
102722420,3sleep0111rcuc/021:50:290
18513993616,7cyclictest23707-21ls23:55:001
1851299352,20cyclictest0-21swapper/022:30:160
1851399347,5cyclictest81rcu_preempt20:45:271
18513993414,8cyclictest22-21ksoftirqd/123:01:061
39872331,28sleep04153-21df20:10:120
269512331,28sleep127022-21users00:00:301
1851399335,5cyclictest81rcu_preempt23:25:211
1851299332,14cyclictest24651-21/usr/sbin/munin23:55:230
18512993316,6cyclictest3-21ksoftirqd/020:25:440
18512993316,6cyclictest3-21ksoftirqd/000:02:060
1851299331,12cyclictest0-21swapper/023:01:200
190252321,27sleep119063-21ntp_states23:40:231
18512993216,6cyclictest3-21ksoftirqd/019:38:280
18512993213,6cyclictest21822-21python20:55:290
1851299321,27cyclictest26841-21wget19:45:110
1851299321,21cyclictest0-21swapper/023:50:120
154122321,27sleep115416-21irqstats22:05:211
272462311,26sleep127284-21ntp_states21:10:241
229502311,26sleep123033-21memory22:25:211
1851399313,4cyclictest81rcu_preempt21:36:541
1851299318,5cyclictest0-21swapper/019:41:160
1851299311,28cyclictest0-21swapper/023:21:280
18512993112,6cyclictest15466-21diskstats20:40:150
18512993112,6cyclictest13567-21df_inode20:35:130
1851299311,15cyclictest7818-21/usr/sbin/munin21:45:170
92952301,3sleep10-21swapper/123:15:171
3047823022,4sleep030532-21swap00:10:280
286872301,5sleep10-21swapper/119:50:091
1851399305,4cyclictest81rcu_preempt00:34:311
1851399301,5cyclictest81rcu_preempt23:24:411
18513993014,5cyclictest40250irq/92-i91522:42:491
1851299308,8cyclictest32372-21awk00:15:280
1851299306,4cyclictest81rcu_preempt20:50:240
1851299303,4cyclictest81rcu_preempt21:21:130
1851299302,15cyclictest25166-21/usr/sbin/munin21:05:200
1851299302,14cyclictest8299-21basename00:40:000
1851299302,14cyclictest16929-21iostat23:35:190
18512993015,5cyclictest3-21ksoftirqd/021:42:200
18512993012,6cyclictest11200-21ntp_states00:45:230
18512993011,6cyclictest20767-21diskstats22:20:140
1851299301,15cyclictest30966-21fschecks_time19:55:150
1851299301,14cyclictest32107-21/usr/sbin/munin21:25:130
76412291,5sleep00-21swapper/020:20:060
72012291,5sleep00-21swapper/020:17:160
6842291,5sleep00-21swapper/022:51:440
42362291,5sleep00-21swapper/000:26:570
36072291,5sleep10-21swapper/120:08:581
313482292,23sleep10-21swapper/122:47:351
297522291,5sleep10-21swapper/121:16:591
290442291,5sleep00-21swapper/000:06:550
24862291,5sleep10-21swapper/100:24:091
242902291,5sleep10-21swapper/121:03:441
226962291,5sleep00-21swapper/019:33:050
215682291,5sleep10-21swapper/123:47:191
1851399296,4cyclictest81rcu_preempt21:40:471
1851399295,18cyclictest25238-21diskstats19:40:141
1851399294,4cyclictest81rcu_preempt21:05:381
1851399294,18cyclictest7526-21iostat_ios23:10:181
1851399294,18cyclictest6046-21diskstats20:15:151
1851399293,4cyclictest81rcu_preempt20:37:531
1851399292,4cyclictest81rcu_preempt20:42:311
1851399292,15cyclictest14650-21cron22:05:001
18513992919,6cyclictest28585-21sendmail_mailqu00:05:281
18513992916,7cyclictest30863-21diskstats19:55:141
18513992915,8cyclictest8248-21iostat_ios20:20:201
1851399291,4cyclictest81rcu_preempt22:30:091
1851299299,6cyclictest28387-21wget21:15:110
1851299297,12cyclictest0-21swapper/022:14:510
1851299292,14cyclictest18864-21diskstats22:15:140
18512992913,6cyclictest3-21ksoftirqd/023:46:510
18512992912,5cyclictest5880-21ntp_states23:05:230
18512992912,5cyclictest3-21ksoftirqd/022:26:420
1851299291,25cyclictest3-21ksoftirqd/021:14:390
18512992912,5cyclictest26687-21iostat22:35:170
1851299291,14cyclictest8552-21grep00:40:110
1851299291,14cyclictest16475-21seq22:09:290
17722291,24sleep11829-21latency22:55:211
128742291,5sleep10-21swapper/120:32:331
127132291,5sleep00-21swapper/020:30:520
124282291,5sleep10-21swapper/121:56:361
82412281,5sleep00-21swapper/023:10:510
6822281,5sleep10-21swapper/122:51:441
300372281,5sleep00-21swapper/019:51:120
296132281,5sleep00-21swapper/022:44:010
276042281,5sleep10-21swapper/122:37:521
222862281,5sleep10-21swapper/120:57:361
1851399286,4cyclictest81rcu_preempt22:21:361
1851399286,4cyclictest81rcu_preempt00:11:151
1851399286,12cyclictest40250irq/92-i91521:52:591
1851399285,4cyclictest81rcu_preempt19:48:021
1851399283,4cyclictest81rcu_preempt23:31:071
1851399282,4cyclictest81rcu_preempt19:32:211
1851399281,11cyclictest3286-21runrttasks21:32:561
1851299289,6cyclictest4498-21mailstats21:35:260
1851299283,13cyclictest0-21swapper/023:19:540
1851299281,9cyclictest0-21swapper/023:30:180
1851299281,13cyclictest1965-21fschecks_time21:30:140
18512992810,5cyclictest2753-21ntp_states20:05:280
1851299280,4cyclictest81rcu_preempt23:42:490
66622271,4sleep10-21swapper/123:08:561
54142271,5sleep10-21swapper/120:13:151
42072271,5sleep10-21swapper/100:26:381
315392271,5sleep10-21swapper/121:20:491
246692271,5sleep10-21swapper/119:39:071
1851399275,4cyclictest81rcu_preempt00:17:481
1851399274,4cyclictest81rcu_preempt21:45:001
1851399273,4cyclictest81rcu_preempt00:47:121
1851399273,18cyclictest19169-21iostat_ios22:15:191
1851399272,11cyclictest8290-21cron00:40:001
18513992719,5cyclictest17861-21unixbench_multi22:10:291
1851399271,13cyclictest0-21swapper/123:55:231
1851299273,8cyclictest1120-21diskstats00:20:140
1851299272,14cyclictest0-21swapper/023:26:430
18512992712,5cyclictest3-21ksoftirqd/021:58:230
1851299271,14cyclictest17884-21ntpq20:45:260
1851299271,13cyclictest11565-21gdbus00:33:560
18512992711,12cyclictest24293-21taskset21:03:450
13422271,5sleep10-21swapper/120:01:061
12712271,5sleep10-21swapper/121:29:031
1851399264,4cyclictest81rcu_preempt00:40:471
1851399261,4cyclictest81rcu_preempt00:52:461
1851299262,6cyclictest3286-21runrttasks00:50:030
13842261,5sleep00-21swapper/020:01:330
1851399258,13cyclictest2225-21dbus-daemon23:39:271
1851399252,10cyclictest10212-21memory20:25:221
1851399245,3cyclictest81rcu_preempt20:52:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional