You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 04:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue Jul 07, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
262619911131077,26cyclictest0-21swapper/019:28:470
260972597550,32sleep00-21swapper/019:23:520
260112563518,30sleep10-21swapper/119:22:571
2626299114106,5cyclictest0-21swapper/119:28:481
292162830,9sleep02626199cyclictest19:30:140
2626199442,16cyclictest9240-21munin-run21:30:000
192652401,4sleep10-21swapper/123:20:251
26261993721,5cyclictest3-21ksoftirqd/021:20:390
2626299365,4cyclictest81rcu_preempt21:25:191
2626199362,22cyclictest29159-21iostat_ios20:55:200
2626199362,22cyclictest29159-21iostat_ios20:55:200
26261993621,5cyclictest3-21ksoftirqd/021:09:090
143662361,31sleep014448-21/usr/sbin/munin20:15:250
143662361,31sleep014448-21/usr/sbin/munin20:15:240
62052351,5sleep06267-21df19:55:140
26261993520,4cyclictest3-21ksoftirqd/022:09:500
26261993519,5cyclictest3-21ksoftirqd/019:47:420
26261993517,4cyclictest111rcuc/000:55:010
26261993419,5cyclictest3-21ksoftirqd/023:52:030
26261993418,5cyclictest3-21ksoftirqd/021:42:520
26261993417,6cyclictest3-21ksoftirqd/000:41:100
189522343,27sleep12225-21dbus-daemon00:52:161
26262993311,6cyclictest16961-21cut21:50:101
26261993318,5cyclictest3-21ksoftirqd/020:21:100
26261993318,5cyclictest3-21ksoftirqd/020:02:090
26261993318,4cyclictest3-21ksoftirqd/022:17:220
2626199331,19cyclictest13008-21pidof21:40:000
51632321,27sleep12695-21snmpd21:16:591
314562321,5sleep10-21swapper/122:26:201
2626199327,5cyclictest40250irq/92-i91523:35:010
2626199326,12cyclictest17461-21cpuspeed_turbos20:25:150
26261993217,5cyclictest3-21ksoftirqd/023:26:070
26261993217,5cyclictest3-21ksoftirqd/019:40:490
26261993216,6cyclictest3-21ksoftirqd/020:07:180
2626199321,19cyclictest16775-21munin-run21:50:000
26261993211,6cyclictest8743-21wget00:20:110
16062321,27sleep12695-21snmpd19:41:261
291362315,5sleep122-21ksoftirqd/123:45:311
2626299317,13cyclictest40250irq/92-i91523:50:151
2626299314,4cyclictest81rcu_preempt00:42:521
26261993117,4cyclictest3-21ksoftirqd/022:55:100
26261993117,4cyclictest3-21ksoftirqd/022:42:020
26261993116,4cyclictest3-21ksoftirqd/023:35:060
26261993112,6cyclictest31118-21python22:25:290
2626199311,16cyclictest5505-21/usr/sbin/munin00:10:190
26261993111,5cyclictest29584-21chrt22:21:220
2626199311,12cyclictest0-21swapper/023:58:410
115812310,9sleep12626299cyclictest21:35:181
40612301,5sleep10-21swapper/100:05:291
2626299305,4cyclictest81rcu_preempt20:57:041
2626299305,4cyclictest81rcu_preempt20:57:031
2626299304,19cyclictest25272-21ntp_states22:10:241
2626299304,19cyclictest23526-21iostat_ios20:40:201
2626299301,3cyclictest0-21swapper/121:41:131
2626299300,4cyclictest81rcu_preempt00:22:051
2626199307,11cyclictest0-21swapper/000:00:100
2626199307,10cyclictest0-21swapper/021:50:100
2626199302,15cyclictest28151-21diskstats23:45:140
2626199301,5cyclictest0-21swapper/021:10:080
26261993015,5cyclictest3-21ksoftirqd/023:10:040
26261993015,5cyclictest3-21ksoftirqd/020:52:560
26261993014,6cyclictest3-21ksoftirqd/022:30:500
26261993013,5cyclictest31627-21ntp_states19:35:260
2626199301,12cyclictest0-21swapper/020:40:290
26261993010,5cyclictest4043-21diskstats21:15:140
169022301,25sleep12695-21snmpd20:22:491
144262301,5sleep00-21swapper/000:36:190
124382301,5sleep10-21swapper/123:02:551
95262291,4sleep10-21swapper/120:04:221
81922291,5sleep00-21swapper/000:16:480
71512291,5sleep00-21swapper/022:50:080
27792291,5sleep10-21swapper/100:04:491
269832291,24sleep127120-21fschecks_time20:50:171
2626299296,4cyclictest81rcu_preempt21:56:051
2626299295,4cyclictest81rcu_preempt22:39:561
2626299295,4cyclictest81rcu_preempt20:17:391
2626299295,4cyclictest81rcu_preempt20:17:391
2626299292,9cyclictest3286-21runrttasks00:25:331
2626299291,6cyclictest81rcu_preempt22:42:571
2626299291,4cyclictest81rcu_preempt23:34:111
2626199295,10cyclictest25507-21switchtime22:10:250
26261992913,5cyclictest3-21ksoftirqd/021:01:170
26261992911,6cyclictest12249-21taskset00:29:400
2626199291,14cyclictest26260-21df23:40:130
2626199291,13cyclictest12449-21/usr/sbin/munin00:30:120
181862291,5sleep10-21swapper/123:19:081
164642291,5sleep10-21swapper/121:47:001
140082291,5sleep10-21swapper/100:33:301
133372291,5sleep10-21swapper/120:15:001
82272281,5sleep10-21swapper/100:17:071
69312281,5sleep00-21swapper/022:49:230
65852281,5sleep10-21swapper/122:45:481
35562281,5sleep10-21swapper/119:46:021
276092281,5sleep10-21swapper/122:15:341
2626299286,4cyclictest81rcu_preempt22:22:351
2626299285,4cyclictest81rcu_preempt23:41:531
2626299285,4cyclictest81rcu_preempt22:06:401
2626299282,4cyclictest81rcu_preempt21:12:101
2626299282,13cyclictest0-21swapper/119:50:171
2626299281,4cyclictest81rcu_preempt22:55:021
2626199288,7cyclictest13234-21grep23:05:150
2626199284,18cyclictest3336-21diskstats00:05:150
26261992813,4cyclictest3-21ksoftirqd/020:34:430
26261992811,5cyclictest20976-21df22:00:120
2626199281,15cyclictest0-21swapper/023:19:470
2626199281,14cyclictest5266-21/usr/sbin/munin19:50:280
26261992811,14cyclictest0-21swapper/021:55:550
251092281,23sleep025270-21fschecks_time20:45:170
224662281,5sleep00-21swapper/020:37:080
224582281,5sleep10-21swapper/120:37:031
142492281,5sleep10-21swapper/123:07:171
110002281,5sleep00-21swapper/021:33:550
7732271,5sleep10-21swapper/123:59:051
320042271,5sleep10-21swapper/121:03:201
2626299277,15cyclictest6485-21open_files21:20:271
2626299274,15cyclictest0-21swapper/120:26:071
2626299273,4cyclictest81rcu_preempt22:51:531
2626299273,4cyclictest81rcu_preempt00:36:371
2626299271,4cyclictest81rcu_preempt19:37:241
26262992712,11cyclictest28921-21/usr/sbin/munin19:30:281
26262992712,11cyclictest24392-21awk23:35:151
26262992710,4cyclictest40250irq/92-i91521:05:231
2626199277,5cyclictest0-21swapper/020:10:110
2626199277,12cyclictest0-21swapper/023:24:480
205542271,5sleep10-21swapper/120:31:471
110672271,5sleep10-21swapper/120:05:561
73402261,5sleep10-21swapper/119:56:221
2626299266,15cyclictest218242chrt23:27:441
2626299263,4cyclictest81rcu_preempt23:10:531
2626299262,20cyclictest0-21swapper/120:45:191
26262992618,5cyclictest754-21head22:30:311
2626199269,14cyclictest0-21swapper/000:49:340
2626199269,14cyclictest0-21swapper/000:49:330
2626199261,13cyclictest12355-21taskset23:02:030
26261992610,5cyclictest3-21ksoftirqd/022:36:250
2626299258,5cyclictest0-21swapper/121:30:281
2626299257,5cyclictest40250irq/92-i91500:10:191
26262992513,9cyclictest22-21ksoftirqd/122:02:201
2626299251,11cyclictest17036-21chrt00:46:521
2626299251,11cyclictest17036-21chrt00:46:521
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional