You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 06:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Mar 14, 2026 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
225309911851176,6cyclictest0-21swapper/119:26:201
225299911021057,33cyclictest0-21swapper/019:26:030
207622624568,40sleep00-21swapper/019:20:090
223472466419,32sleep10-21swapper/119:23:401
99732900,4sleep00-21swapper/023:35:250
188112900,4sleep041ktimersoftd/000:52:320
272982800,3sleep0111rcuc/023:20:150
162562800,4sleep0111rcuc/023:41:570
63802541,31sleep06387-21diskstats22:25:160
311872500,8sleep02252999cyclictest22:50:260
22529994616,20cyclictest3-21ksoftirqd/000:27:530
2252999448,32cyclictest0-21swapper/022:30:350
2253099429,30cyclictest14032-21fschecks_time20:25:151
22529994217,7cyclictest3-21ksoftirqd/023:34:210
22529994217,7cyclictest3-21ksoftirqd/000:36:280
216462425,33sleep021657-21ssh23:47:450
22529994116,15cyclictest3-21ksoftirqd/021:42:160
22529994116,15cyclictest3-21ksoftirqd/021:28:180
22529994112,7cyclictest3-21ksoftirqd/022:17:400
22530994023,13cyclictest0-21swapper/123:10:161
22529994018,7cyclictest3-21ksoftirqd/021:55:420
22529994017,7cyclictest3-21ksoftirqd/021:48:300
22529994016,8cyclictest3-21ksoftirqd/023:52:520
22529994016,7cyclictest3-21ksoftirqd/022:23:030
2253099398,13cyclictest0-21swapper/123:35:291
22529993918,6cyclictest3-21ksoftirqd/023:11:110
22529993917,7cyclictest3-21ksoftirqd/023:17:120
22529993917,7cyclictest3-21ksoftirqd/023:17:120
22529993917,6cyclictest3-21ksoftirqd/021:50:290
22529993916,8cyclictest3-21ksoftirqd/021:33:250
22529993916,10cyclictest3-21ksoftirqd/022:01:140
100382391,4sleep142-21kswapd023:02:131
242392381,34sleep024250-21ssh22:43:510
2253099386,28cyclictest0-21swapper/121:42:151
22529993817,7cyclictest3-21ksoftirqd/022:58:340
22529993817,7cyclictest3-21ksoftirqd/000:08:230
22529993817,6cyclictest3-21ksoftirqd/021:12:570
22529993816,7cyclictest3-21ksoftirqd/023:02:580
22529993816,7cyclictest3-21ksoftirqd/022:48:240
22529993815,7cyclictest3-21ksoftirqd/000:18:470
79782376,27sleep00-21swapper/021:20:100
320232370,5sleep1201rcuc/121:10:291
2253099377,14cyclictest40550irq/92-i91523:51:261
22530993725,8cyclictest6273-21ssh00:05:181
22529993728,5cyclictest10038-21ssh00:42:350
22529993716,7cyclictest3-21ksoftirqd/021:18:250
22529993716,7cyclictest3-21ksoftirqd/000:31:370
22529993715,8cyclictest3-21ksoftirqd/019:31:370
22529993715,7cyclictest3-21ksoftirqd/022:09:490
22529993715,7cyclictest3-21ksoftirqd/020:26:120
22529993711,6cyclictest3-21ksoftirqd/022:12:270
22530993617,13cyclictest22-21ksoftirqd/100:19:561
22530993616,16cyclictest22-21ksoftirqd/123:33:231
2252999366,19cyclictest0-21swapper/020:07:550
22529993615,7cyclictest3-21ksoftirqd/019:54:180
22529993615,6cyclictest3-21ksoftirqd/023:57:460
22529993615,6cyclictest3-21ksoftirqd/000:10:360
22529993615,11cyclictest23445-21cut20:50:160
22529993612,9cyclictest22439-21sh00:21:400
22529993610,7cyclictest3302-21runrttasks19:59:120
22529993610,7cyclictest3302-21runrttasks19:59:110
309112351,30sleep130986-21python00:30:271
2253099358,23cyclictest0-21swapper/122:48:461
2253099352,30cyclictest0-21swapper/121:26:151
22530993522,8cyclictest28071-21ssh00:27:521
2253099351,6cyclictest18772-21ssh22:04:561
266012341,4sleep126615-21ssh21:39:241
227502341,4sleep122763-21ssh22:08:431
22530993425,5cyclictest4649-21hddtemp_smartct20:00:161
2253099342,28cyclictest0-21swapper/123:28:551
2253099341,4cyclictest5469-21ssh22:57:361
2253099341,30cyclictest30519-21ssh22:50:161
2252999347,16cyclictest0-21swapper/023:06:170
251332331,4sleep025143-21/usr/sbin/munin20:55:140
22530993325,6cyclictest0-21swapper/122:16:161
22530993325,4cyclictest2403-21irqbalance23:09:361
22530993322,8cyclictest9583-21ssh00:41:571
2253099332,28cyclictest0-21swapper/122:36:161
2253099332,28cyclictest0-21swapper/122:36:151
2253099331,6cyclictest27064-21/usr/sbin/munin19:35:221
2253099331,4cyclictest81rcu_preempt21:55:421
22529993318,5cyclictest9140-21grep20:10:290
22529993317,7cyclictest0-21swapper/019:37:510
2252999331,30cyclictest0-21swapper/021:08:550
22529993311,7cyclictest3-21ksoftirqd/000:00:350
22529993311,6cyclictest21522-21/usr/sbin/munin20:45:150
2253099323,26cyclictest13080-21ssh22:31:371
22530993225,5cyclictest0-21swapper/122:27:351
2253099322,26cyclictest0-21swapper/123:46:371
2253099321,29cyclictest0-21swapper/121:22:151
2253099321,28cyclictest0-21swapper/122:10:151
2253099321,28cyclictest0-21swapper/121:48:161
2253099321,28cyclictest0-21swapper/121:31:041
2253099321,27cyclictest12714-21ssh00:11:361
2252999329,8cyclictest14557-21ssh00:47:420
2252999329,11cyclictest22527-21cyclictest19:47:270
2252999327,15cyclictest3-21ksoftirqd/023:29:020
22529993216,6cyclictest11706-21cut20:20:100
22529993214,5cyclictest19491-21df_inode20:40:140
22529993214,5cyclictest19491-21df_inode20:40:130
22529993214,5cyclictest17346-21ssh22:35:490
22529993214,5cyclictest17346-21ssh22:35:490
22529993211,6cyclictest3-21ksoftirqd/020:35:480
22529993211,6cyclictest3-21ksoftirqd/020:15:070
274272311,26sleep127440-21irqstats23:20:191
2253099312,4cyclictest81rcu_preempt23:17:121
2253099312,4cyclictest81rcu_preempt23:17:111
22530993123,5cyclictest0-21swapper/120:10:361
22530993120,8cyclictest3731-21unixbench_singl00:35:281
2253099311,5cyclictest20534-21diskstats00:20:161
2253099311,4cyclictest81rcu_preempt21:50:291
2253099311,4cyclictest81rcu_preempt21:18:251
2253099311,4cyclictest0-21swapper/120:21:561
2253099311,28cyclictest0-21swapper/121:00:171
2253099311,27cyclictest111-21usb-storage23:55:361
22529993110,7cyclictest3-21ksoftirqd/019:40:510
22529993110,11cyclictest0-21swapper/020:30:440
199902311,3sleep10-21swapper/120:40:241
199902311,3sleep10-21swapper/120:40:241
280992301,5sleep00-21swapper/021:01:250
2253099307,19cyclictest0-21swapper/122:44:111
2253099304,19cyclictest17905-21iostat_ios20:35:191
2253099302,4cyclictest81rcu_preempt22:23:031
22530993020,6cyclictest1428-21tr00:00:211
2253099301,3cyclictest0-21swapper/119:31:161
2253099301,27cyclictest0-21swapper/119:41:051
2253099301,26cyclictest111-21usb-storage20:16:021
2252999307,6cyclictest4841-21memory20:00:200
2252999306,12cyclictest3302-21runrttasks21:35:360
38712291,5sleep10-21swapper/119:59:001
38712291,5sleep10-21swapper/119:58:591
2253099291,24cyclictest15974-21cat00:50:001
196092291,5sleep10-21swapper/100:53:521
75182281,5sleep10-21swapper/120:07:401
22530992816,9cyclictest22-21ksoftirqd/123:40:461
2253099281,4cyclictest81rcu_preempt19:54:191
300902271,5sleep10-21swapper/121:07:371
170732271,5sleep10-21swapper/120:34:161
2253099265,4cyclictest81rcu_preempt20:56:321
22530992617,5cyclictest22-21ksoftirqd/119:46:201
2253099261,4cyclictest81rcu_preempt20:46:231
22530992517,5cyclictest22-21ksoftirqd/120:51:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional