You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 06:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Nov 22, 2025 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
84959912611229,15cyclictest30485-21kworker/0:319:25:090
84969912391212,23cyclictest0-21swapper/119:25:131
84969910961070,22cyclictest21164-21irqstats19:55:201
83852563518,31sleep10-21swapper/119:24:281
81072562517,30sleep00-21swapper/019:21:320
849599230210,15cyclictest0-21swapper/019:55:190
1805521200,3sleep0111rcuc/022:18:250
307822810,8sleep1849699cyclictest23:05:141
66282750,3sleep0111rcuc/022:40:140
303102690,4sleep0111rcuc/021:57:150
303102690,4sleep0111rcuc/021:57:150
40992640,3sleep14100-21run-parts23:10:321
8496996015,6cyclictest22-21ksoftirqd/123:42:531
8496996015,6cyclictest22-21ksoftirqd/122:34:191
8496996015,5cyclictest22-21ksoftirqd/121:31:201
8496995916,6cyclictest22-21ksoftirqd/123:51:221
8496995915,6cyclictest22-21ksoftirqd/123:26:291
8496995915,6cyclictest22-21ksoftirqd/123:00:471
8496995915,5cyclictest22-21ksoftirqd/122:54:421
8496995915,5cyclictest22-21ksoftirqd/121:46:481
8496995915,5cyclictest22-21ksoftirqd/100:29:391
8496995914,6cyclictest22-21ksoftirqd/100:42:171
8496995913,5cyclictest22-21ksoftirqd/123:19:581
8496995815,6cyclictest22-21ksoftirqd/122:10:511
8496995815,6cyclictest22-21ksoftirqd/100:30:551
8496995815,6cyclictest22-21ksoftirqd/100:30:541
8496995815,5cyclictest22-21ksoftirqd/122:38:101
8496995814,6cyclictest22-21ksoftirqd/121:51:331
8496995814,5cyclictest22-21ksoftirqd/121:25:361
8496995814,5cyclictest22-21ksoftirqd/100:05:321
8496995622,4cyclictest22-21ksoftirqd/123:35:311
8496995614,6cyclictest22-21ksoftirqd/100:48:571
849699525,4cyclictest81rcu_preempt22:15:141
8496995216,5cyclictest22-21ksoftirqd/122:49:201
8496995116,5cyclictest22-21ksoftirqd/123:31:051
8496995115,6cyclictest22-21ksoftirqd/122:07:581
8496995115,6cyclictest22-21ksoftirqd/100:21:281
8496995115,5cyclictest22-21ksoftirqd/100:14:461
849699505,6cyclictest22-21ksoftirqd/100:17:561
8496995022,4cyclictest22-21ksoftirqd/100:38:451
8496995020,4cyclictest22-21ksoftirqd/121:35:101
849699499,5cyclictest22-21ksoftirqd/121:55:371
849699499,5cyclictest22-21ksoftirqd/121:55:361
849699492,4cyclictest81rcu_preempt21:45:001
8496994915,6cyclictest22-21ksoftirqd/121:24:381
8496994915,5cyclictest22-21ksoftirqd/120:45:251
849699487,5cyclictest2220-21dbus-daemon19:50:221
8496994824,4cyclictest22-21ksoftirqd/120:50:241
8496994824,4cyclictest22-21ksoftirqd/120:15:251
8496994816,6cyclictest22-21ksoftirqd/100:03:111
8496994815,5cyclictest22-21ksoftirqd/122:27:061
849699475,13cyclictest22-21ksoftirqd/123:45:091
8496994717,5cyclictest22-21ksoftirqd/120:25:171
8496994715,5cyclictest22-21ksoftirqd/122:44:011
8496994714,5cyclictest22-21ksoftirqd/123:57:041
8496994713,14cyclictest22-21ksoftirqd/100:50:041
8496994710,6cyclictest22-21ksoftirqd/122:24:291
849599471,14cyclictest7666-21ssh22:07:190
8496994616,6cyclictest22-21ksoftirqd/122:55:211
8496994615,6cyclictest22-21ksoftirqd/120:41:251
8496994615,6cyclictest22-21ksoftirqd/120:41:241
8496994615,5cyclictest22-21ksoftirqd/122:00:501
849699453,15cyclictest22-21ksoftirqd/121:18:371
849699453,15cyclictest22-21ksoftirqd/121:18:361
849699449,6cyclictest22-21ksoftirqd/119:34:401
8496994425,4cyclictest22-21ksoftirqd/120:20:151
8496994411,6cyclictest22-21ksoftirqd/123:22:421
287412440,2sleep00-21swapper/000:10:160
849699439,5cyclictest14264-21kworker/1:220:06:141
849699438,5cyclictest15868-21users21:05:291
849699432,15cyclictest22-21ksoftirqd/121:14:191
849699428,6cyclictest22-21ksoftirqd/119:48:321
8496994222,4cyclictest22-21ksoftirqd/119:35:141
849699416,6cyclictest22-21ksoftirqd/120:10:111
8496994126,4cyclictest22-21ksoftirqd/120:00:131
849699407,6cyclictest22-21ksoftirqd/120:30:231
8496994026,4cyclictest22-21ksoftirqd/121:00:171
8496994026,4cyclictest22-21ksoftirqd/120:58:241
8496994026,4cyclictest22-21ksoftirqd/120:35:171
8496994026,4cyclictest22-21ksoftirqd/119:40:261
273132390,8sleep0849599cyclictest23:00:490
849599385,4cyclictest81rcu_preempt21:38:220
8495993818,7cyclictest11837-21grep00:25:290
849599371,17cyclictest16208-21ssh21:42:460
849599363,17cyclictest25720-21memory00:40:210
849599361,22cyclictest8068-21diskstats23:15:140
849599359,12cyclictest1236-21grep20:30:010
849599354,4cyclictest81rcu_preempt23:42:330
8495993530,3cyclictest164112sleep023:23:590
849599351,14cyclictest23399-21hddtemp_smartct21:50:180
28712351,4sleep02902-21/usr/sbin/munin00:50:250
849599349,12cyclictest0-21swapper/023:35:200
849599346,4cyclictest81rcu_preempt00:45:190
849599346,13cyclictest0-21swapper/022:25:160
849599343,4cyclictest81rcu_preempt00:32:370
849599343,4cyclictest81rcu_preempt00:32:360
315592344,5sleep00-21swapper/020:23:230
849599339,4cyclictest81rcu_preempt00:38:130
849599336,5cyclictest81rcu_preempt22:31:040
849599336,4cyclictest81rcu_preempt23:56:010
849599335,5cyclictest81rcu_preempt23:30:000
849599334,7cyclictest81rcu_preempt23:45:100
849599332,4cyclictest81rcu_preempt23:07:210
849599331,19cyclictest1730-21ssh00:15:270
849599331,18cyclictest10216-21cron00:25:010
8495993310,4cyclictest81rcu_preempt23:30:380
849599326,12cyclictest17205-21cut22:50:300
849599325,5cyclictest81rcu_preempt20:57:000
849599324,25cyclictest24164-21cat20:04:540
849599322,4cyclictest81rcu_preempt00:09:050
849599322,17cyclictest0-21swapper/020:36:070
849599321,7cyclictest13440-21ssh23:54:400
849599321,6cyclictest1843-21fschecks_count22:35:170
8495993215,4cyclictest24714-21fschecks_count20:05:170
849599321,18cyclictest2819-21sh23:10:030
849599321,12cyclictest0-21swapper/022:02:380
849599321,10cyclictest0-21swapper/000:00:230
235152321,5sleep00-21swapper/022:57:200
849599317,4cyclictest81rcu_preempt21:26:290
849599317,4cyclictest81rcu_preempt21:10:230
849599316,4cyclictest81rcu_preempt22:12:120
849599315,4cyclictest81rcu_preempt21:34:580
849599314,4cyclictest81rcu_preempt22:47:030
849599313,4cyclictest81rcu_preempt19:50:130
849599313,15cyclictest0-21swapper/021:07:390
154372311,5sleep00-21swapper/019:40:210
849599302,5cyclictest81rcu_preempt21:45:150
849599302,13cyclictest22908-21ssh21:15:320
849599302,13cyclictest22908-21ssh21:15:320
849599301,4cyclictest81rcu_preempt21:20:080
849599292,13cyclictest12884-21munin-run19:35:010
8495992910,6cyclictest7361-21df_inode20:45:150
31102291,6sleep00-21swapper/020:34:510
849599287,4cyclictest81rcu_preempt22:20:240
849599282,4cyclictest81rcu_preempt19:39:510
849599281,5cyclictest0-21swapper/019:45:230
276802281,5sleep00-21swapper/020:12:230
144392281,4sleep00-21swapper/021:04:590
849599271,22cyclictest28118-21aten_r4power_cu20:15:100
849599271,13cyclictest5647-21fschecks_time20:40:140
849599271,13cyclictest5647-21fschecks_time20:40:140
849599261,12cyclictest10013-21switchtime20:50:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional