You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Fri May 02, 2025 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
319719911321110,6cyclictest0-21swapper/019:29:470
315642562517,31sleep00-21swapper/019:21:150
315922464418,31sleep10-21swapper/119:21:341
3197299140131,6cyclictest0-21swapper/119:29:471
86421300,8sleep13197299cyclictest23:45:001
216992490,9sleep13197299cyclictest20:20:241
43872450,3sleep14385-21awk22:25:301
31971994320,4cyclictest111rcuc/021:45:310
31971994023,6cyclictest3-21ksoftirqd/021:58:190
31971994022,6cyclictest3-21ksoftirqd/000:10:450
31971993923,6cyclictest3-21ksoftirqd/022:46:530
31971993923,6cyclictest3-21ksoftirqd/022:43:040
31971993918,10cyclictest3-21ksoftirqd/019:52:540
31971993822,6cyclictest3-21ksoftirqd/022:15:080
31971993822,6cyclictest3-21ksoftirqd/000:08:540
31971993822,5cyclictest3-21ksoftirqd/023:42:200
3197299373,7cyclictest81rcu_preempt00:10:251
31971993722,5cyclictest3-21ksoftirqd/020:27:500
31971993721,6cyclictest3-21ksoftirqd/020:44:360
31971993720,5cyclictest3-21ksoftirqd/023:34:190
31971993620,6cyclictest3-21ksoftirqd/021:38:110
31971993620,5cyclictest3-21ksoftirqd/020:02:170
31971993619,5cyclictest3-21ksoftirqd/020:12:200
3197299358,6cyclictest218082ls21:45:321
3197299351,15cyclictest170432wget21:35:151
3197199358,16cyclictest3-21ksoftirqd/000:15:030
3197199352,8cyclictest14360-21aten_r4power_po00:20:140
3197199352,8cyclictest14360-21aten_r4power_po00:20:140
31971993520,5cyclictest3-21ksoftirqd/020:07:060
31971993520,5cyclictest3-21ksoftirqd/020:07:060
31971993520,5cyclictest3-21ksoftirqd/019:56:010
31971993520,5cyclictest3-21ksoftirqd/019:36:410
31971993520,5cyclictest3-21ksoftirqd/000:33:090
31971993519,5cyclictest3-21ksoftirqd/023:23:550
31971993519,5cyclictest3-21ksoftirqd/021:19:270
31971993519,5cyclictest3-21ksoftirqd/020:34:380
31971993515,8cyclictest3020-21runrttasks22:09:380
231762351,4sleep16203-21packagekitd00:41:351
3197199348,13cyclictest40950irq/93-i91523:55:000
31971993419,5cyclictest3-21ksoftirqd/023:00:340
31971993418,6cyclictest3-21ksoftirqd/021:04:530
31971993318,5cyclictest3-21ksoftirqd/022:31:250
31971993318,5cyclictest3-21ksoftirqd/021:42:560
31971993318,5cyclictest3-21ksoftirqd/021:21:360
31971993318,5cyclictest3-21ksoftirqd/021:14:250
31971993318,5cyclictest3-21ksoftirqd/020:59:370
31971993318,5cyclictest3-21ksoftirqd/020:45:500
31971993318,5cyclictest3-21ksoftirqd/019:42:580
31971993317,6cyclictest3-21ksoftirqd/022:58:520
31971993317,6cyclictest3-21ksoftirqd/021:32:330
200252331,28sleep120029-21ntp_states20:15:281
165712331,28sleep116713-21users20:05:341
165712331,28sleep116713-21users20:05:331
31972993225,3cyclictest0-21swapper/122:40:271
3197299321,4cyclictest81rcu_preempt22:09:001
3197199329,7cyclictest3-21ksoftirqd/022:11:010
3197199329,7cyclictest3-21ksoftirqd/022:11:010
3197199329,7cyclictest3-21ksoftirqd/020:36:400
3197199328,8cyclictest25932-21fschecks_count00:50:220
3197199324,21cyclictest7441-21diskstats22:35:150
31971993218,5cyclictest3-21ksoftirqd/020:54:230
31971993218,5cyclictest3-21ksoftirqd/020:16:440
31971993217,5cyclictest3-21ksoftirqd/023:56:320
31971993217,5cyclictest3-21ksoftirqd/023:15:380
31971993213,14cyclictest7064-21diskstats00:00:160
31971993210,18cyclictest0-21swapper/021:07:380
126292321,4sleep16203-21packagekitd21:21:001
78322311,4sleep17841-21diskstats21:10:181
3197299311,4cyclictest81rcu_preempt22:46:461
3197299311,4cyclictest81rcu_preempt20:36:401
3197199319,7cyclictest3-21ksoftirqd/023:38:500
3197199319,7cyclictest3-21ksoftirqd/023:38:490
3197199318,11cyclictest0-21swapper/022:00:170
3197199311,8cyclictest9070-21ls19:45:330
31971993116,5cyclictest3-21ksoftirqd/019:31:240
31971993116,5cyclictest3-21ksoftirqd/000:46:120
31971993112,7cyclictest20352-21wget23:10:120
31971993111,6cyclictest3-21ksoftirqd/022:26:250
31971993111,6cyclictest3-21ksoftirqd/000:26:200
31971993110,6cyclictest3-21ksoftirqd/020:22:220
3197299307,4cyclictest81rcu_preempt21:27:121
3197299306,4cyclictest81rcu_preempt00:48:301
3197299305,4cyclictest81rcu_preempt23:11:511
3197299305,4cyclictest81rcu_preempt19:48:321
3197299304,4cyclictest81rcu_preempt22:59:481
3197299303,6cyclictest8721-21aten_r4power_po00:05:131
3197299303,4cyclictest81rcu_preempt23:23:421
3197299303,4cyclictest81rcu_preempt20:46:581
31972993016,11cyclictest0-21swapper/121:06:301
3197299301,4cyclictest81rcu_preempt22:11:011
3197299301,4cyclictest81rcu_preempt22:11:001
3197299300,4cyclictest81rcu_preempt20:12:171
3197199301,8cyclictest23054-21chrt00:40:310
31971993013,6cyclictest1503-21seq23:45:190
3197199301,24cyclictest26774-21ntp_states23:25:260
225742300,4sleep1201rcuc/121:50:121
144042301,5sleep10-21swapper/122:54:061
144042301,5sleep10-21swapper/122:54:061
75632291,5sleep10-21swapper/119:42:551
3197299298,5cyclictest81rcu_preempt22:15:301
3197299295,4cyclictest81rcu_preempt23:06:031
3197299294,4cyclictest81rcu_preempt00:15:031
3197299293,4cyclictest81rcu_preempt00:51:381
31972992916,7cyclictest22775-21iostat_ios23:15:221
3197299291,4cyclictest81rcu_preempt23:57:301
3197299291,4cyclictest81rcu_preempt23:38:491
3197299291,4cyclictest81rcu_preempt23:38:491
3197299291,4cyclictest81rcu_preempt19:32:211
31972992911,14cyclictest3020-21runrttasks00:30:161
3197199299,6cyclictest3-21ksoftirqd/021:27:120
203852291,5sleep10-21swapper/121:43:301
81182281,23sleep10-21swapper/100:01:161
3197299284,18cyclictest23265-21diskstats20:25:181
3197299284,18cyclictest1710-21diskstats22:20:171
3197299283,4cyclictest81rcu_preempt23:46:551
3197299283,4cyclictest81rcu_preempt20:50:131
3197299283,19cyclictest4390-21iostat_ios21:00:251
31972992819,4cyclictest22-21ksoftirqd/123:00:291
3197299281,4cyclictest81rcu_preempt00:37:561
3197299281,20cyclictest2518-21cat20:55:271
3197199286,7cyclictest3-21ksoftirqd/000:37:550
3197199286,12cyclictest3-21ksoftirqd/023:05:400
31971992813,5cyclictest3-21ksoftirqd/022:53:120
31971992813,5cyclictest3-21ksoftirqd/022:53:120
31971992813,5cyclictest23409-21/usr/sbin/munin21:50:270
30922281,4sleep00-21swapper/022:23:370
104202281,23sleep110470-21cat21:15:281
86912271,5sleep10-21swapper/122:38:201
68862271,5sleep10-21swapper/122:34:031
3197299273,18cyclictest15360-21diskstats21:30:201
31972992718,6cyclictest22-21ksoftirqd/100:29:331
31972992717,6cyclictest22-21ksoftirqd/119:50:521
3197299271,4cyclictest81rcu_preempt00:22:071
3197299271,4cyclictest81rcu_preempt00:22:071
299052271,5sleep10-21swapper/120:40:481
292272271,5sleep10-21swapper/123:31:581
264832271,4sleep10-21swapper/120:34:221
258332271,5sleep10-21swapper/121:56:431
31972992618,5cyclictest22-21ksoftirqd/122:01:521
31972992617,6cyclictest22-21ksoftirqd/123:52:341
31972992616,6cyclictest22-21ksoftirqd/119:37:231
31972992616,6cyclictest13928-21fschecks_count20:00:181
132352261,5sleep10-21swapper/119:58:261
3197299259,12cyclictest26536-21iostat23:25:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional