You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 13:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Sat Jul 12, 2025 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
98602239164,25sleep20-21swapper/219:07:102
98192234162,21sleep30-21swapper/319:06:393
98742231163,54sleep10-21swapper/119:07:211
97392211179,21sleep00-21swapper/019:05:340
101799910197,3cyclictest0-21swapper/219:18:092
85602690,2sleep00-21swapper/020:15:240
237932650,1sleep00-21swapper/000:30:270
237532600,3sleep232-21ksoftirqd/220:50:232
222892600,2sleep20-21swapper/200:30:012
307592470,4sleep230-21rcuc/222:20:192
10184994327,3cyclictest0-21swapper/320:31:223
10184994327,3cyclictest0-21swapper/320:31:223
10184994025,10cyclictest0-21swapper/321:59:373
10184993927,3cyclictest0-21swapper/320:51:243
10184993831,3cyclictest0-21swapper/319:21:243
10184993816,9cyclictest0-21swapper/320:56:513
10184993726,3cyclictest0-21swapper/323:14:393
10184993722,7cyclictest0-21swapper/319:54:083
10184993717,4cyclictest0-21swapper/322:11:013
10184993616,3cyclictest0-21swapper/321:13:533
1018499361,20cyclictest0-21swapper/323:55:473
1018499361,14cyclictest0-21swapper/319:30:183
1018499361,12cyclictest19874-40dnf20:40:323
1018499351,32cyclictest0-21swapper/321:03:393
1018499351,15cyclictest0-21swapper/323:45:213
1018499351,15cyclictest0-21swapper/323:45:213
1018499341,15cyclictest0-21swapper/322:16:153
1018499339,7cyclictest0-21swapper/319:56:543
10184993321,3cyclictest0-21swapper/322:30:233
10184993315,3cyclictest0-21swapper/322:37:173
10184993314,3cyclictest0-21swapper/300:03:053
1018499331,15cyclictest13971-40dnf21:41:233
1018499331,14cyclictest0-21swapper/320:18:413
278572320,2sleep121-21rcuc/122:15:161
1018499328,8cyclictest0-21swapper/319:43:363
10184993221,2cyclictest0-21swapper/300:36:493
10184993215,3cyclictest0-21swapper/323:29:093
10184993212,9cyclictest0-21swapper/320:09:553
1018499321,19cyclictest0-21swapper/321:37:333
1018499321,15cyclictest0-21swapper/321:34:373
1018499321,15cyclictest0-21swapper/300:14:133
1018499321,12cyclictest0-21swapper/300:15:333
10184993119,3cyclictest0-21swapper/320:39:483
10184993111,9cyclictest0-21swapper/320:28:563
1018499311,14cyclictest0-21swapper/323:20:253
1018499311,13cyclictest0-21swapper/323:03:573
1018499311,12cyclictest0-21swapper/321:25:493
1018499310,24cyclictest0-21swapper/323:53:073
1017499311,5cyclictest86550irq/126-enp1s0-21:25:151
22122300,2sleep10-21swapper/122:30:131
1018499309,3cyclictest0-21swapper/300:24:533
1018499307,3cyclictest0-21swapper/323:09:433
10184993016,3cyclictest0-21swapper/319:37:463
1018499301,27cyclictest0-21swapper/320:23:363
1018499301,18cyclictest0-21swapper/323:40:573
1018499301,18cyclictest0-21swapper/323:40:573
1018499301,18cyclictest0-21swapper/322:29:013
1018499301,12cyclictest0-21swapper/320:01:043
1018499300,20cyclictest0-21swapper/322:49:453
10184992918,3cyclictest0-21swapper/322:52:353
10184992912,7cyclictest0-21swapper/321:08:273
1018499291,15cyclictest0-21swapper/323:17:093
1018499291,13cyclictest5432-21diskstats20:10:153
1018499291,13cyclictest0-21swapper/321:23:333
1018499291,12cyclictest41-21ksoftirqd/300:09:393
10184992910,9cyclictest0-21swapper/319:19:213
1018499281,12cyclictest0-21swapper/322:07:153
1018499280,19cyclictest0-21swapper/321:45:213
1018499276,3cyclictest0-21swapper/321:15:353
1018499271,17cyclictest0-21swapper/321:53:093
10184992711,3cyclictest14634-21snmpd20:45:373
1018499271,10cyclictest0-21swapper/319:46:103
1018499271,10cyclictest0-21swapper/300:28:573
10174992721,3cyclictest4514-21munin-run23:50:011
10174992721,3cyclictest4514-21munin-run23:50:011
10174992710,3cyclictest6329-21users23:50:291
103652261,2sleep010408-21smart_sda00:00:260
1018499267,3cyclictest0-21swapper/322:59:453
1018499265,4cyclictest0-21swapper/300:30:073
10184992615,3cyclictest0-21swapper/323:30:413
1018499261,12cyclictest0-21swapper/322:23:533
1018499261,11cyclictest0-21swapper/322:45:013
1018499260,12cyclictest0-21swapper/322:03:113
1017499261,6cyclictest32596-21/usr/sbin/munin21:10:231
1017499261,18cyclictest0-21swapper/100:33:081
1017499261,15cyclictest21436-21diskstats22:00:161
1016999264,10cyclictest10504-21perf22:50:010
1018499251,12cyclictest0-21swapper/319:14:513
1017499259,4cyclictest9247-21munin-run20:20:011
1017499257,10cyclictest0-21swapper/123:21:281
1017499256,10cyclictest7280-21df_inode23:55:151
1017499251,4cyclictest17867-21grep21:50:271
1017499251,17cyclictest0-21swapper/100:05:141
1017499251,11cyclictest11455-21perf20:25:011
239972240,1sleep20-21swapper/222:05:182
1018499247,8cyclictest0-21swapper/319:25:483
1018499247,8cyclictest0-21swapper/319:25:483
1018499240,20cyclictest12467-21munin-node23:35:173
1017499242,16cyclictest0-21swapper/100:38:401
1017499241,20cyclictest22125-21munin-run00:30:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional