You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-27 - 09:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Wed Aug 27, 2025 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
260199912911244,23cyclictest27893-21pidof19:30:001
258222765720,29sleep10-21swapper/119:23:361
259372740696,29sleep00-21swapper/019:24:480
260189911491,5cyclictest27883-21munin-run19:30:000
1713021020,6sleep00-21swapper/021:59:390
530221000,8sleep02601899cyclictest23:27:210
79572880,4sleep041ktimersoftd/021:15:330
79572880,4sleep041ktimersoftd/021:15:330
78712850,7sleep02601899cyclictest00:37:000
210512800,3sleep041ktimersoftd/000:50:360
39772790,4sleep041ktimersoftd/000:33:200
251372780,5sleep125134-21ssh22:40:331
4522740,7sleep12601999cyclictest21:05:241
296282580,7sleep02601899cyclictest23:52:420
39032570,3sleep041ktimersoftd/022:52:210
103902411,23sleep010425-21ntp_states22:25:270
2601899401,8cyclictest30770-21idleruntime23:20:240
2601999382,21cyclictest0-21swapper/123:12:211
2601899378,13cyclictest6645-21cat22:55:200
26018993714,4cyclictest5317-21ssh22:20:220
26019993526,5cyclictest2020-21diskstats21:10:161
2601899355,5cyclictest81rcu_preempt23:40:220
197972351,30sleep118938-21/usr/sbin/munin20:30:261
26019993417,14cyclictest22-21ksoftirqd/122:20:451
26019993416,5cyclictest1071-21sed22:15:311
26019993416,15cyclictest22-21ksoftirqd/121:21:331
2601999341,5cyclictest81rcu_preempt22:12:111
2601999341,4cyclictest81rcu_preempt23:32:481
2601999341,18cyclictest15384-21ssh00:10:561
2601899346,5cyclictest81rcu_preempt21:53:430
2601899346,4cyclictest81rcu_preempt22:08:190
2601899345,5cyclictest81rcu_preempt00:43:100
2601899344,4cyclictest81rcu_preempt21:26:040
2601899341,21cyclictest29144-21tune2fs22:45:170
301432330,5sleep0111rcuc/021:00:000
295402330,3sleep1201rcuc/120:55:301
2601999332,16cyclictest27759-21ssh23:17:001
2601999331,15cyclictest0-21swapper/121:28:571
2601999331,14cyclictest36292sh00:32:501
2601999331,14cyclictest113172awk00:40:281
2601899338,5cyclictest81rcu_preempt22:15:200
2601899335,4cyclictest81rcu_preempt22:41:580
2601899335,4cyclictest81rcu_preempt00:49:420
2601899333,4cyclictest81rcu_preempt00:14:420
2601899333,3cyclictest81rcu_preempt22:10:130
2601899331,7cyclictest11779-21df21:20:150
26018993313,6cyclictest24291-21ssh00:20:270
26018993313,6cyclictest24291-21ssh00:20:260
2601899331,12cyclictest0-21swapper/023:38:350
2601999329,19cyclictest0-21swapper/123:40:221
2601999328,5cyclictest40950irq/93-i91520:40:021
2601999322,17cyclictest0-21swapper/100:16:411
2601999321,6cyclictest22789-21needreboot23:45:301
2601999321,6cyclictest22789-21needreboot23:45:291
2601999321,27cyclictest0-21swapper/122:26:341
2601999321,17cyclictest3982-21ssh00:00:121
2601899324,4cyclictest81rcu_preempt23:04:290
2601899322,4cyclictest81rcu_preempt22:00:080
26018993213,5cyclictest26750-21users23:15:340
2601899321,27cyclictest18058-21basename20:25:270
26018993212,6cyclictest147222cut22:30:200
26018993212,5cyclictest0-21swapper/023:55:420
26018993210,5cyclictest6340-21rm00:01:490
157292321,3sleep115816-21memory00:45:271
283052311,5sleep10-21swapper/123:50:461
2601999312,17cyclictest0-21swapper/121:44:211
26019993121,6cyclictest18219-21ssh22:34:091
26019993117,8cyclictest13580-21diskstats20:15:171
2601999311,4cyclictest81rcu_preempt23:25:321
2601999311,4cyclictest81rcu_preempt20:52:181
2601999311,4cyclictest81rcu_preempt00:51:571
2601999311,26cyclictest0-21swapper/121:34:481
2601899317,4cyclictest81rcu_preempt21:10:140
2601899316,4cyclictest21087-21/usr/sbin/munin21:30:230
2601899316,13cyclictest3588-21diskmemload21:45:160
2601899313,4cyclictest81rcu_preempt23:47:250
2601899313,4cyclictest81rcu_preempt23:47:240
26018993123,5cyclictest15037-21idleruntime-cro20:20:000
2601899312,15cyclictest8476-21ntp_states20:00:250
2601899312,15cyclictest8476-21ntp_states20:00:250
2601899312,13cyclictest0-21swapper/023:10:000
2601899311,9cyclictest0-21swapper/000:08:360
2601899311,4cyclictest81rcu_preempt22:37:480
2601899311,4cyclictest81rcu_preempt19:39:520
2601899311,4cyclictest81rcu_preempt00:25:380
2601899311,4cyclictest81rcu_preempt00:20:010
26018993110,16cyclictest27320-21awk21:35:340
2601899310,4cyclictest81rcu_preempt23:05:270
214122311,3sleep121423-21ssh22:36:491
187022311,5sleep10-21swapper/120:29:181
16122311,5sleep00-21swapper/021:43:140
322342301,5sleep10-21swapper/119:39:401
321362301,5sleep10-21swapper/122:48:231
2601999307,19cyclictest0-21swapper/122:55:111
2601999304,4cyclictest81rcu_preempt21:51:481
2601999304,4cyclictest81rcu_preempt20:04:321
2601999304,4cyclictest81rcu_preempt20:04:321
2601999304,22cyclictest0-21swapper/123:08:251
2601999303,23cyclictest0-21swapper/123:21:401
2601999302,9cyclictest0-21swapper/100:37:281
2601999302,15cyclictest0-21swapper/122:54:151
2601999301,4cyclictest81rcu_preempt22:02:201
2601999301,4cyclictest81rcu_preempt21:16:201
2601999301,4cyclictest81rcu_preempt21:16:201
2601899305,4cyclictest81rcu_preempt19:50:170
2601899302,15cyclictest26754-21df20:50:150
2601899300,4cyclictest81rcu_preempt19:42:070
14492301,5sleep10-21swapper/123:56:551
74462291,5sleep00-21swapper/019:59:510
70722291,5sleep10-21swapper/119:56:011
52532291,5sleep10-21swapper/119:51:371
2601999299,17cyclictest0-21swapper/121:35:241
2601999293,23cyclictest0-21swapper/123:00:591
2601999292,6cyclictest0-21swapper/121:47:251
2601999292,16cyclictest0-21swapper/100:21:521
2601999292,16cyclictest0-21swapper/100:21:521
26019992921,5cyclictest23834-21cat22:05:311
2601999291,8cyclictest0-21swapper/123:36:201
26019992913,12cyclictest0-21swapper/100:27:551
2601899292,13cyclictest2220-21dbus-daemon20:21:450
2601899291,22cyclictest8071-21iostat23:30:200
26018992911,6cyclictest2220-21dbus-daemon19:45:320
2601899291,15cyclictest11690-21df20:10:170
2601899290,4cyclictest81rcu_preempt21:08:040
204252291,5sleep00-21swapper/020:32:410
35262281,5sleep10-21swapper/119:48:101
315962281,5sleep10-21swapper/121:01:151
2601999289,15cyclictest0-21swapper/121:58:311
2601999283,4cyclictest81rcu_preempt20:47:201
2601999283,21cyclictest0-21swapper/100:06:021
26019992818,6cyclictest9744-21cpuspeed_turbos20:05:151
26019992815,7cyclictest3020-21runrttasks20:10:151
2601899282,13cyclictest29175-21hddtemp_smartct19:30:190
2601899281,23cyclictest317292chrt21:02:360
26018992810,6cyclictest21215-21fschecks_count20:35:210
259392281,5sleep00-21swapper/020:46:160
13852281,5sleep10-21swapper/119:41:421
2601999271,22cyclictest23155-21fschecks_time20:40:171
2601999271,22cyclictest23155-21fschecks_time20:40:161
2601899272,12cyclictest22866-21/usr/sbin/munin20:40:130
2601899272,12cyclictest22866-21/usr/sbin/munin20:40:120
162672271,3sleep116436-21uptime20:20:321
2601999261,16cyclictest0-21swapper/119:34:371
2601899263,15cyclictest0-21swapper/020:07:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional