You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 20:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Fri Apr 19, 2024 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6719911981176,19cyclictest0-21swapper/107:25:081
6719911251112,9cyclictest10866-21mandb07:48:121
6709910661056,7cyclictest0-21swapper/007:25:130
5692652604,32sleep10-21swapper/107:24:321
4152470418,31sleep00-21swapper/007:22:550
670992651,229cyclictest0-21swapper/007:48:110
45732610,3sleep0111rcuc/008:55:330
287442550,4sleep181rcu_preempt08:35:171
671995222,4cyclictest22-21ksoftirqd/112:11:041
18712490,5sleep00-21swapper/010:20:090
671993817,4cyclictest22-21ksoftirqd/110:30:221
671993816,5cyclictest22-21ksoftirqd/111:21:371
671993815,4cyclictest22-21ksoftirqd/108:44:501
76162361,5sleep17620-21irqstats12:00:221
76162361,5sleep17620-21irqstats12:00:221
671993626,6cyclictest26700-21/usr/sbin/munin12:50:261
49162361,4sleep02376-21NetworkManager07:32:110
215602361,31sleep021680-21/usr/sbin/munin11:10:300
96552351,5sleep19717-21ntp_kernel_err12:05:451
671993427,4cyclictest22-21ksoftirqd/110:25:131
671993427,4cyclictest22-21ksoftirqd/109:25:201
67199336,7cyclictest81rcu_preempt08:25:171
671993327,3cyclictest22-21ksoftirqd/109:20:091
671993326,4cyclictest22-21ksoftirqd/111:45:131
671993326,4cyclictest22-21ksoftirqd/111:40:111
671993326,4cyclictest22-21ksoftirqd/111:35:291
671993326,4cyclictest22-21ksoftirqd/111:30:161
671993326,4cyclictest22-21ksoftirqd/110:40:231
671993326,4cyclictest22-21ksoftirqd/110:15:001
671993326,4cyclictest22-21ksoftirqd/109:30:121
671993326,4cyclictest22-21ksoftirqd/109:15:001
671993326,4cyclictest22-21ksoftirqd/109:05:111
671993326,4cyclictest22-21ksoftirqd/109:00:131
671993326,4cyclictest22-21ksoftirqd/108:50:121
671993326,4cyclictest22-21ksoftirqd/108:05:151
671993326,4cyclictest22-21ksoftirqd/107:30:121
671993325,4cyclictest22-21ksoftirqd/109:15:121
67099335,4cyclictest81rcu_preempt10:50:000
67099331,4cyclictest81rcu_preempt12:15:320
149702331,27sleep115050-21/usr/sbin/munin10:55:111
671993226,4cyclictest22-21ksoftirqd/112:15:181
671993226,4cyclictest22-21ksoftirqd/111:00:181
671993226,4cyclictest22-21ksoftirqd/107:40:131
671993226,3cyclictest22-21ksoftirqd/111:50:121
671993226,3cyclictest22-21ksoftirqd/108:05:001
671993225,4cyclictest22-21ksoftirqd/112:35:171
671993225,4cyclictest22-21ksoftirqd/112:25:151
671993225,4cyclictest22-21ksoftirqd/112:20:181
671993225,4cyclictest22-21ksoftirqd/111:05:151
671993225,4cyclictest22-21ksoftirqd/110:50:251
671993225,4cyclictest22-21ksoftirqd/110:45:201
671993225,4cyclictest22-21ksoftirqd/110:35:131
671993225,4cyclictest22-21ksoftirqd/110:18:511
671993225,4cyclictest22-21ksoftirqd/110:05:121
671993225,4cyclictest22-21ksoftirqd/109:50:321
671993225,4cyclictest22-21ksoftirqd/109:45:151
671993225,4cyclictest22-21ksoftirqd/109:35:141
671993225,4cyclictest22-21ksoftirqd/108:55:121
671993225,4cyclictest22-21ksoftirqd/108:21:001
671993225,4cyclictest22-21ksoftirqd/107:55:141
671993213,4cyclictest22-21ksoftirqd/112:49:351
670993217,8cyclictest11066-21diskstats12:10:170
671993125,4cyclictest22-21ksoftirqd/109:55:141
671993125,3cyclictest22-21ksoftirqd/111:59:131
671993125,3cyclictest22-21ksoftirqd/111:17:081
671993125,3cyclictest22-21ksoftirqd/111:17:071
671993125,3cyclictest22-21ksoftirqd/108:10:161
671993124,4cyclictest22-21ksoftirqd/111:10:091
671993124,4cyclictest22-21ksoftirqd/110:00:321
671993124,4cyclictest22-21ksoftirqd/108:45:381
671993116,12cyclictest22-21ksoftirqd/110:20:071
67099316,11cyclictest0-21swapper/011:20:220
67099315,13cyclictest24239-21latency_hist11:20:010
67099315,13cyclictest24239-21latency_hist11:20:000
67099312,24cyclictest15172-21/usr/sbin/munin10:55:110
67099311,19cyclictest25072-21timerandwakeup12:45:290
216922311,5sleep00-21swapper/012:38:100
671993024,4cyclictest22-21ksoftirqd/112:40:131
671993024,4cyclictest22-21ksoftirqd/111:25:101
671993024,4cyclictest22-21ksoftirqd/109:44:071
671993023,4cyclictest22-21ksoftirqd/108:30:161
671993023,4cyclictest22-21ksoftirqd/107:50:281
671993023,4cyclictest22-21ksoftirqd/107:35:171
67099302,4cyclictest81rcu_preempt11:35:550
670993019,6cyclictest2078-21ntpdc11:45:270
670993015,12cyclictest3-21ksoftirqd/008:17:070
67099301,4cyclictest81rcu_preempt09:40:530
67099301,4cyclictest81rcu_preempt09:39:540
67099301,4cyclictest81rcu_preempt08:45:130
67099301,4cyclictest81rcu_preempt08:37:170
67099301,24cyclictest32127-21diskstats11:40:150
67099301,13cyclictest22988-21ntp_states09:45:240
182722301,9sleep00-21swapper/012:30:040
138922300,8sleep067099cyclictest09:20:310
671992922,4cyclictest22-21ksoftirqd/112:30:211
671992922,4cyclictest22-21ksoftirqd/108:15:171
67099292,14cyclictest31914-21/usr/sbin/munin10:10:180
67099292,14cyclictest2376-21NetworkManager08:34:150
67099291,8cyclictest0-21swapper/011:54:030
67099291,23cyclictest1443-21cron10:20:000
260902291,5sleep00-21swapper/008:29:510
250592291,24sleep025178-21sed09:50:290
180642291,5sleep00-21swapper/011:00:370
173172291,5sleep00-21swapper/009:30:270
68382281,5sleep00-21swapper/009:03:530
67099286,10cyclictest5630-21cpu10:30:110
67099285,6cyclictest6204-21gdbus10:35:370
67099281,8cyclictest0-21swapper/011:27:210
670992814,10cyclictest10388-21cat10:40:310
670992813,5cyclictest81rcu_preempt12:50:150
67099281,23cyclictest2220-21dbus-daemon10:26:150
67099281,13cyclictest19847-21grep11:05:300
293072281,5sleep00-21swapper/010:02:520
273962281,5sleep00-21swapper/009:57:420
102972281,5sleep00-21swapper/009:10:470
74482271,5sleep00-21swapper/009:05:160
67099277,15cyclictest0-21swapper/012:20:200
67099276,5cyclictest0-21swapper/008:50:010
67099274,17cyclictest13699-21iostat_ios07:55:200
67099273,4cyclictest81rcu_preempt11:32:070
67099271,4cyclictest81rcu_preempt12:00:030
67099271,4cyclictest81rcu_preempt12:00:020
67099271,4cyclictest81rcu_preempt10:51:380
67099271,21cyclictest29762-21wget10:05:100
67099271,21cyclictest15080-21grep09:25:150
67099271,15cyclictest0-21swapper/011:55:510
67099271,14cyclictest5793-21cut07:35:170
670992710,13cyclictest19546-21/usr/sbin/munin08:10:250
236582271,5sleep00-21swapper/012:43:570
185602271,5sleep00-21swapper/008:09:460
176942271,5sleep00-21swapper/012:25:370
166412271,5sleep00-21swapper/008:04:200
123282271,5sleep00-21swapper/009:17:220
89842261,5sleep00-21swapper/007:44:520
67099264,16cyclictest31070-21python08:40:350
67099261,4cyclictest81rcu_preempt08:22:220
67099261,14cyclictest9030-21wget12:05:310
67099241,4cyclictest81rcu_preempt07:50:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional