You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-19 - 16:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Wed Jun 19, 2024 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
225799912061176,26cyclictest11138-21snmpd19:26:351
224992691646,30sleep00-21swapper/019:24:460
213412566518,31sleep10-21swapper/119:20:221
2257899146124,18cyclictest0-21swapper/019:26:350
69042950,8sleep02257899cyclictest20:05:300
132112400,2sleep013207-21grep23:15:120
227222351,4sleep022725-21df23:40:170
2257999357,4cyclictest91rcu_sched20:06:231
284732340,2sleep128472-21aten_r4power_en22:30:131
22579993425,6cyclictest31178-21/usr/sbin/munin22:35:351
22579993310,18cyclictest18271-21latency_hist00:55:011
22578993316,13cyclictest3-21ksoftirqd/000:20:000
57502321,27sleep15752-21irqstats00:20:281
273072321,3sleep027367-21cut21:00:200
2257999314,4cyclictest81rcu_preempt23:14:091
209902311,26sleep121035-21hddtemp_smartct23:35:211
158532311,26sleep115245-21/usr/sbin/munin21:55:241
321162301,5sleep10-21swapper/121:12:211
266482301,5sleep00-21swapper/019:31:560
2257999306,4cyclictest81rcu_preempt22:25:131
2257999305,4cyclictest81rcu_preempt23:31:401
2257999305,4cyclictest81rcu_preempt00:10:271
2257999304,4cyclictest81rcu_preempt20:58:441
2257999303,4cyclictest81rcu_preempt20:44:321
22579993023,4cyclictest32499-21diskstats22:40:191
2257999301,4cyclictest81rcu_preempt21:43:011
2257999301,4cyclictest81rcu_preempt20:16:011
2257999301,4cyclictest81rcu_preempt00:36:241
22578993013,13cyclictest11588-21ntpdc00:35:310
2257899301,13cyclictest17433-21sh22:00:140
186632301,5sleep10-21swapper/122:03:031
325492291,5sleep00-21swapper/019:49:340
2257999297,4cyclictest81rcu_preempt21:25:531
2257999296,4cyclictest81rcu_preempt23:50:221
2257999296,4cyclictest81rcu_preempt23:16:061
2257999294,4cyclictest81rcu_preempt19:49:161
2257999294,19cyclictest24977-21diskstats22:20:161
2257999294,19cyclictest19314-21diskstats22:05:151
2257999293,4cyclictest81rcu_preempt21:32:431
2257999291,4cyclictest81rcu_preempt20:12:571
2257999291,3cyclictest0-21swapper/100:32:231
22579992910,6cyclictest3020-21runrttasks23:00:061
22579992910,6cyclictest3020-21runrttasks23:00:051
2257999290,4cyclictest81rcu_preempt19:32:591
2257899292,7cyclictest13962-21df20:25:160
15782291,5sleep00-21swapper/021:17:450
143292291,5sleep10-21swapper/100:44:321
140172291,5sleep00-21swapper/000:41:160
112322291,5sleep00-21swapper/021:43:590
10372291,5sleep00-21swapper/022:40:470
53022281,5sleep00-21swapper/021:26:030
33912281,5sleep00-21swapper/021:20:440
33402281,5sleep10-21swapper/122:48:591
297392281,5sleep00-21swapper/023:59:410
286792281,5sleep10-21swapper/119:38:331
284312281,5sleep00-21swapper/019:35:590
279592281,5sleep00-21swapper/022:26:520
246102281,23sleep124700-21fschecks_count23:45:161
242532281,5sleep10-21swapper/122:17:341
2257999285,4cyclictest81rcu_preempt19:40:041
2257999284,4cyclictest81rcu_preempt23:20:481
2257999284,4cyclictest81rcu_preempt23:08:411
2257999284,4cyclictest81rcu_preempt22:51:091
2257999284,4cyclictest81rcu_preempt21:16:091
2257999282,4cyclictest81rcu_preempt21:22:351
22579992816,7cyclictest15181-21iostat_ios00:45:261
22579992816,10cyclictest22-21ksoftirqd/123:42:431
2257899284,18cyclictest19682-21python23:30:330
2257899283,18cyclictest15739-21ntp_states23:20:290
22578992816,8cyclictest21560-21/usr/sbin/munin22:10:270
2257899281,23cyclictest22727-21taskset20:47:290
225202281,5sleep10-21swapper/120:45:401
167722281,5sleep10-21swapper/123:25:031
148672281,5sleep00-21swapper/021:52:470
133412281,5sleep10-21swapper/120:23:141
113862281,5sleep00-21swapper/020:17:390
92752271,5sleep10-21swapper/121:38:211
69862271,5sleep10-21swapper/122:57:521
57022271,5sleep10-21swapper/120:03:001
51962271,5sleep00-21swapper/022:53:460
32402271,5sleep10-21swapper/100:15:101
316452271,5sleep00-21swapper/022:36:110
312642271,5sleep00-21swapper/000:00:500
258192271,5sleep00-21swapper/023:47:540
2257999275,4cyclictest81rcu_preempt21:51:571
2257999272,4cyclictest81rcu_preempt20:31:161
22579992718,5cyclictest2318-21egrep19:55:141
2257999271,4cyclictest81rcu_preempt20:53:501
2257999271,22cyclictest8257-21grep00:25:431
2257999271,11cyclictest29385-21iostat_ios21:05:241
2257899274,17cyclictest14877-21diskstats00:45:200
2257899272,8cyclictest0-21swapper/000:07:390
2257899272,6cyclictest9047-21python20:10:340
2257899272,6cyclictest20292-21users22:05:370
2257899272,12cyclictest2376-21NetworkManager00:21:260
22578992712,8cyclictest1859-21iostat_ios00:10:220
220252271,5sleep00-21swapper/023:37:450
189792271,5sleep10-21swapper/120:38:091
16862271,5sleep00-21swapper/019:51:360
154042271,5sleep10-21swapper/120:29:591
130872271,5sleep00-21swapper/021:48:480
127082271,5sleep00-21swapper/023:13:370
103572271,5sleep00-21swapper/000:32:260
6842261,5sleep10-21swapper/100:05:541
287702261,5sleep00-21swapper/021:05:020
285842261,5sleep10-21swapper/121:04:411
2257999263,3cyclictest81rcu_preempt19:53:031
2257899269,13cyclictest263492chrt22:24:350
2257899266,17cyclictest13310-21runrttasks20:22:560
2257899265,5cyclictest26519-21taskset20:57:520
2257899262,7cyclictest8269-21cat21:35:190
2257899261,8cyclictest26529-21cut23:50:160
22578992617,5cyclictest23837-21cat20:50:260
22578992612,12cyclictest0-21swapper/019:59:590
22578992612,11cyclictest4643-21fschecks_time20:00:210
2257899261,13cyclictest7504-21fschecks_time00:25:230
207792261,5sleep00-21swapper/020:41:470
2257999253,17cyclictest0-21swapper/122:10:161
22579992516,6cyclictest22-21ksoftirqd/100:01:461
22579992511,10cyclictest0-21swapper/123:57:301
2257899258,13cyclictest1652-21aten_r4power_en22:45:110
2257899255,16cyclictest30033-21taskset22:33:550
2257899253,16cyclictest7684-21diskstats23:00:200
2257899253,16cyclictest7684-21diskstats23:00:190
22578992518,4cyclictest30773-21aten_r4power_vo21:10:140
22578992517,5cyclictest3-21ksoftirqd/020:34:280
2257899251,6cyclictest17813-21fschecks_count20:35:180
22578992513,8cyclictest17263-21ntpdc00:50:220
2257999241,9cyclictest12384-21proc_pri21:45:331
2257899243,17cyclictest22829-21wget22:15:100
2257899242,5cyclictest29305-21diskstats19:40:170
2257899241,5cyclictest6749-21grep22:55:360
22578992415,6cyclictest3-21ksoftirqd/023:26:520
22578992413,7cyclictest6201-21fschecks_count21:30:170
2257899241,19cyclictest9369-21aten_r4power_vo23:05:140
22578992314,5cyclictest3-21ksoftirqd/021:55:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional