You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-21 - 07:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack9slot4s (updated Sun Apr 21, 2024 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
188949912251180,31cyclictest19239-21grep19:25:110
188959911551118,33cyclictest23679-21iostat_ios21:00:191
188959911471122,21cyclictest19088-21grep19:25:101
184342576530,31sleep00-21swapper/019:20:450
185702564518,31sleep10-21swapper/119:22:091
204521230,8sleep01889499cyclictest00:20:240
188949911074,31cyclictest0-21swapper/021:00:190
214802660,5sleep181rcu_preempt22:20:231
319592419,5sleep131966-21latency_hist22:50:011
18895994029,8cyclictest40950irq/93-i91519:53:061
18895993832,4cyclictest40950irq/93-i91523:30:281
1889599375,29cyclictest40950irq/93-i91523:50:111
18895993628,4cyclictest22-21ksoftirqd/100:35:011
115682361,29sleep011587-21ntp_states00:45:330
50822351,5sleep15092-21ntp_states20:10:281
274142351,4sleep127434-21iostat_ios21:10:171
196492350,5sleep019650-21fschecks_count20:50:150
1889499351,4cyclictest166132chrt22:06:570
1889499344,4cyclictest8326-21mailstats23:10:330
1889499343,11cyclictest81rcu_preempt23:45:270
1889499342,14cyclictest3378-21cron23:00:000
1889499341,7cyclictest0-21swapper/019:34:270
168502341,9sleep00-21swapper/020:40:450
1889599335,7cyclictest64532/usr/sbin/munin23:05:301
18895993325,5cyclictest24995-21grep23:55:271
315922321,4sleep031692-21latency_hist00:15:010
274212321,5sleep00-21swapper/000:00:370
235642321,27sleep123570-21ntp_states22:25:311
315972311,4sleep031639-21python21:20:320
265062311,5sleep00-21swapper/021:08:200
18895993116,12cyclictest22-21ksoftirqd/123:45:191
1889499312,16cyclictest9443-21iostat_ios00:40:210
18894993118,10cyclictest0-21swapper/021:38:390
1889499311,4cyclictest81rcu_preempt00:52:110
1889499311,4cyclictest81rcu_preempt00:52:100
1889499311,4cyclictest81rcu_preempt00:33:560
90162301,5sleep00-21swapper/021:46:080
42162301,25sleep14259-21sort23:00:221
266792301,4sleep00-21swapper/019:41:200
203022301,5sleep00-21swapper/023:44:480
1889599305,9cyclictest17008-21diskstats23:35:181
18895993017,11cyclictest22-21ksoftirqd/120:00:221
18895993017,10cyclictest22-21ksoftirqd/119:35:171
18895993015,4cyclictest22-21ksoftirqd/100:14:201
18895993014,4cyclictest22-21ksoftirqd/121:40:381
18895993014,12cyclictest22-21ksoftirqd/122:33:471
18895993014,12cyclictest22-21ksoftirqd/121:35:351
1889599301,27cyclictest40950irq/93-i91520:45:261
1889499302,15cyclictest2220-21dbus-daemon00:09:430
18894993020,6cyclictest31955-21grep00:15:120
1889499301,15cyclictest1126-21snmpd23:05:240
1889499301,13cyclictest19022-21cut22:15:120
1889499300,4cyclictest81rcu_preempt22:01:380
182912301,5sleep00-21swapper/023:38:410
155482301,5sleep10-21swapper/120:40:101
142802301,5sleep00-21swapper/023:26:000
134082301,5sleep00-21swapper/020:34:080
90022291,5sleep10-21swapper/123:14:521
323882291,5sleep10-21swapper/119:57:101
315582291,5sleep00-21swapper/022:45:490
288892291,5sleep00-21swapper/019:49:520
264472291,4sleep126621-21perl00:00:181
230802291,5sleep10-21swapper/119:33:061
18895992922,4cyclictest22-21ksoftirqd/122:55:001
18895992915,4cyclictest22-21ksoftirqd/100:35:101
1889599291,26cyclictest40950irq/93-i91522:15:131
1889599291,26cyclictest0-21swapper/123:41:111
1889499294,5cyclictest81rcu_preempt22:50:300
1889499291,8cyclictest0-21swapper/020:45:200
1889499291,4cyclictest81rcu_preempt20:56:440
1889499291,4cyclictest81rcu_preempt20:19:070
1889499291,4cyclictest81rcu_preempt00:27:480
18894992914,11cyclictest0-21swapper/000:39:160
1889499291,15cyclictest2813-21fschecks_time20:05:170
1889499291,14cyclictest9635-21runrttasks20:23:550
18894992910,6cyclictest26942-21wget21:10:090
18894992910,6cyclictest24156-21wc23:55:010
183922291,5sleep00-21swapper/022:10:570
130222291,5sleep00-21swapper/021:58:510
126372291,5sleep00-21swapper/023:23:240
108732291,5sleep00-21swapper/023:19:470
89932281,5sleep10-21swapper/121:45:571
71652281,5sleep00-21swapper/021:41:220
262322281,5sleep00-21swapper/022:34:070
249482281,5sleep10-21swapper/121:05:051
249412281,5sleep00-21swapper/019:38:000
18895992821,4cyclictest2179-21kernelversion22:55:211
18895992820,5cyclictest22-21ksoftirqd/120:15:121
18895992815,10cyclictest22-21ksoftirqd/120:50:311
18895992814,11cyclictest22-21ksoftirqd/121:34:411
18895992814,11cyclictest22-21ksoftirqd/120:26:531
1889599281,25cyclictest40950irq/93-i91522:05:321
18895992812,5cyclictest22-21ksoftirqd/122:11:581
18895992812,12cyclictest22-21ksoftirqd/121:55:261
18894992810,5cyclictest21521-21latency22:20:240
301792271,5sleep10-21swapper/121:17:251
287732271,5sleep10-21swapper/122:40:171
281482271,4sleep00-21swapper/022:39:340
265902271,5sleep10-21swapper/119:40:331
243282271,5sleep00-21swapper/022:28:530
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional