You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-10-04 - 05:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s.osadl.org (updated Wed Oct 04, 2023 00:59:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
191099912581207,30cyclictest3-21ksoftirqd/021:35:390
191109912091186,19cyclictest2779-21snmpd21:35:391
191109911931171,18cyclictest29801-21smartctl19:50:271
186852448404,29sleep00-21swapper/019:21:080
187512354309,31sleep10-21swapper/119:21:511
1910999220197,16cyclictest2397-21lldpd19:50:280
301742910,4sleep12397-21lldpd21:15:411
247872870,4sleep1211ktimersoftd/123:55:231
231002830,4sleep1211ktimersoftd/123:50:261
293522560,3sleep00-21swapper/022:40:280
293522560,3sleep00-21swapper/022:40:280
223622460,3sleep1201rcuc/122:21:011
227922450,3sleep1201rcuc/119:30:371
109912440,8sleep01910999cyclictest00:45:170
1910999431,13cyclictest2779-21snmpd23:07:460
19110994225,4cyclictest22-21ksoftirqd/119:40:261
19110994125,4cyclictest22-21ksoftirqd/122:55:381
19110994124,6cyclictest22-21ksoftirqd/123:27:361
19110994123,6cyclictest22-21ksoftirqd/122:17:131
1910999414,6cyclictest3-21ksoftirqd/020:04:280
19109994127,9cyclictest3-21ksoftirqd/021:40:400
1910999410,12cyclictest18482-21ntp_states20:45:350
19110994025,4cyclictest22-21ksoftirqd/122:40:301
19110994025,4cyclictest22-21ksoftirqd/122:40:301
19110994024,4cyclictest22-21ksoftirqd/121:25:171
19110994023,4cyclictest22-21ksoftirqd/121:42:011
19110994021,9cyclictest22-21ksoftirqd/121:30:261
19110994020,10cyclictest22-21ksoftirqd/120:30:101
19109994010,13cyclictest0-21swapper/020:09:050
106442402,34sleep12779-21snmpd00:44:261
222722391,34sleep12779-21snmpd23:49:061
1911099397,16cyclictest41250irq/92-i91521:50:301
19110993924,4cyclictest22-21ksoftirqd/119:45:191
19110993923,5cyclictest22-21ksoftirqd/123:30:101
19110993923,5cyclictest22-21ksoftirqd/123:30:091
19110993923,5cyclictest22-21ksoftirqd/123:10:291
19110993923,5cyclictest22-21ksoftirqd/120:20:161
1910999399,4cyclictest3-21ksoftirqd/019:48:590
1910999392,9cyclictest0-21swapper/022:53:310
19109993925,9cyclictest3-21ksoftirqd/022:50:010
19109993925,9cyclictest3-21ksoftirqd/022:35:400
1911099382,8cyclictest2397-21lldpd20:03:061
19110993823,4cyclictest22-21ksoftirqd/119:55:361
19110993822,4cyclictest22-21ksoftirqd/100:10:211
19110993821,6cyclictest22-21ksoftirqd/122:25:021
19110993821,5cyclictest22-21ksoftirqd/121:20:381
19110993816,4cyclictest22-21ksoftirqd/122:52:151
1910999385,4cyclictest81rcu_preempt23:30:290
1910999385,4cyclictest81rcu_preempt23:30:290
1910999384,5cyclictest3-21ksoftirqd/000:40:420
1910999383,17cyclictest0-21swapper/021:28:390
19109993831,4cyclictest3-21ksoftirqd/000:10:410
1910999382,9cyclictest0-21swapper/000:15:460
1910999382,9cyclictest0-21swapper/000:00:130
1910999381,9cyclictest2779-21snmpd23:17:460
1910999381,9cyclictest0-21swapper/021:56:410
19109993816,3cyclictest41250irq/92-i91521:23:490
124722381,5sleep12779-21snmpd00:48:311
244282370,4sleep1211ktimersoftd/119:35:331
238142371,31sleep02397-21lldpd19:35:210
1911099373,22cyclictest0-21swapper/120:35:371
1911099373,18cyclictest9921-21cat23:15:281
19110993723,4cyclictest22-21ksoftirqd/120:54:171
19110993722,5cyclictest22-21ksoftirqd/122:47:321
19110993722,4cyclictest22-21ksoftirqd/123:35:281
19110993722,4cyclictest22-21ksoftirqd/122:33:041
19110993722,4cyclictest22-21ksoftirqd/120:59:261
19110993722,4cyclictest22-21ksoftirqd/120:15:341
19110993722,4cyclictest22-21ksoftirqd/119:25:381
19110993722,4cyclictest22-21ksoftirqd/100:25:231
19110993721,5cyclictest22-21ksoftirqd/100:00:221
19110993721,4cyclictest22-21ksoftirqd/123:42:561
19110993721,4cyclictest22-21ksoftirqd/121:09:211
1911099371,4cyclictest2397-21lldpd00:20:361
19110993714,11cyclictest22-21ksoftirqd/122:05:341
1910999379,4cyclictest81rcu_preempt21:12:310
1910999374,5cyclictest3-21ksoftirqd/022:30:220
1910999374,16cyclictest0-21swapper/020:23:040
19109993732,3cyclictest3-21ksoftirqd/021:05:240
19109993730,4cyclictest3-21ksoftirqd/020:55:380
1910999372,19cyclictest0-21swapper/021:01:470
1910999372,15cyclictest0-21swapper/000:34:290
19109993717,3cyclictest41250irq/92-i91523:52:540
19109993716,4cyclictest41250irq/92-i91522:08:050
171002371,4sleep12779-21snmpd20:41:081
19110993622,4cyclictest22-21ksoftirqd/100:38:321
19110993621,4cyclictest22-21ksoftirqd/123:02:111
19110993621,4cyclictest22-21ksoftirqd/123:02:111
19110993621,4cyclictest22-21ksoftirqd/121:04:281
19110993619,8cyclictest22-21ksoftirqd/100:33:101
19110993617,9cyclictest22-21ksoftirqd/120:07:101
19110993614,6cyclictest22-21ksoftirqd/122:12:031
19110993613,11cyclictest22-21ksoftirqd/123:20:181
1910999368,4cyclictest81rcu_preempt20:33:110
1910999367,13cyclictest14182-21taskset20:35:260
1910999366,5cyclictest81rcu_preempt19:30:050
1910999365,5cyclictest3-21ksoftirqd/021:30:240
1910999365,13cyclictest0-21swapper/000:27:180
1910999364,5cyclictest3-21ksoftirqd/000:20:190
1910999363,6cyclictest3-21ksoftirqd/023:23:310
1910999363,5cyclictest3-21ksoftirqd/023:25:390
19109993628,5cyclictest3-21ksoftirqd/023:40:260
19109993625,9cyclictest3-21ksoftirqd/022:24:050
1910999362,16cyclictest0-21swapper/020:25:560
19109993617,3cyclictest41250irq/92-i91500:37:110
19109993616,3cyclictest41250irq/92-i91520:19:070
19109993615,4cyclictest41250irq/92-i91523:46:170
19109993612,5cyclictest3-21ksoftirqd/022:25:310
1910999361,16cyclictest7967-21cut21:45:190
81622350,10sleep12397-21lldpd21:45:211
19110993521,5cyclictest22-21ksoftirqd/122:39:471
19110993521,5cyclictest22-21ksoftirqd/121:10:491
19110993521,4cyclictest22-21ksoftirqd/100:06:381
19110993520,4cyclictest22-21ksoftirqd/123:05:311
19110993520,4cyclictest22-21ksoftirqd/100:51:231
19110993518,6cyclictest22-21ksoftirqd/122:01:301
19110993515,6cyclictest22-21ksoftirqd/121:55:261
19110993513,8cyclictest2779-21snmpd20:25:451
19110993513,6cyclictest22-21ksoftirqd/120:10:391
1910999359,9cyclictest0-21swapper/022:10:130
1910999355,5cyclictest81rcu_preempt21:50:280
1910999355,13cyclictest2397-21lldpd23:55:360
1910999354,4cyclictest81rcu_preempt23:13:080
1910999354,14cyclictest0-21swapper/020:41:310
1910999353,5cyclictest3-21ksoftirqd/020:50:180
1910999353,14cyclictest0-21swapper/022:17:560
19109993519,4cyclictest3-21ksoftirqd/020:10:250
1910999351,7cyclictest3-21ksoftirqd/019:26:440
1910999351,6cyclictest29533-21iostat_ios21:15:320
19109993515,3cyclictest41250irq/92-i91522:00:540
19109993514,3cyclictest41250irq/92-i91519:41:300
19109993510,4cyclictest81rcu_preempt22:56:060
323222341,29sleep132417-21hddtemp_smartct00:15:241
1910999345,16cyclictest0-21swapper/023:02:330
1910999345,16cyclictest0-21swapper/023:02:320
1910999344,5cyclictest3-21ksoftirqd/019:57:440
19109993426,5cyclictest3-21ksoftirqd/000:50:190
1910999342,14cyclictest0-21swapper/000:05:170
19109993410,4cyclictest3-21ksoftirqd/023:35:220
190032331,28sleep10-21swapper/120:46:271
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional