You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 07:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Sat Jul 27, 2024 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
228732238164,25sleep20-21swapper/219:06:592
230482237163,24sleep30-21swapper/319:09:133
227982237165,58sleep00-21swapper/019:06:000
230982205167,25sleep10-21swapper/119:09:521
711421630,4sleep12320599cyclictest23:25:131
895821030,4sleep38964-21gltestperf22:15:143
232109910391,3cyclictest0-21swapper/200:08:422
225942610,4sleep12320599cyclictest22:45:231
167972610,2sleep20-21swapper/221:20:102
167972610,2sleep20-21swapper/221:20:102
23210995955,3cyclictest0-21swapper/221:03:272
17952580,4sleep22321099cyclictest00:25:202
161282540,2sleep339-21rcuc/320:05:123
256992530,3sleep339-21rcuc/321:40:143
2320599447,24cyclictest26721-21cut22:55:201
2320599441,10cyclictest6504-21perf23:25:011
2320599421,32cyclictest29078-21users21:45:281
2321599411,29cyclictest0-21swapper/323:40:213
23215994025,10cyclictest0-21swapper/323:53:263
2319999401,15cyclictest18682-21date21:25:010
2321599391,28cyclictest0-21swapper/322:48:133
2321599381,20cyclictest0-21swapper/322:38:033
2321599381,20cyclictest0-21swapper/320:02:453
2321599371,27cyclictest0-21swapper/322:41:413
2321599371,27cyclictest0-21swapper/322:22:533
2321599370,13cyclictest0-21swapper/300:02:143
23215993617,3cyclictest0-21swapper/323:09:493
2321599361,24cyclictest0-21swapper/322:13:493
2321599361,13cyclictest0-21swapper/321:13:013
2320599367,2cyclictest17862-21latency_hist20:10:011
2320599361,7cyclictest23398-21/usr/sbin/munin19:10:261
23205993615,18cyclictest18768-21ntp_states23:50:211
23205993612,21cyclictest19064-21latency_hist22:40:011
23205993610,3cyclictest0-21swapper/120:56:591
2320599360,8cyclictest16395-21kworker/u8:119:15:021
2319999365,23cyclictest2074-21kworker/u8:123:36:460
2319999361,10cyclictest0-21swapper/023:40:210
2321599351,25cyclictest0-21swapper/323:26:293
2321599351,25cyclictest0-21swapper/320:34:533
2321599351,16cyclictest17172-21hddtemp_smartct21:20:133
2321599351,16cyclictest17172-21hddtemp_smartct21:20:133
2320599353,6cyclictest8785-40dnf19:46:321
2320599352,25cyclictest0-21swapper/123:30:421
2320599352,25cyclictest0-21swapper/123:30:421
2320599351,3cyclictest14885-21perl21:15:151
2319999351,12cyclictest0-21swapper/023:55:500
2319999351,10cyclictest0-21swapper/022:46:530
2321599341,26cyclictest0-21swapper/322:07:413
2320599348,3cyclictest1960-21cat19:30:261
2320599346,3cyclictest30568-21sshd00:18:331
23205993410,3cyclictest0-21swapper/120:48:481
2321599331,23cyclictest0-21swapper/323:17:573
2321599331,20cyclictest0-21swapper/322:56:373
2321599331,20cyclictest0-21swapper/322:52:533
2321599331,18cyclictest0-21swapper/320:37:173
2321599331,18cyclictest0-21swapper/319:44:213
2321599331,18cyclictest0-21swapper/319:39:253
2321599331,14cyclictest0-21swapper/320:15:133
2321599331,14cyclictest0-21swapper/320:15:133
2320599339,4cyclictest1027-21grep21:55:311
2320599337,23cyclictest10559-21cpu22:20:101
2320599335,5cyclictest24871-21kworker/u8:122:04:051
2320599335,3cyclictest86750irq/128-enp1s0-23:15:191
2320599332,8cyclictest22534-21users21:31:071
23205993313,17cyclictest15545-21gltestperf22:30:141
2320599331,29cyclictest13080-21latency_hist23:40:021
23205993312,18cyclictest9910-21/usr/sbin/munin21:05:161
2320599331,12cyclictest581-21systemd-journal22:55:011
23205993310,2cyclictest12652-21/usr/sbin/munin19:55:261
23205993310,20cyclictest1411-21/usr/sbin/munin00:25:141
2319999331,8cyclictest0-21swapper/022:31:010
2319999331,11cyclictest0-21swapper/022:54:450
2319999331,10cyclictest0-21swapper/022:41:410
259112320,3sleep32321599cyclictest20:25:233
2321599321,22cyclictest0-21swapper/319:52:053
2321599321,18cyclictest0-21swapper/321:26:133
2321599321,14cyclictest16317-21irqstats23:45:173
2321599321,14cyclictest0-21swapper/319:57:093
2321599321,13cyclictest0-21swapper/319:11:253
2321599321,12cyclictest0-21swapper/321:38:213
2321599321,10cyclictest0-21swapper/300:05:263
2320599327,2cyclictest24412-21sshd20:24:321
2320599326,3cyclictest31035-21cat20:39:561
2320599324,9cyclictest0-21swapper/100:21:341
2320599322,27cyclictest22390-21cat20:20:011
2320599322,27cyclictest22390-21cat20:20:011
2320599321,28cyclictest827-21cat20:44:561
2320599321,28cyclictest13687-21grep21:10:251
2320599321,24cyclictest30454-21latency_hist19:25:011
23205993212,17cyclictest5145-21/usr/sbin/munin00:35:161
23205993212,17cyclictest4911-21/usr/sbin/munin19:40:151
23205993212,17cyclictest15504-21/usr/sbin/munin23:45:191
23205993210,2cyclictest15389-21sshd20:01:311
2319999325,12cyclictest26320-21perf00:10:020
2319999321,13cyclictest0-21swapper/020:45:410
23215993119,3cyclictest0-21swapper/321:19:013
2321599311,20cyclictest0-21swapper/320:44:133
2321599311,19cyclictest0-21swapper/323:31:253
2321599311,19cyclictest0-21swapper/323:31:253
2321599311,19cyclictest0-21swapper/323:01:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional