You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 18:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot4s.osadl.org (updated Mon Sep 30, 2019 00:45:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
683999584057584046,9cyclictest950ksoftirqd/023:23:400
68429953265316,8cyclictest24511-21kworker/3:223:24:093
68399952375218,17cyclictest16459-21kworker/0:122:51:090
2959421850,5sleep0683999cyclictest23:15:070
973621520,4sleep0683999cyclictest20:25:030
6659211268,16sleep30-21swapper/319:09:363
6667211066,16sleep10-21swapper/119:09:421
6663210867,16sleep20-21swapper/219:09:382
638029571,16sleep00-21swapper/019:06:070
1721989880,1phc2sys0-21swapper/100:35:291
1721690710,1ptp4l21-21ksoftirqd/123:20:141
177102700,1sleep00-21swapper/020:40:120
1721989690,1phc2sys0-21swapper/123:01:391
1721989660,1phc2sys0-21swapper/123:58:581
1721989650,1phc2sys0-21swapper/123:19:561
1721989640,1phc2sys0-21swapper/100:16:251
1721989640,1phc2sys0-21swapper/100:16:251
1721989630,2phc2sys684099cyclictest23:09:371
37002600,1sleep10-21swapper/123:30:011
1721989600,3phc2sys684099cyclictest23:53:241
193102590,2sleep30-21swapper/320:45:043
158922590,3sleep00-21swapper/020:35:180
1721690570,0ptp4l21-21ksoftirqd/123:35:191
1721690560,1ptp4l21-21ksoftirqd/100:05:121
1721989550,1phc2sys0-21swapper/100:10:041
116187550,2custom_interrup0-21swapper/223:23:402
296542540,4sleep3684299cyclictest22:15:043
1721989540,1phc2sys0-21swapper/100:32:311
1721690540,0ptp4l21-21ksoftirqd/100:27:581
1721690530,0ptp4l82050irq/133-enp2s0-00:00:081
1721690520,0ptp4l21-21ksoftirqd/122:51:191
1721989500,1phc2sys0-21swapper/122:57:271
1721989490,1phc2sys0-21swapper/123:30:281
1721690480,1ptp4l0-21swapper/123:40:401
143082480,1sleep314303-21strings23:50:133
1721989460,1phc2sys0-21swapper/123:45:471
1721989460,1phc2sys0-21swapper/123:45:471
1721690440,1ptp4l21-21ksoftirqd/123:11:421
6839994311,15cyclictest13713-21munin-run19:25:010
683999429,15cyclictest28667-21munin-run23:15:010
1721690410,1ptp4l0-21swapper/100:21:011
683999389,13cyclictest0-21swapper/019:55:010
683999386,15cyclictest380-21munin-run21:15:010
684199373,11cyclictest20656-21munin-run19:40:012
683999362,11cyclictest8319-21munin-run23:40:010
79122350,4sleep228-21ksoftirqd/223:35:192
6840993520,12cyclictest724-21NetworkManager22:29:571
683999350,32cyclictest444-21systemd-journal22:30:380
683999340,32cyclictest796-21systemd-logind22:17:270
683999340,31cyclictest796-21systemd-logind23:47:580
683999340,31cyclictest796-21systemd-logind23:47:570
6842993328,3cyclictest707-21avahi-daemon22:28:273
6841993328,3cyclictest707-21avahi-daemon22:15:252
6839993327,4cyclictest724-21NetworkManager22:47:280
683999330,4cyclictest0-21swapper/022:39:500
683999330,30cyclictest796-21systemd-logind19:44:160
6842993227,3cyclictest103-21printk22:51:083
683999320,5cyclictest11236-21cc122:43:260
683999320,5cyclictest11236-21cc122:43:260
684099311,27cyclictest444-21systemd-journal21:45:021
684099311,27cyclictest444-21systemd-journal21:10:001
6839993114,15cyclictest5474-21/usr/sbin/munin21:25:140
6839993112,16cyclictest23174-21/usr/sbin/munin19:45:220
6841993025,3cyclictest17166-21ifconfig22:51:092
6840993012,16cyclictest29336-21/usr/sbin/munin22:15:111
684099300,27cyclictest444-21systemd-journal21:24:321
6839993028,1cyclictest724-21NetworkManager21:37:430
6839993028,1cyclictest724-21NetworkManager21:37:430
684099292,23cyclictest11530-21cc122:43:351
684099292,23cyclictest11530-21cc122:43:351
684099291,25cyclictest444-21systemd-journal21:52:241
6840992912,15cyclictest14141-21ls19:25:031
6840992911,16cyclictest26983-21sh21:00:101
6840992911,15cyclictest22982-21latency_hist19:45:001
684099290,3cyclictest24446-21munin-run22:05:021
684099290,26cyclictest444-21systemd-journal22:49:541
683999299,16cyclictest28019-21fschecks_time00:20:060
683999291,25cyclictest677-21systemd-machine22:07:000
6839992912,14cyclictest3992-21if_enp1s021:20:090
683999290,14cyclictest0-21swapper/019:40:010
6842992825,1cyclictest724-21NetworkManager22:05:293
6841992824,2cyclictest15644-21kworker/2:222:13:282
6841992823,2cyclictest724-21NetworkManager21:56:432
684099289,16cyclictest7600-21sadc21:30:001
684099288,17cyclictest24181-21cut19:45:081
684099288,17cyclictest12659-21/usr/sbin/munin19:20:111
684099282,23cyclictest20071-21cut21:55:061
684099281,22cyclictest8614-21dnf22:39:491
6840992811,14cyclictest7862-21interrupts19:10:101
684099280,3cyclictest12432-21munin-run21:40:011
684099280,3cyclictest12432-21munin-run21:40:011
684099280,2cyclictest10791-21ntp_kernel_pll_20:25:141
684099280,25cyclictest796-21systemd-logind20:05:451
683999283,13cyclictest17644-21munin-run00:00:010
683999282,6cyclictest25373-21cc123:05:530
6839992812,13cyclictest22610-21fschecks_time22:00:070
6839992812,13cyclictest1546-21cut22:25:010
6839992811,13cyclictest23712-21cat20:55:040
6839992810,15cyclictest13142-21cut21:40:070
6839992810,14cyclictest1155-21switchtime00:30:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional