You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-31 - 10:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems

x86 Intel Atom E3825 @1333 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of shadow in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot6s.osadl.org (updated Tue Jan 31, 2023 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3272591980,33ptp4l241ktimersoftd/102:09:161
3272591950,1ptp4l241ktimersoftd/105:42:301
3272591930,12ptp4l241ktimersoftd/107:05:371
3272591920,11ptp4l241ktimersoftd/105:01:201
207202910,8sleep11203799cyclictest04:39:421
3272591860,2ptp4l241ktimersoftd/103:15:431
3272591860,2ptp4l241ktimersoftd/103:06:111
28242860,8sleep01203699cyclictest03:03:510
3272591840,1ptp4l241ktimersoftd/105:20:441
3272591840,13ptp4l241ktimersoftd/106:09:331
3272591830,1ptp4l241ktimersoftd/104:53:421
3272591820,2ptp4l241ktimersoftd/105:14:231
3272591780,1ptp4l241ktimersoftd/106:22:521
438291770,9getstats1203799cyclictest07:10:091
3272591770,1ptp4l241ktimersoftd/102:52:351
12036997716,16cyclictest18843-21taskset06:43:490
3272591760,1ptp4l241ktimersoftd/106:03:491
3272591760,1ptp4l241ktimersoftd/106:03:491
3272591760,1ptp4l241ktimersoftd/103:11:331
12036997622,16cyclictest944-21ssh06:19:450
3272591750,3ptp4l8853-21kworker/1:206:34:191
12036997522,17cyclictest24155-21/usr/sbin/munin07:33:470
12036997521,15cyclictest22620-21ssh04:43:360
12036997521,15cyclictest17727-21ssh04:36:390
12036997520,16cyclictest25976-21ssh06:53:180
12036997520,16cyclictest14657-21ssh07:19:380
12036997519,16cyclictest9668-21ssh07:13:510
12036997515,16cyclictest197-21systemd-journal02:49:470
12036997422,44cyclictest20980-21apt-get05:23:400
12036997421,15cyclictest29920-21ssh06:58:200
12036997421,15cyclictest15822-21ssh05:16:070
12036997420,16cyclictest23297-21ssh07:32:370
12036997420,16cyclictest17447-21ssh05:59:280
12036997420,15cyclictest9810-21taskset05:49:370
12036997420,15cyclictest7355-21ssh05:04:170
12036997419,16cyclictest21333-21ssh04:41:050
12036997418,17cyclictest2131-21ssh04:16:360
175692730,3sleep00-21swapper/006:41:450
12036997321,15cyclictest22326-21sh06:06:560
12036997321,15cyclictest22326-21sh06:06:560
12036997320,15cyclictest3945-21ssh07:05:330
12036997319,15cyclictest7465-21ssh05:48:070
3272591720,20ptp4l8853-21kworker/1:206:39:511
12036997222,12cyclictest27738-21head04:03:430
12036997221,17cyclictest16674-21grep03:38:390
12036997221,17cyclictest15952-21sort02:18:460
12036997220,15cyclictest19656-21ssh05:21:070
12036997218,16cyclictest32374-21ssh04:54:490
12036997217,13cyclictest10912-21apt-get06:33:420
12036997216,12cyclictest30626-21wc04:09:000
3272591710,21ptp4l8853-21kworker/1:203:30:201
3272591710,1ptp4l241ktimersoftd/105:58:431
3272591710,1ptp4l241ktimersoftd/104:14:351
12036997120,16cyclictest14455-21taskset05:56:240
12036997120,15cyclictest29975-21seq04:53:060
12036997120,15cyclictest29975-21seq04:53:060
12036997119,17cyclictest8713-21ssh06:29:270
12036997117,17cyclictest1484-21ssh05:39:010
12036997117,16cyclictest4209-21ssh05:00:550
12036997117,16cyclictest21833-21processes03:48:520
12036997117,15cyclictest27361-21cat06:13:410
12036997117,15cyclictest10551-21ssh04:28:160
12036997019,15cyclictest26149-21ssh06:11:480
12036997019,14cyclictest7465-21ssh07:10:120
12036997018,15cyclictest23144-21fschecks_count03:53:420
12036997018,14cyclictest16852-21fschecks_count07:23:500
12036997018,14cyclictest16852-21fschecks_count07:23:500
12036997017,17cyclictest12352-21taskset04:28:580
12036997016,18cyclictest29272-21/usr/sbin/munin05:33:490
12036997016,18cyclictest25963-21phc2sys03:58:500
12036997016,18cyclictest25963-21phc2sys03:58:500
12036997016,18cyclictest1261-21sshd03:00:440
12036997016,17cyclictest1147-21sshd07:02:470
12036997016,16cyclictest29096-21expr07:39:100
12036997016,16cyclictest27099-21ssh05:30:340
12036997016,16cyclictest27099-21ssh05:30:340
12036997016,15cyclictest3982-21awk06:23:540
12036997015,17cyclictest11824-21chrt05:10:480
12036996918,15cyclictest3154-21sh04:18:340
12036996916,17cyclictest14066-21sshd02:17:420
12036996916,16cyclictest24797-21/usr/sbin/munin02:38:590
12036996916,16cyclictest22104-21sed02:33:450
12036996816,16cyclictest19478-21grep03:43:520
12036996816,15cyclictest14398-21/usr/sbin/munin03:33:410
12036996816,15cyclictest14398-21/usr/sbin/munin03:33:410
12036996815,16cyclictest4310-21basename03:08:440
12036996716,17cyclictest12826-21cat03:28:440
12036996716,16cyclictest31075-21systemctl02:53:520
12036996716,16cyclictest31075-21systemctl02:53:520
12036996716,14cyclictest27242-21snmpd02:26:220
12036996615,16cyclictest9865-21taskset03:22:030
3272591650,1ptp4l241ktimersoftd/105:25:351
12036996519,11cyclictest10432-21taskset03:23:410
12036996515,16cyclictest6009-21dpkg03:13:390
12036996514,16cyclictest21312-21latency_hist02:33:190
12036996414,14cyclictest26859-21mailstats02:43:540
12036996017,23cyclictest12098-21cat02:13:190
3272591580,1ptp4l241ktimersoftd/103:26:051
3272591570,2ptp4l241ktimersoftd/106:57:441
3272591560,4ptp4l8134-21kworker/1:107:14:071
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional