You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-13 - 01:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems

x86 Intel Atom E3825 @1333 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of shadow in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6s.osadl.org (updated Fri Aug 12, 2022 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911130,7ptp4l947-21kworker/1:113:11:151
3272591980,1ptp4l241ktimersoftd/117:00:141
199622960,3sleep10-21swapper/117:06:151
525399910,7cyclictest31880-21/usr/sbin/munin18:36:140
3272591870,2ptp4l241ktimersoftd/114:16:061
525399831,13cyclictest24434-21diskmemload17:16:390
3272591830,1ptp4l241ktimersoftd/116:20:171
525399826,42cyclictest30776-21apt-get16:40:570
3272591770,4ptp4l32388-21kworker/1:118:11:301
525399760,7cyclictest21647-21irqrtprio13:51:020
525399760,7cyclictest10059-21ssh16:55:080
525399751,14cyclictest15807-21ssh17:01:070
525399750,8cyclictest13296-21ssh17:36:290
3272591750,21ptp4l17319-21kworker/1:017:21:111
525399740,8cyclictest24969-21ssh15:54:390
525399740,10cyclictest2785-21rm15:27:150
3272591740,1ptp4l241ktimersoftd/118:42:201
525399735,42cyclictest30285-21snmp_o5powerctl15:21:240
525399730,7cyclictest1805-21ssh16:05:590
3272591730,4ptp4l13204-21kworker/1:116:06:431
3272591730,3ptp4l5877-21kworker/1:117:51:061
3272591730,3ptp4l13054-21kworker/1:016:24:431
525399725,9cyclictest2473-21apt-get16:45:570
525399724,10cyclictest23716-21snmp_o5powerctl15:11:160
525399721,8cyclictest6423-21ssh18:45:060
525399720,8cyclictest8706-21ssh16:13:240
525399720,7cyclictest22474-21ssh17:09:480
525399716,9cyclictest24337-21snmp_o5powerctl13:56:140
525399714,8cyclictest26713-21apt-get18:31:010
525399713,8cyclictest21659-21ssh17:46:220
525399710,8cyclictest28568-21python14:06:100
525399710,8cyclictest16142-21ssh16:21:480
525399710,7cyclictest25439-21seq18:29:010
525399710,7cyclictest12325-21sed13:30:410
525399702,8cyclictest13324-21ssh16:58:190
3272591700,1ptp4l241ktimersoftd/118:01:101
3272591700,1ptp4l241ktimersoftd/117:11:151
525399692,6cyclictest20555-21ssh18:22:570
5253996911,35cyclictest208252chrt13:50:370
525399684,9cyclictest941-21apt-get18:01:060
525399682,9cyclictest7411-21sh15:33:070
525399681,15cyclictest32336-21ssh17:59:340
525399681,14cyclictest2343-21ssh17:24:280
525399680,7cyclictest21587-21ssh16:29:280
3272591680,1ptp4l241ktimersoftd/114:12:361
525399675,8cyclictest10237-21apt-get16:16:000
525399673,9cyclictest6730-21python14:31:090
525399672,7cyclictest32439-21ssh16:03:030
525399672,7cyclictest27517-21ssh15:18:340
525399671,13cyclictest27803-21ssh15:57:040
525399661,7cyclictest20577-21ssh15:49:080
525399661,5cyclictest197-21systemd-journal17:31:260
3272591660,1ptp4l241ktimersoftd/116:43:041
525399659,7cyclictest4644-21snmp_o5powerctl17:26:190
525399654,7cyclictest9449-21/usr/sbin/munin18:11:340
525399652,8cyclictest4058-21snmpd14:48:570
525399652,7cyclictest11771-21ssh15:38:310
525399652,6cyclictest18577-21ssh17:43:170
525399651,9cyclictest23192-21ssh17:10:560
525399651,8cyclictest28559-21ssh17:55:330
525399651,7cyclictest16055-21sed13:36:190
525399642,8cyclictest14649-21snmp_o5powerctl15:41:160
525399642,10cyclictest13607-21snmp_o5powerctl13:31:120
5253996411,6cyclictest17606-21ssh18:20:280
525399635,12cyclictest23763-21snmp_o5powerctl16:31:190
525399632,39cyclictest8856-21snmp_o5powerctl14:36:140
525399631,6cyclictest30051-21ssh16:39:560
3272591630,1ptp4l241ktimersoftd/118:32:231
525399622,8cyclictest10956-21python14:41:100
3272591620,1ptp4l241ktimersoftd/116:54:141
525399617,5cyclictest18431-21taskset13:42:500
525399612,8cyclictest6867-21ssh18:06:280
5254995916,4cyclictest25-21ksoftirqd/115:31:131
525399595,44cyclictest20135-21apt-get15:05:310
3272591590,4ptp4l22158-21kworker/1:015:11:131
3272591590,1ptp4l241ktimersoftd/118:17:551
3272591570,2ptp4l241ktimersoftd/116:40:151
525399563,9cyclictest14055-21apt-get14:50:540
49502564,39sleep00-21swapper/013:13:000
3272591550,3ptp4l7099-21kworker/1:113:24:141
3272591550,1ptp4l241ktimersoftd/117:47:031
525399541,48cyclictest16421-21fschecks_time14:56:000
525399541,47cyclictest5360-21/usr/sbin/munin14:30:410
525399540,9cyclictest4058-21snmpd14:04:340
3272591540,3ptp4l1311-21kworker/1:116:50:131
525399535,11cyclictest9363-21snmp_o5powerctl13:21:110
5253995313,35cyclictest31425-21latency_hist14:15:420
3272591530,1ptp4l241ktimersoftd/118:37:171
3272591530,1ptp4l241ktimersoftd/115:56:101
5253995212,34cyclictest2549-21date14:21:160
3272591520,6ptp4l241ktimersoftd/117:16:031
5253995113,32cyclictest20507-21cpuspeed_turbos15:05:560
3272591510,1ptp4l241ktimersoftd/117:39:281
525499508,4cyclictest25-21ksoftirqd/115:29:391
5254995015,17cyclictest25-21ksoftirqd/114:51:011
3272591500,3ptp4l29006-21kworker/1:014:08:371
3272591500,1ptp4l241ktimersoftd/118:21:341
3272591500,1ptp4l241ktimersoftd/118:07:531
3272591500,1ptp4l241ktimersoftd/117:01:341
3272591500,1ptp4l241ktimersoftd/116:13:491
3272591500,1ptp4l241ktimersoftd/116:01:451
3272591500,1ptp4l241ktimersoftd/115:53:061
3272591500,1ptp4l241ktimersoftd/115:49:211
3272591500,1ptp4l241ktimersoftd/115:16:271
525399494,10cyclictest5476-21apt-get13:15:530
525399491,8cyclictest31942-21perl14:15:580
3272591490,1ptp4l241ktimersoftd/117:56:241
3272591490,1ptp4l241ktimersoftd/117:34:151
3272591490,1ptp4l241ktimersoftd/117:27:371
3272591490,1ptp4l241ktimersoftd/116:31:151
3272591490,1ptp4l241ktimersoftd/115:41:431
3272591490,1ptp4l241ktimersoftd/115:39:071
3272591490,1ptp4l241ktimersoftd/115:21:461
260142490,8sleep1525499cyclictest18:30:071
5254994824,12cyclictest25-21ksoftirqd/114:41:021
3272591480,1ptp4l241ktimersoftd/116:27:381
525499473,10cyclictest197-21systemd-journal15:05:331
3272591470,1ptp4l241ktimersoftd/114:21:141
3272591470,1ptp4l241ktimersoftd/113:56:081
3272591460,1ptp4l241ktimersoftd/114:58:111
3272591460,16ptp4l241ktimersoftd/113:49:141
525499457,5cyclictest25-21ksoftirqd/115:09:581
3272591450,1ptp4l241ktimersoftd/117:43:091
3272591450,1ptp4l241ktimersoftd/113:17:191
3272591440,1ptp4l241ktimersoftd/114:36:251
3272591440,1ptp4l241ktimersoftd/113:51:111
3272591440,1ptp4l241ktimersoftd/113:41:541
3272591440,1ptp4l241ktimersoftd/113:30:491
3272591440,1ptp4l241ktimersoftd/113:26:481
3272591440,13ptp4l241ktimersoftd/114:49:091
3272591430,1ptp4l241ktimersoftd/114:01:141
3272591430,1ptp4l241ktimersoftd/113:36:251
525499417,4cyclictest121rcu_preempt14:26:101
525499413,5cyclictest25-21ksoftirqd/114:33:581
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional