You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-14 - 21:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems

x86 Intel Atom E3825 @1333 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of shadow in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackbslot6s.osadl.org (updated Sun Aug 14, 2022 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725912110,4ptp4l241ktimersoftd/113:12:341
32725911040,1ptp4l241ktimersoftd/117:14:401
32725911030,2ptp4l241ktimersoftd/118:02:271
32725911020,2ptp4l241ktimersoftd/116:41:581
32725911010,1ptp4l241ktimersoftd/118:27:381
32725911010,1ptp4l241ktimersoftd/116:04:051
3272591990,1ptp4l241ktimersoftd/117:51:111
3272591980,10ptp4l241ktimersoftd/117:43:281
3272591970,2ptp4l241ktimersoftd/117:19:071
3272591950,1ptp4l241ktimersoftd/116:47:371
925399933,11cyclictest13951-21apt-get16:51:470
3272591890,1ptp4l241ktimersoftd/117:32:341
3272591860,2ptp4l241ktimersoftd/116:36:561
3272591850,2ptp4l241ktimersoftd/118:39:411
3272591830,4ptp4l690-21kworker/1:115:53:551
3272591820,2ptp4l241ktimersoftd/115:38:051
73262787,11sleep00-21swapper/013:11:360
3272591780,1ptp4l241ktimersoftd/115:57:401
3272591750,3ptp4l690-21kworker/1:116:57:191
3272591740,3ptp4l690-21kworker/1:114:31:451
3272591740,20ptp4l690-21kworker/1:118:06:301
3272591730,3ptp4l690-21kworker/1:115:29:511
925399725,11cyclictest26617-21snmp_o5powerctl17:07:050
3272591720,1ptp4l241ktimersoftd/115:16:241
3272591720,14ptp4l241ktimersoftd/114:16:491
925399715,11cyclictest2387-21snmp_o5powerctl14:12:000
9253997111,7cyclictest28141-21ssh16:30:310
9253997111,7cyclictest28141-21ssh16:30:310
3272591710,3ptp4l690-21kworker/1:118:00:451
3272591710,3ptp4l690-21kworker/1:117:25:421
3272591710,3ptp4l690-21kworker/1:116:18:541
3272591710,3ptp4l690-21kworker/1:116:11:451
925399709,7cyclictest19347-21ssh15:41:560
925399702,15cyclictest21159-21ssh18:16:480
925399694,13cyclictest14585-21apt-get17:31:440
925399694,10cyclictest25812-21snmp_o5powerctl15:06:550
9253996910,7cyclictest31778-21ssh18:28:120
3272591690,1ptp4l241ktimersoftd/115:47:461
3272591690,1ptp4l241ktimersoftd/114:40:531
925399682,14cyclictest32547-21ssh15:20:370
925399681,9cyclictest19416-21ssh18:14:190
9253996819,30cyclictest9-21ksoftirqd/014:32:210
925399681,13cyclictest20833-21kworker/u4:117:51:140
925399680,8cyclictest10546-21phc2sys13:16:490
3272591680,1ptp4l241ktimersoftd/118:15:281
925399674,10cyclictest32436-21snmp_o5powerctl15:57:050
925399665,51cyclictest5304-21apt-get16:41:450
925399664,8cyclictest8464-21ssh15:30:010
925399661,15cyclictest28650-21diskmemload16:19:490
925399661,10cyclictest4058-21snmpd13:30:380
925399655,8cyclictest0-21swapper/015:53:220
925399652,8cyclictest9538-21ssh18:40:510
925399652,7cyclictest10420-21ssh18:03:370
925399651,9cyclictest3936-21ssh16:01:560
9253996510,9cyclictest18762-21ssh17:36:370
9253996510,9cyclictest18762-21ssh17:36:370
925399643,9cyclictest4058-21snmpd15:25:160
3272591640,1ptp4l241ktimersoftd/117:02:341
925399631,8cyclictest4058-21snmpd13:38:180
925399623,9cyclictest21725-21snmp_o5powerctl16:22:090
925399611,47cyclictest28417-21taskset15:13:560
925399611,14cyclictest32555-21seq16:35:450
3272591610,1ptp4l241ktimersoftd/116:30:481
3272591610,1ptp4l241ktimersoftd/116:30:481
3272591590,4ptp4l690-21kworker/1:117:52:041
925399585,7cyclictest29621-21apt-get17:11:420
925399582,51cyclictest21749-21irqstats17:01:480
925399581,52cyclictest1406-21/usr/sbin/munin17:16:490
925399575,8cyclictest13903-21apt-get15:36:420
925399571,8cyclictest4058-21snmpd17:24:570
925399571,7cyclictest5404-21ssh18:36:120
9253995710,5cyclictest42450irq/96-enp4s0-r18:41:490
925399562,9cyclictest31760-21apt-get17:51:390
925399560,8cyclictest17356-21snmp_o5powerctl14:46:550
925399555,10cyclictest11779-21apt-get16:11:450
925399542,46cyclictest9810-21diskstats15:31:460
9253995415,34cyclictest7333-21sh18:00:540
925399540,8cyclictest4758-21sed14:16:580
3272591540,3ptp4l690-21kworker/1:114:44:231
925399539,5cyclictest24982-21runrttasks15:48:390
925399534,11cyclictest2341-21snmp_o5powerctl16:37:080
925399533,11cyclictest26193-21snmp_o5powerctl13:51:550
9253995315,33cyclictest24071-21sh17:41:550
925399531,17cyclictest27935-21ssh18:24:080
925399531,15cyclictest28650-21diskmemload17:30:080
925399524,11cyclictest32698-21snmp_o5powerctl14:06:560
925399524,11cyclictest23695-21snmp_o5powerctl15:02:000
925399522,45cyclictest11352-21apt-config16:11:240
9253995215,32cyclictest9400-21seq14:30:420
9253995215,32cyclictest28650-21diskmemload16:47:520
925399520,8cyclictest12973-21snmp_o5powerctl14:36:580
3272591520,4ptp4l690-21kworker/1:114:12:541
3272591520,1ptp4l241ktimersoftd/117:29:551
3272591520,1ptp4l241ktimersoftd/115:02:011
3272591520,1ptp4l241ktimersoftd/114:52:031
925399513,9cyclictest23348-21hddtemp_smartct13:46:430
925399512,7cyclictest20862-21if_enp1s014:56:420
925399512,43cyclictest13610-21snmp_o5powerctl18:07:040
925399512,15cyclictest7336-21latency_hist14:26:230
9253995113,5cyclictest22509-21seq13:44:400
9253995113,34cyclictest19870-21ssh17:00:000
9253995113,33cyclictest18381-21/usr/sbin/munin14:51:440
9253995112,5cyclictest15017-21phc2sys14:42:000
3272591510,7ptp4l241ktimersoftd/118:25:381
3272591510,21ptp4l241ktimersoftd/116:56:211
3272591510,1ptp4l241ktimersoftd/117:07:091
3272591510,1ptp4l241ktimersoftd/116:31:401
3272591510,1ptp4l241ktimersoftd/115:19:411
925399505,10cyclictest12342-21apt-get13:21:360
3272591500,20ptp4l241ktimersoftd/114:06:441
3272591500,1ptp4l241ktimersoftd/118:16:261
3272591500,1ptp4l241ktimersoftd/117:37:361
3272591500,1ptp4l241ktimersoftd/117:37:361
925399492,7cyclictest28597-21users13:56:580
9253994917,27cyclictest9-21ksoftirqd/013:33:530
9253994914,29cyclictest31180-21apt-key14:06:220
3272591490,1ptp4l241ktimersoftd/118:46:001
3272591490,1ptp4l241ktimersoftd/118:31:271
3272591490,1ptp4l241ktimersoftd/116:07:391
3272591480,1ptp4l241ktimersoftd/116:24:231
3272591480,1ptp4l241ktimersoftd/115:42:101
3272591480,1ptp4l241ktimersoftd/114:56:401
3272591480,1ptp4l241ktimersoftd/113:42:211
3272591470,1ptp4l241ktimersoftd/114:21:511
3272591470,17ptp4l241ktimersoftd/115:21:261
3272591450,1ptp4l241ktimersoftd/115:33:081
3272591450,1ptp4l241ktimersoftd/113:47:151
3272591440,1ptp4l241ktimersoftd/115:06:471
3272591440,1ptp4l241ktimersoftd/114:48:571
3272591440,1ptp4l241ktimersoftd/113:56:521
3272591440,1ptp4l241ktimersoftd/113:55:121
3272591440,1ptp4l241ktimersoftd/113:39:491
3272591430,1ptp4l241ktimersoftd/113:23:411
3272591420,1ptp4l241ktimersoftd/114:01:441
3272591410,1ptp4l241ktimersoftd/114:27:321
925899398,9cyclictest121rcu_preempt13:31:591
925899341,4cyclictest121rcu_preempt13:29:561
925899341,10cyclictest9906-21cut13:16:411
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional