You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 03:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6s.osadl.org (updated Fri Jul 26, 2024 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911230,8ptp4l28956-21kworker/1:212:43:301
3272591890,2ptp4l241ktimersoftd/116:50:131
3272591870,2ptp4l241ktimersoftd/117:53:291
3272591860,2ptp4l241ktimersoftd/114:29:301
3119099855,58cyclictest4485-21apt-get17:13:220
3272591810,1ptp4l241ktimersoftd/116:54:181
3272591810,1ptp4l241ktimersoftd/116:15:021
3272591810,1ptp4l241ktimersoftd/113:02:031
31190998011,5cyclictest845-21runrttasks15:27:330
86692790,5sleep00-21swapper/016:38:480
4172780,2sleep00-21swapper/017:08:260
3119099783,6cyclictest21186-21snmp_o5powerctl16:53:410
3119099782,7cyclictest46-21kswapd017:58:240
3272591770,1ptp4l241ktimersoftd/114:06:261
3119099760,7cyclictest23598-21sh15:35:180
3272591750,1ptp4l241ktimersoftd/115:03:341
3119099754,11cyclictest19707-21snmp_o5powerctl18:08:450
3119099735,10cyclictest20724-21snmp_o5powerctl16:13:410
3272591710,3ptp4l6842-21kworker/1:117:03:571
3272591710,3ptp4l6842-21kworker/1:117:01:111
3119099715,10cyclictest28666-21snmp_o5powerctl13:53:410
18652710,3sleep00-21swapper/015:48:470
3272591700,3ptp4l6842-21kworker/1:117:53:091
3272591700,3ptp4l6842-21kworker/1:117:53:091
3272591700,3ptp4l6842-21kworker/1:116:30:261
3272591700,3ptp4l6842-21kworker/1:116:20:011
3119099704,6cyclictest22798-21apt-get18:13:220
31190997010,8cyclictest5024-21ssh17:52:230
31190997010,8cyclictest5024-21ssh17:52:230
3119099698,6cyclictest18328-21diskmemload15:18:010
3119099694,6cyclictest11831-21apt-get16:03:220
3119099693,10cyclictest16788-21python16:08:390
3119099692,9cyclictest1194-21ssh17:48:080
3119099690,5cyclictest8671-21sh17:56:160
3272591680,15ptp4l241ktimersoftd/118:02:561
3119099684,9cyclictest22490-21apt-get14:53:170
3119099683,8cyclictest11363-21ssh16:43:220
3119099680,10cyclictest25610-21/usr/sbin/munin16:58:390
3119099674,9cyclictest1857-21apt-get15:08:230
3119099671,16cyclictest19527-21ssh15:29:470
3119099671,13cyclictest9362-21kworker/u4:216:22:350
3272591660,1ptp4l241ktimersoftd/112:57:161
31191996628,18cyclictest25-21ksoftirqd/115:28:491
3119099664,7cyclictest8491-21apt-get13:08:200
3119099663,11cyclictest17480-21hddtemp_smartct17:28:310
3119099661,7cyclictest27182-21ssh15:39:330
3119099661,12cyclictest15552-21ssh17:25:570
3119099653,8cyclictest10028-21snmp_o5powerctl17:18:460
3119099652,8cyclictest32562-21memory14:03:320
3119099652,8cyclictest2869-21snmp_o5powerctl12:53:430
3119099643,7cyclictest3757-21apt-get14:13:210
3119099642,8cyclictest5377-21ssh15:53:390
3119099642,8cyclictest5377-21ssh15:53:390
31190996411,8cyclictest29734-21ssh15:43:310
3119099641,12cyclictest14106-21ssh18:03:190
3119099634,8cyclictest2580-21python14:08:350
3119099631,14cyclictest1378-21kworker/u4:116:34:490
3119099631,14cyclictest1378-21kworker/u4:116:34:490
3272591620,1ptp4l241ktimersoftd/118:13:091
31191996217,4cyclictest25-21ksoftirqd/117:18:351
3119099612,8cyclictest8272-21munin-run13:08:070
31191996019,6cyclictest25-21ksoftirqd/114:58:491
31191995817,6cyclictest25-21ksoftirqd/115:34:201
31190995817,35cyclictest8274-21df_inode15:58:240
3272591570,3ptp4l6842-21kworker/1:116:11:321
3272591570,15ptp4l241ktimersoftd/118:07:351
31191995722,17cyclictest25-21ksoftirqd/116:43:351
31191995722,17cyclictest25-21ksoftirqd/113:03:261
31191995716,6cyclictest25-21ksoftirqd/115:23:061
3119099575,42cyclictest25399-21apt-get13:48:220
3119099572,7cyclictest21479-21ssh14:51:350
3119099572,50cyclictest15024-21diskstats13:23:230
3272591560,3ptp4l6842-21kworker/1:116:03:501
31191995619,6cyclictest25-21ksoftirqd/115:14:091
3119099561,8cyclictest32742-21runrttasks15:05:280
31191995518,18cyclictest25-21ksoftirqd/114:23:291
3119099555,13cyclictest16817-21snmp_o5powerctl16:48:450
3119099551,49cyclictest29420-21ssh16:24:380
3272591540,3ptp4l6842-21kworker/1:117:28:341
3272591540,1ptp4l241ktimersoftd/115:46:411
31191995413,6cyclictest25-21ksoftirqd/117:10:361
3119099546,39cyclictest21178-21apt-get13:38:190
3119099545,10cyclictest6699-21memory14:18:300
3119099541,8cyclictest10916-21snmp_o5powerctl15:18:420
3272591530,4ptp4l6842-21kworker/1:116:37:121
3272591530,4ptp4l6842-21kworker/1:116:37:121
31191995318,11cyclictest25-21ksoftirqd/113:48:471
3119099535,9cyclictest27752-21snmp_o5powerctl14:58:430
3119099534,10cyclictest5210-21snmp_o5powerctl12:58:410
3119099531,46cyclictest11162-21ptp4l-jitter14:28:350
31190995310,8cyclictest24444-21ssh17:37:050
31191995214,6cyclictest25-21ksoftirqd/114:57:161
31191995211,6cyclictest25-21ksoftirqd/114:33:281
3119099524,10cyclictest13892-21snmp_o5powerctl13:18:430
31190995216,32cyclictest31148-21latency_hist12:48:070
31190995215,32cyclictest31364-21sh17:06:050
31190995215,32cyclictest17667-21irqstats13:28:310
31190995213,35cyclictest28577-21ssh17:41:300
31190995212,5cyclictest13491-21timerandwakeup14:33:460
3119099521,14cyclictest31312-21ssh16:28:180
3119099520,8cyclictest32578-21snmp_o5powerctl12:48:440
3272591510,1ptp4l241ktimersoftd/115:11:451
31191995115,4cyclictest121rcu_preempt17:33:441
3119099514,10cyclictest16456-21apt-get14:43:200
3119099514,10cyclictest16456-21apt-get14:43:200
3119099513,10cyclictest23286-21apt-get13:43:190
3272591500,1ptp4l241ktimersoftd/114:48:221
31191995014,6cyclictest25-21ksoftirqd/117:13:281
3119099505,11cyclictest14353-21apt-get14:38:250
3119099504,10cyclictest10600-21apt-get13:13:200
3119099502,7cyclictest19233-21diskstats13:33:210
3119099500,7cyclictest30798-21snmp_o5powerctl13:58:410
3272591490,1ptp4l241ktimersoftd/115:59:501
3119199499,6cyclictest25-21ksoftirqd/116:38:291
3119199499,6cyclictest25-21ksoftirqd/115:23:461
31191994910,6cyclictest25-21ksoftirqd/113:38:251
3272591480,1ptp4l241ktimersoftd/115:54:031
3272591480,1ptp4l241ktimersoftd/115:54:031
3272591480,1ptp4l241ktimersoftd/115:51:571
3119199489,8cyclictest25-21ksoftirqd/117:41:491
31191994814,11cyclictest25-21ksoftirqd/113:08:351
31191994813,11cyclictest25-21ksoftirqd/117:23:391
31191994813,11cyclictest25-21ksoftirqd/113:28:191
3119099481,13cyclictest9329-21timerwakeupswit14:23:460
3272591470,1ptp4l241ktimersoftd/115:39:131
3272591470,1ptp4l241ktimersoftd/114:43:281
3272591470,1ptp4l241ktimersoftd/114:43:281
3272591470,1ptp4l241ktimersoftd/114:15:041
3119199478,6cyclictest25-21ksoftirqd/116:25:051
3272591460,1ptp4l241ktimersoftd/117:46:231
3272591460,1ptp4l241ktimersoftd/113:15:481
3119199468,6cyclictest25-21ksoftirqd/113:43:421
3119199467,6cyclictest25-21ksoftirqd/118:15:021
3119199466,6cyclictest25-21ksoftirqd/114:38:391
3119199465,6cyclictest25-21ksoftirqd/114:18:331
3272591450,1ptp4l241ktimersoftd/114:03:081
3119199455,6cyclictest25-21ksoftirqd/114:08:441
3272591440,1ptp4l241ktimersoftd/113:36:011
3119199447,5cyclictest25-21ksoftirqd/112:48:461
3119199446,5cyclictest25-21ksoftirqd/113:23:211
3119199425,5cyclictest25-21ksoftirqd/113:53:231
3119199424,5cyclictest25-21ksoftirqd/113:18:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional