You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 13:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6s.osadl.org (updated Wed Apr 24, 2024 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911760,5ptp4l241ktimersoftd/100:12:081
4382911590,9getstats342299cyclictest05:22:501
4382911030,9getstats342299cyclictest05:32:501
4382911030,8getstats342299cyclictest05:37:501
3272591970,1ptp4l241ktimersoftd/103:48:041
3272591950,1ptp4l241ktimersoftd/103:01:261
3272591910,1ptp4l241ktimersoftd/100:54:301
3272591830,23ptp4l30884-21kworker/1:205:27:571
3272591810,1ptp4l241ktimersoftd/104:48:331
3272591800,20ptp4l31286-21kworker/1:103:12:391
3272591800,20ptp4l31286-21kworker/1:103:12:391
3272591780,3ptp4l32120-21kworker/1:201:01:071
3272591780,20ptp4l19774-21kworker/1:002:20:091
3272591780,1ptp4l241ktimersoftd/103:46:311
3272591770,20ptp4l19774-21kworker/1:002:36:581
3272591740,3ptp4l31286-21kworker/1:104:33:571
3272591730,20ptp4l31286-21kworker/1:103:28:531
3272591650,1ptp4l241ktimersoftd/103:09:171
3272591640,3ptp4l31286-21kworker/1:104:07:341
3272591640,1ptp4l241ktimersoftd/105:04:131
3272591630,1ptp4l241ktimersoftd/103:35:511
3272591600,3ptp4l19774-21kworker/1:002:16:101
3272591580,3ptp4l30884-21kworker/1:205:21:081
341799570,11cyclictest31892-21grep02:27:270
3272591570,3ptp4l32120-21kworker/1:200:48:401
3272591570,3ptp4l31286-21kworker/1:104:57:351
3272591570,3ptp4l31286-21kworker/1:104:17:531
341799565,14cyclictest21164-21latency_hist05:01:470
3272591560,3ptp4l32120-21kworker/1:201:15:391
3272591560,3ptp4l30884-21kworker/1:205:46:421
3272591560,1ptp4l241ktimersoftd/101:19:281
341799553,17cyclictest29931-21cat03:07:080
341799552,16cyclictest13735-21grep04:52:000
3417995510,9cyclictest23417-21ssh04:22:100
341799550,16cyclictest25266-21ssh03:42:290
3272591550,3ptp4l32120-21kworker/1:201:41:511
3272591550,3ptp4l32120-21kworker/1:200:27:321
3272591550,14ptp4l241ktimersoftd/104:30:301
341799549,9cyclictest10009-21cut01:47:100
341799547,10cyclictest5224-21needreboot03:17:090
341799543,17cyclictest14753-21grep00:42:230
341799543,16cyclictest6038-21unixbench_singl01:37:190
341799542,16cyclictest23758-21grep02:17:230
341799541,16cyclictest28735-21cat05:11:460
341799541,16cyclictest28735-21cat05:11:460
341799541,16cyclictest21558-21fschecks_time02:57:030
341799541,16cyclictest1198-21sort01:27:070
341799541,15cyclictest11360-21fschecks_time04:07:050
341799540,16cyclictest9735-21cstates02:41:580
341799540,16cyclictest8069-21seq00:24:550
3422995314,6cyclictest25-21ksoftirqd/105:12:201
341799537,8cyclictest197-21systemd-journal00:38:110
341799532,16cyclictest15559-21irqrtprio04:12:120
341799531,7cyclictest78072chrt02:38:510
341799531,16cyclictest27149-21mailstats01:12:110
341799531,15cyclictest27560-21gdbus03:46:480
341799531,15cyclictest2098-21grep04:37:000
341799531,15cyclictest18055-21cpuspeed_turbos02:07:010
341799530,17cyclictest10321-21ls00:32:120
3272591530,3ptp4l31286-21kworker/1:103:39:381
3272591530,3ptp4l19774-21kworker/1:002:29:261
3272591530,2ptp4l241ktimersoftd/104:37:281
3272591530,2ptp4l241ktimersoftd/100:18:591
341799523,15cyclictest8598-21ssh05:27:150
341799521,18cyclictest14948-21if_enp1s005:37:070
341799521,17cyclictest18849-21cpuspeed_turbos04:17:010
341799521,17cyclictest18598-21ptp4l00:52:120
341799521,16cyclictest26966-21ls04:27:070
341799521,16cyclictest19323-21grep05:42:320
341799521,15cyclictest1105-21irqrtprio05:17:070
341799521,14cyclictest28241-21cpuspeed_turbos01:16:550
341799520,16cyclictest23992-21cpuspeed_turbos01:06:550
341799520,16cyclictest197-21systemd-journal04:48:370
341799520,15cyclictest21331-21tail03:37:280
29782524,36sleep00-21swapper/000:12:400
341799511,45cyclictest140702chrt05:36:210
341799511,15cyclictest16184-21irqrtprio02:02:050
341799510,15cyclictest22899-21unixbench-2d05:02:280
3272591510,3ptp4l31286-21kworker/1:103:25:481
3272591510,2ptp4l241ktimersoftd/101:59:441
163962510,7sleep03405-21cyclictest00:47:120
342299505,12cyclictest25-21ksoftirqd/102:32:221
341799503,9cyclictest5555-21ssh05:22:250
341799502,9cyclictest7516-21ps04:02:060
341799502,9cyclictest31895-21tune2fs03:52:040
341799502,9cyclictest1948-21tune2fs02:32:020
341799502,10cyclictest12531-21grep01:52:220
341799501,17cyclictest21132-21rt-features02:12:120
341799501,15cyclictest18031-21irqrtprio02:52:060
341799501,13cyclictest197-21systemd-journal01:01:430
3272591500,1ptp4l241ktimersoftd/103:59:181
3272591500,1ptp4l241ktimersoftd/103:52:251
3272591500,1ptp4l241ktimersoftd/103:02:241
3272591500,1ptp4l241ktimersoftd/102:52:411
3272591500,1ptp4l241ktimersoftd/101:49:151
342299499,5cyclictest25-21ksoftirqd/100:32:141
3422994915,11cyclictest25-21ksoftirqd/101:22:041
341799493,8cyclictest8351-21tune2fs03:22:000
341799492,9cyclictest7207-21grep01:41:590
341799492,9cyclictest26485-21tune2fs02:22:030
341799492,9cyclictest26485-21tune2fs02:22:030
341799491,17cyclictest32461-21apt-config01:26:430
3272591490,3ptp4l31286-21kworker/1:104:52:451
3272591490,1ptp4l241ktimersoftd/105:08:381
3272591490,1ptp4l241ktimersoftd/105:08:381
3272591490,1ptp4l241ktimersoftd/104:22:381
3272591490,1ptp4l241ktimersoftd/104:13:041
3272591490,1ptp4l241ktimersoftd/104:01:481
3272591490,1ptp4l241ktimersoftd/103:19:021
3272591490,1ptp4l241ktimersoftd/102:51:001
3272591490,1ptp4l241ktimersoftd/102:21:491
3272591490,1ptp4l241ktimersoftd/102:21:491
3272591490,1ptp4l241ktimersoftd/101:41:021
12922490,8sleep1342299cyclictest01:27:091
342299488,5cyclictest25-21ksoftirqd/102:02:081
342299488,5cyclictest25-21ksoftirqd/101:53:261
342299487,5cyclictest25-21ksoftirqd/100:37:061
341799483,8cyclictest7188-21snmp_o5powerctl04:42:240
341799482,9cyclictest4005-21sed00:17:010
341799482,9cyclictest25428-21perl03:02:010
341799481,9cyclictest685-21cut03:12:040
341799481,9cyclictest685-21cut03:12:040
341799480,15cyclictest11979-21cat03:26:560
3272591480,1ptp4l241ktimersoftd/102:42:561
342299475,6cyclictest25-21ksoftirqd/101:02:231
342299471,11cyclictest25-21ksoftirqd/102:11:441
341799472,8cyclictest21788-21apt01:01:550
341799472,8cyclictest19350-21rm03:36:290
341799471,9cyclictest30785-21cut04:32:050
341799471,9cyclictest29075-21tr05:12:040
341799471,8cyclictest14717-21sed01:57:230
3272591470,1ptp4l241ktimersoftd/100:41:571
3272591470,1ptp4l241ktimersoftd/100:22:211
342299468,5cyclictest25-21ksoftirqd/101:07:101
341799460,12cyclictest5505-21chrt03:59:230
341799450,7cyclictest87542chrt00:30:310
341799450,22cyclictest15457-21ssh02:48:110
3272591450,1ptp4l241ktimersoftd/104:45:281
3272591450,1ptp4l241ktimersoftd/101:31:561
3417993910,5cyclictest9-21ksoftirqd/001:32:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional