You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-30 - 07:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6s.osadl.org (updated Sat Sep 30, 2023 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
557921700,8sleep02366999cyclictest02:23:220
852721110,8sleep12367399cyclictest04:32:301
32725911060,4ptp4l241ktimersoftd/123:03:231
3272591960,1ptp4l241ktimersoftd/103:09:351
70732950,3sleep00-21swapper/004:30:190
70732950,3sleep00-21swapper/004:30:190
27342870,5sleep0101ktimersoftd/004:23:490
109772870,8sleep12367399cyclictest01:07:261
438291860,11getstats2367399cyclictest01:01:471
3272591860,1ptp4l241ktimersoftd/103:16:251
3272591780,1ptp4l241ktimersoftd/102:42:251
3272591700,1ptp4l241ktimersoftd/102:22:351
162692690,5sleep010444-21diskmemload01:12:510
3272591610,1ptp4l241ktimersoftd/102:33:041
3272591580,1ptp4l241ktimersoftd/102:59:181
3272591560,4ptp4l32448-21kworker/1:100:44:231
23669995626,9cyclictest9-21ksoftirqd/002:57:370
3272591550,1ptp4l241ktimersoftd/104:28:471
3272591550,1ptp4l241ktimersoftd/104:28:471
23669995521,6cyclictest9-21ksoftirqd/001:20:380
3272591540,3ptp4l974-21kworker/1:201:42:481
3272591540,3ptp4l32247-21kworker/1:104:22:471
3272591540,3ptp4l15152-21kworker/1:201:17:561
3272591540,1ptp4l241ktimersoftd/104:12:111
23669995420,6cyclictest9-21ksoftirqd/003:22:320
252912531,7sleep025298-21rm01:25:430
23669995319,6cyclictest9-21ksoftirqd/001:35:180
23669995319,6cyclictest9-21ksoftirqd/001:35:180
3272591520,3ptp4l7677-21kworker/1:202:28:551
3272591520,3ptp4l22702-21kworker/1:002:47:081
23669995220,5cyclictest9-21ksoftirqd/002:18:010
3272591510,3ptp4l29049-21kworker/1:101:38:241
3272591510,3ptp4l24658-21kworker/1:001:27:191
3272591510,1ptp4l241ktimersoftd/102:11:331
23669995120,6cyclictest9-21ksoftirqd/004:12:130
3272591500,1ptp4l241ktimersoftd/103:47:451
3272591500,1ptp4l241ktimersoftd/103:27:431
3272591500,1ptp4l241ktimersoftd/103:27:431
3272591500,1ptp4l241ktimersoftd/102:06:471
3272591500,1ptp4l241ktimersoftd/101:34:541
3272591500,1ptp4l241ktimersoftd/101:34:541
2366999508,6cyclictest9-21ksoftirqd/003:33:450
23669995021,6cyclictest9-21ksoftirqd/003:43:180
23669995021,5cyclictest9-21ksoftirqd/002:54:170
23669995020,6cyclictest9-21ksoftirqd/002:38:160
23669995020,6cyclictest9-21ksoftirqd/001:11:240
23669995020,6cyclictest9-21ksoftirqd/000:41:180
23669995013,5cyclictest9-21ksoftirqd/003:56:340
23669995012,5cyclictest42650irq/98-enp4s0-t03:12:530
23669995010,7cyclictest12830-21apt-get01:52:250
3272591490,3ptp4l2834-21kworker/1:002:38:061
3272591490,1ptp4l241ktimersoftd/104:18:051
3272591490,1ptp4l241ktimersoftd/103:58:421
3272591490,1ptp4l241ktimersoftd/103:54:481
3272591490,1ptp4l241ktimersoftd/103:43:291
3272591490,1ptp4l241ktimersoftd/103:37:321
3272591490,1ptp4l241ktimersoftd/103:25:361
3272591490,1ptp4l241ktimersoftd/103:03:081
3272591490,1ptp4l241ktimersoftd/102:18:581
3272591490,1ptp4l241ktimersoftd/102:13:591
3272591490,1ptp4l241ktimersoftd/101:57:121
3272591490,1ptp4l241ktimersoftd/101:53:211
3272591490,1ptp4l241ktimersoftd/101:47:201
3272591490,1ptp4l241ktimersoftd/101:25:131
3272591490,1ptp4l241ktimersoftd/101:16:081
2366999499,6cyclictest9-21ksoftirqd/002:51:590
2366999499,6cyclictest2699-21snmp_o5powerctl01:37:450
23669994920,6cyclictest9-21ksoftirqd/002:03:390
23669994919,6cyclictest9-21ksoftirqd/003:08:430
23669994917,6cyclictest9-21ksoftirqd/003:47:190
3272591480,1ptp4l241ktimersoftd/104:10:001
3272591480,1ptp4l241ktimersoftd/103:32:131
3272591480,1ptp4l241ktimersoftd/102:52:361
23669994820,6cyclictest9-21ksoftirqd/003:27:230
23669994820,6cyclictest9-21ksoftirqd/003:27:230
23669994819,6cyclictest9-21ksoftirqd/001:47:220
23669994818,6cyclictest9-21ksoftirqd/003:17:120
2366999479,5cyclictest9-21ksoftirqd/004:10:330
2366999478,6cyclictest9-21ksoftirqd/001:31:490
2366999478,5cyclictest9-21ksoftirqd/002:46:030
2366999478,5cyclictest9-21ksoftirqd/002:27:280
23669994720,6cyclictest9-21ksoftirqd/002:12:420
23669994719,6cyclictest9-21ksoftirqd/003:58:200
23669994719,6cyclictest9-21ksoftirqd/002:00:330
23669994718,6cyclictest9-21ksoftirqd/004:02:170
23669994718,6cyclictest9-21ksoftirqd/003:37:460
3272591460,1ptp4l241ktimersoftd/100:31:181
2366999469,6cyclictest6495-21snmp_o5powerctl01:42:420
2366999465,8cyclictest9-21ksoftirqd/023:22:340
23669994619,6cyclictest9-21ksoftirqd/002:35:010
23669994617,5cyclictest9-21ksoftirqd/004:17:300
3272591450,1ptp4l241ktimersoftd/123:33:081
3272591450,1ptp4l241ktimersoftd/104:02:431
3272591450,1ptp4l241ktimersoftd/100:36:111
3272591450,1ptp4l241ktimersoftd/100:22:201
2366999458,5cyclictest9-21ksoftirqd/003:03:300
23669994517,5cyclictest9-21ksoftirqd/000:42:310
23669994516,6cyclictest9-21ksoftirqd/004:33:190
23669994510,10cyclictest28081-21apt-get00:32:250
3272591440,1ptp4l241ktimersoftd/123:29:041
3272591440,1ptp4l241ktimersoftd/100:49:311
3272591440,1ptp4l241ktimersoftd/100:11:421
3272591440,1ptp4l241ktimersoftd/100:01:591
23673994419,4cyclictest25-21ksoftirqd/103:18:381
23669994416,4cyclictest9-21ksoftirqd/002:08:110
3272591430,1ptp4l241ktimersoftd/100:41:481
3272591430,1ptp4l241ktimersoftd/100:06:191
3272591420,1ptp4l241ktimersoftd/123:51:211
2366999428,5cyclictest9-21ksoftirqd/023:53:190
23669994210,6cyclictest2218-21apt-get00:47:260
23669994210,5cyclictest23852-21apt-get00:22:230
3272591410,1ptp4l241ktimersoftd/100:19:051
3272591410,1ptp4l241ktimersoftd/100:15:321
2366999419,6cyclictest4328-21apt-get00:52:260
2366999418,6cyclictest13271-21apt-get23:57:230
23669994120,18cyclictest9-21ksoftirqd/023:17:320
23669994114,5cyclictest9-21ksoftirqd/001:00:330
3272591400,3ptp4l6405-21kworker/1:223:41:391
3272591400,1ptp4l241ktimersoftd/123:53:361
2366999408,7cyclictest19604-21apt-get00:12:260
2366999408,6cyclictest26633-21apt-get23:12:240
2366999407,6cyclictest15379-21apt-get00:02:210
23669994018,6cyclictest9-21ksoftirqd/023:47:210
23669994015,10cyclictest9-21ksoftirqd/000:17:370
3272591380,1ptp4l241ktimersoftd/100:55:091
3272591370,1ptp4l241ktimersoftd/123:19:461
2366999379,5cyclictest9-21ksoftirqd/023:37:480
2366999377,5cyclictest9-21ksoftirqd/000:07:320
225402373,20sleep022572-21/usr/sbin/munin23:02:390
2366999367,5cyclictest9-21ksoftirqd/023:32:510
2366999367,5cyclictest9-21ksoftirqd/023:07:310
23669993611,9cyclictest26508-21if_err_enp1s0.100:27:330
23669993510,4cyclictest9-21ksoftirqd/001:02:200
2366999348,6cyclictest9-21ksoftirqd/023:27:290
23669993416,11cyclictest6919-21apt-get23:42:240
438491331,27phc2sys7036-21cstates23:42:251
23673993321,7cyclictest9146-21ps01:02:311
3272591320,1ptp4l241ktimersoftd/123:24:191
3272591320,1ptp4l241ktimersoftd/123:12:351
3272591320,1ptp4l241ktimersoftd/123:07:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional