You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-04 - 23:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems

x86 Intel Atom E3825 @1333 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of shadow in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6s.osadl.org (updated Sun Dec 04, 2022 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911170,2ptp4l241ktimersoftd/119:04:381
1014821170,7sleep010151-21irqrtprio17:14:360
32725911160,2ptp4l241ktimersoftd/117:59:581
32725911090,14ptp4l241ktimersoftd/117:09:021
32725911080,2ptp4l241ktimersoftd/116:06:421
32725911070,2ptp4l241ktimersoftd/118:29:301
32725911070,2ptp4l241ktimersoftd/117:23:581
32725911070,1ptp4l241ktimersoftd/118:21:511
32725911070,1ptp4l241ktimersoftd/118:14:311
32725911070,1ptp4l241ktimersoftd/117:40:451
32725911060,2ptp4l241ktimersoftd/116:48:241
32725911050,2ptp4l241ktimersoftd/116:20:421
32725911040,2ptp4l241ktimersoftd/116:34:231
32725911040,1ptp4l241ktimersoftd/117:12:021
32725911040,1ptp4l241ktimersoftd/116:54:231
32725911030,1ptp4l241ktimersoftd/118:44:211
32725911030,1ptp4l241ktimersoftd/117:50:471
32725911020,1ptp4l241ktimersoftd/114:04:251
32725911020,12ptp4l241ktimersoftd/116:52:411
32725911010,1ptp4l241ktimersoftd/118:59:471
32725911010,1ptp4l241ktimersoftd/114:44:281
32725911000,2ptp4l241ktimersoftd/115:09:311
32725911000,1ptp4l241ktimersoftd/116:24:071
3272591990,2ptp4l241ktimersoftd/116:11:441
3272591990,1ptp4l241ktimersoftd/118:56:411
3272591980,2ptp4l241ktimersoftd/117:18:221
296282970,7sleep129630-21switchtime14:19:331
146252970,3sleep0111rcuc/014:59:370
3272591960,3ptp4l241ktimersoftd/113:50:131
3272591960,1ptp4l241ktimersoftd/114:54:421
3272591930,2ptp4l241ktimersoftd/115:59:281
3272591930,1ptp4l241ktimersoftd/118:08:551
3272591880,1ptp4l241ktimersoftd/119:10:151
141852880,5sleep0111rcuc/017:19:230
3272591860,2ptp4l241ktimersoftd/117:55:031
3272591790,3ptp4l28889-21kworker/1:214:38:141
3272591770,1ptp4l241ktimersoftd/119:23:581
3272591770,1ptp4l241ktimersoftd/119:23:581
3272591730,3ptp4l17560-21kworker/1:117:00:381
3272591710,1ptp4l241ktimersoftd/118:52:331
3272591680,3ptp4l2879-21kworker/1:216:30:231
3272591670,1ptp4l241ktimersoftd/117:25:461
3272591660,1ptp4l241ktimersoftd/118:35:001
3272591660,1ptp4l241ktimersoftd/118:35:001
3272591660,1ptp4l241ktimersoftd/118:13:401
3272591650,1ptp4l241ktimersoftd/116:17:471
3272591640,1ptp4l241ktimersoftd/114:24:311
3272591630,1ptp4l241ktimersoftd/115:19:281
166122625,9sleep00-21swapper/013:51:480
3272591610,1ptp4l241ktimersoftd/116:42:051
3272591570,15ptp4l241ktimersoftd/117:33:371
16882995620,6cyclictest9-21ksoftirqd/019:22:150
16882995620,6cyclictest9-21ksoftirqd/019:22:150
3272591550,2ptp4l17560-21kworker/1:118:28:461
3272591550,1ptp4l241ktimersoftd/113:56:241
3270691540,5getstats42350irq/95-enp4s0-r14:12:241
16882995418,5cyclictest9-21ksoftirqd/018:48:340
16882995411,10cyclictest7945-21apt-get19:04:200
16882995315,6cyclictest9-21ksoftirqd/019:02:470
16882995314,6cyclictest9-21ksoftirqd/016:53:550
16882995312,6cyclictest9-21ksoftirqd/017:27:110
16882995221,6cyclictest9-21ksoftirqd/018:51:120
16882995215,5cyclictest9-21ksoftirqd/016:44:510
16882995210,9cyclictest9-21ksoftirqd/018:09:350
16882995210,6cyclictest22334-21apt-get17:29:170
16882995210,10cyclictest9-21ksoftirqd/016:19:350
1688299519,9cyclictest30619-21apt-get16:24:160
1688299519,10cyclictest26667-21apt-get17:34:210
16882995115,6cyclictest9-21ksoftirqd/017:41:320
16882995114,5cyclictest9-21ksoftirqd/019:10:320
16882995113,6cyclictest9-21ksoftirqd/018:22:100
16882995112,5cyclictest9-21ksoftirqd/017:47:030
16882995111,6cyclictest9-21ksoftirqd/018:05:530
16882995111,5cyclictest9-21ksoftirqd/017:08:150
3272591500,2ptp4l241ktimersoftd/115:55:141
3272591500,1ptp4l241ktimersoftd/117:45:321
3270691500,4getstats42350irq/95-enp4s0-r14:52:251
1688299509,9cyclictest9-21ksoftirqd/018:39:090
1688299509,9cyclictest9-21ksoftirqd/016:29:160
1688299509,8cyclictest5017-21apt-get17:09:200
1688299508,9cyclictest7208-21apt-get17:49:190
1688299508,10cyclictest9-21ksoftirqd/017:59:060
1688299508,10cyclictest4334-21apt-get15:54:140
16882995012,5cyclictest9-21ksoftirqd/018:28:170
16882995011,5cyclictest9-21ksoftirqd/016:14:570
3272591490,1ptp4l241ktimersoftd/119:16:031
3272591490,1ptp4l241ktimersoftd/118:40:391
3272591490,1ptp4l241ktimersoftd/114:14:351
1688299499,9cyclictest11533-21apt-get17:54:180
1688299499,6cyclictest9-21ksoftirqd/016:39:180
1688299499,5cyclictest9-21ksoftirqd/018:37:110
1688299499,5cyclictest9-21ksoftirqd/018:37:110
1688299498,9cyclictest30033-21snmp_o5powerctl16:59:370
16882994913,5cyclictest9-21ksoftirqd/016:36:120
16882994912,5cyclictest9-21ksoftirqd/018:33:570
3272591480,1ptp4l241ktimersoftd/117:35:291
3272591480,1ptp4l241ktimersoftd/115:24:331
1688299489,5cyclictest9-21ksoftirqd/016:10:560
16882994811,5cyclictest9-21ksoftirqd/018:15:180
3272591470,1ptp4l241ktimersoftd/115:29:201
1688299479,6cyclictest9-21ksoftirqd/019:16:170
1688299479,10cyclictest9-21ksoftirqd/015:34:360
1688299478,9cyclictest9-21ksoftirqd/014:28:400
1688299478,9cyclictest9-21ksoftirqd/013:54:100
1688299478,9cyclictest10342-21users15:59:400
1688299478,5cyclictest9-21ksoftirqd/014:44:220
1688299478,5cyclictest13219-21apt-get16:04:150
1688299477,6cyclictest9-21ksoftirqd/015:19:270
1688299477,6cyclictest24457-21apt-get16:54:230
1688299477,10cyclictest9-21ksoftirqd/015:14:230
1688299475,9cyclictest9-21ksoftirqd/018:55:000
3272591460,1ptp4l241ktimersoftd/113:59:351
1688299469,5cyclictest9-21ksoftirqd/015:29:290
1688299468,6cyclictest9-21ksoftirqd/015:39:090
1688299468,6cyclictest9-21ksoftirqd/015:39:090
1688299468,6cyclictest9-21ksoftirqd/014:14:250
16882994611,4cyclictest121rcu_preempt14:01:370
3272591450,1ptp4l241ktimersoftd/115:05:251
1688299459,6cyclictest9-21ksoftirqd/014:34:200
1688299458,5cyclictest9-21ksoftirqd/015:49:200
1688299458,5cyclictest9-21ksoftirqd/014:49:370
1688299458,5cyclictest9-21ksoftirqd/014:39:350
1688299456,9cyclictest9-21ksoftirqd/014:30:440
1688299456,9cyclictest9-21ksoftirqd/014:22:280
1688299456,8cyclictest9-21ksoftirqd/014:07:320
16882994511,5cyclictest9-21ksoftirqd/014:54:210
3272591440,1ptp4l241ktimersoftd/115:48:161
1688299448,5cyclictest9-21ksoftirqd/014:09:200
1688299447,5cyclictest9-21ksoftirqd/015:09:380
1688299446,9cyclictest9-21ksoftirqd/015:48:440
16882994427,5cyclictest9-21ksoftirqd/015:24:220
3272591430,1ptp4l241ktimersoftd/115:34:511
3272591420,1ptp4l241ktimersoftd/115:41:271
3272591420,1ptp4l241ktimersoftd/115:41:271
3272591420,1ptp4l241ktimersoftd/115:03:501
1688299427,5cyclictest9-21ksoftirqd/015:04:250
3272591390,1ptp4l241ktimersoftd/115:18:491
3272591380,1ptp4l241ktimersoftd/115:51:031
3272591370,1ptp4l241ktimersoftd/114:30:351
3272591320,1ptp4l241ktimersoftd/114:40:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional