You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-13 - 23:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6s.osadl.org (updated Sat Jul 13, 2024 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911840,5ptp4l241ktimersoftd/112:39:101
32725911080,2ptp4l241ktimersoftd/116:31:421
32725911040,2ptp4l241ktimersoftd/114:58:591
32725911040,1ptp4l241ktimersoftd/112:49:081
32725911030,2ptp4l241ktimersoftd/116:35:591
32725911010,2ptp4l241ktimersoftd/115:15:221
32725911010,1ptp4l241ktimersoftd/117:00:491
32725911010,1ptp4l241ktimersoftd/115:13:411
32725911000,2ptp4l241ktimersoftd/117:47:331
3272591990,1ptp4l241ktimersoftd/113:01:291
136792980,3sleep10-21swapper/117:49:111
3272591960,1ptp4l241ktimersoftd/115:48:051
3272591950,1ptp4l241ktimersoftd/117:21:141
3272591930,1ptp4l241ktimersoftd/116:48:051
3272591880,2ptp4l241ktimersoftd/116:14:171
3272591870,2ptp4l241ktimersoftd/117:38:001
3272591860,2ptp4l241ktimersoftd/117:33:341
3272591810,2ptp4l241ktimersoftd/116:09:251
3272591800,2ptp4l241ktimersoftd/114:29:281
3272591800,1ptp4l241ktimersoftd/116:02:381
3272591790,1ptp4l241ktimersoftd/118:07:221
3272591770,3ptp4l14320-21kworker/1:113:03:571
3272591760,3ptp4l24736-21kworker/1:114:56:241
3272591750,3ptp4l17782-21kworker/1:118:12:101
189172750,5sleep125-21ksoftirqd/117:17:401
3272591740,16ptp4l241ktimersoftd/117:26:311
3272591730,21ptp4l17782-21kworker/1:117:55:571
3272591690,1ptp4l241ktimersoftd/116:07:131
3272591690,1ptp4l241ktimersoftd/115:43:481
3272591690,1ptp4l241ktimersoftd/115:33:521
3272591650,1ptp4l241ktimersoftd/114:23:231
3272591640,1ptp4l241ktimersoftd/117:40:481
3272591640,1ptp4l241ktimersoftd/115:31:531
3272591640,14ptp4l241ktimersoftd/116:19:541
3272591640,14ptp4l241ktimersoftd/114:34:311
49662624,9sleep00-21swapper/012:42:140
3272591580,1ptp4l241ktimersoftd/115:48:581
3272591550,14ptp4l241ktimersoftd/116:23:541
3272591550,14ptp4l241ktimersoftd/116:23:541
3272591510,1ptp4l241ktimersoftd/116:54:091
3272591500,1ptp4l241ktimersoftd/115:23:161
3272591500,1ptp4l241ktimersoftd/113:32:561
3272591490,1ptp4l241ktimersoftd/117:58:531
3272591490,1ptp4l241ktimersoftd/117:13:111
3272591490,1ptp4l241ktimersoftd/116:53:261
3272591490,1ptp4l241ktimersoftd/116:41:221
3272591490,1ptp4l241ktimersoftd/115:55:401
3272591490,1ptp4l241ktimersoftd/115:27:241
3272591490,1ptp4l241ktimersoftd/114:45:171
3272591480,1ptp4l241ktimersoftd/117:08:401
3272591480,1ptp4l241ktimersoftd/114:48:561
3272591480,1ptp4l241ktimersoftd/113:14:201
3272591470,1ptp4l241ktimersoftd/114:24:121
3272591460,1ptp4l241ktimersoftd/115:04:421
3272591450,2ptp4l241ktimersoftd/113:50:431
3272591450,1ptp4l241ktimersoftd/114:18:261
3272591440,1ptp4l241ktimersoftd/113:55:281
3272591430,1ptp4l241ktimersoftd/114:01:201
3272591430,1ptp4l241ktimersoftd/113:39:381
3272591430,1ptp4l241ktimersoftd/113:36:371
3272591420,1ptp4l241ktimersoftd/114:10:271
3272591420,1ptp4l241ktimersoftd/113:20:461
3272591410,1ptp4l241ktimersoftd/113:44:371
3272591410,1ptp4l241ktimersoftd/112:48:391
3272591410,1ptp4l241ktimersoftd/112:48:391
5165994021,14cyclictest15021-21/usr/sbin/munin16:34:170
3272591400,1ptp4l241ktimersoftd/114:04:141
3272591390,1ptp4l241ktimersoftd/114:40:161
29442391,33sleep03115-21sed16:19:130
5165993815,4cyclictest56842sleep012:44:060
5165993815,4cyclictest56842sleep012:44:060
3272591380,1ptp4l241ktimersoftd/113:10:111
313822385,3sleep021481-21kworker/u4:118:09:310
47262370,2sleep04727-21sh14:58:520
3272591370,1ptp4l241ktimersoftd/112:57:421
194412371,5sleep019447-21ssh15:17:330
516599368,25cyclictest9-21ksoftirqd/016:49:140
3272591360,1ptp4l241ktimersoftd/113:25:521
516599355,25cyclictest21741-21awk15:19:300
5165993516,14cyclictest4408-21/usr/sbin/munin17:39:360
5165993516,14cyclictest10350-21sh17:07:510
516599337,21cyclictest17827-21gltestperf17:54:100
516599332,26cyclictest824-21apt-get14:54:020
5165993322,6cyclictest3682-21tail16:59:170
5165993321,7cyclictest13573-21tail17:49:090
5165993320,7cyclictest6376-21gltestperf13:59:020
5165993316,10cyclictest24804-21irqrtprio17:24:150
5165993315,5cyclictest786-21sh16:55:410
516599331,27cyclictest24530-21snmp_o5powerctl13:24:230
516599331,26cyclictest7408-21ls15:43:480
134632330,8sleep0516599cyclictest15:09:170
516599326,6cyclictest159672chrt14:19:540
5165993221,6cyclictest20014-21grep16:39:360
5165993221,6cyclictest16038-21latency15:54:150
5165993215,12cyclictest22502-21ssh16:03:260
5165993214,13cyclictest1206-21taskset16:17:000
516599321,26cyclictest16910-21readlink17:14:260
220912320,3sleep00-21swapper/017:20:410
516599313,8cyclictest23814-21python16:44:260
516599312,24cyclictest11649-21snmp_o5powerctl12:54:290
516599312,23cyclictest26627-21python13:29:190
5165993121,6cyclictest9-21ksoftirqd/018:03:540
5165993121,6cyclictest9-21ksoftirqd/015:25:400
5165993121,6cyclictest9-21ksoftirqd/014:40:130
5165993121,6cyclictest9-21ksoftirqd/013:07:550
5165993121,5cyclictest9-21ksoftirqd/013:51:370
5165993120,6cyclictest18989-21cpuspeed_turbos14:29:020
5165993120,5cyclictest9-21ksoftirqd/013:12:020
5165993119,8cyclictest9-21ksoftirqd/014:04:280
5165993119,7cyclictest9191-21grep12:49:120
5165993118,7cyclictest20527-21sed13:14:290
516599311,25cyclictest10721-21runrttasks15:48:120
516599307,13cyclictest11283-21apt-get15:48:590
516599306,14cyclictest10000-21apt-get16:29:000
516599302,8cyclictest26659-21snmp_o5powerctl14:44:260
516599302,23cyclictest465-21df17:34:040
516599302,23cyclictest13212-21hddtemp_smartct12:59:080
516599302,22cyclictest17941-21snmp_o5powerctl14:24:240
5165993020,6cyclictest9-21ksoftirqd/014:37:580
5165993020,5cyclictest9-21ksoftirqd/016:26:040
5165993020,5cyclictest9-21ksoftirqd/016:26:040
5165993020,5cyclictest9-21ksoftirqd/013:56:440
5165993019,8cyclictest9-21ksoftirqd/016:09:050
5165993019,7cyclictest9-21ksoftirqd/015:29:160
5165993018,7cyclictest31939-21cut13:43:590
5165993017,7cyclictest24661-21ssh18:02:100
5165993014,11cyclictest42450irq/96-enp4s0-r17:29:330
516599301,25cyclictest156-21jbd2/sda1-814:17:020
516599301,24cyclictest29655-21ssh14:49:080
516599294,20cyclictest11525-21ssh17:09:040
5165992920,5cyclictest9-21ksoftirqd/013:19:400
5165992920,4cyclictest9-21ksoftirqd/015:34:070
5165992919,6cyclictest9-21ksoftirqd/013:38:510
5165992919,5cyclictest9-21ksoftirqd/013:38:180
5165992918,6cyclictest23426-21gltestperf16:04:050
516599291,6cyclictest10696-21kworker/u4:214:09:100
516599283,8cyclictest8824-21apt-get17:43:560
5165992715,8cyclictest10018-21snmp_o5powerctl15:04:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional