You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-28 - 19:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6s.osadl.org (updated Thu Sep 28, 2023 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911640,43ptp4l1880-21kworker/1:111:01:591
32725911640,43ptp4l1880-21kworker/1:111:01:591
32725911110,2ptp4l241ktimersoftd/114:48:561
32725911050,13ptp4l241ktimersoftd/116:29:381
32725911010,1ptp4l241ktimersoftd/113:54:361
3272591980,1ptp4l241ktimersoftd/113:20:391
3272591960,1ptp4l241ktimersoftd/115:04:271
3272591950,1ptp4l241ktimersoftd/115:20:551
3272591940,2ptp4l241ktimersoftd/116:23:321
3272591940,1ptp4l241ktimersoftd/115:52:301
3272591900,2ptp4l241ktimersoftd/114:08:111
3272591900,2ptp4l241ktimersoftd/112:03:011
3272591800,2ptp4l241ktimersoftd/114:18:021
3272591760,20ptp4l18797-21kworker/1:213:43:011
3272591760,1ptp4l241ktimersoftd/111:17:491
3272591740,20ptp4l27543-21kworker/1:213:13:191
3272591740,20ptp4l27417-21kworker/1:013:58:391
4050997317,16cyclictest6051-21ssh16:15:140
3272591730,3ptp4l30496-21kworker/1:112:07:471
3272591730,2ptp4l3611-21kworker/1:112:18:031
4050997217,16cyclictest29849-21seq13:58:460
4050997215,17cyclictest25301-21snmp_o5powerctl13:07:150
4050997213,16cyclictest2133-21ssh16:10:400
4050997115,16cyclictest5730-21ssh15:35:380
3272591710,3ptp4l22136-21kworker/1:011:50:381
3272591710,15ptp4l241ktimersoftd/115:47:501
4050997019,15cyclictest19825-21wc15:12:200
4050997014,17cyclictest17809-21rm15:11:050
4050997013,17cyclictest16490-21chrt13:41:290
4050997012,17cyclictest10086-21taskset16:20:050
3272591700,3ptp4l8583-21kworker/1:114:15:321
4050996918,16cyclictest22748-21latency_hist15:56:380
4050996918,14cyclictest22274-21ssh15:16:390
4050996916,16cyclictest12208-21seq13:34:240
4050996914,17cyclictest5540-21chrt14:54:230
4050996914,17cyclictest11036-21mailstats14:17:100
4050996913,17cyclictest19451-21rm13:44:140
4050996911,21cyclictest30107-21rm16:04:520
4050996816,15cyclictest4267-21sh13:22:550
4050996816,15cyclictest14430-21phc2sys-jitter14:22:110
4050996814,18cyclictest21806-21systemctl14:32:130
4050996813,17cyclictest25771-21chrt14:37:300
4050996812,17cyclictest2391-21taskset12:15:340
3272591680,1ptp4l241ktimersoftd/111:53:021
4050996716,17cyclictest31964-21cut12:07:100
4050996714,17cyclictest19172-21chrt12:53:510
4050996714,17cyclictest12804-21chrt12:38:230
4050996714,15cyclictest5542-21cat11:07:170
4050996714,15cyclictest13161-21sh16:23:040
4050996713,17cyclictest8375-21rm14:14:140
4050996713,17cyclictest5527-21rm14:11:040
4050996713,17cyclictest342-21unixbench_singl14:02:200
4050996713,17cyclictest1960-21chrt13:21:170
4050996713,17cyclictest17106-21chrt12:49:180
4050996713,17cyclictest13942-21/usr/sbin/munin11:27:030
4050996713,16cyclictest26501-21sed11:56:340
4050996713,16cyclictest12063-21sed15:42:200
4050996614,16cyclictest9011-21taskset11:15:410
4050996614,16cyclictest8650-21ssh15:38:110
4050996614,16cyclictest23937-21taskset13:51:170
4050996614,16cyclictest16259-21needreboot16:27:140
4050996613,18cyclictest23307-21chrt13:02:370
4050996613,17cyclictest28686-21ssh13:12:050
4050996613,17cyclictest20584-21/usr/sbin/munin12:57:050
4050996613,17cyclictest10898-21taskset11:18:000
4050996613,16cyclictest29740-21ssh15:25:040
4050996613,16cyclictest2602-21chrt14:51:330
4050996613,16cyclictest19800-21taskset11:38:090
4050996613,16cyclictest12327-21/usr/sbin/munin15:02:210
4050996613,15cyclictest29949-21ssh14:43:550
4050996612,18cyclictest1063-21chrt15:29:270
4050996610,20cyclictest8149-21rm13:28:580
3272591660,1ptp4l241ktimersoftd/112:56:541
405099658,18cyclictest172972sleep015:49:100
4050996518,15cyclictest25182-21ssh15:58:360
4050996514,17cyclictest8927-21chrt14:58:200
4050996513,17cyclictest27629-21awk11:57:060
4050996513,17cyclictest14411-21sed12:42:100
4050996513,16cyclictest25627-21mailstats13:52:100
4050996513,16cyclictest16073-21acpi11:31:510
4050996513,15cyclictest19809-21chrt14:30:270
4050996513,13cyclictest24008-21sshd11:48:010
3272591650,1ptp4l241ktimersoftd/115:14:241
4050996413,17cyclictest7562-21interrupts12:27:020
4050996412,17cyclictest4882-21apt-get12:21:540
4050996412,17cyclictest22183-21taskset11:46:070
4050996412,17cyclictest19288-21cat16:31:540
38562644,9sleep00-21swapper/011:05:040
38562644,9sleep00-21swapper/011:05:040
3272591640,1ptp4l241ktimersoftd/111:07:021
4050996313,16cyclictest9572-21if_enp1s0.112:32:020
4050996313,16cyclictest28762-21cat12:01:520
4050996313,15cyclictest13201-21chrt11:22:470
4050996312,16cyclictest2816-21ls12:16:560
3272591630,2ptp4l5194-21kworker/1:215:38:021
3272591620,1ptp4l241ktimersoftd/115:58:011
3272591610,1ptp4l241ktimersoftd/116:14:111
3272591610,1ptp4l241ktimersoftd/114:26:471
3272591600,3ptp4l26801-21kworker/1:015:46:061
38092570,6sleep125-21ksoftirqd/114:52:071
3272591560,2ptp4l241ktimersoftd/114:25:171
3272591560,1ptp4l241ktimersoftd/113:11:251
97752550,7sleep19753-21ssh13:31:511
3272591550,6ptp4l241ktimersoftd/112:47:021
3272591540,1ptp4l241ktimersoftd/114:31:481
3272591530,1ptp4l241ktimersoftd/111:59:321
3272591510,1ptp4l241ktimersoftd/115:24:151
3272591510,1ptp4l241ktimersoftd/111:38:241
3272591500,1ptp4l241ktimersoftd/115:31:451
3272591500,1ptp4l241ktimersoftd/114:37:451
3272591500,1ptp4l241ktimersoftd/114:04:551
3272591500,1ptp4l241ktimersoftd/113:27:491
3272591490,1ptp4l241ktimersoftd/116:08:151
3272591490,1ptp4l241ktimersoftd/114:57:541
3272591490,1ptp4l241ktimersoftd/113:37:301
3272591490,19ptp4l241ktimersoftd/115:07:021
3272591480,1ptp4l241ktimersoftd/115:27:161
3272591480,1ptp4l241ktimersoftd/112:22:391
3272591470,1ptp4l241ktimersoftd/114:42:351
3272591470,1ptp4l241ktimersoftd/111:26:581
3272591470,1ptp4l241ktimersoftd/111:12:051
3272591460,1ptp4l241ktimersoftd/116:33:401
3272591460,1ptp4l241ktimersoftd/113:22:581
3272591450,1ptp4l241ktimersoftd/112:45:551
3272591450,1ptp4l241ktimersoftd/111:45:221
3272591450,1ptp4l241ktimersoftd/111:24:341
3272591440,1ptp4l241ktimersoftd/113:49:431
3272591440,1ptp4l241ktimersoftd/113:05:001
3272591440,14ptp4l241ktimersoftd/112:37:391
3272591420,3ptp4l13924-21kworker/1:111:31:591
3272591420,1ptp4l241ktimersoftd/116:17:321
3272591420,1ptp4l241ktimersoftd/112:54:091
3272591400,1ptp4l241ktimersoftd/112:29:571
3272591390,1ptp4l241ktimersoftd/112:15:541
274742330,6sleep1405199cyclictest16:02:021
3272591320,1ptp4l241ktimersoftd/112:31:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional