You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-03-03 - 21:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6s.osadl.org (updated Sun Mar 03, 2024 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911140,8ptp4l25061-21kworker/1:111:58:031
32725911070,2ptp4l241ktimersoftd/115:35:171
32725911060,1ptp4l241ktimersoftd/117:26:481
32725911060,1ptp4l241ktimersoftd/115:48:171
32725911040,1ptp4l241ktimersoftd/115:11:521
32725911030,1ptp4l241ktimersoftd/116:02:521
32725911030,1ptp4l241ktimersoftd/113:14:291
32725911020,2ptp4l241ktimersoftd/116:24:551
32725911020,13ptp4l241ktimersoftd/114:00:551
32725911010,2ptp4l241ktimersoftd/114:18:281
32725911000,1ptp4l241ktimersoftd/113:27:401
162572980,4sleep02542899cyclictest16:19:530
3272591960,1ptp4l241ktimersoftd/116:24:161
3272591950,1ptp4l241ktimersoftd/114:35:151
3272591950,1ptp4l241ktimersoftd/113:41:151
3272591920,3ptp4l241ktimersoftd/113:29:481
2542899921,40cyclictest17283-21sh17:03:400
3272591890,2ptp4l241ktimersoftd/114:51:291
3272591890,1ptp4l241ktimersoftd/117:11:111
3272591870,1ptp4l241ktimersoftd/117:02:361
3272591860,1ptp4l241ktimersoftd/115:52:121
3272591850,1ptp4l241ktimersoftd/116:52:521
3272591830,1ptp4l241ktimersoftd/116:47:351
2542899838,38cyclictest22692-21ps17:10:020
2542899831,38cyclictest14764-21chrt16:17:010
3272591820,1ptp4l241ktimersoftd/115:08:041
25428998211,37cyclictest14350-21processes14:45:090
2542899811,40cyclictest5562-21seq13:41:240
2542899803,41cyclictest31710-21taskset13:27:120
2542899802,41cyclictest8237-21seq14:38:080
2542899802,41cyclictest25159-21ssh14:15:380
2542899802,41cyclictest18574-21seq14:50:220
2542899802,40cyclictest5453-21sh15:18:120
2542899801,43cyclictest25577-21seq13:14:240
2542899801,42cyclictest26555-21taskset15:01:560
2542899801,41cyclictest7810-21ssh16:07:520
2542899801,39cyclictest30177-21ssh17:20:000
2542899801,38cyclictest5788-21taskset16:49:020
2542899801,37cyclictest1457-21chrt14:29:280
2542899792,41cyclictest29444-21ssh14:22:350
2542899792,41cyclictest12156-21taskset13:58:540
2542899792,39cyclictest3237-21ssh16:00:200
2542899792,39cyclictest12216-21diskmemload15:09:520
2542899791,48cyclictest29493-21taskset13:21:040
2542899791,43cyclictest8143-21taskset12:31:190
2542899791,42cyclictest8957-21ssh16:51:590
2542899791,42cyclictest31063-21sh16:39:380
2542899791,42cyclictest30404-21ssh15:07:270
2542899791,42cyclictest15017-21ssh15:31:120
2542899791,42cyclictest11366-21ssh16:12:330
2542899791,42cyclictest10231-21ssh16:54:380
2542899791,41cyclictest30865-21sh16:39:310
2542899791,41cyclictest21223-21sh15:40:140
2542899791,41cyclictest20401-21ssh14:54:330
2542899791,40cyclictest26027-21ssh16:32:070
2542899791,40cyclictest21546-21taskset17:09:150
2542899791,38cyclictest2323-21apt-get12:19:440
2542899782,40cyclictest2756-21ssh17:25:250
2542899782,40cyclictest20712-21timedrift13:00:120
2542899782,39cyclictest747-21ssh15:57:530
2542899782,39cyclictest4976-21ssh14:34:050
2542899782,39cyclictest26832-21ssh17:15:070
2542899781,42cyclictest29857-21vmstat12:05:120
2542899781,41cyclictest26724-21ssh15:49:160
2542899781,41cyclictest20859-21ps16:25:070
2542899781,41cyclictest17359-21/usr/sbin/munin14:05:070
2542899781,41cyclictest17359-21/usr/sbin/munin14:05:070
2542899781,40cyclictest9222-21cut13:50:030
2542899781,40cyclictest22345-21ssh14:12:390
2542899781,40cyclictest14434-21sh14:00:510
2542899781,39cyclictest9291-21sh14:39:440
2542899781,38cyclictest28393-21/usr/sbin/munin15:50:100
2542899772,41cyclictest26017-21df13:14:520
2542899772,41cyclictest12333-21/usr/sbin/munin12:40:120
2542899772,39cyclictest9542-21sh15:24:420
2542899772,39cyclictest25849-21df_inode11:59:500
2542899772,39cyclictest17725-21/usr/sbin/munin12:54:530
25428997715,40cyclictest7143-21ptp4l13:45:060
2542899771,41cyclictest8155-21sh15:21:120
2542899771,41cyclictest1180-21ps12:15:030
2542899771,40cyclictest18778-21ssh15:37:090
2542899771,39cyclictest10263-21tail12:35:130
2542899762,40cyclictest5162-21/usr/sbin/munin12:24:560
2542899762,40cyclictest474-21kernelversion13:29:580
2542899761,41cyclictest23199-21seq13:06:470
2542899761,40cyclictest31441-21phc2sys12:09:580
2542899761,37cyclictest2197-21fschecks_time13:34:540
2542899761,37cyclictest14034-21phc2sys12:45:030
2542899751,40cyclictest15162-21taskset12:49:390
3272591730,20ptp4l9117-21kworker/1:015:31:551
3272591690,1ptp4l241ktimersoftd/114:44:521
3272591680,1ptp4l241ktimersoftd/112:04:331
3272591660,3ptp4l18963-21kworker/1:214:25:181
253342644,9sleep00-21swapper/011:59:020
3272591580,1ptp4l241ktimersoftd/117:15:231
3272591580,1ptp4l241ktimersoftd/114:05:051
3272591580,1ptp4l241ktimersoftd/114:05:051
3272591570,6ptp4l241ktimersoftd/116:14:581
3272591570,2ptp4l241ktimersoftd/116:41:451
3272591570,1ptp4l241ktimersoftd/116:35:161
2542999556,13cyclictest6642-21snmp_o5powerctl16:05:111
3272591540,1ptp4l241ktimersoftd/112:56:341
3272591530,1ptp4l241ktimersoftd/116:12:351
2542999520,13cyclictest35692irq/88-enp1s0-r12:35:081
3272591510,1ptp4l241ktimersoftd/116:55:211
3272591510,1ptp4l241ktimersoftd/115:57:281
3272591510,1ptp4l241ktimersoftd/115:22:441
2542999513,11cyclictest23626-21apt-get16:29:531
25429995110,12cyclictest15323-21/usr/sbin/munin12:49:491
3272591500,1ptp4l241ktimersoftd/117:22:041
3272591500,1ptp4l241ktimersoftd/114:55:271
3272591490,6ptp4l241ktimersoftd/114:20:561
3272591490,1ptp4l241ktimersoftd/115:43:541
3272591490,1ptp4l241ktimersoftd/115:14:331
3272591490,1ptp4l241ktimersoftd/115:01:431
3272591490,1ptp4l241ktimersoftd/114:42:351
3272591490,1ptp4l241ktimersoftd/114:11:241
2542999495,11cyclictest10893-21snmp_o5powerctl15:25:111
2542999495,10cyclictest2712-21memory14:29:591
2542999492,7cyclictest368-21df_inode12:14:521
3272591480,1ptp4l241ktimersoftd/117:05:231
2542999483,18cyclictest30907-21gltestperf12:09:511
2542999475,9cyclictest22736-21snmp_o5powerctl13:05:071
2542999474,10cyclictest9402-21snmp_o5powerctl13:50:101
25429994612,9cyclictest6293-21df13:44:531
2542999461,19cyclictest26987-21grep12:00:101
2542999452,7cyclictest19659-21df_inode12:59:521
2542999452,10cyclictest10540-21df_inode13:54:511
25429994514,6cyclictest25426-21cyclictest12:41:571
25429994416,6cyclictest25-21ksoftirqd/112:27:551
25429994414,5cyclictest2116-21fschecks_count13:34:531
25429994413,5cyclictest845-21runrttasks13:23:051
25429994412,7cyclictest13236-21tr12:44:521
2542999435,9cyclictest2323-21apt-get12:19:471
2542999351,14cyclictest3272591ptp4l12:30:411
438491334,24phc2sys25622-21date13:14:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional