You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-23 - 08:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6s.osadl.org (updated Fri Feb 23, 2024 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911060,1ptp4l241ktimersoftd/105:02:501
32725911040,12ptp4l241ktimersoftd/102:37:201
32725911030,1ptp4l241ktimersoftd/104:48:541
32725911030,1ptp4l241ktimersoftd/104:20:381
32725911020,1ptp4l241ktimersoftd/105:17:011
32725911020,1ptp4l241ktimersoftd/103:03:011
32725911020,13ptp4l241ktimersoftd/105:00:301
32725911010,3ptp4l241ktimersoftd/123:54:411
32725911000,2ptp4l241ktimersoftd/104:54:571
3272591980,1ptp4l241ktimersoftd/100:51:491
3272591970,11ptp4l241ktimersoftd/102:01:581
133552960,8sleep02669699cyclictest04:07:470
202472910,7sleep020242-21unixbench-2d04:17:050
3272591860,14ptp4l241ktimersoftd/103:47:541
3272591850,2ptp4l241ktimersoftd/101:26:441
2669699831,37cyclictest30930-21rm03:03:060
2669699821,35cyclictest26292-21wc02:12:010
2669699821,34cyclictest278422chrt02:59:250
26696998212,63cyclictest157532chrt01:57:460
2669699811,41cyclictest13650-21ssh02:40:290
2669699811,38cyclictest28045-21runrttasks05:13:480
2669699811,36cyclictest3516-21sh03:55:540
126102810,7sleep112612-21rt-features04:06:551
2669699802,41cyclictest30941-21ssh03:47:170
2669699802,38cyclictest23396-21ssh02:52:210
2669699801,42cyclictest3537-21ssh03:11:220
2669699801,42cyclictest31399-21runrttasks05:18:500
2669699801,42cyclictest2953-21taskset02:25:450
2669699792,41cyclictest4705-21/usr/sbin/munin02:26:580
2669699792,41cyclictest32469-21ssh05:21:240
2669699792,41cyclictest31404-21ssh02:20:280
2669699792,41cyclictest24334-21seq04:22:380
2669699792,41cyclictest23799-21/usr/sbin/munin01:01:500
2669699792,41cyclictest19307-21ssh02:02:260
2669699792,40cyclictest6768-21ssh03:59:320
2669699792,40cyclictest16200-21ssh02:42:180
2669699792,39cyclictest23011-21/usr/sbin/munin03:36:520
2669699792,38cyclictest24540-21ssh05:08:440
2669699792,38cyclictest24540-21ssh05:08:440
2669699791,42cyclictest4805-21ssh04:41:380
2669699791,42cyclictest31978-21ssh04:33:080
2669699791,42cyclictest28606-21ssh04:28:510
2669699791,42cyclictest2577-21ssh03:09:140
2669699791,42cyclictest21346-21ssh02:51:150
2669699791,42cyclictest11618-21ssh04:51:050
2669699791,41cyclictest8819-21ssh02:32:140
2669699791,41cyclictest7434-21ssh03:16:340
2669699791,41cyclictest21379-21ssh03:35:320
2669699791,40cyclictest3722-21/usr/sbin/munin00:16:410
2669699791,38cyclictest16065-21phc2sys04:11:520
3272591780,3ptp4l32021-21kworker/1:104:31:201
2669699788,35cyclictest9710-21fschecks_count01:46:410
2669699782,40cyclictest8463-21hddtemp_smartct00:26:440
2669699782,40cyclictest1413-21cat00:11:340
2669699782,40cyclictest11886-21ssh04:51:220
2669699782,39cyclictest28263-21snmp_o5powerctl01:11:580
2669699781,41cyclictest2917-21ssh04:37:170
2669699781,41cyclictest23969-21ssh02:09:530
2669699781,41cyclictest21803-21ssh05:05:500
2669699781,41cyclictest18856-21/usr/sbin/munin00:51:400
2669699781,41cyclictest17893-21ssh04:58:500
2669699781,41cyclictest12850-21ssh03:22:260
2669699781,40cyclictest27009-21/usr/sbin/munin03:42:010
2669699781,39cyclictest29220-21apt-get01:16:370
2669699781,39cyclictest15407-21/usr/sbin/munin03:26:470
2669699772,42cyclictest6282-21/usr/sbin/munin00:21:430
2669699772,37cyclictest10291-21cat00:31:370
2669699771,42cyclictest5153-21taskset01:36:210
2669699771,41cyclictest16019-21seq00:43:530
2669699771,40cyclictest10099-21ssh04:03:470
2669699771,39cyclictest25440-21/usr/sbin/munin01:06:450
2669699771,38cyclictest31996-21awk00:06:380
2669699762,37cyclictest12376-21kernelversion01:51:520
2669699761,41cyclictest7371-21apt-get01:41:370
2669699761,40cyclictest29182-21munin-node00:01:200
2669699761,40cyclictest1086-21ls01:26:410
2669699761,39cyclictest17809-21sed00:47:000
2669699761,38cyclictest3146-21apt-get01:31:380
2669699761,38cyclictest31330-21apt-get01:21:370
2669699761,38cyclictest12770-21awk00:36:450
2669699761,38cyclictest12770-21awk00:36:450
2669699761,37cyclictest27117-21df_inode23:56:410
2669699751,40cyclictest20639-21runrttasks00:56:180
36262740,3sleep10-21swapper/101:31:481
3272591740,22ptp4l11014-21kworker/1:202:45:421
3272591730,3ptp4l32021-21kworker/1:104:25:551
2669699721,38cyclictest26773-21date23:56:160
3272591700,3ptp4l11014-21kworker/1:201:59:041
3272591700,20ptp4l18096-21kworker/1:101:01:471
3272591690,15ptp4l241ktimersoftd/103:29:471
3272591630,1ptp4l241ktimersoftd/102:26:061
3272591590,3ptp4l18096-21kworker/1:101:41:551
3272591570,2ptp4l241ktimersoftd/105:21:581
3272591570,1ptp4l241ktimersoftd/100:36:441
3272591570,1ptp4l241ktimersoftd/100:36:441
3272591560,2ptp4l241ktimersoftd/102:15:561
3272591560,1ptp4l241ktimersoftd/102:54:381
3272591550,1ptp4l241ktimersoftd/103:32:221
3272591530,3ptp4l19855-21kworker/1:003:07:181
3272591520,4ptp4l28949-21kworker/1:000:46:081
3272591510,3ptp4l32021-21kworker/1:104:02:041
3272591510,3ptp4l21054-21kworker/1:005:12:001
3272591510,3ptp4l19855-21kworker/1:003:37:211
3272591510,3ptp4l11014-21kworker/1:201:52:571
3272591510,1ptp4l241ktimersoftd/123:58:221
3272591510,1ptp4l241ktimersoftd/103:52:441
3272591500,1ptp4l241ktimersoftd/103:25:321
3272591490,1ptp4l241ktimersoftd/105:07:531
3272591490,1ptp4l241ktimersoftd/105:07:531
3272591490,1ptp4l241ktimersoftd/104:13:281
3272591490,1ptp4l241ktimersoftd/103:57:361
3272591490,1ptp4l241ktimersoftd/103:42:311
3272591490,1ptp4l241ktimersoftd/102:59:501
3272591490,1ptp4l241ktimersoftd/102:34:481
3272591490,1ptp4l241ktimersoftd/102:18:091
3272591490,1ptp4l241ktimersoftd/102:07:321
3272591490,1ptp4l241ktimersoftd/101:06:531
3272591490,1ptp4l241ktimersoftd/100:26:161
3272591480,1ptp4l241ktimersoftd/104:41:361
3272591480,1ptp4l241ktimersoftd/104:36:331
3272591480,1ptp4l241ktimersoftd/104:27:271
3272591480,1ptp4l241ktimersoftd/102:27:571
3272591480,1ptp4l241ktimersoftd/101:21:321
3272591480,1ptp4l241ktimersoftd/100:27:011
3272591480,1ptp4l241ktimersoftd/100:11:521
3272591470,1ptp4l241ktimersoftd/102:48:141
3272591460,1ptp4l241ktimersoftd/101:18:371
3272591450,1ptp4l241ktimersoftd/101:46:241
3272591450,1ptp4l241ktimersoftd/101:37:061
3272591440,1ptp4l241ktimersoftd/100:02:261
3272591440,15ptp4l241ktimersoftd/100:33:231
3272591430,1ptp4l241ktimersoftd/103:16:421
3272591430,1ptp4l241ktimersoftd/100:48:511
3272591430,14ptp4l241ktimersoftd/100:10:221
3272591420,1ptp4l241ktimersoftd/103:15:251
3272591420,1ptp4l241ktimersoftd/100:58:181
2669799361,4cyclictest121rcu_preempt01:11:491
3272591310,1ptp4l241ktimersoftd/100:16:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional