You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 14:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6s.osadl.org (updated Sat Apr 27, 2024 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1209421120,4sleep05622-21cyclictest04:41:090
32725911010,9ptp4l241ktimersoftd/100:15:201
178342970,8sleep0562499cyclictest04:48:100
79682960,5sleep131800-21snmpd04:35:571
562499964,49cyclictest28353-21snmp_o5powerctl05:43:230
68902930,8sleep1563299cyclictest03:53:321
562499910,8cyclictest6450-21taskset02:33:300
562499904,45cyclictest25144-21apt-get02:17:580
562499903,48cyclictest12446-21apt-get05:22:580
562499900,6cyclictest7259-21chrt05:15:160
562499890,7cyclictest16095-21ssh05:27:560
562499880,8cyclictest31522-21ssh05:04:400
562499880,8cyclictest31522-21ssh05:04:400
562499880,8cyclictest26498-21processes01:03:120
562499880,6cyclictest19689-21cat00:48:040
562499870,5cyclictest17546-21cstates04:08:030
562499860,8cyclictest15687-21ssh03:24:460
3272591850,2ptp4l241ktimersoftd/101:42:551
562499844,44cyclictest21471-21diskstats04:53:020
5624998413,34cyclictest9795-21latency_hist01:42:440
562499836,43cyclictest13175-21apt-get04:03:000
562499831,48cyclictest21671-21expr03:32:580
562499831,47cyclictest11219-21chrt02:39:420
5624998311,37cyclictest30507-21needreboot03:43:130
5624998310,40cyclictest29056-21ssh04:22:410
562499830,8cyclictest18740-21snmp_o5powerctl03:28:180
562499822,8cyclictest7354-21seq03:14:170
5624998211,36cyclictest31778-21/usr/sbin/munin01:18:090
5624998211,35cyclictest20536-21irqrtprio05:33:100
5624998210,37cyclictest7413-21taskset04:34:420
562499818,38cyclictest25282-21latency_hist04:17:470
562499816,37cyclictest24824-21diskmemload04:27:530
562499813,43cyclictest17604-21df02:48:000
562499812,8cyclictest3227-21ssh03:09:000
562499812,7cyclictest31520-21ssh04:24:010
562499812,41cyclictest6027-21df00:17:580
562499812,40cyclictest2032-21snmp_o5powerctl02:28:170
5624998114,31cyclictest14447-21sensors_temp04:43:170
5624998111,37cyclictest13109-21/usr/sbin/munin02:43:130
5624998111,34cyclictest24127-21wc02:13:230
5624998111,32cyclictest33292chrt05:10:210
98692800,2sleep09868-21awk03:18:050
562499804,40cyclictest29491-21apt-get03:02:570
562499802,41cyclictest8441-21df00:22:510
562499801,9cyclictest26096-21ssh05:41:020
5624998011,34cyclictest7138-21sh03:54:040
3272591800,1ptp4l241ktimersoftd/105:36:061
562499791,7cyclictest8611-21bc05:17:560
562499782,8cyclictest28702-21ssh03:01:450
562499782,41cyclictest29328-21df_inode02:22:590
562499781,10cyclictest13941-21chrt01:51:480
562499778,35cyclictest14210-21sed00:33:190
562499772,7cyclictest5701-21date00:17:430
562499772,7cyclictest28907-21sed01:08:200
562499772,7cyclictest28907-21sed01:08:200
562499772,42cyclictest7468-21seq01:35:330
562499772,41cyclictest21634-21memory02:08:060
562499771,9cyclictest22276-21ssh02:53:120
562499771,8cyclictest28445-21rm03:41:060
562499771,8cyclictest17703-21sed00:43:020
5632997629,5cyclictest25-21ksoftirqd/103:33:041
562499765,51cyclictest1196-21apt-get03:47:590
562499762,8cyclictest28613-21sh05:01:590
562499753,50cyclictest23394-21apt-get00:57:540
562499753,41cyclictest21693-21hddtemp_smartct00:53:000
562499751,7cyclictest12309-21chrt00:29:460
562499751,6cyclictest15781-21taskset01:53:550
562499751,6cyclictest15781-21taskset01:53:550
562499741,8cyclictest17610-21ssh01:58:210
562499741,36cyclictest10319-21perl01:43:020
562499735,36cyclictest10457-21/usr/sbin/munin03:58:190
562499722,35cyclictest3857-21df_inode01:27:580
562499721,7cyclictest29802-21ls01:12:550
562499712,35cyclictest18897-21hddtemp_smartct02:03:040
3272591710,3ptp4l7900-21kworker/1:104:43:551
3272591710,3ptp4l7132-21kworker/1:003:17:261
3272591710,20ptp4l8339-21kworker/1:005:23:111
562499692,46cyclictest2699-21snmp_o5powerctl01:23:160
3272591690,1ptp4l241ktimersoftd/100:58:031
3272591680,3ptp4l28446-21kworker/1:003:02:121
562499670,7cyclictest16362-21awk00:38:200
3272591660,1ptp4l241ktimersoftd/104:49:331
5632996421,13cyclictest25-21ksoftirqd/103:28:251
5632996226,18cyclictest25-21ksoftirqd/105:03:031
5632996226,18cyclictest25-21ksoftirqd/105:03:031
5632996025,18cyclictest25-21ksoftirqd/105:13:141
5632996025,17cyclictest25-21ksoftirqd/104:13:061
5632996023,18cyclictest25-21ksoftirqd/102:53:091
5632996018,6cyclictest25-21ksoftirqd/103:59:261
5632995919,6cyclictest25-21ksoftirqd/101:03:131
5632995819,6cyclictest25-21ksoftirqd/104:11:281
5632995819,6cyclictest25-21ksoftirqd/100:48:041
5632995818,6cyclictest25-21ksoftirqd/105:44:591
5632995816,6cyclictest25-21ksoftirqd/102:08:081
3272591580,4ptp4l31815-21kworker/1:103:47:561
3272591580,4ptp4l31815-21kworker/1:103:47:461
3272591580,11ptp4l241ktimersoftd/102:51:241
283062580,7sleep1563299cyclictest05:01:201
5632995717,6cyclictest25-21ksoftirqd/105:09:121
3272591570,1ptp4l241ktimersoftd/104:29:351
3272591570,1ptp4l241ktimersoftd/102:18:031
5632995619,5cyclictest25-21ksoftirqd/102:02:441
5632995616,6cyclictest25-21ksoftirqd/105:38:061
5632995616,6cyclictest25-21ksoftirqd/104:42:471
5632995517,6cyclictest25-21ksoftirqd/103:12:371
5632995515,5cyclictest25-21ksoftirqd/102:05:351
5632995515,5cyclictest25-21ksoftirqd/101:54:341
5632995515,5cyclictest25-21ksoftirqd/101:54:341
5632995417,5cyclictest25-21ksoftirqd/104:18:521
5632995416,6cyclictest25-21ksoftirqd/104:54:401
3272591540,16ptp4l241ktimersoftd/104:07:101
563299538,5cyclictest25-21ksoftirqd/102:43:001
5632995315,6cyclictest25-21ksoftirqd/105:28:101
5632995314,6cyclictest25-21ksoftirqd/102:28:291
5632995312,6cyclictest25-21ksoftirqd/104:23:161
3272591530,1ptp4l241ktimersoftd/103:22:551
563299529,5cyclictest25-21ksoftirqd/102:33:171
5632995225,4cyclictest25-21ksoftirqd/102:39:501
563299519,6cyclictest25-21ksoftirqd/101:48:211
563299519,6cyclictest25-21ksoftirqd/100:53:101
563299513,4cyclictest121rcu_preempt01:18:141
5632995113,6cyclictest25-21ksoftirqd/100:33:101
5632995113,6cyclictest25-21ksoftirqd/100:18:041
5632995111,6cyclictest25-21ksoftirqd/103:17:491
563299509,6cyclictest25-21ksoftirqd/102:13:161
563299509,6cyclictest25-21ksoftirqd/101:22:561
563299501,6cyclictest29692-21df03:02:591
5632995012,6cyclictest25-21ksoftirqd/101:42:451
5632995012,5cyclictest25-21ksoftirqd/102:27:461
563299498,6cyclictest25-21ksoftirqd/101:28:011
563299496,6cyclictest25-21ksoftirqd/100:43:001
5632994910,6cyclictest25-21ksoftirqd/100:23:031
3272591490,1ptp4l241ktimersoftd/105:19:571
3272591490,1ptp4l241ktimersoftd/103:38:001
563299486,6cyclictest25-21ksoftirqd/100:38:191
3272591480,1ptp4l241ktimersoftd/100:32:431
563299479,5cyclictest25-21ksoftirqd/101:33:121
563299479,5cyclictest25-21ksoftirqd/101:07:521
563299479,5cyclictest25-21ksoftirqd/101:07:521
3272591470,1ptp4l241ktimersoftd/101:13:071
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional