You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 12:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6s.osadl.org (updated Thu Apr 25, 2024 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1861221030,7sleep11245899cyclictest05:39:341
3272591930,3ptp4l241ktimersoftd/100:13:001
146522920,9sleep11245899cyclictest05:32:541
12458997117,18cyclictest14442-21df_inode02:42:241
12458997015,17cyclictest10226-21taskset04:00:261
12458996918,17cyclictest24416-21sh03:37:081
12458996918,17cyclictest24416-21sh03:37:081
12458996916,16cyclictest20254-21ssh03:31:591
12458996713,17cyclictest25515-21snmp_o5powerctl05:02:381
12458996710,20cyclictest8387-21apt-get03:17:121
12458996710,18cyclictest11894-21ssh01:37:501
122152670,8sleep11245899cyclictest04:02:311
110882675,10sleep00-21swapper/000:12:250
12458996618,16cyclictest3804-21taskset03:10:331
12458996618,15cyclictest10038-21sh02:36:491
12458996616,18cyclictest19236-21/usr/sbin/munin02:47:431
12458996610,17cyclictest26947-21date00:57:441
12458996610,17cyclictest26947-21date00:57:441
12458996514,16cyclictest16120-21ssh01:47:381
12458996415,16cyclictest11085-21snmp_o5powerctl05:27:401
12458996413,12cyclictest9135-21ssh05:25:401
12458996412,18cyclictest14551-21users04:47:501
12458996411,31cyclictest25622-21ssh04:21:201
12458996410,17cyclictest28168-21ls05:07:211
12458996315,17cyclictest13401-21taskset02:40:531
12458996311,11cyclictest31752-21ssh03:04:151
12458996310,15cyclictest4731-21ssh04:36:501
12458996217,16cyclictest21037-21taskset04:14:391
12458996216,16cyclictest24186-21taskset02:54:401
12458996216,14cyclictest6037-21taskset05:21:121
12458996213,11cyclictest16974-21ssh04:08:471
12458996212,11cyclictest21858-21ssh03:32:341
12458996211,17cyclictest520-21snmp_o5powerctl02:22:381
12458996210,15cyclictest19857-21mailstats00:37:271
12458996210,12cyclictest28188-21ssh04:23:291
168932610,8sleep01245099cyclictest03:27:170
12458996112,11cyclictest955-21ssh05:13:051
12458996111,11cyclictest23803-21ssh05:01:461
12458996020,17cyclictest9977-21seq01:34:461
12458996020,17cyclictest9977-21seq01:34:461
12458996020,16cyclictest29462-21taskset02:18:141
12458996012,11cyclictest28288-21ssh03:00:091
1245899599,12cyclictest3803-21irqstats02:27:261
12458995915,21cyclictest27331-21diskmemload03:22:101
1245899589,17cyclictest7259-21taskset03:14:331
12458995815,19cyclictest32066-21taskset04:28:411
12458995715,17cyclictest197-21systemd-journal01:55:521
12458995714,12cyclictest11138-21chrt04:44:111
12458995618,15cyclictest2062-21ssh03:49:181
12458995617,15cyclictest5453-21seq01:24:091
12458995610,17cyclictest7119-21ssh03:56:541
12458995516,16cyclictest7237-21sh04:38:491
12458995515,16cyclictest29609-21snmp_o5powerctl03:42:381
12458995512,14cyclictest21884-21ssh05:43:471
12458995416,17cyclictest16624-21sh04:52:131
12458995413,15cyclictest7368-21snmp_o5powerctl01:27:391
12458995413,12cyclictest13826-21snmp_o5powerctl00:17:331
12458995412,18cyclictest1791-21/usr/sbin/munin01:17:171
12458995412,15cyclictest22638-21snmp_o5powerctl00:47:321
12458995315,17cyclictest17685-21seq00:29:441
12458995314,16cyclictest1372-21seq01:15:441
12458995215,16cyclictest15541-21seq00:24:341
12458995213,17cyclictest25048-21awk00:52:441
12458995212,12cyclictest20552-21/usr/sbin/munin01:57:401
12458995212,11cyclictest21936-21irqstats02:02:261
1245899517,18cyclictest250952sleep102:10:471
12458995112,17cyclictest31037-21systemctl01:07:341
12458995112,12cyclictest28868-21grep01:02:321
12458995012,12cyclictest25716-21/usr/sbin/munin02:12:231
12458995011,12cyclictest12932-21df01:42:171
12458994911,12cyclictest21279-21sort00:47:031
1245899436,17cyclictest0-21swapper/100:32:061
1245099415,4cyclictest121rcu_preempt04:08:310
1245099414,4cyclictest131rcu_sched01:10:320
142352401,34sleep014272-21sh05:32:370
1245099403,4cyclictest121rcu_preempt03:10:140
1245099382,4cyclictest121rcu_preempt03:47:170
1245099382,4cyclictest121rcu_preempt02:46:440
1245099381,4cyclictest121rcu_preempt04:20:050
12450993710,23cyclictest10663-21ssh04:43:030
1245099365,11cyclictest9805-21/usr/sbin/munin05:27:500
1245099362,6cyclictest28912-21snmp_o5powerctl02:17:400
1245099361,4cyclictest121rcu_preempt04:12:500
1245099361,3cyclictest121rcu_preempt04:35:380
12450993612,19cyclictest0-21swapper/002:10:160
1245099352,7cyclictest8507-21diskstats01:32:190
1245099352,7cyclictest8507-21diskstats01:32:190
1245099351,7cyclictest20686-21df_inode04:57:220
12450993515,5cyclictest7622-21phc2sys05:22:350
12450993511,10cyclictest30676-21grep04:27:270
86252341,27sleep027331-21diskmemload02:33:280
257962343,4sleep025798-21snmp_o5powerctl03:37:390
257962343,4sleep025798-21snmp_o5powerctl03:37:390
1245099342,6cyclictest370-21ssh03:06:410
1245099342,6cyclictest21700-21memory03:32:310
1245099342,10cyclictest27331-21diskmemload05:04:030
12450993412,17cyclictest28923-21cat03:42:260
12450993411,18cyclictest12733-21cat03:22:140
12450993410,10cyclictest23314-21unixbench_singl02:52:480
1245099335,4cyclictest121rcu_preempt05:13:550
12450993323,6cyclictest9-21ksoftirqd/003:52:460
1245099332,26cyclictest8821-21acpi03:17:170
12450993322,6cyclictest5155-21head03:12:240
1245099332,10cyclictest18741-21apt-get00:37:100
1245099331,6cyclictest29267-21users01:02:430
1245099331,6cyclictest15026-21snmp_o5powerctl00:22:060
1245099331,5cyclictest27331-21diskmemload04:55:180
1245099331,4cyclictest2641-21apt-get05:17:140
1245099331,4cyclictest121rcu_preempt00:20:570
1245099331,11cyclictest121rcu_preempt04:01:020
1245099324,8cyclictest24758-21snmp_o5powerctl00:52:390
1245099323,4cyclictest121rcu_preempt05:09:200
1245099322,4cyclictest3016-21apt-get02:27:160
12450993222,8cyclictest9-21ksoftirqd/001:47:290
1245099321,5cyclictest12470-21snmp_o5powerctl04:02:370
1245099312,23cyclictest2908-21snmp_o5powerctl01:17:410
12450993121,6cyclictest9-21ksoftirqd/005:38:590
12450993121,6cyclictest9-21ksoftirqd/004:26:140
12450993120,7cyclictest9-21ksoftirqd/001:52:300
1245099311,9cyclictest8472-21ssh04:41:410
12450993119,9cyclictest9-21ksoftirqd/001:37:160
12450993119,8cyclictest9-21ksoftirqd/002:57:220
1245099311,5cyclictest16025-21apt-get00:27:100
1245099311,4cyclictest121rcu_preempt00:51:250
1245099303,6cyclictest5737-21apt-get01:27:110
1245099302,22cyclictest14548-21users04:47:500
12450993021,5cyclictest9-21ksoftirqd/005:43:520
12450993021,5cyclictest9-21ksoftirqd/002:14:500
12450993021,4cyclictest9-21ksoftirqd/001:01:460
12450993021,4cyclictest9-21ksoftirqd/001:01:460
12450993020,5cyclictest9-21ksoftirqd/001:14:510
12450993020,5cyclictest9-21ksoftirqd/000:43:260
12450993020,5cyclictest9-21ksoftirqd/000:33:140
12450993012,10cyclictest10477-21apt-get02:37:170
1245099296,13cyclictest31692-21apt-get02:22:170
1245099295,15cyclictest12757-21apt-get01:42:150
12450992918,6cyclictest9-21ksoftirqd/002:02:070
1245099291,10cyclictest4439-21sed01:22:280
12450992817,8cyclictest9-21ksoftirqd/001:57:130
12450992816,7cyclictest17956-21apt-get02:47:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional