You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 12:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot3s.osadl.org (updated Fri Dec 05, 2025 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2709721440,4sleep30-21swapper/319:05:313
3048521070,2sleep00-21swapper/023:05:400
3048521070,2sleep00-21swapper/023:05:400
299062930,2sleep30-21swapper/323:05:303
299062930,2sleep30-21swapper/323:05:303
64302880,2sleep10-21swapper/122:34:321
64302880,2sleep10-21swapper/122:34:321
168322830,5sleep02844099cyclictest22:05:040
311542800,5sleep32844499cyclictest23:50:363
275892790,2sleep20-21swapper/219:05:392
144772750,6sleep37950irq/56-dwc_otg_00:11:413
107602750,1sleep00-21swapper/021:55:500
264412730,8sleep3381ktimersoftd/322:16:273
2844099709,49cyclictest21851-21ntpq22:10:380
2844099706,51cyclictest12423-21cron00:10:120
2844099704,43cyclictest0-21swapper/023:35:250
2844099694,60cyclictest20260-21ssh00:20:320
2844099687,48cyclictest13028-21/usr/sbin/munin00:10:330
2844099682,53cyclictest0-21swapper/022:30:280
2844099682,53cyclictest0-21swapper/022:30:280
2844099678,32cyclictest4337-21latency_hist23:15:120
28440996714,46cyclictest0-21swapper/019:10:150
2844099671,42cyclictest22547-21fschecks_count22:55:330
28442996625,25cyclictest13968-21ssh21:19:152
2844099668,43cyclictest5721-21wc21:05:360
2844099663,46cyclictest13943-21awk20:00:130
133462660,1sleep0101ktimersoftd/021:17:580
2844099659,52cyclictest26395-21awk23:45:120
2844199648,31cyclictest7750irq/56-dwc_otg19:10:151
2844099644,52cyclictest26880-21cut20:35:280
28442996324,15cyclictest27331-21memory23:45:362
28442996315,11cyclictest7950irq/56-dwc_otg_21:05:392
2844099636,54cyclictest0-21swapper/022:35:280
2844099628,45cyclictest14170-21sh22:44:340
2844099624,49cyclictest0-21swapper/023:17:380
28440996213,46cyclictest101ktimersoftd/021:35:410
2844099620,44cyclictest0-21swapper/021:27:280
28442996132,9cyclictest3426-21apt-get21:00:292
28442996119,16cyclictest12882-21basename00:10:312
2844099618,35cyclictest16673-21chrt20:05:370
2844099615,35cyclictest0-21swapper/021:24:410
28440996133,12cyclictest7850irq/56-dwc_otg_00:30:450
28440996133,12cyclictest7850irq/56-dwc_otg_00:30:450
2844099611,53cyclictest22613-21aten_rbpower_po21:30:330
135792610,1sleep00-21swapper/023:26:330
2844299604,22cyclictest7950irq/56-dwc_otg_21:10:242
28442996021,11cyclictest25080-21ssh21:33:192
28442996019,13cyclictest21207-21sh23:37:142
2844099607,46cyclictest0-21swapper/000:25:410
2844099606,41cyclictest0-21swapper/022:50:230
2844099604,44cyclictest32664-21awk22:25:340
2844099601,7cyclictest31870-21munin-run22:25:130
2844099601,43cyclictest7520-21ntp_kernel_err19:40:340
139982600,2sleep339-21ksoftirqd/321:19:183
28442995927,17cyclictest3908-21netstat19:30:342
28442995927,12cyclictest15573-21rm22:45:382
28442995921,20cyclictest7950irq/56-dwc_otg_21:57:292
28442995919,14cyclictest22470-21/usr/sbin/munin22:55:312
2844099593,47cyclictest0-21swapper/023:45:340
2844099592,12cyclictest3342-21chrt19:30:270
2844299585,13cyclictest7950irq/56-dwc_otg_23:55:272
28442995829,12cyclictest17548-21/usr/sbin/munin00:15:432
28442995824,13cyclictest31867-21chrt23:51:032
28442995821,23cyclictest16893-21awk23:30:482
28442995821,19cyclictest7950irq/56-dwc_otg_22:00:362
28442995821,12cyclictest16664-21/usr/sbin/munin20:05:362
28442995818,13cyclictest29845-21ssh00:35:322
2844199583,10cyclictest7850irq/56-dwc_otg_21:10:241
2844099588,40cyclictest0-21swapper/021:14:070
2844099585,43cyclictest0-21swapper/000:02:130
28440995815,40cyclictest101ktimersoftd/021:46:420
28440995815,40cyclictest101ktimersoftd/021:46:420
2844099581,52cyclictest0-21swapper/021:50:200
2844099581,44cyclictest1709-21grep19:25:290
2844099581,44cyclictest1709-21grep19:25:290
2844099581,24cyclictest7950irq/56-dwc_otg_23:20:260
28440995812,43cyclictest101ktimersoftd/020:30:300
28442995734,18cyclictest0-21swapper/219:10:152
28442995726,11cyclictest26830-21apt-get20:35:252
28442995718,12cyclictest6265-21taskset19:35:522
2844099573,43cyclictest18054-21rm22:49:580
28440995713,40cyclictest101ktimersoftd/000:15:410
28440995711,23cyclictest0-21swapper/022:15:270
2844299567,17cyclictest0-21swapper/222:15:252
28442995627,12cyclictest458-21ssh22:25:382
28442995620,13cyclictest14365-21cat20:00:302
28442995620,13cyclictest14365-21cat20:00:302
28442995618,14cyclictest10610-21chrt23:23:052
2844099568,4cyclictest31609-21tail23:50:410
2844099567,41cyclictest0-21swapper/020:00:310
2844099567,41cyclictest0-21swapper/020:00:310
2844099567,39cyclictest17195-21taskset23:31:270
2844099561,41cyclictest22918-21sshd20:24:380
2844099560,43cyclictest0-21swapper/023:59:080
28442995527,12cyclictest3383-21ssh21:46:422
28442995527,12cyclictest3383-21ssh21:46:422
28442995521,12cyclictest5437-21ntp_states23:15:372
28442995518,22cyclictest7850irq/56-dwc_otg_19:25:142
2844099557,33cyclictest30022-21grep00:35:350
2844099556,34cyclictest18287-21sed22:05:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional