You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-06 - 18:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Thu Nov 06, 2025 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
86872239163,24sleep20-21swapper/207:09:302
86882234164,22sleep30-21swapper/307:09:313
84802212178,22sleep10-21swapper/107:06:471
83882202162,26sleep00-21swapper/007:05:380
2430621570,4sleep0881299cyclictest08:55:170
2374821570,2sleep0881299cyclictest11:20:250
2374821570,2sleep0881299cyclictest11:20:250
110232530,3sleep230-21rcuc/208:25:162
93092500,2sleep00-21swapper/007:10:150
48792490,1sleep3401ktimersoftd/308:10:243
265122460,1sleep00-21swapper/009:00:190
881299399,14cyclictest15187-21munin-run09:50:010
883199365,27cyclictest1-21systemd09:00:093
8831993511,3cyclictest29250-21/usr/sbin/munin11:35:253
883199344,18cyclictest780-21rngd07:56:113
883199342,28cyclictest10230-21tr12:05:123
8831993411,3cyclictest836-21runrttasks09:30:243
8831993411,3cyclictest18009-21ntp_states08:40:223
883199339,4cyclictest6400-21/usr/sbin/munin10:40:313
883199335,3cyclictest86550irq/126-enp1s0-07:45:203
883199331,4cyclictest0-21swapper/309:36:253
8831993314,16cyclictest16705-21grep11:05:183
8831993311,3cyclictest24643-21fschecks_count10:10:163
8831993311,2cyclictest31448-21/usr/sbin/munin11:40:183
8831993310,2cyclictest17034-21df12:20:143
883199329,3cyclictest19813-21/usr/sbin/munin10:00:243
883199328,4cyclictest0-21swapper/310:25:263
883199328,3cyclictest5937-21/usr/sbin/munin08:15:183
883199327,4cyclictest15780-21fschecks_count09:50:143
883199324,4cyclictest19653-21cut10:00:013
883199321,6cyclictest14634-21snmpd12:38:553
883199321,6cyclictest14499-21/usr/sbin/munin12:15:263
883199321,3cyclictest16656-40dnf08:39:313
883199321,12cyclictest25450-21tail11:25:163
883199318,3cyclictest10527-21ntp_states10:50:233
883199318,21cyclictest10999-21awk07:15:013
883199312,4cyclictest842-21lldpd09:41:213
883199311,5cyclictest0-21swapper/311:15:243
883199311,4cyclictest0-21swapper/310:05:153
8831993112,3cyclictest18507-21/usr/sbin/munin07:30:143
8831993111,17cyclictest27887-21grep07:50:143
883199311,10cyclictest14634-21snmpd09:48:213
89732300,5sleep3883199cyclictest12:00:223
883199309,4cyclictest8511-21smart_sda10:45:253
883199309,3cyclictest24765-21processes08:55:383
883199301,6cyclictest0-21swapper/310:35:203
883199301,5cyclictest0-21swapper/310:34:033
8831993012,3cyclictest27985-21unixbench_singl10:15:443
8831993012,3cyclictest27985-21unixbench_singl10:15:433
8831993012,3cyclictest18327-21ls11:10:133
883199301,12cyclictest7305-21sshd11:55:423
883199301,12cyclictest0-21swapper/308:33:493
8831993010,4cyclictest0-21swapper/311:45:143
8831993010,3cyclictest8368-21cat08:20:123
8831993010,3cyclictest5378-21netstat09:25:213
883199299,3cyclictest4113-21sshd09:24:423
883199299,3cyclictest20778-21cat07:35:133
883199299,3cyclictest17307-21netstat07:25:173
883199297,5cyclictest19537-21gltestperf12:25:153
883199297,5cyclictest19537-21gltestperf12:25:153
883199294,3cyclictest14634-21snmpd08:53:093
883199294,3cyclictest12050irq/123-ahci[0009:15:013
883199294,3cyclictest12050irq/123-ahci[0009:15:013
883199291,6cyclictest23974-21ntp_states07:40:213
883199291,4cyclictest0-21swapper/312:33:503
883199291,14cyclictest0-21swapper/309:15:493
8831992910,3cyclictest4615-21pmu-power11:50:233
8831992910,2cyclictest836-21runrttasks10:57:233
883199290,19cyclictest0-21swapper/308:25:493
883199284,16cyclictest780-21rngd07:18:353
883199281,5cyclictest29914-21diskmemload11:31:573
883199281,15cyclictest0-21swapper/308:46:473
8831992811,3cyclictest30004-21cat10:20:263
883199281,13cyclictest0-21swapper/308:09:413
883199281,13cyclictest0-21swapper/308:09:413
8831992810,3cyclictest24618-21latency_hist11:25:013
881299283,12cyclictest18282-21munin-run07:30:010
881299281,15cyclictest16713-21munin-run08:40:010
881299281,15cyclictest1308-21awk08:05:010
883199278,3cyclictest14272-21pluginstate12:15:013
883199272,12cyclictest28990-21grep09:05:243
883199271,5cyclictest29914-21diskmemload11:24:523
8831992710,3cyclictest15358-21sendmail_mailst07:20:253
881299273,10cyclictest4113-21sensors10:35:250
881299272,12cyclictest31471-21munin-run08:00:010
883199261,2cyclictest86850irq/129-enp1s0-11:00:143
883199261,11cyclictest0-21swapper/308:01:173
882099261,16cyclictest1292-21latency_hist08:05:011
881299263,11cyclictest5475-21perf11:55:010
881299263,11cyclictest14283-21perf12:15:010
882099251,16cyclictest16352-21sshd08:35:341
882099251,16cyclictest10197-21ps07:10:251
39802250,2sleep10-21swapper/108:10:141
882099248,14cyclictest23-21ksoftirqd/107:55:131
882099241,17cyclictest0-21swapper/111:25:541
882099241,17cyclictest0-21swapper/111:00:121
882599235,8cyclictest0-21swapper/209:25:172
882099237,4cyclictest0-21swapper/111:40:221
882099231,19cyclictest11044-21users10:50:271
882099230,18cyclictest0-21swapper/110:59:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional