You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 13:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Thu Dec 25, 2025 00:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
285507622650,9sleep00-21swapper/019:05:120
197399920,4rtkit-daemon4497-21PK-Backend00:19:191
29050862910,5sleep10-21swapper/121:25:131
197399900,24rtkit-daemon0-21swapper/019:18:220
197399900,24rtkit-daemon0-21swapper/019:18:210
2856431997816,35cyclictest2960894-21cat00:05:012
2856431997816,35cyclictest2960894-21cat00:05:012
2856431997610,37cyclictest2968922-21missed_timers00:25:222
197399750,60rtkit-daemon0-21swapper/119:05:051
2856431997414,41cyclictest2893038-21ntp_kernel_err20:50:252
2856431997414,41cyclictest2893038-21ntp_kernel_err20:50:252
2856431997019,31cyclictest1137-21runrttasks21:39:572
2856431997019,31cyclictest1137-21runrttasks21:39:572
197399670,9rtkit-daemon1972-21rtkit-daemon23:52:441
197399670,9rtkit-daemon1972-21rtkit-daemon00:35:011
285642299650,61cyclictest1972-21rtkit-daemon23:55:290
285605426546,13sleep20-21swapper/219:07:452
29494602640,5sleep00-21swapper/023:30:280
285589326343,14sleep30-21swapper/319:05:403
197399610,9rtkit-daemon1972-21rtkit-daemon21:56:391
197399600,9rtkit-daemon1972-21rtkit-daemon22:03:041
197399600,9rtkit-daemon1972-21rtkit-daemon21:52:590
2856431995920,34cyclictest2921080-21cat22:10:222
197399590,8rtkit-daemon1972-21rtkit-daemon22:40:271
285643199582,33cyclictest0-21swapper/219:30:122
2856431995817,36cyclictest2923952-21expr22:20:132
2856431995814,39cyclictest2920245-21cat22:10:012
197399580,9rtkit-daemon1972-21rtkit-daemon23:56:121
197399580,9rtkit-daemon1972-21rtkit-daemon23:51:210
197399580,9rtkit-daemon1972-21rtkit-daemon21:23:131
197399580,8rtkit-daemon1972-21rtkit-daemon23:21:183
2856431995719,33cyclictest2959269-21date00:00:022
197399570,8rtkit-daemon1972-21rtkit-daemon23:25:170
2856441995617,35cyclictest2920105-21unin-run22:10:003
2856431995619,32cyclictest2963441-21sh00:10:162
2856431995616,36cyclictest2858468-21ls19:15:022
2856431995616,36cyclictest2858468-21ls19:15:022
197399560,9rtkit-daemon1972-21rtkit-daemon23:41:341
197399560,8rtkit-daemon1972-21rtkit-daemon21:04:161
197399560,10rtkit-daemon1972-21rtkit-daemon23:06:093
2856441995520,30cyclictest2859090-21/usr/sbin/munin19:15:123
2856441995520,30cyclictest2859090-21/usr/sbin/munin19:15:113
2856431995518,32cyclictest2894650-21expr20:55:232
197399550,9rtkit-daemon1972-21rtkit-daemon20:15:483
2856441995418,11cyclictest2944022-21cat23:15:223
2856431995415,33cyclictest2938159-21cat23:00:142
2856431995412,37cyclictest2947444-21cat23:25:232
197399540,9rtkit-daemon1972-21rtkit-daemon21:39:021
197399540,9rtkit-daemon1972-21rtkit-daemon21:39:021
197399540,8rtkit-daemon1972-21rtkit-daemon21:41:540
2856441995328,21cyclictest2895513-21perf21:00:003
285643199531,9cyclictest2193-21gdbus21:59:572
2856431995317,31cyclictest2866697-21expr19:35:142
2856431995313,35cyclictest2885685-21cat20:30:152
2856431995313,34cyclictest2917102-21cat22:00:152
197399530,8rtkit-daemon1972-21rtkit-daemon23:24:051
2856441995214,12cyclictest2959923-21cat00:00:243
2856441995214,12cyclictest2959923-21cat00:00:243
2856431995213,34cyclictest2927927-21expr22:30:172
2856431995213,34cyclictest2897622-21cat21:05:132
2856431995212,35cyclictest2950278-21date23:35:022
197399520,44rtkit-daemon3692979-21snapd21:56:100
2856441995114,11cyclictest2913055-21seq21:49:153
2856441995114,11cyclictest2899746-21expr21:10:143
2856431995118,28cyclictest2913183-21date21:50:012
2856431995117,30cyclictest2858376-21munin-node19:15:062
2856431995117,30cyclictest2858376-21munin-node19:15:062
2856431995116,30cyclictest2922735-21needreboot22:15:222
2856431995115,31cyclictest2882170-21expr20:20:142
2856431995111,35cyclictest2931171-21tr22:40:132
285644199502,44cyclictest2938332-21diskstats23:00:163
285644199502,43cyclictest2933159-21hddtemp_smartct22:45:183
2856441995015,10cyclictest2882550-21cat20:20:213
2856441995014,10cyclictest2893586-21seq20:52:373
2856441995014,10cyclictest2893586-21seq20:52:373
2856441995013,11cyclictest2902670-21seq21:19:173
2856441995012,11cyclictest2954260-21cat23:45:183
285643199502,10cyclictest2863985-40lsb_release19:26:052
2856431995015,30cyclictest2878519-21cpu20:10:132
2856431995011,34cyclictest2961969-21wc00:05:292
2856441994920,8cyclictest2964245-40lsb_release00:11:063
2856441994919,11cyclictest2956735-21sed23:50:293
2856441994916,8cyclictest2966307-21perf00:20:003
2856441994914,11cyclictest2928541-21sort22:30:323
2856441994911,11cyclictest2920735-21awk22:10:173
2856431994917,29cyclictest4497-21PK-Backend20:26:112
2856431994917,29cyclictest4497-21PK-Backend20:26:112
2856431994915,30cyclictest2967191-21missed_timers00:20:212
2856431994915,30cyclictest2952192-21cpuspeed23:40:142
2856431994915,29cyclictest2871765-21ls19:50:132
2856431994910,35cyclictest2900491-21timerandwakeup21:10:302
2856422994916,10cyclictest13-21ksoftirqd/020:50:160
2856422994916,10cyclictest13-21ksoftirqd/020:50:150
197399490,42rtkit-daemon1051-21thermald22:35:211
285644199486,17cyclictest2864799-21cstates19:30:123
2856441994818,8cyclictest2926758-21grep22:25:283
2856441994817,6cyclictest2917094-21cstates22:00:153
2856441994813,10cyclictest2923327-21seq22:17:283
285644199481,12cyclictest2951625-21taskset23:37:283
285644199481,12cyclictest2951625-21taskset23:37:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional