You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-09 - 20:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Thu Apr 09, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
253192239164,24sleep10-21swapper/107:06:311
254602233162,58sleep30-21swapper/307:08:233
252672203165,25sleep00-21swapper/007:05:510
253102201164,24sleep20-21swapper/207:06:252
1288721710,4sleep32568699cyclictest10:20:023
1288721710,4sleep32568699cyclictest10:20:023
1028421310,3sleep12567599cyclictest07:45:161
25681999693,2cyclictest0-21swapper/209:17:222
23952660,1sleep10-21swapper/108:40:191
25681995343,9cyclictest0-21swapper/211:06:022
2568699388,4cyclictest0-21swapper/311:30:143
2568699388,4cyclictest0-21swapper/311:30:143
2568699383,6cyclictest20624-40dnf09:20:453
2568699381,11cyclictest26214-21/usr/sbin/munin10:50:243
2566999379,13cyclictest20367-21awk08:10:010
25686993612,3cyclictest4227-21/usr/sbin/munin10:00:263
2568699361,11cyclictest29039-21/usr/sbin/munin12:10:243
2568699361,11cyclictest2659-21/usr/sbin/munin11:10:223
2567599366,18cyclictest0-21swapper/109:40:591
2567599362,22cyclictest0-21swapper/112:21:521
2568699345,3cyclictest87350irq/126-enp1s0-07:40:143
25686993412,3cyclictest29375-21/usr/sbin/munin08:30:223
25686993411,3cyclictest13642-21/usr/sbin/munin11:35:183
2568699340,9cyclictest8385-21kworker/u8:210:10:243
2568699332,9cyclictest7247-21irqstats10:05:183
25686993314,16cyclictest26293-21fschecks_count07:10:143
2568699331,10cyclictest15363-21kworker/u8:111:50:263
2566999338,12cyclictest8423-21idleruntime-cro10:10:010
2568699329,3cyclictest15458-21grep07:55:323
2568699329,3cyclictest0-21swapper/309:45:233
2568699326,6cyclictest0-21swapper/311:26:073
2568699326,3cyclictest87350irq/126-enp1s0-10:45:163
2568699325,3cyclictest1391-21/usr/sbin/munin08:40:213
2568699324,8cyclictest808-21snmpd12:21:533
2568699321,3cyclictest19388-21latency_hist10:35:023
25686993212,2cyclictest7818-21if_err_enp1s011:20:153
25686993210,3cyclictest26535-21sed08:20:253
2568699319,3cyclictest23147-21grep08:15:153
2568699319,2cyclictest827-21runrttasks08:11:273
2568699318,4cyclictest3761-21cpuspeed_turbos08:45:113
2568699318,3cyclictest25598-21/usr/sbin/munin09:35:223
2568699312,5cyclictest29998-21users10:55:233
2568699311,7cyclictest491-21sshd12:16:513
25686993112,3cyclictest29793-21nfs4_client07:15:183
25686993111,3cyclictest6529-21ntp_offset12:30:213
2568699311,12cyclictest5195-21/usr/sbin/munin07:35:213
2568699311,11cyclictest31647-21kworker/u8:010:20:113
2568699311,11cyclictest18038-21/usr/sbin/munin11:45:143
25686993110,3cyclictest827-21runrttasks09:53:213
25686993110,3cyclictest20545-21cat08:10:023
2568699309,3cyclictest827-21runrttasks10:44:093
2568699309,3cyclictest27796-21/usr/sbin/munin09:40:223
2568699309,3cyclictest19888-21expr10:35:133
2568699301,4cyclictest18614-21seq09:18:053
25686993010,3cyclictest15448-21cat10:25:133
2568199309,3cyclictest0-21swapper/207:56:372
2566999306,12cyclictest22564-21awk08:15:020
2568699299,3cyclictest25971-21threads12:00:233
2568699298,4cyclictest15837-21sendmail_mailqu09:10:233
2568699294,4cyclictest15363-21kworker/u8:112:05:143
2568699293,3cyclictest0-21swapper/311:57:243
2568699292,10cyclictest18156-21latency_hist08:05:023
2568699291,4cyclictest810-21sshd12:27:503
2568699291,11cyclictest2624-21head09:55:153
25686992910,3cyclictest931-21expr07:25:113
25686992910,3cyclictest7672-21/usr/sbin/munin12:35:123
25686992910,3cyclictest5921-21ntpq11:15:203
25686992910,3cyclictest32276-21basename08:35:153
2567599292,20cyclictest0-21swapper/110:39:421
2567599292,20cyclictest0-21swapper/110:05:301
2567599291,22cyclictest0-21swapper/108:19:431
56672280,4sleep011-21rcuc/012:30:130
2568699289,2cyclictest4443-21sed07:30:243
2568699288,3cyclictest827-21runrttasks09:26:243
2568699288,3cyclictest11878-21cpuspeed_turbos07:50:123
2568699288,3cyclictest11878-21cpuspeed_turbos07:50:123
2568699287,4cyclictest31425-21tune2fs07:20:143
2568699285,4cyclictest790-21in:imjournal08:50:493
2568699281,14cyclictest0-21swapper/307:45:103
2568699281,10cyclictest32076-21/usr/sbin/munin11:00:253
25675992824,3cyclictest0-21swapper/112:31:141
2567599281,21cyclictest0-21swapper/111:33:161
2567599281,21cyclictest0-21swapper/111:33:161
2567599281,21cyclictest0-21swapper/108:57:491
2567599281,21cyclictest0-21swapper/108:39:311
2567599281,21cyclictest0-21swapper/108:12:021
2567599281,21cyclictest0-21swapper/107:13:341
2567599281,20cyclictest0-21swapper/112:17:551
25686992711,3cyclictest12547-21cpuspeed_turbos09:05:123
25686992710,3cyclictest23482-21cpuspeed_turbos09:30:113
2568699270,2cyclictest87350irq/126-enp1s0-11:40:143
2568699270,2cyclictest0-21swapper/309:03:503
25675992723,3cyclictest0-21swapper/111:54:251
2567599272,11cyclictest2286-21expr09:55:111
2567599271,22cyclictest23500-21tr09:30:111
2567599271,20cyclictest0-21swapper/110:15:261
2567599271,20cyclictest0-21swapper/110:15:261
2567599271,20cyclictest0-21swapper/108:49:451
2567599270,21cyclictest0-21swapper/110:27:551
2568699262,9cyclictest1597-21pmu-power11:05:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional