You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 07:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Thu Apr 16, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
325042237163,25sleep00-21swapper/019:08:020
323512235163,24sleep20-21swapper/219:06:022
324772227153,24sleep30-21swapper/319:07:403
323072200163,24sleep10-21swapper/119:05:301
2744721730,4sleep33275899cyclictest20:10:003
2785921510,3sleep13274799cyclictest23:50:141
2785921510,3sleep13274799cyclictest23:50:141
32754998481,2cyclictest0-21swapper/223:14:472
28092420,1sleep30-21swapper/300:05:223
3274299389,13cyclictest19872-21munin-run22:20:020
3275899373,25cyclictest3058-21cut22:55:013
3275899368,17cyclictest1-21systemd00:10:163
3275899357,17cyclictest19515-21netstat23:30:193
3275899341,25cyclictest0-21swapper/300:27:003
3274299348,12cyclictest4495-21idleruntime-cro21:45:010
3275899337,11cyclictest25225-21crond20:05:003
32758993320,8cyclictest24203-40dnf22:29:243
32758993214,10cyclictest15972-21taskset23:23:403
32758993211,10cyclictest8814-21cat23:05:253
3274799321,20cyclictest12112-21irqstats22:00:171
3275899314,12cyclictest14775-21cpu00:35:123
32747993113,16cyclictest13977-21kworker/u8:121:07:441
32742993113,7cyclictest14075-21grep22:05:150
3275899304,14cyclictest774-21avahi-daemon19:15:023
3275899304,13cyclictest9731-21grep21:55:153
3275899304,13cyclictest30180-21taskset21:29:223
3275899297,7cyclictest1318-21awk00:05:023
3275899295,13cyclictest29855-21/usr/sbin/munin20:15:253
3275899293,19cyclictest15332-21kworker/u8:122:11:453
32758992910,11cyclictest7246-21df_inode21:50:123
3274799291,12cyclictest12068-21kworker/u8:200:29:521
3275899287,7cyclictest18629-21latency_hist19:50:013
3275899287,18cyclictest12432-21sed22:00:213
3275899287,10cyclictest1359-21ntp_states21:35:203
3275899287,10cyclictest1359-21ntp_states21:35:203
3275899286,14cyclictest26083-21users22:30:263
3275899286,13cyclictest18261-21sed21:00:203
3275899285,15cyclictest29622-21latency_hist20:15:003
3275899282,7cyclictest0-21swapper/322:23:303
3275899278,5cyclictest8391-21expr00:20:123
3275899277,5cyclictest13379-21irqstats00:30:193
3275899276,12cyclictest6932-21cat00:15:173
3275899275,6cyclictest87350irq/126-enp1s0-20:50:153
3275899275,4cyclictest31422-21df_inode22:45:133
3275899275,14cyclictest30719-21rt-features23:55:233
3275899274,12cyclictest19806-21cstates21:05:143
3275899274,10cyclictest30104-21kworker/u8:022:07:383
3275899272,21cyclictest21448-21diskmemload23:50:123
3275899272,21cyclictest21448-21diskmemload23:50:123
3275899271,10cyclictest0-21swapper/322:16:493
32758992710,5cyclictest25839-21latency_hist21:20:013
3274799270,19cyclictest23-21ksoftirqd/121:40:111
3274299273,8cyclictest81ktimersoftd/023:10:160
3274299272,13cyclictest2272-21kworker/0:221:45:580
32742992710,4cyclictest13492-21kworker/0:222:29:260
165162270,4sleep19-21rcu_preempt20:55:251
3275899269,6cyclictest25167-21egrep23:45:123
3275899267,6cyclictest6073-21perf20:35:003
3275899267,16cyclictest27758-21ntp_states22:35:203
3275899263,12cyclictest3578-21ntp_states21:40:203
3275899262,14cyclictest1661-21sh20:25:003
3274799269,4cyclictest221ktimersoftd/100:05:231
3274299267,16cyclictest7949-21munin-run00:20:020
3274299267,16cyclictest18288-40dnf23:30:000
3274299261,13cyclictest14538-21munin-run00:35:010
3274299261,13cyclictest12660-21munin-run20:50:010
64892250,4sleep3401ktimersoftd/319:20:173
3275899255,17cyclictest22749-21ntp_states21:10:213
3275899255,12cyclictest0-21swapper/321:45:113
3275899253,8cyclictest9727-21/usr/sbin/munin23:10:253
3275899252,7cyclictest0-21swapper/322:56:003
3275899251,7cyclictest0-21swapper/323:28:053
3275899251,22cyclictest2873-21kworker/u8:023:00:163
32758992510,3cyclictest23972-21ntpq23:40:203
3275499251,5cyclictest0-21swapper/223:50:182
3275499251,5cyclictest0-21swapper/223:50:182
3274799251,18cyclictest23-21ksoftirqd/121:10:111
3274799251,16cyclictest23-21ksoftirqd/122:25:111
3274799251,16cyclictest14930-21/usr/sbin/munin23:20:161
32747992511,12cyclictest9375-21kworker/u8:023:08:461
3274299252,8cyclictest14118-21/usr/sbin/munin23:20:160
3275899247,7cyclictest26094-21cpu21:20:123
3275899245,9cyclictest1-21systemd23:15:153
3275899244,16cyclictest484-21/usr/sbin/munin19:10:123
3275899244,16cyclictest484-21/usr/sbin/munin19:10:113
3275899243,6cyclictest10453-21latency_hist20:45:013
3275899241,7cyclictest14462-21/usr/sbin/munin19:40:243
3275899241,12cyclictest0-21swapper/323:35:133
3274799249,13cyclictest11744-21kworker/u8:219:43:451
3274799245,5cyclictest87550irq/128-enp1s0-22:45:161
3274799244,5cyclictest87550irq/128-enp1s0-00:30:261
3274799241,21cyclictest0-21swapper/122:14:461
3274299249,12cyclictest17062-21idleruntime-cro21:00:010
3274299245,8cyclictest29855-21/usr/sbin/munin20:15:230
3274299242,14cyclictest11988-21kworker/0:000:25:580
3274299241,12cyclictest0-21swapper/021:35:230
3274299241,12cyclictest0-21swapper/021:35:230
32758992314,6cyclictest12618-21diskstats19:35:133
32758992312,6cyclictest827-21runrttasks19:28:153
3275899230,13cyclictest0-21swapper/320:25:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional