You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 12:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack2slot7s.osadl.org (updated Fri Nov 21, 2025 00:39:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
334449995848,7cyclictest491530-21cups-browsed00:04:280
334451995646,7cyclictest392088-21cut21:40:012
334450995545,7cyclictest340441-21grep19:30:011
334449994739,5cyclictest504433-21netstat00:19:110
334449994632,11cyclictest370448-21true21:10:010
334449994614,28cyclictest398207-21ssh21:49:160
334449994614,28cyclictest398207-21ssh21:49:160
334450994530,10cyclictest490359-21needreboot23:59:111
334451994434,6cyclictest479017-21latency23:44:072
334450994437,4cyclictest413041-21latency_hist22:10:021
334450994435,6cyclictest405949-21grep22:00:011
334449994436,6cyclictest2667052-21cups-browsed22:19:160
334449994433,8cyclictest422-21dbus-daemon00:15:020
334451994334,6cyclictest956-21mta-sts-daemon00:09:212
334451994333,6cyclictest421-21avahi-daemon00:34:022
33445199433,28cyclictest2667052-21cups-browsed23:39:152
334450994334,6cyclictest422-21dbus-daemon21:55:011
334450994334,6cyclictest422-21dbus-daemon21:55:011
334450994333,4cyclictest0-21swapper/122:59:111
334451994234,5cyclictest418333-21aten_r2power_en22:19:012
334450994234,4cyclictest0-21swapper/123:20:011
334450994234,4cyclictest0-21swapper/123:20:011
334450994232,6cyclictest351486-21fschecks_time20:09:041
334449994235,4cyclictest450593-21needreboot23:04:090
334449994229,9cyclictest1-21systemd21:44:030
334449994229,9cyclictest1-21systemd21:44:030
334449994223,13cyclictest151ktimers/021:19:100
334451994133,5cyclictest426513-21unixbench_multi22:29:282
334451994133,5cyclictest337434-21munin-run19:20:012
33445199413,31cyclictest383473-21ssh21:28:472
334450994133,5cyclictest455179-21systemd-run23:10:021
334450994133,5cyclictest334471-21latency_hist19:10:021
334450994132,6cyclictest512102-21idleruntime-cro00:30:011
334450994132,5cyclictest475116-21aten_r2power_fr23:39:041
334450994132,5cyclictest395278-21unixbench_singl21:44:281
334450994132,5cyclictest395278-21unixbench_singl21:44:281
334449994135,4cyclictest367430-21sendmail21:00:010
334449994126,13cyclictest491397-21/usr/sbin/munin00:00:020
334451994033,3cyclictest0-21swapper/222:00:012
334451994030,7cyclictest2667052-21cups-browsed22:57:202
334450994032,5cyclictest515656-21latency_hist00:35:011
334450994032,3cyclictest0-21swapper/122:29:151
334450994024,12cyclictest271ktimers/120:34:181
334449994032,5cyclictest362958-21systemd-run20:45:020
334451993931,5cyclictest422-21dbus-daemon23:50:012
334451993930,6cyclictest439545-21fschecks_count22:49:062
334450993932,4cyclictest0-21swapper/100:39:121
334450993930,6cyclictest453-21systemd-logind00:20:011
334450993929,7cyclictest349464-21systemd-run20:00:021
334450993927,8cyclictest469704-21latency_hist23:30:021
334451993831,3cyclictest0-21swapper/223:15:172
334451993831,3cyclictest0-21swapper/223:15:172
334451993830,5cyclictest401787-21proc_pri21:54:222
334451993830,5cyclictest401787-21proc_pri21:54:222
334451993828,6cyclictest423344-21cron22:25:012
334450993830,5cyclictest392080-21ssh21:40:011
334450993830,5cyclictest1-21systemd19:20:011
33445099381,31cyclictest494181-21sh00:04:121
334449993828,7cyclictest415410-21needreboot22:14:140
334449993815,16cyclictest363909-21modprobe20:49:180
334451993729,3cyclictest0-21swapper/220:09:142
334451993727,4cyclictest0-21swapper/223:29:172
334451993721,5cyclictest171rcu_preempt21:12:002
33445199370,12cyclictest36-21ksoftirqd/219:34:122
33445199370,12cyclictest36-21ksoftirqd/219:34:122
33445099373,25cyclictest415478-21ssh22:14:161
33445099373,24cyclictest657-21snmpd21:14:131
334450993729,5cyclictest435868-21aten_r2power_vo22:44:021
334450993729,5cyclictest429691-21mailstats22:34:201
334450993729,5cyclictest399014-21cron21:50:001
334450993729,5cyclictest399014-21cron21:50:001
334450993729,5cyclictest335954-21systemd-run19:15:011
334450993727,6cyclictest266-21systemd-journal21:30:011
334450993725,9cyclictest478766-21cpuspeed23:44:021
334450993725,7cyclictest370428-21diskmemload00:09:101
334449993729,5cyclictest497558-21needreboot00:09:080
334449993728,6cyclictest421-21avahi-daemon00:37:220
334449993728,6cyclictest2667052-21cups-browsed22:30:210
334449993728,6cyclictest266-21systemd-journal21:15:010
334449993725,3cyclictest349466-21systemd20:00:020
334449993723,10cyclictest0-21swapper/020:20:010
33444999371,29cyclictest425988-21ssh22:29:170
33445199365,25cyclictest454383-21ssh23:09:222
334451993630,3cyclictest0-21swapper/221:20:022
334451993628,5cyclictest0-21swapper/221:00:012
334450993627,6cyclictest1-21systemd22:05:021
334450993627,5cyclictest0-21swapper/121:34:181
334449993630,3cyclictest385259-21kworker/u8:3-nfsiod22:45:020
334449993629,4cyclictest465992-21cut23:25:000
334449993629,4cyclictest465992-21cut23:25:000
334449993629,4cyclictest405560-21grep21:59:240
334449993626,7cyclictest359352-21ntp_kernel_pll_20:34:180
33445199355,25cyclictest433067-21grep22:39:202
33445199354,24cyclictest415497-21ssh22:14:172
334451993529,3cyclictest0-21swapper/223:25:012
334451993529,3cyclictest0-21swapper/223:25:012
334451993529,3cyclictest0-21swapper/223:04:062
334451993528,4cyclictest402509-21kworker/u8:1-rpciod22:01:172
334451993526,5cyclictest1-21systemd00:30:022
334451993523,3cyclictest171rcu_preempt20:39:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional