You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-11 - 06:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot7s.osadl.org (updated Tue Nov 11, 2025 00:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7675224382199,97sleep00-21swapper19:08:370
78779916014,56cyclictest10229-21munin-run22:40:030
78779915931,23cyclictest11405-1kworker/u3:519:30:200
78779915815,100cyclictest22787-21irqstats23:55:390
78779915810,124cyclictest3622-21grep21:56:010
78779915718,25cyclictest8899-21df_inode19:15:150
78779915718,113cyclictest24338-21df_inode00:05:290
78779915715,27cyclictest20600-21/usr/sbin/munin23:41:490
78779915712,123cyclictest24928-21apt-get00:11:180
78779915621,26cyclictest2399-21diskstats21:50:370
78779915618,40cyclictest26977-21munin-run00:20:010
78779915615,118cyclictest16521-21munin-run20:00:030
78779915513,103cyclictest16715-21cstates20:00:240
78779915433,84cyclictest10716-21proc_pri22:40:560
78779915413,115cyclictest10848-21apt-get19:25:270
78779915410,27cyclictest4490-21ls22:01:020
78779915317,23cyclictest7012-21munin-run22:20:030
78779915317,109cyclictest11146-21apt-get22:45:150
78779915316,112cyclictest28169-21ntp_kernel_pll_21:10:470
78779915315,46cyclictest28793-21diskstats00:30:320
78779915315,25cyclictest8734-21munin-node19:15:080
78779915315,114cyclictest19877-21munin-run23:40:060
78779915313,26cyclictest16658-21modprobe23:20:010
78779915313,24cyclictest18750-21grep23:30:540
78779915313,22cyclictest5497-21/usr/sbin/munin22:10:380
78779915311,30cyclictest112-21systemd-journal19:25:010
78779915310,121cyclictest18851-21grep20:11:040
78779915242,23cyclictest12356-21processes22:51:000
78779915235,22cyclictest18323-21latency_hist23:30:040
78779915219,29cyclictest4816-21diskstats22:05:330
78779915215,113cyclictest1067-21grep21:41:040
78779915214,115cyclictest31163-21apt-get21:30:290
78779915214,100cyclictest31863-21snmpd19:52:400
78779915212,29cyclictest30125-21head21:21:050
78779915212,115cyclictest27511-21/usr/sbin/munin00:21:070
78779915211,100cyclictest26165-21munin-run21:00:010
78779915132,21cyclictest21319-21ntpq23:45:570
78779915116,36cyclictest30301-21apt-get21:25:230
78779915115,24cyclictest1591-21df21:45:280
78779915114,113cyclictest24846-21grep20:50:420
78779915112,25cyclictest27450-21ps21:05:560
78779915017,23cyclictest21625-21irqstats20:30:400
78779915017,20cyclictest32024-21apt-get21:36:010
78779915014,113cyclictest14534-21irqstats23:05:400
78779915011,115cyclictest15407-21wc23:10:470
78779915011,114cyclictest19861-21/usr/sbin/munin20:20:530
78779915010,99cyclictest26872-21timerwakeupswit21:01:030
7877991499,24cyclictest9150-21grep22:30:580
78779914932,20cyclictest0-21swapper23:50:250
78779914930,98cyclictest12919-21kernelversion22:55:420
78779914917,27cyclictest12605-21apt-get19:35:180
78779914915,23cyclictest22423-21irqstats20:35:390
78779914834,96cyclictest112-21systemd-journal23:02:400
78779914831,19cyclictest16960-21irqstats23:20:400
78779914826,20cyclictest0-21swapper21:15:500
78779914813,25cyclictest28062-21irqstats00:25:390
7877991479,116cyclictest8361-21sendmail_mailqu22:26:000
78779914731,92cyclictest24043-21irqstats20:45:400
78779914715,109cyclictest7827-21munin-run22:25:020
78779914712,25cyclictest24080-21head00:01:050
78779914711,27cyclictest21332-21sshd20:26:400
78779914711,112cyclictest23507-21/usr/sbin/munin20:40:580
78779914614,109cyclictest14222-21/usr/sbin/munin19:46:080
78779914510,112cyclictest13639-21ls19:40:420
78779914415,103cyclictest19031-21apt-get20:15:140
78779914414,26cyclictest18178-21latency_hist20:10:040
78779914217,24cyclictest29583-21df00:35:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional