You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 08:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Sat Dec 06, 2025 00:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16769552940,4sleep10-21swapper/120:55:151
17144702830,5chrt0-21swapper/022:40:310
17517402770,7sleep30-21swapper/300:25:343
163905427344,23sleep00-21swapper/019:07:240
163939699672,45cyclictest1753-21gnome-shell21:05:173
163891826739,22sleep10-21swapper/119:05:411
163820726640,20sleep30-21swapper/319:05:183
163939699652,42cyclictest1753-21gnome-shell22:15:053
163939699651,32cyclictest1673600-21cat20:45:123
163890726546,13sleep20-21swapper/219:05:342
1639396996429,31cyclictest1753-21gnome-shell21:36:453
163939699642,43cyclictest1753-21gnome-shell22:38:583
163939699631,37cyclictest1701884-21/usr/sbin/munin22:05:203
163939699631,36cyclictest1752492-21cat00:30:163
163939699631,35cyclictest860997-21snmpd20:16:153
162399630,9rtkit-daemon1622-21rtkit-daemon21:18:131
163939699622,44cyclictest1753-21gnome-shell21:50:553
163939699622,33cyclictest1753-21gnome-shell20:26:253
163939699621,37cyclictest969-21sshd20:44:403
163939699615,28cyclictest1617-10pipewire-media-23:05:123
163939699611,33cyclictest860997-21snmpd00:00:353
163939699602,33cyclictest1753-21gnome-shell21:20:223
163939699602,33cyclictest1753-21gnome-shell19:45:033
163939699602,31cyclictest1690473-21chrt21:34:493
163939699602,29cyclictest1753-21gnome-shell20:00:303
163939699601,33cyclictest1679835-21taskset21:02:203
163939699601,33cyclictest1679835-21taskset21:02:203
163939699601,32cyclictest854-21avahi-daemon21:15:023
163939699592,32cyclictest1753-21gnome-shell21:10:033
163939699592,30cyclictest1747785-21memory00:15:233
163939699592,30cyclictest1747785-21memory00:15:223
163939699592,29cyclictest1753-21gnome-shell19:15:003
163939699591,39cyclictest0-21swapper/319:55:393
163939699591,35cyclictest1728354-21sed23:20:243
163939699582,39cyclictest1753-21gnome-shell00:12:433
163939699582,33cyclictest854-21avahi-daemon00:00:033
163939699582,33cyclictest854-21avahi-daemon00:00:033
163939699582,30cyclictest1753-21gnome-shell23:10:103
163939699581,32cyclictest1730713-21taskset23:26:423
163939699581,32cyclictest1730713-21taskset23:26:413
163939699581,32cyclictest1688596-21taskset21:28:003
163939699581,31cyclictest860997-21snmpd00:07:323
1639396995811,42cyclictest1753-21gnome-shell23:01:163
163939699572,31cyclictest1753-21gnome-shell21:47:443
163939699572,30cyclictest1753-21gnome-shell23:46:173
163939699572,30cyclictest1753-21gnome-shell22:34:183
163939699572,25cyclictest16983682grep21:55:233
163939699571,34cyclictest1719875-21/usr/sbin/munin22:55:263
163939699571,34cyclictest1069-21runrttasks00:35:233
163939699571,34cyclictest1069-21runrttasks00:35:223
163939699571,30cyclictest1649986-21taskset19:37:073
1639388995720,12cyclictest1744744-21cat00:05:351
163939699562,29cyclictest1753-21gnome-shell22:10:363
163939699562,29cyclictest1753-21gnome-shell20:06:563
163939699552,29cyclictest1753-21gnome-shell20:10:063
163938899552,9cyclictest2181-21gdbus22:50:001
163939699542,27cyclictest1753-21gnome-shell20:52:573
163938899542,25cyclictest1668557-21/usr/sbin/munin20:30:181
1639388995417,11cyclictest1736971-21cat23:45:161
1639388995416,11cyclictest1726972-21sed23:15:311
1639388995416,11cyclictest1656343-21needreboot19:55:221
1639388995413,7cyclictest0-21swapper/100:15:011
163939699532,29cyclictest1753-21gnome-shell22:28:203
163939699532,28cyclictest1753-21gnome-shell19:43:173
163939699531,48cyclictest1665899-21sshd20:21:313
163938899532,15cyclictest1753288-21python300:30:301
162399530,8rtkit-daemon1622-21rtkit-daemon19:57:310
17487672520,7sleep22197014-21PK-Backend00:20:032
17487672520,7sleep22197014-21PK-Backend00:20:032
163939699522,27cyclictest1753-21gnome-shell00:22:343
1639396995221,25cyclictest1700894-21apt-get22:05:023
1639396995221,25cyclictest1700894-21apt-get22:05:013
163939699521,27cyclictest1678540-21latency_hist21:00:023
1639388995216,11cyclictest1693456-21grep21:40:291
1639388995216,10cyclictest1674662-21seq20:47:401
1639388995214,12cyclictest1646058-21awk19:25:251
163939699511,35cyclictest175350gnome-shell23:15:203
163938899511,11cyclictest1655432-21apt19:55:011
1639396995018,28cyclictest1734784-21basename23:40:013
1639396995018,28cyclictest1734784-21basename23:40:003
1639388995019,9cyclictest26-21ksoftirqd/100:17:401
1639388995019,9cyclictest26-21ksoftirqd/100:17:401
1639388995019,11cyclictest1707423-21ntpq22:20:271
1639388995016,11cyclictest1643772-21expr19:20:141
1639388995014,11cyclictest1710582-21seq22:30:211
1639388995014,11cyclictest1663941-21timerandwakeup20:15:301
163938899501,25cyclictest3242255-21gdbus23:45:011
1639396994920,24cyclictest1654740-21open_inodes19:50:273
163939699491,32cyclictest1708263-21cat22:25:023
1639388994917,9cyclictest1699794-21expr22:00:151
1639388994917,9cyclictest1699794-21expr22:00:141
1639388994913,12cyclictest1754152-21apt00:35:141
1639388994913,12cyclictest1754152-21apt00:35:131
162399490,40rtkit-daemon1506-21systemd19:10:260
16668582480,13sleep2331rcuc/220:25:222
163938899482,21cyclictest1652591-21df19:45:161
1639388994818,12cyclictest1690305-21sshd21:32:401
1639388994817,9cyclictest1739127-21missed_timers23:50:211
1639388994817,9cyclictest1739127-21missed_timers23:50:211
1639388994815,10cyclictest1672709-21grep20:40:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional