You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-13 - 19:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Thu Nov 13, 2025 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
197562241164,24sleep30-21swapper/307:08:483
196552239163,24sleep10-21swapper/107:07:291
178912236164,59sleep20-21swapper/207:05:092
195192235163,60sleep00-21swapper/007:05:430
2039321750,5sleep01994099cyclictest08:20:220
2735821480,4sleep01994099cyclictest08:35:270
19950991140,112cyclictest0-21swapper/210:19:312
305412710,3sleep3401ktimersoftd/311:10:223
210422710,3sleep10-21swapper/109:35:261
118912640,4sleep01994099cyclictest11:40:250
19950996258,3cyclictest0-21swapper/211:51:412
310692520,4sleep339-21rcuc/310:00:133
251822470,3sleep121-21rcuc/107:20:021
19950994642,3cyclictest0-21swapper/211:26:592
322922330,4sleep230-21rcuc/207:35:172
1994699331,13cyclictest0-21swapper/110:35:011
19950993228,3cyclictest0-21swapper/208:01:162
1994699321,15cyclictest24846-21swap12:10:251
1994699311,14cyclictest496-21jbd2/dm-0-812:00:491
1994699311,14cyclictest14346-21awk09:20:211
1994099311,14cyclictest29957-21munin-run12:25:010
19946993013,3cyclictest29577-21grep08:40:271
1994099305,12cyclictest15274-21munin-run09:25:010
1994099301,13cyclictest7953-21munin-run11:35:010
1994699291,11cyclictest904-21/usr/sbin/munin12:30:191
1995799281,8cyclictest10415-21grep09:10:253
1994699281,6cyclictest0-21swapper/109:10:311
1994699281,19cyclictest0-21swapper/109:15:291
1994699280,7cyclictest0-21swapper/109:04:551
1994099283,12cyclictest11528-21basename10:30:020
1994099281,12cyclictest25652-21idleruntime-cro08:35:010
1995799274,12cyclictest16627-40dnf11:53:483
1994099271,14cyclictest4188-21munin-run12:40:010
19940992710,7cyclictest0-21swapper/009:50:180
1994099270,12cyclictest2002-21awk12:35:010
268052260,5sleep29-21rcu_preempt07:20:272
1994699266,4cyclictest0-21swapper/108:48:491
1994099260,12cyclictest4278-21awk09:00:000
1995799250,5cyclictest848-21sssd_nss09:50:163
1995099251,7cyclictest16044-21cat10:40:012
1994699259,8cyclictest0-21swapper/107:33:091
1994699259,2cyclictest0-21swapper/108:10:231
1994699253,10cyclictest0-21swapper/111:59:361
1994699251,9cyclictest0-21swapper/109:26:511
1994699251,7cyclictest8676-21diskmemload12:37:231
1994699251,16cyclictest0-21swapper/109:05:251
1994699251,10cyclictest0-21swapper/112:06:111
1994699251,10cyclictest0-21swapper/109:54:091
1994699250,11cyclictest0-21swapper/110:46:471
1994099251,12cyclictest23435-21munin-run08:30:010
1995799241,10cyclictest12649-21/usr/sbin/munin10:30:213
1995099247,4cyclictest25642-21perf08:35:022
1994699248,2cyclictest0-21swapper/111:05:171
1994699241,14cyclictest0-21swapper/110:24:231
1994699241,10cyclictest8676-21diskmemload10:15:331
1994699240,5cyclictest0-21swapper/109:30:271
1995799238,2cyclictest845-21grep11:15:263
1995799237,7cyclictest86550irq/126-enp1s0-12:15:133
1995799231,11cyclictest0-21swapper/311:29:403
1995799231,10cyclictest8676-21diskmemload09:15:253
1994699238,3cyclictest0-21swapper/111:02:451
1994699238,3cyclictest0-21swapper/110:10:371
1994699238,3cyclictest0-21swapper/110:10:371
1994699237,4cyclictest13699-21ls11:45:231
1994699235,3cyclictest0-21swapper/111:51:271
1994699233,3cyclictest0-21swapper/110:02:111
1994699231,3cyclictest23052-21users08:25:271
1994699231,3cyclictest0-21swapper/110:55:151
1994699231,21cyclictest0-21swapper/108:39:451
1994699231,16cyclictest0-21swapper/111:20:541
1994699231,11cyclictest0-21swapper/108:33:111
1994699231,11cyclictest0-21swapper/107:51:311
1994699231,10cyclictest28325-21diskstats12:20:111
1994699231,10cyclictest0-21swapper/107:21:011
1994099234,16cyclictest10234-21munin-run08:00:000
150592230,4sleep121-21rcuc/110:35:231
1995799226,6cyclictest0-21swapper/312:14:343
19957992216,4cyclictest15494-21grep08:10:163
1995799221,13cyclictest0-21swapper/312:28:093
1995799220,10cyclictest0-21swapper/311:46:553
1995799220,10cyclictest0-21swapper/310:57:333
1995099226,4cyclictest23848-21pmu-power10:55:242
1995099221,6cyclictest659-21/usr/sbin/munin10:05:152
1994699228,2cyclictest0-21swapper/108:50:131
1994699226,4cyclictest0-21swapper/109:40:451
1994699221,9cyclictest0-21swapper/108:06:311
1994699221,19cyclictest0-21swapper/111:44:591
1994699221,19cyclictest0-21swapper/108:15:221
1994699221,18cyclictest0-21swapper/110:05:141
1994699221,14cyclictest0-21swapper/110:50:021
1994699221,12cyclictest0-21swapper/111:19:231
1994699221,11cyclictest0-21swapper/112:26:511
1994099221,11cyclictest0-21swapper/009:50:000
1995799216,5cyclictest0-21swapper/310:38:043
1995799215,7cyclictest86550irq/126-enp1s0-09:10:003
1995799213,10cyclictest2214-21/usr/sbin/munin12:35:263
1995799211,16cyclictest1335-21grep10:05:193
1995799211,11cyclictest23665-21/usr/sbin/munin08:30:163
1995799210,9cyclictest0-21swapper/309:56:253
1995799210,8cyclictest0-21swapper/311:43:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional