You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 00:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Wed Nov 26, 2025 12:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
166472240163,25sleep00-21swapper/007:06:030
168732235160,24sleep30-21swapper/307:09:003
166442233164,56sleep20-21swapper/207:06:012
168332231157,25sleep10-21swapper/107:08:291
535021790,4sleep31705999cyclictest10:20:203
1162121550,2sleep01703899cyclictest09:20:230
51321430,4sleep21705299cyclictest11:25:022
1903921050,4sleep31705999cyclictest12:05:163
1705299103100,2cyclictest0-21swapper/210:05:542
292612670,4sleep339-21rcuc/307:35:133
292612670,4sleep339-21rcuc/307:35:133
22352650,4sleep32239-21unixbench_singl11:25:263
211192590,4sleep339-21rcuc/307:15:213
17052995249,2cyclictest0-21swapper/207:22:402
326302350,4sleep21705299cyclictest07:40:262
1703899329,11cyclictest18985-21perf09:40:010
1703899311,15cyclictest1052-21munin-run12:40:010
1703899306,11cyclictest22739-21munin-run08:35:000
238392280,3sleep223841-21proc_pri12:15:242
1704699275,10cyclictest780-21rngd09:05:161
1704699272,15cyclictest0-21swapper/111:05:331
17046992720,3cyclictest4212-21munin-run10:20:011
1703899271,13cyclictest2021-21idleruntime-cro10:15:010
1703899270,12cyclictest23375-21awk09:50:010
1703899270,12cyclictest23375-21awk09:50:010
1704699263,11cyclictest0-21swapper/111:23:001
1704699261,17cyclictest0-21swapper/108:50:231
1704699251,15cyclictest4850-21fschecks_count10:20:161
205382241,3sleep020810-21/usr/sbin/munin12:10:130
1705999242,3cyclictest12050irq/123-ahci[0011:00:003
1704699242,16cyclictest0-21swapper/108:26:071
1704699242,15cyclictest21-21rcuc/112:30:151
1704699241,20cyclictest20161-21df10:55:131
1704699241,17cyclictest0-21swapper/112:13:031
1704699241,16cyclictest0-21swapper/109:36:141
1704699241,15cyclictest0-21swapper/109:01:491
1703899249,3cyclictest28632-21/usr/sbin/munin11:15:230
1703899242,11cyclictest941-21/usr/sbin/munin07:45:170
17038992412,7cyclictest848-21sssd_nss08:04:240
145852240,5sleep232-21ksoftirqd/209:30:012
1705999237,7cyclictest0-21swapper/309:59:283
1705999237,6cyclictest0-21swapper/312:10:293
1704699234,9cyclictest23-21ksoftirqd/111:15:011
1704699232,15cyclictest0-21swapper/111:16:281
17046992315,4cyclictest22901-21grep09:45:281
17046992315,4cyclictest22901-21grep09:45:281
1704699231,4cyclictest14634-21snmpd11:59:061
1704699231,4cyclictest14634-21snmpd11:59:061
17046992314,3cyclictest0-21swapper/107:19:311
1704699231,20cyclictest0-21swapper/110:11:331
1704699231,17cyclictest0-21swapper/107:23:091
1704699231,12cyclictest0-21swapper/112:29:171
1703899232,10cyclictest0-21swapper/011:00:260
1705999228,8cyclictest0-21swapper/309:44:493
1705999227,6cyclictest0-21swapper/311:08:233
1705999226,5cyclictest0-21swapper/311:43:393
1705999221,6cyclictest27670-21gltestperf12:25:153
1705999221,5cyclictest0-21swapper/309:20:143
1705299226,7cyclictest32-21ksoftirqd/212:30:152
17046992218,3cyclictest0-21swapper/109:12:541
1704699221,18cyclictest22713-21cpu12:15:131
1704699221,18cyclictest0-21swapper/110:05:211
1704699221,16cyclictest0-21swapper/111:42:121
1704699221,16cyclictest0-21swapper/108:46:231
1704699221,15cyclictest0-21swapper/109:28:491
1704699221,15cyclictest0-21swapper/108:30:091
1704699221,10cyclictest0-21swapper/108:10:271
17046992210,6cyclictest3983-21kworker/u8:010:46:221
1704699220,17cyclictest0-21swapper/109:30:191
1703899221,11cyclictest14289-21ntp_states10:40:230
237062211,2sleep221624-21kworker/u8:011:01:232
1705999218,3cyclictest5767-21diskmemload12:04:283
1705999218,3cyclictest0-21swapper/307:25:363
1705999217,7cyclictest0-21swapper/310:54:393
1705999217,7cyclictest0-21swapper/310:54:393
1705999217,5cyclictest0-21swapper/311:10:213
1705999216,6cyclictest0-21swapper/310:37:533
1705999216,4cyclictest0-21swapper/312:36:283
1705999211,5cyclictest0-21swapper/311:38:123
1705999211,12cyclictest0-21swapper/310:10:143
1705999211,11cyclictest2582-21diskstats10:15:143
17059992110,8cyclictest8573-21sshd10:29:493
17059992110,3cyclictest23129-21pmu-power11:00:223
1705999210,7cyclictest0-21swapper/310:40:053
1705999210,6cyclictest0-21swapper/309:10:483
1705299211,6cyclictest0-21swapper/207:14:282
1704699215,10cyclictest0-21swapper/112:06:591
1704699212,3cyclictest0-21swapper/109:53:071
1704699212,17cyclictest0-21swapper/108:37:381
17046992117,3cyclictest0-21swapper/108:41:011
17046992117,3cyclictest0-21swapper/108:41:011
17046992117,3cyclictest0-21swapper/107:28:011
1704699211,6cyclictest0-21swapper/111:27:401
17046992116,3cyclictest26409-21grep09:55:161
17046992113,2cyclictest0-21swapper/107:45:131
1704699211,18cyclictest0-21swapper/112:01:281
1704699211,15cyclictest0-21swapper/112:20:541
1704699211,15cyclictest0-21swapper/111:39:591
1704699211,15cyclictest0-21swapper/111:31:141
1704699211,15cyclictest0-21swapper/108:58:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional