You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 20:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Sun Nov 23, 2025 12:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
193622238164,24sleep30-21swapper/307:08:223
193462237164,60sleep20-21swapper/207:08:102
175092206166,26sleep10-21swapper/107:05:061
193292202164,25sleep00-21swapper/007:07:550
19593997874,3cyclictest0-21swapper/209:22:232
241302580,3sleep011-21rcuc/007:15:250
19593994240,1cyclictest0-21swapper/208:07:442
253802360,12sleep341-21ksoftirqd/308:35:013
1959399362,20cyclictest13052-21kworker/2:008:37:492
1958899361,8cyclictest0-21swapper/110:27:411
1958899361,26cyclictest0-21swapper/111:14:071
1959399352,18cyclictest13052-21kworker/2:009:28:132
1958899341,14cyclictest0-21swapper/111:52:411
1958899331,15cyclictest11105-21diskstats09:15:131
1958899331,13cyclictest0-21swapper/112:34:311
1958399335,13cyclictest19967-21munin-run10:50:010
1959399321,12cyclictest13052-21kworker/2:012:00:292
1959399321,12cyclictest13052-21kworker/2:012:00:292
1958899321,13cyclictest0-21swapper/108:24:331
1958899320,8cyclictest0-21swapper/111:17:531
1958899316,14cyclictest0-21swapper/109:12:311
1958899311,9cyclictest0-21swapper/110:46:431
1958899311,14cyclictest0-21swapper/110:11:331
1958899311,12cyclictest0-21swapper/110:42:111
1958899311,11cyclictest5703-21sed07:50:011
1958899310,8cyclictest0-21swapper/110:52:151
1958399315,12cyclictest3013-21idleruntime-cro11:25:020
1958399312,15cyclictest8327-21diskmemload10:35:350
1959399302,10cyclictest13052-21kworker/2:008:50:212
1959399302,10cyclictest13052-21kworker/2:008:50:212
1958899301,14cyclictest0-21swapper/111:49:431
1958899301,14cyclictest0-21swapper/111:38:411
1958899301,14cyclictest0-21swapper/109:21:351
1958899301,14cyclictest0-21swapper/107:52:031
1958899301,13cyclictest0-21swapper/112:29:031
1958899301,12cyclictest0-21swapper/109:59:511
1958899301,12cyclictest0-21swapper/107:17:291
1958899301,11cyclictest0-21swapper/111:40:491
1958899301,11cyclictest0-21swapper/110:56:411
1958899301,11cyclictest0-21swapper/110:56:411
1958899300,24cyclictest0-21swapper/112:36:451
1958899300,13cyclictest0-21swapper/109:43:451
1959399292,17cyclictest13052-21kworker/2:010:20:452
1959399292,16cyclictest13052-21kworker/2:007:37:092
19588992912,3cyclictest1312-21/usr/sbin/munin07:40:141
1958899291,22cyclictest0-21swapper/112:21:151
1958899291,14cyclictest3573-21diskstats11:25:131
1958899291,13cyclictest0-21swapper/112:19:211
1958899291,12cyclictest0-21swapper/112:09:031
1958899291,11cyclictest0-21swapper/110:30:111
1958899291,11cyclictest0-21swapper/107:25:161
1958899291,10cyclictest0-21swapper/109:05:591
1958899290,13cyclictest0-21swapper/110:38:411
1958899290,11cyclictest0-21swapper/108:37:071
1958399294,12cyclictest16510-21awk08:15:010
1959399281,19cyclictest13052-21kworker/2:010:44:532
1958899281,13cyclictest0-21swapper/110:00:211
1958899281,12cyclictest0-21swapper/111:04:231
1958899281,12cyclictest0-21swapper/109:36:311
1958899281,12cyclictest0-21swapper/108:29:531
1958899281,11cyclictest0-21swapper/111:58:351
1958899281,11cyclictest0-21swapper/111:21:011
1958899281,11cyclictest0-21swapper/111:05:471
1958899281,11cyclictest0-21swapper/110:15:531
1958899281,11cyclictest0-21swapper/109:32:491
1958899281,10cyclictest8327-21diskmemload12:00:531
1958899281,10cyclictest8327-21diskmemload12:00:531
1958899281,10cyclictest0-21swapper/112:11:391
1958899280,12cyclictest0-21swapper/110:06:131
1958899280,12cyclictest0-21swapper/108:05:171
1958399285,11cyclictest11172-21awk10:30:010
1959399272,11cyclictest13052-21kworker/2:009:40:052
1959399272,10cyclictest13052-21kworker/2:011:14:212
19593992716,3cyclictest13052-21kworker/2:011:28:372
1959399271,12cyclictest13052-21kworker/2:008:15:252
1959399270,10cyclictest13052-21kworker/2:012:36:452
1958899271,13cyclictest0-21swapper/109:45:411
1958899271,11cyclictest0-21swapper/108:54:091
1958899271,11cyclictest0-21swapper/108:54:091
1958899271,10cyclictest0-21swapper/111:30:251
19588992710,3cyclictest31236-40dnf07:34:521
1959399262,14cyclictest13052-21kworker/2:011:55:172
1959399262,12cyclictest13052-21kworker/2:009:36:532
1959399262,10cyclictest13052-21kworker/2:007:10:452
1959399261,18cyclictest13052-21kworker/2:011:21:572
1959399261,12cyclictest13052-21kworker/2:008:34:212
1959399261,10cyclictest13052-21kworker/2:007:23:092
1958899261,13cyclictest0-21swapper/107:45:451
1958899261,12cyclictest0-21swapper/110:21:431
1958899261,11cyclictest0-21swapper/109:01:571
1958899260,11cyclictest0-21swapper/109:54:131
1958899260,11cyclictest0-21swapper/109:54:131
1958399261,13cyclictest9598-21munin-run11:40:020
1958399260,12cyclictest23740-21idleruntime-cro09:45:020
1959399252,10cyclictest13052-21kworker/2:010:17:412
19593992513,2cyclictest13052-21kworker/2:012:19:252
1959399251,21cyclictest11979-21grep09:15:232
1959399251,13cyclictest13052-21kworker/2:010:35:332
19593992511,3cyclictest13052-21kworker/2:007:58:372
1959399250,12cyclictest13052-21kworker/2:010:07:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional