You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 15:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Fri Nov 28, 2025 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
291122238163,24sleep20-21swapper/207:06:542
290722237162,24sleep00-21swapper/007:06:240
291062236161,23sleep10-21swapper/107:06:491
292532204168,24sleep30-21swapper/307:08:443
29468996462,1cyclictest0-21swapper/211:40:252
29468995956,2cyclictest0-21swapper/210:46:212
306322580,4sleep02945799cyclictest09:35:250
29468995652,3cyclictest0-21swapper/208:12:012
80812530,3sleep12946299cyclictest11:10:281
54012490,2sleep20-21swapper/211:05:242
29468994946,2cyclictest0-21swapper/209:23:442
29468994932,2cyclictest10336-21kworker/2:207:37:192
29468994737,2cyclictest10336-21kworker/2:207:56:412
29468994636,2cyclictest4961-21kworker/2:012:30:322
29468994331,3cyclictest4961-21kworker/2:009:33:552
29468994230,2cyclictest4961-21kworker/2:011:37:482
29468993926,3cyclictest4961-21kworker/2:009:36:252
29473993825,3cyclictest0-21swapper/307:56:413
29468993828,2cyclictest4961-21kworker/2:010:16:152
29468993828,2cyclictest10336-21kworker/2:207:24:232
2945799388,14cyclictest26963-21munin-run09:30:010
29457993810,13cyclictest4349-21munin-run07:25:010
29468993726,3cyclictest4961-21kworker/2:009:01:152
29468993725,3cyclictest4961-21kworker/2:012:04:032
29468993724,6cyclictest4961-21kworker/2:012:36:112
2946899371,14cyclictest4961-21kworker/2:011:20:172
29468993626,2cyclictest10336-21kworker/2:207:40:432
29468993625,3cyclictest4961-21kworker/2:010:53:592
29468993625,3cyclictest4961-21kworker/2:010:53:592
29468993624,3cyclictest10336-21kworker/2:208:37:392
29468993624,3cyclictest10336-21kworker/2:208:37:392
2945799367,14cyclictest8742-21munin-run07:35:010
2947399351,22cyclictest0-21swapper/312:36:033
29468993525,2cyclictest10336-21kworker/2:207:30:412
29468993523,2cyclictest4961-21kworker/2:008:56:392
29468993519,2cyclictest10336-21kworker/2:207:25:112
29468993517,3cyclictest4961-21kworker/2:008:52:432
2947399341,27cyclictest0-21swapper/308:12:473
29468993422,5cyclictest4961-21kworker/2:011:16:352
2946899342,22cyclictest4961-21kworker/2:010:21:352
29468993418,3cyclictest4961-21kworker/2:010:25:352
29473993316,8cyclictest0-21swapper/311:02:593
29468993330,2cyclictest4961-21kworker/2:011:02:592
29468993320,3cyclictest4961-21kworker/2:009:25:452
192792330,4sleep02945799cyclictest11:38:040
2947399320,24cyclictest0-21swapper/310:29:473
29468993221,3cyclictest4961-21kworker/2:010:12:352
29468993220,3cyclictest4961-21kworker/2:012:28:582
29468993219,3cyclictest10336-21kworker/2:208:15:412
254622320,4sleep1221ktimersoftd/109:25:141
29468993120,3cyclictest4961-21kworker/2:009:19:072
29468993116,7cyclictest4961-21kworker/2:011:10:052
29468993111,3cyclictest4961-21kworker/2:009:42:572
2947399303,4cyclictest780-21rngd11:50:163
29468993020,2cyclictest10336-21kworker/2:207:46:252
29468993019,2cyclictest4961-21kworker/2:011:33:242
29468993019,2cyclictest4961-21kworker/2:011:26:352
29468993015,3cyclictest4961-21kworker/2:012:22:032
2947399294,5cyclictest780-21rngd11:15:273
29473992916,3cyclictest0-21swapper/310:16:153
29468992924,3cyclictest4961-21kworker/2:010:41:032
2946899292,19cyclictest4961-21kworker/2:010:30:432
29468992920,2cyclictest10336-21kworker/2:207:14:552
29468992919,2cyclictest10336-21kworker/2:208:22:392
29468992912,4cyclictest4961-21kworker/2:009:55:232
29457992911,15cyclictest11282-21munin-run12:35:010
2947399286,8cyclictest780-21rngd12:08:033
29473992821,3cyclictest0-21swapper/312:30:333
29473992815,4cyclictest0-21swapper/307:10:133
2947399281,12cyclictest0-21swapper/309:12:433
29468992818,5cyclictest4961-21kworker/2:010:06:412
29468992818,2cyclictest10336-21kworker/2:208:00:072
2945799285,11cyclictest13154-21perf07:45:010
289342280,4sleep341-21ksoftirqd/308:20:133
29473992717,3cyclictest0-21swapper/307:37:193
29473992713,8cyclictest0-21swapper/309:32:273
29473992711,3cyclictest0-21swapper/308:56:393
2947399271,11cyclictest0-21swapper/309:54:273
2946899271,12cyclictest4961-21kworker/2:009:13:372
2945799271,12cyclictest18193-21perf09:10:010
2947399265,3cyclictest780-21rngd10:56:593
2947399261,12cyclictest0-21swapper/309:57:273
29468992617,2cyclictest4961-21kworker/2:011:50:352
29468992615,2cyclictest4961-21kworker/2:009:05:312
29468992612,3cyclictest4961-21kworker/2:011:49:472
2945799269,14cyclictest29822-21basename10:50:010
2947399256,7cyclictest780-21rngd12:01:453
2947399253,4cyclictest780-21rngd11:40:413
29473992517,7cyclictest86750irq/128-enp1s0-07:40:393
29473992516,3cyclictest0-21swapper/311:37:473
2947399250,16cyclictest0-21swapper/309:45:433
2947399250,16cyclictest0-21swapper/309:45:433
2946899258,4cyclictest86850irq/129-enp1s0-08:40:192
2946899258,4cyclictest86850irq/129-enp1s0-08:40:192
29468992516,2cyclictest10336-21kworker/2:208:07:372
2946899251,15cyclictest4961-21kworker/2:008:47:232
29468992511,2cyclictest4961-21kworker/2:010:58:392
2945799251,12cyclictest13778-21perf09:00:020
2947399246,2cyclictest86550irq/126-enp1s0-10:00:513
2947399245,8cyclictest780-21rngd07:18:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional