You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-07 - 23:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot3s.osadl.org (updated Fri Nov 07, 2025 12:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2268964215255,92sleep30-21swapper/307:06:493
226908228454,10sleep20-21swapper/207:08:222
226840028252,9sleep10-21swapper/107:05:241
226898127753,6sleep00-21swapper/007:07:030
2269336992421,1cyclictest0-21swapper/307:39:243
226933699232,13cyclictest2303547-21taskset07:40:123
24519572221,9sleep02452590-21grep09:45:150
226933699222,14cyclictest2432904-21taskset09:30:223
226933699221,17cyclictest2449340-21taskset09:42:003
226933699220,18cyclictest2504520-21taskset10:19:523
226933699213,14cyclictest2625950-21taskset11:36:373
2269336992118,1cyclictest0-21swapper/309:55:003
2269336992111,8cyclictest0-21swapper/312:00:113
226933699211,17cyclictest0-21swapper/309:12:303
226933699211,17cyclictest0-21swapper/309:12:303
226933699211,16cyclictest2565305-21taskset10:57:453
26359202201,9sleep22636109-21expr11:45:152
226933699208,8cyclictest2671579-21taskset12:06:033
2269336992017,1cyclictest0-21swapper/312:24:203
2269336992017,1cyclictest0-21swapper/311:05:213
2269336992017,1cyclictest0-21swapper/310:05:143
2269336992016,2cyclictest0-21swapper/309:55:173
226933699201,15cyclictest66550irq/131-enp1s0-TxRx-310:10:073
226933699201,15cyclictest2596095-21chrt11:18:333
26720292191,8sleep02398796-21diskmemload12:06:490
26193712191,3sleep20-21swapper/211:33:442
24354372191,2sleep10-21swapper/109:34:341
23697012190,7sleep02369702-21kthreadcore08:40:160
226933699198,7cyclictest2688684-21taskset12:17:423
226933699192,13cyclictest2634488-21taskset11:43:143
226933699192,12cyclictest2713793-21taskset12:32:573
2269336991915,2cyclictest0-21swapper/310:35:273
226933699191,15cyclictest0-21swapper/310:00:073
226933699191,14cyclictest2555779-21chrt10:50:183
226933699191,14cyclictest0-21swapper/311:00:253
226933699191,14cyclictest0-21swapper/310:23:093
226933699191,14cyclictest0-21swapper/309:46:493
226933699191,14cyclictest0-21swapper/309:20:133
226933699191,14cyclictest0-21swapper/309:16:433
226933699191,13cyclictest2398816-21sleep09:10:003
226933699191,13cyclictest0-21swapper/311:46:033
226933699191,11cyclictest2620083-21taskset11:35:013
226933699191,11cyclictest2291350-21taskset07:25:213
226933699190,15cyclictest2335279-21chrt08:09:343
226933699190,15cyclictest2335279-21chrt08:09:343
24748592181,4sleep12474938-21irqstats10:00:151
24659922181,2sleep00-21swapper/009:54:560
24328442182,8sleep22432903-21ntp_states09:30:222
226933699187,7cyclictest2313674-21taskset07:47:053
226933699184,11cyclictest66550irq/131-enp1s0-TxRx-310:45:073
226933699182,12cyclictest2704561-21taskset12:26:483
2269336991815,2cyclictest0-21swapper/311:10:243
2269336991815,2cyclictest0-21swapper/311:10:243
2269336991815,1cyclictest0-21swapper/311:50:233
2269336991815,1cyclictest0-21swapper/310:25:153
2269336991815,1cyclictest0-21swapper/307:55:173
2269336991813,2cyclictest66550irq/131-enp1s0-TxRx-310:32:313
226933699181,2cyclictest66550irq/131-enp1s0-TxRx-311:26:283
2269336991812,4cyclictest0-21swapper/312:10:363
226933699181,14cyclictest2657331-21chrt11:57:293
226933699181,14cyclictest0-21swapper/311:21:213
226933699181,14cyclictest0-21swapper/307:10:133
226933699181,13cyclictest0-21swapper/312:35:123
226933699181,13cyclictest0-21swapper/309:25:353
226933699181,13cyclictest0-21swapper/308:20:133
226933699181,10cyclictest2328902-21taskset08:00:203
27150022171,11sleep02715009-21ssh12:34:590
26245832171,10sleep02624643-21ntpq11:35:230
26189262178,2sleep02398796-21diskmemload11:32:580
25958652171,6sleep12595866-21sh11:18:081
25814422171,9sleep22398796-21diskmemload11:09:272
25348272171,9sleep12398796-21diskmemload10:39:041
226933699172,11cyclictest2441495-21taskset09:36:353
2269336991714,1cyclictest0-21swapper/308:35:193
226933699171,2cyclictest0-21swapper/307:55:003
226933699171,12cyclictest2292847-21chrt07:30:143
226933699170,14cyclictest2388302-21turbostat09:04:553
226933699170,14cyclictest0-21swapper/308:50:163
27205312161,9sleep12398796-21diskmemload12:35:571
27149912161,3sleep20-21swapper/212:34:572
25723902161,10sleep12572405-21ssh11:01:321
25433582161,9sleep02398796-21diskmemload10:45:000
24860622163,8sleep02486182-21ldconfig10:05:190
24205342161,10sleep22420546-21ssh09:24:452
23927282161,5sleep22392796-21systemctl09:00:242
22969582161,10sleep12297081-21mailstats07:30:251
2269336991614,1cyclictest0-21swapper/310:40:163
2269336991614,1cyclictest0-21swapper/308:40:173
2269336991613,1cyclictest0-21swapper/308:10:123
226933699161,10cyclictest2356251-21taskset08:25:403
226933699160,13cyclictest0-21swapper/308:30:213
226933699160,13cyclictest0-21swapper/307:20:193
226933699160,11cyclictest2281714-21chrt07:17:023
26427612150,10sleep12642767-21ssh11:48:501
25665312151,7sleep12566613-21munin-run11:00:001
25257592151,9sleep02525764-21ssh10:31:290
23828212155,4sleep014-21ksoftirqd/008:52:470
23030742151,10sleep22303143-40gst-plugin-scan07:39:242
226933699151,9cyclictest2388095-21taskset08:57:313
2269336991512,2cyclictest0-21swapper/308:15:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional