You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 01:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Fri Nov 28, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9010210679,9sleep10-21swapper/107:09:271
883329585,6sleep30-21swapper/307:07:093
827329251,35sleep20-21swapper/207:05:282
904528269,9sleep00-21swapper/007:09:510
107662660,0sleep20-21swapper/211:32:592
913999280,1cyclictest0-21swapper/212:35:162
9139992423,1cyclictest0-21swapper/210:10:102
913999240,2cyclictest0-21swapper/210:53:582
913999220,22cyclictest0-21swapper/211:10:192
913999220,22cyclictest0-21swapper/211:10:182
913499220,22cyclictest0-21swapper/109:34:381
914399210,17cyclictest0-21swapper/308:20:153
914399210,14cyclictest0-21swapper/308:05:133
913999204,16cyclictest0-21swapper/212:18:562
913999192,3cyclictest1957-21diskmemload11:01:392
9130991918,1cyclictest0-21swapper/009:23:460
9130991918,1cyclictest0-21swapper/009:23:450
913099191,3cyclictest141rcu_preempt11:25:290
9143991816,1cyclictest472-21avahi-daemon10:15:243
9143991812,2cyclictest2792-21sh10:05:003
9139991816,1cyclictest0-21swapper/209:30:112
9139991812,2cyclictest32-21ksoftirqd/211:23:112
913999180,17cyclictest0-21swapper/211:59:022
913999180,17cyclictest0-21swapper/210:39:062
9134991818,0cyclictest0-21swapper/110:19:411
9143991712,3cyclictest11036-21idleruntime-cro11:04:593
914399170,15cyclictest500-21in:imuxsock12:04:493
913999176,10cyclictest9129-21cyclictest12:33:222
913999170,17cyclictest13700-21users09:45:282
19512170,0chrt0-21swapper/012:19:130
9143991614,1cyclictest472-21avahi-daemon10:09:263
9143991613,2cyclictest472-21avahi-daemon10:24:223
914399160,16cyclictest0-21swapper/311:21:233
913499161,1cyclictest606-21ntp_states10:55:201
913499160,1cyclictest0-21swapper/111:20:131
913499160,16cyclictest0-21swapper/107:35:191
913099165,2cyclictest141rcu_preempt12:35:000
913099161,12cyclictest0-21swapper/007:30:130
9143991514,1cyclictest39-21ksoftirqd/311:18:583
9143991513,1cyclictest1957-21diskmemload11:55:153
9143991512,1cyclictest0-21swapper/308:45:223
913999150,14cyclictest0-21swapper/210:55:132
913499156,4cyclictest224-21systemd-journal09:04:381
913499155,6cyclictest224-21systemd-journal09:16:281
913499150,1cyclictest0-21swapper/111:58:051
914399145,5cyclictest224-21systemd-journal07:25:003
9143991411,2cyclictest2839-21sed10:30:233
913499142,3cyclictest224-21systemd-journal12:09:591
9134991410,3cyclictest25-21ksoftirqd/110:35:091
9134991410,3cyclictest12436-21grep09:45:181
9134991410,2cyclictest25838-21ls07:45:011
913499140,2cyclictest0-21swapper/109:43:491
9130991411,1cyclictest0-21swapper/011:06:290
913099140,2cyclictest0-21swapper/011:58:410
913099140,13cyclictest0-21swapper/009:10:560
914399132,7cyclictest1148-21ssh11:25:203
9143991310,2cyclictest25317-21grep07:40:283
9143991310,2cyclictest19952-21tr10:45:153
9143991310,2cyclictest1950-21grep09:35:283
9143991310,2cyclictest15545-21grep10:40:263
9143991310,2cyclictest10400-21ssh09:15:273
914399130,13cyclictest0-21swapper/312:13:453
913999139,3cyclictest24429-21sed08:45:262
9139991310,2cyclictest26111-21taskset10:23:352
9139991310,2cyclictest20706-21sh09:25:112
9139991310,2cyclictest19176-21cat08:35:232
9139991310,2cyclictest10902-21grep12:00:182
913999130,13cyclictest0-21swapper/209:12:022
913499139,3cyclictest29134-21wc10:00:001
913499139,2cyclictest27509-21grep08:55:131
913499139,2cyclictest17592-21grep11:10:161
913499139,2cyclictest17592-21grep11:10:151
913499138,4cyclictest61750irq/125-enp2s0-09:54:141
913499138,3cyclictest20227-21cron12:35:001
913499137,5cyclictest1378-21ntpd11:38:001
913499135,2cyclictest224-21systemd-journal08:30:281
9134991310,2cyclictest6191-21grep11:00:181
9134991310,2cyclictest387-21grep09:35:171
9134991310,2cyclictest3687-21tr08:05:161
9134991310,2cyclictest31131-21grep07:55:121
9134991310,2cyclictest28712-21head10:25:191
9134991310,2cyclictest19592-21grep07:30:161
9134991310,2cyclictest17981-21grep08:35:121
913499130,11cyclictest0-21swapper/111:28:591
913099139,3cyclictest28191-21perf07:50:000
913099138,3cyclictest0-21swapper/010:28:370
913099131,11cyclictest6165-21ssh09:40:140
9130991311,1cyclictest10865-21cut12:00:180
9130991310,2cyclictest17594-21wc07:25:200
913099130,12cyclictest0-21swapper/011:40:010
221132130,1sleep2311rcuc/209:53:572
914399129,2cyclictest8901-21grep08:15:173
914399129,2cyclictest6472-21sort08:10:193
914399129,2cyclictest567-21sed09:05:193
914399129,2cyclictest3251-21sed09:10:153
914399129,2cyclictest30526-21tr11:50:143
914399129,2cyclictest30106-21cut09:00:233
914399129,2cyclictest30095-21grep12:15:163
914399129,2cyclictest27935-21wc09:30:243
914399129,2cyclictest24035-21basename11:45:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional