You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-10-15 - 10:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Thu Oct 15, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
182162260179,21sleep00-21swapper/019:06:450
181792234161,24sleep30-21swapper/319:06:153
184102205169,24sleep20-21swapper/219:09:162
180472202170,21sleep10-21swapper/119:05:251
2886221550,5sleep11855499cyclictest21:55:251
203932630,1sleep00-21swapper/022:50:220
218982510,1sleep10-21swapper/119:15:121
218982510,1sleep10-21swapper/119:15:121
18560995047,2cyclictest0-21swapper/221:24:502
1856099358,15cyclictest23600-21grep23:00:122
18560993410,6cyclictest911-21rs:main2
1854699338,12cyclictest23908-21munin-run00:15:020
1856099327,10cyclictest2158-21awk00:35:262
1856099319,10cyclictest20156-21ntp_states22:50:192
1856099316,14cyclictest810-21sshd00:32:442
1856799281,11cyclictest0-21swapper/323:42:123
1856099287,12cyclictest21703-21latency_hist00:10:012
1856099287,10cyclictest4565-21cat19:50:012
1856099286,9cyclictest7253-21diskmemload22:40:012
1856099285,14cyclictest27890-21/usr/sbin/munin23:10:252
1856099285,11cyclictest87350irq/126-enp1s0-22:20:112
1855499283,9cyclictest7253-21diskmemload21:15:181
18554992818,3cyclictest0-21swapper/121:21:231
1854699282,13cyclictest0-21swapper/023:15:260
1854699282,12cyclictest21713-21munin-run00:10:010
18546992810,15cyclictest6651-21idleruntime-cro19:55:020
1856799271,6cyclictest0-21swapper/322:28:303
18567992713,2cyclictest30494-21awk00:30:013
1856799271,10cyclictest616-21kworker/u8:020:11:353
18567992710,9cyclictest0-21swapper/320:30:143
1856099279,7cyclictest14525-21ntp_states20:10:192
1856099276,8cyclictest18248-21munin-run21:35:012
1856099274,14cyclictest26661-21acpi20:40:122
1856099274,10cyclictest26853-21fschecks_time00:20:142
1856099274,10cyclictest0-21swapper/200:05:012
1854699271,3cyclictest87550irq/128-enp1s0-00:24:400
1854699271,15cyclictest28003-21idleruntime-cro19:30:020
293222261,21sleep129478-21users23:10:271
1856799261,6cyclictest0-21swapper/322:45:313
1856799261,6cyclictest0-21swapper/322:45:313
1856799261,4cyclictest0-21swapper/323:24:323
1856099268,6cyclictest808-21snmpd21:13:342
1856099265,7cyclictest0-21swapper/200:15:162
1856099264,9cyclictest9978-21smart_sda23:40:242
1856099264,12cyclictest17710-21sed20:20:012
1856099264,10cyclictest3081-21/usr/sbin/munin21:00:132
1856099263,8cyclictest13293-21cstates23:50:132
1856099263,8cyclictest13293-21cstates23:50:132
18546992617,4cyclictest0-21swapper/020:05:220
1854699261,2cyclictest87550irq/128-enp1s0-23:09:480
177702260,8sleep123-21ksoftirqd/122:45:181
177702260,8sleep123-21ksoftirqd/122:45:181
1856799252,11cyclictest1836-21df22:10:113
1856799251,6cyclictest0-21swapper/323:00:283
1856799251,5cyclictest0-21swapper/300:36:563
1856799251,3cyclictest3384-21memory19:45:173
1856799251,16cyclictest0-21swapper/320:39:153
1856799251,15cyclictest0-21swapper/300:32:073
1856799251,12cyclictest28845-21/usr/sbin/munin20:45:233
1856799251,11cyclictest12220-21df_inode21:20:163
1856799251,10cyclictest0-21swapper/300:20:243
1856099257,10cyclictest31597-21perl20:50:152
1856099256,10cyclictest17345-21cat00:00:012
1856099254,9cyclictest25364-21kworker/u8:123:30:012
1856099253,14cyclictest808-21snmpd23:09:382
1856099253,13cyclictest6880-21egrep19:55:112
1856099253,12cyclictest4772-21fschecks_count23:30:162
18554992516,3cyclictest0-21swapper/121:48:361
18554992515,3cyclictest13409-21memory22:35:191
1855499251,18cyclictest0-21swapper/123:52:311
1855499251,18cyclictest0-21swapper/123:52:311
1854699254,9cyclictest87550irq/128-enp1s0-22:31:240
216512240,3sleep011-21rcuc/021:40:200
1856799249,3cyclictest26506-21irqstats23:05:163
1856799245,5cyclictest12625-21kworker/u8:023:47:433
1856799244,9cyclictest7253-21diskmemload22:15:323
1856799243,2cyclictest41-21ksoftirqd/300:12:043
1856799242,4cyclictest15852-21kworker/u8:221:48:363
1856799241,6cyclictest0-21swapper/323:55:383
1856799241,6cyclictest0-21swapper/322:06:443
1856799241,6cyclictest0-21swapper/300:16:253
1856799241,5cyclictest0-21swapper/323:39:333
1856799241,4cyclictest0-21swapper/321:50:173
1856799241,11cyclictest27264-21/usr/sbin/munin21:55:223
1856799241,11cyclictest20673-21/usr/sbin/munin21:40:133
1856799241,11cyclictest14076-21/usr/sbin/munin21:25:183
1856799241,11cyclictest12495-21/usr/sbin/munin22:35:193
1856799241,11cyclictest0-21swapper/323:15:063
1856799241,11cyclictest0-21swapper/322:02:213
1856099247,6cyclictest24144-21/usr/sbin/munin21:45:232
1856099245,7cyclictest17851-21/usr/sbin/munin20:20:262
1856099245,5cyclictest808-21snmpd23:39:432
1856099245,13cyclictest22228-21sed21:40:252
1856099244,7cyclictest15144-21ntp_states21:25:222
1856099243,7cyclictest26059-21bc19:25:122
1856099243,12cyclictest0-21swapper/222:09:292
1856099243,10cyclictest31146-21ntpq23:15:222
1856099242,6cyclictest0-21swapper/222:49:562
1856099242,6cyclictest0-21swapper/222:49:562
1856099242,12cyclictest19514-21ntp_kernel_pll_21:35:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional