You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 03:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Thu Dec 11, 2025 00:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
189442239163,24sleep20-21swapper/219:09:572
169882239162,24sleep00-21swapper/019:05:070
186402204175,19sleep10-21swapper/119:06:021
169912203166,25sleep30-21swapper/319:05:113
465021610,4sleep11905299cyclictest21:00:231
1231321410,5sleep01904699cyclictest22:30:250
1536421290,4sleep01904699cyclictest23:51:510
1536421290,4sleep01904699cyclictest23:51:510
1996121180,2sleep20-21swapper/222:50:152
19056996562,2cyclictest0-21swapper/219:25:262
191982590,3sleep119203-21pmu-power00:00:231
1905299441,35cyclictest25267-21gltestperf00:15:171
19056994340,2cyclictest0-21swapper/219:55:102
1905299431,27cyclictest16829-21gltestperf20:15:171
19052994310,24cyclictest28571-21if_err_enp2s021:55:181
1905299411,28cyclictest25062-40dnf21:46:251
1905299411,27cyclictest13745-21awk20:10:021
1905299410,29cyclictest20719-21runrttasks21:37:031
1905299402,26cyclictest14589-21/usr/sbin/munin21:25:191
1905299401,32cyclictest17454-21kworker/u8:023:59:071
1905299401,30cyclictest8639-21acpi22:25:131
1905299401,24cyclictest29093-21cpu00:25:131
1905299401,23cyclictest836-21runrttasks21:52:211
1905699391,29cyclictest0-21swapper/220:54:282
1905299391,31cyclictest15267-21kworker/u8:122:18:131
1905299391,25cyclictest23154-21latency_hist21:45:021
1905299391,25cyclictest23154-21latency_hist21:45:021
1905299391,18cyclictest0-21swapper/122:22:001
19056993816,13cyclictest19109-40dnf22:46:332
19056993816,13cyclictest19109-40dnf22:46:332
1905299382,32cyclictest9026-21munin-run23:40:011
1905299381,30cyclictest17454-21kworker/u8:000:31:221
1905299381,28cyclictest22928-21/usr/sbin/munin22:55:241
1905299381,19cyclictest15006-21awk22:40:011
1905299380,26cyclictest2129-21runrttasks23:21:201
19056993724,7cyclictest3953-40dnf19:45:252
1905299371,33cyclictest29121-21sh20:45:011
1905299371,28cyclictest848-21sssd_nss23:30:151
1905299371,28cyclictest27142-21memory23:05:211
1905299371,25cyclictest16926-21sshd22:41:451
1905299371,22cyclictest26944-21awk00:20:141
1905299370,29cyclictest0-21swapper/119:35:121
1905299370,21cyclictest0-21swapper/121:30:161
1905299364,18cyclictest21205-21grep22:50:281
1905299363,19cyclictest0-21swapper/123:41:051
1905299362,30cyclictest19109-40dnf22:46:331
1905299362,30cyclictest19109-40dnf22:46:331
1905299361,26cyclictest0-21swapper/119:32:481
1905299361,26cyclictest0-21swapper/119:32:481
1905299361,25cyclictest9260-21smartctl21:10:241
1905299361,25cyclictest22762-21/usr/sbin/munin20:30:241
1905299361,22cyclictest2722-21sh19:45:011
1905299361,22cyclictest15918-21cat20:14:571
19052993610,23cyclictest31609-21cpu20:50:141
52472350,2sleep20-21swapper/219:50:112
1905699353,23cyclictest29263-21wc00:25:132
1905299353,22cyclictest86550irq/126-enp1s0-20:05:021
1905299352,27cyclictest86750irq/128-enp1s0-21:22:251
1905299351,31cyclictest19132-21/usr/sbin/munin20:20:171
1905299351,31cyclictest15627-21perf23:55:011
1905299351,31cyclictest15627-21perf23:55:011
1905299351,30cyclictest24499-21cat00:15:021
1905299351,23cyclictest7368-21cpu19:55:131
1905299351,22cyclictest0-21swapper/100:05:221
1905299351,21cyclictest22129-21/usr/sbin/munin19:15:221
1905299350,22cyclictest0-21swapper/123:10:161
1905699341,26cyclictest0-21swapper/220:02:562
19056993410,11cyclictest12677-21memory20:05:192
1905299344,25cyclictest4140-21cut19:45:261
1905299343,27cyclictest25403-21ntp_states19:20:231
1905299341,25cyclictest0-21swapper/122:07:481
1905299341,24cyclictest27450-21kworker/u8:022:04:531
1905299341,20cyclictest7764-21diskmemload23:49:451
282972330,2sleep30-21swapper/321:55:163
1905699339,15cyclictest20309-21cpu00:05:162
1905699336,16cyclictest0-21swapper/223:30:012
19052993314,16cyclictest20567-21acpi20:25:151
1905299331,29cyclictest3082-21munin-run00:40:011
23392320,2sleep30-21swapper/300:35:243
1905699328,8cyclictest13937-21unixbench_singl21:20:282
1905299323,20cyclictest3893-21fgrep23:25:251
1905299322,27cyclictest20314-21ntpq19:10:211
1905299321,28cyclictest3355-21latency_hist21:00:021
1905299321,27cyclictest5792-21acpi21:05:111
1905299317,14cyclictest0-21swapper/122:31:471
1905299311,27cyclictest30626-21/usr/sbin/munin23:15:251
1905299311,26cyclictest24374-21entropy23:00:141
1904699318,11cyclictest21612-21perf22:55:000
1905699308,13cyclictest21192-21/usr/sbin/munin21:40:222
1905699308,13cyclictest21192-21/usr/sbin/munin21:40:222
1905699307,13cyclictest23384-21/usr/sbin/munin21:45:162
1905699306,16cyclictest31341-21ls00:30:122
1905699306,13cyclictest28335-21cat23:10:022
1905699301,13cyclictest0-21swapper/222:32:022
19056993011,11cyclictest0-21swapper/222:40:112
19056993010,7cyclictest24849-21cat00:15:132
19056993010,13cyclictest18389-21sh00:00:142
1905299307,20cyclictest25950-21needreboot20:35:201
1905299307,20cyclictest25950-21needreboot20:35:201
1905299301,26cyclictest27788-21smart_sda19:25:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional