You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 09:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Fri Apr 10, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35472235160,22sleep00-21swapper/019:05:480
35472235160,22sleep00-21swapper/019:05:480
22552224162,55sleep20-21swapper/219:05:142
22552224162,55sleep20-21swapper/219:05:132
36472201166,23sleep10-21swapper/119:07:061
36472201166,23sleep10-21swapper/119:07:051
35302201166,23sleep30-21swapper/319:05:343
35302201166,23sleep30-21swapper/319:05:343
3963996158,2cyclictest0-21swapper/223:26:502
3963995955,3cyclictest0-21swapper/221:07:122
258552420,1sleep10-21swapper/121:10:171
3970994015,13cyclictest26929-40dnf22:25:233
396399401,29cyclictest0-21swapper/200:33:152
3963993835,2cyclictest0-21swapper/222:29:292
397099365,21cyclictest16130-21/usr/sbin/munin00:30:193
394999369,13cyclictest25637-21munin-run22:25:010
397099357,22cyclictest0-21swapper/322:40:133
3970993511,10cyclictest808-21snmpd21:25:153
397099349,20cyclictest0-21swapper/322:15:013
397099348,9cyclictest29416-21munin-run21:20:013
3970993410,15cyclictest79592head00:10:163
83652330,4sleep011-21rcuc/000:10:200
397099339,15cyclictest1038-21/usr/sbin/munin20:15:243
397099339,15cyclictest1038-21/usr/sbin/munin20:15:243
397099338,16cyclictest24458-21cstates23:35:133
397099334,14cyclictest9563-21hddtemp_smartct23:00:153
3970993319,5cyclictest19460-21/usr/sbin/munin20:55:193
397099329,5cyclictest87350irq/126-enp1s0-00:20:253
397099329,13cyclictest24624-21/usr/sbin/munin19:55:243
397099328,14cyclictest22584-21grep23:30:153
3970993215,4cyclictest18663-21users22:05:263
3970993212,10cyclictest23443-21perf22:20:003
397099321,11cyclictest0-21swapper/300:39:113
3970993211,12cyclictest5853-21munin-run21:40:023
396399321,19cyclictest0-21swapper/220:21:202
394999321,24cyclictest9908-21kworker/0:021:49:540
397099319,8cyclictest8459-21cstates21:45:143
397099319,6cyclictest8260-21unixbench_singl22:55:243
397099318,12cyclictest15490-21/usr/sbin/munin23:15:243
3970993113,10cyclictest32221-21latency_hist22:40:013
3970993113,10cyclictest32221-21latency_hist22:40:013
3970993111,17cyclictest14395-21tune2fs00:25:153
394999311,23cyclictest10515-21kworker/0:023:12:370
394999311,14cyclictest19659-21munin-run23:25:000
397099309,12cyclictest28673-21/usr/sbin/munin23:45:143
397099304,15cyclictest0-21swapper/321:52:073
3970993015,4cyclictest13629-21df23:10:133
3970993012,15cyclictest3833-21memory00:00:193
394999301,19cyclictest32124-21kworker/0:222:56:530
394999300,11cyclictest27534-21kworker/0:022:32:130
397099299,11cyclictest87350irq/126-enp1s0-00:15:143
3970992921,5cyclictest12358-21smart_sda23:05:233
3970992920,5cyclictest11157-40dnf19:24:243
3970992919,7cyclictest1035-21diskstats23:55:143
3970992913,4cyclictest31179-21unixbench_singl21:20:273
3970992911,8cyclictest28078-21cpu22:30:123
3970992911,6cyclictest4274-21munin-run22:50:013
396399291,11cyclictest0-21swapper/219:51:472
396399290,17cyclictest0-21swapper/223:17:122
395899294,18cyclictest32479-21cut21:25:161
394999292,10cyclictest1365-21kworker/0:221:40:180
394999291,21cyclictest9908-21kworker/0:022:04:460
394999291,10cyclictest10515-21kworker/0:023:30:170
397099289,11cyclictest30986-21latency_hist20:10:013
397099288,6cyclictest87650irq/129-enp1s0-21:30:133
397099287,9cyclictest0-21swapper/321:55:203
397099286,9cyclictest28954-21cat20:05:013
397099285,14cyclictest0-21swapper/300:10:023
397099285,13cyclictest6330-21sshd22:53:223
3970992820,5cyclictest21544-40dnf23:26:143
3970992814,8cyclictest7323-21/usr/sbin/munin21:40:243
3970992810,7cyclictest23658-21taskset22:20:093
396399286,3cyclictest0-21swapper/223:45:112
396399281,12cyclictest0-21swapper/223:20:482
395899284,16cyclictest0-21swapper/123:34:271
394999281,22cyclictest6202-21kworker/0:000:07:020
3949992811,2cyclictest87350irq/126-enp1s0-23:45:110
394999281,11cyclictest25895-21kworker/0:200:00:180
397099277,8cyclictest17908-21sed20:50:253
397099277,12cyclictest11446-21/usr/sbin/munin19:25:153
397099277,12cyclictest0-21swapper/323:40:153
397099276,13cyclictest22428-21/usr/sbin/munin19:50:173
3970992720,4cyclictest6624-21smart_sda19:15:033
3970992716,7cyclictest32290-21ntp_states20:10:193
3970992711,13cyclictest5974-21sshd19:13:073
396399271,17cyclictest0-21swapper/219:23:432
396399271,11cyclictest0-21swapper/222:38:522
396399271,11cyclictest0-21swapper/222:38:512
396399270,9cyclictest0-21swapper/220:08:552
394999271,16cyclictest25000-21kworker/0:021:26:410
394999271,13cyclictest21252-21awk22:15:010
397099269,14cyclictest20941-21cpuspeed_turbos21:00:133
397099268,9cyclictest15838-21/usr/sbin/munin19:35:123
397099266,7cyclictest87350irq/126-enp1s0-21:10:153
3970992619,4cyclictest4527-21smart_sda20:20:233
3970992618,5cyclictest23860-21/usr/sbin/munin21:05:173
3970992618,5cyclictest13119-21ntp_states20:40:203
3970992618,5cyclictest11118-21smart_sda20:35:233
3970992617,6cyclictest20232-21/usr/sbin/munin19:45:243
3970992617,6cyclictest18762-21/usr/sbin/munin23:20:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional