You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 01:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Mon Dec 15, 2025 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
282482237162,26sleep20-21swapper/207:08:092
280442206168,26sleep00-21swapper/007:05:300
282772201164,25sleep10-21swapper/107:08:321
280472201165,24sleep30-21swapper/307:05:333
2751621520,2sleep32848699cyclictest10:45:173
170212560,4sleep1221ktimersoftd/107:55:111
28476994844,3cyclictest0-21swapper/111:24:071
28476994844,3cyclictest0-21swapper/111:24:071
214912480,1sleep011-21rcuc/008:05:130
2846699388,14cyclictest17185-21munin-run09:10:010
28466993810,13cyclictest7778-21munin-run07:35:010
28476993633,2cyclictest0-21swapper/109:50:481
2846699356,13cyclictest4605-21munin-run09:55:010
2846699334,13cyclictest22203-21munin-run10:35:010
2846699314,17cyclictest8382-21munin-run08:50:010
2846699302,13cyclictest767-21awk11:00:010
49372290,8sleep232-21ksoftirqd/209:55:112
2848299291,12cyclictest0-21swapper/210:08:462
2848299291,12cyclictest0-21swapper/210:08:462
28486992712,3cyclictest87450irq/129-enp1s0-08:35:233
2846699279,15cyclictest25978-21munin-run09:30:010
2848699261,8cyclictest0-21swapper/311:40:503
2846699261,12cyclictest22812-21munin-run11:50:010
28466992610,14cyclictest26602-21perf10:45:010
2847699251,4cyclictest23361-21grep09:20:241
2848699241,11cyclictest2168-21sshd09:47:073
2848699241,11cyclictest10188-21sshd07:40:083
2848299243,4cyclictest26026-21latency_hist09:30:022
2846699242,19cyclictest6809-21munin-run10:00:010
156932240,5sleep32848699cyclictest11:30:233
2848699238,3cyclictest3565-21sshd12:19:083
2848699237,3cyclictest11664-21sshd11:23:083
2848699237,3cyclictest11664-21sshd11:23:083
2848299231,12cyclictest0-21swapper/212:22:022
2847699232,3cyclictest449-21ntp_states12:10:211
2847699232,17cyclictest5236-21munin-run11:10:011
2847699231,16cyclictest0-21swapper/107:53:061
2847699231,15cyclictest17192-21diskmemload10:02:171
2846699238,8cyclictest18090-21kworker/0:112:07:180
28466992315,4cyclictest23550-21tr08:10:110
2846699230,11cyclictest25019-21awk11:55:010
58172220,1sleep10-21swapper/109:55:171
2848699225,3cyclictest0-21swapper/311:26:563
2848699224,4cyclictest19683-21sshd10:26:083
2848699221,10cyclictest28672-21/usr/sbin/munin07:10:143
2848699220,9cyclictest0-21swapper/308:27:423
2848299229,5cyclictest87450irq/129-enp1s0-11:40:132
2848299229,5cyclictest87450irq/129-enp1s0-08:50:242
2848299228,3cyclictest0-21swapper/212:03:542
28476992214,3cyclictest0-21swapper/107:17:081
2847699221,2cyclictest20854-21mailstats09:15:221
2847699221,18cyclictest19981-21seq11:40:241
2847699221,16cyclictest0-21swapper/112:38:091
2847699221,16cyclictest0-21swapper/112:03:161
2847699221,16cyclictest0-21swapper/109:49:281
2846699222,8cyclictest32439-21kworker/0:008:54:400
2846699222,10cyclictest25087-21kworker/0:008:20:200
2846699221,6cyclictest14024-21turbostat11:30:010
27132221,2sleep00-21swapper/008:35:160
2848699216,2cyclictest0-21swapper/309:40:143
2848699214,7cyclictest10468-21/usr/sbin/munin12:35:183
2848699212,6cyclictest11438-21/usr/sbin/munin10:10:133
2848699211,5cyclictest11873-21ntp_states08:55:213
2848299219,3cyclictest17258-21irqstats11:35:182
2848299217,5cyclictest12050irq/123-ahci[0012:35:012
2848299211,12cyclictest0-21swapper/210:45:422
2847699211,3cyclictest4772-21proc_pri07:25:221
2847699211,3cyclictest0-21swapper/111:15:241
28476992113,3cyclictest0-21swapper/110:36:211
28476992112,2cyclictest11778-21sh10:10:131
28476992111,9cyclictest0-21swapper/108:14:301
2847699211,15cyclictest0-21swapper/112:15:591
2847699211,15cyclictest0-21swapper/112:06:141
2847699211,15cyclictest0-21swapper/111:26:391
2847699211,15cyclictest0-21swapper/111:01:281
2847699211,15cyclictest0-21swapper/110:42:511
2847699211,15cyclictest0-21swapper/109:06:151
2847699211,15cyclictest0-21swapper/108:47:071
2847699211,15cyclictest0-21swapper/108:09:561
2847699211,14cyclictest0-21swapper/109:27:031
2847699211,14cyclictest0-21swapper/109:11:051
2847699211,11cyclictest12549-21tr07:45:101
2847699211,11cyclictest12549-21tr07:45:101
2847699210,16cyclictest0-21swapper/112:25:141
2846699211,8cyclictest30153-21kworker/0:209:40:120
40852200,4sleep29-21rcu_preempt07:25:142
2848699207,2cyclictest24307-21sshd10:39:073
2848699206,3cyclictest0-21swapper/308:54:023
2848699205,4cyclictest87450irq/129-enp1s0-09:50:203
2848699202,5cyclictest6527-21ntp_states11:10:203
2848699202,15cyclictest24621-21/usr/sbin/munin10:40:223
2848699201,7cyclictest3259-21/usr/sbin/munin11:05:223
2848699201,6cyclictest0-21swapper/307:19:393
2848699201,5cyclictest13631-21/usr/sbin/munin10:15:133
2848699200,10cyclictest0-21swapper/311:54:163
2848299209,7cyclictest23417-21systemd-journal09:20:312
2848299207,5cyclictest12050irq/123-ahci[0008:05:022
2847699209,3cyclictest4565-21diskstats08:40:141
2847699201,5cyclictest800-21snmpd10:50:171
28476992013,2cyclictest0-21swapper/110:06:431
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional