You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 21:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Wed Dec 24, 2025 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12912239163,25sleep00-21swapper/007:09:360
9812204168,24sleep20-21swapper/207:05:352
11632202166,24sleep10-21swapper/107:07:561
13152200164,24sleep30-21swapper/307:09:523
1027121850,3sleep1141399cyclictest12:20:211
14199910399,3cyclictest0-21swapper/207:28:302
141999103100,2cyclictest0-21swapper/211:59:122
1419999289,2cyclictest0-21swapper/212:31:262
277652710,1sleep30-21swapper/309:20:173
143872530,6sleep339-21rcuc/307:35:233
141399491,15cyclictest0-21swapper/112:11:401
1419994016,16cyclictest10150-21/usr/sbin/munin09:55:282
1419994013,13cyclictest21684-21latency_hist11:35:022
141399394,7cyclictest24330-40dnf09:10:301
141399382,33cyclictest1112-21munin-run09:35:011
1419993713,12cyclictest11165-21sh12:25:012
1419993712,14cyclictest11398-21/usr/sbin/munin12:25:152
1419993711,14cyclictest0-21swapper/207:49:322
275072360,1sleep20-21swapper/209:20:162
1419993613,13cyclictest499-21uname10:45:172
1419993613,12cyclictest29320-21/usr/sbin/munin09:25:132
1419993612,21cyclictest31312-21tune2fs08:15:152
1419993612,14cyclictest26977-21timerwakeupswit10:30:262
1419993611,14cyclictest13934-21uptime10:00:292
1413993615,4cyclictest13623-21cut11:15:161
141399361,19cyclictest11846-21ntp_states11:10:221
1405993611,12cyclictest6782-21munin-run12:15:000
1419993512,13cyclictest17373-21/usr/sbin/munin11:25:262
1419993511,14cyclictest2587-21gunzip09:35:272
140599351,27cyclictest0-21swapper/008:06:460
141999342,20cyclictest12455-21kworker/2:008:10:472
1419993415,10cyclictest9538-21users09:50:282
1419993413,8cyclictest645-21/usr/sbin/munin08:20:132
1419993413,8cyclictest16422-21memory07:40:192
1419993412,10cyclictest16035-21unixbench-2d10:05:252
1419993411,13cyclictest13344-21fschecks_count11:15:142
1419993410,13cyclictest19389-21ntpq09:00:232
1419993410,13cyclictest19389-21ntpq09:00:232
141399345,18cyclictest0-21swapper/111:08:441
141999338,14cyclictest0-21swapper/211:00:012
1419993314,9cyclictest3051-21ntp_states10:50:222
1419993310,7cyclictest15277-21latency_hist07:40:022
1419993310,13cyclictest1926-21awk12:00:262
141399334,3cyclictest0-21swapper/112:15:351
1413993317,3cyclictest12767-21timerandwakeup12:25:251
1413993316,2cyclictest0-21swapper/107:27:531
140599331,26cyclictest0-21swapper/007:27:090
141999329,14cyclictest0-21swapper/207:10:172
1419993215,6cyclictest23468-21tr10:25:112
1419993214,7cyclictest12857-21taskset07:32:142
1419993213,8cyclictest22211-21ntp_states10:20:212
141399321,10cyclictest397-21latency_hist08:20:021
140599322,14cyclictest23127-21munin-run10:25:020
140599321,24cyclictest0-21swapper/011:18:560
140599321,23cyclictest22502-21diskmemload10:33:040
140599321,23cyclictest0-21swapper/009:56:070
140599321,22cyclictest0-21swapper/010:43:020
140599321,15cyclictest7116-21munin-run08:35:020
141999319,9cyclictest0-21swapper/210:35:182
141999319,12cyclictest0-21swapper/209:20:022
141999318,10cyclictest10975-21expr11:10:122
1419993112,12cyclictest0-21swapper/212:11:092
141399312,7cyclictest30555-21/usr/sbin/munin11:55:251
141399311,7cyclictest0-21swapper/109:27:311
141399311,12cyclictest0-21swapper/110:40:351
141399311,12cyclictest0-21swapper/109:04:161
141399311,12cyclictest0-21swapper/109:04:161
140599311,23cyclictest16813-21kworker/0:211:25:250
140599311,23cyclictest0-21swapper/012:05:330
141999309,9cyclictest835-21runrttasks10:41:002
141999309,7cyclictest22502-21diskmemload11:47:432
141999308,7cyclictest0-21swapper/211:40:162
141999308,12cyclictest22502-21diskmemload10:19:072
141999308,12cyclictest22502-21diskmemload10:19:072
141999308,10cyclictest0-21swapper/211:05:002
141999302,23cyclictest12455-21kworker/2:007:56:392
1419993020,7cyclictest23077-21/usr/sbin/munin09:10:152
1419993014,8cyclictest3906-21diskstats09:40:152
1419993010,12cyclictest8250-21mailstats12:15:232
141399308,3cyclictest0-21swapper/110:56:121
141399301,9cyclictest16993-21expr10:10:141
141399301,14cyclictest0-21swapper/109:53:211
141399301,11cyclictest0-21swapper/110:01:071
141399301,10cyclictest22502-21diskmemload11:04:041
141399300,15cyclictest0-21swapper/111:36:281
141399300,14cyclictest0-21swapper/108:24:161
141399300,14cyclictest0-21swapper/107:50:391
141399300,14cyclictest0-21swapper/107:50:391
141399300,12cyclictest0-21swapper/111:48:121
140599301,14cyclictest30555-21/usr/sbin/munin11:55:170
140599301,14cyclictest0-21swapper/010:58:480
140599301,13cyclictest0-21swapper/008:44:380
141999296,13cyclictest87250irq/129-enp1s0-08:45:212
1419992919,7cyclictest25364-21/usr/sbin/munin08:00:212
1419992913,7cyclictest4528-21/usr/sbin/munin07:15:152
1419992912,5cyclictest15174-21/usr/sbin/munin11:20:252
1419992911,6cyclictest801-21snmpd10:12:212
1419992911,5cyclictest0-21swapper/212:10:022
141399297,4cyclictest19294-21df_inode10:15:141
141399297,4cyclictest19294-21df_inode10:15:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional