You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 21:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Thu Dec 04, 2025 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
278382240165,24sleep30-21swapper/307:07:323
277012237162,24sleep10-21swapper/107:05:441
278812236163,24sleep00-21swapper/007:08:040
278832235161,24sleep20-21swapper/207:08:072
2813499108105,2cyclictest0-21swapper/209:36:342
300772620,3sleep30-21swapper/308:25:143
265542560,4sleep081ktimersoftd/009:30:180
28134994633,2cyclictest0-21swapper/209:06:192
2813499451,14cyclictest2746-21kworker/2:107:40:182
28122994211,14cyclictest3026-21munin-run07:25:010
28129994011,26cyclictest20842-21/usr/sbin/munin08:05:261
2812999394,8cyclictest9634-40dnf12:31:141
2812999393,2cyclictest86850irq/129-enp1s0-09:10:021
2812999383,2cyclictest4508-21/usr/sbin/munin09:55:171
2812999373,16cyclictest25866-40dnf09:30:161
28138993620,5cyclictest0-21swapper/310:27:213
2812999362,4cyclictest27438-21/usr/sbin/munin08:20:181
2812999361,10cyclictest1571-21cat08:35:021
2812999351,9cyclictest0-21swapper/112:11:571
2812999351,8cyclictest0-21swapper/109:35:431
2812999351,10cyclictest15115-21sed07:50:191
28134993414,4cyclictest25290-21kworker/2:110:09:532
2812999348,3cyclictest11238-21ntp_states12:35:221
2812999341,10cyclictest22733-21smart_sda09:20:251
28138993222,3cyclictest0-21swapper/311:46:153
2813499321,10cyclictest0-21swapper/212:31:092
28129993213,3cyclictest0-21swapper/107:40:401
2812999321,18cyclictest21047-21awk10:30:231
2812999321,14cyclictest0-21swapper/109:45:261
2812999321,11cyclictest1362-21/usr/sbin/munin12:15:271
2813499318,3cyclictest0-21swapper/208:55:262
2812999312,2cyclictest86850irq/129-enp1s0-11:39:361
2812999311,9cyclictest0-21swapper/111:49:321
2812999311,16cyclictest0-21swapper/111:08:241
2812999311,12cyclictest0-21swapper/110:29:541
2812999310,16cyclictest0-21swapper/107:47:471
135002310,4sleep339-21rcuc/307:45:243
28129993012,4cyclictest0-21swapper/111:55:351
2812999300,16cyclictest0-21swapper/109:52:291
2812999300,15cyclictest780-21rngd08:03:161
2812999300,15cyclictest0-21swapper/110:42:391
2812999300,15cyclictest0-21swapper/108:18:441
2812299304,13cyclictest25012-21munin-run08:15:010
2812299301,13cyclictest0-21swapper/007:35:130
2813899295,3cyclictest86850irq/129-enp1s0-07:40:153
2813499297,3cyclictest0-21swapper/209:43:262
2813499297,3cyclictest0-21swapper/209:43:252
2812999298,3cyclictest86750irq/128-enp1s0-08:42:161
28129992913,2cyclictest0-21swapper/107:26:031
2813499286,3cyclictest2746-21kworker/2:107:46:162
2812999281,14cyclictest0-21swapper/110:05:181
2813899277,4cyclictest780-21rngd12:30:193
2813899275,10cyclictest780-21rngd12:20:093
2813899271,6cyclictest0-21swapper/308:14:233
2813499275,3cyclictest7957-21kworker/2:208:49:532
2813499275,2cyclictest25290-21kworker/2:110:58:152
2812999278,2cyclictest86750irq/128-enp1s0-07:10:571
2812999276,2cyclictest0-21swapper/107:55:201
28129992716,3cyclictest30993-21sort08:25:251
28129992710,3cyclictest16847-21diskmemload11:34:461
2812299272,20cyclictest7-21ksoftirqd/010:05:520
2813499266,3cyclictest0-21swapper/207:55:262
2813499262,11cyclictest7957-21kworker/2:209:00:562
2812999265,5cyclictest780-21rngd11:24:581
2812999261,11cyclictest0-21swapper/107:35:101
2812999261,10cyclictest0-21swapper/109:00:301
2812999260,13cyclictest0-21swapper/108:36:581
2812999260,13cyclictest0-21swapper/108:36:581
2812299261,13cyclictest22506-21munin-run11:50:010
2813899257,4cyclictest780-21rngd07:10:083
2813899256,3cyclictest780-21rngd11:19:153
2813899254,10cyclictest780-21rngd11:41:353
2813499254,2cyclictest86750irq/128-enp1s0-09:55:372
2813499252,4cyclictest25290-21kworker/2:110:24:112
2812999252,3cyclictest1401-21hddtemp_smartct11:00:181
2812999252,12cyclictest0-21swapper/110:24:361
28129992513,2cyclictest0-21swapper/112:00:541
2813899242,4cyclictest28993-21memory09:35:213
28138992419,2cyclictest148752sleep309:05:133
28138992412,3cyclictest4423-21ps07:25:233
28138992410,3cyclictest0-21swapper/309:21:533
2813899240,9cyclictest0-21swapper/308:20:263
2813499248,3cyclictest2746-21kworker/2:107:40:022
2813499245,4cyclictest25290-21kworker/2:111:10:172
2813499245,3cyclictest2746-21kworker/2:107:51:142
2813499245,11cyclictest30-21rcuc/207:14:202
2813499244,3cyclictest86550irq/126-enp1s0-12:10:252
28134992414,2cyclictest25290-21kworker/2:112:07:352
2813499241,11cyclictest0-21swapper/209:45:572
2813499241,10cyclictest0-21swapper/211:46:372
2813499241,10cyclictest0-21swapper/210:50:292
2813499241,10cyclictest0-21swapper/210:30:132
2812999241,8cyclictest780-21rngd12:26:161
2812999241,6cyclictest0-21swapper/112:20:261
2812999241,11cyclictest16847-21diskmemload09:25:101
2812999240,12cyclictest0-21swapper/107:17:551
2812299247,10cyclictest0-21swapper/010:02:060
2812299240,9cyclictest1115-21kworker/0:308:49:050
2813899237,5cyclictest1362-21/usr/sbin/munin12:15:253
2813899236,3cyclictest0-21swapper/310:20:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional