You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 01:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Thu Nov 27, 2025 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33562242166,24sleep30-21swapper/307:07:283
32772228163,52sleep20-21swapper/207:06:262
35432210136,24sleep10-21swapper/107:09:511
34682210181,19sleep00-21swapper/007:08:530
2158921580,5sleep3366499cyclictest11:29:563
1053721240,3sleep3366499cyclictest12:15:243
294322990,3sleep2365799cyclictest11:45:202
128852770,4sleep1365199cyclictest12:20:251
261242620,9sleep341-21ksoftirqd/310:25:133
124312610,2sleep00-21swapper/009:55:110
152422570,3sleep20-21swapper/210:00:162
95142540,2sleep00-21swapper/012:15:140
3664994427,10cyclictest0-21swapper/309:34:013
113702380,2sleep10-21swapper/107:25:121
366499371,25cyclictest0-21swapper/311:49:193
365799364,4cyclictest31439-21cat10:35:252
366499351,27cyclictest0-21swapper/309:28:413
366499351,23cyclictest0-21swapper/311:23:273
366499351,15cyclictest0-21swapper/311:35:013
366499351,14cyclictest0-21swapper/312:38:253
365799352,5cyclictest2453-40dnf08:16:332
3657993514,18cyclictest24045-21gltestperf10:20:162
120822350,5sleep0364499cyclictest09:53:590
366499341,14cyclictest0-21swapper/311:09:133
366499341,14cyclictest0-21swapper/307:49:433
366499341,11cyclictest0-21swapper/307:54:133
365799341,8cyclictest0-21swapper/209:35:212
3657993412,19cyclictest12737-21smart_sda12:20:232
366499331,19cyclictest0-21swapper/312:34:353
366499331,19cyclictest0-21swapper/310:49:173
366499331,19cyclictest0-21swapper/310:49:173
366499331,16cyclictest0-21swapper/309:15:553
366499331,14cyclictest0-21swapper/309:51:013
366499331,13cyclictest0-21swapper/308:16:013
365799339,3cyclictest5171-21/usr/sbin/munin08:25:182
365799337,2cyclictest6185-21cat12:05:232
365799334,3cyclictest20549-21kworker/2:009:49:082
365799333,26cyclictest26289-21turbostat.cron08:00:012
365799332,5cyclictest5109-21smart_sda07:10:242
366499321,15cyclictest0-21swapper/310:44:213
366499321,14cyclictest0-21swapper/312:22:233
366499321,11cyclictest0-21swapper/308:00:153
365799329,3cyclictest28378-21fschecks_time10:30:152
365799328,3cyclictest15873-21/usr/sbin/munin12:30:222
365799325,3cyclictest12050irq/123-ahci[0008:05:132
365799324,5cyclictest30629-21smart_sda09:20:262
365799324,25cyclictest7360-21head09:40:272
365799323,26cyclictest24089-21systemd-journal07:55:022
365799321,8cyclictest25888-21cat10:25:122
365799321,22cyclictest0-21swapper/211:26:102
3657993211,3cyclictest3541-21fschecks_time08:20:132
364499326,12cyclictest4028-21perf10:50:000
364499326,12cyclictest4028-21perf10:50:000
366499311,15cyclictest0-21swapper/310:19:593
366499311,13cyclictest0-21swapper/307:30:213
365799319,3cyclictest848-21sssd_nss08:55:022
365799319,3cyclictest25667-21idleruntime09:10:172
365799319,2cyclictest12399-21/usr/sbin/munin09:55:132
365799318,4cyclictest1552-21/usr/sbin/munin11:55:222
365799312,6cyclictest836-21runrttasks11:18:322
365799312,5cyclictest9896-21smart_sda11:00:242
365799312,4cyclictest11124-40dnf12:18:342
365799311,4cyclictest4573-21df10:50:132
365799311,12cyclictest2982-21grep09:30:282
3657993110,3cyclictest836-21runrttasks11:42:012
3657993110,3cyclictest14297-21gltestperf12:25:142
3651993110,10cyclictest23-21ksoftirqd/111:10:221
366499301,19cyclictest0-21swapper/312:07:093
366499301,19cyclictest0-21swapper/309:11:253
366499301,19cyclictest0-21swapper/308:58:133
366499301,18cyclictest0-21swapper/309:36:533
366499301,15cyclictest0-21swapper/311:43:533
366499301,13cyclictest0-21swapper/312:04:513
366499301,13cyclictest0-21swapper/310:55:153
366499301,13cyclictest0-21swapper/310:14:173
366499301,12cyclictest0-21swapper/310:31:013
366499301,12cyclictest0-21swapper/309:22:053
366499301,12cyclictest0-21swapper/307:15:313
366499301,11cyclictest0-21swapper/312:29:573
366499301,11cyclictest0-21swapper/307:21:333
366499301,10cyclictest0-21swapper/308:38:073
3664993010,3cyclictest0-21swapper/310:05:153
365799309,3cyclictest836-21runrttasks12:02:412
365799309,3cyclictest836-21runrttasks11:34:552
365799308,4cyclictest18975-21/usr/sbin/munin07:40:262
365799307,3cyclictest32444-21grep08:10:242
365799304,3cyclictest86550irq/126-enp1s0-10:45:272
365799304,3cyclictest86550irq/126-enp1s0-10:45:272
365799304,3cyclictest18323-21grep11:20:212
365799304,11cyclictest780-21rngd07:24:012
365799302,3cyclictest15294-21crond07:35:012
365799301,4cyclictest569-21/usr/sbin/munin09:25:262
3657993011,16cyclictest814-21sshd10:58:332
3657993011,16cyclictest21028-21pluginstate07:45:222
365799301,10cyclictest0-21swapper/209:17:442
366499291,9cyclictest0-21swapper/310:24:533
366499291,18cyclictest0-21swapper/307:57:493
366499291,12cyclictest24735-21diskmemload09:55:113
366499291,12cyclictest0-21swapper/309:40:093
366499291,12cyclictest0-21swapper/307:41:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional