You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 02:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Tue Dec 09, 2025 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
125592236163,24sleep20-21swapper/219:07:232
108002236164,59sleep30-21swapper/319:05:093
126342204165,25sleep00-21swapper/019:08:200
107982203164,25sleep10-21swapper/119:05:081
2543021500,4sleep01285599cyclictest20:50:130
12867999693,2cyclictest0-21swapper/221:42:222
198282580,3sleep20-21swapper/220:35:212
72622570,1sleep30-21swapper/322:35:183
72622570,1sleep30-21swapper/322:35:183
54112530,4sleep15410-21cat20:05:021
172662530,1sleep10-21swapper/100:10:211
226372510,1sleep00-21swapper/021:55:200
1286799401,27cyclictest18702-21cstates00:15:162
1286799365,20cyclictest17419-21expr21:45:132
1286799361,23cyclictest14097-21/usr/sbin/munin00:05:172
1286799352,3cyclictest86550irq/126-enp1s0-23:30:162
1285599355,14cyclictest7551-21munin-run20:10:020
1286799342,3cyclictest12050irq/123-ahci[0023:45:012
1286799342,3cyclictest12050irq/123-ahci[0023:45:012
1286799342,27cyclictest1857-40dnf22:20:342
1286799341,5cyclictest2449-21/usr/sbin/munin22:25:212
1286799341,5cyclictest19882-21fschecks_time21:50:152
1286799341,19cyclictest86550irq/126-enp1s0-23:25:162
1286799341,19cyclictest10606-21/usr/sbin/munin21:30:182
1286799331,7cyclictest13059-21expr21:35:152
1286799331,7cyclictest13059-21expr21:35:142
1286799331,6cyclictest25796-21idleruntime-cro22:05:022
1286799331,6cyclictest21531-21grep20:40:152
1286799331,6cyclictest11238-21/usr/sbin/munin22:45:172
1286799331,3cyclictest11638-21latency_hist00:00:022
1286799328,20cyclictest15778-21cpuspeed_turbos22:55:162
1286799322,26cyclictest26432-21ntp_states20:50:212
1286799321,2cyclictest0-21swapper/200:40:022
12867993212,17cyclictest25106-21/usr/sbin/munin00:30:302
1286799321,20cyclictest32-21ksoftirqd/222:05:132
1286799321,18cyclictest23838-21users23:10:282
1287299316,17cyclictest22464-40dnf00:22:293
1286799313,24cyclictest28332-40dnf23:21:322
1286799313,23cyclictest14380-21/usr/sbin/munin20:25:292
1286799312,3cyclictest12050irq/123-ahci[0022:55:022
1286799312,25cyclictest5924-21diskstats20:05:162
1286799311,5cyclictest0-21swapper/200:00:172
1286799311,4cyclictest0-21swapper/221:20:142
1286799311,26cyclictest19380-21grep23:00:262
12867993112,16cyclictest2975-21cat23:40:022
1286799307,20cyclictest28381-21irqstats20:55:222
1286799306,20cyclictest16949-21gltestperf00:10:182
1286799305,22cyclictest8740-21df21:25:132
1286799304,22cyclictest5121-21fschecks_time22:30:172
1286799303,15cyclictest86750irq/128-enp1s0-19:30:162
1286799302,23cyclictest2234-21ntp_states19:55:222
1286799302,23cyclictest15066-21munin-node19:15:012
1286799301,3cyclictest27931-21grep19:40:202
1286799301,3cyclictest17863-40dnf19:19:342
1286799301,3cyclictest17276-21idleruntime20:30:162
1286799301,3cyclictest17276-21idleruntime20:30:162
1286799301,3cyclictest12174-21/usr/sbin/munin20:20:192
1286799301,2cyclictest86750irq/128-enp1s0-19:35:192
1286799301,2cyclictest7822-21df_inode23:50:162
1286799301,26cyclictest9744-21latency_hist20:15:002
1286799301,24cyclictest2885-21ntp_states21:10:252
12867993012,15cyclictest21317-21expr00:20:172
1286799301,20cyclictest5279-21/usr/sbin/munin23:45:282
1286799300,5cyclictest0-21swapper/222:10:142
12855993011,16cyclictest18283-21munin-run00:15:010
1287299299,9cyclictest10606-21/usr/sbin/munin21:30:193
1286799296,20cyclictest10045-21netstat22:40:202
1286799292,4cyclictest31747-21munin-run21:05:012
1286799292,23cyclictest4360-21diskstats21:15:152
1286799292,23cyclictest3741-21uniq20:00:162
1286799292,23cyclictest21310-21smart_sda23:05:262
1286799292,22cyclictest23550-21sed00:25:182
1286799291,6cyclictest0-21swapper/223:18:372
1286799291,4cyclictest31128-21/usr/sbin/munin22:15:182
1286799291,4cyclictest11311-21/usr/sbin/munin20:15:242
12867992913,14cyclictest21843-21grep19:25:252
1286799291,2cyclictest31971-21/usr/sbin/munin21:05:132
12867992911,15cyclictest836-21runrttasks19:21:252
1286299297,8cyclictest3509-21fschecks_count23:40:151
1286299297,8cyclictest3509-21fschecks_count23:40:151
1287299280,21cyclictest12132-21cstates00:00:143
1286799284,21cyclictest29197-21cpuspeed_turbos19:45:122
1286799281,4cyclictest24076-21/usr/sbin/munin20:45:202
1286799281,3cyclictest7937-21/usr/sbin/munin22:35:252
1286799281,3cyclictest7937-21/usr/sbin/munin22:35:252
1286799281,3cyclictest21948-21chrt21:55:132
1286799281,2cyclictest31331-21/usr/sbin/munin19:50:172
1286299281,10cyclictest1590-21diskmemload22:30:231
211752270,3sleep081ktimersoftd/000:20:150
1287299278,3cyclictest15868-21sshd00:07:283
1287299276,3cyclictest28849-21/usr/sbin/munin23:25:203
1287299275,14cyclictest2589-21runrttasks23:36:483
1287299271,10cyclictest20489-21idleruntime-cro00:20:023
1286299271,16cyclictest1590-21diskmemload21:49:241
1286299271,10cyclictest0-21swapper/123:30:491
1287299264,7cyclictest0-21swapper/321:50:423
1287299260,18cyclictest17380-21ntp_states00:10:243
1287299260,16cyclictest26040-21users23:15:293
1287299260,16cyclictest0-21swapper/321:25:223
1287299260,15cyclictest0-21swapper/319:37:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional