You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 19:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Thu Dec 04, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
421219998222,56cyclictest0-21swapper/211:35:012
421219997820,38cyclictest0-21swapper/207:15:022
42121999779,63cyclictest0-21swapper/208:15:002
421219996928,28cyclictest435262-21/usr/sbin/munin08:30:192
42121499691,57cyclictest0-21swapper/007:45:100
421219996834,28cyclictest432721-21/usr/sbin/munin08:15:182
421219996834,28cyclictest432721-21/usr/sbin/munin08:15:182
421214996847,14cyclictest14-21rcu_preempt10:15:010
421214996847,14cyclictest14-21rcu_preempt10:15:000
421214996327,4cyclictest0-21swapper/007:55:270
421219996234,15cyclictest0-21swapper/207:20:142
421219996224,32cyclictest0-21swapper/209:15:282
42121699619,21cyclictest22-21rcuc/108:55:021
42121999609,35cyclictest0-21swapper/207:30:182
421219995942,11cyclictest461225-21apt-get11:00:172
421219995942,11cyclictest461225-21apt-get11:00:172
421219995936,15cyclictest0-21swapper/208:40:162
421219995933,16cyclictest0-21swapper/208:35:142
421219995842,10cyclictest0-21swapper/208:00:002
421219995840,10cyclictest437892-21apt-get08:45:162
421219995839,14cyclictest0-21swapper/211:20:162
421219995747,5cyclictest446303-21munin-plugin-st09:35:002
421219995739,14cyclictest0-21swapper/210:05:142
421219995739,10cyclictest446503-21apt-get09:35:192
421219995736,15cyclictest0-21swapper/211:50:142
421219995735,14cyclictest0-21swapper/212:20:122
421219995645,6cyclictest444827-21apt-get09:25:172
421219995638,11cyclictest449036-21munin-node09:50:112
421219995632,13cyclictest0-21swapper/210:25:132
421219995535,14cyclictest0-21swapper/209:40:142
421219995535,13cyclictest0-21swapper/208:55:192
421219995534,12cyclictest0-21swapper/211:35:132
421219995533,14cyclictest0-21swapper/212:15:142
421219995528,20cyclictest450114-21/usr/sbin/munin09:55:232
421219995444,7cyclictest454291-21/usr/sbin/munin10:20:212
421219995444,7cyclictest454291-21/usr/sbin/munin10:20:212
421219995440,5cyclictest431344-21meminfo08:05:262
421219995439,10cyclictest0-21swapper/211:15:152
421219995433,12cyclictest0-21swapper/210:35:142
421219995433,10cyclictest428906-21/usr/sbin/munin07:50:272
421219995429,16cyclictest434113-21grep08:20:292
421219995421,4cyclictest452805-21memory10:10:252
42121499542,20cyclictest478003-21gpgv12:40:010
42121499541,27cyclictest15-21rcuc/012:20:010
421219995344,5cyclictest450738-21apt-get10:00:142
421219995343,5cyclictest448199-21apt-get09:45:162
421219995339,10cyclictest0-21swapper/210:50:142
421219995337,12cyclictest0-21swapper/211:05:132
421219995332,12cyclictest473557-21/usr/sbin/munin12:10:282
421219995330,13cyclictest460418-21/usr/sbin/munin10:55:192
421219995330,12cyclictest0-21swapper/212:05:132
421219995326,19cyclictest439400-21grep08:55:012
42121699535,8cyclictest0-21swapper/108:10:011
421214995342,5cyclictest464362-21kworker/u8:0+events_power_efficient11:55:110
421214995342,5cyclictest464362-21kworker/u8:0+events_power_efficient11:55:100
421219995240,8cyclictest0-21swapper/209:00:122
421219995240,7cyclictest463259-21/usr/sbin/munin11:10:272
421219995239,7cyclictest430825-21sshd08:02:222
421219995239,7cyclictest430825-21sshd08:02:222
421219995238,10cyclictest0-21swapper/212:25:142
421219995237,8cyclictest471698-21/usr/sbin/munin12:00:232
421219995236,8cyclictest423076-21/usr/sbin/munin07:15:292
421219995235,11cyclictest443985-21munin-node09:20:112
421219995230,14cyclictest456336-21/usr/sbin/munin10:30:262
421219995230,14cyclictest0-21swapper/212:30:142
421219995229,12cyclictest0-21swapper/207:45:112
421216995239,8cyclictest474509-21grep12:15:281
421219995139,9cyclictest0-21swapper/211:25:132
421219995136,10cyclictest424296-21apt-get07:25:162
421219995130,11cyclictest0-21swapper/210:40:142
421219995037,9cyclictest453424-21/usr/sbin/munin10:15:202
421219995037,9cyclictest453424-21/usr/sbin/munin10:15:202
421219995036,8cyclictest0-21swapper/207:40:232
421219995036,11cyclictest0-21swapper/211:55:122
421219995036,11cyclictest0-21swapper/211:55:122
421219995035,10cyclictest425970-21munin-node07:35:112
421219995025,15cyclictest0-21swapper/211:45:212
421219994941,4cyclictest434426-21apt-get08:25:122
421219994933,10cyclictest459029-21ptp4l-jitter10:45:272
421219994923,15cyclictest477337-21munin-node12:35:122
421216994838,5cyclictest456577-21grep10:30:291
421216994822,12cyclictest231ktimers/109:10:131
421216994821,12cyclictest14-21rcu_preempt07:45:001
421214994836,8cyclictest0-21swapper/008:15:000
42121499481,11cyclictest0-21swapper/011:40:010
421219994734,10cyclictest441445-21/usr/sbin/munin09:05:132
421219994734,10cyclictest441445-21/usr/sbin/munin09:05:122
421219994729,14cyclictest442897-21/usr/sbin/munin09:10:302
42121699473,16cyclictest22-21rcuc/109:35:011
42121699466,14cyclictest22-21rcuc/109:40:011
42121699461,10cyclictest0-21swapper/111:45:001
42121499461,10cyclictest0-21swapper/010:15:010
421219994529,10cyclictest468503-21grep11:40:292
421216994530,10cyclictest0-21swapper/107:20:221
421216994523,14cyclictest231ktimers/111:00:141
421216994523,14cyclictest231ktimers/111:00:141
421214994530,11cyclictest0-21swapper/007:25:270
421214994529,13cyclictest131ktimers/008:50:150
421214994432,8cyclictest0-21swapper/010:30:280
421219994323,14cyclictest421302-21latency_hist07:10:012
421216994326,13cyclictest231ktimers/110:15:131
421216994326,13cyclictest231ktimers/110:15:131
421216994324,14cyclictest231ktimers/108:45:121
421214994337,3cyclictest21050irq/252-8000000.ethernet12:10:270
421214994330,9cyclictest0-21swapper/007:15:000
421214994313,6cyclictest15-21rcuc/008:20:290
42121499431,32cyclictest0-21swapper/011:20:160
421216994233,6cyclictest465144-21grep11:20:311
421216994229,9cyclictest0-21swapper/111:10:291
421214994235,4cyclictest0-21swapper/008:45:110
421216994132,6cyclictest14-21rcu_preempt09:05:271
421216994132,6cyclictest14-21rcu_preempt09:05:271
421216994131,6cyclictest0-21swapper/107:30:291
421216994130,7cyclictest0-21swapper/107:25:291
421214994131,7cyclictest0-21swapper/011:15:310
42121499412,5cyclictest0-21swapper/010:45:200
42121499411,4cyclictest0-21swapper/010:00:130
42121699405,3cyclictest471253-21apt-config12:00:011
42121699405,3cyclictest471253-21apt-config12:00:011
421216994032,4cyclictest14-21rcu_preempt08:35:261
421216994030,7cyclictest0-21swapper/108:30:281
421216994028,8cyclictest0-21swapper/111:25:291
421216994028,7cyclictest0-21swapper/111:15:311
421216994024,11cyclictest231ktimers/111:45:141
42121699402,32cyclictest0-21swapper/108:20:231
421214994031,7cyclictest457466-21sendmail10:40:000
421214994031,5cyclictest0-21swapper/011:40:290
421214994030,6cyclictest0-21swapper/010:55:010
421214994028,8cyclictest0-21swapper/011:50:210
421214994027,9cyclictest0-21swapper/009:10:220
421214994027,10cyclictest0-21swapper/012:30:300
42121499401,4cyclictest449103-21df_inode09:50:180
42121499401,2cyclictest0-21swapper/007:25:020
421216993928,6cyclictest0-21swapper/110:10:291
421216993927,6cyclictest0-21swapper/110:05:271
42121499396,9cyclictest15-21rcuc/009:35:000
421214993933,3cyclictest21050irq/252-8000000.ethernet11:45:300
42121499392,4cyclictest0-21swapper/010:30:000
421214993918,19cyclictest0-21swapper/011:25:220
421214993918,15cyclictest0-21swapper/011:00:190
421214993918,15cyclictest0-21swapper/011:00:190
42121499391,5cyclictest443470-21tail09:15:260
42121499391,30cyclictest0-21swapper/012:30:010
421216993831,4cyclictest168350irq/126-8000000.ethernet-tx108:10:171
421216993827,7cyclictest435008-21grep08:25:271
421216993827,7cyclictest0-21swapper/110:45:291
421216993821,10cyclictest0-21swapper/110:35:311
42121699381,9cyclictest421378-21/usr/sbin/munin07:10:191
42121499384,13cyclictest21250irq/208-8000000.ethernet09:40:010
421214993826,8cyclictest0-21swapper/008:35:010
421216993728,5cyclictest0-21swapper/107:20:001
421216993725,8cyclictest231ktimers/109:00:051
421216993724,9cyclictest0-21swapper/112:10:291
421216993723,8cyclictest0-21swapper/110:20:301
421216993723,8cyclictest0-21swapper/110:20:301
42121699371,30cyclictest0-21swapper/110:50:041
42121699371,30cyclictest0-21swapper/107:45:261
421214993729,5cyclictest21250irq/208-8000000.ethernet10:05:140
421214993728,4cyclictest0-21swapper/008:15:290
421214993728,4cyclictest0-21swapper/008:15:290
421214993726,7cyclictest0-21swapper/009:10:000
421214993726,7cyclictest0-21swapper/009:10:000
42121499371,4cyclictest0-21swapper/009:05:010
42121499371,31cyclictest0-21swapper/008:00:120
42121499371,31cyclictest0-21swapper/008:00:110
421216993629,4cyclictest0-21swapper/109:45:291
421216993628,4cyclictest0-21swapper/108:00:271
421216993628,4cyclictest0-21swapper/108:00:271
421216993626,5cyclictest0-21swapper/110:00:271
421216993624,8cyclictest0-21swapper/107:55:281
42121699361,4cyclictest0-21swapper/112:25:011
421214993630,4cyclictest21250irq/208-8000000.ethernet08:35:170
421214993628,5cyclictest0-21swapper/008:55:330
421214993624,8cyclictest0-21swapper/009:55:290
42121499362,32cyclictest0-21swapper/008:40:210
421214993611,8cyclictest436491-1kworker/0:1H+mmc_complete09:25:020
421214993610,23cyclictest0-21swapper/007:15:060
421216993526,5cyclictest0-21swapper/111:35:291
421216993525,6cyclictest0-21swapper/108:50:211
421216993522,9cyclictest466860-21grep11:30:301
421216993522,7cyclictest231ktimers/108:40:311
421216993522,7cyclictest0-21swapper/107:35:281
421216993517,10cyclictest0-21swapper/112:40:011
42121499353,4cyclictest0-21swapper/010:20:020
42121499353,4cyclictest0-21swapper/010:20:020
421214993527,4cyclictest0-21swapper/009:25:290
421214993526,6cyclictest472047-21grep12:00:290
421214993526,4cyclictest0-21swapper/007:30:210
421216993428,4cyclictest14-21rcu_preempt09:40:191
421216993420,7cyclictest22-21rcuc/112:25:201
42121699341,26cyclictest457449-21apt-get10:40:051
421214993427,4cyclictest447553-21sh09:40:210
42121499342,26cyclictest0-21swapper/011:15:010
42121499341,31cyclictest0-21swapper/008:05:140
421216993327,3cyclictest168350irq/126-8000000.ethernet-tx111:05:141
421216993323,7cyclictest22-21rcuc/110:25:201
421216993323,6cyclictest22-21rcuc/111:50:231
421216993320,7cyclictest22-21rcuc/112:05:231
421214993327,4cyclictest21250irq/208-8000000.ethernet11:30:140
421214993323,7cyclictest0-21swapper/009:45:290
421214993323,7cyclictest0-21swapper/007:35:280
421214993315,6cyclictest450175-1kworker/0:0H+mmc_complete12:25:010
42121499331,29cyclictest458069-21/usr/sbin/munin10:40:250
421216993223,5cyclictest443677-21grep09:15:281
421216993222,7cyclictest231ktimers/109:55:161
421216993220,9cyclictest22-21rcuc/112:00:051
421216993219,7cyclictest231ktimers/110:55:131
421214993226,4cyclictest21250irq/208-8000000.ethernet07:50:220
421214993221,7cyclictest0-21swapper/007:40:290
42121499321,29cyclictest15-21rcuc/008:25:250
42121499321,27cyclictest462495-21ptp4l-jitter11:05:280
421216993122,6cyclictest22-21rcuc/109:50:271
421216993121,6cyclictest0-21swapper/109:20:191
421216993116,11cyclictest0-21swapper/108:15:291
421216993116,11cyclictest0-21swapper/108:15:291
421216993019,8cyclictest231ktimers/112:30:171
42121499301,27cyclictest0-21swapper/012:05:180
42121499301,23cyclictest421209-21cyclictest07:10:000
421216992921,5cyclictest22-21rcuc/109:25:291
421216992918,7cyclictest0-21swapper/107:50:291
42121499281,4cyclictest460982-21sshd10:55:520
421216992610,9cyclictest22-21rcuc/107:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional