You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 05:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Tue May 12, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
571584997114,16cyclictest613016-21/usr/sbin/munin23:10:191
571581996962,3cyclictest584595-21apt-get20:25:010
571581996424,3cyclictest597937-21cut21:40:230
571584996243,14cyclictest231ktimers/119:20:151
571581996221,3cyclictest626784-21diskstats00:30:190
571581996221,3cyclictest626784-21diskstats00:30:190
571581995930,26cyclictest602157-21/usr/sbin/munin22:05:210
571581995929,27cyclictest616100-21/usr/sbin/munin23:25:280
571581995928,4cyclictest616487-21/usr/sbin/munin23:30:110
571581995928,4cyclictest616487-21/usr/sbin/munin23:30:110
571581995926,26cyclictest582314-21/usr/sbin/munin20:10:170
571585995848,7cyclictest311ktimers/222:30:152
571585995848,7cyclictest311ktimers/222:30:152
571581995831,3cyclictest617418-21apt-get23:35:130
571585995745,8cyclictest578590-21munin-plugin-st19:50:012
571581995718,36cyclictest596395-21/usr/sbin/munin21:30:270
57158199571,44cyclictest0-21swapper/020:05:010
571581995621,29cyclictest605134-21latency_hist22:25:030
571581995527,3cyclictest621209-21/usr/sbin/munin23:55:270
571581995526,3cyclictest583393-21meminfo20:15:260
57158199543,43cyclictest0-21swapper/022:50:010
571581995424,3cyclictest572359-21users19:10:290
571581995415,4cyclictest587933-21/usr/sbin/munin20:40:270
571581995322,27cyclictest590815-21cat21:00:010
571581995315,34cyclictest591895-21fschecks_time21:05:210
571581995314,3cyclictest597043-21interrupts21:35:240
571585995239,9cyclictest0-21swapper/221:40:022
571584995242,5cyclictest598381-21munin-plugin-st21:45:001
571581995220,3cyclictest580222-21grep19:55:290
571581995220,28cyclictest606598-21phc2sys22:30:250
571581995220,28cyclictest606598-21phc2sys22:30:250
571581995125,23cyclictest612230-21/usr/sbin/munin23:05:160
571584995041,5cyclictest584599-21munin-plugin-st20:25:001
57158199506,42cyclictest0-21swapper/019:15:200
57158199506,42cyclictest0-21swapper/019:15:200
571581995033,12cyclictest623326-21apt-get00:10:150
571581995025,3cyclictest581673-21irqstats20:05:230
571581995011,3cyclictest625867-21apt-get00:25:170
571585994936,9cyclictest0-21swapper/223:35:002
571585994936,9cyclictest0-21swapper/223:35:002
571581994935,10cyclictest588424-21diskstats20:45:190
571581994934,11cyclictest573733-21apt-get19:20:150
571581994933,11cyclictest599421-21apt-get21:50:140
571581994929,15cyclictest0-21swapper/022:10:150
571581994910,3cyclictest585145-21irqstats20:25:230
571585994837,7cyclictest0-21swapper/223:10:002
571585994833,10cyclictest0-21swapper/223:55:002
571581994839,7cyclictest0-21swapper/000:15:150
57158199483,7cyclictest611112-21cron23:00:010
571581994834,11cyclictest627557-21munin-node00:35:100
571581994832,12cyclictest595413-21meminfo21:25:250
571581994831,12cyclictest577950-21apt-get19:45:160
571581994830,14cyclictest0-21swapper/019:40:140
571581994827,17cyclictest586044-21/usr/sbin/munin20:30:260
571581994821,3cyclictest576427-21perl19:35:210
571581994820,3cyclictest608219-21irqstats22:40:230
571585994734,8cyclictest625612-21grep00:20:302
571585994734,8cyclictest0-21swapper/219:45:002
571585994734,8cyclictest0-21swapper/200:10:272
571584994737,5cyclictest623125-21munin-run00:10:001
57158499473,5cyclictest141rcu_preempt19:45:191
571581994733,11cyclictest619115-21apt-get23:45:160
571581994731,13cyclictest615259-21/usr/sbin/munin23:20:260
571581994731,13cyclictest615259-21/usr/sbin/munin23:20:260
571581994714,29cyclictest614503-21munin-run23:20:000
571581994712,31cyclictest594973-21latency_hist21:25:010
571581994711,8cyclictest621838-21dropbear00:00:200
571584994613,18cyclictest231ktimers/122:20:121
57158199467,3cyclictest603833-21perl22:15:210
571581994633,9cyclictest575852-21/usr/sbin/munin19:30:260
571581994632,9cyclictest620324-21/usr/sbin/munin23:50:260
571581994626,16cyclictest606033-21cat22:30:010
571581994618,3cyclictest622786-21memory00:05:250
571585994538,3cyclictest576907-21sendmail19:40:002
571585994527,10cyclictest0-21swapper/220:15:302
571584994536,4cyclictest14-21rcu_preempt21:50:181
571584994525,13cyclictest231ktimers/121:15:151
571584994525,12cyclictest231ktimers/122:45:141
571581994534,8cyclictest574932-21/usr/sbin/munin19:25:270
571581994534,7cyclictest611866-21grep23:00:300
571581994530,12cyclictest607180-21/usr/sbin/munin22:35:190
571581994527,15cyclictest625366-21/usr/sbin/munin00:20:270
571584994425,12cyclictest0-21swapper/119:15:001
571581994430,11cyclictest610073-21/usr/sbin/munin22:50:290
571581994421,19cyclictest599156-21grep21:45:290
571581994421,19cyclictest599156-21grep21:45:290
571585994333,5cyclictest590633-21unixbench_singl20:55:292
571585994332,6cyclictest0-21swapper/200:25:302
571584994339,2cyclictest0-21swapper/120:40:011
571581994336,3cyclictest578789-21apt-get19:50:130
571581994329,10cyclictest0-21swapper/023:40:150
571581994327,11cyclictest594013-21grep21:15:290
571585994236,4cyclictest311ktimers/220:30:162
571585994226,9cyclictest0-21swapper/200:05:292
571581994235,3cyclictest613019-21apt-get23:10:140
571581994234,5cyclictest589566-21/usr/sbin/munin20:50:280
571581994233,5cyclictest601727-21users22:00:310
571581994231,8cyclictest593092-21grep21:10:310
571581994230,9cyclictest600530-21/usr/sbin/munin21:55:230
571581994229,10cyclictest591335-21/usr/sbin/munin21:00:280
571581994226,11cyclictest587123-21grep20:35:290
57158599415,11cyclictest5715781cyclictest19:10:152
571585994127,7cyclictest0-21swapper/220:25:292
571585994123,11cyclictest0-21swapper/223:55:302
571584994126,11cyclictest0-21swapper/120:40:011
571584994124,11cyclictest231ktimers/123:50:121
571584994118,16cyclictest231ktimers/119:35:111
571585994031,6cyclictest311ktimers/219:55:122
571585994031,4cyclictest311ktimers/223:10:112
571585994028,7cyclictest0-21swapper/223:35:282
571585994027,7cyclictest0-21swapper/220:40:012
571585994023,10cyclictest0-21swapper/220:00:192
57158499406,20cyclictest22-21rcuc/121:30:181
571584994027,7cyclictest0-21swapper/119:40:281
57158499401,13cyclictest0-21swapper/121:30:021
571585993930,4cyclictest628099-21grep00:35:292
571585993926,9cyclictest0-21swapper/221:20:282
571585993923,8cyclictest0-21swapper/223:25:022
571585993923,8cyclictest0-21swapper/223:25:022
571585993922,11cyclictest605027-21grep22:20:272
571584993932,4cyclictest14-21rcu_preempt21:35:241
571584993931,5cyclictest599221-21munin-plugin-st21:50:001
571584993931,5cyclictest599221-21munin-plugin-st21:50:001
571584993931,4cyclictest0-21swapper/122:50:231
571584993929,5cyclictest0-21swapper/120:00:001
571584993927,8cyclictest0-21swapper/122:00:001
571584993924,8cyclictest0-21swapper/120:55:291
571584993921,13cyclictest231ktimers/123:15:121
57158599387,26cyclictest30-21rcuc/220:20:282
571585993831,4cyclictest608602-21munin-plugin-st22:45:002
571585993831,4cyclictest14-21rcu_preempt20:40:112
571585993829,5cyclictest0-21swapper/221:40:302
571585993829,5cyclictest0-21swapper/219:20:202
571585993824,8cyclictest0-21swapper/221:45:292
571585993824,8cyclictest0-21swapper/221:45:292
571585993824,6cyclictest0-21swapper/223:40:282
571585993822,8cyclictest0-21swapper/223:00:262
571584993824,8cyclictest0-21swapper/119:30:271
571584993824,10cyclictest0-21swapper/122:40:001
571584993822,8cyclictest0-21swapper/122:55:281
571584993819,13cyclictest231ktimers/120:10:151
571585993732,3cyclictest311ktimers/220:45:122
571585993730,5cyclictest311ktimers/222:15:262
571585993729,5cyclictest609438-21apt22:50:002
571585993729,4cyclictest0-21swapper/221:35:002
571585993729,4cyclictest0-21swapper/219:25:292
571585993727,6cyclictest599948-21grep21:50:272
571585993726,6cyclictest589770-21grep20:50:302
571585993726,5cyclictest614503-21munin-plugin-st23:19:592
571585993725,8cyclictest0-21swapper/221:55:212
571585993725,8cyclictest0-21swapper/219:15:272
571585993725,8cyclictest0-21swapper/219:15:272
57158599372,29cyclictest1660-21snmpd21:15:232
571585993715,13cyclictest0-21swapper/221:10:222
571585993710,14cyclictest0-21swapper/219:10:012
571584993728,5cyclictest0-21swapper/120:15:271
571584993723,11cyclictest231ktimers/123:55:121
571584993722,9cyclictest0-21swapper/121:05:201
571585993623,5cyclictest0-21swapper/222:05:212
571585993622,10cyclictest0-21swapper/219:50:292
571585993610,10cyclictest602793-21/usr/sbin/munin22:10:192
571584993629,3cyclictest0-21swapper/122:05:291
571584993628,4cyclictest0-21swapper/100:20:011
571584993627,5cyclictest605999-21apt-config22:30:011
571584993624,9cyclictest0-21swapper/120:25:271
571584993620,10cyclictest0-21swapper/100:25:221
571584993616,14cyclictest231ktimers/123:20:101
571584993616,14cyclictest231ktimers/123:20:101
571585993527,5cyclictest311ktimers/220:05:162
571585993525,7cyclictest605860-21grep22:25:302
571585993525,6cyclictest311ktimers/222:35:182
571585993524,7cyclictest619689-21grep23:45:292
571585993524,7cyclictest0-21swapper/219:35:002
571585993524,7cyclictest0-21swapper/200:30:292
571585993524,7cyclictest0-21swapper/200:30:292
571585993522,8cyclictest0-21swapper/200:00:292
571585993513,15cyclictest167550irq/134-8000000.ethernet-tx221:27:192
57158599351,28cyclictest615645-21/usr/sbin/munin23:25:262
571584993526,4cyclictest0-21swapper/119:20:011
571584993526,4cyclictest0-21swapper/119:20:011
571584993513,11cyclictest617224-21cat23:35:021
571584993513,11cyclictest617224-21cat23:35:021
57158499351,28cyclictest0-21swapper/123:40:241
571585993425,5cyclictest311ktimers/221:03:152
571585993423,5cyclictest601665-21grep22:00:302
571584993425,6cyclictest0-21swapper/100:00:281
571584993425,4cyclictest0-21swapper/122:40:171
571581993418,11cyclictest0-21swapper/019:10:010
571584993323,5cyclictest0-21swapper/123:35:281
571584993319,8cyclictest22-21rcuc/122:10:241
571584993315,14cyclictest231ktimers/122:15:101
571584993315,12cyclictest231ktimers/120:05:141
57158499331,4cyclictest0-21swapper/119:25:191
57158499331,26cyclictest0-21swapper/123:05:231
57158499328,14cyclictest580573-21/usr/sbin/munin20:00:181
571584993224,5cyclictest14-21rcu_preempt00:20:221
571584993224,5cyclictest0-21swapper/120:30:171
571584993223,5cyclictest0-21swapper/122:30:201
571584993223,5cyclictest0-21swapper/122:30:201
571584993220,8cyclictest0-21swapper/123:45:271
571584993216,8cyclictest0-21swapper/119:55:011
57158499321,28cyclictest616265-21sshd23:26:361
571585993125,5cyclictest311ktimers/222:50:362
571585993124,5cyclictest311ktimers/200:15:142
571585993122,7cyclictest311ktimers/221:05:122
571585993118,8cyclictest311ktimers/222:55:112
571584993122,6cyclictest0-21swapper/123:00:291
571584993120,8cyclictest0-21swapper/100:35:231
571585993022,5cyclictest311ktimers/220:10:282
571584993015,10cyclictest231ktimers/120:50:121
571584993014,5cyclictest0-21swapper/121:25:021
571584992920,5cyclictest0-21swapper/121:00:291
57158499291,2cyclictest0-21swapper/121:15:001
57158499291,25cyclictest588352-21/usr/sbin/munin20:45:271
571584992819,7cyclictest22-21rcuc/122:00:271
57158499281,25cyclictest0-21swapper/100:10:261
571584992619,5cyclictest626951-21if_eth100:30:231
571584992619,5cyclictest626951-21if_eth100:30:231
571584992012,4cyclictest0-21swapper/119:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional