You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 11:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sat Mar 21, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
766602996626,34cyclictest0-21swapper/020:30:120
766602996418,42cyclictest798391-21grep22:10:280
766605996355,6cyclictest0-21swapper/223:35:012
766605996355,6cyclictest0-21swapper/223:35:012
766602996124,2cyclictest772268-21diskstats19:40:180
76660499593,22cyclictest0-21swapper/123:55:021
76660299581,29cyclictest0-21swapper/022:45:010
766602995728,5cyclictest766693-21cmp19:10:020
766602995728,4cyclictest821582-21/usr/sbin/munin00:30:180
76660599562,16cyclictest30-21rcuc/221:30:012
766602995624,6cyclictest776488-21diskstats20:05:190
766602995620,8cyclictest792531-21latency_hist21:40:000
766605995513,9cyclictest0-21swapper/220:05:012
766602995514,36cyclictest801763-21grep22:30:270
76660299544,47cyclictest797188-21tail22:05:260
766602995440,7cyclictest791399-21unixbench_multi21:30:270
766602995440,7cyclictest791399-21unixbench_multi21:30:260
766604995342,7cyclictest817946-21munin-plugin-st00:10:001
766602995316,34cyclictest773625-21grep19:45:280
76660499522,10cyclictest0-21swapper/121:55:181
76660299524,46cyclictest0-21swapper/023:35:290
76660299524,46cyclictest0-21swapper/023:35:280
766602995225,3cyclictest806853-21users23:00:270
76660299514,22cyclictest0-21swapper/021:20:010
766604995040,7cyclictest775363-21munin-plugin-st20:00:001
766602995034,12cyclictest795166-21/usr/sbin/munin21:55:100
766602995034,12cyclictest0-21swapper/021:45:120
766602995033,12cyclictest0-21swapper/023:25:120
766602995033,11cyclictest0-21swapper/020:35:150
766602995030,14cyclictest0-21swapper/020:25:120
766602995013,3cyclictest777383-21/usr/sbin/munin20:10:190
766604994930,10cyclictest0-21swapper/120:00:281
766602994931,14cyclictest0-21swapper/000:10:140
766602994929,15cyclictest766909-21/usr/sbin/munin19:10:170
766605994826,15cyclictest311ktimers/200:00:132
766604994838,6cyclictest0-21swapper/122:05:281
766604994834,10cyclictest231ktimers/120:40:131
766602994841,4cyclictest167350irq/118-8000000.ethernet-tx000:00:170
766602994831,11cyclictest0-21swapper/023:10:090
766602994829,14cyclictest0-21swapper/021:40:120
766602994829,14cyclictest0-21swapper/021:40:120
766602994822,3cyclictest786902-21irqstats21:05:230
766602994813,10cyclictest799592-21/usr/sbin/munin22:20:180
766605994736,8cyclictest0-21swapper/220:40:002
766605994734,10cyclictest1283-21cron22:30:012
766605994731,10cyclictest0-21swapper/219:15:012
766605994728,14cyclictest311ktimers/222:45:102
766604994735,5cyclictest0-21swapper/123:50:011
766604994735,5cyclictest0-21swapper/123:50:001
766604994728,9cyclictest0-21swapper/100:10:271
76660499471,5cyclictest0-21swapper/123:30:011
76660299478,36cyclictest809727-21fschecks_count23:20:190
766602994740,4cyclictest167350irq/118-8000000.ethernet-tx020:40:270
766602994733,10cyclictest770297-21munin-plugin-st19:30:000
766602994729,14cyclictest798700-21/usr/sbin/munin22:15:180
766602994728,14cyclictest820359-21/usr/sbin/munin00:20:260
766602994719,4cyclictest819182-21perl00:15:210
766602994716,4cyclictest814477-21munin-run23:50:000
766602994716,4cyclictest814477-21munin-run23:50:000
766602994712,3cyclictest768598-21sendmail19:20:000
766602994710,10cyclictest807692-21users23:05:270
766605994636,5cyclictest793289-21munin-plugin-st21:45:012
766605994636,5cyclictest793289-21munin-plugin-st21:45:002
766605994635,8cyclictest795808-21munin-plugin-st22:00:002
766605994631,12cyclictest311ktimers/219:35:142
766602994633,9cyclictest784106-21apt-get20:50:140
766602994633,9cyclictest784106-21apt-get20:50:140
766602994622,18cyclictest769358-21grep19:20:270
766602994616,27cyclictest779079-21lsblk20:20:200
76660299461,43cyclictest0-21swapper/020:45:100
766605994536,6cyclictest821278-21grep00:25:282
766605994530,10cyclictest311ktimers/219:30:122
766604994533,8cyclictest808866-21fschecks_count23:15:201
766604994529,11cyclictest0-21swapper/123:35:281
766604994529,11cyclictest0-21swapper/123:35:281
766604994527,10cyclictest0-21swapper/121:40:191
766604994527,10cyclictest0-21swapper/121:40:191
766602994534,6cyclictest805066-21grep22:50:290
766602994530,12cyclictest796458-21/usr/sbin/munin22:00:280
766602994518,25cyclictest773949-21/usr/sbin/munin19:50:180
766602994512,31cyclictest0-21swapper/022:25:110
766605994434,7cyclictest311ktimers/221:00:162
766604994428,10cyclictest0-21swapper/120:45:181
76660299446,3cyclictest817377-21diskstats00:05:190
766602994434,7cyclictest803771-21/usr/sbin/munin22:45:160
766602994430,10cyclictest0-21swapper/000:35:110
766602994429,9cyclictest0-21swapper/023:15:110
766602994428,13cyclictest815959-21/usr/sbin/munin23:55:260
766602994425,14cyclictest790597-21grep21:25:280
766602994417,3cyclictest785871-21df_inode21:00:180
766605994335,4cyclictest0-21swapper/223:40:292
766604994335,4cyclictest787275-21cron21:10:001
766604994328,10cyclictest767673-21cpu19:15:021
766602994339,2cyclictest787901-21/usr/sbin/munin21:10:250
766602994334,5cyclictest775576-21apt-get20:00:150
766602994331,9cyclictest778530-21/usr/sbin/munin20:15:260
766602994328,11cyclictest0-21swapper/023:30:150
766602994324,3cyclictest820983-21meminfo00:25:230
766605994230,9cyclictest311ktimers/222:50:132
766605994226,8cyclictest0-21swapper/223:00:272
766604994232,7cyclictest805148-21unixbench_singl22:50:291
766604994229,8cyclictest0-21swapper/122:55:281
766604994229,8cyclictest0-21swapper/122:55:281
766604994228,9cyclictest0-21swapper/122:30:281
766602994227,12cyclictest794575-21/usr/sbin/munin21:50:240
766602994224,16cyclictest785399-21/usr/sbin/munin20:55:270
766605994132,6cyclictest274-21systemd-journal19:40:172
766605994132,4cyclictest0-21swapper/222:00:292
766605994127,10cyclictest311ktimers/220:20:142
766604994128,8cyclictest0-21swapper/122:40:271
766604994126,10cyclictest0-21swapper/123:10:171
766602994134,4cyclictest774874-21ssh19:55:210
766602994126,12cyclictest802215-21/usr/sbin/munin22:35:210
766602994118,18cyclictest771533-21grep19:35:210
766602994110,28cyclictest0-21swapper/023:55:010
766605994027,11cyclictest311ktimers/221:35:152
766605994026,11cyclictest311ktimers/223:20:142
766604994030,6cyclictest0-21swapper/121:30:151
766604994030,6cyclictest0-21swapper/121:30:151
766604994027,9cyclictest0-21swapper/121:00:291
766604994025,8cyclictest0-21swapper/122:20:191
76660499401,3cyclictest0-21swapper/119:20:011
766602994025,11cyclictest813296-21/usr/sbin/munin23:40:230
766602994023,14cyclictest789261-21/usr/sbin/munin21:20:180
766605993931,4cyclictest773679-21munin-plugin-st19:50:002
766605993930,5cyclictest778630-21grep20:15:282
766605993928,9cyclictest311ktimers/223:55:112
766605993920,12cyclictest311ktimers/222:30:102
766605993915,12cyclictest782425-21/usr/sbin/munin20:40:192
766604993929,7cyclictest0-21swapper/120:30:281
766604993927,8cyclictest0-21swapper/123:30:281
766604993925,8cyclictest0-21swapper/122:35:281
766604993924,9cyclictest0-21swapper/100:15:281
76660499391,4cyclictest0-21swapper/100:35:021
766602993928,8cyclictest770637-21ssh19:30:190
766602993917,16cyclictest805460-21/usr/sbin/munin22:55:190
766602993917,16cyclictest805460-21/usr/sbin/munin22:55:180
766605993827,7cyclictest809361-21grep23:15:282
766605993825,3cyclictest775358-21latency_hist20:00:002
76660499389,26cyclictest815231-21tr23:50:281
76660499386,26cyclictest812997-21/usr/sbin/munin23:40:181
766604993828,4cyclictest0-21swapper/120:30:021
766604993826,7cyclictest0-21swapper/120:55:271
766604993826,7cyclictest0-21swapper/119:20:271
766604993825,9cyclictest0-21swapper/119:45:281
766605993728,5cyclictest0-21swapper/221:10:272
766605993722,8cyclictest0-21swapper/200:20:282
766604993725,7cyclictest0-21swapper/119:40:291
766604993724,9cyclictest1653-21lldpd19:25:171
766604993724,7cyclictest796448-21grep22:00:271
766604993724,10cyclictest0-21swapper/120:15:281
76660599366,12cyclictest766540-21apt-get19:10:012
766604993628,5cyclictest0-21swapper/119:10:011
766604993627,5cyclictest0-21swapper/121:40:011
766604993625,7cyclictest779532-21grep20:20:291
766604993625,7cyclictest0-21swapper/120:05:291
766604993623,8cyclictest0-21swapper/121:50:311
766604993622,8cyclictest0-21swapper/120:50:271
766604993622,8cyclictest0-21swapper/120:50:271
766605993528,4cyclictest14-21rcu_preempt21:50:302
766605993527,4cyclictest787228-21grep21:05:282
766605993527,4cyclictest0-21swapper/223:50:282
766604993528,4cyclictest167450irq/126-8000000.ethernet-tx123:20:281
766604993524,6cyclictest0-21swapper/119:50:281
766604993521,8cyclictest1660-21snmpd23:06:361
766605993427,4cyclictest806032-21sendmail23:00:002
766605993427,4cyclictest806032-21sendmail23:00:002
766605993427,4cyclictest788959-21cron21:20:002
766605993426,4cyclictest0-21swapper/222:05:282
766605993423,6cyclictest811877-21grep23:30:282
766605993422,6cyclictest0-21swapper/220:50:182
766605993422,6cyclictest0-21swapper/220:50:182
766605993420,9cyclictest0-21swapper/220:10:002
76660599341,6cyclictest780604-21wc20:30:012
766604993424,6cyclictest0-21swapper/121:45:201
766604993423,8cyclictest0-21swapper/100:25:271
766604993422,7cyclictest0-21swapper/122:10:281
766604993421,9cyclictest0-21swapper/119:35:191
76660499341,28cyclictest0-21swapper/100:20:241
76660499341,27cyclictest0-21swapper/120:35:121
766605993323,6cyclictest0-21swapper/222:20:282
76660599331,26cyclictest0-21swapper/200:05:162
766604993324,6cyclictest816463-21/usr/sbin/munin00:00:201
766604993322,7cyclictest0-21swapper/121:20:011
766604993321,8cyclictest0-21swapper/119:30:281
766604993319,7cyclictest0-21swapper/123:00:191
766605993220,5cyclictest0-21swapper/219:15:032
766605993214,14cyclictest311ktimers/219:25:122
76660599321,25cyclictest0-21swapper/200:30:162
766605993123,5cyclictest0-21swapper/222:15:152
766605993122,7cyclictest311ktimers/220:10:162
766605993122,6cyclictest781253-21unixbench_multi20:30:282
766605993122,5cyclictest790860-21/usr/sbin/munin21:30:202
766605993122,5cyclictest790860-21/usr/sbin/munin21:30:202
766605993121,7cyclictest784944-21/usr/sbin/munin20:55:112
766605993120,5cyclictest0-21swapper/222:10:252
76660599311,28cyclictest0-21swapper/223:50:012
76660599311,28cyclictest0-21swapper/223:50:002
766604993124,4cyclictest788254-21latency_hist21:15:021
766604993123,5cyclictest1261-21rs:main1
766604993120,8cyclictest0-21swapper/121:20:271
766605993022,5cyclictest0-21swapper/200:10:112
766605993019,8cyclictest0-21swapper/222:40:002
766605993019,8cyclictest0-21swapper/221:49:592
766605993019,7cyclictest822976-21grep00:35:272
766605993018,8cyclictest789752-21grep21:20:282
76660599301,26cyclictest768816-21/usr/sbin/munin19:20:102
766604993020,7cyclictest0-21swapper/122:25:281
766604993019,8cyclictest823012-21cron00:40:011
766605992922,5cyclictest783905-21munin-plugin-st20:50:002
766605992922,4cyclictest14-21rcu_preempt00:17:012
766605992916,11cyclictest30-21rcuc/223:25:272
76660599291,26cyclictest0-21swapper/222:40:152
766605992821,4cyclictest30-21rcuc/223:05:272
766605992821,4cyclictest0-21swapper/219:50:282
766605992819,4cyclictest0-21swapper/223:10:242
766604992820,5cyclictest0-21swapper/122:15:281
766604992516,5cyclictest0-21swapper/121:25:261
76660499241,21cyclictest0-21swapper/120:12:351
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional