You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 01:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sat May 30, 2026 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
136709996341,13cyclictest185735-21apt-get11:55:152
136709996337,14cyclictest0-21swapper/207:15:122
136709996032,15cyclictest0-21swapper/208:35:132
136709996032,15cyclictest0-21swapper/208:35:132
136709996011,25cyclictest0-21swapper/207:45:022
136709995941,12cyclictest179752-21apt-get11:20:162
136709995941,12cyclictest179752-21apt-get11:20:152
136709995938,15cyclictest181522-21apt-get11:30:152
136709995913,39cyclictest147466-21/usr/sbin/munin08:10:192
136709995841,12cyclictest178052-21apt-get11:10:162
136709995841,12cyclictest178052-21apt-get11:10:162
136709995838,16cyclictest0-21swapper/210:50:132
136709995836,14cyclictest0-21swapper/208:45:142
136709995738,11cyclictest163609-21apt-get09:45:172
136709995736,12cyclictest170706-21/usr/sbin/munin10:25:262
136709995642,11cyclictest0-21swapper/210:55:152
136709995638,13cyclictest0-21swapper/208:55:132
136709995635,12cyclictest0-21swapper/207:30:142
136709995635,12cyclictest0-21swapper/207:30:142
136709995632,15cyclictest185145-21/usr/sbin/munin11:50:242
13670599561,17cyclictest0-21swapper/007:40:020
136709995539,10cyclictest150011-21apt-get08:25:152
136709995538,13cyclictest0-21swapper/211:25:102
136709995536,12cyclictest146000-21/usr/sbin/munin08:00:252
136709995533,14cyclictest151459-21/usr/sbin/munin08:30:292
136709995529,14cyclictest0-21swapper/209:35:132
136709995513,27cyclictest0-21swapper/209:45:012
13670999549,19cyclictest0-21swapper/209:00:172
136709995439,11cyclictest0-21swapper/210:35:162
136709995437,14cyclictest0-21swapper/207:35:102
136709995432,15cyclictest160665-21/usr/sbin/munin09:25:272
136709995432,15cyclictest160665-21/usr/sbin/munin09:25:272
136709995431,12cyclictest0-21swapper/212:25:132
136709995431,12cyclictest0-21swapper/212:25:132
136709995429,18cyclictest144652-21wc07:55:022
136709995411,28cyclictest0-21swapper/209:35:002
13670899545,44cyclictest0-21swapper/109:35:001
136708995431,11cyclictest0-21swapper/110:25:131
13670599548,9cyclictest173539-21apt-get10:45:010
136709995343,5cyclictest188268-21apt-get12:10:122
136709995338,11cyclictest0-21swapper/210:20:162
136709995334,11cyclictest173833-21apt-get10:45:152
13670899534,17cyclictest0-21swapper/108:35:001
136708995331,14cyclictest149737-21grep08:20:301
136708995328,14cyclictest0-21swapper/111:05:151
136708995319,28cyclictest143700-21kthreadd07:48:221
136708995318,8cyclictest0-21swapper/107:40:271
136709995239,7cyclictest148627-21/usr/sbin/munin08:15:252
136709995238,7cyclictest159604-21memory09:20:262
136709995237,9cyclictest147075-21/usr/sbin/munin08:05:292
136709995237,7cyclictest168663-21/usr/sbin/munin10:15:312
136709995236,12cyclictest0-21swapper/212:35:112
136709995235,12cyclictest0-21swapper/210:10:132
136709995233,12cyclictest165359-21/usr/sbin/munin09:55:182
136709995230,13cyclictest144901-21/usr/sbin/munin07:55:172
136709995229,12cyclictest0-21swapper/211:05:132
13670899528,35cyclictest165285-21/usr/sbin/munin09:55:191
13670899526,17cyclictest0-21swapper/109:00:011
136708995235,11cyclictest182361-21apt-get11:35:161
136708995231,12cyclictest0-21swapper/111:00:121
136709995145,2cyclictest164449-21apt-get09:50:132
136709995137,8cyclictest154480-21/usr/sbin/munin08:50:232
136709995136,10cyclictest0-21swapper/211:45:112
136709995136,10cyclictest0-21swapper/211:45:102
136709995134,14cyclictest0-21swapper/211:00:132
136709995129,14cyclictest139128-21/usr/sbin/munin07:20:242
136708995140,7cyclictest140536-21munin-node07:30:111
136708995140,7cyclictest140536-21munin-node07:30:111
136708995135,8cyclictest170134-21/usr/sbin/munin10:20:311
136708995131,11cyclictest167244-21/usr/sbin/munin10:05:241
136708995131,11cyclictest167244-21/usr/sbin/munin10:05:231
136708995129,14cyclictest192779-21/usr/sbin/munin12:35:241
136708995127,12cyclictest0-21swapper/111:45:121
136708995127,12cyclictest0-21swapper/111:45:121
13670599515,30cyclictest20850irq/208-8000000.ethernet08:35:190
13670599515,30cyclictest20850irq/208-8000000.ethernet08:35:190
136705995142,5cyclictest170169-21munin-plugin-st10:25:000
136705995132,16cyclictest167350irq/118-8000000.ethernet-tx010:10:280
136709995042,4cyclictest149169-21apt-get08:20:142
136709995041,5cyclictest186592-21apt-get12:00:142
136709995041,5cyclictest158445-21apt-get09:15:182
136709995041,5cyclictest158445-21apt-get09:15:172
136709995039,5cyclictest191944-21/usr/sbin/munin12:30:252
136709995037,9cyclictest182364-21/usr/sbin/munin11:35:162
136709995036,9cyclictest171204-21/usr/sbin/munin10:30:092
136709995036,10cyclictest179148-21/usr/sbin/munin11:15:232
136709995035,11cyclictest0-21swapper/209:05:122
136709995034,9cyclictest152623-21/usr/sbin/munin08:40:182
136709995032,12cyclictest137171-21/usr/sbin/munin07:10:262
136709995032,11cyclictest183269-21/usr/sbin/munin11:40:152
136709995031,13cyclictest139826-21/usr/sbin/munin07:25:202
136709995031,10cyclictest167282-21/usr/sbin/munin10:05:242
136709995031,10cyclictest167282-21/usr/sbin/munin10:05:242
136708995041,5cyclictest148381-21/usr/sbin/munin08:15:181
136708995039,7cyclictest148076-21/usr/sbin/munin08:10:291
136708995031,12cyclictest181021-21/usr/sbin/munin11:25:251
136708995029,13cyclictest153113-21/usr/sbin/munin08:40:291
136708995026,17cyclictest158152-21unixbench_multi09:10:291
136708995025,14cyclictest146807-21/usr/sbin/munin08:05:241
136708995018,26cyclictest186589-21/usr/sbin/munin12:00:281
13670599504,12cyclictest14-21rcu_preempt11:30:010
136705995040,6cyclictest0-21swapper/011:50:210
136709994937,8cyclictest172903-21apt-get10:40:152
136709994936,7cyclictest189417-21/usr/sbin/munin12:15:242
136709994933,10cyclictest157683-21/usr/sbin/munin09:10:212
136708994937,6cyclictest0-21swapper/109:25:021
136708994936,7cyclictest157278-21/usr/sbin/munin09:05:281
136708994936,10cyclictest150625-21sshd08:25:341
136708994935,9cyclictest153803-21ptp4l08:45:281
136708994932,10cyclictest140051-21/usr/sbin/munin07:25:281
136708994929,12cyclictest155420-21/usr/sbin/munin08:55:251
136708994927,15cyclictest166702-21grep10:00:281
136708994927,13cyclictest191128-21/usr/sbin/munin12:25:261
136708994927,13cyclictest191128-21/usr/sbin/munin12:25:261
13670599493,40cyclictest0-21swapper/009:30:020
13670599493,40cyclictest0-21swapper/009:30:010
136709994842,2cyclictest189968-21apt-get12:20:142
136709994841,4cyclictest187676-21/usr/sbin/munin12:05:212
136709994832,9cyclictest142292-21/usr/sbin/munin07:40:162
136708994834,8cyclictest137685-21munin-setwarn07:15:011
136708994833,9cyclictest145828-21/usr/sbin/munin08:00:211
136708994829,12cyclictest164121-21/usr/sbin/munin09:45:291
13670599482,6cyclictest0-21swapper/008:15:220
136709994733,8cyclictest166213-21df_inode10:00:172
136708994733,9cyclictest183333-21fschecks_count11:40:191
136708994733,9cyclictest171836-21sshd10:34:321
136708994732,9cyclictest164866-21/usr/sbin/munin09:50:271
136708994732,8cyclictest139275-21/usr/sbin/munin07:20:281
136708994730,8cyclictest184946-21/usr/sbin/munin11:50:171
136708994729,12cyclictest176071-21/usr/sbin/munin10:55:291
136708994728,14cyclictest0-21swapper/111:55:141
136708994728,12cyclictest144309-21/usr/sbin/munin07:50:281
136708994726,14cyclictest180043-21/usr/sbin/munin11:20:241
136708994726,14cyclictest180043-21/usr/sbin/munin11:20:241
136708994725,15cyclictest190303-21/usr/sbin/munin12:20:261
136705994741,4cyclictest0-21swapper/009:55:110
136705994733,10cyclictest0-21swapper/009:15:300
136705994733,10cyclictest0-21swapper/009:15:300
136708994634,8cyclictest168122-21/usr/sbin/munin10:10:251
136708994630,9cyclictest152108-21/usr/sbin/munin08:35:281
136708994630,9cyclictest152108-21/usr/sbin/munin08:35:281
136708994630,9cyclictest145393-21grep07:55:301
136708994628,11cyclictest187752-21/usr/sbin/munin12:05:261
136708994625,13cyclictest192173-21grep12:30:271
136708994622,16cyclictest181683-21cut11:30:201
136705994639,4cyclictest20650irq/252-8000000.ethernet11:00:010
136705994639,4cyclictest167350irq/118-8000000.ethernet-tx012:10:250
136708994538,4cyclictest158584-21ssh09:15:221
136708994538,4cyclictest158584-21ssh09:15:211
136708994532,7cyclictest178269-21/usr/sbin/munin11:10:211
136708994532,7cyclictest178269-21/usr/sbin/munin11:10:211
136708994532,7cyclictest175284-21sshd10:50:331
136708994531,8cyclictest169280-21sshd10:15:321
136708994530,11cyclictest0-21swapper/110:40:121
136708994529,9cyclictest141431-21/usr/sbin/munin07:35:151
136708994528,12cyclictest188606-21/usr/sbin/munin12:10:251
13670599451,40cyclictest177642-21ptp4l-jitter11:05:290
136708994437,4cyclictest189105-21munin-node12:15:101
136708994435,5cyclictest162766-21munin-node09:40:101
136708994434,7cyclictest138476-21/usr/sbin/munin07:15:281
136708994433,5cyclictest179138-21/usr/sbin/munin11:15:221
136708994431,9cyclictest173539-21apt-get10:45:071
136708994430,11cyclictest160312-21/usr/sbin/munin09:25:201
136708994430,11cyclictest160312-21/usr/sbin/munin09:25:191
136708994428,11cyclictest0-21swapper/108:50:121
136705994430,9cyclictest0-21swapper/008:10:300
136705994425,14cyclictest131ktimers/009:10:120
136705994415,4cyclictest146338-21apt-get08:05:010
136708994327,12cyclictest161906-21munin-node09:35:121
136708994322,15cyclictest172190-21sh10:35:221
136705994329,8cyclictest0-21swapper/010:30:260
13670599431,3cyclictest149329-21lsblk08:20:200
13670599431,2cyclictest0-21swapper/009:05:020
136709994222,14cyclictest136803-21latency_hist07:10:022
13670599427,4cyclictest143721-21gpgv07:50:010
136705994229,8cyclictest0-21swapper/008:05:300
136705994224,15cyclictest0-21swapper/011:00:120
13670599422,3cyclictest136837-21ls07:10:010
13670599421,7cyclictest0-21swapper/009:35:010
13670599421,6cyclictest0-21swapper/011:20:000
136705994134,4cyclictest20650irq/252-8000000.ethernet11:20:230
136705994134,4cyclictest20650irq/252-8000000.ethernet11:20:230
136705994132,5cyclictest20850irq/208-8000000.ethernet12:00:270
13670599412,4cyclictest173539-21apt-get10:45:030
13670599412,3cyclictest0-21swapper/007:15:200
13670599411,38cyclictest0-21swapper/010:50:230
13670599411,38cyclictest0-21swapper/008:30:160
136705994033,4cyclictest20650irq/252-8000000.ethernet09:50:270
13670599402,7cyclictest153088-21grep08:40:270
136705994023,15cyclictest0-21swapper/012:20:190
136705994014,24cyclictest0-21swapper/011:35:290
13670599401,37cyclictest0-21swapper/010:15:290
13670599401,36cyclictest0-21swapper/007:55:290
136705993932,5cyclictest0-21swapper/012:30:250
136705993926,8cyclictest14-21rcu_preempt11:30:210
13670599391,5cyclictest170625-21irqstats10:25:220
13670599391,5cyclictest0-21swapper/009:25:000
13670599391,36cyclictest0-21swapper/007:25:180
13670599391,2cyclictest0-21swapper/012:20:020
13670599386,4cyclictest172682-21latency_hist10:40:010
13670599382,2cyclictest0-21swapper/012:25:180
13670599382,2cyclictest0-21swapper/012:25:180
136705993821,15cyclictest0-21swapper/008:25:110
136705993821,15cyclictest0-21swapper/007:40:280
136705993820,14cyclictest131ktimers/007:20:120
13670599381,4cyclictest0-21swapper/008:50:190
136708993722,10cyclictest136718-21wc07:10:011
136705993726,6cyclictest0-21swapper/010:05:290
136705993726,6cyclictest0-21swapper/010:05:290
136705993723,10cyclictest0-21swapper/009:35:190
13670599371,34cyclictest0-21swapper/012:35:150
13670599371,34cyclictest0-21swapper/012:05:120
13670599371,34cyclictest0-21swapper/007:50:260
13670599361,4cyclictest0-21swapper/007:35:020
13670599361,4cyclictest0-21swapper/007:35:010
13670599361,33cyclictest0-21swapper/008:49:120
13670599361,33cyclictest0-21swapper/007:14:420
13670599361,32cyclictest0-21swapper/008:55:120
136705993528,4cyclictest20850irq/208-8000000.ethernet11:55:160
13670599351,4cyclictest0-21swapper/009:40:220
13670599351,32cyclictest0-21swapper/010:02:090
13670599351,2cyclictest0-21swapper/011:45:010
136705993428,4cyclictest20850irq/208-8000000.ethernet11:45:120
136705993428,4cyclictest20850irq/208-8000000.ethernet11:45:120
13670599341,7cyclictest178144-21grep11:10:180
13670599341,7cyclictest178144-21grep11:10:180
13670599331,2cyclictest0-21swapper/009:05:120
136705993226,3cyclictest0-21swapper/009:50:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional