You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 17:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Fri Mar 20, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3268249910045,50cyclictest0-21swapper/011:55:100
326825999567,15cyclictest0-21swapper/110:10:001
32682899771,42cyclictest0-21swapper/210:35:012
32682899761,2cyclictest0-21swapper/211:50:012
32682899731,55cyclictest0-21swapper/208:45:012
32682899721,48cyclictest0-21swapper/210:50:002
326824997111,20cyclictest20850irq/208-8000000.ethernet12:20:020
326828996728,33cyclictest0-21swapper/211:25:002
326828996436,22cyclictest338896-21munin-plugin-st08:20:002
32682899642,54cyclictest347629-21/usr/sbin/munin09:10:292
32682899601,2cyclictest0-21swapper/212:15:102
32682499606,19cyclictest0-21swapper/011:05:010
32682899592,49cyclictest353634-21/usr/sbin/munin09:45:292
32682599598,9cyclictest372247-21rm11:35:021
326828995827,22cyclictest0-21swapper/209:40:292
32682899581,49cyclictest350735-21/usr/sbin/munin09:25:282
32682899581,2cyclictest0-21swapper/210:55:142
32682899581,2cyclictest0-21swapper/210:25:012
32682899581,2cyclictest0-21swapper/210:25:012
32682899581,2cyclictest0-21swapper/208:45:132
32682899574,45cyclictest344511-21tail08:50:272
32682899574,45cyclictest344511-21tail08:50:272
326828995729,22cyclictest361747-21grep10:30:272
32682899572,47cyclictest382002-21phc2sys12:30:252
32682899572,47cyclictest357363-21/usr/sbin/munin10:05:282
32682899572,46cyclictest328409-21/usr/sbin/munin07:15:222
326828995715,35cyclictest0-21swapper/207:45:292
32682899571,50cyclictest370861-21/usr/sbin/munin11:25:222
32682899571,49cyclictest358949-21/usr/sbin/munin10:15:232
32682899571,49cyclictest341977-21/usr/sbin/munin08:35:252
32682899571,47cyclictest334326-21/usr/sbin/munin07:50:212
32682899571,2cyclictest0-21swapper/211:40:132
32682899571,2cyclictest0-21swapper/211:40:132
32682899571,2cyclictest0-21swapper/208:00:012
32682899567,43cyclictest377445-21/usr/sbin/munin12:05:152
32682899563,44cyclictest340788-21apt-get08:30:142
326828995629,21cyclictest0-21swapper/212:35:282
32682899562,47cyclictest357976-21/usr/sbin/munin10:10:202
32682899562,46cyclictest351942-21apt-get09:35:162
32682899562,45cyclictest378477-21fschecks_time12:10:202
32682899561,48cyclictest356430-21/usr/sbin/munin10:00:232
32682899561,48cyclictest346556-21/usr/sbin/munin09:00:292
32682899561,47cyclictest349624-21/usr/sbin/munin09:20:222
32682899561,47cyclictest332964-21sshd07:40:342
32682899561,46cyclictest372377-21/usr/sbin/munin11:35:162
32682899561,43cyclictest375876-21/usr/sbin/munin11:55:202
32682899561,41cyclictest351860-21latency_hist09:35:022
32682899561,2cyclictest0-21swapper/209:50:102
32682899561,2cyclictest0-21swapper/208:05:122
32682899552,45cyclictest339423-21/usr/sbin/munin08:20:242
326828995515,32cyclictest0-21swapper/209:55:212
32682899551,48cyclictest348891-21/usr/sbin/munin09:15:252
32682899551,48cyclictest348891-21/usr/sbin/munin09:15:252
32682899551,47cyclictest380341-21/usr/sbin/munin12:20:252
32682899551,47cyclictest368301-21/usr/sbin/munin11:10:222
32682899551,47cyclictest326987-21/usr/sbin/munin07:10:282
32682899551,46cyclictest364948-21/usr/sbin/munin10:50:232
32682899551,46cyclictest364948-21/usr/sbin/munin10:50:222
32682899551,41cyclictest0-21swapper/211:00:172
32682899551,2cyclictest0-21swapper/211:15:132
32682899551,2cyclictest0-21swapper/211:15:122
32682899543,42cyclictest347010-21/usr/sbin/munin09:05:232
32682899542,44cyclictest335728-21munin-node08:00:112
32682899541,46cyclictest371441-21munin-node11:30:112
32682899541,46cyclictest363010-21/usr/sbin/munin10:40:092
32682899541,45cyclictest331619-21/usr/sbin/munin07:35:192
32682899541,44cyclictest339947-21apt-get08:25:152
32682899541,3cyclictest0-21swapper/211:50:162
32682899533,43cyclictest329814-21/usr/sbin/munin07:25:112
32682899532,42cyclictest330705-21/usr/sbin/munin07:30:162
32682899532,42cyclictest330705-21/usr/sbin/munin07:30:152
32682899532,42cyclictest328974-21apt-get07:20:132
32682899531,45cyclictest367481-21/usr/sbin/munin11:05:222
32682899521,44cyclictest380901-21/usr/sbin/munin12:25:192
32682899521,44cyclictest376607-21/usr/sbin/munin12:00:132
32682899521,44cyclictest345069-21/usr/sbin/munin08:55:182
32682899521,44cyclictest337840-21/usr/sbin/munin08:10:272
32682899521,44cyclictest337840-21/usr/sbin/munin08:10:272
32682899512,42cyclictest360460-21/usr/sbin/munin10:25:172
326824995131,11cyclictest15-21rcuc/008:40:010
326824995013,6cyclictest0-21swapper/009:00:000
32682499496,5cyclictest0-21swapper/007:10:280
326824994930,15cyclictest15-21rcuc/011:25:130
326824994840,5cyclictest334615-21grep07:50:270
326824994840,5cyclictest0-21swapper/011:35:010
326824994728,13cyclictest131ktimers/008:20:100
326825994631,10cyclictest0-21swapper/108:35:001
326825994620,11cyclictest231ktimers/110:10:121
326825994537,4cyclictest364491-21munin-plugin-st10:50:001
326825994532,8cyclictest382245-21head12:30:271
326824994539,3cyclictest20650irq/252-8000000.ethernet08:10:000
326824994538,4cyclictest352573-21cron09:39:590
326824994537,4cyclictest0-21swapper/008:15:160
326824994536,5cyclictest329494-21grep07:20:260
326825994435,5cyclictest343912-21grep08:45:271
32682499448,23cyclictest340564-21kworker/0:1+events11:10:010
326824994437,4cyclictest167350irq/118-8000000.ethernet-tx011:00:000
326824994437,4cyclictest167350irq/118-8000000.ethernet-tx008:45:170
32682499443,15cyclictest0-21swapper/008:55:010
32682499443,15cyclictest0-21swapper/008:55:010
32682499443,10cyclictest0-21swapper/010:15:020
326825994331,8cyclictest0-21swapper/111:50:001
326825994331,7cyclictest333787-21grep07:45:291
326825994330,8cyclictest375476-21grep11:50:301
326824994324,17cyclictest0-21swapper/008:10:240
326824994324,17cyclictest0-21swapper/008:10:240
326825994224,4cyclictest329593-21kworker/u8:1-events_freezable_power_07:40:201
32682599421,6cyclictest0-21swapper/109:25:001
326824994234,5cyclictest167350irq/118-8000000.ethernet-tx012:15:010
326824994234,4cyclictest0-21swapper/009:45:210
326824994216,13cyclictest364687-21/usr/sbin/munin10:50:180
326824994216,13cyclictest364687-21/usr/sbin/munin10:50:180
32682899411,33cyclictest326922-21latency_hist07:10:012
326825994128,9cyclictest0-21swapper/107:15:011
326824994134,4cyclictest363179-21cut10:40:190
326824994134,4cyclictest20650irq/252-8000000.ethernet09:55:250
32682499411,5cyclictest0-21swapper/012:40:010
32682499411,4cyclictest274-21systemd-journal09:35:000
32682499411,4cyclictest0-21swapper/007:30:240
32682499411,4cyclictest0-21swapper/007:30:240
32682499411,38cyclictest0-21swapper/011:20:290
32682499411,38cyclictest0-21swapper/009:40:180
32682499411,37cyclictest340791-21cpu08:30:160
32682599405,29cyclictest24-21ksoftirqd/109:05:201
326825994031,5cyclictest0-21swapper/109:10:291
326825994030,6cyclictest330391-21grep07:25:271
326825994030,5cyclictest0-21swapper/107:55:261
326825994029,6cyclictest0-21swapper/109:50:191
32682499403,8cyclictest362749-21apt-config10:40:010
326824994025,13cyclictest0-21swapper/008:25:280
326824994025,10cyclictest0-21swapper/012:30:270
326824994024,14cyclictest167350irq/118-8000000.ethernet-tx011:45:170
32682499401,4cyclictest381086-21irqstats12:25:230
32682499401,4cyclictest0-21swapper/011:40:200
32682499401,4cyclictest0-21swapper/011:40:190
32682499401,37cyclictest0-21swapper/011:10:160
32682499401,37cyclictest0-21swapper/007:15:030
326825993931,4cyclictest0-21swapper/111:05:281
326825993930,5cyclictest365329-21munin-plugin-st10:55:001
326825993930,5cyclictest365329-21munin-plugin-st10:55:001
326825993928,4cyclictest231ktimers/110:25:101
326825993916,11cyclictest231ktimers/111:35:111
326824993932,4cyclictest167350irq/118-8000000.ethernet-tx009:10:250
326824993926,8cyclictest0-21swapper/010:20:270
326824993926,8cyclictest0-21swapper/010:20:270
32682499391,4cyclictest335133-21irqstats07:55:240
32682499391,4cyclictest0-21swapper/009:05:310
32682499391,35cyclictest379515-21processes12:15:250
32682499391,35cyclictest346056-21/usr/sbin/munin09:00:190
32682499391,35cyclictest131ktimers/009:50:280
326825993831,4cyclictest0-21swapper/109:30:271
326825993830,5cyclictest22-21rcuc/107:40:011
326825993830,4cyclictest0-21swapper/110:59:591
326825993825,9cyclictest0-21swapper/112:05:251
32682599382,27cyclictest353634-21/usr/sbin/munin09:45:181
32682499381,4cyclictest0-21swapper/007:39:210
32682499381,3cyclictest374961-21/usr/sbin/munin11:50:170
32682499381,3cyclictest368971-21df_inode11:15:190
32682499381,3cyclictest368971-21df_inode11:15:180
32682499381,3cyclictest357012-21apt-get10:05:160
32682499381,35cyclictest0-21swapper/010:45:190
32682499381,35cyclictest0-21swapper/010:18:470
32682499381,35cyclictest0-21swapper/009:20:010
32682499381,35cyclictest0-21swapper/009:20:010
32682499381,2cyclictest0-21swapper/012:10:010
326825993729,4cyclictest167450irq/126-8000000.ethernet-tx109:25:111
326825993728,6cyclictest361827-21grep10:30:271
32682599372,13cyclictest0-21swapper/110:00:021
32682599371,2cyclictest0-21swapper/112:05:011
326824993730,4cyclictest20850irq/208-8000000.ethernet07:40:180
326824993723,12cyclictest131ktimers/007:25:270
32682499371,32cyclictest335822-21tune2fs08:00:180
32682499371,2cyclictest349331-21apt-get09:20:120
326825993628,5cyclictest0-21swapper/111:40:261
326825993628,5cyclictest0-21swapper/111:40:261
326825993621,10cyclictest0-21swapper/111:15:211
326825993621,10cyclictest0-21swapper/111:15:211
326824993621,14cyclictest0-21swapper/008:41:580
32682499361,33cyclictest0-21swapper/007:48:330
326825993520,9cyclictest376384-21sendmail12:00:011
326825993520,8cyclictest378817-21grep12:10:281
32682599351,28cyclictest337404-21/usr/sbin/munin08:10:271
32682599351,28cyclictest337404-21/usr/sbin/munin08:10:261
326824993529,4cyclictest20850irq/208-8000000.ethernet12:00:260
326824993520,13cyclictest0-21swapper/010:01:040
32682499351,32cyclictest0-21swapper/011:38:250
32682499351,32cyclictest0-21swapper/009:26:240
326825993426,4cyclictest0-21swapper/107:30:161
326825993426,4cyclictest0-21swapper/107:30:161
326825993422,6cyclictest341625-21/usr/sbin/munin08:35:221
326825993422,6cyclictest0-21swapper/110:20:261
326825993422,6cyclictest0-21swapper/110:20:251
32682599341,4cyclictest0-21swapper/109:20:021
32682599341,4cyclictest0-21swapper/109:20:011
32682599341,2cyclictest0-21swapper/112:25:011
32682499341,31cyclictest0-21swapper/010:25:140
32682499341,2cyclictest0-21swapper/007:10:020
326825993324,6cyclictest339684-21grep08:20:281
326825993324,5cyclictest0-21swapper/108:50:281
326825993324,5cyclictest0-21swapper/108:50:281
326825993323,6cyclictest0-21swapper/108:00:211
326825993319,10cyclictest0-21swapper/112:15:251
32682599326,19cyclictest24-21ksoftirqd/110:15:101
326825993222,5cyclictest0-21swapper/110:35:211
326825993123,4cyclictest0-21swapper/109:40:291
326825993121,6cyclictest0-21swapper/111:00:261
326825993120,7cyclictest363569-21grep10:40:271
326825993119,8cyclictest22-21rcuc/109:55:261
326825993119,5cyclictest0-21swapper/112:35:171
326825993113,8cyclictest0-21swapper/112:30:001
32682499316,22cyclictest12-21ksoftirqd/010:30:100
326825993024,4cyclictest0-21swapper/108:05:111
326825993020,6cyclictest346480-21grep09:00:281
32682599301,2cyclictest0-21swapper/111:15:011
326825993012,4cyclictest167450irq/126-8000000.ethernet-tx108:55:271
326825992922,4cyclictest371158-21unixbench_multi11:25:291
326825992921,5cyclictest351649-21apt-get09:35:061
326825992921,5cyclictest0-21swapper/108:30:021
326825992920,5cyclictest0-21swapper/107:15:191
326825992917,7cyclictest231ktimers/107:50:131
326825992821,4cyclictest343017-21tail08:40:261
326825992821,4cyclictest0-21swapper/111:20:291
326825992819,6cyclictest0-21swapper/107:10:011
326825992818,7cyclictest231ktimers/107:20:111
326825992617,7cyclictest231ktimers/108:15:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional