You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 20:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Wed Apr 22, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15451699541,44cyclictest30-21rcuc/209:05:012
15451699541,36cyclictest0-21swapper/209:20:012
154514995410,28cyclictest22-21rcuc/107:45:011
154514995410,28cyclictest22-21rcuc/107:45:011
154512995414,3cyclictest180952-21memory09:40:240
154512995243,5cyclictest167350irq/118-8000000.ethernet-tx010:50:160
15451699516,11cyclictest191424-21apt-get10:45:022
154512995144,4cyclictest184690-21latency_hist10:05:010
154512995144,4cyclictest167350irq/118-8000000.ethernet-tx007:20:180
154512995143,4cyclictest167350irq/118-8000000.ethernet-tx008:45:240
154512995119,5cyclictest205727-21/usr/sbin/munin12:05:260
154514995042,5cyclictest190582-21munin-plugin-st10:40:001
154512995043,4cyclictest194038-21munin-plugin-st11:00:000
154512995042,4cyclictest167350irq/118-8000000.ethernet-tx008:00:290
154514994937,9cyclictest177056-21run-parts09:20:001
15451299497,39cyclictest208790-21sh12:25:190
15451499488,12cyclictest14-21rcu_preempt12:20:001
154514994836,8cyclictest0-21swapper/110:20:011
15451499482,20cyclictest22-21rcuc/111:20:011
154512994837,6cyclictest0-21swapper/009:20:250
154512994830,15cyclictest167350irq/118-8000000.ethernet-tx008:55:180
15451299482,44cyclictest0-21swapper/012:10:250
15451299482,44cyclictest0-21swapper/012:10:250
15451299482,22cyclictest0-21swapper/007:15:010
15451499472,15cyclictest0-21swapper/111:35:011
15451499472,15cyclictest0-21swapper/111:35:011
154512994740,5cyclictest170214-21munin-plugin-st08:40:000
154512994740,4cyclictest167350irq/118-8000000.ethernet-tx010:35:280
154512994735,8cyclictest156654-21grep07:20:010
154516994633,7cyclictest0-21swapper/207:15:012
154516994632,9cyclictest0-21swapper/207:40:272
154516994632,9cyclictest0-21swapper/207:40:262
15451299465,8cyclictest0-21swapper/009:05:010
154516994532,8cyclictest0-21swapper/211:25:282
154516994530,7cyclictest0-21swapper/210:20:202
154514994534,8cyclictest194037-21run-parts11:00:001
154514994531,9cyclictest0-21swapper/109:45:001
154512994538,4cyclictest167350irq/118-8000000.ethernet-tx009:50:230
154512994536,4cyclictest202572-21munin-plugin-st11:50:000
15451299452,5cyclictest196071-21df11:10:150
154512994523,19cyclictest20650irq/252-8000000.ethernet09:10:240
154512994517,3cyclictest186610-21df10:15:160
154516994438,4cyclictest311ktimers/210:15:112
154516994434,4cyclictest0-21swapper/211:05:012
154514994430,8cyclictest0-21swapper/110:10:261
154514994417,17cyclictest231ktimers/111:20:111
154512994438,3cyclictest167350irq/118-8000000.ethernet-tx008:40:170
154512994437,4cyclictest167350irq/118-8000000.ethernet-tx010:25:270
15451699433,22cyclictest0-21swapper/211:15:012
154516994327,12cyclictest0-21swapper/210:15:012
154516994323,11cyclictest0-21swapper/209:55:192
154514994326,11cyclictest231ktimers/108:30:171
15451299437,7cyclictest176960-21grep09:15:290
15451299435,7cyclictest0-21swapper/012:40:010
15451299433,5cyclictest164578-21diskstats08:05:170
154512994335,5cyclictest199760-21proc_pri11:30:260
154512994335,5cyclictest199760-21proc_pri11:30:260
154512994310,8cyclictest194887-21apt-get11:05:030
154516994230,6cyclictest157347-21grep07:20:292
15451499426,4cyclictest0-21swapper/112:05:011
154514994232,6cyclictest0-21swapper/109:20:261
15451299424,6cyclictest189856-21cat10:35:010
154512994235,4cyclictest167350irq/118-8000000.ethernet-tx010:40:150
154512994232,6cyclictest19750irq/27-20000000.i2c11:20:280
154516994132,5cyclictest0-21swapper/210:45:162
154516994125,6cyclictest0-21swapper/211:10:202
154514994133,4cyclictest0-21swapper/111:10:001
154514994127,10cyclictest1283-21cron12:35:001
154514994124,10cyclictest0-21swapper/108:00:201
154514994119,11cyclictest191524-21cat10:45:011
154516994025,8cyclictest204196-21grep11:55:292
154516994023,10cyclictest0-21swapper/212:20:272
154516994011,24cyclictest0-21swapper/211:30:222
154516994011,24cyclictest0-21swapper/211:30:222
15451499408,21cyclictest22-21rcuc/112:05:101
154514994021,12cyclictest231ktimers/108:25:161
154512994033,4cyclictest20650irq/252-8000000.ethernet07:45:160
154512994033,4cyclictest20650irq/252-8000000.ethernet07:35:100
154512994032,4cyclictest0-21swapper/008:15:270
154512994032,4cyclictest0-21swapper/008:15:270
154512994028,6cyclictest185447-21grep10:05:280
154512994027,10cyclictest0-21swapper/010:10:250
15451299401,37cyclictest160273-21diskstats07:40:170
15451299401,37cyclictest160273-21diskstats07:40:170
15451699399,24cyclictest2-21kthreadd07:58:232
154516993936,2cyclictest0-21swapper/208:25:012
154516993910,18cyclictest172000-21cmp08:50:012
15451499393,3cyclictest0-21swapper/107:20:011
154514993930,5cyclictest201734-21munin-plugin-st11:45:001
154514993928,5cyclictest0-21swapper/111:50:281
154514993927,7cyclictest0-21swapper/108:55:291
154514993925,7cyclictest14-21rcu_preempt11:10:281
154514993923,9cyclictest0-21swapper/112:40:001
15451299398,4cyclictest162138-21/usr/sbin/munin07:50:210
154512993933,4cyclictest0-21swapper/012:30:200
154512993933,3cyclictest0-21swapper/009:30:010
154512993929,7cyclictest187942-21grep10:20:280
154512993925,9cyclictest183753-21grep09:55:290
15451299391,36cyclictest0-21swapper/012:00:220
15451299391,36cyclictest0-21swapper/011:00:140
15451299391,36cyclictest0-21swapper/008:20:200
154512993911,3cyclictest208107-21irqstats12:20:220
154512993910,3cyclictest198779-21if_err_eth111:25:210
154516993830,4cyclictest0-21swapper/207:20:022
154516993829,5cyclictest0-21swapper/212:00:292
154516993828,5cyclictest168520-21cron08:29:592
15451699381,28cyclictest0-21swapper/212:10:012
15451499381,11cyclictest0-21swapper/112:30:011
15451299389,26cyclictest203613-21/usr/sbin/munin11:55:120
154512993833,4cyclictest0-21swapper/007:35:000
154512993831,4cyclictest167350irq/118-8000000.ethernet-tx010:45:240
154512993821,4cyclictest3999792-1kworker/0:1H+mmc_complete07:10:020
154512993821,15cyclictest0-21swapper/011:50:130
154512993810,25cyclictest165602-21/usr/sbin/munin08:10:210
154516993729,5cyclictest0-21swapper/208:35:002
154516993729,4cyclictest0-21swapper/210:00:292
154516993729,4cyclictest0-21swapper/209:45:002
154516993727,7cyclictest209292-21grep12:25:292
154516993727,7cyclictest197719-21/usr/sbin/munin11:20:262
154516993727,6cyclictest159899-21grep07:35:272
154516993727,5cyclictest0-21swapper/210:35:282
154516993724,7cyclictest0-21swapper/210:30:202
154516993722,7cyclictest0-21swapper/212:15:272
154516993720,9cyclictest0-21swapper/207:25:202
154514993728,4cyclictest0-21swapper/109:25:171
154514993721,12cyclictest231ktimers/108:20:131
15451499371,9cyclictest0-21swapper/109:55:011
154514993719,9cyclictest0-21swapper/111:55:201
154512993728,6cyclictest19750irq/27-20000000.i2c11:15:280
154512993728,5cyclictest0-21swapper/011:35:190
15451299371,3cyclictest0-21swapper/009:05:130
15451299371,3cyclictest0-21swapper/009:05:130
15451299371,34cyclictest0-21swapper/007:55:240
154516993628,6cyclictest311ktimers/209:30:252
154516993628,5cyclictest311ktimers/209:05:152
154516993628,5cyclictest311ktimers/209:05:142
154516993628,5cyclictest203349-21grep11:50:282
154516993628,4cyclictest0-21swapper/212:30:262
154516993626,5cyclictest0-21swapper/208:10:242
15451699362,3cyclictest0-21swapper/209:20:012
154514993627,5cyclictest0-21swapper/109:35:001
154514993623,9cyclictest0-21swapper/107:50:261
15451499362,22cyclictest22-21rcuc/108:45:021
154514993619,8cyclictest0-21swapper/110:20:191
154514993615,15cyclictest231ktimers/112:10:121
154514993615,15cyclictest231ktimers/112:10:111
154512993630,4cyclictest0-21swapper/008:30:230
154512993627,6cyclictest201670-21grep11:40:280
154512993625,7cyclictest0-21swapper/009:30:290
154512993619,14cyclictest172519-21/usr/sbin/munin08:50:240
15451299361,33cyclictest0-21swapper/008:25:150
15451699356,23cyclictest0-21swapper/209:50:152
154516993526,6cyclictest193079-21grep10:50:272
154516993525,6cyclictest178650-21grep09:25:282
154516993524,8cyclictest0-21swapper/208:40:292
154516993524,7cyclictest311ktimers/208:05:112
154516993522,8cyclictest202503-21grep11:45:272
154516993522,8cyclictest0-21swapper/209:35:192
154516993521,8cyclictest0-21swapper/211:45:002
154516993519,8cyclictest0-21swapper/210:25:282
154514993527,5cyclictest185464-21unixbench_singl10:05:281
154514993527,5cyclictest183169-21/usr/sbin/munin09:55:201
154514993525,7cyclictest0-21swapper/107:55:271
154514993523,6cyclictest0-21swapper/111:05:001
154514993521,9cyclictest0-21swapper/108:05:211
15451299356,23cyclictest207751-21latency_hist12:20:000
154512993529,4cyclictest20850irq/208-8000000.ethernet09:35:230
154512993520,13cyclictest0-21swapper/009:45:070
154512993520,13cyclictest0-21swapper/009:45:070
154516993426,5cyclictest311ktimers/211:10:012
154516993426,4cyclictest0-21swapper/211:00:002
154516993426,3cyclictest311ktimers/211:35:112
154516993425,6cyclictest311ktimers/208:00:252
154516993424,7cyclictest311ktimers/209:50:002
154516993424,7cyclictest311ktimers/209:50:002
154516993423,5cyclictest0-21swapper/208:50:202
154516993419,7cyclictest0-21swapper/207:30:282
154514993424,7cyclictest1660-21snmpd10:04:041
154514993424,6cyclictest0-21swapper/110:50:251
15451499341,27cyclictest166181-21/usr/sbin/munin08:15:221
15451499341,27cyclictest166181-21/usr/sbin/munin08:15:221
15451499341,27cyclictest158500-21/usr/sbin/munin07:30:181
154514993412,17cyclictest231ktimers/110:30:141
154512993422,9cyclictest158283-21sshd07:27:140
154516993327,4cyclictest311ktimers/210:10:002
154516993325,5cyclictest0-21swapper/212:40:002
154516993324,6cyclictest154506-21cyclictest12:10:282
154516993324,6cyclictest154506-21cyclictest12:10:282
154516993315,12cyclictest166814-21sshd08:19:152
154516993315,12cyclictest166814-21sshd08:19:152
154514993322,7cyclictest0-21swapper/109:00:261
154516993221,6cyclictest169566-21/usr/sbin/munin08:35:262
154516993218,8cyclictest0-21swapper/208:55:292
154514993225,4cyclictest181489-21/usr/sbin/munin09:45:151
154514993225,4cyclictest181489-21/usr/sbin/munin09:45:151
154514993225,4cyclictest167450irq/126-8000000.ethernet-tx111:25:151
154514993225,4cyclictest0-21swapper/109:05:151
154514993225,4cyclictest0-21swapper/109:05:151
154514993223,4cyclictest0-21swapper/110:25:191
154514993222,5cyclictest0-21swapper/111:45:191
154514993217,12cyclictest231ktimers/110:45:121
15451499321,3cyclictest0-21swapper/107:40:011
154514993212,14cyclictest231ktimers/108:10:101
15451699311,24cyclictest0-21swapper/207:45:242
154514993123,4cyclictest0-21swapper/107:10:011
154514993122,5cyclictest22-21rcuc/109:35:291
154514993120,7cyclictest0-21swapper/108:55:011
154516993020,7cyclictest0-21swapper/209:10:272
154516993010,14cyclictest167550irq/134-8000000.ethernet-tx207:50:152
154514993023,4cyclictest0-21swapper/107:45:291
15451499302,26cyclictest157660-21/usr/sbin/munin07:25:281
15451499299,14cyclictest231ktimers/108:35:121
154514992921,5cyclictest0-21swapper/107:10:181
154514992921,4cyclictest0-21swapper/108:40:251
154516992819,5cyclictest0-21swapper/207:10:012
154514992822,3cyclictest167450irq/126-8000000.ethernet-tx111:35:151
154514992821,5cyclictest176200-21sshd09:14:151
154514992619,3cyclictest0-21swapper/107:25:011
154514992519,4cyclictest0-21swapper/112:20:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional