You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 18:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Wed Aug 19, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
278184991105,99cyclictest0-21swapper/007:15:020
278184998882,4cyclictest131ktimers/011:25:010
278187997439,14cyclictest301414-21apt-get09:25:021
27818499711,3cyclictest0-21swapper/008:35:010
278187996354,4cyclictest298783-21apt-get09:10:011
278187996354,4cyclictest298783-21apt-get09:10:011
278187995922,9cyclictest329456-21apt-key12:10:011
278187995851,4cyclictest231ktimers/112:00:011
278187995748,5cyclictest321000-21munin-plugin-st11:20:001
278187995730,14cyclictest0-21swapper/107:15:121
278184995727,26cyclictest0-21swapper/011:40:300
278184995636,17cyclictest167350irq/118-8000000.ethernet-tx008:50:240
278187995433,12cyclictest316889-21apt-get10:55:181
278187995229,14cyclictest0-21swapper/112:10:111
278187995138,9cyclictest0-21swapper/111:15:011
278187995134,11cyclictest278351-21apt-get07:10:161
278184995143,5cyclictest0-21swapper/007:20:010
27818499511,2cyclictest0-21swapper/010:40:010
27818499511,2cyclictest0-21swapper/010:40:010
278188995037,8cyclictest307411-21sendmail10:00:002
278188995037,8cyclictest307411-21sendmail10:00:002
278187995026,15cyclictest334209-21/usr/sbin/munin12:35:221
278187995024,18cyclictest281697-21grep07:25:281
278184995042,5cyclictest167350irq/118-8000000.ethernet-tx010:35:000
27818899497,25cyclictest30-21rcuc/212:05:182
27818899494,20cyclictest0-21swapper/208:05:012
278187994932,9cyclictest0-21swapper/111:30:191
278187994932,10cyclictest0-21swapper/109:35:221
278187994931,9cyclictest282226-21/usr/sbin/munin07:30:201
278187994929,13cyclictest0-21swapper/109:55:151
278187994929,13cyclictest0-21swapper/109:55:151
278187994927,12cyclictest0-21swapper/107:20:291
278187994927,11cyclictest313937-21ptp4l-jitter10:35:271
278187994927,11cyclictest313937-21ptp4l-jitter10:35:271
278187994925,15cyclictest331186-21/usr/sbin/munin12:15:311
278187994922,19cyclictest295363-21grep08:45:301
278187994921,20cyclictest324730-21fschecks_time11:40:211
278184994931,15cyclictest167350irq/118-8000000.ethernet-tx011:15:180
278184994918,28cyclictest0-21swapper/008:30:000
278188994841,4cyclictest318386-21munin-plugin-st11:05:002
278188994835,8cyclictest0-21swapper/212:15:002
278187994831,12cyclictest0-21swapper/110:30:121
278187994828,12cyclictest0-21swapper/112:25:151
278187994823,17cyclictest286797-21head07:55:281
278187994823,14cyclictest283757-21/usr/sbin/munin07:40:161
278184994811,33cyclictest0-21swapper/009:35:280
278188994740,4cyclictest0-21swapper/210:10:002
278187994729,10cyclictest0-21swapper/107:35:301
278187994726,10cyclictest0-21swapper/110:20:131
278187994725,13cyclictest0-21swapper/109:45:161
278187994724,13cyclictest0-21swapper/110:50:131
278187994718,18cyclictest0-21swapper/111:25:141
278184994728,9cyclictest298814-21latency_hist09:10:010
278184994728,9cyclictest298814-21latency_hist09:10:010
278187994635,5cyclictest0-21swapper/111:00:231
278187994631,8cyclictest288902-21ssh08:10:181
278187994628,9cyclictest310488-21/usr/sbin/munin10:15:281
278187994628,9cyclictest304431-21grep09:40:211
278187994627,11cyclictest308857-21/usr/sbin/munin10:05:281
278187994626,12cyclictest312001-21fschecks_time10:25:201
278187994626,10cyclictest300775-21munin-node09:20:111
278187994625,14cyclictest326594-21/usr/sbin/munin11:50:241
278187994623,14cyclictest0-21swapper/111:05:261
278187994623,12cyclictest0-21swapper/108:20:141
278187994621,14cyclictest0-21swapper/110:10:121
27818799460,18cyclictest0-21swapper/110:50:011
278184994618,24cyclictest0-21swapper/007:25:010
27818499461,39cyclictest0-21swapper/011:00:010
278187994534,7cyclictest292762-21grep08:30:281
278187994529,12cyclictest333414-21/usr/sbin/munin12:30:251
278187994529,12cyclictest333414-21/usr/sbin/munin12:30:241
278187994528,9cyclictest289763-21sh08:15:211
278187994528,12cyclictest0-21swapper/108:55:131
278187994528,12cyclictest0-21swapper/108:55:131
278187994528,10cyclictest331946-21/usr/sbin/munin12:20:281
278187994525,13cyclictest295713-21/usr/sbin/munin08:50:201
278187994522,16cyclictest306506-21head09:50:261
278184994537,4cyclictest167350irq/118-8000000.ethernet-tx007:40:010
278184994535,5cyclictest301432-21apt-config09:25:000
27818499451,12cyclictest0-21swapper/008:10:010
278188994436,5cyclictest324376-21run-parts11:40:012
278188994433,7cyclictest334537-21unixbench_singl12:35:292
278188994430,9cyclictest0-21swapper/208:40:292
278188994429,9cyclictest0-21swapper/211:05:212
27818899441,33cyclictest2215812-1kworker/2:0H+kblockd09:44:232
278187994435,5cyclictest325433-21apt-get11:45:141
278187994435,5cyclictest325433-21apt-get11:45:131
278187994432,7cyclictest0-21swapper/111:20:271
278187994431,9cyclictest0-21swapper/107:45:141
278187994431,9cyclictest0-21swapper/107:45:141
278187994429,10cyclictest0-21swapper/108:35:121
278187994428,10cyclictest297380-21diskstats09:00:181
278187994426,8cyclictest285461-21/usr/sbin/munin07:50:181
278184994433,8cyclictest300561-21sendmail09:20:010
278184994431,10cyclictest294854-21fschecks_count08:45:200
27818499441,5cyclictest285036-21awk07:45:290
27818499441,5cyclictest285036-21awk07:45:290
27818499441,41cyclictest0-21swapper/010:40:290
278188994336,4cyclictest0-21swapper/210:55:002
278188994323,15cyclictest311ktimers/207:20:152
278187994333,6cyclictest298783-21apt-get09:10:051
278187994332,7cyclictest0-21swapper/110:40:291
278187994331,8cyclictest324293-21/usr/sbin/munin11:35:291
278187994329,7cyclictest294001-21/usr/sbin/munin08:40:191
278187994328,11cyclictest0-21swapper/108:00:131
278187994321,11cyclictest0-21swapper/110:00:141
278184994337,4cyclictest167350irq/118-8000000.ethernet-tx011:55:210
278184994333,7cyclictest296988-21grep08:55:290
278184994333,7cyclictest296988-21grep08:55:290
27818499431,5cyclictest0-21swapper/009:25:050
278188994235,4cyclictest30-21rcuc/209:25:022
278188994230,8cyclictest0-21swapper/207:50:282
278188994230,8cyclictest0-21swapper/207:30:002
278187994229,10cyclictest0-21swapper/112:00:171
278187994228,7cyclictest0-21swapper/108:25:201
278187994226,9cyclictest302672-21/usr/sbin/munin09:30:201
278184994232,7cyclictest287633-21grep08:00:290
278184994225,15cyclictest0-21swapper/012:05:200
278184994223,13cyclictest131ktimers/011:30:150
278188994130,5cyclictest328555-21grep12:00:312
278188994129,8cyclictest327385-21kernelversion11:55:242
278188994115,22cyclictest30-21rcuc/209:00:012
278188994115,22cyclictest30-21rcuc/209:00:012
27818799414,9cyclictest0-21swapper/107:10:011
278187994126,9cyclictest299971-21dropbear09:15:171
278184994134,4cyclictest167350irq/118-8000000.ethernet-tx012:30:160
278184994134,4cyclictest167350irq/118-8000000.ethernet-tx012:30:160
278184994134,2cyclictest0-21swapper/011:45:260
278184994134,2cyclictest0-21swapper/011:45:260
27818499411,5cyclictest290722-21irqstats08:20:230
27818499411,38cyclictest0-21swapper/009:30:160
27818499411,34cyclictest320310-21latency_hist11:15:020
278188994031,4cyclictest0-21swapper/211:25:292
278188994018,11cyclictest311ktimers/207:10:112
27818899401,33cyclictest2879211/usr/sbin/munin08:05:292
278187994024,12cyclictest0-21swapper/108:05:141
27818499405,4cyclictest0-21swapper/011:55:010
278184994034,4cyclictest0-21swapper/007:30:140
278184994032,5cyclictest0-21swapper/010:30:000
27818499401,9cyclictest0-21swapper/007:55:000
278188993930,4cyclictest0-21swapper/210:45:312
278188993928,7cyclictest305248-21grep09:45:232
278188993927,8cyclictest0-21swapper/208:45:212
278188993926,9cyclictest311ktimers/208:10:122
278188993925,6cyclictest0-21swapper/208:15:302
278188993925,10cyclictest0-21swapper/209:15:312
278188993924,8cyclictest0-21swapper/210:40:292
278188993924,10cyclictest14-21rcu_preempt10:35:002
278184993932,4cyclictest167350irq/118-8000000.ethernet-tx010:15:270
278184993925,8cyclictest0-21swapper/010:45:300
278184993923,14cyclictest0-21swapper/007:25:250
27818499391,5cyclictest0-21swapper/009:05:000
27818499391,3cyclictest0-21swapper/009:15:010
27818499391,36cyclictest0-21swapper/010:10:300
27818499391,35cyclictest0-21swapper/012:35:260
27818499391,2cyclictest0-21swapper/009:55:010
278188993830,4cyclictest0-21swapper/207:50:002
278188993830,4cyclictest0-21swapper/207:50:002
278188993827,5cyclictest282581-21grep07:30:282
278188993826,7cyclictest293657-21grep08:35:282
278188993826,7cyclictest0-21swapper/207:15:272
278184993830,4cyclictest14-21rcu_preempt10:05:200
278184993829,7cyclictest324385-21sendmail11:40:000
27818499381,35cyclictest0-21swapper/008:40:300
278188993731,3cyclictest2-21kthreadd12:24:242
278188993728,5cyclictest0-21swapper/211:35:012
278188993726,7cyclictest311ktimers/207:55:212
278188993726,5cyclictest311ktimers/212:30:292
278188993726,5cyclictest311ktimers/212:30:292
278188993723,9cyclictest0-21swapper/208:30:012
278188993722,8cyclictest0-21swapper/210:55:312
278188993714,11cyclictest311ktimers/209:50:102
278184993731,4cyclictest20850irq/208-8000000.ethernet08:15:210
278184993731,4cyclictest0-21swapper/007:40:160
27818499371,34cyclictest0-21swapper/012:15:160
27818499371,34cyclictest0-21swapper/011:05:210
27818499371,34cyclictest0-21swapper/010:50:070
27818499371,34cyclictest0-21swapper/009:45:220
27818499371,34cyclictest0-21swapper/008:10:240
278188993627,4cyclictest0-21swapper/208:55:012
278188993625,6cyclictest0-21swapper/210:35:262
278188993625,6cyclictest0-21swapper/210:35:262
278188993623,10cyclictest0-21swapper/209:00:262
27818899362,27cyclictest301588-21latency_hist09:25:012
278184993630,3cyclictest167350irq/118-8000000.ethernet-tx010:20:220
278184993627,5cyclictest329933-21cut12:10:210
278188993525,6cyclictest320901-21grep11:15:302
278188993522,6cyclictest30-21rcuc/208:30:152
278188993518,10cyclictest311ktimers/211:50:112
278184993531,2cyclictest0-21swapper/007:59:560
278184993524,7cyclictest0-21swapper/011:25:220
278184993519,14cyclictest0-21swapper/009:44:300
27818499351,32cyclictest0-21swapper/012:28:310
27818499351,32cyclictest0-21swapper/009:59:290
27818499351,32cyclictest0-21swapper/009:59:290
27818499351,32cyclictest0-21swapper/008:36:450
278188993426,4cyclictest0-21swapper/207:40:292
278188993424,6cyclictest303112-21grep09:30:292
278188993421,9cyclictest0-21swapper/210:15:302
278184993428,4cyclictest20850irq/208-8000000.ethernet11:00:240
27818499341,31cyclictest0-21swapper/012:02:300
278188993326,4cyclictest0-21swapper/210:20:292
278188993323,7cyclictest30-21rcuc/207:35:172
278188993323,4cyclictest0-21swapper/212:15:302
278188993321,8cyclictest0-21swapper/211:40:302
27818499331,3cyclictest0-21swapper/012:21:000
27818899323,7cyclictest832-21systemd-network09:14:252
278188993223,6cyclictest30-21rcuc/209:35:242
278188993222,7cyclictest30-21rcuc/211:20:182
278188993220,7cyclictest0-21swapper/209:10:012
278188993220,7cyclictest0-21swapper/209:10:012
278188993124,5cyclictest30-21rcuc/212:25:272
278188993123,5cyclictest30-21rcuc/210:10:212
278188993122,7cyclictest30-21rcuc/211:10:262
278188993121,7cyclictest311ktimers/210:00:182
278188993115,5cyclictest167550irq/134-8000000.ethernet-tx208:24:222
27818499311,28cyclictest0-21swapper/010:01:140
27818899301,27cyclictest0-21swapper/210:25:202
27818499301,23cyclictest0-21swapper/007:10:010
278188992922,4cyclictest0-21swapper/211:45:262
278188992922,4cyclictest0-21swapper/211:45:262
278188992619,4cyclictest311ktimers/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional