You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 00:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Wed Sep 16, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4002935997535,35cyclictest0-21swapper/109:00:011
4002935997033,31cyclictest0-21swapper/110:25:281
4002935996731,31cyclictest0-21swapper/110:35:291
4002935996728,31cyclictest0-21swapper/110:05:271
4002933996617,45cyclictest4054294-21latency_hist12:10:010
4002933996617,45cyclictest4019970-21find08:45:280
4002933996531,29cyclictest4043779-21cut11:05:270
4002933996420,3cyclictest4016385-21/usr/sbin/munin08:25:230
4002935996326,33cyclictest4039682-21grep10:40:291
4002935996321,35cyclictest0-21swapper/111:40:281
4002935996216,39cyclictest0-21swapper/108:50:291
400293599621,53cyclictest4018018-21ssh08:35:231
4002935996140,17cyclictest4027672-21grep09:30:301
4002935996138,18cyclictest4055228-21munin-plugin-st12:15:001
4002935996127,28cyclictest0-21swapper/111:00:291
400293599612,50cyclictest4018983-21meminfo08:40:271
400293599612,50cyclictest4018983-21meminfo08:40:271
400293599611,51cyclictest4007604-21apt-get07:35:131
400293599611,51cyclictest4003097-21apt-get07:10:131
400293599603,48cyclictest4010980-21apt-get07:55:151
400293599603,48cyclictest4010980-21apt-get07:55:141
400293599602,50cyclictest4028814-21apt-get09:40:171
400293599601,51cyclictest4022063-21apt-get09:00:151
400293599601,50cyclictest4011839-21apt-get08:00:151
4002933996015,42cyclictest0-21swapper/008:20:290
4002935995936,19cyclictest4036304-21unixbench_multi10:20:281
4002935995929,25cyclictest4054226-21grep12:05:291
400293599591,51cyclictest4025738-21memory09:20:251
400293599591,51cyclictest4004303-21/usr/sbin/munin07:15:171
400293599591,50cyclictest4019526-21apt-get08:45:151
400293599581,51cyclictest4027955-21/usr/sbin/munin09:35:121
400293599581,51cyclictest4027955-21/usr/sbin/munin09:35:121
400293599581,50cyclictest4030564-21/usr/sbin/munin09:50:161
400293599581,50cyclictest4030564-21/usr/sbin/munin09:50:161
400293599581,50cyclictest4015306-21munin-node08:20:121
400293599581,49cyclictest4045977-21apt-get11:20:151
400293599581,48cyclictest4006761-21apt-get07:30:151
4002933995830,25cyclictest4031332-21/usr/sbin/munin09:55:120
400293599572,47cyclictest4040388-21/usr/sbin/munin10:45:271
4002935995723,30cyclictest0-21swapper/110:15:291
400293599571,49cyclictest4059141-21/usr/sbin/munin12:35:261
400293599571,49cyclictest4026632-21/usr/sbin/munin09:25:261
400293599571,48cyclictest4046907-21apt-get11:25:141
4002933995747,6cyclictest0-21swapper/011:10:280
400293599562,46cyclictest4040810-21apt-get10:50:131
400293599562,46cyclictest4016149-21apt-get08:25:151
400293599562,45cyclictest4013607-21apt-get08:10:121
4002935995620,30cyclictest0-21swapper/112:20:291
4002933995623,4cyclictest4011583-21sed07:55:300
4002933995623,4cyclictest4011583-21sed07:55:300
4002933995610,43cyclictest4041754-21fschecks_count10:55:190
400293599555,44cyclictest4009877-21grep07:45:271
400293599552,45cyclictest4048739-21ssh11:35:221
400293599552,45cyclictest4023102-21/usr/sbin/munin09:05:211
4002935995517,34cyclictest0-21swapper/107:50:251
400293599551,47cyclictest4051120-21/usr/sbin/munin11:50:291
400293599551,46cyclictest4045116-21apt-get11:15:121
400293599551,46cyclictest4024579-21apt-get09:15:141
400293599551,46cyclictest4008462-21apt-get07:40:111
400293599551,46cyclictest4008462-21apt-get07:40:111
400293599551,46cyclictest4005296-21/usr/sbin/munin07:20:211
400293599551,45cyclictest4057966-21apt-get12:30:141
4002933995525,3cyclictest4007311-21unixbench_multi07:30:290
400293599543,44cyclictest4047745-21apt-get11:30:141
400293599541,47cyclictest4029952-21/usr/sbin/munin09:45:251
400293599541,46cyclictest4055504-21/usr/sbin/munin12:15:201
400293599541,46cyclictest4052301-21/usr/sbin/munin11:55:251
400293599541,45cyclictest4034028-21diskstats10:10:171
400293599541,44cyclictest4037430-21apt-get10:30:151
400293399549,43cyclictest0-21swapper/010:05:270
4002933995442,8cyclictest4036798-21/usr/sbin/munin10:25:210
4002933995436,13cyclictest4029072-21/usr/sbin/munin09:40:250
4002933995422,4cyclictest4017027-21grep08:30:130
4002933995419,30cyclictest4034040-21/usr/sbin/munin10:10:180
4002933995417,34cyclictest4041491-21latency_hist10:55:010
400293599537,38cyclictest0-21swapper/112:00:271
400293599532,42cyclictest4031629-21/usr/sbin/munin09:55:251
400293599531,45cyclictest4057127-21apt-get12:25:151
400293599531,45cyclictest4043747-21/usr/sbin/munin11:05:261
400293599531,45cyclictest4032250-21/usr/sbin/munin10:00:161
400293599531,45cyclictest4032250-21/usr/sbin/munin10:00:161
400293599531,45cyclictest4005920-21munin-node07:25:121
4002933995343,8cyclictest4046274-21/usr/sbin/munin11:20:250
4002933995322,3cyclictest4029951-21meminfo09:45:250
4002933995312,4cyclictest4025460-21grep09:20:160
400293599521,45cyclictest4024098-21/usr/sbin/munin09:10:261
400293599521,43cyclictest4050283-21apt-get11:45:141
4002933995243,6cyclictest4047164-21/usr/sbin/munin11:25:220
4002933995240,8cyclictest4057963-21munin-node12:30:110
4002933995220,29cyclictest4048758-21tune2fs11:35:230
4002933995220,29cyclictest0-21swapper/007:15:010
4002933995217,8cyclictest4018504-21latency_hist08:40:000
4002935995129,18cyclictest0-21swapper/111:10:281
400293599511,44cyclictest4042258-21/usr/sbin/munin10:55:291
400293599511,43cyclictest4017205-21/usr/sbin/munin08:30:191
400293599511,43cyclictest4012675-21/usr/sbin/munin08:05:121
400293599511,43cyclictest4012675-21/usr/sbin/munin08:05:121
4002933995145,3cyclictest4024879-21/usr/sbin/munin09:15:260
4002933995139,8cyclictest0-21swapper/011:30:180
4002933995138,10cyclictest4011842-21/usr/sbin/munin08:00:170
4002933995128,19cyclictest0-21swapper/007:50:170
4002933995122,3cyclictest4032451-21irqstats10:00:220
4002933995122,3cyclictest4032451-21irqstats10:00:220
4002933995116,28cyclictest0-21swapper/008:55:010
400293599501,42cyclictest4014450-21/usr/sbin/munin08:15:171
4002933995038,8cyclictest4057498-21/usr/sbin/munin12:25:250
4002933995033,12cyclictest4027546-21cut09:30:290
4002933994937,9cyclictest4009597-21meminfo07:45:230
4002933994936,8cyclictest4045328-21/usr/sbin/munin11:15:210
4002933994934,10cyclictest4004553-21phc2sys07:15:250
4002933994932,14cyclictest4040477-21/usr/sbin/munin10:45:280
4002933994930,12cyclictest4024144-21ptp4l09:10:270
4002933994915,30cyclictest0-21swapper/007:20:270
4002933994837,8cyclictest4028158-21/usr/sbin/munin09:35:220
4002933994837,8cyclictest4028158-21/usr/sbin/munin09:35:220
4002933994836,8cyclictest4012748-21/usr/sbin/munin08:05:190
4002933994836,8cyclictest4012748-21/usr/sbin/munin08:05:180
4002933994835,9cyclictest4014953-21/usr/sbin/munin08:15:290
4002933994834,10cyclictest4030728-21/usr/sbin/munin09:50:210
4002933994834,10cyclictest4030728-21/usr/sbin/munin09:50:210
4002933994833,10cyclictest4018851-21cut08:40:220
4002933994833,10cyclictest4018851-21cut08:40:220
4002933994832,13cyclictest4054878-21/usr/sbin/munin12:10:210
4002933994831,9cyclictest4013769-21cut08:10:200
4002933994831,9cyclictest4006471-21tail07:25:280
4002933994831,11cyclictest4059337-21sed12:35:290
4002933994816,6cyclictest4008532-21diskstats07:40:180
4002933994816,6cyclictest4008532-21diskstats07:40:180
4002933994736,8cyclictest4039607-21/usr/sbin/munin10:40:290
4002933994735,8cyclictest4022480-21/usr/sbin/munin09:00:260
4002933994732,11cyclictest4043165-21head11:00:300
4002933994731,12cyclictest4049543-21cut11:40:190
4002933994731,12cyclictest0-21swapper/010:15:120
4002933994731,10cyclictest4038317-21/usr/sbin/munin10:35:160
4002933994718,3cyclictest4056586-21memory12:20:250
4002933994715,7cyclictest4023266-21ps09:05:250
4002933994715,3cyclictest4052785-21ls12:00:010
4002933994635,8cyclictest4007816-21/usr/sbin/munin07:35:230
4002933994633,8cyclictest4050574-21/usr/sbin/munin11:45:240
4002933994632,11cyclictest4037427-21munin-node10:30:120
4002933994610,30cyclictest0-21swapper/009:00:010
4002933994534,7cyclictest4035796-21/usr/sbin/munin10:20:160
4002933994533,9cyclictest4053190-21/usr/sbin/munin12:00:260
4002939994429,9cyclictest4048278-21unixbench_multi11:30:292
4002933994419,17cyclictest4027034-21latency_hist09:30:010
4002939994330,9cyclictest0-21swapper/211:40:002
4002939994330,8cyclictest0-21swapper/212:05:292
4002939994325,8cyclictest0-21swapper/211:40:282
4002939994325,13cyclictest0-21swapper/208:35:302
4002933994327,11cyclictest4055957-21grep12:15:290
4002939994233,6cyclictest4008250-21sendmail07:40:002
4002939994230,9cyclictest0-21swapper/207:30:292
4002939994227,9cyclictest0-21swapper/212:35:292
4002939994226,8cyclictest0-21swapper/210:15:292
4002939994224,8cyclictest0-21swapper/208:00:292
4002939994224,10cyclictest0-21swapper/207:50:262
4002939994217,13cyclictest0-21swapper/208:10:202
400293599422,29cyclictest3988281-21kworker/u8:3+ext4-rsv-conversion07:10:001
4002933994230,8cyclictest4051227-21/usr/sbin/munin11:50:190
4002939994129,8cyclictest0-21swapper/209:05:272
4002939994129,8cyclictest0-21swapper/208:25:292
4002939994128,8cyclictest0-21swapper/208:10:012
4002939994128,8cyclictest0-21swapper/208:10:012
4002939994125,8cyclictest4037689-21/usr/sbin/munin10:30:242
4002939994031,5cyclictest0-21swapper/208:00:002
4002939994031,5cyclictest0-21swapper/208:00:002
4002939994030,6cyclictest0-21swapper/210:45:292
4002939994028,8cyclictest0-21swapper/212:20:292
4002939994028,7cyclictest0-21swapper/209:40:302
4002939994028,7cyclictest0-21swapper/209:35:292
4002939994028,7cyclictest0-21swapper/209:35:292
4002939994027,8cyclictest0-21swapper/207:15:282
4002939994026,9cyclictest0-21swapper/207:40:282
4002939994026,9cyclictest0-21swapper/207:40:282
4002939993927,7cyclictest4015309-21apt-get08:20:162
4002939993926,9cyclictest0-21swapper/210:40:292
4002939993926,8cyclictest0-21swapper/207:10:302
4002939993925,9cyclictest0-21swapper/210:00:192
4002939993925,9cyclictest0-21swapper/210:00:192
4002939993924,8cyclictest0-21swapper/212:10:262
4002939993922,8cyclictest4058257-21/usr/sbin/munin12:30:242
4002939993916,13cyclictest4027306-21fschecks_time09:30:232
4002939993916,11cyclictest4024080-21phc2sys-jitter09:10:262
4002933993912,22cyclictest0-21swapper/007:10:000
4002939993828,5cyclictest4031334-21apt-get09:55:172
4002939993827,7cyclictest0-21swapper/212:15:292
4002939993826,7cyclictest0-21swapper/211:00:292
4002939993822,8cyclictest0-21swapper/209:00:232
4002939993821,8cyclictest4030240-21grep09:45:292
4002939993818,12cyclictest4014601-21cut08:15:212
4002939993814,16cyclictest4046122-21sh11:20:212
4002939993814,14cyclictest4009883-21head07:45:262
400293999374,27cyclictest311ktimers/211:50:182
4002939993726,6cyclictest0-21swapper/211:10:192
4002939993725,5cyclictest0-21swapper/210:20:282
4002939993628,4cyclictest4047545-21munin-plugin-st11:30:002
4002939993628,4cyclictest4043759-21/usr/sbin/munin11:05:262
4002939993628,4cyclictest0-21swapper/212:00:272
4002939993625,5cyclictest0-21swapper/211:45:282
4002939993619,10cyclictest4034649-21latency_hist10:15:002
4002939993616,11cyclictest4038819-21tail10:35:292
400293999359,15cyclictest4024766-21fschecks_time09:15:212
400293999357,22cyclictest0-21swapper/211:00:012
4002939993527,4cyclictest4005923-21apt-get07:25:162
4002939993526,5cyclictest0-21swapper/208:45:202
4002939993526,4cyclictest4025737-21/usr/sbin/munin09:20:242
4002939993520,8cyclictest4030826-21phc2sys09:50:242
4002939993520,8cyclictest4030826-21phc2sys09:50:242
4002939993519,8cyclictest4020768-21/usr/sbin/munin08:50:282
4002939993427,4cyclictest311ktimers/210:30:002
4002939993426,4cyclictest4005084-21apt-get07:20:152
4002939993426,4cyclictest0-21swapper/208:40:182
4002939993426,4cyclictest0-21swapper/208:40:182
4002939993423,6cyclictest0-21swapper/208:55:282
4002939993421,8cyclictest0-21swapper/210:05:192
4002939993416,11cyclictest4057648-21grep12:25:282
4002939993415,8cyclictest4052484-21grep11:55:272
4002939993414,13cyclictest167550irq/134-8000000.ethernet-tx211:15:252
4002939993324,5cyclictest0-21swapper/210:50:202
4002939993324,4cyclictest0-21swapper/209:30:012
4002939993315,11cyclictest4017104-21cut08:30:172
4002939992818,7cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional