You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 14:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Mon Nov 24, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3728317991427,124cyclictest0-21swapper/023:25:010
3728317991427,124cyclictest0-21swapper/023:25:010
3728317997733,10cyclictest0-21swapper/023:50:260
3728317997063,4cyclictest0-21swapper/000:15:160
3728321996830,31cyclictest30-21rcuc/219:35:022
372831799681,55cyclictest0-21swapper/019:10:140
372831799652,48cyclictest0-21swapper/019:40:140
3728319996319,15cyclictest22-21rcuc/120:05:181
372831999631,31cyclictest0-21swapper/121:05:191
372831799625,13cyclictest0-21swapper/000:30:010
3728317996243,9cyclictest3737127-21apt-key20:00:010
3728321996120,17cyclictest3745632-21cat20:50:002
3728319996023,18cyclictest1325-21sendmail-mta23:35:141
3728319996023,18cyclictest1325-21sendmail-mta23:35:141
3728319996012,13cyclictest22-21rcuc/123:45:011
3728321995940,11cyclictest311ktimers/223:50:142
3728321995837,15cyclictest311ktimers/222:15:132
3728317995743,2cyclictest0-21swapper/000:20:110
3728317995743,2cyclictest0-21swapper/000:20:110
372831799571,4cyclictest0-21swapper/023:10:010
372831799571,4cyclictest0-21swapper/023:10:000
3728317995647,5cyclictest0-21swapper/021:25:140
372831999556,23cyclictest0-21swapper/123:45:011
372831999551,35cyclictest0-21swapper/120:50:011
3728319995444,6cyclictest3740479-21run-parts20:20:011
3728319995444,6cyclictest3740479-21run-parts20:20:011
372831999538,17cyclictest3773224-21/usr/sbin/munin23:30:201
372831999534,16cyclictest3770684-21/usr/sbin/munin23:15:181
3728319995140,9cyclictest1287-21cron00:34:591
3728321995042,4cyclictest3751737-21munin-plugin-st21:25:002
3728319995045,3cyclictest0-21swapper/122:35:011
3728317995036,5cyclictest3778900-21head00:00:290
3728321994930,11cyclictest311ktimers/220:25:132
3728319994931,13cyclictest3762903-21apt-key22:30:011
3728321994836,8cyclictest3784955-21sendmail00:40:002
3728321994828,12cyclictest311ktimers/222:45:132
3728317994840,4cyclictest21050irq/252-8000000.ethernet19:35:150
3728317994839,5cyclictest21050irq/252-8000000.ethernet22:30:310
372831799482,3cyclictest3776409-21latency_hist23:50:000
3728321994732,10cyclictest3731023-21grep19:20:312
372831999474,33cyclictest3751015-21apt-key21:20:021
372831999474,33cyclictest3751015-21apt-key21:20:021
372831999474,17cyclictest3769004-21/usr/sbin/munin23:05:191
372831999474,17cyclictest3769004-21/usr/sbin/munin23:05:191
372831999473,22cyclictest3780911-21/usr/sbin/munin00:15:231
3728319994729,11cyclictest0-21swapper/119:50:281
3728319994728,10cyclictest0-21swapper/100:20:281
3728319994728,10cyclictest0-21swapper/100:20:281
3728317994741,4cyclictest0-21swapper/020:45:120
3728317994731,9cyclictest3761869-21grep22:20:290
372831799472,4cyclictest3735860-21phc2sys19:50:270
3728321994632,9cyclictest311ktimers/200:00:132
372831799468,5cyclictest0-21swapper/000:00:000
3728321994531,8cyclictest0-21swapper/221:20:012
3728321994531,8cyclictest0-21swapper/221:20:012
3728321994530,10cyclictest3764573-21munin-plugin-st22:40:002
3728321994530,10cyclictest3764573-21munin-plugin-st22:39:592
3728321994530,10cyclictest0-21swapper/219:55:002
3728321994529,12cyclictest311ktimers/221:40:102
3728321994527,11cyclictest0-21swapper/222:25:222
3728319994530,11cyclictest3761104-21munin-plugin-st22:20:001
3728321994431,9cyclictest0-21swapper/222:50:292
3728319994430,9cyclictest0-21swapper/122:00:301
3728317994435,4cyclictest21050irq/252-8000000.ethernet22:35:190
3728317994435,4cyclictest21050irq/252-8000000.ethernet22:35:190
3728319994319,13cyclictest0-21swapper/119:15:131
3728319994319,12cyclictest0-21swapper/121:10:121
372831999431,10cyclictest0-21swapper/121:55:011
3728317994336,4cyclictest21050irq/252-8000000.ethernet20:05:270
3728317994334,4cyclictest21050irq/252-8000000.ethernet20:55:170
3728317994332,4cyclictest21050irq/252-8000000.ethernet20:35:190
3728317994331,7cyclictest3779687-21sed00:05:320
372831799432,38cyclictest0-21swapper/022:40:120
372831799432,35cyclictest3766207-21unixbench_singl22:45:270
372831799431,4cyclictest0-21swapper/021:15:120
372831799431,4cyclictest0-21swapper/021:15:120
3728321994230,8cyclictest0-21swapper/220:15:002
3728321994230,6cyclictest0-21swapper/220:45:002
3728321994224,13cyclictest311ktimers/219:35:132
3728319994231,5cyclictest0-21swapper/119:14:591
3728319994225,11cyclictest3784307-21apt-get00:35:161
3728319994223,14cyclictest231ktimers/119:35:131
3728319994216,3cyclictest3732757-21users19:30:301
3728317994235,4cyclictest0-21swapper/021:20:160
3728317994234,4cyclictest21050irq/252-8000000.ethernet22:50:220
3728317994234,4cyclictest21050irq/252-8000000.ethernet22:05:140
3728317994234,4cyclictest21050irq/252-8000000.ethernet20:50:170
3728317994232,4cyclictest21050irq/252-8000000.ethernet20:00:190
3728317994232,4cyclictest21050irq/252-8000000.ethernet20:00:190
3728321994128,8cyclictest311ktimers/220:20:152
3728321994128,10cyclictest311ktimers/219:15:152
3728321994126,10cyclictest0-21swapper/223:10:012
3728321994126,10cyclictest0-21swapper/223:10:012
3728321994125,10cyclictest0-21swapper/223:15:212
3728321994124,12cyclictest0-21swapper/200:25:292
3728319994132,5cyclictest168350irq/126-8000000.ethernet-tx121:40:151
3728319994121,14cyclictest0-21swapper/121:35:151
3728319994117,11cyclictest3728313-21cyclictest19:20:141
372831799413,6cyclictest3748106-21head21:00:310
3728317994136,2cyclictest0-21swapper/021:45:010
3728317994134,4cyclictest21050irq/252-8000000.ethernet21:05:190
3728317994134,4cyclictest21050irq/252-8000000.ethernet20:15:190
3728317994134,4cyclictest21050irq/252-8000000.ethernet20:15:190
3728317994134,4cyclictest21050irq/252-8000000.ethernet00:35:250
3728317994133,5cyclictest21050irq/252-8000000.ethernet20:20:280
3728317994133,5cyclictest0-21swapper/019:20:120
3728317994133,4cyclictest3739420-21grep20:10:280
3728317994130,7cyclictest3768736-21grep23:00:280
372831799411,3cyclictest0-21swapper/019:10:010
3728321994029,7cyclictest3748123-21grep21:00:312
3728321994029,5cyclictest0-21swapper/222:00:282
3728321994028,9cyclictest311ktimers/220:05:132
3728321994025,11cyclictest311ktimers/200:30:152
372831999406,29cyclictest0-21swapper/120:55:191
3728319994033,4cyclictest3745551-21munin-plugin-st20:50:011
3728319994023,12cyclictest0-21swapper/121:20:281
372831999401,2cyclictest0-21swapper/120:40:011
3728317994033,4cyclictest21050irq/252-8000000.ethernet23:30:190
3728317994033,4cyclictest21050irq/252-8000000.ethernet23:15:210
3728317994033,4cyclictest21050irq/252-8000000.ethernet21:50:230
3728317994033,4cyclictest21050irq/252-8000000.ethernet20:40:250
3728317994028,7cyclictest0-21swapper/020:30:280
3728317994028,7cyclictest0-21swapper/020:30:280
3728317994025,9cyclictest0-21swapper/021:30:210
3728317994025,9cyclictest0-21swapper/021:30:210
3728321993929,6cyclictest3731947-21munin-plugin-st19:30:002
3728321993929,6cyclictest0-21swapper/221:30:272
3728321993929,6cyclictest0-21swapper/221:30:272
3728321993921,10cyclictest0-21swapper/223:55:292
3728319993928,8cyclictest0-21swapper/122:50:001
3728319993924,8cyclictest3735325-21munin-plugin-st19:50:001
3728319993916,14cyclictest3772705-21/usr/sbin/munin23:25:261
3728319993913,17cyclictest3777206-21grep23:50:301
3728317993932,4cyclictest21050irq/252-8000000.ethernet22:15:240
3728317993932,4cyclictest21050irq/252-8000000.ethernet21:45:210
3728317993932,4cyclictest21050irq/252-8000000.ethernet21:35:220
3728317993931,4cyclictest21050irq/252-8000000.ethernet23:40:130
3728317993930,6cyclictest3780779-21sed00:15:010
3728321993826,9cyclictest0-21swapper/220:35:012
3728321993826,9cyclictest0-21swapper/220:35:002
3728321993826,6cyclictest3770418-21grep23:10:302
3728321993822,9cyclictest0-21swapper/223:25:262
3728321993822,10cyclictest0-21swapper/219:45:272
372832199381,20cyclictest3774923-21/usr/sbin/munin23:40:192
372831999384,28cyclictest22-21rcuc/123:00:211
3728319993826,7cyclictest0-21swapper/120:10:291
3728319993821,12cyclictest0-21swapper/122:35:141
3728319993821,12cyclictest0-21swapper/122:35:141
372831999381,4cyclictest0-21swapper/119:30:011
3728319993812,19cyclictest3778639-21cut00:00:261
3728319993811,12cyclictest24-21ksoftirqd/121:30:011
3728317993831,4cyclictest21050irq/252-8000000.ethernet19:45:200
3728317993831,3cyclictest0-21swapper/019:15:020
3728317993829,5cyclictest21250irq/208-8000000.ethernet00:30:270
3728321993731,4cyclictest3774697-21cron23:40:002
3728321993731,4cyclictest3774697-21cron23:40:002
372831999377,16cyclictest3728313-21cyclictest22:10:171
372831999372,5cyclictest3779238-21cut00:05:231
3728319993725,8cyclictest3764545-21kworker/u8:0-events_power_efficient22:40:251
3728319993725,6cyclictest0-21swapper/120:00:021
3728319993723,9cyclictest3741536-21apt-get20:25:171
3728319993719,11cyclictest0-21swapper/122:05:101
3728319993716,8cyclictest0-21swapper/121:30:141
3728319993716,8cyclictest0-21swapper/121:30:141
3728317993729,5cyclictest3732249-21sh19:30:200
3728317993729,4cyclictest1668-21snmpd23:35:240
3728317993729,4cyclictest1668-21snmpd23:35:240
372831799371,8cyclictest3749672-21grep21:10:260
3728321993621,9cyclictest0-21swapper/223:30:292
3728321993620,11cyclictest0-21swapper/200:20:252
3728321993620,11cyclictest0-21swapper/200:20:242
3728321993618,13cyclictest311ktimers/222:20:142
3728321993610,17cyclictest3779981-21/usr/sbin/munin00:10:232
372831999369,12cyclictest0-21swapper/120:35:021
372831999369,12cyclictest0-21swapper/120:35:021
3728319993629,3cyclictest3733848-21apt-get19:40:151
3728319993622,7cyclictest0-21swapper/123:10:301
3728319993619,10cyclictest0-21swapper/122:20:151
372831999361,4cyclictest0-21swapper/123:25:011
372831999361,4cyclictest0-21swapper/123:25:011
3728317993627,5cyclictest3772982-21grep23:25:290
372832199351,28cyclictest0-21swapper/222:00:002
372831999359,4cyclictest3766769-21meminfo22:50:241
3728319993527,4cyclictest0-21swapper/121:04:591
3728317993531,2cyclictest0-21swapper/021:55:170
3728317993528,4cyclictest0-21swapper/023:10:280
3728321993427,3cyclictest3737001-21sh19:59:592
3728321993425,5cyclictest0-21swapper/223:00:292
3728321993425,5cyclictest0-21swapper/200:05:292
3728321993423,7cyclictest0-21swapper/219:10:232
3728321993420,8cyclictest0-21swapper/221:45:212
3728321993417,9cyclictest3747272-21grep20:55:282
3728319993423,7cyclictest0-21swapper/120:20:311
3728319993422,7cyclictest0-21swapper/120:00:291
3728319993422,7cyclictest0-21swapper/120:00:291
3728319993418,12cyclictest0-21swapper/120:40:171
3728317993430,2cyclictest0-21swapper/022:10:210
3728317993429,2cyclictest0-21swapper/022:00:210
3728317993426,5cyclictest3767453-21lsblk22:55:210
3728317993423,7cyclictest0-21swapper/022:25:310
3728321993329,2cyclictest0-21swapper/222:40:252
3728321993322,6cyclictest0-21swapper/221:35:212
3728321993321,8cyclictest311ktimers/220:50:122
3728321993317,11cyclictest0-21swapper/223:00:012
3728319993316,12cyclictest0-21swapper/121:45:281
3728319993314,12cyclictest3757256-21/usr/sbin/munin21:55:211
3728319993313,12cyclictest3767404-21ssh22:55:201
3728317993324,6cyclictest3731365-21/usr/sbin/munin19:25:180
372831799331,3cyclictest0-21swapper/020:25:200
3728321993226,3cyclictest3781569-21sendmail00:20:002
3728321993223,4cyclictest0-21swapper/221:05:222
3728319993215,8cyclictest0-21swapper/119:10:011
3728321993123,4cyclictest0-21swapper/219:40:232
3728321993121,5cyclictest0-21swapper/221:15:012
3728321993120,7cyclictest0-21swapper/223:45:282
3728321993118,9cyclictest30-21rcuc/222:05:132
3728321993117,9cyclictest0-21swapper/223:25:002
3728321993117,9cyclictest0-21swapper/223:25:002
3728321993117,12cyclictest311ktimers/220:15:142
3728321993117,12cyclictest311ktimers/220:15:142
3728319993118,7cyclictest3777898-21/usr/sbin/munin23:55:281
3728319993116,10cyclictest3780112-21/usr/sbin/munin00:10:241
3728321993024,4cyclictest3743860-21munin-plugin-st20:39:592
372832199301,27cyclictest0-21swapper/222:30:162
3728319992913,10cyclictest3783161-21grep00:25:291
3728321992820,4cyclictest0-21swapper/221:50:212
372832199267,16cyclictest0-21swapper/222:10:492
3728321992622,2cyclictest0-21swapper/221:25:292
3728321992616,6cyclictest0-21swapper/220:05:012
3728321992616,6cyclictest0-21swapper/220:05:002
372832199251,12cyclictest30-21rcuc/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional