You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 23:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sat Apr 04, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
975040999413,71cyclictest0-21swapper/010:30:250
975040997234,8cyclictest0-21swapper/008:15:290
975040997234,8cyclictest0-21swapper/008:15:290
975042995851,5cyclictest231ktimers/110:50:201
975040995524,27cyclictest997001-21/usr/sbin/munin09:15:240
97504499537,33cyclictest30-21rcuc/210:05:012
975042995327,18cyclictest231ktimers/107:55:111
975044995239,8cyclictest1027374-21latency_hist12:15:002
97504499511,32cyclictest0-21swapper/210:55:012
97504299517,10cyclictest22-21rcuc/110:05:011
975042995138,9cyclictest1000765-21sendmail09:40:001
975040995138,10cyclictest1017825-21sendmail11:20:000
975044995042,4cyclictest1016140-21munin-plugin-st11:09:592
975044994940,5cyclictest1000755-21cat09:40:002
975042994911,24cyclictest982311-21/usr/sbin/munin07:50:201
97504499481,28cyclictest0-21swapper/211:35:012
97504499481,28cyclictest0-21swapper/211:35:012
975042994838,6cyclictest984564-21grep08:00:291
975042994832,11cyclictest0-21swapper/110:15:281
975042994828,12cyclictest231ktimers/110:30:131
975042994725,15cyclictest231ktimers/109:25:171
975042994725,15cyclictest231ktimers/109:25:171
975042994635,6cyclictest0-21swapper/108:45:281
97504299463,19cyclictest974980-21apt-get07:10:021
975042994630,10cyclictest0-21swapper/108:10:011
975042994630,10cyclictest0-21swapper/108:10:011
97504099469,28cyclictest0-21swapper/010:15:010
975044994532,9cyclictest311ktimers/210:45:122
975044994530,10cyclictest0-21swapper/207:55:002
975044994526,10cyclictest1030674-21munin-plugin-st12:35:002
975042994539,4cyclictest231ktimers/109:50:011
975042994539,4cyclictest231ktimers/109:50:011
975042994537,5cyclictest1017823-21latency_hist11:20:001
975040994537,5cyclictest0-21swapper/008:10:110
975040994536,5cyclictest0-21swapper/012:25:300
975040994531,10cyclictest0-21swapper/009:25:300
975040994531,10cyclictest0-21swapper/009:25:300
975040994523,20cyclictest20650irq/252-8000000.ethernet07:15:260
975042994426,12cyclictest231ktimers/109:55:131
975042994425,9cyclictest0-21swapper/107:25:291
975042994425,9cyclictest0-21swapper/107:25:291
975040994438,3cyclictest0-21swapper/012:10:100
975040994432,9cyclictest990641-21sendmail08:40:000
97504099443,14cyclictest15-21rcuc/010:25:010
975044994332,6cyclictest975805-21grep07:10:282
975044994331,9cyclictest1021291-21sendmail11:39:592
975044994328,9cyclictest311ktimers/208:00:152
975044994325,13cyclictest0-21swapper/207:25:292
975044994325,13cyclictest0-21swapper/207:25:292
975042994336,4cyclictest988113-21munin-plugin-st08:25:011
975040994331,9cyclictest0-21swapper/010:20:010
975044994228,8cyclictest1007629-21grep10:15:282
975042994228,9cyclictest991420-21grep08:40:291
975042994226,8cyclictest0-21swapper/112:20:271
975042994224,13cyclictest231ktimers/107:30:121
97504099421,3cyclictest983320-21dropbear07:55:220
975044994132,6cyclictest1002543-21munin-plugin-st09:50:002
975044994129,7cyclictest0-21swapper/208:45:212
975044994122,11cyclictest311ktimers/208:20:122
975042994126,10cyclictest0-21swapper/111:25:201
975042994126,10cyclictest0-21swapper/111:20:261
97504099416,4cyclictest0-21swapper/010:40:010
97504099413,5cyclictest976019-21latency_hist07:15:010
975040994134,5cyclictest985485-21munin-plugin-st08:10:000
975040994134,5cyclictest985485-21munin-plugin-st08:10:000
975040994134,4cyclictest0-21swapper/010:00:280
975040994132,6cyclictest0-21swapper/009:35:150
97504099412,4cyclictest989226-21diskstats08:30:180
97504099412,4cyclictest989226-21diskstats08:30:180
97504099411,37cyclictest1028769-21ptp4l12:20:260
975044994025,9cyclictest0-21swapper/209:25:302
975044994025,9cyclictest0-21swapper/209:25:302
975042994030,6cyclictest1005819-21grep10:05:291
975042994030,6cyclictest0-21swapper/108:10:281
975042994029,7cyclictest0-21swapper/112:10:271
975042994024,8cyclictest0-21swapper/111:35:271
975042994024,8cyclictest0-21swapper/108:30:281
975042994024,8cyclictest0-21swapper/108:30:281
975042994023,9cyclictest0-21swapper/112:05:201
975042994021,13cyclictest231ktimers/107:15:131
975040994035,2cyclictest0-21swapper/011:50:110
975040994029,8cyclictest0-21swapper/009:55:290
975040994028,8cyclictest0-21swapper/011:00:300
975040994028,8cyclictest0-21swapper/011:00:290
97504099402,34cyclictest1012659-21unixbench_multi10:45:280
975044993927,9cyclictest30-21rcuc/211:55:012
975044993926,8cyclictest1018711-21grep11:20:272
97504299394,3cyclictest0-21swapper/112:35:011
975042993925,8cyclictest0-21swapper/109:10:271
975042993923,8cyclictest0-21swapper/112:15:281
975042993918,14cyclictest231ktimers/110:45:111
975042993910,3cyclictest0-21swapper/111:35:021
975042993910,3cyclictest0-21swapper/111:35:021
975040993928,8cyclictest0-21swapper/009:20:270
975040993927,9cyclictest0-21swapper/007:35:280
975040993927,8cyclictest0-21swapper/009:35:010
975040993927,8cyclictest0-21swapper/008:50:200
97504099391,3cyclictest1019029-21df11:25:180
97504099391,33cyclictest0-21swapper/009:10:010
97504099391,2cyclictest0-21swapper/011:00:010
97504499384,3cyclictest0-21swapper/208:55:182
975044993831,4cyclictest167550irq/134-8000000.ethernet-tx212:26:042
975044993831,4cyclictest0-21swapper/211:30:002
975044993829,6cyclictest1025559-21grep12:00:282
975044993827,7cyclictest999834-21unixbench_multi09:30:272
975042993828,5cyclictest0-21swapper/110:40:261
97504299381,9cyclictest0-21swapper/111:45:011
975042993819,12cyclictest231ktimers/110:20:141
975040993834,2cyclictest0-21swapper/009:55:010
975040993834,2cyclictest0-21swapper/009:55:010
97504099382,8cyclictest1022281-21cat11:45:020
97504099381,4cyclictest0-21swapper/007:30:010
97504099381,4cyclictest0-21swapper/007:30:010
97504099381,35cyclictest0-21swapper/010:50:250
97504499378,4cyclictest1026305-21tr12:05:292
975044993728,5cyclictest0-21swapper/210:40:202
975044993728,4cyclictest0-21swapper/212:15:272
975044993727,7cyclictest0-21swapper/207:30:292
975044993725,9cyclictest987360-21latency_hist08:20:012
975044993725,9cyclictest987360-21latency_hist08:20:012
975044993724,8cyclictest0-21swapper/208:30:202
975044993724,8cyclictest0-21swapper/208:30:202
975044993722,11cyclictest0-21swapper/209:55:272
97504299377,3cyclictest0-21swapper/108:50:291
975042993727,5cyclictest0-21swapper/107:20:271
975042993726,7cyclictest0-21swapper/109:30:191
975042993724,6cyclictest1029787-21grep12:25:301
975042993723,7cyclictest0-21swapper/109:00:271
975042993720,11cyclictest231ktimers/109:15:151
975042993718,14cyclictest22-21rcuc/110:40:011
97504299371,31cyclictest0-21swapper/111:45:231
975040993731,4cyclictest20850irq/208-8000000.ethernet10:05:190
975040993730,4cyclictest167350irq/118-8000000.ethernet-tx009:45:160
97504099372,4cyclictest981996-21grep07:45:290
975040993718,13cyclictest1016043-21grep11:05:280
97504099371,3cyclictest1000756-21apt-get09:40:020
97504099371,3cyclictest0-21swapper/008:55:190
97504099371,2cyclictest0-21swapper/007:25:010
975044993629,4cyclictest975034-21cyclictest08:50:272
975044993629,4cyclictest1001650-21grep09:40:292
975044993628,5cyclictest976923-21unixbench_multi07:15:292
975044993625,7cyclictest0-21swapper/210:35:282
975044993624,8cyclictest0-21swapper/207:20:292
975042993622,8cyclictest0-21swapper/108:55:281
97504299361,30cyclictest0-21swapper/111:05:261
975040993630,4cyclictest20850irq/208-8000000.ethernet09:00:210
975040993630,4cyclictest20850irq/208-8000000.ethernet08:45:180
975040993626,5cyclictest0-21swapper/008:40:290
97504099361,3cyclictest0-21swapper/012:05:180
97504099361,33cyclictest0-21swapper/008:25:250
97504099361,33cyclictest0-21swapper/008:20:310
975044993526,5cyclictest0-21swapper/210:30:262
975044993526,5cyclictest0-21swapper/209:50:212
975044993526,5cyclictest0-21swapper/209:50:202
97504499352,5cyclictest1006607-21mailstats10:10:252
975044993522,8cyclictest0-21swapper/209:10:202
97504499351,5cyclictest1017826-21munin-run11:20:002
97504499351,30cyclictest1022500-21df_inode11:45:162
97504299352,6cyclictest22-21rcuc/109:25:021
975042993514,12cyclictest22-21rcuc/108:20:011
975042993514,12cyclictest22-21rcuc/108:20:011
97504299351,2cyclictest0-21swapper/111:05:011
97504299351,2cyclictest0-21swapper/111:05:011
975040993528,4cyclictest20850irq/208-8000000.ethernet11:35:220
975040993527,3cyclictest1011651-21proc_pri10:40:250
975040993526,7cyclictest0-21swapper/011:10:140
97504099352,27cyclictest0-21swapper/012:00:010
975044993424,5cyclictest0-21swapper/208:15:012
975044993418,12cyclictest0-21swapper/208:25:272
97504499341,27cyclictest0-21swapper/207:55:112
975042993424,5cyclictest0-21swapper/112:35:251
975042993424,5cyclictest0-21swapper/110:25:181
975042993418,11cyclictest231ktimers/110:10:091
975042993415,11cyclictest0-21swapper/112:00:191
97504299341,2cyclictest0-21swapper/111:00:011
975040993428,4cyclictest20850irq/208-8000000.ethernet12:35:180
97504099341,4cyclictest0-21swapper/007:40:590
97504099341,30cyclictest1018566-21gzip11:20:250
975044993327,4cyclictest167550irq/134-8000000.ethernet-tx212:20:162
975044993325,5cyclictest0-21swapper/210:30:002
975044993323,5cyclictest311ktimers/208:05:292
975044993323,5cyclictest311ktimers/208:05:292
975044993322,6cyclictest1031415-21grep12:35:272
975044993321,8cyclictest0-21swapper/208:35:262
975042993325,5cyclictest0-21swapper/108:35:251
97504099331,2cyclictest0-21swapper/007:55:010
97504099331,26cyclictest0-21swapper/007:10:010
975044993225,4cyclictest0-21swapper/211:55:272
975044993224,4cyclictest0-21swapper/211:10:162
975044993223,5cyclictest0-21swapper/210:55:212
975044993222,5cyclictest0-21swapper/207:50:002
975044993221,7cyclictest0-21swapper/210:20:282
975044993213,12cyclictest311ktimers/209:20:132
97504299325,14cyclictest981797-21phc2sys07:45:261
975042993224,6cyclictest995060-21/usr/sbin/munin09:05:211
975042993224,5cyclictest0-21swapper/111:10:261
975042993224,4cyclictest0-21swapper/107:10:281
975042993223,5cyclictest0-21swapper/109:45:201
975042993221,8cyclictest0-21swapper/109:40:261
97504299321,5cyclictest0-21swapper/111:55:011
97504299321,4cyclictest0-21swapper/108:25:261
975040993223,6cyclictest0-21swapper/011:30:270
975040993223,6cyclictest0-21swapper/011:30:270
97504099321,4cyclictest0-21swapper/012:15:040
97504099321,4cyclictest0-21swapper/011:50:000
97504099321,29cyclictest0-21swapper/007:30:120
97504099321,25cyclictest984764-21latency_hist08:05:010
97504499312,26cyclictest0-21swapper/211:00:272
97504499312,26cyclictest0-21swapper/211:00:272
975044993120,6cyclictest994746-21grep09:00:272
975042993120,6cyclictest1024645-21grep11:55:271
975040993125,4cyclictest20850irq/208-8000000.ethernet12:00:180
97504099311,2cyclictest0-21swapper/009:15:010
975042993019,7cyclictest0-21swapper/107:40:281
975040993025,4cyclictest0-21swapper/012:30:190
97504099301,4cyclictest0-21swapper/010:30:010
975044992920,7cyclictest997358-21sshd09:16:162
975042992917,9cyclictest0-21swapper/107:35:281
975044992825,2cyclictest0-21swapper/207:35:192
975044992821,5cyclictest311ktimers/211:45:012
975044992817,6cyclictest0-21swapper/207:10:022
97504499272,21cyclictest981204-21grep07:40:282
975044992720,4cyclictest0-21swapper/209:05:262
975044992720,4cyclictest0-21swapper/208:40:282
975044992716,8cyclictest311ktimers/210:05:302
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional