You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 13:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Thu Nov 27, 2025 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2197390997928,36cyclictest0-21swapper/219:55:012
219738499711,23cyclictest21050irq/252-8000000.ethernet19:15:010
2197390996324,33cyclictest2251443-21/usr/sbin/munin00:30:192
2197390996319,19cyclictest2231919-21/usr/sbin/munin22:35:202
219739099622,38cyclictest0-21swapper/219:55:012
2197384996128,25cyclictest0-21swapper/023:15:110
219739099600,26cyclictest0-21swapper/220:20:022
219739099594,18cyclictest2248059-21/usr/sbin/munin00:10:182
219739099589,25cyclictest0-21swapper/222:15:012
219739099585,30cyclictest2219926-21/usr/sbin/munin21:25:172
219738699584,6cyclictest2238461-21kworker/u8:3+events_power_efficient23:35:011
2197390995732,15cyclictest2199694-21apt-get19:20:192
2197390995512,18cyclictest2198290-21munin-node22:30:012
2197390995510,19cyclictest0-21swapper/222:55:022
2197386995543,8cyclictest2223108-21munin-plugin-st21:45:001
2197390995437,11cyclictest0-21swapper/219:15:022
219739099538,13cyclictest2211708-21apt-get20:35:012
219739099538,13cyclictest2211708-21apt-get20:35:012
2197390995232,14cyclictest0-21swapper/200:00:122
2197390995129,12cyclictest0-21swapper/220:50:242
2197390995124,15cyclictest0-21swapper/223:25:142
2197390995123,15cyclictest0-21swapper/219:25:132
2197390995037,7cyclictest2245278-21grep23:50:322
2197390995034,11cyclictest2221608-21apt-get21:35:142
2197390995032,13cyclictest2247221-21apt-get00:05:152
219739099501,36cyclictest0-21swapper/221:50:002
2197390994933,11cyclictest2215621-21apt-get21:00:162
2197390994925,14cyclictest0-21swapper/222:30:152
2197384994930,12cyclictest131ktimers/021:40:120
2197384994922,21cyclictest21050irq/252-8000000.ethernet20:05:240
2197390994824,11cyclictest0-21swapper/219:35:122
2197390994820,15cyclictest0-21swapper/223:15:132
219739099481,24cyclictest0-21swapper/200:25:002
2197390994729,12cyclictest0-21swapper/223:45:122
2197390994727,11cyclictest2225588-21grep21:55:282
2197390994722,14cyclictest0-21swapper/223:00:142
219738699471,23cyclictest0-21swapper/119:15:011
2197384994735,8cyclictest2229008-21munin-plugin-st22:20:000
2197384994734,9cyclictest0-21swapper/021:25:280
2197390994624,11cyclictest0-21swapper/223:30:142
2197390994535,6cyclictest2226393-21grep22:00:302
2197390994529,12cyclictest2236998-21apt-get23:05:142
2197390994528,9cyclictest2212244-21apt-get20:40:112
2197390994526,12cyclictest2218877-21sendmail21:19:592
2197390994526,10cyclictest2233385-21unixbench_singl22:40:272
2197390994525,10cyclictest0-21swapper/220:20:272
2197386994533,7cyclictest0-21swapper/119:55:301
2197386994531,9cyclictest0-21swapper/121:35:181
2197386994531,9cyclictest0-21swapper/119:10:011
2197384994539,3cyclictest12-21ksoftirqd/019:25:100
2197384994536,5cyclictest2221299-21grep21:30:280
219738499452,37cyclictest0-21swapper/000:25:130
2197390994436,4cyclictest2201370-21apt-get19:30:122
2197390994432,9cyclictest2252276-21sshd00:35:082
2197390994432,7cyclictest2251208-21grep00:25:292
2197390994430,5cyclictest2219085-21/usr/sbin/munin21:20:282
2197390994423,11cyclictest0-21swapper/221:50:142
2197390994421,13cyclictest2207925-21grep20:05:292
2197390994419,16cyclictest2229752-21unixbench_multi22:20:272
2197386994431,9cyclictest0-21swapper/121:25:281
2197386994429,9cyclictest0-21swapper/122:55:291
2197384994433,6cyclictest24150irq/422-mmc120:14:590
2197384994432,8cyclictest0-21swapper/021:15:000
2197390994330,9cyclictest2214762-21apt-get20:55:152
2197390994329,8cyclictest0-21swapper/223:35:192
2197390994327,10cyclictest2235063-21grep22:50:302
2197390994325,12cyclictest0-21swapper/223:40:132
2197390994321,18cyclictest0-21swapper/220:15:012
2197390994321,14cyclictest2228843-21/usr/sbin/munin22:15:262
2197386994332,7cyclictest0-21swapper/100:05:281
2197386994316,15cyclictest2215417-21basename21:00:001
2197390994232,5cyclictest0-21swapper/223:55:282
2197390994227,9cyclictest0-21swapper/219:45:112
2197390994224,11cyclictest0-21swapper/223:20:192
2197390994219,17cyclictest2238589-21latency_hist23:15:002
2197386994234,5cyclictest22-21rcuc/121:15:011
2197386994232,6cyclictest2214562-21munin-plugin-st20:55:001
2197386994229,9cyclictest0-21swapper/100:00:291
2197386994225,12cyclictest0-21swapper/123:55:281
2197386994222,12cyclictest0-21swapper/122:10:291
2197386994222,11cyclictest0-21swapper/120:45:281
2197384994230,7cyclictest0-21swapper/000:20:290
2197390994134,3cyclictest2216460-21apt-get21:05:132
2197390994123,12cyclictest2199614-21grep19:20:022
2197390994123,12cyclictest2199614-21grep19:20:022
2197390994114,20cyclictest2197495-21latency_hist19:10:012
2197386994129,6cyclictest0-21swapper/123:10:281
2197386994128,8cyclictest0-21swapper/123:15:201
2197386994127,9cyclictest2241049-21grep23:25:301
2197386994127,8cyclictest0-21swapper/120:20:271
2197386994125,9cyclictest0-21swapper/123:45:281
2197386994124,10cyclictest0-21swapper/119:35:301
2197386994123,10cyclictest0-21swapper/123:50:321
2197384994132,5cyclictest2235041-21grep22:50:290
219738499412,11cyclictest2238647-21latency_hist23:15:020
2197384994120,17cyclictest0-21swapper/021:00:270
219738499411,38cyclictest0-21swapper/019:40:210
2197384994113,26cyclictest2239963-21phc2sys-jitter23:20:250
2197390994034,3cyclictest2226683-21apt-get22:05:152
2197390994031,4cyclictest2220770-21apt-get21:30:142
2197390994029,8cyclictest2233832-21/usr/sbin/munin22:45:232
2197390994026,8cyclictest2223055-21grep21:40:272
2197390994023,12cyclictest0-21swapper/221:10:132
219738499404,21cyclictest15-21rcuc/022:05:000
2197384994033,5cyclictest2217099-21grep21:10:000
2197384994033,4cyclictest2234162-21unixbench_multi22:45:290
2197384994032,5cyclictest2223865-21grep21:45:280
2197384994027,8cyclictest2231542-21grep22:30:320
2197384994023,13cyclictest131ktimers/019:20:130
219738499401,34cyclictest0-21swapper/020:20:140
2197390993926,10cyclictest2203065-21/usr/sbin/munin19:40:102
2197390993923,11cyclictest0-21swapper/200:15:132
219738699398,5cyclictest2205385-21apt-get19:55:011
2197386993932,4cyclictest2233377-21unixbench_singl22:40:261
2197386993928,7cyclictest0-21swapper/121:15:281
2197386993927,8cyclictest0-21swapper/122:35:011
2197386993926,9cyclictest0-21swapper/122:15:271
2197386993926,9cyclictest0-21swapper/121:00:281
2197386993926,8cyclictest0-21swapper/119:20:311
2197386993922,9cyclictest0-21swapper/120:00:301
2197386993922,5cyclictest0-21swapper/119:35:011
2197384993930,7cyclictest0-21swapper/000:35:300
2197384993930,4cyclictest0-21swapper/022:40:000
2197384993929,6cyclictest2227277-21grep22:05:280
2197384993926,9cyclictest0-21swapper/000:15:220
219738499392,2cyclictest0-21swapper/023:40:000
2197384993919,7cyclictest1845229-1kworker/0:2H+mmc_complete19:35:010
219738499391,32cyclictest0-21swapper/000:30:120
2197386993824,9cyclictest0-21swapper/123:00:271
219738699381,30cyclictest231ktimers/122:30:001
2197384993830,5cyclictest21250irq/208-8000000.ethernet21:55:180
2197384993828,7cyclictest2222250-21munin-plugin-st21:40:010
2197384993827,7cyclictest0-21swapper/023:00:280
2197384993825,8cyclictest131ktimers/000:10:140
2197384993823,12cyclictest131ktimers/000:05:120
2197384993814,21cyclictest15-21rcuc/023:40:160
2197390993732,2cyclictest2206537-21apt-get20:00:142
2197390993716,14cyclictest2213084-21apt-get20:45:142
2197386993726,6cyclictest2250332-21grep00:20:281
2197386993725,7cyclictest0-21swapper/121:25:011
2197386993724,8cyclictest0-21swapper/119:45:271
2197386993723,9cyclictest0-21swapper/121:30:251
2197386993718,14cyclictest0-21swapper/100:30:281
219738699371,31cyclictest1668-21snmpd22:35:181
2197384993730,4cyclictest0-21swapper/020:30:130
2197384993730,4cyclictest0-21swapper/020:30:130
2197384993729,5cyclictest21250irq/208-8000000.ethernet23:30:130
2197384993729,5cyclictest0-21swapper/023:10:000
2197384993728,5cyclictest15-21rcuc/019:35:150
219738499372,30cyclictest2215350-21head20:55:270
219738499371,3cyclictest0-21swapper/022:40:180
219738499371,34cyclictest0-21swapper/019:50:210
219738499371,34cyclictest0-21swapper/019:45:180
219738499370,34cyclictest2244297-21/usr/sbin/munin23:45:260
2197386993627,5cyclictest0-21swapper/120:40:121
2197386993626,6cyclictest0-21swapper/121:45:281
2197386993626,5cyclictest0-21swapper/122:45:211
2197386993617,10cyclictest0-21swapper/119:40:281
219738699361,29cyclictest0-21swapper/100:25:121
2197384993630,4cyclictest21250irq/208-8000000.ethernet20:50:170
2197384993630,3cyclictest2246915-21unixbench_multi00:00:290
2197384993628,4cyclictest0-21swapper/023:25:310
2197384993626,6cyclictest15-21rcuc/023:55:240
2197390993527,4cyclictest168450irq/134-8000000.ethernet-tx220:27:202
2197386993525,5cyclictest0-21swapper/123:35:271
2197386993523,7cyclictest0-21swapper/123:05:281
2197386993523,7cyclictest0-21swapper/120:10:291
2197384993531,2cyclictest0-21swapper/022:55:010
2197384993528,4cyclictest21250irq/208-8000000.ethernet22:20:130
2197384993525,5cyclictest0-21swapper/020:20:010
2197384993514,14cyclictest131ktimers/019:15:110
2197384993514,14cyclictest131ktimers/019:15:110
219738499351,31cyclictest2230571-21mailstats22:25:280
219738499351,28cyclictest0-21swapper/022:10:170
219738499351,28cyclictest0-21swapper/020:29:260
2197390993418,10cyclictest2212016-21cron20:40:002
2197390993418,10cyclictest2212016-21cron20:40:002
2197386993427,4cyclictest0-21swapper/121:55:271
2197386993426,5cyclictest0-21swapper/100:10:281
2197386993424,7cyclictest0-21swapper/122:05:291
2197386993422,8cyclictest0-21swapper/100:39:591
2197384993427,4cyclictest20050irq/27-20000000.i2c21:20:000
2197384993423,8cyclictest0-21swapper/020:45:290
2197386993322,8cyclictest0-21swapper/121:10:011
2197386993321,8cyclictest0-21swapper/119:20:001
2197386993321,8cyclictest0-21swapper/119:20:001
219738699331,27cyclictest0-21swapper/122:20:261
219738499334,19cyclictest2197385-21latency_hist19:10:010
2197384993327,4cyclictest0-21swapper/020:35:020
2197384993327,4cyclictest0-21swapper/020:35:020
2197384993326,4cyclictest20050irq/27-20000000.i2c20:00:290
2197384993324,4cyclictest0-21swapper/020:40:230
219738499331,29cyclictest0-21swapper/019:55:310
2197386993223,5cyclictest168350irq/126-8000000.ethernet-tx119:25:241
2197386993222,7cyclictest0-21swapper/122:50:281
2197386993221,7cyclictest0-21swapper/122:00:291
2197384993225,5cyclictest0-21swapper/021:55:000
219738499321,2cyclictest0-21swapper/021:25:000
2197386993120,7cyclictest0-21swapper/120:15:271
2197386993023,5cyclictest2224144-21/usr/sbin/munin21:50:221
2197386993023,4cyclictest168350irq/126-8000000.ethernet-tx120:30:231
2197386993023,4cyclictest168350irq/126-8000000.ethernet-tx120:30:231
2197384993018,6cyclictest0-21swapper/023:55:000
219738699291,2cyclictest0-21swapper/120:30:011
2197386992817,8cyclictest0-21swapper/100:15:301
2197386992817,6cyclictest0-21swapper/123:40:251
219738699281,11cyclictest0-21swapper/120:40:021
219738699281,11cyclictest0-21swapper/120:40:011
2197386992718,4cyclictest0-21swapper/123:20:271
2197386992519,4cyclictest0-21swapper/120:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional