You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-10 - 06:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Thu Jul 10, 2025 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
52036699701,38cyclictest0-21swapper/000:40:010
52036699681,48cyclictest0-21swapper/021:40:010
52037099647,20cyclictest30-21rcuc/219:40:012
520366996222,17cyclictest0-21swapper/000:25:020
520366996125,22cyclictest15-21rcuc/020:10:010
52036699588,17cyclictest12-21ksoftirqd/021:10:010
520366995852,4cyclictest0-21swapper/023:30:110
52036699571,27cyclictest0-21swapper/020:25:010
520367995543,7cyclictest529148-21sendmail19:59:591
520366995345,4cyclictest0-21swapper/022:45:300
52036699526,19cyclictest0-21swapper/022:00:010
52036699526,19cyclictest0-21swapper/022:00:010
52036699526,16cyclictest12-21ksoftirqd/022:55:010
520366995234,12cyclictest548791-21unixbench_singl21:50:290
520366995210,12cyclictest15-21rcuc/021:50:010
520366995123,4cyclictest0-21swapper/023:00:020
520370995040,5cyclictest561613-21munin-plugin-st23:10:012
520370995039,6cyclictest14-21rcu_preempt20:50:182
520366995036,8cyclictest566640-21grep23:35:290
520366995015,27cyclictest534575-21dropbear20:30:180
520370994936,7cyclictest532530-21grep20:15:312
52036699493,40cyclictest523996-21munin-run19:29:590
52036699492,40cyclictest0-21swapper/000:00:260
520367994838,7cyclictest556542-21run-parts22:40:001
520366994814,7cyclictest12-21ksoftirqd/021:15:000
520370994737,5cyclictest560671-21grep23:00:282
520370994736,7cyclictest533464-21cron20:24:592
520366994730,12cyclictest0-21swapper/019:10:220
520366994711,14cyclictest12-21ksoftirqd/000:35:020
520370994626,13cyclictest0-21swapper/222:05:002
520366994634,8cyclictest555626-21grep22:30:330
52036699461,22cyclictest0-21swapper/021:20:020
520370994532,9cyclictest559918-21sendmail23:00:002
520370994530,10cyclictest1263-21cron21:55:002
520370994530,10cyclictest0-21swapper/200:25:222
520367994527,12cyclictest0-21swapper/122:10:271
520367994527,12cyclictest0-21swapper/122:10:271
520366994528,12cyclictest0-21swapper/019:20:010
520370994435,5cyclictest535997-21munin-plugin-st20:40:002
520370994430,10cyclictest551387-21munin-plugin-st22:09:592
52036699444,7cyclictest526562-21grep19:40:250
520366994436,5cyclictest524930-21munin-plugin-st19:35:000
520370994333,6cyclictest0-21swapper/219:25:232
520370994330,8cyclictest0-21swapper/221:45:022
520370994329,9cyclictest0-21swapper/223:20:292
520370994329,11cyclictest529144-21sendmail19:59:592
520370994327,10cyclictest0-21swapper/223:10:252
520370994326,12cyclictest311ktimers/200:35:162
52037099431,9cyclictest0-21swapper/200:05:022
520366994333,5cyclictest19950irq/27-20000000.i2c19:55:020
520366994328,11cyclictest0-21swapper/022:05:300
52036699431,9cyclictest0-21swapper/000:20:020
52036699431,4cyclictest0-21swapper/020:05:010
520370994234,5cyclictest566686-21sendmail23:40:002
520370994233,5cyclictest0-21swapper/221:20:282
520370994230,8cyclictest522312-21sendmail19:20:002
520370994227,10cyclictest0-21swapper/219:45:302
520370994223,15cyclictest311ktimers/220:55:132
52036799427,12cyclictest22-21rcuc/123:30:021
520367994233,5cyclictest0-21swapper/121:10:201
520367994232,6cyclictest0-21swapper/120:40:281
520367994228,9cyclictest0-21swapper/122:40:301
520367994228,9cyclictest0-21swapper/122:40:301
520367994219,16cyclictest231ktimers/123:55:111
520366994234,4cyclictest20750irq/251-8000000.ethernet22:40:160
520366994234,4cyclictest20750irq/251-8000000.ethernet22:40:160
520370994132,6cyclictest0-21swapper/200:20:002
520370994131,6cyclictest537691-21grep20:50:002
520370994121,14cyclictest0-21swapper/219:35:012
520370994113,5cyclictest865-21systemd-network21:00:062
52036799417,5cyclictest27250irq/343-wl18xx19:45:241
52036699413,35cyclictest0-21swapper/021:25:210
52036699413,25cyclictest131ktimers/000:15:000
520366994123,13cyclictest0-21swapper/023:05:220
520366994111,12cyclictest12-21ksoftirqd/022:40:010
52037099409,19cyclictest30-21rcuc/223:30:192
520370994025,9cyclictest0-21swapper/220:30:262
520370994023,13cyclictest311ktimers/222:50:152
520370994022,12cyclictest311ktimers/220:25:132
520370994022,12cyclictest311ktimers/220:25:132
520370994021,11cyclictest0-21swapper/220:05:002
520370994019,15cyclictest311ktimers/223:40:132
52036799401,3cyclictest551324-21unixbench_singl22:05:301
52036799401,3cyclictest0-21swapper/121:00:011
52036799401,2cyclictest0-21swapper/121:40:011
52036699404,5cyclictest12-21ksoftirqd/019:35:290
52036699404,5cyclictest12-21ksoftirqd/019:35:290
520366994030,5cyclictest527364-21grep19:45:310
52036699401,4cyclictest532567-21unixbench_singl20:15:310
520370993927,7cyclictest0-21swapper/222:15:292
520370993925,10cyclictest0-21swapper/219:50:282
520367993931,4cyclictest0-21swapper/121:50:171
520367993930,4cyclictest0-21swapper/121:00:201
520367993929,6cyclictest0-21swapper/120:50:291
520367993926,9cyclictest0-21swapper/121:15:211
520367993926,8cyclictest0-21swapper/119:25:221
520367993925,8cyclictest0-21swapper/123:45:251
520367993925,8cyclictest0-21swapper/123:45:251
52036799391,5cyclictest0-21swapper/119:35:011
520366993930,5cyclictest20950irq/209-8000000.ethernet20:35:290
520366993924,10cyclictest0-21swapper/023:20:280
520366993921,13cyclictest131ktimers/022:00:160
520370993824,8cyclictest0-21swapper/200:30:292
52036799381,2cyclictest0-21swapper/123:05:001
52036699389,4cyclictest0-21swapper/020:45:020
520366993831,4cyclictest0-21swapper/021:35:210
520366993830,5cyclictest0-21swapper/023:50:010
520366993830,5cyclictest0-21swapper/023:50:010
520366993829,5cyclictest0-21swapper/023:40:220
520366993828,7cyclictest0-21swapper/019:20:290
52036699382,7cyclictest544895-21fschecks_time21:30:250
520366993824,9cyclictest0-21swapper/000:05:200
520366993820,2cyclictest0-21swapper/022:25:250
52036699381,6cyclictest15-21rcuc/020:55:220
52037099374,17cyclictest541355-21/usr/sbin/munin21:10:222
520370993724,9cyclictest0-21swapper/221:45:222
520370993718,13cyclictest311ktimers/223:45:162
520370993718,13cyclictest311ktimers/223:45:162
520367993731,4cyclictest168350irq/127-8000000.ethernet-tx119:50:281
520367993729,5cyclictest532610-21sh20:20:011
520367993728,6cyclictest554698-21grep22:25:271
520367993727,7cyclictest0-21swapper/123:50:261
520367993725,7cyclictest570904-21tail00:00:281
520367993724,7cyclictest0-21swapper/123:20:291
520367993715,6cyclictest27350irq/343-s-wl18xx00:25:261
52036799371,4cyclictest0-21swapper/123:40:011
52036799371,2cyclictest0-21swapper/100:35:011
52036699373,31cyclictest0-21swapper/023:15:000
520366993727,6cyclictest569234-21head23:50:270
52036699372,31cyclictest537645-21unixbench_singl20:45:300
52036699371,6cyclictest0-21swapper/020:15:010
52036699371,31cyclictest552304-21latency_hist22:15:020
52036699371,31cyclictest552304-21latency_hist22:15:020
52037099363,30cyclictest0-21swapper/219:35:242
52037099363,30cyclictest0-21swapper/219:35:232
52037099363,17cyclictest30-21rcuc/219:10:012
520370993622,10cyclictest0-21swapper/220:05:292
520370993620,11cyclictest311ktimers/222:35:162
520367993626,6cyclictest0-21swapper/119:40:151
520367993623,8cyclictest0-21swapper/100:15:301
520366993631,3cyclictest12-21ksoftirqd/020:50:220
52036699362,32cyclictest0-21swapper/021:20:200
52036699361,4cyclictest0-21swapper/020:30:020
52036699361,4cyclictest0-21swapper/020:30:010
520370993528,4cyclictest168450irq/135-8000000.ethernet-tx220:10:182
520370993525,7cyclictest0-21swapper/223:15:332
520370993521,8cyclictest541289-21cat21:10:022
52036799353,3cyclictest553573-21kernelversion22:20:251
520367993530,3cyclictest0-21swapper/123:30:291
520367993527,4cyclictest168350irq/127-8000000.ethernet-tx123:15:261
520367993526,6cyclictest567521-21grep23:40:301
520367993526,6cyclictest535943-21unixbench_singl20:35:291
52036799351,3cyclictest0-21swapper/120:25:011
520366993529,4cyclictest20950irq/209-8000000.ethernet19:55:190
520366993528,4cyclictest20950irq/209-8000000.ethernet23:55:180
520366993522,9cyclictest553843-21grep22:20:290
52036699351,22cyclictest535653-1kworker/0:2H+kblockd23:20:000
520366993511,5cyclictest131ktimers/000:20:120
520370993424,5cyclictest0-21swapper/221:30:232
520370993423,6cyclictest0-21swapper/222:40:222
520370993423,6cyclictest0-21swapper/222:40:212
520370993417,14cyclictest311ktimers/222:10:132
520370993417,14cyclictest311ktimers/222:10:132
520367993427,4cyclictest558722-21kernelversion22:50:261
520367993424,6cyclictest549581-21unixbench_multi21:55:321
520367993424,6cyclictest549581-21unixbench_multi21:55:321
520367993420,11cyclictest574341-21grep00:20:301
52036799341,31cyclictest0-21swapper/120:30:231
520366993428,4cyclictest20950irq/209-8000000.ethernet23:00:260
520366993427,5cyclictest0-21swapper/023:25:130
520366993419,6cyclictest0-21swapper/022:15:140
520366993410,22cyclictest0-21swapper/021:00:280
520370993328,3cyclictest0-21swapper/222:30:012
520370993324,5cyclictest0-21swapper/220:40:282
520370993320,10cyclictest0-21swapper/221:35:312
520370993318,10cyclictest311ktimers/219:10:142
520367993326,4cyclictest0-21swapper/121:35:001
520367993324,5cyclictest0-21swapper/121:05:181
520367993324,5cyclictest0-21swapper/100:10:231
520367993322,7cyclictest0-21swapper/122:00:341
520367993321,8cyclictest0-21swapper/121:40:271
520367993321,7cyclictest0-21swapper/120:45:301
520367993317,11cyclictest51-21kcompactd020:05:121
52036799331,6cyclictest561135-21cut23:05:221
52036799331,6cyclictest0-21swapper/119:10:001
52036799331,4cyclictest0-21swapper/119:15:011
520370993224,5cyclictest168450irq/135-8000000.ethernet-tx221:15:302
520370993220,7cyclictest0-21swapper/221:55:202
520370993220,7cyclictest0-21swapper/221:55:192
52037099321,26cyclictest0-21swapper/222:20:182
520367993223,5cyclictest0-21swapper/122:45:271
52036799322,27cyclictest547898-21grep21:45:291
52036799321,6cyclictest0-21swapper/122:20:001
520367993211,10cyclictest521653-21/usr/sbin/munin19:15:201
52036699322,4cyclictest15-21rcuc/019:10:020
52037099313,26cyclictest14-21rcu_preempt00:20:182
520370993123,6cyclictest543897-21/usr/sbin/munin21:25:222
520367993123,4cyclictest0-21swapper/122:55:321
520367993122,4cyclictest0-21swapper/100:35:291
520367993119,8cyclictest0-21swapper/123:10:231
52036799311,2cyclictest0-21swapper/100:10:011
520370993023,4cyclictest168450irq/135-8000000.ethernet-tx200:00:002
520370993019,8cyclictest522514-21/usr/sbin/munin19:20:262
52037099301,24cyclictest0-21swapper/223:50:102
520367993021,7cyclictest1666-21snmpd20:26:031
520367993021,7cyclictest1666-21snmpd20:26:031
520367993016,11cyclictest0-21swapper/121:25:221
520370992919,5cyclictest0-21swapper/223:25:282
520367992916,9cyclictest0-21swapper/121:20:261
520367992916,8cyclictest530834-21cron20:10:021
52036799291,26cyclictest529604-21if_eth120:00:231
52036799291,16cyclictest0-21swapper/119:22:011
520370992810,7cyclictest571205-21/usr/sbin/munin00:05:202
520370992722,2cyclictest0-21swapper/222:45:292
52037099271,14cyclictest0-21swapper/200:14:382
520367992719,4cyclictest0-21swapper/122:30:321
52036799271,13cyclictest0-21swapper/119:37:261
52036799271,13cyclictest0-21swapper/119:37:251
52037099261,4cyclictest554993-21apt-config22:30:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional