You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-02 - 23:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Sat May 02, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
57937199985,9cyclictest590683-21apt-get08:15:010
579372999688,5cyclictest22-21rcuc/112:35:011
57937199851,2cyclictest0-21swapper/010:30:000
57937199841,2cyclictest0-21swapper/009:05:020
57937199821,75cyclictest628720-21/usr/sbin/munin11:55:220
57937199821,74cyclictest587185-21/usr/sbin/munin07:50:280
57937199793,20cyclictest1660-21snmpd12:20:190
57937199789,36cyclictest614755-21rm10:35:010
57937199789,36cyclictest614755-21rm10:35:010
57937199777,13cyclictest596975-21/usr/sbin/munin08:50:190
57937199741,68cyclictest615214-21phc2sys10:35:250
57937199711,63cyclictest595466-21fschecks_time08:40:200
57937199702,60cyclictest593586-21latency_hist08:30:020
57937199691,2cyclictest616578-21apt-get10:45:130
57937199671,64cyclictest629845-21/usr/sbin/munin12:00:290
57937199671,64cyclictest582464-21fschecks_count07:25:200
57937199671,63cyclictest623530-21grep11:25:190
57937199671,63cyclictest610348-21users10:05:290
57937199671,60cyclictest0-21swapper/009:30:010
57937199671,60cyclictest0-21swapper/009:30:010
579371996627,34cyclictest0-21swapper/011:40:300
57937199661,4cyclictest633607-21df12:25:180
57937199653,4cyclictest0-21swapper/011:35:000
579371996527,35cyclictest585043-21cut07:40:210
57937199652,3cyclictest579594-21df07:10:170
57937199651,62cyclictest0-21swapper/011:45:250
57937199642,4cyclictest622021-21memory11:15:240
57937199641,60cyclictest587624-21tune2fs07:55:190
57937199641,3cyclictest635958-21munin-run12:40:000
57937199632,29cyclictest0-21swapper/010:00:130
57937199631,3cyclictest632148-21meminfo12:15:250
57937199631,3cyclictest632148-21meminfo12:15:240
579375996247,10cyclictest0-21swapper/212:00:002
57937199623,56cyclictest0-21swapper/007:30:280
57937199621,58cyclictest592013-21fschecks_time08:20:210
57937199621,58cyclictest581278-21cron07:17:000
57937199621,4cyclictest608338-21meminfo09:55:240
57937199621,3cyclictest618555-21memory10:55:240
57937199621,3cyclictest604033-21meminfo09:30:250
57937199621,3cyclictest593654-21df08:30:160
57937199621,2cyclictest0-21swapper/011:10:170
579375996112,20cyclictest30-21rcuc/208:30:012
579371996146,11cyclictest167350irq/118-8000000.ethernet-tx011:00:230
57937199612,3cyclictest590207-21grep08:10:210
57937199611,4cyclictest612343-21diskstats10:20:180
57937199611,4cyclictest612343-21diskstats10:20:180
57937599607,19cyclictest32-21ksoftirqd/209:30:022
57937599607,19cyclictest32-21ksoftirqd/209:30:012
579375996043,13cyclictest311ktimers/212:30:122
57937199601,3cyclictest610642-21diskstats10:10:160
57937199601,3cyclictest606673-21ptp4l09:45:270
579375995942,10cyclictest311ktimers/207:50:142
579371995915,5cyclictest0-21swapper/009:50:290
579371995915,5cyclictest0-21swapper/009:50:280
579375995837,16cyclictest30-21rcuc/209:45:012
57937199581,54cyclictest0-21swapper/009:15:270
57937199581,3cyclictest600923-21head09:10:290
57937199581,3cyclictest1660-21snmpd12:08:510
57937199581,23cyclictest616135-21/usr/sbin/munin10:40:250
57937199571,54cyclictest0-21swapper/008:35:240
57937199571,3cyclictest589203-21apt-get08:05:180
57937199571,3cyclictest582129-21users07:20:300
579371995712,40cyclictest131ktimers/010:15:160
57937199571,23cyclictest0-21swapper/008:05:010
57937599565,37cyclictest30-21rcuc/209:15:182
57937199561,50cyclictest1660-21snmpd09:05:300
57937199557,11cyclictest635019-21cron12:35:010
57937199554,12cyclictest605317-21latency_hist09:40:010
579371995518,5cyclictest0-21swapper/011:35:270
579371995518,5cyclictest0-21swapper/011:35:270
579371995515,6cyclictest0-21swapper/010:50:280
579371995421,3cyclictest0-21swapper/008:55:200
57937199535,20cyclictest0-21swapper/009:20:210
57937199522,25cyclictest0-21swapper/007:45:210
57937199521,29cyclictest0-21swapper/011:06:120
57937199511,45cyclictest0-21swapper/007:10:010
57937199511,45cyclictest0-21swapper/007:10:010
579375995043,2cyclictest0-21swapper/211:05:002
579375995040,7cyclictest30-21rcuc/210:05:012
57937199501,26cyclictest631281-21kernelversion12:10:230
57937599492,24cyclictest30-21rcuc/211:25:022
57937199491,46cyclictest0-21swapper/011:20:260
57937599489,11cyclictest14-21rcu_preempt12:25:002
579375994828,15cyclictest30-21rcuc/210:45:012
57937199481,28cyclictest0-21swapper/009:41:240
579372994734,6cyclictest621422-21grep11:10:271
57937199471,28cyclictest0-21swapper/007:37:150
57937199471,27cyclictest0-21swapper/011:50:210
579375994629,12cyclictest311ktimers/209:20:142
579375994626,12cyclictest311ktimers/207:25:122
579371994622,4cyclictest20850irq/208-8000000.ethernet08:45:140
579371994622,4cyclictest20850irq/208-8000000.ethernet08:45:140
57937599455,26cyclictest618895-21apt-get11:00:012
579372994537,5cyclictest593310-21munin-plugin-st08:30:001
579372994534,6cyclictest0-21swapper/111:15:161
579372994529,9cyclictest0-21swapper/108:50:291
57937599445,12cyclictest30-21rcuc/210:00:022
579375994437,4cyclictest14-21rcu_preempt10:35:292
579375994435,6cyclictest588061-21grep07:55:292
579375994429,10cyclictest0-21swapper/209:00:292
579375994427,12cyclictest311ktimers/208:05:142
579372994431,9cyclictest591618-21sendmail08:20:011
57937299441,34cyclictest635891-21unixbench_singl12:35:291
579372994329,10cyclictest0-21swapper/112:00:291
579372994326,11cyclictest0-21swapper/107:15:271
579375994232,5cyclictest586312-21unixbench_singl07:45:282
579375994231,6cyclictest0-21swapper/212:10:292
579375994228,9cyclictest0-21swapper/212:00:302
579372994235,4cyclictest608667-21cron10:00:001
57937599418,12cyclictest584895-21/usr/sbin/munin07:40:192
579375994128,7cyclictest0-21swapper/209:05:292
579375994124,11cyclictest311ktimers/210:50:122
579372994132,5cyclictest0-21swapper/111:40:291
579372994129,7cyclictest630711-21grep12:05:281
579372994123,14cyclictest231ktimers/107:45:111
57937299411,33cyclictest0-21swapper/108:35:281
579375994030,5cyclictest0-21swapper/208:50:172
579375994028,8cyclictest0-21swapper/207:35:292
579375994024,11cyclictest311ktimers/208:00:132
579375994024,10cyclictest0-21swapper/212:15:252
579375994024,10cyclictest0-21swapper/212:15:252
579372994029,6cyclictest588040-21grep07:55:281
579372994025,9cyclictest0-21swapper/112:30:001
579375993930,5cyclictest0-21swapper/210:25:292
579375993929,5cyclictest0-21swapper/211:35:282
579375993929,5cyclictest0-21swapper/211:35:282
579375993928,6cyclictest0-21swapper/210:10:272
579375993924,10cyclictest0-21swapper/208:15:012
579375993921,11cyclictest311ktimers/209:35:122
579372993926,8cyclictest0-21swapper/107:10:281
579372993920,10cyclictest0-21swapper/111:05:201
57937599385,24cyclictest32-21ksoftirqd/212:10:022
579375993830,4cyclictest0-21swapper/207:10:302
579375993827,6cyclictest0-21swapper/209:45:282
579375993826,9cyclictest0-21swapper/210:20:202
579375993826,9cyclictest0-21swapper/210:20:202
579375993826,4cyclictest0-21swapper/209:55:012
579375993826,4cyclictest0-21swapper/209:55:012
579372993828,4cyclictest0-21swapper/112:15:291
579372993828,4cyclictest0-21swapper/112:15:291
579372993827,7cyclictest0-21swapper/111:55:271
579372993822,10cyclictest0-21swapper/107:35:001
57937299381,2cyclictest0-21swapper/109:45:011
57937599379,20cyclictest30-21rcuc/207:20:192
579375993724,6cyclictest0-21swapper/207:30:292
579375993715,5cyclictest611191-21kworker/u8:2-ext4-rsv-conversion10:45:022
579372993728,5cyclictest0-21swapper/109:05:291
579372993727,6cyclictest584615-21grep07:35:291
579372993726,8cyclictest0-21swapper/108:40:281
579372993726,6cyclictest0-21swapper/109:30:331
579372993723,9cyclictest0-21swapper/110:35:191
579375993626,6cyclictest610293-21grep10:05:282
57937599362,28cyclictest832-21systemd-network11:28:242
579375993622,7cyclictest30-21rcuc/211:15:132
579372993629,4cyclictest167450irq/126-8000000.ethernet-tx110:45:301
579372993628,5cyclictest0-21swapper/108:05:321
579372993626,4cyclictest0-21swapper/112:20:251
579375993521,9cyclictest311ktimers/210:15:142
579375993521,10cyclictest311ktimers/211:30:132
579372993528,3cyclictest594177-21unixbench_singl08:30:281
579372993525,7cyclictest618840-21grep10:55:271
57937299352,30cyclictest611409-21/usr/sbin/munin10:15:171
579372993519,10cyclictest0-21swapper/111:50:281
579375993426,5cyclictest14-21rcu_preempt11:05:292
579375993424,5cyclictest0-21swapper/211:45:272
579375993423,6cyclictest0-21swapper/207:20:012
57937599341,4cyclictest0-21swapper/208:25:012
579372993425,5cyclictest0-21swapper/110:40:281
579372993422,7cyclictest0-21swapper/109:45:191
579372993421,9cyclictest0-21swapper/108:15:021
579372993420,7cyclictest0-21swapper/108:45:281
579372993420,7cyclictest0-21swapper/108:45:281
57937299341,2cyclictest0-21swapper/111:30:011
579375993327,4cyclictest14-21rcu_preempt11:10:262
579375993325,5cyclictest594439-21/usr/sbin/munin08:35:192
579375993324,5cyclictest14-21rcu_preempt10:30:302
579375993324,5cyclictest14-21rcu_preempt10:30:302
57937599332,29cyclictest14-21rcu_preempt08:45:172
57937599332,29cyclictest14-21rcu_preempt08:45:162
57937599331,2cyclictest0-21swapper/207:10:012
57937599331,2cyclictest0-21swapper/207:10:012
579372993323,5cyclictest0-21swapper/110:20:201
579372993323,5cyclictest0-21swapper/110:20:201
579372993321,8cyclictest0-21swapper/109:10:291
579372993321,7cyclictest0-21swapper/110:30:271
579372993321,7cyclictest0-21swapper/110:30:271
579372993320,8cyclictest0-21swapper/107:25:291
579375993224,6cyclictest0-21swapper/211:54:242
579375993223,6cyclictest311ktimers/208:55:272
579375993222,7cyclictest0-21swapper/208:15:282
579375993219,9cyclictest0-21swapper/212:40:012
579372993228,2cyclictest0-21swapper/111:00:271
579372993226,4cyclictest167450irq/126-8000000.ethernet-tx110:00:211
579372993225,3cyclictest631715-21date12:15:011
579372993224,5cyclictest0-21swapper/110:15:011
579372993221,7cyclictest0-21swapper/108:55:291
579372993221,6cyclictest0-21swapper/107:50:051
57937299321,2cyclictest0-21swapper/109:30:011
57937299321,2cyclictest0-21swapper/109:30:011
57937299321,2cyclictest0-21swapper/109:05:011
579375993122,4cyclictest14-21rcu_preempt08:40:292
579375993117,8cyclictest593572-21date08:30:012
579372993125,3cyclictest627324-21unixbench_multi11:45:281
579372993123,5cyclictest625646-21grep11:35:281
579372993123,5cyclictest625646-21grep11:35:271
579372993121,5cyclictest0-21swapper/107:25:021
579372993120,7cyclictest0-21swapper/111:30:281
57937299311,28cyclictest0-21swapper/111:20:191
57937299311,26cyclictest592363-21unixbench_multi08:20:281
579375993022,6cyclictest311ktimers/209:30:122
579372993021,5cyclictest0-21swapper/109:50:281
579372993021,5cyclictest0-21swapper/109:50:281
579372993020,7cyclictest0-21swapper/108:00:261
579372993019,7cyclictest0-21swapper/107:40:211
579375992921,6cyclictest633825-21sed12:25:242
579375992921,6cyclictest311ktimers/211:40:162
579375992919,7cyclictest600516-21cut09:10:212
579372992917,8cyclictest0-21swapper/109:35:231
579372992818,5cyclictest0-21swapper/110:25:011
579372992720,5cyclictest0-21swapper/109:15:161
579372992719,6cyclictest0-21swapper/109:20:291
579372992714,8cyclictest0-21swapper/107:10:011
579372992714,8cyclictest0-21swapper/107:10:011
579372992618,5cyclictest0-21swapper/110:50:291
579372992517,6cyclictest0-21swapper/110:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional