You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-17 - 20:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Thu Jul 17, 2025 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293503299811,74cyclictest0-21swapper/010:40:170
2935034997817,15cyclictest2943259-21/usr/sbin/munin07:55:231
293503299631,4cyclictest0-21swapper/009:40:170
293503299591,48cyclictest2991003-21cut12:35:240
293503299591,47cyclictest0-21swapper/009:38:290
2935036995446,4cyclictest2979597-21unixbench_singl11:25:322
293503299542,44cyclictest2983774-21grep11:50:250
2935036995335,11cyclictest0-21swapper/209:30:192
293503299533,13cyclictest2977865-21apt-get11:20:010
293503299531,4cyclictest2958180-21grep09:20:290
2935034995239,9cyclictest0-21swapper/111:39:591
2935036995044,3cyclictest311ktimers/210:35:202
2935036995040,6cyclictest2938665-21grep07:30:002
2935034995036,8cyclictest0-21swapper/109:10:301
293503299503,5cyclictest2946168-21ps08:10:280
293503299502,41cyclictest2946797-21cut08:15:240
2935036994831,10cyclictest0-21swapper/209:25:342
293503299487,24cyclictest15-21rcuc/007:35:010
2935036994737,7cyclictest311ktimers/211:55:162
293503299472,6cyclictest2954801-21grep09:00:280
2935036994636,4cyclictest0-21swapper/207:45:292
2935036994628,8cyclictest0-21swapper/212:15:272
293503499466,19cyclictest22-21rcuc/111:15:001
2935032994639,5cyclictest2940442-21sendmail07:39:590
2935036994530,8cyclictest2972691-21grep10:45:292
2935034994524,14cyclictest0-21swapper/109:05:311
2935032994510,3cyclictest0-21swapper/008:40:000
2935036994432,7cyclictest0-21swapper/212:05:342
2935036994425,11cyclictest0-21swapper/210:25:232
2935036994425,11cyclictest0-21swapper/210:25:222
2935036994422,13cyclictest32-21ksoftirqd/207:20:002
2935036994412,15cyclictest2956771-21/usr/sbin/munin09:15:202
2935034994436,4cyclictest0-21swapper/110:45:011
2935034994430,9cyclictest0-21swapper/107:10:311
293503299444,34cyclictest0-21swapper/010:20:010
2935032994436,5cyclictest2938665-21munin-plugin-st07:30:000
293503299442,5cyclictest2980849-21fschecks_time11:35:220
293503299441,40cyclictest2952709-21grep08:50:230
293503299441,40cyclictest0-21swapper/008:20:180
2935036994334,5cyclictest168450irq/135-8000000.ethernet-tx212:30:322
2935036994330,8cyclictest2965135-21grep10:00:312
2935036994328,8cyclictest0-21swapper/211:10:022
2935036994328,7cyclictest2945602-21munin-plugin-st08:09:592
2935036994325,9cyclictest0-21swapper/207:55:142
2935036994324,11cyclictest0-21swapper/208:30:282
293503699432,19cyclictest32-21ksoftirqd/211:55:012
2935032994330,8cyclictest0-21swapper/011:05:180
293503299432,4cyclictest2955461-21ps09:05:290
293503299432,38cyclictest0-21swapper/012:20:260
293503299431,5cyclictest2949604-21tail08:30:270
2935036994232,5cyclictest0-21swapper/210:30:312
2935036994231,7cyclictest311ktimers/207:50:272
2935036994230,8cyclictest0-21swapper/207:10:302
2935036994230,4cyclictest2974403-21grep10:55:292
2935036994227,7cyclictest0-21swapper/210:10:202
2935036994224,8cyclictest0-21swapper/211:40:202
2935036994222,11cyclictest0-21swapper/209:55:302
2935036994221,12cyclictest311ktimers/208:10:162
2935036994220,12cyclictest0-21swapper/209:10:232
2935034994229,8cyclictest0-21swapper/107:40:301
2935034994225,11cyclictest0-21swapper/107:35:281
2935032994235,5cyclictest2986413-21grep12:09:590
2935032994235,4cyclictest20750irq/251-8000000.ethernet10:05:150
293503299422,5cyclictest2953466-21diskstats08:55:200
293503299422,4cyclictest0-21swapper/007:55:220
293503299421,6cyclictest2970376-21latency_hist10:35:000
293503299421,5cyclictest2979919-21df_inode11:30:200
293503299421,5cyclictest2979919-21df_inode11:30:200
293503299421,5cyclictest2968624-21latency_hist10:25:010
293503299421,4cyclictest2984333-21irqstats11:55:220
2935036994127,8cyclictest0-21swapper/208:35:262
2935036994127,10cyclictest0-21swapper/212:20:212
2935036994127,10cyclictest0-21swapper/209:40:292
2935036994113,18cyclictest2980693-21/usr/sbin/munin11:35:202
2935034994130,7cyclictest0-21swapper/111:00:291
2935034994126,10cyclictest0-21swapper/111:55:291
293503299419,29cyclictest0-21swapper/009:55:230
2935032994133,4cyclictest0-21swapper/009:55:000
293503299412,5cyclictest2944631-21/usr/sbin/munin08:00:310
293503299412,4cyclictest2989448-21meminfo12:25:260
2935032994118,21cyclictest0-21swapper/009:10:200
293503299411,6cyclictest2985029-21tune2fs12:00:180
293503299411,5cyclictest2986977-21ps12:10:280
293503299411,4cyclictest2979313-21meminfo11:25:290
293503299411,4cyclictest2962139-21fw_packets09:45:220
293503299411,4cyclictest2948413-21diskstats08:25:180
293503299411,4cyclictest2945263-21meminfo08:05:280
293503299411,3cyclictest0-21swapper/010:35:270
2935036994032,5cyclictest311ktimers/208:50:302
2935036994029,6cyclictest0-21swapper/210:05:312
2935036994027,7cyclictest311ktimers/209:35:232
2935036994026,9cyclictest0-21swapper/210:20:282
2935036994026,6cyclictest2978769-21grep11:20:302
2935036994021,11cyclictest0-21swapper/210:50:252
2935036994021,11cyclictest0-21swapper/210:50:252
2935034994029,6cyclictest0-21swapper/112:10:311
2935034994026,9cyclictest0-21swapper/109:25:361
2935034994026,8cyclictest0-21swapper/110:50:291
2935034994026,8cyclictest0-21swapper/110:50:291
2935034994026,7cyclictest0-21swapper/110:35:291
2935034994025,10cyclictest0-21swapper/108:50:301
2935032994031,5cyclictest20950irq/209-8000000.ethernet09:15:230
2935032994018,20cyclictest0-21swapper/011:00:160
293503299401,5cyclictest2958666-21dropbear09:25:290
293503299401,4cyclictest2976449-21df_inode11:10:170
293503299401,4cyclictest2959612-21meminfo09:30:250
293503299401,4cyclictest0-21swapper/007:45:280
293503299401,37cyclictest0-21swapper/010:45:250
293503699395,28cyclictest311ktimers/207:30:202
2935036993928,7cyclictest2989743-21grep12:25:302
2935036993923,9cyclictest0-21swapper/211:15:232
2935036993923,9cyclictest0-21swapper/210:45:022
2935034993929,5cyclictest0-21swapper/107:15:291
2935034993927,7cyclictest0-21swapper/107:25:271
2935034993925,10cyclictest0-21swapper/109:35:291
2935034993923,10cyclictest0-21swapper/109:45:291
2935034993922,9cyclictest0-21swapper/109:15:201
2935032993932,4cyclictest20950irq/209-8000000.ethernet08:40:160
2935032993926,10cyclictest2936901-21grep07:15:300
293503299391,4cyclictest0-21swapper/008:45:230
293503299391,3cyclictest2978483-21open_files11:20:260
293503299391,3cyclictest2969088-21meminfo10:25:280
293503299391,3cyclictest2969088-21meminfo10:25:270
2935036993828,6cyclictest311ktimers/208:20:272
2935034993826,9cyclictest0-21swapper/108:25:281
2935034993826,7cyclictest0-21swapper/109:00:161
2935034993825,7cyclictest0-21swapper/107:45:301
2935034993825,7cyclictest0-21swapper/107:30:291
2935034993824,10cyclictest0-21swapper/111:15:311
2935032993829,6cyclictest2974369-21grep10:55:300
2935032993828,7cyclictest0-21swapper/010:10:310
293503299381,4cyclictest2981607-21df11:40:170
293503299381,4cyclictest0-21swapper/007:20:260
293503299381,3cyclictest2940947-21load07:40:250
293503299381,3cyclictest0-21swapper/007:10:260
293503699374,24cyclictest2948922-21head08:25:292
2935036993727,6cyclictest0-21swapper/209:00:292
2935036993726,7cyclictest311ktimers/209:05:192
2935036993725,5cyclictest311ktimers/210:15:192
2935036993722,8cyclictest0-21swapper/207:35:212
2935036993721,9cyclictest2991404-21grep12:35:322
2935034993729,5cyclictest2991473-21sendmail12:40:001
2935034993727,7cyclictest0-21swapper/111:50:261
2935034993727,5cyclictest0-21swapper/109:40:301
2935034993724,7cyclictest0-21swapper/111:20:301
293503299371,3cyclictest2942457-21lsblk07:50:230
293503699368,18cyclictest2937745-21sed07:20:292
2935036993627,5cyclictest311ktimers/211:10:292
2935036993624,8cyclictest0-21swapper/212:00:292
293503499365,5cyclictest0-21swapper/111:30:011
2935034993626,7cyclictest0-21swapper/110:30:301
2935034993625,8cyclictest0-21swapper/108:15:321
2935034993625,7cyclictest0-21swapper/110:05:321
2935034993625,7cyclictest0-21swapper/109:00:001
2935034993625,7cyclictest0-21swapper/108:30:291
2935034993625,7cyclictest0-21swapper/108:10:301
2935034993625,5cyclictest0-21swapper/108:25:001
2935034993623,9cyclictest0-21swapper/109:50:261
2935034993622,8cyclictest0-21swapper/112:30:321
293503299361,4cyclictest0-21swapper/011:45:280
293503299361,4cyclictest0-21swapper/010:00:140
2935032993614,20cyclictest15-21rcuc/012:30:310
2935036993526,6cyclictest311ktimers/211:30:172
2935036993526,6cyclictest311ktimers/211:30:172
2935034993527,5cyclictest0-21swapper/108:05:311
2935034993526,5cyclictest0-21swapper/109:55:301
2935034993523,8cyclictest0-21swapper/110:20:281
2935034993522,9cyclictest0-21swapper/112:05:311
2935034993522,9cyclictest0-21swapper/112:00:291
2935034993522,8cyclictest0-21swapper/111:45:311
2935034993522,8cyclictest0-21swapper/109:30:281
2935032993525,7cyclictest0-21swapper/012:15:200
293503699347,17cyclictest2947169-21sed08:15:332
2935036993424,6cyclictest311ktimers/209:45:472
293503699341,27cyclictest0-21swapper/208:00:182
293503699341,26cyclictest0-21swapper/209:20:142
2935034993426,4cyclictest0-21swapper/107:50:301
2935034993425,6cyclictest0-21swapper/111:40:281
2935034993422,8cyclictest0-21swapper/112:25:301
2935034993420,8cyclictest0-21swapper/110:55:291
2935036993325,5cyclictest311ktimers/212:10:242
2935036993324,6cyclictest311ktimers/208:55:122
2935036993324,6cyclictest311ktimers/208:45:222
2935036993323,7cyclictest311ktimers/211:45:162
2935036993323,6cyclictest0-21swapper/208:40:302
2935034993324,5cyclictest2944703-21unixbench_singl08:00:301
2935034993322,8cyclictest2967739-21sendmail10:20:001
2935032993329,3cyclictest14-21rcu_preempt07:10:000
293503699327,15cyclictest2941204-21tail07:40:302
2935036993221,5cyclictest311ktimers/209:55:022
2935034993212,16cyclictest231ktimers/111:05:121
2935036993124,4cyclictest168450irq/135-8000000.ethernet-tx211:00:152
2935034993124,4cyclictest0-21swapper/108:40:311
2935034993122,4cyclictest0-21swapper/109:20:301
293503299311,25cyclictest0-21swapper/010:50:020
293503299311,25cyclictest0-21swapper/010:50:020
2935034993021,7cyclictest0-21swapper/110:10:221
2935034993021,6cyclictest0-21swapper/107:20:291
2935034993020,7cyclictest0-21swapper/112:20:311
2935034993020,7cyclictest0-21swapper/112:15:291
2935034993020,6cyclictest0-21swapper/108:35:281
2935034993019,6cyclictest0-21swapper/110:00:311
2935034992915,8cyclictest2968787-21/usr/sbin/munin10:25:141
2935034992915,8cyclictest2968787-21/usr/sbin/munin10:25:141
293503499291,26cyclictest2972167-21/usr/sbin/munin10:45:231
2935036992818,5cyclictest0-21swapper/207:10:012
2935034992818,7cyclictest0-21swapper/111:35:011
2935034992818,7cyclictest0-21swapper/111:35:011
293503499271,24cyclictest0-21swapper/108:45:291
2935034992513,4cyclictest0-21swapper/107:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional