You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 23:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6s.osadl.org (updated Fri May 02, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2800196997313,22cyclictest2836360-21/usr/sbin/munin10:40:232
2800195996449,12cyclictest231ktimers/107:45:171
280019699622,27cyclictest2836137-21cron10:40:012
280019599613,45cyclictest2831849-21apt-config10:15:011
2800195996120,16cyclictest2824393-21/usr/sbin/munin09:30:241
2800195995710,19cyclictest2802339-21/usr/sbin/munin07:20:201
2800196995338,11cyclictest2802128-21sendmail07:20:012
2800196995338,11cyclictest2802128-21sendmail07:20:012
280019699527,14cyclictest2819897-21apt-get09:05:012
2800196995245,4cyclictest2808866-21sendmail08:00:002
2800195995245,4cyclictest22-21rcuc/110:20:011
2800195995231,14cyclictest231ktimers/107:30:161
2800192995118,3cyclictest0-21swapper/008:15:010
2800196995038,8cyclictest2818207-21munin-plugin-st08:55:002
2800195995037,8cyclictest0-21swapper/109:05:021
280019599497,30cyclictest22-21rcuc/107:40:011
2800192994932,7cyclictest14-21rcu_preempt11:25:010
2800196994834,10cyclictest0-21swapper/208:29:592
2800196994816,18cyclictest2844772-21/usr/sbin/munin11:30:222
2800192994818,28cyclictest0-21swapper/009:20:000
280019599464,36cyclictest22-21rcuc/112:00:011
2800195994627,15cyclictest231ktimers/108:05:131
280019699456,20cyclictest32-21ksoftirqd/209:50:002
2800195994537,4cyclictest2800999-21munin-plugin-st07:15:001
2800195994530,11cyclictest0-21swapper/110:40:321
2800192994539,4cyclictest0-21swapper/009:20:120
2800192994539,4cyclictest0-21swapper/009:20:120
2800192994534,7cyclictest0-21swapper/007:35:250
280019299453,24cyclictest0-21swapper/007:50:210
2800192994531,9cyclictest0-21swapper/012:00:010
2800195994435,5cyclictest2828331-21head09:50:301
2800195994433,8cyclictest2829244-21sendmail09:59:591
2800192994433,7cyclictest0-21swapper/012:25:310
280019299442,9cyclictest2835914-21tail10:35:290
280019699434,18cyclictest14-21rcu_preempt10:25:002
2800196994333,6cyclictest0-21swapper/207:35:322
2800196994331,9cyclictest0-21swapper/210:55:212
2800195994328,8cyclictest0-21swapper/110:30:011
2800195994328,8cyclictest0-21swapper/110:30:001
2800195994328,7cyclictest0-21swapper/109:15:281
2800195994324,12cyclictest231ktimers/111:40:181
2800195994310,20cyclictest2822719-21/usr/sbin/munin09:20:191
2800195994310,20cyclictest2822719-21/usr/sbin/munin09:20:191
2800192994336,4cyclictest2845411-21munin-plugin-st11:35:000
2800192994334,4cyclictest0-21swapper/007:10:130
2800192994333,6cyclictest2839526-21sendmail11:00:000
280019299431,38cyclictest2810522-21/usr/sbin/munin08:05:290
2800196994233,5cyclictest0-21swapper/210:34:592
2800196994232,5cyclictest0-21swapper/212:15:312
2800195994231,8cyclictest0-21swapper/107:30:011
2800195994229,9cyclictest0-21swapper/108:15:321
2800192994235,3cyclictest0-21swapper/011:40:010
2800192994234,4cyclictest0-21swapper/009:05:220
2800196994134,3cyclictest2842893-21sendmail11:19:592
2800196994127,9cyclictest0-21swapper/210:45:292
2800195994134,5cyclictest231ktimers/110:50:171
2800195994127,9cyclictest0-21swapper/112:30:281
2800195994126,10cyclictest231ktimers/111:00:151
2800192994132,5cyclictest2848770-21cron11:55:010
2800192994126,11cyclictest0-21swapper/008:20:000
2800192994125,11cyclictest0-21swapper/012:35:010
280019299411,34cyclictest0-21swapper/010:50:150
2800196994034,4cyclictest2849617-21sendmail11:59:592
2800196994030,6cyclictest2829195-21grep09:55:342
2800195994030,6cyclictest0-21swapper/111:30:311
2800195994022,12cyclictest231ktimers/111:15:151
2800192994033,4cyclictest20750irq/251-8000000.ethernet09:55:340
2800192994030,7cyclictest0-21swapper/008:40:240
2800192994029,6cyclictest0-21swapper/009:30:210
2800192994029,4cyclictest2849615-21apt-get12:00:050
280019299402,4cyclictest0-21swapper/009:25:150
280019299401,34cyclictest0-21swapper/010:45:010
280019299401,22cyclictest0-21swapper/010:00:130
280019299401,22cyclictest0-21swapper/010:00:130
280019299401,21cyclictest0-21swapper/010:30:300
280019299401,12cyclictest0-21swapper/007:25:000
2800196993931,5cyclictest168450irq/135-8000000.ethernet-tx208:05:292
2800196993929,6cyclictest2856334-21grep12:35:312
2800196993929,6cyclictest0-21swapper/212:05:282
2800196993929,6cyclictest0-21swapper/211:10:292
280019599397,4cyclictest0-21swapper/111:40:021
2800195993930,6cyclictest2835210-21grep10:30:311
2800195993925,9cyclictest0-21swapper/112:05:271
2800195993925,8cyclictest0-21swapper/112:15:311
2800192993933,4cyclictest2830927-21grep10:09:590
2800192993926,8cyclictest0-21swapper/012:05:200
2800192993926,10cyclictest2814837-21sh08:35:000
280019299391,9cyclictest0-21swapper/008:50:010
280019299391,4cyclictest0-21swapper/011:20:010
280019299391,36cyclictest0-21swapper/009:40:010
280019299391,2cyclictest0-21swapper/011:00:190
280019299391,21cyclictest2826991-21df_inode09:45:220
2800196993829,5cyclictest0-21swapper/210:15:202
2800196993822,11cyclictest0-21swapper/208:45:202
280019699381,30cyclictest0-21swapper/207:40:282
2800195993825,9cyclictest0-21swapper/109:05:271
2800195993816,4cyclictest2844759-21latency_hist11:30:001
2800192993831,4cyclictest20950irq/209-8000000.ethernet09:05:010
2800192993826,8cyclictest0-21swapper/011:45:290
2800192993825,9cyclictest0-21swapper/010:10:210
2800192993825,9cyclictest0-21swapper/008:20:320
2800192993825,9cyclictest0-21swapper/008:20:320
280019299381,4cyclictest0-21swapper/011:30:000
280019299381,2cyclictest0-21swapper/012:20:000
2800196993730,4cyclictest168450irq/135-8000000.ethernet-tx212:25:282
2800196993730,4cyclictest168450irq/135-8000000.ethernet-tx209:10:162
2800196993723,11cyclictest311ktimers/207:50:092
2800195993730,4cyclictest0-21swapper/111:10:291
2800195993728,5cyclictest0-21swapper/107:15:281
2800195993728,5cyclictest0-21swapper/107:15:281
2800195993727,5cyclictest0-21swapper/108:40:201
2800195993725,8cyclictest0-21swapper/109:30:001
2800195993725,7cyclictest0-21swapper/112:20:291
2800195993722,6cyclictest0-21swapper/110:45:291
280019299374,22cyclictest15-21rcuc/011:45:000
2800192993731,3cyclictest0-21swapper/007:40:190
2800192993730,5cyclictest2804654-21munin-plugin-st07:35:000
280019299371,3cyclictest0-21swapper/007:10:010
280019299371,34cyclictest0-21swapper/010:20:160
280019299371,2cyclictest0-21swapper/012:25:010
2800196993627,4cyclictest0-21swapper/208:30:282
2800196993624,7cyclictest0-21swapper/212:30:182
2800196993623,9cyclictest0-21swapper/208:15:312
2800195993632,2cyclictest0-21swapper/111:55:021
2800195993628,4cyclictest2852143-21unixbench_multi12:10:271
2800195993622,9cyclictest0-21swapper/111:05:301
2800195993620,10cyclictest231ktimers/108:25:171
2800192993629,4cyclictest20750irq/251-8000000.ethernet11:05:150
2800192993628,5cyclictest15-21rcuc/010:20:000
2800192993627,5cyclictest0-21swapper/008:30:010
2800192993619,12cyclictest0-21swapper/012:35:240
280019299361,4cyclictest0-21swapper/010:25:130
280019299361,4cyclictest0-21swapper/010:25:130
280019699358,9cyclictest2812527-21/usr/sbin/munin08:20:222
280019699358,9cyclictest2812527-21/usr/sbin/munin08:20:222
2800196993528,4cyclictest168450irq/135-8000000.ethernet-tx210:10:272
2800196993527,5cyclictest2815040-21/usr/sbin/munin08:35:252
2800196993527,4cyclictest1263-21cron08:45:002
2800196993524,8cyclictest0-21swapper/211:20:252
2800196993522,8cyclictest0-21swapper/210:30:012
2800196993522,8cyclictest0-21swapper/210:30:012
280019699351,28cyclictest0-21swapper/207:45:272
2800195993524,6cyclictest0-21swapper/112:25:321
2800195993524,6cyclictest0-21swapper/111:45:291
2800195993523,8cyclictest0-21swapper/107:40:281
2800195993522,9cyclictest0-21swapper/107:50:261
2800192993529,4cyclictest20950irq/209-8000000.ethernet07:45:250
2800192993526,6cyclictest2841942-21grep11:10:300
2800192993521,9cyclictest0-21swapper/008:00:290
280019299351,32cyclictest0-21swapper/009:10:230
280019299351,2cyclictest0-21swapper/007:30:010
2800196993427,4cyclictest168450irq/135-8000000.ethernet-tx209:15:172
2800196993422,9cyclictest0-21swapper/211:50:202
2800196993421,7cyclictest2843936-21/usr/sbin/munin11:25:322
2800195993427,3cyclictest0-21swapper/108:35:221
2800195993426,5cyclictest0-21swapper/110:20:301
2800195993424,5cyclictest0-21swapper/108:00:291
2800195993419,8cyclictest0-21swapper/109:45:321
2800195993416,13cyclictest231ktimers/110:35:161
280019599341,5cyclictest0-21swapper/109:00:021
2800195993415,13cyclictest231ktimers/108:10:141
280019599340,11cyclictest0-21swapper/109:15:011
2800192993428,4cyclictest20950irq/209-8000000.ethernet09:40:180
2800192993427,4cyclictest19950irq/27-20000000.i2c07:55:290
2800192993426,6cyclictest131ktimers/012:10:260
2800196993324,5cyclictest0-21swapper/211:00:252
2800196993324,5cyclictest0-21swapper/210:00:312
2800196993324,5cyclictest0-21swapper/210:00:302
280019699332,25cyclictest0-21swapper/207:25:182
280019699331,29cyclictest0-21swapper/212:20:292
280019699331,27cyclictest0-21swapper/209:25:272
2800195993322,7cyclictest0-21swapper/108:45:281
2800195993321,7cyclictest2830047-21grep10:00:301
2800195993321,7cyclictest2830047-21grep10:00:301
2800192993327,4cyclictest19950irq/27-20000000.i2c09:55:010
2800192993327,4cyclictest168250irq/119-8000000.ethernet-tx008:50:230
2800192993326,5cyclictest131ktimers/010:45:270
2800192993326,4cyclictest20950irq/209-8000000.ethernet07:15:030
2800192993326,4cyclictest20950irq/209-8000000.ethernet07:15:030
280019699321,4cyclictest2846257-21munin-run11:40:012
280019699321,25cyclictest0-21swapper/207:30:252
2800195993225,4cyclictest2843098-21/usr/sbin/munin11:20:131
2800195993222,7cyclictest2808847-21cron08:00:001
2800195993217,11cyclictest231ktimers/108:30:121
2800196993125,4cyclictest168450irq/135-8000000.ethernet-tx209:40:162
2800196993123,5cyclictest0-21swapper/211:05:222
280019699311,5cyclictest2838335-21meminfo10:50:262
2800195993122,5cyclictest0-21swapper/110:05:211
2800195993119,8cyclictest0-21swapper/112:35:251
280019699302,5cyclictest2818708-21memory08:55:272
2800196993022,4cyclictest0-21swapper/209:20:282
2800196993022,4cyclictest0-21swapper/209:20:282
280019699301,15cyclictest0-21swapper/207:10:172
2800195993022,5cyclictest2812527-21/usr/sbin/munin08:20:301
2800195993022,5cyclictest2812527-21/usr/sbin/munin08:20:301
2800195993018,5cyclictest22-21rcuc/107:10:011
280019299301,26cyclictest2815097-21ssh08:35:190
280019699292,3cyclictest2819897-21apt-get09:05:032
2800196992922,4cyclictest168450irq/135-8000000.ethernet-tx209:30:302
2800196992921,4cyclictest0-21swapper/211:40:282
280019699291,26cyclictest0-21swapper/207:20:122
2800195992917,8cyclictest2850445-21grep12:00:281
2800195992910,4cyclictest27350irq/343-s-wl18xx09:41:131
2800192992920,7cyclictest2818550-21lsblk08:55:230
280019699281,4cyclictest2825872-21munin-run09:40:002
280019699281,25cyclictest0-21swapper/210:05:142
280019699281,24cyclictest2811388-21http08:15:002
2800195992822,3cyclictest22-21rcuc/109:40:011
2800195992820,5cyclictest0-21swapper/108:50:291
2800195992818,7cyclictest2839408-21grep10:55:311
280019699271,24cyclictest0-21swapper/211:45:142
2800196992710,3cyclictest27350irq/343-s-wl18xx09:50:122
2800196992620,4cyclictest0-21swapper/212:10:212
280019699261,3cyclictest0-21swapper/212:00:162
280019699251,22cyclictest0-21swapper/208:00:352
2800196991813,3cyclictest2800284-21latency_hist07:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional