You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 23:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sun Dec 07, 2025 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3047569991244,89cyclictest3048475-21munin-node07:15:023
3047562998452,27cyclictest3099181-21munin-plugin-st12:10:000
3047562998033,10cyclictest3063935-21grep08:40:300
3047562997932,42cyclictest0-21swapper/012:35:280
3047562997737,32cyclictest3087939-21grep11:00:280
3047562997661,11cyclictest0-21swapper/008:50:020
3047562997661,11cyclictest0-21swapper/008:50:010
304756399758,35cyclictest0-21swapper/109:45:021
3047562997235,11cyclictest131ktimers/007:35:120
3047562997235,11cyclictest131ktimers/007:35:120
3047562997226,10cyclictest0-21swapper/009:45:310
3047562997133,6cyclictest20050irq/27-20000000.i2c09:40:270
304756299671,49cyclictest0-21swapper/010:05:150
3047562996635,5cyclictest3097485-21latency_hist12:00:000
3047562996629,32cyclictest3055138-1kworker/0:1H+mmc_complete09:20:010
3047567996031,25cyclictest3047556-21cyclictest10:40:292
3047562996049,4cyclictest21050irq/252-8000000.ethernet11:35:330
3047562996046,10cyclictest3100022-21munin-plugin-st12:15:000
3047567995936,19cyclictest0-21swapper/211:25:002
3047567995831,22cyclictest0-21swapper/208:15:292
3047563995830,25cyclictest0-21swapper/110:35:011
304756299585,39cyclictest21250irq/208-8000000.ethernet09:40:010
3047567995728,25cyclictest0-21swapper/210:10:012
304756399561,18cyclictest3095163-21/usr/sbin/munin11:45:191
3047562995645,5cyclictest3057913-21grep08:05:290
3047562995645,5cyclictest3057913-21grep08:05:280
304756299563,46cyclictest3063022-21unixbench_singl08:35:290
3047567995537,15cyclictest3087175-21munin-plugin-st11:00:012
3047567995537,15cyclictest3087175-21munin-plugin-st11:00:012
3047567995530,20cyclictest0-21swapper/209:30:322
3047567995528,21cyclictest0-21swapper/211:20:002
3047563995545,6cyclictest0-21swapper/110:55:311
3047563995545,6cyclictest0-21swapper/110:55:311
3047567995329,19cyclictest0-21swapper/211:30:222
3047567995325,23cyclictest0-21swapper/211:05:212
3047567995323,21cyclictest0-21swapper/207:15:232
3047567995227,21cyclictest0-21swapper/211:10:362
3047567995227,21cyclictest0-21swapper/211:10:362
3047563995227,18cyclictest3070569-21cut09:20:281
3047563995220,26cyclictest3084459-21sshd10:43:131
3047562995246,4cyclictest0-21swapper/012:20:120
3047567995135,11cyclictest0-21swapper/208:05:002
3047567995124,20cyclictest0-21swapper/208:35:282
304756799512,41cyclictest3069354-21/usr/sbin/munin09:15:192
3047567995123,20cyclictest0-21swapper/211:40:282
304756799511,43cyclictest0-21swapper/207:10:182
304756799510,39cyclictest3047556-21cyclictest08:05:122
304756799510,39cyclictest3047556-21cyclictest08:05:112
3047563995121,24cyclictest1668-21snmpd09:18:121
3047562995131,8cyclictest0-21swapper/011:20:010
304756799505,37cyclictest0-21swapper/212:10:272
304756799505,37cyclictest0-21swapper/210:20:012
3047567995026,20cyclictest0-21swapper/207:45:272
3047567995022,24cyclictest0-21swapper/212:25:212
3047567995022,24cyclictest0-21swapper/212:25:212
3047567995016,29cyclictest0-21swapper/208:35:012
3047567995015,28cyclictest3055249-21ptp4l07:50:272
3047567995015,28cyclictest3055249-21ptp4l07:50:272
3047563995036,8cyclictest3061786-21fschecks_time08:30:201
3047563995033,12cyclictest3053242-21/usr/sbin/munin07:40:181
3047563995029,12cyclictest3065549-21/usr/sbin/munin08:50:291
3047563995029,12cyclictest3065549-21/usr/sbin/munin08:50:291
3047563995024,14cyclictest231ktimers/109:55:121
304756799492,38cyclictest3071584-21/usr/sbin/munin09:25:302
3047567994921,23cyclictest0-21swapper/208:55:262
3047567994919,22cyclictest3063563-21fschecks_time08:40:232
3047567994916,25cyclictest0-21swapper/210:30:282
3047563994930,13cyclictest3051878-21ptp4l07:30:271
3047563994928,11cyclictest3050109-21/usr/sbin/munin07:20:281
3047563994928,11cyclictest3050109-21/usr/sbin/munin07:20:281
3047563994917,16cyclictest0-21swapper/111:20:111
3047562994942,5cyclictest131ktimers/007:30:000
3047562994931,9cyclictest0-21swapper/012:00:310
304756799483,38cyclictest0-21swapper/207:45:002
304756799483,37cyclictest3079225-21grep10:10:282
304756799482,38cyclictest3092046-21cut11:25:282
304756799482,37cyclictest3097197-21/usr/sbin/munin11:55:262
3047567994821,21cyclictest0-21swapper/210:50:362
3047567994821,21cyclictest0-21swapper/210:50:362
3047567994814,27cyclictest0-21swapper/211:05:002
304756799481,40cyclictest0-21swapper/209:05:262
304756799481,40cyclictest0-21swapper/209:05:252
304756799481,39cyclictest3064870-21latency_hist08:50:012
3047567994810,31cyclictest0-21swapper/207:55:272
3047563994840,4cyclictest3088226-21munin-node11:05:131
3047563994831,10cyclictest3096123-21grep11:50:221
3047563994828,13cyclictest3100677-21/usr/sbin/munin12:15:281
3047563994823,17cyclictest3079201-21sed10:10:271
3047562994835,9cyclictest3071652-21grep09:25:290
3047562994832,9cyclictest3080092-21grep10:15:270
3047562994814,7cyclictest3086239-21apt-get10:55:010
3047562994814,7cyclictest3086239-21apt-get10:55:010
304756799479,31cyclictest0-21swapper/212:30:302
3047567994729,14cyclictest3069074-21cron09:15:002
3047567994725,18cyclictest3060927-21sshd08:25:252
304756799471,39cyclictest0-21swapper/209:45:152
3047563994732,11cyclictest3102075-21fschecks_time12:25:221
3047563994732,11cyclictest3102075-21fschecks_time12:25:221
3047563994732,11cyclictest3067663-21dropbear09:05:171
3047563994732,11cyclictest3067663-21dropbear09:05:171
3047563994731,8cyclictest3060043-21sh08:20:231
3047563994728,13cyclictest3073371-21dropbear09:35:331
3047563994728,12cyclictest3066580-21latency_hist09:00:011
3047563994726,13cyclictest3102853-21grep12:30:211
3047562994738,4cyclictest0-21swapper/008:00:280
3047562994727,10cyclictest0-21swapper/009:30:310
304756299471,12cyclictest0-21swapper/009:55:010
304756799465,33cyclictest0-21swapper/211:50:312
304756799463,36cyclictest3066907-21sh09:00:202
3047567994627,14cyclictest0-21swapper/208:10:202
304756799462,35cyclictest3100221-21apt-get12:15:142
304756799461,40cyclictest3076057-21latency_hist09:55:002
304756799461,35cyclictest3103394-21apt-get12:35:052
3047567994611,28cyclictest168450irq/134-8000000.ethernet-tx209:35:202
3047563994631,9cyclictest3072250-21cut09:30:291
3047563994631,8cyclictest3098916-21/usr/sbin/munin12:05:271
3047563994630,9cyclictest3071632-21grep09:25:301
3047563994629,10cyclictest3080175-21gpgv10:20:011
3047563994623,16cyclictest3081413-21grep10:25:231
3047563994622,19cyclictest3064148-21latency_hist08:45:011
304756799452,36cyclictest3095501-21phc2sys11:45:262
304756799452,35cyclictest3052350-21/usr/sbin/munin07:35:162
304756799452,35cyclictest3052350-21/usr/sbin/munin07:35:162
304756799452,33cyclictest3084471-21apt-get10:45:052
3047567994518,23cyclictest0-21swapper/208:50:302
3047567994518,23cyclictest0-21swapper/208:50:292
3047567994516,23cyclictest3052004-21grep07:30:282
3047567994514,24cyclictest0-21swapper/211:35:352
304756799451,37cyclictest3083166-21tune2fs10:35:222
304756799451,37cyclictest3050211-21ptp4l-jitter07:20:292
304756799451,37cyclictest3050211-21ptp4l-jitter07:20:292
304756799451,36cyclictest3081902-21/usr/sbin/munin10:25:332
304756799451,36cyclictest3050620-21apt-get07:25:132
3047563994533,8cyclictest3077038-21/usr/sbin/munin10:00:161
3047563994531,8cyclictest0-21swapper/107:55:001
3047563994531,8cyclictest0-21swapper/107:55:001
3047563994529,9cyclictest3057316-21date08:05:011
3047563994529,10cyclictest3090029-21sh11:15:211
3047563994528,8cyclictest3089369-21/usr/sbin/munin11:10:331
3047563994528,8cyclictest3089369-21/usr/sbin/munin11:10:331
3047563994528,11cyclictest3051304-21grep07:30:011
3047563994526,12cyclictest3059463-21/usr/sbin/munin08:15:281
3047563994524,13cyclictest3097780-21/usr/sbin/munin12:00:211
304756299454,8cyclictest3086708-21cut10:55:230
304756299454,8cyclictest3086708-21cut10:55:230
3047562994539,2cyclictest0-21swapper/007:30:010
3047562994535,7cyclictest3077577-21grep10:00:300
3047562994533,8cyclictest3053682-21grep07:40:290
304756299453,36cyclictest3079254-21unixbench_singl10:10:280
3047562994530,9cyclictest0-21swapper/009:00:290
3047562994529,7cyclictest3068178-21grep09:05:290
3047562994529,7cyclictest3068178-21grep09:05:290
304756799446,31cyclictest0-21swapper/209:40:212
3047567994425,15cyclictest3098296-21grep12:00:312
304756799441,35cyclictest3070512-21tr09:20:262
3047563994436,4cyclictest3093177-21apt-get11:35:011
3047563994435,3cyclictest3097367-21tail11:55:281
3047563994432,8cyclictest3064863-21munin-plugin-st08:50:001
3047563994432,8cyclictest3052474-21sh07:35:221
3047563994432,8cyclictest3052474-21sh07:35:221
3047563994431,9cyclictest3077897-21/usr/sbin/munin10:05:201
3047563994428,8cyclictest3101413-21cut12:20:251
3047563994428,8cyclictest3087543-21fschecks_time11:00:211
3047563994427,12cyclictest3076120-21latency_hist09:55:021
3047563994427,11cyclictest3067218-21/usr/sbin/munin09:00:281
3047563994427,10cyclictest3099439-21dropbear12:10:161
3047563994426,9cyclictest3055728-21/usr/sbin/munin07:55:161
3047563994421,15cyclictest3085279-21/usr/sbin/munin10:45:291
3047562994428,11cyclictest0-21swapper/008:20:330
304756299442,11cyclictest3102036-21grep12:25:210
304756299442,11cyclictest3102036-21grep12:25:200
304756799434,36cyclictest0-21swapper/210:20:292
304756799432,35cyclictest3077335-21tail10:00:272
304756799431,35cyclictest0-21swapper/212:05:212
304756799431,33cyclictest0-21swapper/208:20:162
3047563994328,7cyclictest3058210-21/usr/sbin/munin08:10:211
3047563994326,10cyclictest3054091-21fschecks_count07:45:181
3047563994325,12cyclictest0-21swapper/112:35:271
3047563994323,14cyclictest3086147-21tail10:50:361
3047563994323,14cyclictest3086147-21tail10:50:361
3047563994322,13cyclictest3081261-21latency_hist10:25:021
304756399431,25cyclictest0-21swapper/109:50:011
3047562994335,5cyclictest21050irq/252-8000000.ethernet10:25:290
3047562994333,5cyclictest21250irq/208-8000000.ethernet07:45:280
3047563994234,4cyclictest3094326-21apt-get11:40:111
3047563994234,4cyclictest3068838-21/usr/sbin/munin09:10:261
3047563994234,4cyclictest3048796-21munin-node07:15:051
3047563994227,10cyclictest3061310-21unixbench_multi08:25:311
3047562994234,4cyclictest21050irq/252-8000000.ethernet07:15:040
3047562994233,5cyclictest21250irq/208-8000000.ethernet12:30:220
304756799411,32cyclictest3047787-21latency_hist07:10:012
3047563994135,3cyclictest3057611-21/usr/sbin/munin08:05:231
3047563994135,3cyclictest3057611-21/usr/sbin/munin08:05:231
3047563994125,13cyclictest3083069-21fschecks_count10:35:211
3047562994134,4cyclictest21050irq/252-8000000.ethernet07:10:280
304756299413,3cyclictest0-21swapper/011:30:010
3047562994130,6cyclictest3061202-21grep08:25:310
3047562994129,6cyclictest3095734-21grep11:45:280
3047562994124,12cyclictest0-21swapper/008:30:280
3047563994031,4cyclictest3047504-21apt-get07:10:011
3047563994031,4cyclictest3047504-21apt-get07:10:011
3047563994030,8cyclictest3093867-21cut11:35:341
3047563994027,9cyclictest3062573-21fschecks_time08:35:201
3047563994023,10cyclictest0-21swapper/111:30:001
304756299404,6cyclictest3089485-21tail11:10:350
304756299404,6cyclictest3089485-21tail11:10:350
3047562994030,6cyclictest131ktimers/011:50:310
3047562994024,11cyclictest0-21swapper/010:30:280
304756299402,2cyclictest0-21swapper/010:00:020
304756299401,2cyclictest0-21swapper/009:15:010
304756799392,33cyclictest3076329-21cut09:55:222
304756799391,35cyclictest3101081-21apt-get12:20:132
3047563993932,4cyclictest3048112-21/usr/sbin/munin07:10:251
3047562993926,8cyclictest0-21swapper/008:55:280
304756299391,6cyclictest0-21swapper/008:50:000
304756799381,31cyclictest0-21swapper/207:10:012
3047562993828,6cyclictest3088811-21grep11:05:300
3047562993828,6cyclictest3050420-21munin-plugin-st07:25:000
3047562993828,6cyclictest3050420-21munin-plugin-st07:25:000
3047562993827,8cyclictest3094856-21grep11:40:270
3047562993824,7cyclictest0-21swapper/010:40:010
3047562993820,7cyclictest0-21swapper/010:25:010
3047562993818,12cyclictest3084514-21apt-config10:45:010
304756299376,4cyclictest3093332-21cp11:35:020
3047562993726,6cyclictest3100797-21grep12:15:300
3047562993725,6cyclictest0-21swapper/007:50:270
3047562993725,6cyclictest0-21swapper/007:50:260
304756299371,9cyclictest0-21swapper/008:00:000
304756299371,34cyclictest0-21swapper/010:45:230
3047562993621,10cyclictest3090977-21fschecks_count11:20:210
3047562993522,9cyclictest0-21swapper/008:10:300
304756299351,5cyclictest0-21swapper/009:25:000
3047562993423,9cyclictest131ktimers/008:15:140
304756299335,3cyclictest3047504-21apt-get07:10:020
304756299335,3cyclictest3047504-21apt-get07:10:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional