You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 03:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Tue Apr 21, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3016278991051,2cyclictest0-21swapper/019:15:010
301628299742,43cyclictest3067918-21/usr/sbin/munin00:10:192
3016281997466,5cyclictest231ktimers/121:15:011
301628299701,54cyclictest0-21swapper/220:00:012
3016278997039,26cyclictest3019864-21grep19:25:280
301628299681,53cyclictest0-21swapper/200:15:102
301628299681,53cyclictest0-21swapper/200:15:102
3016282996629,29cyclictest0-21swapper/222:00:292
3016282996629,29cyclictest0-21swapper/222:00:292
3016282996541,20cyclictest3060124-21cron23:25:012
301627899652,6cyclictest3035296-21grep20:55:280
301628299641,51cyclictest0-21swapper/222:55:112
301627899645,33cyclictest3056643-21unixbench_multi23:00:290
301627899642,5cyclictest3017982-21ptp4l19:15:260
3016282996324,33cyclictest3054907-21unixbench_singl22:50:282
301628299631,49cyclictest0-21swapper/200:30:112
3016278996329,31cyclictest0-21swapper/022:40:000
3016278996214,43cyclictest0-21swapper/023:40:010
3016278996214,43cyclictest0-21swapper/023:40:010
3016282996128,26cyclictest0-21swapper/222:05:292
301628299611,48cyclictest0-21swapper/221:25:122
301628299611,48cyclictest0-21swapper/219:30:112
301627899611,7cyclictest3031541-21sh20:35:220
301627899611,7cyclictest3031541-21sh20:35:220
3016282996032,22cyclictest3067720-21munin-plugin-st00:10:002
3016282996018,35cyclictest0-21swapper/223:15:272
3016278996043,15cyclictest3054125-21cat22:50:000
3016278996031,24cyclictest3063424-21grep23:40:300
301627899602,5cyclictest3024122-21munin-run19:55:000
3016278996021,35cyclictest0-21swapper/023:55:200
301627899601,57cyclictest3072596-21/usr/sbin/munin00:35:280
3016282995931,23cyclictest3029306-21unixbench_singl20:20:292
301628299592,49cyclictest3035287-21/usr/sbin/munin20:55:282
301628299592,49cyclictest3030508-21apt-get20:30:182
3016282995922,33cyclictest0-21swapper/223:25:302
3016278995942,14cyclictest167350irq/118-8000000.ethernet-tx019:55:250
301627899594,13cyclictest3071888-21grep00:30:280
3016278995921,33cyclictest0-21swapper/023:00:010
301628299582,47cyclictest3033953-21/usr/sbin/munin20:50:162
301628299581,51cyclictest3050649-21sshd22:28:152
301628299581,49cyclictest3056954-21apt-get23:05:152
301628299581,49cyclictest3042785-21/usr/sbin/munin21:40:272
301628199588,21cyclictest3024119-21apt-get19:55:001
301627899585,4cyclictest3026748-21munin-run20:10:010
3016278995838,16cyclictest20650irq/252-8000000.ethernet20:10:210
3016278995825,30cyclictest3047203-21grep22:05:290
3016278995825,29cyclictest20850irq/208-8000000.ethernet20:30:220
301628299572,47cyclictest3037354-21apt-get21:10:152
301628299571,49cyclictest3047482-21/usr/sbin/munin22:10:302
301628299571,48cyclictest3056568-21/usr/sbin/munin23:00:272
301628299571,45cyclictest0-21swapper/220:35:122
301628299571,45cyclictest0-21swapper/220:35:122
301628299571,43cyclictest0-21swapper/221:50:122
301627899573,8cyclictest3020745-21apt19:35:000
3016278995730,24cyclictest20650irq/252-8000000.ethernet22:40:180
3016278995726,27cyclictest20650irq/252-8000000.ethernet19:25:010
3016278995725,29cyclictest20850irq/208-8000000.ethernet20:00:300
301628299561,47cyclictest3036827-21/usr/sbin/munin21:05:272
301628299561,46cyclictest3027493-21/usr/sbin/munin20:10:272
301627899562,8cyclictest3068016-21cut00:10:190
301627899561,52cyclictest0-21swapper/023:05:280
301628299553,44cyclictest3032346-21ssh20:40:192
301628299553,44cyclictest3016756-21/usr/sbin/munin19:10:262
301628299552,46cyclictest3017534-21ssh19:15:062
301628299551,47cyclictest3048648-21/usr/sbin/munin22:15:262
301628299551,46cyclictest3049185-21apt-get22:20:132
301628299551,46cyclictest3027879-21apt-get20:15:142
301628299551,46cyclictest3018432-21/usr/sbin/munin19:20:152
301628299551,45cyclictest3070518-21ssh00:25:162
301628299551,43cyclictest0-21swapper/221:45:142
301628299551,42cyclictest0-21swapper/200:20:122
3016282995513,35cyclictest0-21swapper/221:15:272
3016278995542,10cyclictest167350irq/118-8000000.ethernet-tx021:55:240
301627899552,8cyclictest3036935-21/usr/sbin/munin21:05:280
3016278995518,34cyclictest3069933-21/usr/sbin/munin00:20:270
3016278995517,34cyclictest3038343-21fschecks_time21:15:220
301628299542,44cyclictest3057792-21apt-get23:10:142
301628299541,45cyclictest3061171-21apt-get23:30:132
301628299541,45cyclictest3051703-21apt-get22:35:162
301628299541,44cyclictest3026111-21apt-get20:05:132
301628299541,41cyclictest0-21swapper/220:25:122
301627899545,5cyclictest3054322-21apt-get22:50:050
3016278995432,17cyclictest3028420-21grep20:15:290
3016278995431,19cyclictest20850irq/208-8000000.ethernet23:20:000
3016278995425,25cyclictest3041380-21grep21:35:010
301628299533,43cyclictest3035785-21/usr/sbin/munin21:00:212
301628299531,46cyclictest3042194-21sshd21:37:332
301628299531,45cyclictest3072242-21/usr/sbin/munin00:35:212
301628299531,45cyclictest3063763-21/usr/sbin/munin23:45:152
301628299531,45cyclictest3033045-21apt-get20:45:152
301628299531,44cyclictest3064862-21/usr/sbin/munin23:50:262
301628299531,44cyclictest3040733-21apt-get21:30:132
301628299531,44cyclictest3022963-21/usr/sbin/munin19:45:272
301628299531,44cyclictest3022963-21/usr/sbin/munin19:45:262
301628299531,42cyclictest0-21swapper/219:50:142
301628299531,40cyclictest0-21swapper/222:30:142
3016278995329,20cyclictest20650irq/252-8000000.ethernet23:25:250
3016278995326,23cyclictest20650irq/252-8000000.ethernet21:50:120
301627899532,43cyclictest3029535-21latency_hist20:25:010
301627899532,11cyclictest3043459-21grep21:45:210
3016278995320,28cyclictest0-21swapper/019:40:010
301627899531,4cyclictest0-21swapper/023:15:010
301627899531,11cyclictest3037895-21grep21:10:280
301628299523,40cyclictest3022030-21/usr/sbin/munin19:40:242
301628299522,43cyclictest3052816-21/usr/sbin/munin22:40:232
301628299522,42cyclictest3063240-21/usr/sbin/munin23:40:272
3016282995224,21cyclictest3062006-21/usr/sbin/munin23:35:282
3016282995224,21cyclictest3062006-21/usr/sbin/munin23:35:282
301628299521,44cyclictest3066594-21/usr/sbin/munin00:00:282
301628299521,44cyclictest3065790-21/usr/sbin/munin23:55:252
301628299521,44cyclictest3019589-21/usr/sbin/munin19:25:262
301628299521,43cyclictest3044950-21apt-get21:55:112
3016278995244,4cyclictest167350irq/118-8000000.ethernet-tx000:05:170
3016278995237,10cyclictest167350irq/118-8000000.ethernet-tx021:00:280
3016278995231,17cyclictest20650irq/252-8000000.ethernet19:45:160
3016278995231,17cyclictest20650irq/252-8000000.ethernet19:45:160
3016278995229,19cyclictest20850irq/208-8000000.ethernet21:35:170
301627899522,8cyclictest3046608-21latency_hist22:05:010
301627899522,8cyclictest3046608-21latency_hist22:05:010
301627899522,6cyclictest3071003-21grep00:25:280
301627899522,5cyclictest3039782-21ls21:25:010
301627899522,10cyclictest3047653-21cut22:10:210
3016278995220,23cyclictest0-21swapper/019:10:010
3016278995220,23cyclictest0-21swapper/019:10:010
301627899521,8cyclictest3048580-21/usr/sbin/munin22:15:240
3016278995218,31cyclictest0-21swapper/020:25:280
3016278995214,32cyclictest0-21swapper/023:50:210
3016282995116,28cyclictest0-21swapper/219:35:292
301628299511,43cyclictest3053481-21/usr/sbin/munin22:45:162
301628299511,43cyclictest3025595-21/usr/sbin/munin20:00:282
301627899516,38cyclictest0-21swapper/020:50:010
301627899514,7cyclictest3040579-21grep21:30:000
301627899512,9cyclictest3043066-21latency_hist21:45:000
3016278995127,21cyclictest20850irq/208-8000000.ethernet23:45:230
301627899512,6cyclictest3069295-21grep00:15:270
301627899512,6cyclictest3069295-21grep00:15:270
301627899511,9cyclictest3061349-21/usr/sbin/munin23:30:220
301627899511,8cyclictest3021888-21/usr/sbin/munin19:40:210
301628299501,42cyclictest3039450-21/usr/sbin/munin21:20:272
301627899502,8cyclictest3066771-21grep00:00:300
301627899501,3cyclictest3032283-21forks20:40:180
3016281994942,5cyclictest0-21swapper/120:25:011
301627899496,37cyclictest0-21swapper/020:50:270
301627899494,39cyclictest3049718-21sed22:20:290
301627899492,8cyclictest3050142-21fschecks_count22:25:210
301628199483,6cyclictest3055801-21apt-get23:00:021
3016281994836,10cyclictest14-21rcu_preempt21:05:011
301627899485,4cyclictest3059681-21tune2fs23:20:210
301627899471,11cyclictest3050923-21/usr/sbin/munin22:30:170
3016281994630,7cyclictest3023263-21kworker/u8:2-ext4-rsv-conversion19:55:001
3016281994524,16cyclictest231ktimers/122:45:091
3016281994432,5cyclictest0-21swapper/122:00:211
3016281994432,5cyclictest0-21swapper/122:00:211
301628199441,8cyclictest0-21swapper/123:30:001
301628199441,4cyclictest0-21swapper/120:45:001
3016281994332,6cyclictest0-21swapper/121:35:001
3016281994329,9cyclictest0-21swapper/123:35:281
3016281994329,9cyclictest0-21swapper/123:35:271
3016281994325,11cyclictest0-21swapper/100:15:011
301628199424,12cyclictest22-21rcuc/119:45:011
3016281994231,7cyclictest3019008-21unixbench_singl19:20:291
3016281994131,6cyclictest22-21rcuc/123:25:001
3016281994128,8cyclictest0-21swapper/121:25:201
3016281994128,8cyclictest0-21swapper/119:10:281
3016281994127,6cyclictest3023263-21kworker/u8:2+writeback20:10:051
301628199411,4cyclictest0-21swapper/100:25:001
301628199404,24cyclictest3056110-21/usr/sbin/munin23:00:191
3016281994031,6cyclictest0-21swapper/123:55:191
301628199402,31cyclictest0-21swapper/120:35:231
301628199402,31cyclictest0-21swapper/120:35:231
3016281993930,4cyclictest0-21swapper/119:45:251
3016281993930,4cyclictest0-21swapper/119:45:251
3016281993927,7cyclictest0-21swapper/121:55:281
3016281993925,8cyclictest0-21swapper/122:05:281
3016281993924,11cyclictest0-21swapper/123:45:251
301628199391,2cyclictest0-21swapper/121:25:011
301628299381,31cyclictest3016351-21sed19:10:012
301628299381,31cyclictest3016351-21sed19:10:002
3016281993828,5cyclictest0-21swapper/119:35:171
3016281993826,8cyclictest0-21swapper/100:30:261
3016281993825,6cyclictest0-21swapper/121:50:201
301628199381,2cyclictest0-21swapper/121:00:011
301628199381,29cyclictest0-21swapper/123:15:271
3016281993724,8cyclictest0-21swapper/122:15:291
3016281993723,7cyclictest0-21swapper/122:40:291
301628199372,28cyclictest0-21swapper/120:50:261
3016281993722,10cyclictest0-21swapper/122:10:211
301628199371,4cyclictest0-21swapper/120:50:011
301628199371,3cyclictest0-21swapper/121:05:011
301628199368,2cyclictest3070991-21unixbench_multi00:25:281
3016281993625,8cyclictest3028456-21grep20:15:291
3016281993625,7cyclictest0-21swapper/100:35:211
3016281993623,9cyclictest0-21swapper/120:30:311
301628199362,26cyclictest0-21swapper/123:05:191
3016281993620,7cyclictest3025854-21unixbench_singl20:00:311
3016281993523,6cyclictest3054324-21/usr/sbin/munin22:50:231
3016281993522,8cyclictest0-21swapper/121:15:301
301628199352,27cyclictest0-21swapper/100:05:221
3016281993518,10cyclictest3017396-21dropbear19:15:041
301628199351,27cyclictest3043361-21fschecks_count21:45:191
301628199351,27cyclictest3020407-21meminfo19:30:231
3016281993427,3cyclictest167450irq/126-8000000.ethernet-tx122:35:261
3016281993426,4cyclictest0-21swapper/121:35:281
3016281993425,5cyclictest0-21swapper/123:50:281
301628199341,27cyclictest0-21swapper/123:10:111
3016281993324,5cyclictest0-21swapper/123:30:271
3016281993320,8cyclictest0-21swapper/122:30:291
3016281993320,8cyclictest0-21swapper/120:10:011
301628199331,26cyclictest3066860-21sshd00:02:161
301628199321,3cyclictest0-21swapper/121:45:011
3016281993123,4cyclictest0-21swapper/119:25:201
3016281993122,6cyclictest1660-21snmpd22:26:471
3016281993121,5cyclictest0-21swapper/120:30:011
301628199301,2cyclictest0-21swapper/123:45:001
301628199291,2cyclictest0-21swapper/100:20:021
301628199291,2cyclictest0-21swapper/100:20:011
301628199281,4cyclictest0-21swapper/122:25:001
301628199174,8cyclictest0-21swapper/119:10:011
301628199174,8cyclictest0-21swapper/119:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional