Aux Copy Schedule

Hi @DBA , thanks for the post!

When you say ‘start’, are you referring to the scheduling of the Aux Copy operation, or the times of the jobs being copied?

The jobs themselves are identical copies in all ways.

The scheduled operation itself will start when the time of the schedule arrives.

I was referring to when the job starts getting copied, it has a daily schedule setup but we are a bit behind in our Aux copies, they just keep adding up, and have been the the last few months.

Backup Copies are extracting data from snapshots to a disklibrary, at least based on your description this is my assumption. The Auxiliary Copy will then copy the data to for example a secondary disklibrary or a tape library. An Auxiliary Copy can be started parallel or during a backup copy, only when data at least is available partially the Auxiliary Copy can begin copying. Looking at your last reply you have the setting where Auxiliary processes are re-scanning for new data, when you have to many new daily data or the transfer speed (probably due to lack of either streams/readers, compute or network bandwidth capacity) this effect can occur where Auxiliary copies keep running.

Some questions:

• What type of data is being Backup Copied / Auxiliary Copied?
• What is the daily new amount of data coming from the Backup Copy?
• What is the transfer speed of the Auxiliary Copy?
• Is this deduplicated data?
• Do you have a fixed amount readers configured in the Auxliary Copy schedule or do you have it set to Max?
• Do you use scalable resource allocation in the Auxliary Copy schedule?
  It probably is as your Auxiliary Copies keep getting new data, this option does that if the option “Pick new data for Scalable Resource Auxiliary Copy job” (within Media Management → Auxiliary Copy) is set to value 1.
  If configured what is the Batch Size configured in the Advanced Settings within the schedule → Scalable Resource Allocation Tab?
• Is the receiving media agent in the Auxiliary Copy being used as a primary target for any backups? If not is the media agent configured with Optimize for concurrent LAN backups (located on Control tab)?
• Is the Storage Policy configured with the option: “Distribute data evenly among multiple streams for offline read operations”
• Is the Storage Policy configured with the option “Enable stream randomization for backup/archiver jobs”

Hope these answers help out. I was not certain how to verify the info on the third from last question from the bottom. Do you think anything should be changed.  Appreciate the help

• What type of data is being Backup Copied / Auxiliary Copied? 95% Window servers and the rest are Linux servers 
• What is the daily new amount of data coming from the Backup Copy? Its slightly different every night but ranges from 60-70TB per night
• What is the transfer speed of the Auxiliary Copy? Estimate of 700 GB/h
• Is this deduplicated data? Its deduplicated data on the primary but not the Aux side
• Do you have a fixed amount readers configured in the Auxliary Copy schedule or do you have it set to Max? It is set to Max
• Do you use scalable resource allocation in the Auxliary Copy schedule? Yes
  It probably is as your Auxiliary Copies keep getting new data, this option does that if the option “Pick new data for Scalable Resource Auxiliary Copy job” (within Media Management → Auxiliary Copy) is set to value 1. Yes that is set to 1
  If configured what is the Batch Size configured in the Advanced Settings within the schedule → Scalable Resource Allocation Tab? “The max jobs process is se to 1,000” under the scalable resource allocation.
• Is the receiving media agent in the Auxiliary Copy being used as a primary target for any backups? If not is the media agent configured with Optimize for concurrent LAN backups (located on Control tab)?  One media agents is being used a a proxy for IntelliSnap for one server 18TB’s. Not sure if that answers your question. ??
• Is the Storage Policy configured with the option: “Distribute data evenly among multiple streams for offline read operations” Yes
• Is the Storage Policy configured with the option “Enable stream randomization for backup/archiver jobs” Yes

Also there are Aux copies scheduled to start every day at 11am. 

@Jos Meijer These are  Aux copies - DDB is beside the point 

Simple question:  Is your network connection pegged during the Aux Copy jobs, or does there appear to be room to spare?  If your network connection is saturated, obviously you cannot go any faster.  If there’s plenty of more bandwidth, the bottleneck is likely either read speeds from the source or write speeds to the destination.  Or maybe you need more streams.

https://documentation.commvault.com/2022e/expert/109223_performance_analysis_tool.html

I might suggest trying the Performance Analysis Tool to see if it can identify any bottleneck.

Thanks,
Scott

The speed time or thoughput for for Aux copies is pretty good 700 GB/h or so. We did do a performance test and what is confusing is the read time is slower than then  write time by a lot. I would have expected the opposite.