Storage and Deduplication

Howdy folks,Our current environment:One on-prem mediaagent connected to SAN for primary backupsOne off-site mediaagent with storage and jbod for DROne Commserve265TB of deduplicated data, 1 DDB, nearly 11PB of undeduplicated dataOur goal:We want to add a second on-prem mediaagent (with its own DDB and index cache) to work in tandem with our current primary mediaagent. Our idea/hope/goal is that both on-prem mediaagents (one existing, one new) would be under the same storage, deduplication, and copy policies and Commserve would load-balance jobs between the two. Both of these would then copy over to our third (existing) off-site mediaagent.  We met with our Commvault rep during purchasing of the new mediaagent and he said it would be possible, but didn’t give us any specifics. Now that installation/setup is here, I can’t find any documentation on how to actually accomplish this. I’ve found everything I need to prepare for installation, and install the Commvault software on the mediaagen

Dear all,I am currently struggling with the following topic, I hope anybody can help.In our Commvault Infrastructure we have 3 Media Agents, each with its own local Library and Deduplication Engine. On each Deduplication Engine we have 3 Dedup Databases, named DDB_Files, DDB_VMs and DDB_Databases.I am now adding a new Media Server to the platform but I can’t figure out how to create the 3 DDBs for the local Deduplication Engine, to reproduce the configuration of the existing MAs. May anybody be so kind to suggest me how to do? Thank you!Gaetano

Hello All,We have 2 Media Agents where the backend storage is going to be replaced with the advanced storage so that the support is available from storage point of view. We have 2 different libraries from two different media agents. So now my question is how will I move the data from the library to new library within the same media agent. The backups are running continuously and they will be running without any break. Let me know if you have reference links or steps to perform these steps.RegardsKishore 

I’m wondering how to add an incremental SP into a working environment without causing mission critical BUs to fail.I have 4 “very large” NAS/NFS subclients which all go to a SP which currently has just one S3 destination for all jobs. It was becoming impractical to send all fulls and incs to tape and the business requirement is just “daily backups to tape” so we do synthetic fulls, but, even occasional synth fulls then would need to copy to tape, all wasting tapes due to cycles, etc. I had talked to one of the guys in support about this and it sounded “easy enough” but when I try to deploy, things don’t look like it was described over the phone.So, what we would really like to do is have only incremental jobs copied from that S3 copy to tape. No fulls, ever go to tape. We also don’t want to skip any incs going to the existing primary bucket.I thought it would be as simple as creating a new incremental policy but I have observed that if I have any Incremental SP’s the actual option to s

Hi Everyone! I am looking to see if there is anyone else that is backing up Microsoft AG clusters with nodes that are hosted in different geographical DCs? We have the MSQL AG client configured at the moment to backup to “PLAN - DC1” but when the DBA’s failover the cluster to another node, the backups are being transfered across the WAN from “DC2” to “DC1” Should we not configure the backups using the AG for these DBs and confgure them on the clusters nodes instead and configure the storage polices to point to the Commvault Plan for that site or is there another option? Thanks for your time! 

Hello everyone,Two months ago we put two new media agents into operation with a new backup storage. The two old media agents were shut down. Since you don't want to restart the old media agents due to the old operating system, the question would now be whether it is possible to remove the mount paths to the old media agents (LUN's) from Commvault? The data has a retention period of 30 days and this should also have expired. If we could open these paths like that, that would be great.RegardsThomas

Team , how the hypersalce x , media agent handle the jobs when a failure of one job occurs , i have performed a testing where a job was running with media agent 2 of hyperscal node 2 and i shutdown the same node , 1> the running job is on running mode - and no progress  2> i started new job and it completed successfully started the node 2 and still no progress on that job and it failed .why was it not assigned to any other media agents - and why the job is handled only by one media agent - i can see restore jobs used all 3 media agent but backup is by one , do we have control on this . 3> after the nodes came up , there was a restore job happned from node 2 to node 2 - may i know what basically getting restored ?

I’m backing up a few NAS subclients that are between 10-30TB each.Currently they are scheduled to do a synthetic full backup every weekend with incremental backups every weeknight.These are then aux copied off to tape.Because of the very low change rate in reality probably 95% of what’s written to tape each week is exactly the same as the week before.The speed of the aux copy is becoming an issue as I don’t seem able to aux to two drives but drop down to a single drive when other backup jobs need the second drive.So my question is whether I’m stuck in the past in a traditional GFS mindset and I should look at the “Automatic Synthetic Full” backup option?All backups are kept on disk and tape for a minimum 30 days and extended retention keeps monthly full backups for a year.We have a stupidly quick media agent with an NVMe dual partitioned DDB so in theory we’re doing best practise so the synthetic fulls only take an hour or two each but the 5 days auxing the lot to tape is painful and i

We have a disk storage and we have a limited space on that disk and don’t have any plans to extend the storage on the disk. In weekends the storage utilization is high and could you please help me to process to reclaim the storage on the concern disk.

Hi! Trying to understand selective copy connected with database agents (mysql and psql). My config is : two storage polices (one from data and one for log)  full aux copy from primary to secondary DC selective copy to tape (for both log and data SP; first full backup each week with 4 week retention, first full backup each month with 6 months extended retention) What we see is not consistent across DBA agents and logs are not always copied as we would expect together with data ; postgres (FS based) write data and logs to separate storage polices, selective copy works as expected psql (with intelisnap) not execute log backup during full, logs are not copied to offsite copy, recovery need to based only on logs present on filesystem during snapshot mysql (by xtrybackup) is doing log backup to same SP during full, so logs are not in storage policy in what we expect to be and are not copied to offsite copy, during recovery only data is restoredDo we have any guidance on above? Or configurati

Hello,On our VMware infrastructure, a Windows 2012 file server contains five datastores (LUNs) and we want to distribute these LUNs to new file servers. From the vCenter, we planned to detach the LUNs and reattach them to the new server. However, on each of these LUNs, several TB of files were archived and stubs replaced the files. What should we do to ensure that nothing is lost during these manipulations?Thank you for your help.

I have 3 locations worldwide with different companies. I want to back up these locations with a secondary copy of the backups at the main location in a storage pool.  Is this possible with an auxiliary copy?or what is the best way to do this? 

Hi i have a question about DDB assignment.In my environment i have 2 file DDB for same disklibraryI think it was created by mistake when creating a new storage policy. So my question is can i remove (seal) the 1 DDB that i dont need? and will the storage policy using that DDB switch over to the other DDB? they are both under the same Global DDB.the reason this is a problem is that this DDB is located on the comserve nodes and they dont handle this load well. i could of course move the DDB but i would prefer to remove them instead.

Hi All,is there some possibility to perform the action of “pick data for verification” for a job of a Storage Policy with a command line? Maybe I have to do it on a lot of jobs and I’m looking for a script.Any help is appreciatedThanks

i have a DR site with a vmware vsphere cluster. I use commvault replication to this DR site. I would like to monitor how much date is transferred after compression and dedupe.Where could i found this information ? I have a LAN to LAN 10Mb/s link and i want to understand what is transferred over the WAN.Regards

Hello, What is best practices Software Compression setting to reduces storage space? Automaticly its on SP but when are you suing compressie on Client and Media Agent? Or maybe turn compression off?

currently I backup S3 bucket with managed key, plan change the key to CMK, will commvault support S3 bucket backup with CMK?

1, Commvault support Data domain from 11.32,  it only support DD hardware, or also support DDVE(Data domain virtual edition)? 2, I write my primary copy to cloud library(Azure storage account), any chance to run AUX. copy to Data domain, want to see my secondary copy on DD

Hello,customer wants to use a storage system with native deduplication option for file services. Are there any known issues in backing up and restoring the system with NAS/NDMP? Or is it useful not to use the storage deduplication?Thanks and regards,Thomas

We would like to understand more upon how the data is uploaded :Multi-Part? Part size? Chunking? Average part count? Average part size?

Hi, We have a situation with filled up DDB drives in a 3-MA grid setup. XL-sized MAs but with 1.3TB DDB NVMe (should be 2TB according to sizing recommendations). The reson for the large DDBs seems to be due to a customer backing up a lot of small files that deduplicate quite well, we see between 25-30 billion secondary records and 2.7 billion unique records on the File DDB partitions. 94-95% dedup and performance is exceptional good with this amount of data in the Storage Pool, 60-70µs and ca 660TB. We also see pruning working as lowering retention also reduces the secondary records and give us GB back on the DDB volumes. We have two options in this hardware…We can expand the DDB volumes by concatenating (in Windows) another 1.3TB NVMe to the existing one, giving us 2.6TB on the DDB drives. Add one, two or three additional DDB-partitions (one per server) to the DDB, placing them on the extra, available 1.3TB NVMe (MAs in extended mode with 6 DDB partitions, each on a dedicated drive) A

Hello,We are using a shared commcell, but we need to send tape backup to a customer.We was thinking about restore a commserv DR backup on an other server, and then keep it on customer side in case of restore.But we don't know if we need a licence on the restored commserv and if we can run on both in same time.Or maybe you could know an other solution to ensure that tape backup can be used by customer without issue.

Hi, As I’m not really finding an answer in the documentation, I’m checking here if somebody knows.I would like to know if there exists a way to add exceptions to Selective Copies.Let’s say I wanted to copy all Monthly Backups to tape, except for example the first month of the year. I don’t see an “automated” way to do this. I could select the “Do not Automatically select jobs” and do it manually, but that kind of defeats the purpose. Is there any way to do this? Thanks

Hi Team, We have one requirement. We are planning to remove Old MA and Library and we are planning to configure New MA and  New Library.Is it possible to move all client data from Old configuration to new configuration?

Hi Support Team, We are running backups daily, weekly and monthly to disk library. Now we are going to take secondary copy in to tape with three tape drives.  So, The requirement is Weekly Full Backup for Database Servers and Monthly Backup for File server and application servers. Weekly backups need to take tape like First Week backup for week-1 Tape, Second Week backup for week-2 tape, Third week backup for week-3 tape, Fourth week backup for week-4 tape and Fifth week backup for week-5 Tape.Monthly backups need to take dedicated Monthly tape. Also Two tape drive for dedicated to backup and another one for restore purpose. Could you please help us how to achieve and its possible. Thanks Regards,ManiD