Skip to main content

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 991 Topics
  • 4,389 Replies
991 Topics
A
Byte
Alex HayByte
asked in Storage and Deduplication
Microsoft AG backups across multiple sties

Hi Everyone! I am looking to see if there is anyone else that is backing up Microsoft AG clusters with nodes that are hosted in different geographical DCs? We have the MSQL AG client configured at the moment to backup to “PLAN - DC1” but when the DBA’s failover the cluster to another node, the backups are being transfered across the WAN from “DC2” to “DC1” Should we not configure the backups using the AG for these DBs and confgure them on the clusters nodes instead and configure the storage polices to point to the Commvault Plan for that site or is there another option? Thanks for your time! 

2
A
Byte
7 months ago
T
Byte
thomas.SByte
asked in Storage and Deduplication
Remove mount paths without deleting data

Hello everyone,Two months ago we put two new media agents into operation with a new backup storage. The two old media agents were shut down. Since you don't want to restart the old media agents due to the old operating system, the question would now be whether it is possible to remove the mount paths to the old media agents (LUN's) from Commvault? The data has a retention period of 30 days and this should also have expired. If we could open these paths like that, that would be great.RegardsThomas

1
S
Vaulter
7 months ago
A
Byte
AjalByte
asked in Storage and Deduplication
Hyperscale x handling jobs while node is down

Team , how the hypersalce x , media agent handle the jobs when a failure of one job occurs , i have performed a testing where a job was running with media agent 2 of hyperscal node 2 and i shutdown the same node , 1> the running job is on running mode - and no progress  2> i started new job and it completed successfully started the node 2 and still no progress on that job and it failed .why was it not assigned to any other media agents - and why the job is handled only by one media agent - i can see restore jobs used all 3 media agent but backup is by one , do we have control on this . 3> after the nodes came up , there was a restore job happned from node 2 to node 2 - may i know what basically getting restored ?

1
Jon Vengust
Vaulter
7 months ago
P
Byte
Paul HutchingsByte
asked in Storage and Deduplication
Automatic Synthetic Full v normal Backup Schedule?

I’m backing up a few NAS subclients that are between 10-30TB each.Currently they are scheduled to do a synthetic full backup every weekend with incremental backups every weeknight.These are then aux copied off to tape.Because of the very low change rate in reality probably 95% of what’s written to tape each week is exactly the same as the week before.The speed of the aux copy is becoming an issue as I don’t seem able to aux to two drives but drop down to a single drive when other backup jobs need the second drive.So my question is whether I’m stuck in the past in a traditional GFS mindset and I should look at the “Automatic Synthetic Full” backup option?All backups are kept on disk and tape for a minimum 30 days and extended retention keeps monthly full backups for a year.We have a stupidly quick media agent with an NVMe dual partitioned DDB so in theory we’re doing best practise so the synthetic fulls only take an hour or two each but the 5 days auxing the lot to tape is painful and i

1
A
Vaulter
7 months ago
T
Bit
Tyson Storage TeamBit
asked in Storage and Deduplication
Space reclamation

We have a disk storage and we have a limited space on that disk and don’t have any plans to extend the storage on the disk. In weekends the storage utilization is high and could you please help me to process to reclaim the storage on the concern disk.

1
K
Vaulter
7 months ago
G
Byte
GrzegorzByte
asked in Storage and Deduplication
Big Data Apps on no longer needed copy

Hello all!In our environment, we have created a temporary copies within our few storage policies - (call them copy 6 and 7). Those were tape copies. We have keep some backup there for 2 months, but it is no longed needed. We do not need those copies within those storage policies any more. But for now, even if they are no longer any backup retained on this 6-7 copy, we do have a lot of “Big Data Apps” jobs retained on those copies.We would like to delete those copies because it interferes with our “workflow” which picks jobs for copies and it's keeping to mark them to copy for 6-7 copy. (even if copy is disabled) So my question is - what exactly this Big Data Apps is? It is some kind of Index, am I correct? If those “Big Data Apps” are stored on copies 6-7 are there any dependencies for other copies, other jobs keep in other/same storage policies?Can we just delete copy 6-7 from our storage policies even if they are still those Big Data Apps stored on it, and it won't affect the rest of

12
G
Byte
7 months ago
L
Byte
lborekByte
asked in Storage and Deduplication
selective copy for psql/psql

Hi! Trying to understand selective copy connected with database agents (mysql and psql). My config is : two storage polices (one from data and one for log)  full aux copy from primary to secondary DC selective copy to tape (for both log and data SP; first full backup each week with 4 week retention, first full backup each month with 6 months extended retention) What we see is not consistent across DBA agents and logs are not always copied as we would expect together with data ; postgres (FS based) write data and logs to separate storage polices, selective copy works as expected psql (with intelisnap) not execute log backup during full, logs are not copied to offsite copy, recovery need to based only on logs present on filesystem during snapshot mysql (by xtrybackup) is doing log backup to same SP during full, so logs are not in storage policy in what we expect to be and are not copied to offsite copy, during recovery only data is restoredDo we have any guidance on above? Or configurati

2
L
Byte
7 months ago
Y
Bit
Yves MorinBit
asked in Storage and Deduplication
Reattach datastore to a new server that contains stubs.

Hello,On our VMware infrastructure, a Windows 2012 file server contains five datastores (LUNs) and we want to distribute these LUNs to new file servers. From the vCenter, we planned to detach the LUNs and reattach them to the new server. However, on each of these LUNs, several TB of files were archived and stubs replaced the files. What should we do to ensure that nothing is lost during these manipulations?Thank you for your help.

2
Y
Bit
7 months ago
Y
Bit
YvonneSBit
asked in Storage and Deduplication
3 primary copy pool in 1 secondary copy pool - is this possible??

I have 3 locations worldwide with different companies. I want to back up these locations with a secondary copy of the backups at the main location in a storage pool.  Is this possible with an auxiliary copy?or what is the best way to do this? 

1
M
Byte
7 months ago
J
Byte
J_RByte
asked in Storage and Deduplication
Can i change which DDB a Storage Policu should use?

Hi i have a question about DDB assignment.In my environment i have 2 file DDB for same disklibraryI think it was created by mistake when creating a new storage policy. So my question is can i remove (seal) the 1 DDB that i dont need? and will the storage policy using that DDB switch over to the other DDB? they are both under the same Global DDB.the reason this is a problem is that this DDB is located on the comserve nodes and they dont handle this load well. i could of course move the DDB but i would prefer to remove them instead.

4
J
Byte
7 months ago
Y
Byte
YNAPByte
asked in Storage and Deduplication
Pick for data verification job

Hi All,is there some possibility to perform the action of “pick data for verification” for a job of a Storage Policy with a command line? Maybe I have to do it on a lot of jobs and I’m looking for a script.Any help is appreciatedThanks

3
A
Vaulter
7 months ago
K
Byte
KevinDodd
asked in Storage and Deduplication
Cloud Library (S3) - Best Practice

Evening folks,I am after some advise/best practice info if possible (happy to be linked to any documentation!)What is best practice when using multiple cloud libraries (AWS S3) - is it better to an individual cloud library per S3 bucket (which also means multiple DDBs!!) or is it best to have a single cloud library with multiple mount paths to each S3 bucket within said library (which I believe will leave you with a single DDB?)Many thanks in advance!

3
Onno van den Berg
Commvault Certified Expert
7 months ago
P
Patrick Bidondo
asked in Storage and Deduplication
transferred data for replcation job

i have a DR site with a vmware vsphere cluster. I use commvault replication to this DR site. I would like to monitor how much date is transferred after compression and dedupe.Where could i found this information ? I have a LAN to LAN 10Mb/s link and i want to understand what is transferred over the WAN.Regards

3
A
Vaulter
7 months ago
E
Byte
Egor SkepkoByte
asked in Storage and Deduplication
Best practices Software Compression setting to reduce storage space

Hello, What is best practices Software Compression setting to reduces storage space? Automaticly its on SP but when are you suing compressie on Client and Media Agent? Or maybe turn compression off?

4
E
Byte
7 months ago
X
Byte
xiwenByte
asked in Storage and Deduplication
CMK change on S3 bucket

currently I backup S3 bucket with managed key, plan change the key to CMK, will commvault support S3 bucket backup with CMK?

2
X
Byte
7 months ago
X
Byte
xiwenByte
asked in Storage and Deduplication
AUX. to DDVE

1, Commvault support Data domain from 11.32,  it only support DD hardware, or also support DDVE(Data domain virtual edition)? 2, I write my primary copy to cloud library(Azure storage account), any chance to run AUX. copy to Data domain, want to see my secondary copy on DD

1
A
Vaulter
7 months ago
T
Byte
ThomasGByte
asked in Storage and Deduplication
Deduplication on source file

Hello,customer wants to use a storage system with native deduplication option for file services. Are there any known issues in backing up and restoring the system with NAS/NDMP? Or is it useful not to use the storage deduplication?Thanks and regards,Thomas

3
A
Vaulter
7 months ago
L
Byte
LahariByte
asked in Storage and Deduplication
How does the data backup to cloud environment happens does it use multipart upload or chunking

We would like to understand more upon how the data is uploaded :Multi-Part? Part size? Chunking? Average part count? Average part size?

1
Damian Andre
Vaulter
7 months ago
P
Commvault Certified Expert
PatrikCommvault Certified Expert
asked in Storage and Deduplication
Full DDB disk - Expand drive or Add DDB-partitions?

Hi, We have a situation with filled up DDB drives in a 3-MA grid setup. XL-sized MAs but with 1.3TB DDB NVMe (should be 2TB according to sizing recommendations). The reson for the large DDBs seems to be due to a customer backing up a lot of small files that deduplicate quite well, we see between 25-30 billion secondary records and 2.7 billion unique records on the File DDB partitions. 94-95% dedup and performance is exceptional good with this amount of data in the Storage Pool, 60-70µs and ca 660TB. We also see pruning working as lowering retention also reduces the secondary records and give us GB back on the DDB volumes. We have two options in this hardware…We can expand the DDB volumes by concatenating (in Windows) another 1.3TB NVMe to the existing one, giving us 2.6TB on the DDB drives. Add one, two or three additional DDB-partitions (one per server) to the DDB, placing them on the extra, available 1.3TB NVMe (MAs in extended mode with 6 DDB partitions, each on a dedicated drive) A

2
P
Commvault Certified Expert
7 months ago
S
Vaulter
Sunil RVaulter
asked in Storage and Deduplication
Use tape backup on a restore commserv from DR backup

Hello,We are using a shared commcell, but we need to send tape backup to a customer.We was thinking about restore a commserv DR backup on an other server, and then keep it on customer side in case of restore.But we don't know if we need a licence on the restored commserv and if we can run on both in same time.Or maybe you could know an other solution to ensure that tape backup can be used by customer without issue.

1
Chris Hollis
Vaulter
7 months ago
J
Byte
JeremyByte
asked in Storage and Deduplication
Selective Copy Exceptions

Hi, As I’m not really finding an answer in the documentation, I’m checking here if somebody knows.I would like to know if there exists a way to add exceptions to Selective Copies.Let’s say I wanted to copy all Monthly Backups to tape, except for example the first month of the year. I don’t see an “automated” way to do this. I could select the “Do not Automatically select jobs” and do it manually, but that kind of defeats the purpose. Is there any way to do this? Thanks

2
J
Byte
7 months ago
T
Bit
Tyson Storage TeamBit
asked in Storage and Deduplication
How to Move Client from old MA and library to New MA and Library

Hi Team, We have one requirement. We are planning to remove Old MA and Library and we are planning to configure New MA and  New Library.Is it possible to move all client data from Old configuration to new configuration?

3
A
Vaulter
7 months ago
M
Byte
ManiDByte
asked in Storage and Deduplication
Secondary copy to Tape

Hi Support Team, We are running backups daily, weekly and monthly to disk library. Now we are going to take secondary copy in to tape with three tape drives.  So, The requirement is Weekly Full Backup for Database Servers and Monthly Backup for File server and application servers. Weekly backups need to take tape like First Week backup for week-1 Tape, Second Week backup for week-2 tape, Third week backup for week-3 tape, Fourth week backup for week-4 tape and Fifth week backup for week-5 Tape.Monthly backups need to take dedicated Monthly tape. Also Two tape drive for dedicated to backup and another one for restore purpose. Could you please help us how to achieve and its possible. Thanks Regards,ManiD  

11
J
Vaulter
8 months ago
T
Bit
Tyson Storage TeamBit
asked in Storage and Deduplication
Disk Cache

Hi Team,We have enable dish cache for sql backup and log RPO is given 1 hour  and Commit is 4 hours. We can see the committed job but we can’t see log RPO jobs. I would like to know to check sql transaction log backups are backing up to disk cache.  

3
A
Vaulter
8 months ago
C
Commvault Engineer
asked in Storage and Deduplication
Gridstor implementation for SAN Disk Library

Hi Guys, We got a new SAN Storage, which is fully dedicated for backup. Since it's an FC Storage, we’ll present the LUNs to MediaAgents agents through SAN Switches. Our concern is about High Availability for MediaAgents regarding SAN. Is it possible to implement Gridstor through SAN ? We’ve already done that in the past with Object storage through mount path sharing. We now are wondering if this is feasible also through FC. Since SAN configuration implies Zoning configuration through SAN switches and LUNs are mounted locally into each MediaAgent. Overall, that's our need, being able to back up and restore through the SAN storage with 2 different MediaAgent and having some sort of HA in case of a failure of any MediaAgent. Any recommendations regarding this configuration would be appreciated. Kind regards.

2
C
8 months ago

Badge winners

Show all badges
Terms & ConditionsCookie settings