commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 891 Topics
  • 4,088 Replies

891 Topics

G
Byte
GrzegorzByte
asked in Storage and Deduplication

Big Data Apps on no longer needed copy

Hello all!In our environment, we have created a temporary copies within our few storage policies - (call them copy 6 and 7). Those were tape copies. We have keep some backup there for 2 months, but it is no longed needed. We do not need those copies within those storage policies any more. But for now, even if they are no longer any backup retained on this 6-7 copy, we do have a lot of “Big Data Apps” jobs retained on those copies.We would like to delete those copies because it interferes with our “workflow” which picks jobs for copies and it's keeping to mark them to copy for 6-7 copy. (even if copy is disabled) So my question is - what exactly this Big Data Apps is? It is some kind of Index, am I correct? If those “Big Data Apps” are stored on copies 6-7 are there any dependencies for other copies, other jobs keep in other/same storage policies?Can we just delete copy 6-7 from our storage policies even if they are still those Big Data Apps stored on it, and it won't affect the rest of

12
G
Byte
2 months ago
L
Byte
lborekByte
asked in Storage and Deduplication

selective copy for psql/psql

Hi! Trying to understand selective copy connected with database agents (mysql and psql). My config is : two storage polices (one from data and one for log)  full aux copy from primary to secondary DC selective copy to tape (for both log and data SP; first full backup each week with 4 week retention, first full backup each month with 6 months extended retention) What we see is not consistent across DBA agents and logs are not always copied as we would expect together with data ; postgres (FS based) write data and logs to separate storage polices, selective copy works as expected psql (with intelisnap) not execute log backup during full, logs are not copied to offsite copy, recovery need to based only on logs present on filesystem during snapshot mysql (by xtrybackup) is doing log backup to same SP during full, so logs are not in storage policy in what we expect to be and are not copied to offsite copy, during recovery only data is restoredDo we have any guidance on above? Or configurati

2
L
Byte
3 months ago
Y
Bit
Yves MorinBit
asked in Storage and Deduplication

Reattach datastore to a new server that contains stubs.

Hello,On our VMware infrastructure, a Windows 2012 file server contains five datastores (LUNs) and we want to distribute these LUNs to new file servers. From the vCenter, we planned to detach the LUNs and reattach them to the new server. However, on each of these LUNs, several TB of files were archived and stubs replaced the files. What should we do to ensure that nothing is lost during these manipulations?Thank you for your help.

2
Y
Bit
3 months ago
Y
Bit
YvonneSBit
asked in Storage and Deduplication

3 primary copy pool in 1 secondary copy pool - is this possible??

I have 3 locations worldwide with different companies. I want to back up these locations with a secondary copy of the backups at the main location in a storage pool.  Is this possible with an auxiliary copy?or what is the best way to do this? 

1
M
Byte
3 months ago
J
Byte
J_RByte
asked in Storage and Deduplication

Can i change which DDB a Storage Policu should use?

Hi i have a question about DDB assignment.In my environment i have 2 file DDB for same disklibraryI think it was created by mistake when creating a new storage policy. So my question is can i remove (seal) the 1 DDB that i dont need? and will the storage policy using that DDB switch over to the other DDB? they are both under the same Global DDB.the reason this is a problem is that this DDB is located on the comserve nodes and they dont handle this load well. i could of course move the DDB but i would prefer to remove them instead.

4
J
Byte
3 months ago
Y
Byte
YNAPByte
asked in Storage and Deduplication

Pick for data verification job

Hi All,is there some possibility to perform the action of “pick data for verification” for a job of a Storage Policy with a command line? Maybe I have to do it on a lot of jobs and I’m looking for a script.Any help is appreciatedThanks

3
A
Vaulter
3 months ago
K
Byte
KevinDodd
asked in Storage and Deduplication

Cloud Library (S3) - Best Practice

Evening folks,I am after some advise/best practice info if possible (happy to be linked to any documentation!)What is best practice when using multiple cloud libraries (AWS S3) - is it better to an individual cloud library per S3 bucket (which also means multiple DDBs!!) or is it best to have a single cloud library with multiple mount paths to each S3 bucket within said library (which I believe will leave you with a single DDB?)Many thanks in advance!

3
Onno van den Berg
Commvault Certified Expert
3 months ago
P
Patrick Bidondo
asked in Storage and Deduplication

transferred data for replcation job

i have a DR site with a vmware vsphere cluster. I use commvault replication to this DR site. I would like to monitor how much date is transferred after compression and dedupe.Where could i found this information ? I have a LAN to LAN 10Mb/s link and i want to understand what is transferred over the WAN.Regards

3
A
Vaulter
3 months ago
E
Byte
Egor SkepkoByte
asked in Storage and Deduplication

Best practices Software Compression setting to reduce storage space

Hello, What is best practices Software Compression setting to reduces storage space? Automaticly its on SP but when are you suing compressie on Client and Media Agent? Or maybe turn compression off?

4
E
Byte
3 months ago
X
Byte
xiwenByte
asked in Storage and Deduplication

CMK change on S3 bucket

currently I backup S3 bucket with managed key, plan change the key to CMK, will commvault support S3 bucket backup with CMK?

2
X
Byte
3 months ago
X
Byte
xiwenByte
asked in Storage and Deduplication

AUX. to DDVE

1, Commvault support Data domain from 11.32,  it only support DD hardware, or also support DDVE(Data domain virtual edition)? 2, I write my primary copy to cloud library(Azure storage account), any chance to run AUX. copy to Data domain, want to see my secondary copy on DD

1
A
Vaulter
3 months ago
T
Byte
ThomasGByte
asked in Storage and Deduplication

Deduplication on source file

Hello,customer wants to use a storage system with native deduplication option for file services. Are there any known issues in backing up and restoring the system with NAS/NDMP? Or is it useful not to use the storage deduplication?Thanks and regards,Thomas

3
A
Vaulter
3 months ago
L
Byte
LahariByte
asked in Storage and Deduplication

How does the data backup to cloud environment happens does it use multipart upload or chunking

We would like to understand more upon how the data is uploaded :Multi-Part? Part size? Chunking? Average part count? Average part size?

1
Damian Andre
Vaulter
3 months ago
P
Commvault Certified Expert
PatrikCommvault Certified Expert
asked in Storage and Deduplication

Full DDB disk - Expand drive or Add DDB-partitions?

Hi, We have a situation with filled up DDB drives in a 3-MA grid setup. XL-sized MAs but with 1.3TB DDB NVMe (should be 2TB according to sizing recommendations). The reson for the large DDBs seems to be due to a customer backing up a lot of small files that deduplicate quite well, we see between 25-30 billion secondary records and 2.7 billion unique records on the File DDB partitions. 94-95% dedup and performance is exceptional good with this amount of data in the Storage Pool, 60-70µs and ca 660TB. We also see pruning working as lowering retention also reduces the secondary records and give us GB back on the DDB volumes. We have two options in this hardware…We can expand the DDB volumes by concatenating (in Windows) another 1.3TB NVMe to the existing one, giving us 2.6TB on the DDB drives. Add one, two or three additional DDB-partitions (one per server) to the DDB, placing them on the extra, available 1.3TB NVMe (MAs in extended mode with 6 DDB partitions, each on a dedicated drive) A

2
P
Commvault Certified Expert
3 months ago
S
Vaulter
Sunil RVaulter
asked in Storage and Deduplication

Use tape backup on a restore commserv from DR backup

Hello,We are using a shared commcell, but we need to send tape backup to a customer.We was thinking about restore a commserv DR backup on an other server, and then keep it on customer side in case of restore.But we don't know if we need a licence on the restored commserv and if we can run on both in same time.Or maybe you could know an other solution to ensure that tape backup can be used by customer without issue.

1
Chris Hollis
Vaulter
3 months ago
J
Byte
JeremyByte
asked in Storage and Deduplication

Selective Copy Exceptions

Hi, As I’m not really finding an answer in the documentation, I’m checking here if somebody knows.I would like to know if there exists a way to add exceptions to Selective Copies.Let’s say I wanted to copy all Monthly Backups to tape, except for example the first month of the year. I don’t see an “automated” way to do this. I could select the “Do not Automatically select jobs” and do it manually, but that kind of defeats the purpose. Is there any way to do this? Thanks

2
J
Byte
3 months ago
T
Bit
Tyson Storage TeamBit
asked in Storage and Deduplication

How to Move Client from old MA and library to New MA and Library

Hi Team, We have one requirement. We are planning to remove Old MA and Library and we are planning to configure New MA and  New Library.Is it possible to move all client data from Old configuration to new configuration?

3
A
Vaulter
3 months ago
M
Byte
ManiDByte
asked in Storage and Deduplication

Secondary copy to Tape

Hi Support Team, We are running backups daily, weekly and monthly to disk library. Now we are going to take secondary copy in to tape with three tape drives.  So, The requirement is Weekly Full Backup for Database Servers and Monthly Backup for File server and application servers. Weekly backups need to take tape like First Week backup for week-1 Tape, Second Week backup for week-2 tape, Third week backup for week-3 tape, Fourth week backup for week-4 tape and Fifth week backup for week-5 Tape.Monthly backups need to take dedicated Monthly tape. Also Two tape drive for dedicated to backup and another one for restore purpose. Could you please help us how to achieve and its possible. Thanks Regards,ManiD  

11
J
Vaulter
3 months ago
T
Bit
Tyson Storage TeamBit
asked in Storage and Deduplication

Disk Cache

Hi Team,We have enable dish cache for sql backup and log RPO is given 1 hour  and Commit is 4 hours. We can see the committed job but we can’t see log RPO jobs. I would like to know to check sql transaction log backups are backing up to disk cache.  

3
A
Vaulter
3 months ago
C
Commvault Engineer
asked in Storage and Deduplication

Gridstor implementation for SAN Disk Library

Hi Guys, We got a new SAN Storage, which is fully dedicated for backup. Since it's an FC Storage, we’ll present the LUNs to MediaAgents agents through SAN Switches. Our concern is about High Availability for MediaAgents regarding SAN. Is it possible to implement Gridstor through SAN ? We’ve already done that in the past with Object storage through mount path sharing. We now are wondering if this is feasible also through FC. Since SAN configuration implies Zoning configuration through SAN switches and LUNs are mounted locally into each MediaAgent. Overall, that's our need, being able to back up and restore through the SAN storage with 2 different MediaAgent and having some sort of HA in case of a failure of any MediaAgent. Any recommendations regarding this configuration would be appreciated. Kind regards.

2
C
3 months ago
X
Byte
xiwenByte
asked in Storage and Deduplication

Huge DB2 restore setting

DB2 backup size is 25TB, separate on 16 disks. I saw below article.Q1, any suggestion on maximum number of concurrent parallelism queries for my 25TB DB2 restore?You can improve restore operation performance by using parallelism.If the database contains a large number of table spaces and indexes, you can perform a restore operation more quickly when you set a maximum number of concurrent parallelism queries. This takes advantage of the available input/output bandwidth and processor power of the DB2 server.https://documentation.commvault.com/2023e/expert/using_parallelism_for_enhancing_db2_restore_performance_01.htmlQ2, any suggestion on the number of buffers and buffer size for 25TB DB2 restore?ou can improve the performance of restore operations of backup images by increasing the number of buffers.https://documentation.commvault.com/v11/expert/setting_db2_buffers_for_restore_01.html

2
I
Vaulter
3 months ago
M
Byte
mach123Byte
asked in Storage and Deduplication

Total Data Size on Disk Historical Report

I would like to know if there is a report on the historical growth of the Total Data on Disk Size attribute in a dedupe engineAny information provided is appreciated.  The total disk size as we know is the size of the reference jobs and data written

1
Damian Andre
Vaulter
3 months ago
C
Bit
CamillaBit
asked in Storage and Deduplication

Deduplication failure

We are experiencing issues with our HyperScale cluster. The backups seem to be functioning, but we are receiving the following error message during backup:Error Code: [13:244]Description: [Deduplication failure] [Dedupe disk media] [Encountered a network error. Could not connect to the CVD on the target MediaAgent to launch the DDB engine.We also see this error message in the storage pool in Command CenterCreate Storage Pool Failed[Reason:There is an issue with HyperScale X storage configuration. The CV services are restarted on all nodes. Anyone know a solution? /Camilla

1
Damian Andre
Vaulter
3 months ago
R
Bit
RichardLBit
asked in Storage and Deduplication

Snap backup of oracle database fails

Hi,New to Commvault. We are trying to create a snap backup of an Oracle database to HPE3Par but this fails. ‘Strange(?)’ thing is that snap backups of the VM work fine. Do i need to configure something on the vmware/3par side? I can't figure out the error:2199 a36 12/27 11:45:07 ### 3PAR-getDevArrayInfo() - [/dev/sdb] Page 0x83 [lun wwn - ] [is 16Byte WWN - No][is 16Byte ID - No]2199 a36 12/27 11:45:07 215 [GETARRAY] Unable to get array details as given array name is empty. Please make sure to get the right array name from LUN or volume.2199 a36 12/27 11:45:07 ### isRemoteCallEnabled() -  Unable to set the login credentials for SMIS provider2199 a36 12/27 11:45:07 ### 3PAR-TP_prepareDevices[Local]() - Starting to prepare snapshot/clone [1 devices].[]2199 a36 12/27 11:45:07 ### 3PAR-TP_prepareDevices[Local]() - 3PAR-TP_prepareDevices[Local]: Attempting to get array info from host device path /dev/sdb2199 a36 12/27 11:45:07 ### 3PAR-getDevArrayInfo() - [/dev/sdb] Page 0x83 [lun wwn - ] [

5
L
Byte
3 months ago
C
Commvault Engineer
asked in Storage and Deduplication

Secondary copies ports requirement

Hi Commvaulters, Can someone advise me with the needed network ports to be open in order to perform an aux copy between 2 MAs.We installed a new MA on a remote site, and we want to open only the needed ports between it and the CS (For communication) and between it and the MAs located on the main site.Please to note that we are running CV version 11.24, I know that the main ports are 8400 for communication and 8403 for data transfer.Is there any other once that needs to be opened ? We want to minimize port opening in order to fully secure the remote MA. Regards.

5
Nikos.Kyrm
Byte
3 months ago

Badge winners

  • Contributor 1
    Royhas earned the badge Contributor 1
  • Topic Starter 1
    DCJhas earned the badge Topic Starter 1
  • Contributor 1
    slow backup with Catalys HPEhas earned the badge Contributor 1
  • Contributor 10
    mfoxhas earned the badge Contributor 10
  • Contributor 25
    TD89has earned the badge Contributor 25
Show all badges
Terms & ConditionsCookie settings