Skip to main content
commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 1,132 Topics
  • 4,844 Replies
1132 Topics
A
Aglidic
asked in Storage and Deduplication
s3 worm and infinite retention

Hello is it possible to enable worm on a s3 bucket with infinite retention? If we want to worm only for 30 days with infinite retention what is the best way?Just create a copy with infinite retention and worm enabled on  it Create a copy of 30 days with worm and add extended retentionthanks in advance

663
N
Vaulter
S
Byte
slow backup with Catalys HPEByte
asked in Storage and Deduplication
slow backup and restore with Catalys HPE

Hello Commvault, we have been working with Commvault and Catalys HPE for 2 months since before we used Data Protector from Microfocus and Veeam. At first the performance was incredible but as the backups continued we noticed that the backup and restore speed dropped noticeably, reaching the point of restoring VMware VMs over SAN at a speed of 50GB/hour which is extremely slow. I reviewed the documentation provided by Commvault and also by HPE and the only strange thing I noticed is that the number of objects we had in the catalys stores when we used Data Protect or Veeam were from 2000 to 5000 and now with Commvault their stores store more of 40,000 objects and this does not affect the performance. I see that 30% are index objects that run at 1 pm. Please have any suggestions and if you have had a similar problem before.

701
Onno van den Berg
Commvault Certified Expert
G
Bit
Galcomm2268Bit
asked in Storage and Deduplication
Cloudian S3 WORM pruning issue

Hi All, There are some posts around this topic but none I could see directly apply.Running 11.28 we have plan that backs up a large system - once a week - that generally takes days to run in order to get the primary copy to disk.Once this is completed one of the AuxCopy jobs is to send this to a Cloudian destination as non-deduplicated data into buckets that are utilising object-lock WORM type functionality.The retention is the same for the Primary and Cloudian copies (14 days).What seems to happen is that when the retention period of the Primary job has been fulfilled I can see that the media agent is attempting to clean up the objects from Primary disk-based and Cloudian copies however as the Primary job took so long to run (lets say over 2 days) then the Cloudian objects won’t be deleted by the Commvault process as they are retention locked until potentially the same time the next day. Commvault makes no attempt to do an extra tidy up the next day and just errors in the log files sa

811
Arunkumar P
Vaulter
J
Byte
Jass GillByte
asked in Storage and Deduplication
Deduplication at the Storage Policy vs Deduplication at Subclient

Hi Team,I have a query on how does Deduplication at the Storage Policy compare with setting Deduplication at Subclient level ?I have to set a mediaagent partition while enabling Deduplication while creating a storage policy.When choosing the same storage policy at the subclient level, I could see Enable deduplication Tab in properties to be selected by default as “on client”. Shouldn’t it be “on media agent”?How does it differentiate from each other? 

451
L
Vaulter
M
Bit
Marty at ARABit
asked in Storage and Deduplication
Data Domain VTL LTO-8 versus LTO-5

Is there any performance advantage to an LTO-8 VTL versus an LTO-5 VTL on Data Domain? 

3724
L
Byte
A
Bit
aleswalkerBit
asked in Storage and Deduplication
Intellisnap for encrypted volumes on nimble

Does intellisnap work with encrypted volumes on a nimble SAN device? If so, how?

271
Rajiv
Vaulter
F
Byte
Farmer92Byte
posted in Storage and Deduplication
What type of storage array do you use?

We currently use IBM V5000 arrays for our Commvault backup target to land our deduped backups.  We are starting to review other options to see what other fast, cost effective options are out there.  I do prefer to use Fiber Channel connections, but open to options.   Since Commvault is really the brain in our scenario, the storage array does not really need any features, just good speed. What Vendor Storage arrays do you use?  Are you happy with it?  

462231
S
Byte
D
Byte
dmoesByte
asked in Storage and Deduplication
Bad Tape, how to recopy jobs from synchronous copy?

Good morning,I have the following scenario:2 tape libraries A (primary) and B (secondary) 1 tape on library A went bad, we’re marking it as bad and removing it from the library How do I trigger Commvault to copy those missing jobs from the secondary library B, to a new tape on A? Best regards,Daniel

1042
D
Byte
P
Byte
PatricGByte
asked in Storage and Deduplication
Move data from one mount path to anoter existing mount path

Hi,We’re running Commvault 11.24.116We need to move all data from one existing mount path to another existing mount path. Both with data in them.We’ve found this can be done in version 11.32 https://documentation.commvault.com/v11/essential/157074_moving_backup_location_to_new_location.htmlCan it be done in 11.24.116?If so, where do we find the function?If not, which version must we upgrade to? Any thing to consider prior to upgrading?

1441
Arunkumar P
Vaulter
T
Byte
TommyByte
asked in Storage and Deduplication
Tape Library Drive Troubleshooting

Hi,I have so far replaced three drives in our DELL/EMC ML3 Tape Lib and still experiencing the same problem. Currently, there’s one valid drive that is working fine - when it comes to the other one, it is mounted and immediately unmounted after a couple of seconds - one try after another in an endless loop.According to DELL, there’s nothing in the library log that would indicate the root of the problem (the log is clean) - they send me another drive and then the case is closed until the issue rises again.I tried swapping the drives in slots but the problem is following the same drive no matter the slot. At this point, I’d like to exclude software-related cause of the issue.Currently, the number of errors associated with mounting and unmounting the drive is way over its threshold; that might be the reason why CV is ignoring the drive completely - how can I reset the counter? Is there a particular procedure I should follow when replacing a drive? I can see there’s an option ‘Mark drive a

8952
T
Byte
G
Byte
G2TByte
asked in Storage and Deduplication
Netapp Intellisnap can't find the right vserver/SVM

After adding the array into array management and triggering a intellisnap backup.  Commvault is failing to create snapshot due to not finding the specified vserver.Error Code: [32:392] Description: Snap creation failed. : [Unable to create snapshot for FileServer:[192.168.1.65] Volume:[/vol/vmware_nfs] SnapName:[SP_2_1075_4_1693309853]. Return code:[15698][Specified vserver not found]] Source: cvcs, Process: vsbkpI’ve checked the vsbkp logs...ManageONTAP::SetVserverForTunneling() - Using SVM[vol] for tunnelingIt appears to be searching for vserver called “vol”, which i’m not sure where this comes from, there is only one vserver on this netapp and it called SVM0.Anyone run into this?  

4363
Emils
Vaulter
C
Bit
C523Bit
asked in Storage and Deduplication
Multiple Job Failures: "Mount path does not have enough space"

We’re using Commvault v11.28.48 and have several jobs that are in a “waiting” status and sitting at 10%-20%. The reason is simple: Mount path does not have enough space.I’m new to Commvault (our backup admin left recently and I wasn’t involved in the initial config or daily use) so I may be missing something obvious, but I thought aged data would be deleted automatically. I’ve run the “Data Retention Forecast and Compliance Report” and see the various estimated aging dates, the only thing that sticks out is the last line under the Disk Media Summary:Estimated Size to Free: 9406 GB (this box is green: “prunable job / recyclable media”) Delay reason for physical space cleanup: Archive file has been queued for pruning from the DDBOur Netapp library is 24.7TB with a size on disk of 24.46TB, reserve space set to 100GB, so an extra 9TB would be great. “Enable pruning of aged data” is checked on the library.Am I correct in thinking that 9406GB is data that should be automatically removed (pru

3012
C
Bit
PedroRocha
Byte
PedroRochaByte
asked in Storage and Deduplication
Under 30% compression/dedupe savings on Oracle Database

Hello,I'm not sure if compression/dedupe savings for this DB is fine. Actually, it seems poor… any ideas on what it could be? It's not a special DB…The online fulls are below 30% in savings. Incrementals and archive logs are above 50% in general..Regards,Pedro Rocha

3542
PedroRocha
Byte
M
Byte
mzatorByte
asked in Storage and Deduplication
Can a StorageGRID synchronous aux copy have a vault/replica as a source copy ?

Hello Team. I have a storage policy with a snap primary which snaps a netapp a700, and a vault/replica (not a mirror) that CV orchestrates the replication between the a700 and a fas8700. There is a primary copy as well but I don’t want to use this as the source copy for the storagegrid copy; i want to use the vault copy as the source copy for the storagegrid copy. I am creating a new storagegrid synchronous aux copy and the only options to pick for source copy are primary and storagegrid.  The only configuration I can figure out that works is to have a primary copy, which copies the snap primary copy, and to choose the primary copy as the source copy for the storagegrid copy. Is this expected behavior of the program ? Is there any way to configure the program so a storagegrid copy can have as its source copy the replica/vault copy ?Thank you!

542
M
Byte
N
Bit
Naveed NooriBit
asked in Storage and Deduplication
Client [XYZ] was unable to connect to the tape server

i have 3 Filer client and a media agent al three on the same swtich no firewall or router.all filer have subclient.one filer have 8 subclient and backup copy are not working on two of the subclient give below error.Error Code: [39:501]Description: Client [XYZ03] was unable to connect to the tape server [ABC123] on IP(s) [10.0.0.34] port [54719]. Please check the network connectivity.Source: ABC123, Process: NasBackup  

6345
N
Bit
PedroRocha
Byte
PedroRochaByte
asked in Storage and Deduplication
Data Written x Size on Media

I've seen several discussions regarding this topic. But I still don't get it. From the docs:Application Size: The size of the data that needs to be backed up from a client computer. Application size is not always identical to the size reported by file or database management tools.Data Written: New data written on media by each backup job.Size on Media: Size of deduplicated data written on the media. Consider the following real job:Job 1 (deduped disk lib is the destination): App Size: 33.4TBData Written: 24.93Size on Media: 7.30 1st question: what is the total size occupied by this job in the dedup disk lib?2nd question: is data written size, before dedup? Does it account for sw compression only? both?3rd question: is size on media just the size of unique blocks for the job (disregarding the baseline?)? regards,Pedro

11503
N
Vaulter
J
Byte
Jorge de SousaByte
asked in Storage and Deduplication
Tape mirroring

Hello, guys  I want to perform a secondary copy to tape, and be able to write the data to tow tapes at once, Same data must be written to tow different tapes that belong to two different pools (main pool and copy pool). The idea is to be able to have mirroed data on tapes that will be stored on different sites (customer policy). Data must be read once from primary store (source) and write at same time to diferent tapes.Customer has a library with 3 drives. Any idea?Regards.  

391
W
Vaulter
A
Byte
Ayman_SeyamByte
asked in Storage and Deduplication
Aux Copy failed

Hello All I have an error with the auxiliary copy Failed to Copy or verify Chunk [29532431] in media [CV_MAGNETIC], Storage Policy [New-MA2-FS-Backup-Retention-30D-30C-DDB], Copy [Primary], Host [TE-CV-MA-04.efinance.com.eg], Path [F:\YTIUSF_02.16.2021_12.37\CV_MAGNETIC\V_1046223], File Number [19], Backup Jobs []. Please check if all the disk library mount paths in the dedup storage policy copy are properly configured to read from the MediaAgent. Please check if all the disk library mount paths in the dedup storage policy copy are properly configured to read from the MediaAgent.

4791
Rajiv
Vaulter
M
Byte
MubaraqByte
asked in Storage and Deduplication
LTO8 and LTO6 cartridges not writing compressed data

Hello, TeamI have a customer who is writing directly to the tape library with any dedupe in place. Their challenge is, for their LTO8 and LTO6, the data writing to tape is making use of the native capacity instead of the compressed capacity.  They have the hardware compression enabled on each of their storage policy and they confirmed that before moving to commvault, their previous backup solution makes use of the compressed capacity when writing data. Is there any settings that can be done on commvault to ensure that the data is compressed so it can write full capacity of the data?Please, advise

2733
Onno van den Berg
Commvault Certified Expert
P
Bit
pingsoon
asked in Storage and Deduplication
Tape Library support

We are in the process of replacing a tape library with another. How many tape libraries can be configured on a mediaagent? We would like to have both attached at the same time for a transition period. The old one has LTO6 drives and the new one has LTO9 drives.

1693
Rajiv
Vaulter
PedroRocha
Byte
PedroRochaByte
asked in Storage and Deduplication
Best tape backup performance setting

Hi! Can you share what would be the best setting for tape backup performance?Considering 1 tape drive, which multiplexing setting to chose? What should be into account? Which other settings? Hardware compression? Regards,Pedro

5111
T
Vaulter
Michal128
Byte
Michal128Byte
asked in Storage and Deduplication
The best configuraion for Commvaul Immutable soluion in Azure

Hello, I am looking for the best solution for immutable copy of data built on Commvault in Azure. We have some configuration, but I would like to see what Commvault Community can propose. I am looking for few approaches: First copy of data is in local. Azure copy is working as DR site. Dedicated storage for Immutable in Azure per site (locally).  First copy of data is in local. Azure copy is working as DR site. Shared storage for Immutable in Azure per site (locally).In that both approach I would like to know about the cost and how to estimate decrease usage storage between dedicated - shared storage ? What will be the best storage configuration for that solution Deduplicated or Not-deduplicated?  Retention for Immutable is 14 days and 2 cycles. Storage usage for Immutable solution (Hot or Cool)?And I think the most important how to calculate cost for those solutions if I have only local backup solution in current state. Regards, Michal 

10325
M
Byte
ApK
Byte
ApKByte
asked in Storage and Deduplication
Dell ECS as a on prem S3 library

Hello fellow Vaulters. Are there any out there, that have experience with the Dell ECS storage system used for AuxCopy data as a S3 library on prem? Or do anyone have other on-prem S3 storage systems to recommend? I am in the process of evaluating a new S3 target storage system to host AuxCopy data. Thanks-Anders

2852
ApK
Byte
N
Byte
Nik14Byte
asked in Storage and Deduplication
Restore Performance

HI All, We have introduced Exagrid storage system as our backup storage solution, after the implementation we have noticed that the restore job is taking longer time than the expected one.We used Netapp as storage solution before Exagrid and also at the current setup with Exagrid we have enable the dedupe in both CommVault and Exagrid as well. How to identify where is the bottleneck. We have enabled the encryption and compression also in the Exagrid system. 

2253
T
Vaulter
C
Comtech
asked in Storage and Deduplication
Reference Arc HyperscaleX non-routable network

Hi Good day!Environment Details Planned initial:Commserve: dual home.  has network 10.x.x.x (agent backup) and 172.x.x.x for (VMware)Network Topology: Bonded LACPTotal Portal on HSX:  2 dual cards 25 GB ports. and 1 ILO/IPMI. Total available port per node is 5 including ILO.How many nodes: 3Plan to define only two network DP with CS and SP.DP/CS Registration: 172.x.x.x SP: 192.x.x.xPresent issue:Customer has non-routable network (10.x.x.x for agent backup DB/SQL) which cannot be routed with DP network mentioned above. This is a reference architecture and HSX can have only one routable network possible.Does below topology will work, looking for best suggestion:Topology: Bonded VLAN LACPDP bond1 has VLAN 100 and 200.and SP is 192.x.x.x no VLAN.bond1.100  VLAN on DP for CS Registration and default gateway will mention on this network. (DNS, NTP, SSH, VMware, replication aux copy) all should work using this network 172.x.x.x, it is a routable network. Note: DNS and VMware are on different

972
C
description of image

Badge winners

Show all badges
Terms & ConditionsCookie settings