Skip to main content
commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 1,128 Topics
  • 4,835 Replies
1128 Topics
clariion
Byte
clariionByte
asked in Storage and Deduplication
Data Written vs Size on disk (HyperScale)

​​Size on disk 55,74 TB, but data written is 24,77 TB​​​​​​ Hi folks, I’m trying to figure this out for few hours and I still didn’t find anything wrong in the Storage Policy, DiskLib, Media Agent properties... Backup jobs are also fine. I have counted 10800 jobs manually, just to be sure that the size is correct. 24,77 TB of data is written. BUT how it can be possible, that size on disk takes 55,74 TB? Did someone had the same situation?

20627
gjack
Vaulter
J
JamieK
asked in Storage and Deduplication
MA hardware refresh and library mount paths move

Hi all, I’m looking for some steer with regards to a disk library and mount paths move between MediaAgents. I may be over-thinking this but just looking for clarification. My client has a MediaAgent which to be decommissioned. The mount paths are volumes presented from the SAN which have also now been presented to the new MediaAgent. (Offline in Disk Mgmt on new MA awaiting action). Is this just as simple as following the Migrate Shared Disk Libraries option in Disk Libraries - Advanced to move the mount paths configuration to the new MediaAgent or are there any gotchas to be aware of? Normally, I’d just go through a mount path move process but can’t in this case. Thanks in advance.

10372
J
P
Commvault Certified Expert
PatrikCommvault Certified Expert
asked in Storage and Deduplication
Azure CloudLib Data Written does not match Dedupe statistics

I have a CloudLibrariy in Azure configured with three Cool Blobs. (three mount paths). Commvault reports Application Size 30TB and Data on Disk 50TB. In Azure the disks reports to be filled with 12TB. We have verified that WORM is disabled on the volumes in Azure. It seems that Commvault messes up the statistics for some reason. Have anyone seen this before on Azure CloudLibs?

984
P
Vaulter
A
Bit
AndroidBit
asked in Storage and Deduplication
Immutable Backup Images

We currently have a ‘dual-site’ scenario - each with 2 media agents attached to a Dell/EMC ME4084 disk library. Commvault is configured with a CommCell in each site - with failover enabled. Backup images are secured in each local site and then a secondary copy replicated to the alternate site. As I am sure is common - the questions are being raised around immutable backups in this CV environment I have seen documentation regarding immutability of cloud based backups, and discussions of WORM technology - but am unsure as to what applies to us here with our CommVault / disk library configuration. V11 SP20 Any input appreciated…..

29915
Damian Andre
Vaulter
Mike Struening
Vaulter
Mike StrueningVaulter
published in Storage and Deduplication
Disk Library mount path is offline due to nfs local_lock option set in mount options after upgrading to 11.20 or higher

Sharing this information Proactively. Issue: After upgrading to 11.20 or higher, NFS Mount Paths show offline in the Comcell GUI with the error "The mount path is marked offline due to nfs local_lock option set in mount options" CVMA.log on the Media Agent will show: 102415 1901f 01/13 19:06:53 ### WORKER [96/0/0 ] :CVMAMagneticWorker.cpp:6992: Marking mount path \[<mount path>] mounted on dir \[/commvault\_fas\-syd\] offline due to mount options [rw,relatime,vers=3,rsize=65536,wsize=65536,namlen=255,hard,nolock,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=170.65.110.200,mountvers=3,mountport=635,mountproto=tcp,local_lock=all,addr=<IP Address>] Cause: Checking the NFS mount options by running mount -v will reveal the path is not set to "local_lock=none": In earlier releases, it was advised to set local_lock=none as per https://documentation.commvault.com/commvault/v11/article?p=12567.htm. However, 11.20 has enforced the check. This was done due to issues where multiple Media Agents

24180
Mike Struening
Vaulter
N
NelsonBalbo
asked in Storage and Deduplication
Preferred restore location: Recovery data from azure cloud library

Hi There! I have Vmware vm backed up on-premises and auxiliary copy to Azure cloud library. When I try recovery a VMs that I supposed already transferred data to azure, I’m able to see bandwidth on firewall ports increase. So I think this scenario report a local data recovery to azure. I’d like to recovery data that already on azure cloud ( that was transfer by auxiliary copy). Someone could hep me with this steps? Thanks!

837
Mike Struening
Vaulter
R
Bit
Rob CarseyBit
asked in Storage and Deduplication
The real cost of AWS Glacier Deep Archive

I’ve been trying to figure out what my costs would be if I discontinued my off-site backup service (they physically come and take the tapes to an off-site location) and moved to S3 Glacier Deep Archive. We maintain on-premise backups as well, and in the past 20 years, we’ve never had to do a restore from off-site tapes -- so I’m definitely not concerned at all for that “100 year” event. The pricing of GDA is straightforward.. data lives (or, is billed) at a minimum of 6 months at $1/TB, but then there are also costs for PUTs and GETs (currently $0.05 per 1000). I’m very unsure how many requests I would consume per month when uploading data to the cloud. Trying to sell my boss on this.. but need an idea of how GETs/PUTs work in Commvault.

9734
YYZ
Byte
Mohit Chordia
Byte
Mohit ChordiaByte
asked in Storage and Deduplication
Multiple DDB Partitions or Single DDB Partition

Hi Team, I have a query . If a storage library has 8 mount paths , all configured from different media agents and shared with each other . Should we create DDB partition on all 8 media agents or only on 1 media agent ? What will help to increase performance of backup jobs , DDB is hosted only on 1 media agent or distributed across multiple media agents ? I am thinking that if DDB is hosted only on 1 MA backup job has to look only on 1 MA everytime for duplicate blocks and signatures , if the DDB is distributed wouldn't it make the backup job slower as the backup job will check for duplicate blocks and signatures across multiple configured DDB partitions . Let me know if my understanding is incorrect ?

14214
P
Vaulter
neuwiesener
Byte
neuwiesenerByte
asked in Storage and Deduplication
Stream allocation for Auxcopy

Could someone explain a flow of process for allocating readers for an auxcopy job? What does stream allocation take place in CVJobReplicatorODS exactly? I see that the number of readers is a function of num of CPU and RAM. By default, each CPU in a proxy can support 10 streams, and each stream requires 100 MB of memory. For e.g for VSA. E.g. My VSA backups were backed up with x number of readers and y number of writers to HPE StoreOnce Catalyst. How does the replication agent (auxcopy) decide and allocate readers for copying a list of N jobs to tape. Imagine there is a primary copy → Storeonce Catalyst secondary copy → tape (combine streams to 2 tape drives with multiplexing factor of 25). Number of readers varies from 12 to 38 in my environment. It appears that the number of readers used for the subclients plays a role in the number of readers that will be assigned in the auxcopy. My goal is to increase the readers for the auxcopy jobs for improving the performance. My auxcopy with 38

25136
Emils
Vaulter
M
Byte
ManikandnByte
asked in Storage and Deduplication
Deduplication requirement for Long term retention copy in Cloud

Hi All, I came across the CommVault documentation, mentioning that deduplication won’t make much impact when I am keep my long retention copy in cloud as tape replacement. Can anyone share more details about the your own experience or CommVault documentation regarding pros/cons of keep the long term copy in cloud with/without dedup. Thanks, Mani

4261
Damian Andre
Vaulter
W
Vaulter
Winston WVaulter
asked in Storage and Deduplication
Failing DDB Backup on a Linux-based MA due to extent exhaustion

Hi Team, My DDB Backup operations are failing with the following error message: Snap creation failed on volumes holding DDB paths. A quick review of the job logs points to insufficient space (0 extents). What could this mean? Regards Winston

30013
M
Byte
H
Bit
hiLanceBit
asked in Storage and Deduplication
Secondary Copy To Tape - Content Indexing

Hello, I am hoping someone can direct me in the right direction. I have a secondary copy to tape with an infinite retention period. The tapes will be stored offsite for safe keeping, currently tapes are onsite. I noticed during restores of older data I would need to insert the tape media containing the index to browse content to restore. Is there a way/method to keep this index on a local storage so the tape is not needed to browse the contents?

5512
J
Vaulter
M
Byte
ManikandnByte
asked in Storage and Deduplication
Regarding Dedup path for cloud Storage pool creation

Hi Team, I have a HyperScale with 6 node cluster in on-prem for primary copy. For Secondary copy I need to move the data to Cloud (Archive Storage). My doubt is, when I am creating the Cloud Storage Pool, Do I select the existing (On-Prem) de-dup path (/ws/ddb/P_1/Copy/_21/Files/31) ( or) Do I need to create a dedicated the dedup path in the on-prem MA If I need to option 2, then what is the recommended dedup partition value and reason behind that? And also share the your best practice for hybrid data protection, if any. Thanks, Manikandan

4626
M
Byte
T
Byte
tsmtmillerByte
asked in Storage and Deduplication
Perm to Tape

How can I just make backups to tape Perm, once a month? Can I set retention to 0 days?

52610
T
Byte
Matthew M. Magbee
Byte
Matthew M. MagbeeSocial Yottabyte
posted in Storage and Deduplication
Using server 2008r2 as a media agent after FR22 .3 update

This is a conversation post after my initial post about FR22 .3 This is more of a findings topic/conversation . I had three older wk8r2 media agents ( now replaced) that experienced widespread issues after going to FR22 .3 NOTE: none of these issues are/were recorded with Commvault as actual issues. The decision to replace/Migrate the OS was made at the 11th hour after working weeks on these issues. The basic application appears to work just fine with 2k8r2 fr22 .3 - Readiness, services running ,can run jobs etc. The issue we were running into was consistent across all three. And the only 2k8r2 media agents in our environment's I knew it was an issue. Seemed too coincidental not to be. After the Fr22 .3 update- within 4 hours our jobs started experiencing all or some of the following errors: Pipeline errors Media mount services device not ready library full. Even when attempting to select new snap mount hosts for jobs i was getting connection refused messages in the GXTail event logs.

1594
Matthew M. Magbee
Byte
D
Byte
drPhilByte
asked in Storage and Deduplication
Cloud storage https connection

Hi there, I have successfully added the cloud storage (S3 compatible). However, for the time being I am only able to set up connection based on http protocol. When I want to add a new cloud storage library using https there is the error message failed to do verification. To move further, I would like to utilize https protocol. I have self signed certificate from my netapp cloud storage S3 compatible - is it possible to allow using it since I dont have CA issued cert? Could Commvault be forced to use a self signed certificate? What I did try was to “Use this additional setting and set its value to 0 to skip the checking of the server's certificate claimed identity for the cloud libraries”, but it didnt help. Is it possible to check using of this settings? Do you have any suggestions for such situation? Thanks for you ideas.

18891
Damian Andre
Vaulter
J
Bit
Jay SonBit
asked in Storage and Deduplication
Aux copy error: may not be copied as we failed to get array controller Media Agent, make sure to set an array controller Media Agent for source Array, will be retried soon

In our CIFN environment, we would like to take snapvaults from our primary (snap copy), under our storage policy. WE are currently using Open Replication (not OCUM). Our initial (copy) snapshot works fine but aux copy (snapvaults) are not. Here is the message under the Progress tab when job initiates. Error: Data to Storage Policy [storage-xxx] Copy [snap_vault] may not be copied as we failed to get array controller Media Agent, make sure to set an array controller Media Agent for source Array, will be retried soon. Any ideas?

8172
dude
Byte
W
Vaulter
Winston WVaulter
asked in Storage and Deduplication
Failing DDB Backup on a Linux-based MA due to thin pool/volume threshold

Hi Team, My DDB Backup operations are failing with the following error message: Snap creation failed on volumes holding DDB paths. A quick review of the job logs points to some sort of free space threshold being reached. What could this mean? Regards Winston

18163
Matthew M. Magbee
Byte
W
Vaulter
Winston WVaulter
asked in Storage and Deduplication
Failing DDB Backup on a Windows-based MA due to shadow copy space allocation exhaustion

Hi Team, My DDB Backup operations are failing with the following error message: The snapshot of the Dedupe database from the previous attempt of this job is not available and a new one could not be created, as the job cannot continue under this condition, it will fail I can't really find anything in the Commvault logs outside of a few VSS-related errors. What could this mean? Regards Winston

31532
W
Vaulter
J
Vaulter
JordanVaulter
asked in Storage and Deduplication
How do I move the location of my Deduplication Database?

I’ve been encountering some hardware issue’s on my DDB disk and was wondering if there is a guide on how to move the location of the DDB?

33483
P
Commvault Certified Expert
Alireza B
Vaulter
Alireza BVaulter
asked in Storage and Deduplication
Backup Copy fails with error code 80:125

Just wondering why my Backup Copy fails with 80:125 Snap Job [...], Storage Policy [...] is skipped for backup copy as the backup level of job is non-full but the full job of the cycle is not yet copied to backup copy destination.

8101
V
Vaulter
J
Vaulter
JordanVaulter
asked in Storage and Deduplication
Why is my aux copy using so many tapes?

I noticed I am low on spare media and immediately saw that my Aux copy is using way more tapes than I expected. How do I find out why this is happening?

5231
D
Vaulter
J
Vaulter
JordanVaulter
asked in Storage and Deduplication
Where did the tapes go when I deconfigured my Tape Library?

One of my colleagues deconfigured a Tape Library and now we can’t find the associated tapes. Where did they go? We need to get the barcode numbers and potentially move them to the new library.

3551
D
Vaulter
W
Vaulter
Winston WVaulter
published in Storage and Deduplication
Changing iRMC (HyperScale Appliance HS1300 & HS3300) Password using IPMITool

The following procedure allows you to safely update Fujitsu Appliance iRMC Password which won't impact operations such as: RHEV-M Hardware failure alerting Important Note - for the HyperScale Appliance\, Commvault leverages the IPMI protocol to monitor the physical hardware by design\, and reports back to Command Center if there is a fault. IPMI - Intelligent Platform Management Interface is a set of computer interface specifications for an autonomous computer subsystem that provides management and monitoring capabilities independently of the host system's CPU, firmware and operating system. The following procedure are applicable for the following use cases: Updating iRMC Password for security purpose Resetting iRMC Password if it is forgotten or lost IPMITool is installed at the Guest OS level (Redhat OS) Updating iRMC Password First, you will need to establish a SSH session onto the Guest OS (HyperScale RedHat 7.#) Then input the following command: # ipmitool user set password 2 (the

13440
W
Vaulter
D
Vaulter
Daniel BrouwerVaulter
asked in Storage and Deduplication
Where can I find instructions about how to replace a Hyperscale metadisk?

I have a failed Hyperscale metadisk that needs to be replaced. How would I replace the disk?

7781
Emils
Vaulter
description of image

Popular tags

Badge winners

  • Topic Starter 50
    Dennishas earned the badge Topic Starter 50
  • Contributor 25
    Dheeraj Shettyhas earned the badge Contributor 25
  • Contributor 10
    Sougato Royhas earned the badge Contributor 10
  • Contributor 1
    jc4570has earned the badge Contributor 1
  • Solver 1
    Putrahas earned the badge Solver 1
Show all badges
Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings