Skip to main content
commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 1,139 Topics
  • 4,859 Replies
1139 Topics
M
Byte
MubaraqByte
asked in Storage and Deduplication
Commvault Deduplication with a deduplicated storage.

Hi, TeamHope we are all doing fine.I will like to get ideas on a topic.I have a client who uses Dell EMC data domain as their backup repository and they do not use commvault deduplication at all, they rely on dedup on the storage.. The backups do not seem to flying at the moment. I have done CVDisk and the storage is not doing bad.  Also done CVNetwork test and the throughputs are great.I am suspecting the Storage deduplication is the culprit….I am not able to check the Q & I because it is it not a CV DDB. The storage team cannot really help out to check, as they have no idea of what is going on..I proposed a new Media Agent to load balance the workload and i will like to know if they can use CV Dedupe for the new storage policies with the same Data Domain storage. The point man says they have a 3TB 10k SAS which is a bit manageable for CV Dedupe.Please, advise. 

40651
J
Vaulter
D
Byte
drPhilByte
asked in Storage and Deduplication
DDB database reconstruction and deletion

Hi there, I want to share my experience with DDB reconstruction. My colleagues started the DDB database reconstruction because the DDB database was not in good condition. There were no current backups of DDB database (the last backup was 14 days old) and maybe some other error messages were active. They decided to start full reconstruction, maybe there was no option to make manual backup of the DDB database - hm, but the database had not been updated with new records anyway. The thing is that the reconstruction is very time consuming and moreover, since the DDB database is not running the backup jobs are not possible. The workaround we did was to temporarily disable deduplication. Another caveat is that we are running out of disk space. And that is how a disaster looks like . At the end I wil put my hypothetic questions. Is the DDB database needed for restoring of data - I wouldnt say so. And what would happen if the broken DDB database was deleted and completely the new one was built

39651
Mike Struening
Vaulter
V
Byte
virgilByte
asked in Storage and Deduplication
error 13:138 on auxiliary copy between 2 MA

HelloI have a problem of auxiliary copy between two media agents with HP StoreOnceI have a 2*100MB WAN link between the two MA.I got 13:138 errors but job is still runningSee attachments for detailsIf someone could help meSP11.22No firewallingFirewall is Off on the two MA Regards  

39321
J
Vaulter
DaysAndCycles
Byte
DaysAndCycles
asked in Storage and Deduplication
Secondary Copy on Disk - Implications of WORM setting

Commvault 11.18 (soon to be 11.20).    - We are on the cusp of eliminating our secondary backups to tape.   The benefit of a secondary copy on tape was the build-in air-gapping (and ability to move it offsite for safe-keeping).    We plan to move to creating our secondary copies on disk in a different city.   Commvault’s built-in Ransomware protection is  no-brainer, but WHAT ABOUT WORM?    What are the implications of the WORM storage on space consumption?   Is there any scenario in which a WORM-enabled deduplicated secondary copy that is a true copy of the deduplicated primary copy (and with the same retention) would be any LARGER than the primary copy?   Presumably, if a 1000 jobs share one block on the secondary storage, that block will not be removed until the last of those 1000 jobs ages out.Any info is appreciated.   Thanks!

387212
Nikos.Kyrm
Byte
J
Bit
jcutter03Bit
posted in Storage and Deduplication
Tape Library Options

Hello everyone, hopefully wanting to get some recommendations and possibly help. We are currently shopping to replace our HP LTO6 SAS Tape Libraries. We are looking at the Quantum i3’s to support LTO8. First off let me explain our setup2 Media Agents 4 Tape Libraries (HP LTO6) - 2 of them directly connected 6GB SAS to 1 media Agent and the other 2 drives directly connected 6GB SAS to the other media agentWe are looking at the i3 but would want both media agents to be able to utilize the same drives from the unit. We know how we currently have it setup and 2 drives belong to one media agent and the other 2 to the other. So some quick questions:Any recommendations on other brands we should look at?  Anyone recommend the quantum tape drives? What would the setup of this look like from a SAS to Media Agent setup look like? Right now obviously 1 media agent can’t use the other’s tape drives and we dont want to be in this position in the new setup. If we have 4 drives we want all of our medi

38686
M
Vaulter
D. Kerrivan
D. Kerrivan
asked in Storage and Deduplication
MediaAgent iSCSI disk library mount marked offline, but is present.

This has been driving me mildly nuts for the past 3 days post a power shutdown for our site.We had some challenges with our storage network, that prevented iSCSI comms for a few hours after we powered up our site post some scheduled electrical work.We solved that by the software equivalent of a power on/power off on the switches in question (two unrelated port channels to our SAN were disabled/re-enabled). Great. iSCSI works again with all hosts.The MA in question, a VM, is borrowing space on a temporary basis from a newer array, as I am doing a lot of migration work, and is mounting the volumes in Windows via iSCSI as opposed to using an iSCSI mounted data store in VMWare which is treated as an HDD by the OS.   Keep in mind, this was all working swimmingly before this past weekend.  For the past three days, CV is convinced that the 5 mount points in question are offline, and do not have a controller.  If you go to the OS, and browse, you can drill down as deeply into the mounted volum

385112
Mike Struening
Vaulter
DaysAndCycles
Byte
DaysAndCycles
posted in Storage and Deduplication
Commvault Official Deduplication Limits

I think there are several deduplication-related subjects that require thorough documentation by Commvault.     1.) There is a long-standing recommendation to limit deduplication database disks to TWO PER MEDIA AGENT.’ I was able to track this recommendation as far back as Simpana 9.0, but I’m not sure if it pre-dates that.   This limit feels rather arbitrary, and it doesn’t take into account the performance capabilities of the host platform, or advances in computing kit since the original recommendation was made.   I can’t find any references showing WHY such a limit should exist.In my case, I have three Deduplication disks on my media agents (all NVMe SSD), and that runs with zero issues.  The Media Agents are spec’d over the recommended Extra Large spec, and they don’t even sweat.  I would like to issue a  call to Commvault to really explain why this limitation is in place. The Deduplication Building Block section of the documentation would be an ideal place for this information.  Th

38069
S
Byte
S
Bit
SollyKBit
asked in Storage and Deduplication
Restore failing with error Error Code: [13:244] Description: [Media read operation failure] [Dedupe disk media] [Access to the file/media denied.]

Restore failing(goes to Pending) with error Error Code: [13:244]Description: [Media read operation failure] [Dedupe disk media] [Access to the file/media denied.]When running on Media agent 01 but goes through when running on Media Agent 02

375513
Sougato Roy
Vaulter
Robert Horowski
Commvault Certified Expert
Robert HorowskiCommvault Certified Expert
asked in Storage and Deduplication
How many DDB partitions are supported on single MA?

I’m a little confused about multiple partitions and or DDBs limitation. There are several places when limits are mentioned like the one and only Hardware Specifications for Deduplication Mode1) https://documentation.commvault.com/11.24/expert/111985_hardware_specifications_for_deduplication_mode.htmlwhich mentions “2 DDB Disks” per MA andConfiguring Additional Partitions for a Deduplication Database2) https://documentation.commvault.com/11.24/expert/12455_configuring_additional_partitions_for_deduplication_database.htmlwhich mentions “30 DDB partitions” per MA.Also, In my recent discussion with PS member I was told that a partition should be treated as DDB itself.All of this creates a lot of confusion likea) is “DDB Disk” the same as DDB?b) is “DDB partition” the same as DDB?If you look at 1) /Scaling and Resiliency there is a informationThe back-end size of the data. For example: Each 2 TiB DDB disk holds up to 250 TiB for disk and 500 TiB for cloud extra large MediaAgent. That means

375013
P
Vaulter
G
Byte
gogi100Byte
asked in Storage and Deduplication
delete old backups

i have the commvault  v11.28.83. i want delete old backup from disk manually because of i have not empy space on my storage disk. the agging option is finishing works, but the disk space is not emptied.how to do it?

370013
A
S
Commvault Certified Expert
SSchmidtCommvault Certified Expert
asked in Storage and Deduplication
DDB Resync scheduled

Hi All, maybe you have an idear. We had 2 GDSPs in the enviroment which gets the status resync scheduled.  The Daily DDB Verifiy jobs running fine without any problem.  The Status of the DDbs is chaning from different time. An DDb Restore was not started.   Do you have an idear ? 

36877
S
Commvault Certified Expert
W
Byte
WaynByte
asked in Storage and Deduplication
Tape not available

Nice day, some tapes are not available in the scratch pool, although they are physically present in the library. He tried to move them to the library and did a full scan, but it didn't help. What can be done to make them available? 

367618
L
Byte
M
Byte
MansoorByte
posted in Storage and Deduplication
How to calculate sizing for Media agent deduplication partition

How to calculate sizing for Media agent deduplication partition

36582
M
Byte
S
Byte
Sudharshan KumarByte
asked in Storage and Deduplication
Media Retirement

Hello Team,  Just thought to discuss with everyone, we have lots of medias thats turn into "Deprecated” moved to Retire Pool which are very less usage. When am looked the information in Media Properties shows below message,   When I could see Side information, shows ver less usage info : As per the default CommVault Media Hardware Maintenance shows as below,  Here my question is : Whether those medias mark as good and re-use for future its advisible? Can you someone clarifity from MM. @Christian Kubik 

35686
Mike Struening
Vaulter
S
Bit
SaimanojBit
asked in Storage and Deduplication
Mount path to Mount path Data Migration

I need to check if there is any option to move the data from one mount path to another mount path in the same library. I need this to be done for mitigating over commit issue at back end storage. I am having 3-4 mount paths in which only one job is there , i want to move that one job to any other MP within the library and get that deleted so that over commit issue will get solved.  Current Version: V11 SP26.23Backend Storage : Netapp

35092
YYZ
Byte
D
Byte
drPhilByte
asked in Storage and Deduplication
Mount Path does not have enough space/Disk Library running out of space

Hi all,after some time we are facing another serious issue. There is no available space on the disk library. Ayayay.We have tried to find if there are any unprunable jobs. There were some of them and therefore we have set option to ignore cycle retention for disable subclients. Unfortunately, only small amount of GBs have been aged. Now, there is a question what to do next. I have no idea how to find what can be deleted in order to make more free space for the backups. Moreover, there will be quit a big deduplication ration, so even manual deletion of some jobs do not have to be useful. Maybe, one useful information can be that during the last month there were increase in data cca 10TB, which is 10 percent increase. Is there possibility to figure out what data did this increase? Is there any generule rule or useful tool within the Commvault to fight with this issue?

349510
Mike Struening
Vaulter
Mohit Chordia
Byte
Mohit ChordiaByte
asked in Storage and Deduplication
Delete Mount Path from de-dupe library and decommission Media agent

Team,We are using windows servers as Backup media agents , I want to decommission one of the media agent “x”  which is part of 3 libraries and dedupe storage policies. I have disbaled the mount paths on all 3 libraries associated with media agent “x”  , view content shows that there is no data present on the mount path . When I try to delete the mount path associated with media agent ‘x’ faces below error -Mount path is used by a Deduplication database.The data on this mount path used by the deduplication DB could be referenced by other backup jobs. The mount path can be deleted only when all associated storage policies/copies with deduplication enabled are deleted. See Deduplication DBs tab on the property dialog of this mount path to view the list of DDBs and storage policies/copies. if I unshare the mount paths associated with media agent ‘x’ with other mouth paths of the same library and remove media agent ‘x’ from data paths tab in dedupe storage policy , the restore jobs starts f

344915
Mike Struening
Vaulter
J
Vaulter
JordanVaulter
asked in Storage and Deduplication
How do I move the location of my Deduplication Database?

I’ve been encountering some hardware issue’s on my DDB disk and was wondering if there is a guide on how to move the location of the DDB?

33603
P
Commvault Certified Expert
Mohit Chordia
Byte
Mohit ChordiaByte
asked in Storage and Deduplication
Enabling Ransomware Protection on a MediaAgent for disk library

Hi Community , Does Enabling Ransomware Protection on a windows MediaAgent CV feature make my disk library and backup copies immutable ? Do we also need WORM enabled primary or secondary copies even after enabling this CV native feature for full proof ransomware protection ? If yes , what is the use of ransomware protection feature ?Regards, Mohit

33565
Nikos.Kyrm
Byte
G
Bit
Glenn NgobeniBit
asked in Storage and Deduplication
The job has failed because the VSS snapshot could not be created.

Good day,Please Advise.Error Code: [7:314] The job has failed because the VSS snapshot could not be created.I have checked vssadmin list writers: No errors found.  State: [1] Stable  Last error: No errorDDB Backup Disk free space is 260 GBProcess Manager service: VSS Provider Service is running.Warm regardsGlenn Ngobeni

32164
J
W
Vaulter
Winston WVaulter
asked in Storage and Deduplication
Failing DDB Backup on a Windows-based MA due to shadow copy space allocation exhaustion

Hi Team, My DDB Backup operations are failing with the following error message: The snapshot of the Dedupe database from the previous attempt of this job is not available and a new one could not be created, as the job cannot continue under this condition, it will fail I can't really find anything in the Commvault logs outside of a few VSS-related errors. What could this mean? RegardsWinston 

31722
W
Vaulter
S
Bit
ScottNBit
asked in Storage and Deduplication
S3 Object Locking and Versioning

There is a related topic regarding my question but I don’t feel it was adequately answered:  Essentially there is a conflict in documentation regarding versioning and how object locking works. Firstly the public cloud architecture guide for AWS states that bucket and object versioning is not supported in Commvault (p. 85 of AWS Cloud Architecture Guide - Feature Release 11.25 (commvault.com))However, when enabling object locking in AWS, versioning is enabled by default on the bucket and objects - it is by design. Under ‘Enabling S3 Object Lock’ section (https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-lock-overview.html) it states that versioning is enabled.So if Commvault doesn’t support versioning (and will result in orphaned objects), how can Commvault support object locking, which also enables versioning?We have also tested this in the lab and can confirm when object locking is enabled, we do not see any data prune from the cloud library. We have run the workflow, store

31555
J
Vaulter
Robert Horowski
Commvault Certified Expert
Robert HorowskiCommvault Certified Expert
asked in Storage and Deduplication
S3 Compatible Storage Untrusted Certificate

Hi! I’m trying to add S3 Compatible Storage as a Cloud Library, but I get error: 3292  1194  12/20 10:31:44 ### [cvd] CVRFAMZS3::SendRequest() - Error: Error = 440373292  1194  12/20 10:31:48 ### [cvd] CURL error, CURLcode= 60, SSL peer certificate or SSH remote key was not OK I already troubleshoot it and I was able to successfully add the storage as a Cloud Lib using “nCloudServerCertificateNameCheck” mentioned in another thread  (Thanks @Damian Andre ! ) The thing is that the provider has a valid certificate Issued by:CN = R3O = Let's EncryptC = USwith root cert:CN = ISRG Root X1O = Internet Security Research GroupC = USSo I am wondering if instead of ignoring all the possible certificates I could just add this one, valid certificate to Commvault so it trust this provider and allow me to configure DiskLib. Is this possible? Also not sure it that’s related since certificate administration is not my cup of tea, but curl-ca-bundle.crt is dated to FEB 2016 on this MA which is a fresh in

31207
Robert Horowski
Commvault Certified Expert
S
Byte
Shalika SenadeeraByte
asked in Storage and Deduplication
Unable to use disk mount path

Mount path volume is dirty. Please run chkdsk on this volume

30965
Mike Struening
Vaulter
P
Byte
Paul HutchingsByte
asked in Storage and Deduplication
Failed to process chunk since 11.24.19 upgrade

Yesterday our environment did an automatic upgrade from 11.20.xx to 11.24.29.Previously I have had absolutely zero issues with data verification and backups and aux copies and all jobs show as passing data verification.Now I’m seeing errors/issues on aux copies and data verification along the lines of:Failed to process chunk [2840311] in media [V_98073], at the time of error in library [Disk Library] and mount path [[ma02] C:\Mount\maglib04], for storage policy [Backup to Disk] copy [Primary] MediaAgent []: Data read from media appears to be invalid..We’re using global dedupe and lots of synthetic full backups so I’m trying a proper full backup on a problem job to see what happens.Before I raise with support does anyone have any suggestions or thoughts please?This is a Windows MA environment where there have been zero issues this literally started to happen after the 11.24.29 install.Obviously this doesn’t seem good :(

30444
Mike Struening
Vaulter
description of image

Badge winners

Show all badges
Terms & ConditionsCookie settings