Storage and Deduplication

We’re using Commvault v11.28.48 and have several jobs that are in a “waiting” status and sitting at 10%-20%. The reason is simple: Mount path does not have enough space.I’m new to Commvault (our backup admin left recently and I wasn’t involved in the initial config or daily use) so I may be missing something obvious, but I thought aged data would be deleted automatically. I’ve run the “Data Retention Forecast and Compliance Report” and see the various estimated aging dates, the only thing that sticks out is the last line under the Disk Media Summary:Estimated Size to Free: 9406 GB (this box is green: “prunable job / recyclable media”) Delay reason for physical space cleanup: Archive file has been queued for pruning from the DDBOur Netapp library is 24.7TB with a size on disk of 24.46TB, reserve space set to 100GB, so an extra 9TB would be great. “Enable pruning of aged data” is checked on the library.Am I correct in thinking that 9406GB is data that should be automatically removed (pru

Hello,I'm not sure if compression/dedupe savings for this DB is fine. Actually, it seems poor… any ideas on what it could be? It's not a special DB…The online fulls are below 30% in savings. Incrementals and archive logs are above 50% in general..Regards,Pedro Rocha

Hello Team. I have a storage policy with a snap primary which snaps a netapp a700, and a vault/replica (not a mirror) that CV orchestrates the replication between the a700 and a fas8700. There is a primary copy as well but I don’t want to use this as the source copy for the storagegrid copy; i want to use the vault copy as the source copy for the storagegrid copy. I am creating a new storagegrid synchronous aux copy and the only options to pick for source copy are primary and storagegrid.  The only configuration I can figure out that works is to have a primary copy, which copies the snap primary copy, and to choose the primary copy as the source copy for the storagegrid copy. Is this expected behavior of the program ? Is there any way to configure the program so a storagegrid copy can have as its source copy the replica/vault copy ?Thank you!

I've seen several discussions regarding this topic. But I still don't get it. From the docs:Application Size: The size of the data that needs to be backed up from a client computer. Application size is not always identical to the size reported by file or database management tools.Data Written: New data written on media by each backup job.Size on Media: Size of deduplicated data written on the media. Consider the following real job:Job 1 (deduped disk lib is the destination): App Size: 33.4TBData Written: 24.93Size on Media: 7.30 1st question: what is the total size occupied by this job in the dedup disk lib?2nd question: is data written size, before dedup? Does it account for sw compression only? both?3rd question: is size on media just the size of unique blocks for the job (disregarding the baseline?)? regards,Pedro

Hello All I have an error with the auxiliary copy Failed to Copy or verify Chunk [29532431] in media [CV_MAGNETIC], Storage Policy [New-MA2-FS-Backup-Retention-30D-30C-DDB], Copy [Primary], Host [TE-CV-MA-04.efinance.com.eg], Path [F:\YTIUSF_02.16.2021_12.37\CV_MAGNETIC\V_1046223], File Number [19], Backup Jobs []. Please check if all the disk library mount paths in the dedup storage policy copy are properly configured to read from the MediaAgent. Please check if all the disk library mount paths in the dedup storage policy copy are properly configured to read from the MediaAgent.

Hello, TeamI have a customer who is writing directly to the tape library with any dedupe in place. Their challenge is, for their LTO8 and LTO6, the data writing to tape is making use of the native capacity instead of the compressed capacity.  They have the hardware compression enabled on each of their storage policy and they confirmed that before moving to commvault, their previous backup solution makes use of the compressed capacity when writing data. Is there any settings that can be done on commvault to ensure that the data is compressed so it can write full capacity of the data?Please, advise

We are in the process of replacing a tape library with another. How many tape libraries can be configured on a mediaagent? We would like to have both attached at the same time for a transition period. The old one has LTO6 drives and the new one has LTO9 drives.

Hi! Can you share what would be the best setting for tape backup performance?Considering 1 tape drive, which multiplexing setting to chose? What should be into account? Which other settings? Hardware compression? Regards,Pedro

Hello, I am looking for the best solution for immutable copy of data built on Commvault in Azure. We have some configuration, but I would like to see what Commvault Community can propose. I am looking for few approaches: First copy of data is in local. Azure copy is working as DR site. Dedicated storage for Immutable in Azure per site (locally).  First copy of data is in local. Azure copy is working as DR site. Shared storage for Immutable in Azure per site (locally).In that both approach I would like to know about the cost and how to estimate decrease usage storage between dedicated - shared storage ? What will be the best storage configuration for that solution Deduplicated or Not-deduplicated?  Retention for Immutable is 14 days and 2 cycles. Storage usage for Immutable solution (Hot or Cool)?And I think the most important how to calculate cost for those solutions if I have only local backup solution in current state. Regards, Michal 

Hello fellow Vaulters. Are there any out there, that have experience with the Dell ECS storage system used for AuxCopy data as a S3 library on prem? Or do anyone have other on-prem S3 storage systems to recommend? I am in the process of evaluating a new S3 target storage system to host AuxCopy data. Thanks-Anders

HI All, We have introduced Exagrid storage system as our backup storage solution, after the implementation we have noticed that the restore job is taking longer time than the expected one.We used Netapp as storage solution before Exagrid and also at the current setup with Exagrid we have enable the dedupe in both CommVault and Exagrid as well. How to identify where is the bottleneck. We have enabled the encryption and compression also in the Exagrid system. 

Hi Good day!Environment Details Planned initial:Commserve: dual home.  has network 10.x.x.x (agent backup) and 172.x.x.x for (VMware)Network Topology: Bonded LACPTotal Portal on HSX:  2 dual cards 25 GB ports. and 1 ILO/IPMI. Total available port per node is 5 including ILO.How many nodes: 3Plan to define only two network DP with CS and SP.DP/CS Registration: 172.x.x.x SP: 192.x.x.xPresent issue:Customer has non-routable network (10.x.x.x for agent backup DB/SQL) which cannot be routed with DP network mentioned above. This is a reference architecture and HSX can have only one routable network possible.Does below topology will work, looking for best suggestion:Topology: Bonded VLAN LACPDP bond1 has VLAN 100 and 200.and SP is 192.x.x.x no VLAN.bond1.100  VLAN on DP for CS Registration and default gateway will mention on this network. (DNS, NTP, SSH, VMware, replication aux copy) all should work using this network 172.x.x.x, it is a routable network. Note: DNS and VMware are on different

Here is the situation: Primary copy - main siteSecondary Copy - DR site Tape Copy - DR Site We are doing Aux copy from Primary > Secondary and Secondary > TapeWe got alot of errors reading chunks when doing Aux to Tape. we noticed that those jobs fail to restore from Secondary copy also , on Primary site , jobs can restore Can i mark chunks/jobs as bad on secondary copy and have commvault recopy the jobs INCLUDING the bad chunks from Primary copy again and not save bad chunks due to dedup ?

Hi Good Day,I like to know whether two HyperscaleX  located in different DCs (25 KM distance between DCs)  can register with a Single Commserv sitting in one of its DC?  Is this workable and any thing to consider before setting up.Also like to know an auxilary copy can be send to opposing DCs HSX devices managed by Single commserve.

Heath report showing critical with given error "No Index Backup in last 30 days " whereas backup is getting completed for client.

Currently our client is using the built-in KMS server which stores encryption keys in the Commvault Database. As far as I can find, there is no way to extract these keys.We are looking to transition to Azure Key Vault for storing these keys. It is very easy to change the KMS server, but in theory this would leave us unable to access the previous backups as we technically do not have access to those keys for decryption.I have searched this extensively and there is no documentation for this (confirmed via Commvault support phone call). What is the proper process for changing the KMS server on a backup location, particularly the built-in KMS server over to a third-party, without losing access to backups? I did find 1 forum post stating this “just works”, but I need to provide some kind of concrete answer for my higher-ups to be happy. Thank you in advance!

Hello, We have some auxiliary copy jobs configured that run just once a week copyng only the full backp-us to tape All seems working ok but be received this alarm attached and to be honest,we don't really fully understand it…Can you kindly tell us why do you consider thta we have this behavior Thank you  

HiMy backups seem to get to 70% then stop and sit in a pending state with the following message being displayed in the job controller.“i have confirmed that the media agent and the CommServe can communicate (have run CVPing and CVIPInfo both return success).have also tried searching on the Error Code 62:468 and get no results for that, at a bit of a loss as to what is going on?

We are trying to use CommVault to backup an Oracle 19c Database straight to our hyperscale servers ( was backing to as separate SAN disk and then to hyperscale hope to reduce the extra step) backup is working, but a full backup gets all the white space on the data drive instead of only the used space and takes about 13 hrs to complete.   Currently we are thinking that the SBT switch in the RMAN is what is doing this to us.   Anyone else doing this?   The length of time to backup has the DBA’s worried.

Hi Community,With reference to the following post where there is no longer an option to select:https://community.commvault.com/topic/show?tid=5967&fid=49Is there a way to confirm which option is being selected for an Aux Copy Operation?  I would like to confirm because I would assume that when copying between 2 cloud libraries, Disk Read Optimized copy would be more efficient and cheaper in cost being that each block does not need to be read to generate the signature - or at least that's the way I read doco.  Would there be an entry in logs to determine this?Thanks in advance for the advice/assistance. 

Hello, Recently we had to make a configuration with:1x CommServe1x MediaAgent2x StoreOnce Catalyst MediaAgent and the 2 StoreOnce are Connected through Fiber. Backups to the first StoreOnce Catalyst works fine without any errors but when we initiate  Aux Copy from the First StoreOnce to the Second StoreOnce its say its fails due to Chunk errors. Any ideas about the Configuration we need to follow in order for the Aux Copy to succeed ? 

Hi, good morning.I did install Commvault Version 11.28.70 .Meantime on my Vcenter infrastructure I did create and install one Appliance Quantum VTL DXi 5000 Community Edition (this appliance it did develope on CentOS O.S.)Both servers are on the same network, I can ping the vtl without problems.I would like to know how can I make for connect/configure the VTL on my Commvault Environment.I did try without success to configure the same on the Commvault COmmand Center with the produce : Storage/Disk/Add. ecc. I did insert the information of the server( user and password ) but when I try to insert the path (the vtl appliance it’s on CentOS O.S. ) I can’t configure correctly the path.THanks in advance.Best regardsRicardo

Hi guys,has anyone experience with iSCSI-attached tape libraries and the sharing of the drives? It should work, but it is not really documentated and I am concerned about performance, stability and functionality. Even more, if only one network is available for both, regular network traffic and iSCSI connection. Any information/experiences would be apreciated. thanks a lot!

Hi All, We have Linux cluster with shared disks. Both servers are resides on a VMWare environment. Due to a VMWare issue we cannot take snapshot of the vms. Now we want to backup these VMs from commvault. We are currently takin backups from few file systems on these VMs.I tried to enable 1-Touch recovery and initiate a full backup. Backup fails on “Backup” phase showing following error. +++++++++++++++++++Enor Code: [82: 172]Description: Could not connect to the DeDuplication Database process for Store ld[33].+++++++++++++++++++ This mentioned DeDuplication Database is online and shows no errors. When removed 1-Touch backup is running smoothly. 

Similar to this article, I'd like to show simple queries to retrieve DDB information from CSDB.Important note: do not modify CSDB data and modules, just use READ operations only.Also pleaseTo keep your activities safe you need to keep uncommitted read from any table as one of the following techniques:use CommServ -- just for convenience-- place the following at the top of any queryset transaction isolation level read uncommitted;-- place with(nolock) statement in each table referenceselect * from APP_Application with(nolock)Most of the DDB information is stored in tables started with Idx, for configuration of DDB is stored mainly the following 3 tables, first one is for DDB information, latter 2 for partitions:select * from IdxSIDBStoreselect * from IdxSIDBSubStoreselect * from IdxAccessPathTo combine this, including which MA is in use for each partition, like the following:select store.SIDBStoreName as 'DDB Name' ,apc.name as 'MediaAgent' ,ap.Path as 'Partition path'from Id