Storage and Deduplication

Good day,CS: V11.16.xBefore doing a hardware refresh for the CS, we created a VM in a lab with wins2019 and imported the CS DB during SP28 installation. all works fine. However, once login to the CommCell Console, we received a message indicating that the DDB was currently undergoing maintenance and required the completion of maintenance operations such as DDB resynchronization and conversion to a transactional DDB, among others.we have 2 DDBs, and the "convertddbTov5" plan indicates that there are 2 Memdb that need to be converted to version 5. Questions:  if the DDB resynchronization will function as expected after the CS hardware refresh, as two of the DDBs are MemDBs that will need to be converted to V5 after the successful hardware refresh and DDB resynchronization. Which logs will display the DDB resynchronization status and process, does "sidbengine.log"? if the DDB resynchronization or the "convertddbTov5" operation will impose any restrictions on the ability to browse or resto

Hi,I am block replicating a 225 TB drive, however, every now and then I get a message:I should be concerned if such errors are acceptable. On source: 1476 7e8 10/13 14:25:49 22 [xxxxx8] BlrWinFsHasher::copyNextHashes() - Empty hash result received.1476 308c 10/13 14:25:50 22 [xxxxx8] BlrCtrl::connect() - Connection to xxxxxx01/10.xx.x.xxx:571491476 7e8 10/13 14:31:50 22 [xxxx8] BlrHead::addEvent() - Exception for pair 22: Unexpected mixing error in source.1476 7e8 10/13 14:31:50 22 [xxxxx8] BlrHead::error() - 0xEDDD0001:{BlrSmartSync::thread(295)/Int.1.0x1-Timed out waiting for more hashes to come from Tail ESX}.1476 7e8 10/13 14:31:50 22 [xxxxx8] BlrHead::error() - Delegating recovery to main thread1476 308c 10/13 14:31:50 22 [xxxxx8] BlrHead::headThread() - Error recovery1476 308c 10/13 14:31:50 22 [xxxxx8] BlrHead::headThread() - Interrupt smartsync pair 221476 308c 10/13 14:31:50 22 [xxxxx8] ~BlrSmartSync() - Shortcut comparator destructionOn target:  9088 a6c 10/13 15:23:26 ### AS

We took on September 25th. The storage policy was set as below. Deduplication: Enabled Retention: set to 1 day and 0 cycles Worm Lock: DisabledOn the 26th, when the retention period had ended, CommVault sent in delete requests to the Cloud Storage for deletion of the metadata and indexes. However, no delete requests were sent for the archived data chunks. The Cloud Storage responded to these delete requests by deleting the metadata and indexes and responding to CommVault with a positive 204 response.MediaAgent CloudFileAccess log: 5916 1760 09/26 12:15:28 ### [CVMountd] RemoveFile() - deleteimmediatezerocycle/7Z8CZ4_09.25.2023_11.54/CV_MAGNETIC/V_3222/CHUNK_14571/CHUNK_META_DATA_145715916 1760 09/26 12:15:28 ### [CVMountd] RemoveFile() - deleteimmediatezerocycle/7Z8CZ4_09.25.2023_11.54/CV_MAGNETIC/V_3222/CHUNK_14571/CHUNK_META_DATA_14571.idx5916 1760 09/26 12:15:28 ### [CVMountd] RemoveFile() - deleteimmediatezerocycle/7Z8CZ4_09.25.2023_11.54/CV_MAGNETIC/V_3222/CHUNK_14575/CHUNK_

Hello   2nd Copies to Azure Cool Storage.In the context of architectural best practices for MediaAgent sizing (page #49), there's a statement that advises against enabling data verification for cloud storage libraries.https://documentation.commvault.com/2022e/expert/assets/pdf/public-cloud-architecture-guide-for-microsoft-azure11-25.pdfAs of October 2023, is this advice still considered a valid practice? Furthermore, what methods are suggested to avoid issues with corrupted data chunks in cloud storage? Does Commvault propose the practice of sealing the DDBevery 90 or 180 days for this purpose? thanks

Dear Team & Mike Struening, We are facing auxcopy completed with error issue last few months, We dont have Tape backup. We are facing below error:-  Please help us to resolve the issue.

Hello,just one question:If Commvault WORM copy with Dell Powerscale/Isilon Smartlock is enabled, will the data be pruned after the retention of the copy has met? Thank you.Regards,Thomas

Hi all,We have Pure as a primary storage. Using CommVault (via IntelliSnap) we backup data from it (Snap Copy). Then we mount snapshots to Media Agent (MA) and perform backup copy (Primary) from snapshots to our primary backup storage - which is NetApp (NA1). We have another similar NetApp in different location (NA2).Question - is it possible to create additional backup copy from Primary copy using SnapMirror\SnapVault?It is possible to create additional Snapshot Copy but you have to use NetApp as a primary storage. Which is not a case.So we want to have second backup copy (NA2) and it should be available as a source for restore for clients. And we don’t want to utilize our MAs and network when NetApps can do everything themselves.

Hi Everyone,Currently we are making traditional backups from HS to HS (Primary - Secondary Copy).We added an extra Cloud Library as AGC location as mentioned in the picture below.GoalThe AGC NEEDS to finish within 24 hours contains File System + SQL Agents that were backed up from the last 24 hours on the Disk Libraries.ObservationFrom the {Secondary to AGC} it seems that new bckjobs are not picked up after the aux copy started.Example: If bckjob 1-4 contains 10TB of data, commvault waits until these ones are finished and then will pick up the next bckjobs while some Media Agents in the Cloud Library are doing less work.ConclusionThe {Secondary to AGC} takes to much time (+/- 48 hours), after the Full Backups are finished in the weekends on the Disk Libraries. It does NOT meet the requirements.Questions1. Are my observations correct if yes, how to tune it?2. Any other options to meet the requirements? 

Hello,is there an easy way to find out copies in storage policies that are not scheduled? It is easy to find clients with “No schedule” but this option is not available for auxcopies.Thank you., Regards,Thomas 

Hi,I want to enable Horizontal Scaling but I don’t know how Commvault will handle old clients and subclients.Do I need to create new client/subclient?

I am trying to estimate the capacity I am going to need when changing the retention time on my Global Deduplication policy - Primary copy from 30 days to one year.If I look at the capacity of the storage policy now, w/ the 30-day retention period, would multiplying that by 12 give me an accurate estimate on capacity I will need to keep that primary copy for one year?  Ex - Primary copy w/30-day retention period = 300GB - changing to 365-day retention period = 3.6TB ? 

scenario: I have a WORM storage policy (deduplication enabled) of retention 3 days 1 cycleI have run 2 full backups to my storage on same day which completed 1 cycle of retention and with deduplication 7 days of retention is added so total (3+7) 10 days of retention. Will my first set of data be deleted on 11th day since it completes retention on both cycles and days or kindly correct if there is any gap in my understanding here ?

Hello is it possible to enable worm on a s3 bucket with infinite retention? If we want to worm only for 30 days with infinite retention what is the best way?Just create a copy with infinite retention and worm enabled on  it Create a copy of 30 days with worm and add extended retentionthanks in advance

Hello Commvault, we have been working with Commvault and Catalys HPE for 2 months since before we used Data Protector from Microfocus and Veeam. At first the performance was incredible but as the backups continued we noticed that the backup and restore speed dropped noticeably, reaching the point of restoring VMware VMs over SAN at a speed of 50GB/hour which is extremely slow. I reviewed the documentation provided by Commvault and also by HPE and the only strange thing I noticed is that the number of objects we had in the catalys stores when we used Data Protect or Veeam were from 2000 to 5000 and now with Commvault their stores store more of 40,000 objects and this does not affect the performance. I see that 30% are index objects that run at 1 pm. Please have any suggestions and if you have had a similar problem before.

Hi All, There are some posts around this topic but none I could see directly apply.Running 11.28 we have plan that backs up a large system - once a week - that generally takes days to run in order to get the primary copy to disk.Once this is completed one of the AuxCopy jobs is to send this to a Cloudian destination as non-deduplicated data into buckets that are utilising object-lock WORM type functionality.The retention is the same for the Primary and Cloudian copies (14 days).What seems to happen is that when the retention period of the Primary job has been fulfilled I can see that the media agent is attempting to clean up the objects from Primary disk-based and Cloudian copies however as the Primary job took so long to run (lets say over 2 days) then the Cloudian objects won’t be deleted by the Commvault process as they are retention locked until potentially the same time the next day. Commvault makes no attempt to do an extra tidy up the next day and just errors in the log files sa

Hi Team,I have a query on how does Deduplication at the Storage Policy compare with setting Deduplication at Subclient level ?I have to set a mediaagent partition while enabling Deduplication while creating a storage policy.When choosing the same storage policy at the subclient level, I could see Enable deduplication Tab in properties to be selected by default as “on client”. Shouldn’t it be “on media agent”?How does it differentiate from each other? 

Is there any performance advantage to an LTO-8 VTL versus an LTO-5 VTL on Data Domain? 

Does intellisnap work with encrypted volumes on a nimble SAN device? If so, how?

Good morning,I have the following scenario:2 tape libraries A (primary) and B (secondary) 1 tape on library A went bad, we’re marking it as bad and removing it from the library How do I trigger Commvault to copy those missing jobs from the secondary library B, to a new tape on A? Best regards,Daniel

Hi,We’re running Commvault 11.24.116We need to move all data from one existing mount path to another existing mount path. Both with data in them.We’ve found this can be done in version 11.32 https://documentation.commvault.com/v11/essential/157074_moving_backup_location_to_new_location.htmlCan it be done in 11.24.116?If so, where do we find the function?If not, which version must we upgrade to? Any thing to consider prior to upgrading?

Hi,I have so far replaced three drives in our DELL/EMC ML3 Tape Lib and still experiencing the same problem. Currently, there’s one valid drive that is working fine - when it comes to the other one, it is mounted and immediately unmounted after a couple of seconds - one try after another in an endless loop.According to DELL, there’s nothing in the library log that would indicate the root of the problem (the log is clean) - they send me another drive and then the case is closed until the issue rises again.I tried swapping the drives in slots but the problem is following the same drive no matter the slot. At this point, I’d like to exclude software-related cause of the issue.Currently, the number of errors associated with mounting and unmounting the drive is way over its threshold; that might be the reason why CV is ignoring the drive completely - how can I reset the counter? Is there a particular procedure I should follow when replacing a drive? I can see there’s an option ‘Mark drive a

After adding the array into array management and triggering a intellisnap backup.  Commvault is failing to create snapshot due to not finding the specified vserver.Error Code: [32:392] Description: Snap creation failed. : [Unable to create snapshot for FileServer:[192.168.1.65] Volume:[/vol/vmware_nfs] SnapName:[SP_2_1075_4_1693309853]. Return code:[15698][Specified vserver not found]] Source: cvcs, Process: vsbkpI’ve checked the vsbkp logs...ManageONTAP::SetVserverForTunneling() - Using SVM[vol] for tunnelingIt appears to be searching for vserver called “vol”, which i’m not sure where this comes from, there is only one vserver on this netapp and it called SVM0.Anyone run into this?  

We’re using Commvault v11.28.48 and have several jobs that are in a “waiting” status and sitting at 10%-20%. The reason is simple: Mount path does not have enough space.I’m new to Commvault (our backup admin left recently and I wasn’t involved in the initial config or daily use) so I may be missing something obvious, but I thought aged data would be deleted automatically. I’ve run the “Data Retention Forecast and Compliance Report” and see the various estimated aging dates, the only thing that sticks out is the last line under the Disk Media Summary:Estimated Size to Free: 9406 GB (this box is green: “prunable job / recyclable media”) Delay reason for physical space cleanup: Archive file has been queued for pruning from the DDBOur Netapp library is 24.7TB with a size on disk of 24.46TB, reserve space set to 100GB, so an extra 9TB would be great. “Enable pruning of aged data” is checked on the library.Am I correct in thinking that 9406GB is data that should be automatically removed (pru

Hello,I'm not sure if compression/dedupe savings for this DB is fine. Actually, it seems poor… any ideas on what it could be? It's not a special DB…The online fulls are below 30% in savings. Incrementals and archive logs are above 50% in general..Regards,Pedro Rocha

Hello Team. I have a storage policy with a snap primary which snaps a netapp a700, and a vault/replica (not a mirror) that CV orchestrates the replication between the a700 and a fas8700. There is a primary copy as well but I don’t want to use this as the source copy for the storagegrid copy; i want to use the vault copy as the source copy for the storagegrid copy. I am creating a new storagegrid synchronous aux copy and the only options to pick for source copy are primary and storagegrid.  The only configuration I can figure out that works is to have a primary copy, which copies the snap primary copy, and to choose the primary copy as the source copy for the storagegrid copy. Is this expected behavior of the program ? Is there any way to configure the program so a storagegrid copy can have as its source copy the replica/vault copy ?Thank you!