Storage and Deduplication

Hello We are using Exchange Mailbox archiving with +10 year retention. For a couple of years we have been using Content Indexing for these jobs, but it’s not needed any more. We have disabled CI and it’s valid for next archiving jobs, but how to clean up previous Content Indexing entries (without deleting archiving jobs)? We would like just to free up space on CI disks as it’s not required any more. As far as I know this procedure - https://documentation.commvault.com/11.20/deleting_content_index_of_specific_backup_job.html - points to Indexing V1 and we don’t have such option in our job history menu. Kind regards,Maciek

Hello Community,I have a problem, that the Index Cache Directory usage grows steadily (~ 2Gb per week) and currently 80% of free space is consumed.Due to specifics of the environment, Load Balancing and adding free space is almost impossible. As per the CV documentation, the active metadata are deleted from Index Cache, when the corresponding jobs meet retention:https://documentation.commvault.com/2023e/commcell-console/backupset_level_indexing_index_cache_cleanup.html#index-cleanupand the compaction process happens every 30 days by default:https://documentation.commvault.com/additionalsetting/compaction-enforce-days.htmlCan I use the Additional Setting COMPACTION_ENFORCE_DAYS to set another frequency for the Compaction process, e.g. 1 week? I expect, that then the metadata from aged jobs will be deleted every week, rather than every month, and this will free up space in Index Cache.Is this assumption correct?What impact can this setting have on the environment? Best regards, Aleksandr

Hi, I am facing error regarding connection to DeDuplication Database. It can be caused by many reason but my specific problem is that the directory with DDB is locked for write. This was confirmed by SIDBEngine.log and simply you cannot create folder in DDB folder.Status of DDB is ONLINE. I can freely read from it, I can freely travers through it, I can copy the folder to different place and here I can create files/folders inside without limit. There is no way to manage from CMV - it is not possible to backup, restore, seal, verify etc. I cannot move the partition. It seems as Windows/Hardware problem but….I checked windows logs - no events from disk, scsi etc.I checked filesystem - all looks fineI checked hardware events (it is HPE server, so iLO log, IML log, I checked smart array status)It seems that it is limited only to this DDB folder. On the same drive, same volume, different directory all working as usual. So there is no write protection on drive or volume level (checked by dis

Hi, For data security I was told to do search on the WORM option at Primary copy level of our storage policies.. Just a bit of background of our environment, we have short data retention set on our Primary Copy - 35 days 1 cycle. My understanding is that this WORM option in storage polices work within Commvault software and no admin(or anyone) can delete backup jobs after it is enabled, and we have to wait for job to age out and then be pruned by commvault automatically. Then I was advised that if I enable WORM, DDB for its storage policy will be sealed. A new DDB will be created automatically after rebaselined. So I have some questions below. is DDB sealing an automate process? i did enable WORM option more than a month ago for a storage policy for testing but I cannot see a sealed ddb under ‘Deduplication engines’. Our disk libraries are quite big (from 300 TB to 800TB). if we need to do the rebaseline every time, will this take long time and have impact on performance? With only 35

hi, we have s3 compatible cloud storage and we have multiple customers in a single commcell each with their own cloud bucket. Sometime the space on the storage is reclaimed only when space reclamation is run. According to your document that says - “Use the space reclamation feature to reclaim idle space on non-supported sparse files storage” - how can I find if our cloud supports this or not. Only our disk storage mount paths say “supports sparse” or “not support sparse” but there is no such thing for cloud mount path. Why data aging does not clear up the space and needs space reclamation to clean up. how often should I run this?

I will soon have to implement Commvault on a site consisting of the following elements:- 2 MediaAgent- A NetApp storage array presenting file per block via iSCSIThe idea is that the MAs work on the same storage and that when one goes down the other continues to provide availability to the infrastructure for both backup and restore operations and reading a lot I think that the best for my case would be to implement GridStor: https://documentation.commvault.com/2022e/expert/10842_gridstor_alternate_data_paths.htmlFor my knowledge and experience, reading it makes me a somewhat complicated configuration and I don't know if it fits the needs I am looking for.This is the procedure that is the most difficult for me because I do not understand very well why: https://documentation.commvault.com/2022e/expert/9788_san_attached_libraries_configuration.htmlI thought that presenting the LUN to the MA and formatting it and sharing the data path with the other MA would be enough but I see that it is n

Hello everyone, hopefully wanting to get some recommendations and possibly help. We are currently shopping to replace our HP LTO6 SAS Tape Libraries. We are looking at the Quantum i3’s to support LTO8. First off let me explain our setup2 Media Agents 4 Tape Libraries (HP LTO6) - 2 of them directly connected 6GB SAS to 1 media Agent and the other 2 drives directly connected 6GB SAS to the other media agentWe are looking at the i3 but would want both media agents to be able to utilize the same drives from the unit. We know how we currently have it setup and 2 drives belong to one media agent and the other 2 to the other. So some quick questions:Any recommendations on other brands we should look at?  Anyone recommend the quantum tape drives? What would the setup of this look like from a SAS to Media Agent setup look like? Right now obviously 1 media agent can’t use the other’s tape drives and we dont want to be in this position in the new setup. If we have 4 drives we want all of our medi

Hi.  We have a complicated setup where we are using a Topology Group to send data between Media Agents through a Firewall and Proxy.  Once the data hits the Firewall all data is forced into 2 tunnel ports.In addition to this control we would like to reduce the number of source ports being used so that these can be monitored for backup flow.  Currently using the Dynamic Port Range 49152 and 65535 does not allow us to do this.Is it as simple as forcing all data traffic into the tunnel (8403 by default) and if so will this create a bottleneck.Thanks, Andy

Hi, I am dealing with api’s for a project, so I need to see backup job’s that’s why I use this api “http://WebConsoleHostName/webconsole/api/Job” and this api  returns all the jobs in the past one year in CommCell environment. But some jobs are missing, I can not see, How can I see all the jobs ? 

What’s the easiest way to confirm a Cool/Archive cloud library is working? I have migrated data from a Hot storage blob container. I provisioned an additional storage container as Hot in Azure and provisioned it as Cool/Archive as recommended by Commvault. I attempted a restore of a file from this Archive library and the restore just completed as normal without the use of a workflow so I’m worried the data isn’t in the Archive tier as expected. Any ideas how to confirm the data is actually in Archive and Metadata is in Cool? And why was the restore just standard? 

We have four Exchange servers. Each DB has a passive and active copy with them being on different servers. We installed the media agent and a backup disk on the exchange db server. Usually i know what DBs are passive on each server so i setup a subclient on each one so the back up will run from the passive disk directly over the SAN to the backup disk without using the network. However sometime exchange admins will do patching late at night and the DBs will failover and they wont fail them back til later. when this happens the db backups are much slower. I want to avoid this by configuring each subclient to only backup the passive DBs that are on the same server as the media agent/backup disk. my goal is to never run backups over the network even when DBs are failed over to other servers. is this possible? 

I want to move jobs from disk to tape, when I run the auxiliary copy it gives me an error when it finds a CHUNK and some of the jobs are marked as bad, try to mark them as good and it gives me the following error "the selectted job cannont be marked good , since it has been marked bad by the system during a read operations"Already validate at the Operating System level that the CHUNKs are in the corresponding route.If I try to view the backup data for those bad jobs through a restore I can view and navigate to the file to restore Is there any way to recover the good status of the jobs?

Hi  All,After installing a new library (NAS with CIFS share) with new storage policy (no compression , no encryption) –Backup jobs are running fine, but aux copy jobs (replication to the DR site) are much slower than before , about x10 times slower.We checked the network performance between MA and repository and between MA production and MA DR site – all working well.What can be the problem? Is there any fine tuning for the aux copy wo work faster?Thanks.

Could the DDB Verification and the Auxiliary Copy jobs impact on DDB disk in terms of Query & Insert time (the calculation)? We have some Database's Average Q&I Times across Partitions in the last 3 and 14 days with very high values. Backups jobs are running fine. No Performance degradation during backups with a good Deduplication ratio. There are no significant events. Most of the time we’re doing Database Log backups (So, no dedup here) and running Admin Jobs to copy data onto tapes or to create secondary copies. At night, we're doing incremental backups (VMware and FS agents). We have an issue with Synthetic Full backups (https://community.commvault.com/commvault-q-a-2/synthetic-full-is-not-running-based-on-automatic-schedule-settings-2744) and I'm wondering about how this issue also can impact on those times. Some info:VMware VM Media Agents are running updated Linux. 8 CPU cores, 32 GB RAM. DDB Flash disk. Kernel Parameter Configuration done. DDB Verification: Incremental

Hi together, I am planning a MediaAgent that has enough storage capacity to be my disk storage. Deduplication should be active, it is Back-end Size for Disk Storage Small (Up to 50TB).Are there any recommendations or requirements regarding the RPM of the backup disks? I did not find anything in the CommVault documentation, only the RPM recommendation for the OS/software disk.Thanks in advance for your help!

Hi Commvault People, I have a tidying up exercise to do, which will ultimately involve this:- 1 - Decommission two MA’s currently working as partitioned dedupe  (lets call, them MA3 and MA4)2 - Migrate workloads to remaining MA’s, also with their own partitioned GDSP configs.     Lets call them MA1 and MA2.3 - Noting that Storage Policies on MA1\MA2 versus MA3\MA4 have very different retention. I know that generally speaking, you can easily reassociate to another SP and away you go, but that’s only useful if you have matching retention.The issue I have is that my MA3 and MA4 Storage Policies (whose ma’s I want to retire) are set to Infinite retention.  The Storage Policies on the remaining ma’s (MA1\MA2 are not). So If I want to migrate the workloads away from MA3 and MA4, is it possible to somehow keep the Storage Policies in tact that were previously associated with MA3 and MA4. I would prefer to keep them in tact to avoid yet more legacy and historical SP’s clogging up the environme

Is there any reason we are doing the Double Dedupe for Aux Copy(DASH Copy)? What is the benefits for us.   

Hello,I have a tape that appears to be stuck in one of the library drives. The tape itself  reports that it is stuck in the drive. I have tried the Clean / Reload / Unload Drive options to do effect. I also restarted the Quantum tape library to see if that helps, again no luck.     Cheers  

Hello Team,  Just thought to discuss with everyone, we have lots of medias thats turn into "Deprecated” moved to Retire Pool which are very less usage. When am looked the information in Media Properties shows below message,   When I could see Side information, shows ver less usage info : As per the default CommVault Media Hardware Maintenance shows as below,  Here my question is : Whether those medias mark as good and re-use for future its advisible? Can you someone clarifity from MM. @Christian Kubik 

Hi Community, Recently we acquired an Object storage library, which is compatible with CV (Oceanstore 100D), I was wondering how should it be configured.Should it be configured as a cloud library ? How can it be mapped to our MA ?Sorry if these questions may sound a bit silly, am a nooby regarding object storage, am only used to the classic NAS/SAN storage. Any step by step recommendations would be much appreciated to get a better understanding. Best regards.

Hi,Im having issues with throttling network utilisation for aux copies. I have about 10 Storage Policies all with Secondary copies.I’ve configured “Throttle Network Bandwidth (MB/HR)” to 25000 for the secondary copy for all storage policy. If my maths is correct that would be approx 50Mbps per aux copy. Even with all 10 running at the same times utilisation shouild only be approx 500Mbps.However through network montioring i can see when these aux copies are running they are using well over the 50Mbps configured (and saturating the network).Is my maths wrong is or the throttling configuration not  working how i expect it to work?Thanks in advance for any responses.

Hello guys. I’m looking for some advice/tips on how best to configure additional selective copies in a storage policy and ensure they are deduplicated to avoid rewriting the same blocks on cloud storage. The Primary Copy is deduped and goes to Library 1. I want Weekly and Monthly copies to go on Library 2 and 3 respectively with each copy disabled. I noticed I can’t use the Global Deduplication Policy being used by the Primary Copy on the additional copies. Anyone has some thoughts on how to tackle this? I’m not a fan of using Extended Retention on the Primary Copy as and set Weekly and Monthly retention on one media/point of failure. 

Hello,after upgrading from V11FR20 to V11FR24 I noticed a new schedule policy named “System Created DDB Space Reclamation schedule policy” which was disabled by default.I basically know what the Space Reclamation functionality is about, and the policy has all our deduplication engines assigned. But when initializing this policy it finished in less than a quarter of an hour and from the logs only one dedup engine was processed. Another manual start just gives below error message. Can anybody explain to me what this schedule policy is about and how it is supposed to work? 

Hi Guys, Hope you’re doing well !We have some DDB backup jobs that completes with errors.The job lasts 1 seconds only. In the events, it shows the below message:“job completed immediately as none of the stores are eligible for backup” Do you have any idea on what could be the reason?Thanks a lot for your usual help. Best Regards

Hi all, I would like to ask you if it is possible to add NFS share as Disk library in the CV. If so, is it necessary to mount the NFS share to the media agent before adding it?