Skip to main content

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 1,001 Topics
  • 4,426 Replies
1001 Topics
J
Byte
JeremyByte
asked in Storage and Deduplication
Issue with creating a recovery point for Exchange database

Hi! We trying to create a Recovery Point to recover a specific e-mail but the job fails after a couple of seconds. We do see a “ Error Code [655362] returned - [Error decrypting password]. “ in the logs. Not sure what password is referenced here. It concerns a intellisnap snapshot which is available on the storage. Has anyone seen this error before?

7
J
Byte
5 hours ago
I
Byte
IggyByte
asked in Storage and Deduplication
Indexing Job Retention & Data Aging

Hi All.Can someone please explain how data aging functions on an Indexing job?Referring to "https://community.commvault.com/self-hosted-q-a-2/why-are-index-server-jobs-agent-type-big-data-apps-being-retained-on-storage-longer-than-the-storage-policy-indicates-5132".I have a storage policy with several copies to different libraries. This is a mix of disk, S3 and S3 with Object Lock enabled.There are several Indexing Jobs which reside on the S3 library with Object Lock enabled but the dependent backup jobs are located on a different selective copy. Is there a way to have the Indexing jobs kept with the backup jobs or is this by design?The issue here is that the Object Lock enabled library is configured with 90 days retention and the other S3 library is configured with long-term retention varying between 365 days to 1825 days.The above behaviour is preventing the sealed DDBs from being removed when all backup jobs have met retention as the Indexing jobs are retained.I have seen the inform

7
H
Vaulter
1 month ago
F
Byte
Farmer92Byte
asked in Storage and Deduplication
Storage for On-Prem Commault install

What are folks using for the storage to backend your On-Prem Commvault installation?Today we are using IBM fiber channel arrays.  They are getting a bit old, and we are looking to refresh. Are you using FC SANs? IP?  ISCSI? NFS? SMB?What vendor hardware are you using?  Are you happy with it?Any other info you would like to share would be greatly appreciated.

7
K
Byte
3 months ago
S
Byte
SahiNoByte
asked in Storage and Deduplication
Move old DDB and Mount Path to new Media Agent to dismantle the old MA

Hello everyone, I have a quick question, I am fairly convinced this is the way to do it, but due to the nature of it, I am unsure and want to make extra sure.A few months ago, we deployed a new media agent in one of our Commcells, to replace the old Media Agent which was going EOL. We would now like to dismantle the old EOL, however, the old DDB on the old MA is still showing referenced jobs (132 of them):  We are now at a point where we can no longer wait for these jobs to naturally age out. Along with support, we have worked out a process to move all data away from the old media agent. This involves moving the mount path still residing on the old media agent to the new one using this process: https://documentation.commvault.com/2023e/expert/156684_moving_mount_path_to_new_location.html as well as moving the old, sealed DDB to a new partition on the new media agent. Then, we would check all jobs in the sealed DDB to make sure they are now referencing a path on the new media agent, and

7
S
Byte
6 months ago
Yuggyuy
Byte
YuggyuyByte
asked in Storage and Deduplication
11.32, S3 Object Lock and the Architecture Guide.

Hello. I’ve been doing a lot of reading, I’ve seen the threads on here and I’ve read the architecture guide but I am still a little puzzled as to what I actually need to configure.I would like to apply WORM in the Commcell and object-lock in S3IA.I believe objects will be aged from the bucket when the DDB seals periodically.  This happens at the same period as the policy copy retentionI still don’t quite understand why bucket object retention has to be set to twice the policy copy retention.I also can’t work out if I need to add a lifecycle config rule and set the  non current version expiration to 2 days.  I know this needs to be done for none object-locked buckets that don’t have versioning enabled, but an object-locked bucket does.  Does anyone else use worm and ol, what are your configs?  Do you see issues where the size that Commvault reports is not the same as the actual bucket size due to objects not expiring? Thanks,

7
Yuggyuy
Byte
6 months ago
Fernando Souza
Byte
Fernando SouzaByte
asked in Storage and Deduplication
DDB - Cluster Windows - Doubts

Hello,I have a doubt in setting up DDB Creation in awindows cluster environment.2 physical servers with installed media agent and a virtual storage (starwind)1) can the DDB be on the storage shared by the nodes of the cluster?2) Can I use only 1 DDB for all nodes (MA) or should I have a DDB for each MA? 

6
L
Vaulter
3 years ago
M
Byte
ManikandnByte
asked in Storage and Deduplication
Regarding Dedup path for cloud Storage pool creation

Hi Team, I have a HyperScale with 6 node cluster in on-prem for primary copy. For Secondary copy I need to move the data to Cloud (Archive Storage).My doubt is, when I am creating the Cloud Storage Pool, Do I select the existing (On-Prem) de-dup path (/ws/ddb/P_1/Copy/_21/Files/31) ( or) Do I need to create a dedicated the dedup path in the on-prem MAIf I need to option 2, then what is the recommended dedup partition value and reason behind that?  And also share the your best practice for hybrid data protection, if any.  Thanks,Manikandan

6
M
Byte
3 years ago
A
Vaulter
akirbyVaulter
asked in Storage and Deduplication
Limiting the data ports used to send data between Media Agents

Hi.  We have a complicated setup where we are using a Topology Group to send data between Media Agents through a Firewall and Proxy.  Once the data hits the Firewall all data is forced into 2 tunnel ports.In addition to this control we would like to reduce the number of source ports being used so that these can be monitored for backup flow.  Currently using the Dynamic Port Range 49152 and 65535 does not allow us to do this.Is it as simple as forcing all data traffic into the tunnel (8403 by default) and if so will this create a bottleneck.Thanks, Andy

6
Mike Struening
Vaulter
3 years ago
Ken_H
Byte
Ken_HByte
asked in Storage and Deduplication
Possible to increase the Aux Copy anomaly threshold?

I do full backups of production servers on Friday night and non-production servers Saturday night.  Every Monday my inbox has roughly 20 anomaly emails about aux copy jobs running longer than usual.  This has been going on for months now.  Is it possible to tweak the anomaly thresholds in CommVault so I get fewer emails?Ken 

6
Mike Struening
Vaulter
3 years ago
P
Commvault Certified Expert
PatrikCommvault Certified Expert
asked in Storage and Deduplication
Dedup Data Written expands with new DD-engine

Hi, We are setting up a new Windows MA with new DD-Engine and a new DiskLib. The DDB disk has been configured with recommended 32k block size and the DiskLib volumes with 64k block size. We have run a new DASH Copy in the SP to create a new dedup baseline from the previous backed up data. And the plan is to make this DASH Copy the new Primary once all data is available. A standard re-baseline operation, that usually get better dedup ratio with an updated DD-Engine. The backup data is mostly Hyper-V vm’s. In this case the Data Written in the old copy was 9TB and the Copy stopped att 18TB in the new MA as it ran out of resources - DiskLib Full. This was unexpected. Now we are thinking about doing Move DDB and MountPath but if there is a general Deduplication degration we are not sure if this will work, and if we will run into the same issues again. Does anyone have a similar experience or knowledge about this issue and a recommendation on how to move forward?I have done both new baseline

6
Mike Struening
Vaulter
3 years ago
neuwiesener
Byte
neuwiesenerByte
asked in Storage and Deduplication
Stream allocation for Auxcopy

Could someone explain a flow of process for allocating readers for an auxcopy job?What does stream allocation take place in CVJobReplicatorODS exactly? I see that the number of readers is a function of num of CPU and RAM. By default, each CPU in a proxy can support 10 streams, and each stream requires 100 MB of memory. For e.g for VSA.E.g. My VSA backups were backed up with x number of readers and y number of writers to HPE StoreOnce Catalyst.How does the replication agent (auxcopy) decide and allocate readers for copying a list of N jobs to tape. Imagine there is a primary copy → Storeonce Catalystsecondary copy → tape (combine streams to 2 tape drives with multiplexing factor of 25). Number of readers varies from 12 to 38 in my environment. It appears that the number of readers used for the subclients plays a role in the number of readers that will be assigned in the auxcopy. My goal is to increase the readers for the auxcopy jobs for improving the performance. My auxcopy with 38 rea

6
Emils
Vaulter
3 years ago
J
Byte
jparaujoByte
asked in Storage and Deduplication
run auxiliary copy when full backup is done

Hi guys, I have storage policy SP_A that run daily monday-saturday incremental and sunday FULL.I have a secondary copy in this SP_A that run a scheduled at MONDAY 23h a selective copy of a full weekly backup.I wonder if I can get this behaviour: the same auxiliary copy of a secondary copy with the last full backup of week but that runs just after primary copy finishes.Is it possible get this?

6
Mike Struening
Vaulter
3 years ago
S
Vaulter
shaleyVaulter
asked in Storage and Deduplication
How do I troubleshoot slow backups or restores coming from or writing to disk?

I have general slow performance from my backend storage.  How can I determine the issue on my backend storage?

6
Mike Struening
Vaulter
2 years ago
E
Byte
EldanByte
asked in Storage and Deduplication
Can't do Online Full SAP for Oracle backup

getting the following errorError Code: [82:172]Description: Could not connect to the DeDuplication Database process for Store Id [44].Source: sapdrfr7, Process: backint_oracle don’t find the backing oracle processany suggestions? 

6
Mike Struening
Vaulter
3 years ago
G
Byte
gibby101Byte
asked in Storage and Deduplication
question about setting up exchange db client to backup all passive DBs.

We have four Exchange servers. Each DB has a passive and active copy with them being on different servers. We installed the media agent and a backup disk on the exchange db server. Usually i know what DBs are passive on each server so i setup a subclient on each one so the back up will run from the passive disk directly over the SAN to the backup disk without using the network. However sometime exchange admins will do patching late at night and the DBs will failover and they wont fail them back til later. when this happens the db backups are much slower. I want to avoid this by configuring each subclient to only backup the passive DBs that are on the same server as the media agent/backup disk. my goal is to never run backups over the network even when DBs are failed over to other servers. is this possible? 

6
Mike Struening
Vaulter
3 years ago
B
Byte
Baba ImaniByte
asked in Storage and Deduplication
Add Azure Storage Account Container as an Independent Library

I have a question. We have a Azure storage account container “backup” added as Cloud Storage Library in Commvault. This storage account and container is provisioned in Commvault as CL_Backup library. Can I create an additional container in the same storage account, name it “newbackups” and add it as a separate library in Storage Resources called CL_SecondaryBackups for example?I’m trying to leverage data cost savings in Azure by using the same storage account but with multiple containers.

6
Mike Struening
Vaulter
3 years ago
D
Byte
drPhilByte
asked in Storage and Deduplication
Reservation Status: No new readers can be allocated

Hello, in the log of aux copy job (primary copy(disk storage) to secondary copy (tape library), there is this information: "Reservation Status: No new readers can be allocated, check for additional streams after [900] seconds, pending streams [1]". Can you explain here, what does it mean and possibly how to avoid this? Can this state caused slow backup performance?

6
L
Byte
3 years ago
Patrick Dijkgraaf
Commvault Certified Expert
Patrick DijkgraafCommvault Certified Expert
asked in Storage and Deduplication
Does convert to DDBv5 also enable Horizontal Scaling?

Hi all,Sorry for yet another question. But I love the quick feedback I get on this platform! :-)I have a customer running DDBv4 who wants to leverage DDBv5 with Horizontal Scaling.I know that we have the ConvertDDBToV5 workflow, or alternativelywe could convert the DDB manually.But would that also enable Horizontal Scaling automatically? Or is there some separate procedure required for getting horizontal scaling?Thanks in advance for your reply!

6
Mike Struening
Vaulter
3 years ago
B
Byte
Baba ImaniByte
asked in Storage and Deduplication
Best Way to Confirm Combined Storage Tiers Functioning

What’s the easiest way to confirm a Cool/Archive cloud library is working? I have migrated data from a Hot storage blob container. I provisioned an additional storage container as Hot in Azure and provisioned it as Cool/Archive as recommended by Commvault. I attempted a restore of a file from this Archive library and the restore just completed as normal without the use of a workflow so I’m worried the data isn’t in the Archive tier as expected. Any ideas how to confirm the data is actually in Archive and Metadata is in Cool? And why was the restore just standard? 

6
Mike Struening
Vaulter
2 years ago
V
Byte
virgilByte
asked in Storage and Deduplication
Can't Move Tape to an appropriate scratch pool

Hi ,just a simple question.i  try to copy data to a assigned media but can’t move the tape to appropriate scratch pool.the media is mark to appendable.there is an option or a prerequisites to do this actionthanks for anwers.regards

6
Mike Struening
Vaulter
3 years ago
S
Byte
Sudharshan KumarByte
asked in Storage and Deduplication
Media Retirement

Hello Team,  Just thought to discuss with everyone, we have lots of medias thats turn into "Deprecated” moved to Retire Pool which are very less usage. When am looked the information in Media Properties shows below message,   When I could see Side information, shows ver less usage info : As per the default CommVault Media Hardware Maintenance shows as below,  Here my question is : Whether those medias mark as good and re-use for future its advisible? Can you someone clarifity from MM. @Christian Kubik 

6
Mike Struening
Vaulter
3 years ago
J
Bit
jcutter03Bit
posted in Storage and Deduplication
Tape Library Options

Hello everyone, hopefully wanting to get some recommendations and possibly help. We are currently shopping to replace our HP LTO6 SAS Tape Libraries. We are looking at the Quantum i3’s to support LTO8. First off let me explain our setup2 Media Agents 4 Tape Libraries (HP LTO6) - 2 of them directly connected 6GB SAS to 1 media Agent and the other 2 drives directly connected 6GB SAS to the other media agentWe are looking at the i3 but would want both media agents to be able to utilize the same drives from the unit. We know how we currently have it setup and 2 drives belong to one media agent and the other 2 to the other. So some quick questions:Any recommendations on other brands we should look at?  Anyone recommend the quantum tape drives? What would the setup of this look like from a SAS to Media Agent setup look like? Right now obviously 1 media agent can’t use the other’s tape drives and we dont want to be in this position in the new setup. If we have 4 drives we want all of our medi

6
M
Vaulter
3 years ago
B
Byte
Baba ImaniByte
asked in Storage and Deduplication
Deduplication on Independent Copies for Azure Cloud Backups

Hello guys. I’m looking for some advice/tips on how best to configure additional selective copies in a storage policy and ensure they are deduplicated to avoid rewriting the same blocks on cloud storage. The Primary Copy is deduped and goes to Library 1. I want Weekly and Monthly copies to go on Library 2 and 3 respectively with each copy disabled. I noticed I can’t use the Global Deduplication Policy being used by the Primary Copy on the additional copies. Anyone has some thoughts on how to tackle this? I’m not a fan of using Extended Retention on the Primary Copy as and set Weekly and Monthly retention on one media/point of failure. 

6
Sean Crifasi
Vaulter
3 years ago
I
Commvault Certified Expert
iConsultantCommvault Certified Expert
asked in Storage and Deduplication
Tape usage - Size of Stored Data

Hi,Until recently, ~1 TB of data was stored on all our LTO4 tapes.I recently changed 2 things:I created a Global Secondary Copy Policy I enabled software encryption for the (secondary) backups to tape (Re-encrypt, BlowFish, Key length 128, No Access)Now, only ~750 GB of data is stored on all tapes before they are marked full. A decrease of 25%.Is one of these two changes a known, proven and expectedcause for this decreased usage of the tapes?Thanks!

6
Mike Struening
Vaulter
3 years ago
K
Bit
Kevin O'NeillBit
asked in Storage and Deduplication
On Prem Aux copy to S3?

We are looking into adding an additional layer of offsite backup storage. Amazon S3. The current idea would be add a 3rd copy to an existing storage policy. This copy would reflect the AWS S3 library. Can I Aux copy on premise backup data using physical on premise media agents directly to S3 Any suggestions would be appreciated. Thank you

6
L
Byte
3 years ago

Badge winners

Show all badges
Terms & ConditionsCookie settings