commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 889 Topics
  • 4,076 Replies

889 Topics

J
Byte
JeremyByte
asked in Storage and Deduplication

DDB Verification not completing in time

Hi,I’m working on an issue with DDB Verification on a HyperScale X environment.I talked to someone at Commvault Support who explained that planned DDB verifications were removed from the best practices on HyperScale X because it could impact Space Reclamation Jobs, aswell as impact performance. However, our customer needs to be able to produce reports to document and prove compliance in regards to ISO certifications. They were able to import a report on their Private Metrics Reporting server so they can generate reports based on Admin jobs.However, they are noticing that DDB verifications are taking a very long time and they aren’t actually completing, so all subsequent DDB verification are just queueing up. The DDBs in this environment are very large.Does anybody have a suggestion how we could solve this issue and actually getting these DDB verification jobs to finish in a timely manner? Would scheduling them more often solve the issue?Looking forward to your suggestions.Jeremy

3
Mike Struening
Vaulter
1 year ago
A
Byte
Ayman SeyamByte
asked in Storage and Deduplication

The path doesn’t have sufficient space to perform a DDB backup

I have installed Linux MA with RHEL 8 OS and attached a 2.9TB NVMe Disk  formatted using LVM and divided In equally into two partitions (1.4TB for each one ) when trying to add storage pool and specify DDB path I get an error (The path doesn’t have sufficient space to perform a DDB backup) although no data written yet  NVMe Partition with no data  

3
I
Byte
1 year ago
N
Byte
Nico BassonByte
asked in Storage and Deduplication

Do not retain intermediate incrementals and differentials before a new differential

Trying to check this option in the Retention tab of the Storage Policy copy, but it doesn't stay selected when I close and re-open the settings window. Am I missing something obvious?

3
Mike Struening
Vaulter
1 year ago
J
Byte
Joel BatesByte
asked in Storage and Deduplication

DDB Update to V5 question - Stop backups -vs.- Temporarily Disable Dedupe

Upgrading my DDB’s to V5, trying to avoid fully stopping backups while I squeeze in the upgrade. Is it possible to check “Temporarily Disable Deduplication”  under Dedupe Engines > [DDB name] > properties > Deduplication > advanced tab, and perform the upgrade? The DDB needs to come offline for compaction. Thanks in advance, Joel Bates

3
J
Byte
1 year ago
Nikos.Kyrm
Byte
Nikos.KyrmByte
asked in Storage and Deduplication

Snap copy to Server Plan

Hello CV community!I see that from 11.24, you can add snapshot copies to server plans.https://documentation.commvault.com/v11/essential/139040_new_features_for_snapshot_management_in_1124.htmlIm not sure, this snap copy in supported only with specific type of storages?Does anyone actually use it ?Please for your feedback,Nikos

3
J
Vaulter
1 year ago
N
Byte
NikkyArtByte
asked in Storage and Deduplication

Delete DDB

Hello!How I can just delete DDB when server with this DDB no longer exists? and these DDB are no longer needed. Why do simple actions in Commvault cause “pain”?

3
Mike Struening
Vaulter
1 year ago
Matthew M. Magbee
Byte
Matthew M. MagbeeSocial Yottabyte
asked in Storage and Deduplication

replication group to dell powerscale

Looking to start a replication group from a VM and default backupset to a mount path on a dell powerscale. Going forward this volume will be san hosted instead of mounted via a server. Upon looking at the config- i dont see an option. Im away replication groups are agent to agent. I thought about makign a library with the location- but even that doenst allow. 

3
Jos Meijer
Commvault Certified Expert
1 year ago
V
Byte
VBalazsByte
asked in Storage and Deduplication

When start using drilling holes?

I have a productive commcell, where all mount path supports drilling of holes (Sparse). When I open a mount path property in Windows, I can see "Size on disk" is much more smaller than the "Size" of the folder. The whole partition smaller than the "Size" of the folder, but of course, larged than "Size on disk".I installed a test environment, where all mount path also supports drilling of holes (Sparse). Scheduled or manual backups are succeed and stored on mount paths. But when I open a mount path property in Windows on test MA, then I can see the "Size" and the "Size on disk" are the same. Or "Size on disk" is a bit larger. If I check a file with "fsutil sparse queryflag", then I get the response: "This file is NOT set as sparse"My question is, when backend file sizes start to decrease? When will be sparse set on backup files, what stored on a sparse supported mounth path?

3
V
Byte
1 year ago
M
Byte
MauroByte
asked in Storage and Deduplication

Device_Label deleted

I understand the DEVICE_LABEL file is used for pruning so it missing could be an issue.I have a customer who's deleted the file off a volume.Will this affect pruning and would there be any other potential issues that could arise?Is there a way to recreate the file if it is required, without recreating the volume?The volume is configured as a WORM device for compliance.Thanks so much.

3
O
Vaulter
1 year ago
C
CarlosPerez
asked in Storage and Deduplication

Refresh arrays with intellisnap

Hi team, I need help designing a Commvault configuration for storage infrastructure renovation. We have a customer who has an old netapp storage with two arrays with snapvault and snapmirror between them managed by Commvault with OCUM and all clients using Intellisnap. The customer will refresh the storage arrays by moving SVMs to new arrays, I am not really sure if just moving the SVM will be completely transparent for Comvault transparent for Commvault or will it be necessary to configure the new arrays, the SVMs, and create the replicas from scratch again. Thank you.

3
T
Vaulter
1 year ago
Patrick Müllner
Byte
Patrick MüllnerByte
asked in Storage and Deduplication

Enable horizontal scaling of DDB

Hi,one Question for Enable horizontal scaling of DDB.Did I need the Baseline Space on the Storage after activation or did he convert the old DDB?Thx!

3
A
Vaulter
1 year ago
J
Byte
JoergByte
asked in Storage and Deduplication

Is ceph supported as mount path of a dedup disklib

My customer has configured a dedup disklib. The shared mount path is a directory in a filesystem working on ceph layer. One night he found a lot of jobs waiting because the library was open for jobs but did not write data to disk. There was an unknown error on the ceph layer and a reboot of nodes solve this issue.  The point is that the library was online and did not went offline during the “ceph error”. Customer reach the maximum limit of jobs and new partial important backup jobs could not start. Now we analyzed what happened. My question here:Is ceph supported as target of a disklib.In BOL I found entries about kubernetes, S3 connection etc. but nothing about using it as mountpath in a filesystem. I know that ceph supports block, file and object level.Thanks in advance for your answers Joerg

3
Damian Andre
Vaulter
1 year ago
X
Byte
xiwenByte
asked in Storage and Deduplication

Cloud library - AWS S3 endpoint

CV server is AWS EC2, cloud library is AWS S3, plan to create VPC endpoint between EC2 and S3, will make sure the data traffic is on AWS backbone. AWS provide gateway and interface VPC endpoint, which one is better?

3
M
Vaulter
1 year ago
LukeBrett
Byte
LukeBrettByte
asked in Storage and Deduplication

Error Code: [19:861] Could not connect to the DeDuplication Database process

Hi,We’ve been having this Error (Error Code: [19:861] Could not connect to the DeDuplication Database process for Store Id [xxx], Process:clBackupChild, JobManager or clBackup) on multiple clients recently (agents seem random : Linux FS, Windows FS, Oracle RAC… v. 11.24.34). Our network team did not change any FW rules.The only temporary solution we found for backups to complete is disabling Client Side Dedup on all clients having the error, but we would prefer not having our MAs do the dedup.If anyone had a similar problem, any suggestion and ideas would be appreciated!Regards

3
Mike Struening
Vaulter
1 year ago
Z
Bit
Zer0c00LBit
asked in Storage and Deduplication

Understanding restore point retention

Hello,I am trying to fully understand restore point retention to achieve my goals. I also have Incident 221117-488 currently open about this.Here’s what I am trying to achieve: a low priority backup plan that runs on a daily schedule, and consistently retains as close to 3 restore points as possible.Here are the settings I currently have for my base and derived planBase plan: WIN_SYS_STD_BASE_LOWSLA: 1 week, inherited from CommCellBackup destinationsPrimary - 3 days retention periodSecondary - 3 days retention periodDatabase optionsLog backup RPO - 4 hour(s)Run full backup every: 1 weekStorage pool Override not allowedRPO Override requiredFolders to backup Override optionalDerived plan (Defines scheduling only): WIN_SYS_STD_BASE_LOW_10PMDefined in Java GUI: Run synthetic full every 3 daysBackup frequency: Run incremental every day at 10:00 PMBackup destinations (Inheriting from base plan)Primary - 3 days retention periodSecondary - 3 days retention periodDatabase optionsLog backup RPO

3
Mike Struening
Vaulter
1 year ago
R
Byte
Rahul MainiByte
asked in Storage and Deduplication

Disable seal deduplication

Can anyone help that how to disable seal deduplication?

3
C
Vaulter
1 year ago
W
Byte
Ward DuncanByte
asked in Storage and Deduplication

How can I verify manually verify contents in cloud

I am manually running an aux copy to an S3 bucket but don’t know how to verify that everything has been copied.  How do I verify that the source library and the cloud copy have the same contents?

3
D
Byte
1 year ago
R
Byte
Rehan BariByte
asked in Storage and Deduplication

Is it possible that high Q&I times can cause the following error message: Description: Timeout while waiting for a reply from DeDuplication Database engine for Store Id [X]

Hello,  I have Oracle backups running which are scheduled through RMAN which occasionally fail with the following error code: “Error Code: [82:177] Description: Timeout while waiting for a reply from DeDuplication Database engine for Store Id [X]” Steps that I have taken to troubleshoot the issue: Dedupe engine is active and running Created a one way persistent tunnel from the client to the commserve and Media agentsas suggested by another thread pertaining to the same issue “ERROR CODE [82:172]: Could not connect to the DeDuplication Database process for Store Id [xx]. Source: xxxx, Process: backint_oracle | Community (commvault.com)”Our Q&I times across the board for our media agents are quite high. For this particular engine the times are 6,416 microseconds (307%). I believe the ddb is not running on SSD, but regular disk. Is it possible that this could be causing the above error? If not I’m not sure what else could be the reason for this. 

3
R
Byte
1 year ago
H
Hrishikesh_Kolhe
posted in Storage and Deduplication

Commvault Best Practice for Deployment

Hi All,What can be the best practice for Implementation/Deployment of commvault tool?

3
Onno van den Berg
Commvault Certified Expert
1 year ago
DMowers
Vaulter
DMowersVaulter
posted in Storage and Deduplication

MANAGING PENDING ACTIONS IN VAULT TRACKER

There seems to be some question surrounding VAULT TRACKER and how to manage PENDING ACTIONS.This is the correct process on how to manage the pending actions for Vault Tracker:https://documentation.commvault.com/11.26/essential/111089_managing_pending_vault_tracker_actions.htmlSince some organizations are retaining there tape footprint for archival and data protection from Ransomware, Vault Tracker is a excellent tool for tape management. Dwayne

3
Mike Struening
Vaulter
1 year ago
C
Carl Brault
asked in Storage and Deduplication

Azure cloud lib with significant iterative read operations

Hello community,I have a customer whose backing up in a disk lib, then auxcopies to an Azure Cloud lib.However, when customer looks at his Azure costs for the last 5 days, they spend over 100 dollars a day in Iterative read operations. I’m trying to figure out what is reading so much from the cloud library. The total written size for a day is 200GB. why 41 million read requests? The DDB Verification is disabled for this library.Is there anything else I should look into?Thanks in advance.

3
C
1 year ago
Gaetano
Byte
GaetanoByte
asked in Storage and Deduplication

Waiting for send queue to get emptied.

Hi all,one question about DDB Verification jobs.The verification jobs for one of our DDBs takes quite a long time, usually a matter of days. When I check the ScalableDDBVerf.log file I see many messages like this  WARNING - Waiting for send queue to get emptied. Curr Size [200] Should I consider this a symptom of a problem? Thank you in advanceGaetano

3
Gaetano
Byte
1 year ago
D
Byte
DaveKByte
asked in Storage and Deduplication

Auxcopy job, one stream

I have an Auxcopy Source (HYperscale-X), destination (Hy7perscale). I have max numbers of readers set and multiple mount paths set on the Copy. I have thousands of jobs in the Auxcopy, yet only one stream gets allocated. What am I missing?

3
J
Vaulter
1 year ago
S
Byte
SteveMByte
asked in Storage and Deduplication

Unable to add network disk storage

We have CV 11 .24.56 and using Dedupe.  We already have this Disk Library setup and were using 60% of the library but now we wanted to add another mount path and use the other 40% because no one ever used the storage space!  I cannot send screenshots so I will try to explain. We have a Primary site (Pri-1) and an Alternate site (Alt-1) and Commvault copies the data to the Pri-1 Disk Library and then we do a Dash Copy of the data to the Alt-1 Disk Library so we have 2 online disk libraries one at each site and the libraries each have their on Folder or Mount Path and we have Global Dedupe policies one setup for the Pri-1 Library and another Global Dedupe setup for Alt-1 Library. (This is how it was setup by installer).   My issue is that when I went to add the extra storage I was able to add the storage as a new Disk Library with a new Mount path successfully.  The libraries show up in Commvault as Alt-2 and Pri-2 under the library.  I then was able to add this second  Primary Data site

3
Jos Meijer
Commvault Certified Expert
1 year ago
G
Byte
gibby101Byte
asked in Storage and Deduplication

Windows media agent boostfs to DD6900

Is anyone using a data domain (we are using a 6900). its attached to a Windows media agent using Boostfs. Its new and we started doing backups about two weeks. All the backups completed successfully. Then we tried to do a tape aux copy and started gettiing a couple data verification errors some of the jobs. Id like to compare settings with someone because i can’t figure out whats causing it.

3
C
Vaulter
1 year ago

Badge winners

  • Topic Starter 1
    RobinHhas earned the badge Topic Starter 1
  • Contributor 1
    PPChas earned the badge Contributor 1
  • Contributor 1
    ACTREChas earned the badge Contributor 1
  • Contributor 1
    Waleed Al Mansorihas earned the badge Contributor 1
  • Topic Starter 1
    ACTREChas earned the badge Topic Starter 1
Show all badges
Terms & ConditionsCookie settings