commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 891 Topics
  • 4,088 Replies

891 Topics

K
Bit
Knorr-BremseBit
asked in Storage and Deduplication

Can't change storage policy

Due to the fact of changing the backup storage infrastructure, I only want to change the storage policy.Our former strategy was to have a spool copy and to aux copies - one to NAS and one to LTO.This was done due to the fact that we had a performance/backup time issueWe solved this by direct attached SSDs to the backup server.Now I want to set a retention to the primary copy and delete the no longer needed Aux copy to NAS. This points also to the same storage (the local SSDs) and wastes the need space on this.If I want to change the retention on the primary storage policy I get error shown in the screenshot and changes are discarded.I don’t know where to find these settings (Archiver retention rule and “Onepass”) I have never set a archiver (retention rule), we are not using archiving  

2
K
Bit
1 year ago
S
Bit
ScottNBit
asked in Storage and Deduplication

S3 Object Locking and Versioning

There is a related topic regarding my question but I don’t feel it was adequately answered:  Essentially there is a conflict in documentation regarding versioning and how object locking works. Firstly the public cloud architecture guide for AWS states that bucket and object versioning is not supported in Commvault (p. 85 of AWS Cloud Architecture Guide - Feature Release 11.25 (commvault.com))However, when enabling object locking in AWS, versioning is enabled by default on the bucket and objects - it is by design. Under ‘Enabling S3 Object Lock’ section (https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-lock-overview.html) it states that versioning is enabled.So if Commvault doesn’t support versioning (and will result in orphaned objects), how can Commvault support object locking, which also enables versioning?We have also tested this in the lab and can confirm when object locking is enabled, we do not see any data prune from the cloud library. We have run the workflow, store

5
J
Vaulter
1 year ago
D
Byte
drPhilByte
asked in Storage and Deduplication

Aux copy jobs are stuck on 99%

Hi there, have you ever seen in the Job Controller view, that there are some Aux copy jobs on 99% (progress bar) for a couple of days? Moreover, Estimated Completion Time says Not Applicable. However, Application size and Total Data Process number is slightly increasing during the time. And of course, aux copy jobs are in therunning state. My assumption is and it looks like that there are still some jobs needed to be copied from the primary to the secondary policy copy. Is it possible? And is it worth to wait for the job completion or better to kill the job.  

9
Matthew M. Magbee
Byte
1 year ago
Nikos.Kyrm
Byte
Nikos.KyrmByte
asked in Storage and Deduplication

Secondary Copy from Primary Storage Policy only with daily backups

Hello community ! I try to find a way to send only weekly and monthly backups to a secondary storage (Azure Blob Storage) from a Primary Storage Policy that haves only daily backups (7 days retention).I see from Aux-Copy wizard, that the only way is to create a Selective Copy with only full backup jobs. So, basically to copy only synthetic fulls once a week in my case.But, I cant figure it out, how to copy also monthly jobs!Please for your feedback!Best regards,Nikos

4
C
Vaulter
1 year ago
J
Byte
JoergByte
asked in Storage and Deduplication

Is ceph supported as mount path of a dedup disklib

My customer has configured a dedup disklib. The shared mount path is a directory in a filesystem working on ceph layer. One night he found a lot of jobs waiting because the library was open for jobs but did not write data to disk. There was an unknown error on the ceph layer and a reboot of nodes solve this issue.  The point is that the library was online and did not went offline during the “ceph error”. Customer reach the maximum limit of jobs and new partial important backup jobs could not start. Now we analyzed what happened. My question here:Is ceph supported as target of a disklib.In BOL I found entries about kubernetes, S3 connection etc. but nothing about using it as mountpath in a filesystem. I know that ceph supports block, file and object level.Thanks in advance for your answers Joerg

3
Damian Andre
Vaulter
1 year ago
G
Byte
gibby101Byte
asked in Storage and Deduplication

Data Transferred over network

i see this all the time and i never understood it. we make backup copies from disk to tape, both attached to the same media agent. During these aux copies it has the Data Transferred over Network number, which I think should be 0, but there is usually a number there. For example this aux job has these numbers, still running:Total Data Processed: 3.23 TBData Transferred Over Network: 107.95 GBTotal Data to Process: 4.7 TB

2
Onno van den Berg
Commvault Certified Expert
1 year ago
J
Byte
Joel BatesByte
asked in Storage and Deduplication

DDB Update to V5 question - Stop backups -vs.- Temporarily Disable Dedupe

Upgrading my DDB’s to V5, trying to avoid fully stopping backups while I squeeze in the upgrade. Is it possible to check “Temporarily Disable Deduplication”  under Dedupe Engines > [DDB name] > properties > Deduplication > advanced tab, and perform the upgrade? The DDB needs to come offline for compaction. Thanks in advance, Joel Bates

3
J
Byte
1 year ago
V
Byte
Vaibhav WaghmareByte
asked in Storage and Deduplication

Aux copy issue

Kindly suggest how to run Aux copy on 2 tape media simultaneously. we observed previously aux copy were written on 2 tape simultaneously but now we facing delay in Aux copy operation data is copying on the single tape media

4
M
Vaulter
1 year ago
L
Bit
Laurent LabonteBit
posted in Storage and Deduplication

Identifying traditionnel DDB version on the log to the MA

How and where to identify the traditional DDB version on the management agent login the log "SIDBEngine.log on the media agent we find this 6292 126c 12/16 13:00:19 ### 1-0-1-0 LoadConfig 313 Use MemDB [false] But you can't see the version number? And do you have a version number? does it exist?

1
Damian Andre
Vaulter
1 year ago
Marco Lachance
Byte
Marco LachanceByte
asked in Storage and Deduplication

My customer is currently at 11.24.60, should I upgrade the environment to 2022E prior to start deploying the HSX Cluster ?

Hi, quick on the ISO 2.3 for reference architecture deployment dvd_10072022_113351.iso ?I don't know if I’m in the right place for the question but !This ISO is based on which FR ? FR.24 !?My customer is currently at 11.24.60, should I upgrade the environment to 2022E prior to start deploying the HSX Cluster ?I’ve seen a lot of new features for monitoring and securing nodes !Thank you,     

2
Graham Swift
Vaulter
1 year ago
C
Commvault Certified Expert
ChrisKCommvault Certified Expert
asked in Storage and Deduplication

S3 with WORM and extended retention

Situation:primary Backup on site A onto S3 with deduplication, retention of 30 days / 4 cycles, no WORMBackup copy (synchronous) to another site onto S3 with deduplication, retention of 30 days / 4 cycles, extended retention for 365 days (monthly fulls) and 10 years (yearly full), WORM Question:if we enable (object-level) WORM with the Workflow on the Backup Copy storage pool then by default the WORM Lock period is twice the retention, meaning in the above example WORM Lock would be 60 days (2x 30 days). However, how does that affect the extended retention for the monthly / yearly fulls? To what value would the WORM lock have to be set to guarantee that the monthly and yearly fulls are WORM protected for 365 days / 10 years, but all the other backups should follow the “normal” WORM lock of 30 days?If we set the WORM Lock to 10 years (how long the yearly fulls need to be WORM protected) then all backups that get copied would get that 10 year lock, even all the incrementals that get copi

4
C
Commvault Certified Expert
1 year ago
S
Byte
Shalika SenadeeraByte
asked in Storage and Deduplication

Unable to use disk mount path

Mount path volume is dirty. Please run chkdsk on this volume

5
Mike Struening
Vaulter
1 year ago
G
Byte
gibby101Byte
asked in Storage and Deduplication

Windows media agent boostfs to DD6900

Is anyone using a data domain (we are using a 6900). its attached to a Windows media agent using Boostfs. Its new and we started doing backups about two weeks. All the backups completed successfully. Then we tried to do a tape aux copy and started gettiing a couple data verification errors some of the jobs. Id like to compare settings with someone because i can’t figure out whats causing it.

3
C
Vaulter
1 year ago
B
Byte
BatuhanByte
asked in Storage and Deduplication

How to increase streams for DAG backup and restore jobs?

Hi all, I have a DAG cluster and it has 7 TB data. Backup job complate 1 day about. Restore jobs duration time worse than backup jobs duration time(1.5 day about). How can I reduse this times(Backup and restore but restore important than backup)? I tried increase stream number but its not working.

1
O
Vaulter
1 year ago
Gaetano
Byte
GaetanoByte
asked in Storage and Deduplication

Waiting for send queue to get emptied.

Hi all,one question about DDB Verification jobs.The verification jobs for one of our DDBs takes quite a long time, usually a matter of days. When I check the ScalableDDBVerf.log file I see many messages like this  WARNING - Waiting for send queue to get emptied. Curr Size [200] Should I consider this a symptom of a problem? Thank you in advanceGaetano

3
Gaetano
Byte
1 year ago
E
Byte
ElmerTByte
asked in Storage and Deduplication

Proper disk configuration for new CV server

Hi, We have recently acquired a new server and storage as part of our hardware refresh for the Commvault server.The new server have the following:2x 480GB SATA SSD configured as Raid 1 (OS installed)2x 1.6TB PCIe SSD - still deciding whether to use host based mirroring or leave it as standalone disks, intended use is for SQL database, DDB, and index. The old server has the following disk configuration:OS - 558GB - 173GB usedSQL - 278GB - 866MB usedDDB - 418GB - 25.6GB usedCommvault V11 SP16 HPK17 Any recommendation for the new server’s disk configuration? If I will use host based mirroring will it have impact on the server’s performance? Which Commvault version should I use? 2022E or 11.26? Thank you in advance. 

2
Steven Robinson
Vaulter
1 year ago
Gaetano
Byte
GaetanoByte
asked in Storage and Deduplication

Weird System Created DDB Space Reclamation schedule policy

Hello,let me ask your opinion about the following situation.When I check the details of the System Created DDB Space Reclamation schedule policy I see that it looks like “corrupted”.As you can see in the attached image, in the summary screen it shows Type “Data Verification” while in the dialog the type is “Data Protection”. Moreover, the Associations  tab shows the list of Clients instead of the DDB list.Is this normal? How can I get rid of this?  Thank you in advanceGaetano

8
Gaetano
Byte
1 year ago
R
Byte
Rahul MainiByte
asked in Storage and Deduplication

Disable seal deduplication

Can anyone help that how to disable seal deduplication?

3
C
Vaulter
1 year ago
C
Commvault Engineer
asked in Storage and Deduplication

Configuring WORM on cloud storage

Hi All, Was documenting about the WORM activation on our cloud storage, from different threads here and using the documentation. Came across different questions, which I hope will get some answer through this topic.1 - On the link that follows, it’s stating that “Note: Once applied, the WORM functionality is irreversible”.Does that mean when we activate the WORM on the storage through the workflow, we cannot change the retention ? We wanted as a first time test the WORM, with the setting of the retention of one storage policy copy on the storage pool as a test with 1 day only. Does that mean that we cannot change the retention of the workflow to something else ? Let's say 15 days. 2 - Same from the link, since our storage pool is using deduplication, it’s stated that the retention on the storage will be set twice of the one on the storage pool, our copies on the storage pool will be set to 15 days, does that mean the data will remain for 30 days on the storage without being deleted, af

7
C
Vaulter
1 year ago
J
Bit
JasonTFBit
asked in Storage and Deduplication

Data Domain DDBoost feature

My company is planning to do a tech refresh on our aging data domain to a newer version. We also highlighted that we’re having backup slowness issues on some of our large Oracle databases & some NDMP backups. Our current configuration is backing up to a VTL located in our data domain & no compression or deduped are enabled from Commvault layer.Dell’s sales team advice us to purchase an additional license for DDBoost for the new Data Domain. This is because DDBoost will be able to perform a very good dedupe & compression rate from the source level before transferring it to our data domain, thus saving the time it took to transfer via network.However I’ve been checking around Commvault’s KB and looks like commvault only works with BoostFS & not DD Boost. I haven’t check with Dell yet regarding this. May I know has anyone implemented DDBoost on your environment for backing up databases/vm & NDMP? 

24
Onno van den Berg
Commvault Certified Expert
1 year ago
Y
Bit
ythetiotBit
asked in Storage and Deduplication

Boost FS and Grid store

Actually we testing boostfs (Data Domain) with Commvault it’s possible to configure two MA in Grid store with Boost FS ?? 

2
A
1 year ago
Z
Bit
Zer0c00LBit
asked in Storage and Deduplication

Understanding restore point retention

Hello,I am trying to fully understand restore point retention to achieve my goals. I also have Incident 221117-488 currently open about this.Here’s what I am trying to achieve: a low priority backup plan that runs on a daily schedule, and consistently retains as close to 3 restore points as possible.Here are the settings I currently have for my base and derived planBase plan: WIN_SYS_STD_BASE_LOWSLA: 1 week, inherited from CommCellBackup destinationsPrimary - 3 days retention periodSecondary - 3 days retention periodDatabase optionsLog backup RPO - 4 hour(s)Run full backup every: 1 weekStorage pool Override not allowedRPO Override requiredFolders to backup Override optionalDerived plan (Defines scheduling only): WIN_SYS_STD_BASE_LOW_10PMDefined in Java GUI: Run synthetic full every 3 daysBackup frequency: Run incremental every day at 10:00 PMBackup destinations (Inheriting from base plan)Primary - 3 days retention periodSecondary - 3 days retention periodDatabase optionsLog backup RPO

3
Mike Struening
Vaulter
1 year ago
S
Byte
SHASHAByte
asked in Storage and Deduplication

Maglib status implementation in Grafana

Hi All,Has anybody worked on bringing in the Commvault maglib status and tape media usage status to Grafana dashboard? Is there anyway to showcase the usage trend and capacity reporting based on maglib utilization and publish in Grafana?Possibly if we can take the real time data from Commvault then we can pretty much show this metric in Grafana. Any leads?

9
M
Bit
1 year ago
D
Byte
dorotaByte
posted in Storage and Deduplication

Disk Library on LVM or gpt disk

Hi,I'm setting up the new Linux (Red-Hat) MediaAgent right now and I have a "what would be better" question. Maybe someone would like to share experiences :) On this new MediaAgent I plan to create a new disk library. MediaAgent will have available resources via SAN from an array (several volumes of 8TB each). Is it better to do LVM on these volumes (create vgs, create lvols and finally create filesystem - for example ext4) or better to make a gpt (parted) partitions and create ext4 without creating vgs and lvols?I am very curious about your opinion what would be a better solution.greetings 

5
D
Byte
1 year ago
Patrick Müllner
Byte
Patrick MüllnerByte
asked in Storage and Deduplication

Enable horizontal scaling of DDB

Hi,one Question for Enable horizontal scaling of DDB.Did I need the Baseline Space on the Storage after activation or did he convert the old DDB?Thx!

3
A
Vaulter
1 year ago

Badge winners

Show all badges
Terms & ConditionsCookie settings