commvault.com commvault.com

Events
Platform Updates
Support
How-To Videos
Vault Club

Community
Commvault Cloud Topics
Storage and Deduplication

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

896 Topics
4,098 Replies

When you subscribe we will email you when there is a new topic in this category

896 Topics

Most views

Recently active Most replies Newest first

kevcorBit

asked in Storage and Deduplication

Identify hot/cool/archive usage in Azure easily

I hope this is simple to answer for someone. I looked in the Azure portal but was unable to find what I was looking for. We’re new to using Azure archive for our secondary copies, and the billing seems higher than expected. Actual billing is showing about five times higher than estimates. We’re wondering if some data is in hot or cool rather than archive. Is there an easy way to identify what is in hot, cool, and archive by a chart or something in the portal?

2 years ago

JohanaByte

asked in Storage and Deduplication

Auxiliary copy to tape

Good morning to all.On a monthly basis I release auxiliary copies to tape ending with a total of 11 tapes.I wanted to do a restore of about 675MB and it asked me for 9 tapes to do it, is this so why the data has been distributed on 9 tapes?Shouldn't it be on one tape only? Since the size of the L7 tape is large. Could it be due to the "Use Scalable Resource Allocation" option? Thank you very much for your help.Best regards,Johana 😀

1 year ago

Melissa AdamsCommvault Certified Expert

asked in Storage and Deduplication

Melissa AdamsCommvault Certified Expert

asked in Storage and Deduplication

Video data backups/secondary copies with Dedupe

Good morning I have a customer that is backing up in car videos (local sheriff’s dept) and he is deduping this data. We have created a new stand alone dedupe database for this data and are using a selective copy to copy weekly fulls to another target. We have set up another stand alone dedupe database for this copy. The customer is having issues getting this data copied over - it’s taking multiple days. The full backup is about 40 TB in size. We have recommended not using dedupe for this copy, but the customer does not have enough capacity for non-deduped copies. Are there any optimizations that can be made to speed up this aux copy? They currently have only 1 subclient backing up all the data - if they split this out, would that help in using multiple streams for the aux copy? Any other suggestions? Thanks

2 years ago

Mohit ChordiaByte

asked in Storage and Deduplication

Isilon Smart lock as WORM Enabled Library

Hi Team,Iam testing Isilon Smart lock feature for storage level immutability with Commvault DASH Aux Copies.My Dedupe is hosted on local drive ( non-worm) on windows media agent .Library is created from smart lock directory from Isilon .My question is that how does CV writes to WORM enabled storage ? As per the current settings on Isilon Smart lock there is autocommit time period of 5 mins ... files that have been in a SmartLock directory for a 5 mins of time without being modified will automatically committed to a WORM state.Can Commvault handle this because i guess there will be chunks which will not modify for 5 mins and need to update later during Aux copy process? Will the Aux copy fail or create new chunks/folders ?What about DDB ? Keeping DDB on non-worm and data on worm is recommended way ?Regards,Mohit

2 years ago

TP_EricksonByte

asked in Storage and Deduplication

Selective Copy Aux Copy No data needs to be copied

Got a storage policy with a active selective Copy that is supposed to copy the data written to a HDD library and copy it to a tape. It missed its aux backup for whatever reason. When trying to manually run an aux copy from the storage policy it tells me there is no Data that needs to be copied when clearly there is no job records of the aux performing backups. How do i force an aux copy without this error popping up .

2 years ago

brucquat

asked in Storage and Deduplication

Deduplication block level factor

Hello,In the documentation Deduplication Building Block Guide (commvault.com), it is mentioned that:“The DDBs created for Windows Media Agent should be formatted at 32 KB block size to reduce the impact of NTFS fragmentation over a time period.”Is the format at 32 KB referring to the block size of the disk itself (NTFS block size) or referring to the “Block Level Deduplication Factor” parameter of the Storage Policy as shown below ?Thanks

1 year ago

PatricGByte

asked in Storage and Deduplication

List all backups currently on tape outside 'Media in Library'

Hi there,We’re running Commvault v.11.21.34Is there a way to get a list of all backups currently on tapes outside the ‘Media in Library’.Some report or other way to get this list. Best regardsPatricG.

2 years ago

drPhilByte

asked in Storage and Deduplication

Aux copy jobs are stuck on 99%

Hi there, have you ever seen in the Job Controller view, that there are some Aux copy jobs on 99% (progress bar) for a couple of days? Moreover, Estimated Completion Time says Not Applicable. However, Application size and Total Data Process number is slightly increasing during the time. And of course, aux copy jobs are in therunning state. My assumption is and it looks like that there are still some jobs needed to be copied from the primary to the secondary policy copy. Is it possible? And is it worth to wait for the job completion or better to kill the job.

1 year ago

Eduardo BragaByte

asked in Storage and Deduplication

DDB Verification and Aux Copy Jobs impact on DDB disk

Could the DDB Verification and the Auxiliary Copy jobs impact on DDB disk in terms of Query & Insert time (the calculation)? We have some Database's Average Q&I Times across Partitions in the last 3 and 14 days with very high values. Backups jobs are running fine. No Performance degradation during backups with a good Deduplication ratio. There are no significant events. Most of the time we’re doing Database Log backups (So, no dedup here) and running Admin Jobs to copy data onto tapes or to create secondary copies. At night, we're doing incremental backups (VMware and FS agents). We have an issue with Synthetic Full backups (https://community.commvault.com/commvault-q-a-2/synthetic-full-is-not-running-based-on-automatic-schedule-settings-2744) and I'm wondering about how this issue also can impact on those times. Some info:VMware VM Media Agents are running updated Linux. 8 CPU cores, 32 GB RAM. DDB Flash disk. Kernel Parameter Configuration done. DDB Verification: Incremental

1 year ago

tsmtmillerByte

asked in Storage and Deduplication

Removing Data from Tapes

Hello, if you have backup jobs on tape and want to delete the contents and reuse the tape, can you just right click the tape and delete contents? I do not know if you right click delete contents will cause any issues in CV with the jobs associated to the tape contents.

1 year ago

neuwiesenerByte

asked in Storage and Deduplication

Disk Volume Size Watermark

Came across this setting and was wondering when this should be used? What is a possible usecase to tweak this setting? Configure Disk Volume SizeDisk volumes are created based on the volume size. When the size of the volume reaches the maximum size, then a new volume is created. The maximum size of a disk volume is set to 25 GB by default, and this value can be modified. On the ribbon in the CommCell Console, click the Storage tab, and then click Media Management. Click the Resource Manager Configuration tab. Modify the Disk volume physical size high watermark in GB parameter as required. From the Disk volume physical size high watermark in GB box, enter the disk volume size. Click OK. https://documentation.commvault.com/11.24/expert/9319_disk_libraries_advanced.html#b9365_use_unbuffered_io

2 years ago

HenkeByte

asked in Storage and Deduplication

Command syntax explained

Hello,Is there someone that can interpret and let me know my assumption on the switches in the below command to are.-j = jobId-i = Deduplication Partition-c = ??-in = CV Instance-cn = Client-group = ??“C:\Program Files\Commvault\ContentStore\Base\SIDB2.exe -j 0 -i 74 -c 178 -in Instance001 -cn client-server 1 -group 0”Also, if anyone know why the above doesen’t have a JobId, or rather why it’s 0. Is it just an internal thing to the SIDB2 process?I’ve seen the command have -j 0 as well as a -j xyz jobId that is searchable. BRHenrik

2 years ago

Melissa AdamsCommvault Certified Expert

asked in Storage and Deduplication

VSS DDB Backup Failures

Hey all - we are having a VSS failure for our DDB backups. Providers look fine but seems like there is some sort of issue with it.Windows Application Log error says the provider could not be started. The provider referenced is the Galaxy VSS Provider Service. It is telling us there are no associated devices.This has been working just fine and then just randomly started failing on Nov 22nd. Nothing has changed on the media agent.When running the vss creation manually - the error is VSS_E_UNEXPECTED_PROVIDER_ERRORCustomer will most likely open a ticket but wondering if anyone has any ideas?PS- we rebooted just for the heck of it...

2 years ago

DaBackupsByte

posted in Storage and Deduplication

Explain like my manager is 5 years old, Data Written, Application size, and Size on disk?

We are low on space. As we look through old jobs, or anything that is still being held on past our retention period. We have plenty of infinite and long term retained items mixed with our regular data in our primary DDB. I’m claiming that the infinite retention or long-term jobs could be hodling reference blocks. This is the reason why we see data size on disk being a reasonable number but the library being full. For example, 800 TB size on disk but the 1.5PB library is full. as we go through jobs, some are seen as not “big fish” because data written may show for example 85GB written for a 1.5TB App size server. We skip and don’t worry about this because, I’m told well 85 GB is only what will come back in space. Let's look for 1TB + being written. I’m thinking that even as we size our future library, we should consider a pool of space that will always sit there and hodl these reference blocks and be “unuseable” space. Hopefully this rant makes sense?

2 years ago

Commvault Engineer

asked in Storage and Deduplication

S3-compatible Object Storage configuration

Hi Community, Recently we acquired an Object storage library, which is compatible with CV (Oceanstore 100D), I was wondering how should it be configured.Should it be configured as a cloud library ? How can it be mapped to our MA ?Sorry if these questions may sound a bit silly, am a nooby regarding object storage, am only used to the classic NAS/SAN storage. Any step by step recommendations would be much appreciated to get a better understanding. Best regards.

1 year ago

Patrick DijkgraafCommvault Certified Expert

asked in Storage and Deduplication

Amazon S3 Standard-IA/Deep Archive WORM questions

Hi all,one of our customers (running CV11.24.43) is interested in configuring a Selective Copy to Amazon S3 Standard-IA/Deep Archive (Combined Storage Tier). So far, no problem.We intend to copy Monthly Fulls. Basic retention will be 365 days and Yearly Fulls will get extended retention set to 10 years.Also, they want to lock the objects to prevent them from being deleted before the retention is met. The “Enable WORM Storage” workflow should take care of that.But it does raise a few questions:Would you recommend using Deduplication in this scenario, or not? If we use Dedupe, I suppose a DDB seal will take place automatically ever 365 days, right? In this combined storage tier, metadata is written to Standard-IA, and actual backup data is stored in the Deep Archive tier, right? Do we set the object-level retention on both tiers? Retention of Index V2 backups does not follow the Storage Policy settings, and might be pruned earlier than the configured retention on the Storage Policy. What

1 year ago

Karamveer SinghBit

asked in Storage and Deduplication

DDB v4 gen 2 table structure

Hi alli need your help to understand table architecture for Deduplication database v4 gen2 table structure and there functioning. There is as such no information available on documentation explaining current ddb table structure. Please help with the information if possible.

2 years ago

vtulerBit

asked in Storage and Deduplication

Failed to verify the device from MediaAgent - Failed to check cloud server status Error: The certificate file is not found. Error = 44336

Hello. I’m trying to configure an Oracle Cloud Infrastructure Object Storage but it’s showing this error: I already put all the information required to configure, such as: Service Host, Tenancy OCID, User OCID, Key’s Fingerprint, PEM Key Filename and Bucket.Also created a config file in .oci folder.What do I have to do to solve this problem?

1 year ago

ChrisKCommvault Certified Expert

asked in Storage and Deduplication

S3 with WORM and extended retention

Situation:primary Backup on site A onto S3 with deduplication, retention of 30 days / 4 cycles, no WORMBackup copy (synchronous) to another site onto S3 with deduplication, retention of 30 days / 4 cycles, extended retention for 365 days (monthly fulls) and 10 years (yearly full), WORM Question:if we enable (object-level) WORM with the Workflow on the Backup Copy storage pool then by default the WORM Lock period is twice the retention, meaning in the above example WORM Lock would be 60 days (2x 30 days). However, how does that affect the extended retention for the monthly / yearly fulls? To what value would the WORM lock have to be set to guarantee that the monthly and yearly fulls are WORM protected for 365 days / 10 years, but all the other backups should follow the “normal” WORM lock of 30 days?If we set the WORM Lock to 10 years (how long the yearly fulls need to be WORM protected) then all backups that get copied would get that 10 year lock, even all the incrementals that get copi

1 year ago

zori92Bit

asked in Storage and Deduplication

Library inventory is in progress

Hi,When I try to export a tape, I get a library inventory is in progress error I can't find a way to solve this problem, any ideas?

2 years ago

Page 11 / 36

Badge winners

shylahas earned the badge Contributor 1
Adithyahas earned the badge Contributor 1
shanmartin84has earned the badge Topic Starter 1
Pradyuhas earned the badge Contributor 5
dpireshas earned the badge Contributor 1

Show all badges

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

Commvault Login

Login to the community

Commvault Login

Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.

Username or e-mail

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.