commvault.com commvault.com

Events
Platform Updates
Support
How-To Videos
Vault Club

Community
Commvault Cloud Topics
Storage and Deduplication

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

893 Topics
4,088 Replies

When you subscribe we will email you when there is a new topic in this category

893 Topics

Newest first

Recently active Most replies Most views

Marty at ARABit

asked in Storage and Deduplication

Melissa AdamsCommvault Certified Expert

asked in Storage and Deduplication

Egress Charges on AWS Aux copy

Hey all - can someone explain this statement in the Cloud Architecture Guide for AWS (page 29)?Do not utilize an on-premises MediaAgent to perform Auxiliary copy as Cloud egress costs (S3 Pricing >) will be incurred.We have customers doing this very thing and one is having an issue with high egress charges. We are not sure that the charges are from Commvault but want to make sure. The customer turned off data verification but that did not make a difference. They are writing Oracle logs directly to the cloud library (instead of primary onsite) and are very tight on hard drive space and have a lot of index restores happening but I don’t see either of those things causing large Egress. The index restores would come from the primary onsite copy.Can someone point me in the right direction on if there are other things with this aux copy that could cause egress?Thanks!Melissa

1 year ago

tmyooByte

asked in Storage and Deduplication

Backup data from the disk library is not Aging normally.

HelloCommvault Version uses the V11 SP16.The OS of the Media Server with DISK LIBRARY where Aging is not working is AIX.When checking the contents of DISK LIBRARY in Commvault, the data shows 2.21TB written.When checking the CV_MAGNETIC path usage capacity of DISK LIBRARY PATH on the media server, it shows that you are using approximately 11TB.If you have any experience in solving this phenomenon, please share your solution.

1 year ago

Xb-WolfByte

asked in Storage and Deduplication

selective copy media not copied: how do I back up the missed jobs?

Hi, I have a selective copy that backup a week's data on a tape. This tape i export every friday offsite.This week i I did not have more scratch and if i check media not copied on a selective copy i see more data.Now have scratch tape, and if i check jobs faile for storage policy there are more on status: not selected.how do i relaunch those jobs? if i search on job history same jobs id, there are on status completed because not saved only selective copy

1 year ago

Kegan LevettBit

asked in Storage and Deduplication

Drive stuck at the "Media is being Unmounted" status

Hello,I have a tape that appears to be stuck in one of the library drives. The tape itself reports that it is stuck in the drive. I have tried the Clean / Reload / Unload Drive options to do effect. I also restarted the Quantum tape library to see if that helps, again no luck. Cheers

1 year ago

lborekByte

asked in Storage and Deduplication

DDB and disk library limits

Hi! Some time ago we set up Commcell dedicated to Hadoop environment. One media agent, one DDB (two partitions, hosted on local SSDs), deduplication block size increased to 512KB, disk library from few external SAN attached storage arrays. And it keep growing :) Few incremental jobs a day, writing ~10TB, synthetic full each 10 days. Without any performance issues so far. DDB Q&I ~ 500ns. Both backup and restore time acceptable. It’s kind of archive, not typical backup solution. Last month I was asked to disable retention, because ongoing migration activities. And it keep growing faster. I assume until 2PB on disk library by the end of year. So wondering when I’d hit the ceiling for this setup? I know it breaks media agent and deduplication sizing, but until Q&I time are fine everything is acceptable? Or i would hit other limit? It need to survive until end of this year! :) Some numbers below : Thanks!

2 years ago

Eduardo BragaByte

asked in Storage and Deduplication

Drive Cleaning - On sense code option

Hi,Does anyone know what sense codes CVLT interprets to start a drive cleaning job?We suspect that CVLT is starting tape drive cleanup jobs under unexpected and undesired conditions.The option “Set drive as needs on CRC errors” is not checked. In two days we got one new cleaning universal tape that expired. There's another one on the way. A new cleaning tape has 50 cycles. We have a Qualstar model RLS-87120 LTO6 with 5 drives. There is no automatic/schedule cleaning at the Library side. There is drive cleaning schedule on CVLT. We would greatly appreciate it if someone could contact the developers and find out this information. The Tape Library supports a specific sense code to inform a system that its drives needs cleaning.

2 years ago

Xb-WolfByte

asked in Storage and Deduplication

Tape Full and refresh media

Hi, i have more tape mark FULL, but if I see the contents, tape have more data expired and only 3gb not expired!It’s correct that tape remains FULL until everything data has expired?I can work around the problem configuring Media refresh? if this is solution i see on my copy of storage policy and the flag on tag media “Enable media refresh” are greyed out!!Thanks

2 years ago

Pasqual DöhringByte

posted in Storage and Deduplication

Understanding DDB Statistics

Hello there. In the last couple of months I was asked by a few customers where all the data growth on their disk libraries came from. And by digging deeper into that topic I tried to understand the data and statistics from the DDBs. I had to realize that some of those statistics seem to be very odd and that I don’t understand them. So maybe someone can enlighten me. Let’s take a look at a screenshot from statistics of a “normal” DDB: So what do we got here:Deduplication Engine Name: self-explanatoryCreation Time: self-explanatoryVersion: I just take this as it is but is there anything out there but Version 11? Does it refer to Commvault 11? I thought a recent DDB should be Version 5 (or 4.2 if you prefer) and a somewhat older DDB should be version 4. So what does “11” mean”?Total Application Size: AFAIK this is the total data that got backed up into this DDB. All fulls, incrementals and so on before compression and dedupe.Total Data Size on Disk: Seems to be self-explanatoryDeduplicati

1 year ago

Michal128Byte

asked in Storage and Deduplication

Archive backup from local Commserve on tapes to AZURE.

Hello, One of our client has Archive backup on tapes which is configured in one location and that type of infra is managed by local Commserve server. There is a question about the possibility of migration that Archive backup to AZURE. In the end client would like to get all archive backup in AZURE cloud with possibility of manage the backup from Commserve in AZURE cloud which is a different machine (Global solution for organization). And my question what will be the best approach for that migration and how to calculate the storage usage in AZURE for that migration process? Regards, Michal

1 year ago

jmiamaralByte

asked in Storage and Deduplication

DDB Verification in amazon glacer

Hello all, I have an auxiliary copy with deduplication running to a Glacier and i would like to run a DDB Verification on it, just to see an estimate cost for future verifications.What i would like to know is how do i use the workflow Cloud Storage Archive Recall for every job id that is referenced in that DDB, since in the workflow window it makes me choose a backup job id. Kind regards,Jmiamaral

2 years ago

Commvault Engineer

asked in Storage and Deduplication

Migrating VTL backed up data to Disk Library

Hello Community, We have a VTL configured, which backups are saved to it, we want to decommission the VTL while preserving the data backed up.Is there any way to move/migrate the data saved in the VTL to a Disk Library ? And if so, is it possible to enable deduplication on the data migrated from the VTL to the Disk Library to save more space. Kind regards.

2 years ago

Egor SkepkoByte

asked in Storage and Deduplication

Data aging, deleting old jobs

Hello, We have some issues with getting storage space free. When i run Forecast repoort i dont see sometging wrong, mostly jobs are, basic days or last of the week/month underOn the webconsole under Storage - Data Retantion i see 80TB above year. Really i those data i cannot find under the SP.Last week under SP> Summory> Storage Policy / Copy Space storage Recovery prediction i sow 16-4 35TB and 30 TB on 17-4. Under are prediction for this weekAfter aging i sow alot of prunable records in DDB, i run DDB verification and after really didnt sow any space freed on storage. I run Space reclamintation with lvl 1 with Clear orphan data, nothing changes on Storage. I wil uploade dataging log, if need to see sidbprune log i can upload it aswel

1 year ago

JoergByte

asked in Storage and Deduplication

How many drives can we configure to one SAN-Attached tape Library.

V11.25 SAN-Attached Tape LibraryHow many drives are supported at one library? We use a big VTL and have no problem to configure 500 and more to one tape lib. Now we have unclear failures and I want to check in general if we have reached a hard coded limit. We work with 600 and more drives.I looked up documentation.commvault.com but cannot find anything about limits.Can you help?

1 year ago

JohanaByte

asked in Storage and Deduplication

Backup Copy To Tape

Hello, we currently have a server where AD and File System backups are performed (Disk D: and Disk F:). The customer has asked us to copy to tape the F: Disk, how is it done, with an auxiliary copy? Thanks 😊

2 years ago

singhalyogiBit

asked in Storage and Deduplication

DDB for metallic Storage

we are setting up AUX copy to MCSS cold storage for one of my customer and have used IN premise DDB to send dash copy to cloud Storage.I have confusion here.Support our In premise Site/Server goes down.Will i be able to recover my data from cloud after rebuilding CV server? because both in DDB were in local storage only.or Does it copies DDB to MCSS also?

2 years ago

Adel BOUKHATEM

asked in Storage and Deduplication

Synchronize All DDBs grayed out

Hi Guys, I hope everybody is fine !So I ran a health report on my Commserve and on the “DDB Performance and Status” section in the “readiness” column, it shows: Needs resync.When I try to resynchronize the DDBs from Storage Resources→ Deduplication Engines, the “Synchronize All DDBs” is grayed out.The DDB status is showing active.Does it mean that as long as it is online I can’t run the synchronization, or I missed something? Thanks !

2 years ago

Anand KByte

asked in Storage and Deduplication

Configuration of two different NAS disk library using single / two DDB partition

Hello Team,We are planning to configure two different NAS disk libraries with three media agent physical servers.Each media agent server is having dedicated two SSD drives and configuration of RAID1.We want to know each disk library will use seperate DDB or will use single DDB.DDB disk is only one in each media agent server.Thanks and Regards,Anand

2 years ago

Patrick DijkgraafCommvault Certified Expert

asked in Storage and Deduplication

Amazon S3 Standard-IA/Deep Archive WORM questions

Hi all,one of our customers (running CV11.24.43) is interested in configuring a Selective Copy to Amazon S3 Standard-IA/Deep Archive (Combined Storage Tier). So far, no problem.We intend to copy Monthly Fulls. Basic retention will be 365 days and Yearly Fulls will get extended retention set to 10 years.Also, they want to lock the objects to prevent them from being deleted before the retention is met. The “Enable WORM Storage” workflow should take care of that.But it does raise a few questions:Would you recommend using Deduplication in this scenario, or not? If we use Dedupe, I suppose a DDB seal will take place automatically ever 365 days, right? In this combined storage tier, metadata is written to Standard-IA, and actual backup data is stored in the Deep Archive tier, right? Do we set the object-level retention on both tiers? Retention of Index V2 backups does not follow the Storage Policy settings, and might be pruned earlier than the configured retention on the Storage Policy. What

1 year ago

VitasByte

asked in Storage and Deduplication

DDB access - performance transaction logs - SQL - Oracle

Interestingly enough there are 2 conflicting theories regarding SQL and ORA transaction log deduplication and pruning question. There is one from CV support engineer: “We discussed high Q&I times and any way to reduce the load on the DDB.We both acknowledged that SQL Transaction Logs are not deduplicated, however you were curious if the T-Log backups communicated in anyway to the DDB which may impose any, albeit minimal, load or processing on the DDB.I was able to confirm that SQL Transaction Log backups do not communicate with the Deduplication process and therefore will not have any effect on Q&I times: https://documentation.commvault.com/11.24/expert/12434_deduplication_support.html””…………………………...But but but, other CV engineer says if the storage policy used for trans logs is deduplicated, CV is not smart enough and will try to deduplicate anyway. It will also involve pruning at the end of the cycle. And when I look at the jobs from deduplication engine level, I see my tran

2 years ago

Page 20 / 36

Badge winners

CV_USERhas earned the badge Topic Starter 1
LeoLamhas earned the badge Topic Starter 1
SAGAR UPPALhas earned the badge Contributor 1
TomasKhas earned the badge Topic Starter 1
Artem Veselovhas earned the badge Topic Starter 1

Show all badges

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

Commvault Login

Login to the community

Commvault Login

Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.

Username or e-mail

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.