Skip to main content

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 994 Topics
  • 4,399 Replies
994 Topics
D
Bit
doms24Bit
asked in Storage and Deduplication
Changing Azure Storage Tiers

We have been using Azure Storage accounts as offsite libraries for years.   We fully take advantage of cool storage tier, but with our usage history, I would like to start setting the Commvault Azure Libraries to archive storage tier.   What is the best way to get the blobs assigned to the archive tier?  I assume that only new written data will have archive and the rest will have COOL, until it is pruned.  Retention varies from 1 year to upwards of 10years.  Is there a native workflow available, or should I think about creating a new library and AUX copy the data into the new configuration.  

2
Henke
Byte
2 years ago
X
Byte
xiwenByte
asked in Storage and Deduplication
How to backup index and DBB?

I created new storage policy, nothing under Associated subclients table, Where may I associate Index and DDB to new storage policy?

1
O
Vaulter
2 years ago
P
Commvault Certified Expert
PatrikCommvault Certified Expert
asked in Storage and Deduplication
Reuse Tape Media in a new Commmcell

Hi, We are deconfiguring a TapeLibrary in one Commcell and want to make a clean setup in a different Commcell and reuse the tapes. We do not want to migrate MediaAgents or save data. We did configure the TapeLib in the new Commcell but got issues as the tapes indicates that they belongs to a different Commcell. What would be the correct way to make the tapes reusable or turn up as new tapes in the new Commcell?  Regards,Patrik

2
P
Commvault Certified Expert
2 years ago
V
Byte
VitasByte
asked in Storage and Deduplication
Compression VS deduplication SQL and ORA transaction logs.

How do I read this job status data? What is my deduplication savings if any, or is it just compression alone. Where do I look for actual deduplication savings for the job.Can I leave deduplication enabled for transaction logs, or will that affect performance?Once job is completed I only see this :Could it be thatmy dedupe savings is nil? Or am I am mixing the terms and compression is actually a deduplication? 

7
Damian Andre
Vaulter
2 years ago
F
Byte
FM85Byte
asked in Storage and Deduplication
Use an existing library with data while creating global deduplication policy

Hi All, We currently only have intellisnap backup and the existing disk library is only being used for the SQL tlog backups. We are planning to onboard few streaming backups and configure global deduplication.Is it possible to select the existing library which contains transaction log data while creating the global deduplication policy without impacting the data on it? I am trying to avoid to have multiple disk libraries. Or do I need to configure an empty disk library for this purpose? Thanks.  

5
Damian Andre
Vaulter
2 years ago
M
Byte
MubaraqByte
asked in Storage and Deduplication
Commvault Deduplication with a deduplicated storage.

Hi, TeamHope we are all doing fine.I will like to get ideas on a topic.I have a client who uses Dell EMC data domain as their backup repository and they do not use commvault deduplication at all, they rely on dedup on the storage.. The backups do not seem to flying at the moment. I have done CVDisk and the storage is not doing bad.  Also done CVNetwork test and the throughputs are great.I am suspecting the Storage deduplication is the culprit….I am not able to check the Q & I because it is it not a CV DDB. The storage team cannot really help out to check, as they have no idea of what is going on..I proposed a new Media Agent to load balance the workload and i will like to know if they can use CV Dedupe for the new storage policies with the same Data Domain storage. The point man says they have a 3TB 10k SAS which is a bit manageable for CV Dedupe.Please, advise. 

1
J
Vaulter
2 years ago
S
Bit
Samarth SaxenaBit
asked in Storage and Deduplication
script to move the tape from vault to primary partition in commvault

Require script to move the tape from vault to primary partition in commvault

3
Mike Struening
Vaulter
2 years ago
YYZ
Byte
YYZByte
asked in Storage and Deduplication
Global Storage Copy Policy - to Tape - Error when changing retention

Hi Has anyone seen this error when changing retention on a Tape Global Copy policy The policy was initially a ‘basic’ policy using days The change was to add Extended retention

8
Mike Struening
Vaulter
2 years ago
T
Byte
tigger2Byte
asked in Storage and Deduplication
Wanting to have tapes that are not full be written to until they are full, and 'full/appendable" designation

I have 2 hopefully related questions to tape writing/usage. please pardon my ignorance :)I am seeing tapes that are “never being written to again” and are not full at all with this message “Marked full/appendable due to media group switching to a different data path”. My assumption is that the tape was writing, and then something happened to the job… but shouldn’t it not be “marked” as anything, and just be ‘appendable” until its full?  We have ( in the tape library properties) “mark media appendable” and “use appendable media” set to 90 days”. These tapes are not > 90 days old.  is there a way to unmark them or not cause them to be marked “full/appendable” (whatever that means? why full and also appendable?) In the docs for “Default Scratch” media group, I see these settings (below).  I want to have any tape that’s “not full yet”  to be picked before any other “completely empty” tapes.  What setting should I choose? The ‘reused” and “recycled” terms below don’t make sense to me. Cu

2
T
Byte
2 years ago
K
Byte
KavyaByte
asked in Storage and Deduplication
Commvault Tape encryption

I need to encrypt the data that is getting Auxed to tapes for a specific Client. How do we do?

5
Mike Struening
Vaulter
2 years ago
T
Bit
TheDude75Bit
asked in Storage and Deduplication
One or multiple mount paths for physical S3 Storage (on-prem)

In the Commvault “public cloud architecture guide for amazon web services” is a note about using only a single mount path when using AWS S3:Do not create multiple mount paths to generate additional Amazon S3 performance, Amazon S3 increased request rate enhancements have removed the need to randomize object prefixes to achieve faster performance with S3.But my question is: what’s the recommended mount path count when using an on-prem S3 Storage system as library in Commvault? The vendor of the storage does not care. They say they can handle one single bucket in one single mount path and scale unlimited. But what about Commvault?

3
T
Bit
2 years ago
M
Byte
ManikandnByte
asked in Storage and Deduplication
Aux copy Prioritization

Hello everyone!I've configured a File Server with a Data Drive and a System State Backup. I'm a little perplexed when I look at the AUX copy history because of the following numbers. For your convenience, I've attached a sample AUX copy behavior.Commvault is not copying data based on date and is jumping back and forth in time.I couldn't find any sort of prioritization system based on the date, backup type, or content.Can anyone describe how Commvault prioritizes data for secondary copies and how that priority can be changed?Is it possible to define a client-based priority for Aux copy? Thanks in Advance,Manikandan

3
M
Vaulter
2 years ago
F
Byte
feedmefanByte
asked in Storage and Deduplication
Storage Engineer

I’m currently performing backups of Azure Fileshare for a subscription using Commvault. The backup is being performed in one Azure region and customer wants to restore the Azure Fileshare to another region.  What do I need to do perform that type of restore in Commvault?

2
Damian Andre
Vaulter
2 years ago
N
Bit
NikramakBit
asked in Storage and Deduplication
Azure Combined Tier

A customer of ours intends to move their Azure workload to Metallic in the near future.Because we don't manage the azure side of things for the customer, I assumed that the Azure blob storage was a combined tier based on what was configured in Commvault (screenshot below). The cloud libraries are configured in Commvault to use a Combined Tier of storage where we write metadata to Hot and chunk data to Archive tier. Based on that I’d suggested that a rehydration of data is needed from Archive tier to hot tier to perform an Auxcopy to Metallic or lodge a ticket with Microsoft to have the entire contents of the blob converted to Hot tier so that it can be read by the AuxCopy process.  CV cloud library explorer shows chunks in Archive tierTo learn more about Azure's blob storage configuration, the customer turned to Microsoft. Microsoft confirmed that no data needed to be rehydrated in order to migrate to Metallic because they could only see Azure's hot-tier blob storage configured on that

8
N
Bit
2 years ago
K
Byte
kszafByte
asked in Storage and Deduplication
Deduplication backup

Hi, I have few question about deduplication. I will be very appreciate for help:how to backup servers with enabled deduplication - some special tips how to recover files from volumes with deduplication enabled is the option of data backup on such servers with the use of an installed agent recommended / not recommended, how does it affect the backup speed, why Commvault is not able to recover data from disks after deduplication, maybe something else needs to be configured?Thanks for help!

2
S
Vaulter
2 years ago
C
Byte
chris_ahnByte
asked in Storage and Deduplication
Aux copy to S3

Hello!! I want to Aux copy ( Virtual Tape Libary → S3) but, The error occurred as follows.The error occurred twice.Occurred at 2.8TB(Total capacity 3.2) It worked well, but suddenly it didn't work.

1
Damian Andre
Vaulter
2 years ago
P
Byte
Paul HutchingsByte
asked in Storage and Deduplication
Failed to process chunk since 11.24.19 upgrade

Yesterday our environment did an automatic upgrade from 11.20.xx to 11.24.29.Previously I have had absolutely zero issues with data verification and backups and aux copies and all jobs show as passing data verification.Now I’m seeing errors/issues on aux copies and data verification along the lines of:Failed to process chunk [2840311] in media [V_98073], at the time of error in library [Disk Library] and mount path [[ma02] C:\Mount\maglib04], for storage policy [Backup to Disk] copy [Primary] MediaAgent []: Data read from media appears to be invalid..We’re using global dedupe and lots of synthetic full backups so I’m trying a proper full backup on a problem job to see what happens.Before I raise with support does anyone have any suggestions or thoughts please?This is a Windows MA environment where there have been zero issues this literally started to happen after the 11.24.29 install.Obviously this doesn’t seem good :(

4
Mike Struening
Vaulter
2 years ago
C
Commvault Engineer
asked in Storage and Deduplication
Media Agent database

Hi Commvault Community, Just wondering if the Media Agent in Commvault uses a specific database ? Since the CommServ uses SQL DB for its metadata, I was wondering if the MA uses certain DB for DDB or Index Cache or anything else.

3
Mike Struening
Vaulter
2 years ago
L
Bit
lgriswoldBit
posted in Storage and Deduplication
AuxCopy free space is less than primary

We  have 2 Synology 24TB storage libraries, one for the primary and the other at another site for the AuxCopy.The primary has Free Space 15.34TB, Size on Disk 8.59TB, Total Application Size 30.5TB.The AuxCopy has Free Space 3.62TB, Size on Disk 20.33TB, Total Application Size 30.33TB Shouldn’t the AuxCopy be an exact replica of the Primary?  Why would it be larger? Thanks for any suggestions.Larry

4
Mike Struening
Vaulter
2 years ago
Z
Bit
zadok001Bit
asked in Storage and Deduplication
Failed to read media during restore

Hi everyone This is my first post. I was trying to restore some files I lost from an earlier backup. I could view the files and folders. I selected the copy precedence to be 1 (my primary copy)However, whenever the operation starts, it gives the error “Failed to read media during restore” and stops at 5%Everything seems fine. Until I tried to skip the errors, and I find out that the folders are restored, but no files in them.Please help out. Is there something in the settings I have to change?

9
Mike Struening
Vaulter
2 years ago
Mohit Chordia
Byte
Mohit ChordiaByte
asked in Storage and Deduplication
Pure Storage as Immutable Secondary Copy

Hi Community ,We are using disk library as our Primary Backup Storage  . We would like to configure immutable secondary DASH copy on Pure Flash Blade . I would like to understand -- Can i create a disk library from Pure Flash Blade with hardware immutability ? Can i use Pure Flash Blade array to create a DASH Aux copy with source as disk library primary copy to target as library created from Pure Flash Blade . Backups are Streaming & VSA , not IntelliSnap .  As per the CV documentation and videos , i see that Pure is only configured as Primary backup storage with IntelliSnap backups . Can we use it as backup library target for aux copies ? 

7
O
Vaulter
2 years ago
J
JMherrDaat
asked in Storage and Deduplication
Error Code: [13:138] - Data Verification DDBs Fails

Hi, I try to run a data verification but the job take this error:Error Code: [13:138] Description: Error occurred while processing chunk [7670174] in media [V_], at the time of error in library [LibStorage] and mount path [[LibStorage] R:\], for storage policy [SP_BackupSystem] copy [Aux_Disk] MediaAgent []: Backup job []. Mount path inaccessible. Source: , Process: AuxCopyMgr  

5
Mike Struening
Vaulter
2 years ago
Gaetano
Byte
GaetanoByte
asked in Storage and Deduplication
Running Auxiliary Copy overlaps with Primary schedule

Hello,I need a little clarification about long running Auxiliary Copies.On a daily basis we run a Primary Copy schedule which is followed by three auxiliary copies. Quite often the auxiliaries take a very long time to complete, enough to overlap with the primary copy schedule of the following day. This makes the jobs on day 2 to “enter” the still running auxiliary copies from day 1, is there any way to avoid this? Is it possible to set a boundary on the latest job to be included in an auxiliary copy?To my understanding, the Copy Policy->Backup Period->End Time setting cannot be used as it would provide a fixed date rather than a moving one.Sorry if this sounds a bit dummy and thanks for you supportGaetano

9
Gaetano
Byte
2 years ago
R
Row
asked in Storage and Deduplication
Jobs mark bad

I want to move jobs from disk to tape, when I run the auxiliary copy it gives me an error when it finds a CHUNK and some of the jobs are marked as bad, try to mark them as good and it gives me the following error "the selectted job cannont be marked good , since it has been marked bad by the system during a read operations"Already validate at the Operating System level that the CHUNKs are in the corresponding route.If I try to view the backup data for those bad jobs through a restore I can view and navigate to the file to restore Is there any way to recover the good status of the jobs?

5
Mike Struening
Vaulter
2 years ago
A
Byte
Allan0105Byte
asked in Storage and Deduplication
Commvault Problem recognizing new tapes.

Tapes are not write protected physically but commvault shows the tapes are bad and write protected for all the new tapes. any suggestion on this? 

15
Mike Struening
Vaulter
2 years ago

Badge winners

Show all badges
Terms & ConditionsCookie settings