commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 898 Topics
  • 4,103 Replies

898 Topics

D
Byte
DavidBByte
asked in Storage and Deduplication

Cloud Storage alert report mount and prunning errors/issues

Have some alerts that just started showing up in the past couple of days for a particular AWS cloud libraryCloud MountPath(s) without pruner MediaAgent [ {Library[Lib1] MountPath[[store2] s3-backup] DeviceName[Device_94]} ]  (yesterday and today. Same time each day)andFailure Reason: Failed to check status of parent directory, media agent cannot access the storage. (started on the 19th and occurs roughly at the same time each day) (Additionally this error first occurred when the cloud storage was associated with a different Media Agent.  )The library has two mount paths, and the mount error mostly comes from the 2nd path.  Although it once reported the other.Checked the jobs for the storage policy related to it, and it seems that nothing is missing.Have looked through the logs and other than the similar alert text, I don’t see what could be causing the alerts. There are multiple storage policies using the same Media Agent and the same S3 bucket.  None of the others are having this prob

4
Damian Andre
Vaulter
2 years ago
A
Bit
AsyrafBit
asked in Storage and Deduplication

Chunk files being unique and only readable per Commvault CCID

Hi,I’m looking for a statement or write-up state that commvault CCID is unique for customer. Any Commvault customer backup data cannot be read by different CCID. Something like their data encrypted or tied by their CCID. Thanks.

4
Mike Struening
Vaulter
2 years ago
F
Byte
faiezByte
asked in Storage and Deduplication

Auxiliary Copy slow performance

Hi AllI’m having performance issue with the auxiliary copy. This log capture from media agent. Having low data transfer rate. There is 2 media agent installed in this site, one is working fine, another one got issue. |*5850951*|*Perf*|592185| =======================================================================================|*5850951*|*Perf*|592185| Job-ID: 592185            [Pipe-ID: 5850951]            [App-Type: 0]            [Data-Type: 1]|*5850951*|*Perf*|592185| Stream Source:   xxxxx|*5850951*|*Perf*|592185| Simpana Network medium:   SDT|*5850951*|*Perf*|592185| Head duration (Local):  [29,June,21 11:58:57  ~  30,June,21 05:31:55] 17:32:58 (63178)|*5850951*|*Perf*|592185| Tail duration (Local):  [29,June,21 11:58:57  ~  30,June,21 05:32:31] 17:33:34 (63214)|*5850951*|*Perf*|592185| ----------------------------------------------------------------------------------------------------------------------------------------|*5850951*|*Perf*|592185|     Perf-Counter                  

4
Ryan Carr
Vaulter
2 years ago
E
Byte
Eduardo BragaByte
asked in Storage and Deduplication

Is it worth deduplicating Transactional Logs?

We think that there is no real benefit for the Commvault to deduplicate Transaction Log data. Maybe some compression benefit, but today we deduplicate practically everything. I started another topic (Difference between Incremental Storage Policy and Log Storage policy) to ask about the differences between Log Storage Policy and Incremental Storage Policy. The idea is to have a specific Storage Policy for Database Agents Transactional Logs with deduplication disabled. By examining some backups jobs, we noticed that Savings Percentage comes entirely from Compression. Due to its nature, It seems that there is no gain when deduplicating variable data like Transactional Logs. By disabling deduplication for those data, in theory, we can keep DDB smaller and reduce Q&I times. Am I right?  

4
Mike Struening
Vaulter
2 years ago
antonio
Byte
antonioByte
asked in Storage and Deduplication

Warning message Deduplication Engine

Hello everyone, hope all of you had a good time in Christmas with family and friends and all are just fine,  .I got a question that I think is easy to resolve:Recently I noticed a warning icon in the Deduplication Engines in CommCell Console, and I wanted to know how I can fix this. Above there’s a screenshot in how it shows to me: Thanks, 

4
antonio
Byte
2 years ago
T
Byte
TP_EricksonByte
asked in Storage and Deduplication

Backing up Exchange Databases from HD Library to tape

We had to back up some exchange Dags for short term retentions to an 3Par Disk library. The Mount Path is from one of our media agents where i can see what's stored on the 3Par. My boss wants me to back up the month of September that we have on disk to tape, so we can clear it out from the 3Par for another month of Storage.  Would the best way to back this up to tape would be to create a subclient on the media agent the drive is mounted to , target the Data Chuncks for the time of the month he wants backed up, and assign it a storage policy that will back it up to tape, or will that not capture the data we want from the 3Par?

4
Mike Struening
Vaulter
2 years ago
Mohit Chordia
Byte
Mohit ChordiaByte
asked in Storage and Deduplication

Offline Copy Implementation in Commvault

Hello Community ,Did anyone implemented or have an idea how to implement offline backup copy in Commvault ?Backup is being written to commodity servers with local storage attached .The goal is that once backup job or aux copy  is completed , the target media agent should go offline and it should come online automatically during recovery request or next backup/aux copy schedule .By any workflow or cv feature can we control power ON or power DOWN of media agent ? What are the best practices or procedure to implement offline backup copy .Regards, Mohit

4
Mike Struening
Vaulter
2 years ago
Ken_H
Byte
Ken_HByte
asked in Storage and Deduplication

Incremental backups not copied to secondary storage

I have a storage policy that has 7 days, 1 cycle retention with two copies:  Primary and DR.  It appears that none of the incremental backups are replicated to DR.  Does CommVault somehow treat incremental backups differently than full backups when it comes to replication to the DR storage?Second question:  I just ran a full backup of a small production server, verified that it’s only on the primary storage, did right-click on the storage policy > All tasks > Run Aux Copy > select Copy: 2-DASH-to-DR > OK > and get “No data needs to be copied”.  I don’t understand how I can have so many backups, both incremental and full, that show as only being on the primary storage.  Does anyone have any idea why my Aux Copy doesn’t seem to be working?Thanks in advance for any help.Ken

4
Ken_H
Byte
2 years ago
T
Byte
TP_EricksonByte
asked in Storage and Deduplication

Selective Copy Aux Copy No data needs to be copied

Got a storage policy with a active selective Copy that is supposed to copy the data written to a HDD library and copy it to a tape. It missed its aux backup for whatever reason. When trying to manually run an aux copy from the storage policy it tells me there is no Data that needs to be copied when clearly there is no job records of the aux performing backups. How do i force an aux copy without this error popping up .  

4
Hyder
Vaulter
2 years ago
T
Byte
TonyQByte
asked in Storage and Deduplication

Library not recognising tapes since new CommCell Server and DR database restore

Hello Fellow CV Community I have an issue with our USA CommCell.  We had to build a new 2019 VM CommCell Server due to the fact we were running on 2012R2 and we could not upgrade our Service Pack to 24 until we went past that OS.  Since upgrading and doing a DR restore, any new tapes we put in our library come back with the following when verifying the media:“Media in library [HP MSL 4048 Tape Library], slot [slot42] does not have a valid media label that is not written to by this product.”We thought this was just an issue with tapes that were in the library, when we did the upgrade and saw this an oversight.  However this is happening after we took all those tapes out, rebooted the library and added brand new tapes in to the library.Our infinite backups are at risk until we get this resolved.  Any help as always would be greatly appreciated. TonyQ  

4
C
Vaulter
1 year ago
RubeckDK
Byte
RubeckDKByte
posted in Storage and Deduplication

IBM Elastic Storage System as a backup target... Anyone?

Hi peeps..  Anyone out there with experience in using IBM ESS 5000 as a backup target for CVLT?We're about to set this up... Multiple MA grids will be connecting to the IBM ESS using SMB on a 100Gb network.. If anyone has some do's and don'ts or best practices feel free to chip in :-) Would be very much appreciated..  Thank you.. Best regardsKim

4
RubeckDK
Byte
2 years ago
R
Bit
Rob CarseyBit
asked in Storage and Deduplication

The real cost of AWS Glacier Deep Archive

I’ve been trying to figure out what my costs would be if I discontinued my off-site backup service (they physically come and take the tapes to an off-site location) and moved to S3 Glacier Deep Archive.We maintain on-premise backups as well, and in the past 20 years, we’ve never had to do a restore from off-site tapes -- so I’m definitely not concerned at all for that “100 year” event.The pricing of GDA is straightforward.. data lives (or, is billed) at a minimum of 6 months at $1/TB, but then there are also costs for PUTs and GETs (currently $0.05 per 1000).  I’m very unsure how many requests I would consume per month when uploading data to the cloud.Trying to sell my boss on this.. but need an idea of how GETs/PUTs work in Commvault.

4
YYZ
Byte
3 years ago
L
Byte
LaurentByte
asked in Storage and Deduplication

Windows MA to migrate to Linux MA

Hello ! In the next days, I have the opportunity to replace an existing Windows MA (with VSA) with a Linux MA (also with VSA).The windows MA has a local (internal) disk library hosting deduplicated backups of a single storage policy. The target Linux MA also has internal disks library + an LTO8 tape library.Both MAs are online and can communicate over the IP network. It looks possible to perform a move of the DDB of the windows MA to the Linux MA, but it is not possible to perform a move of the windows Mount Path to a linux server. I would like to keep my existing Storage policy (that of course can be edited for this purpose) and existing backups so they could age normally (ideally) without manual action at the expected end date of retention. Has anyone already performed in real such action ?How have you done this ? Or would you ?   Of course, I can create a new storage policy with deduplication targetting the linux MA, and attach all the clients to this new SP, but this is what I wish

4
S
Vaulter
2 years ago
P
Commvault Certified Expert
PatrikCommvault Certified Expert
asked in Storage and Deduplication

Azure CloudLib Data Written does not match Dedupe statistics

I have a CloudLibrariy in Azure configured with three Cool Blobs. (three mount paths). Commvault reports Application Size 30TB and Data on Disk 50TB. In Azure the disks reports to be filled with 12TB. We have verified that WORM is disabled on the volumes in Azure. It seems that Commvault messes up the statistics for some reason. Have anyone seen this before on Azure CloudLibs?   

4
P
Vaulter
3 years ago
Melissa Adams
Commvault Certified Expert
Melissa AdamsCommvault Certified Expert
asked in Storage and Deduplication

Encryption on S3 and data transmission

Hey all - we are using encryption on our S3 library in AWS.  Is it a best practice to also enable software encryption on the primary copy?  For the encryption of the backup data going to S3, is there a specific encryption type I can find somewhere that is in use? This is in my storage policy Primary copy properties. This is just an example of where I found the setting….  

4
Mike Struening
Vaulter
2 years ago
F
Bit
Fabrice LEFORTBit
asked in Storage and Deduplication

Reducing data retention (Aux copy)

Hi all, I start on this community, so thanks about all help you can give me. Near 2 years ago, we make a mis configuration on our infrastucture.Result : We have datas on Tape, which have bad data retention date.When I modify the retention date of jobs, I have 2 different behaviors :When I increase retention date : COMMVAULT show the right date When I reduce retention date : COMMVAULT don’t make any changesWhy ?How can I expect that datas expire at the right date ? My COMMServe is in 11.24.21 Thanks in advance

4
Mike Struening
Vaulter
2 years ago
P
Byte
Paul HutchingsByte
asked in Storage and Deduplication

Backup DDB to tape?

Is there any reason (technical or best practise) why the DDB policy can’t backup to tape?It’s defaulted to our disk library which is on the same MA as the DDB.Tape feels a bit safer 

4
Scott Moseman
Vaulter
2 years ago
Marco Lachance
Byte
Marco LachanceByte
asked in Storage and Deduplication

Report for back-end storage usage ?

Hi, is there a way to know how much a server/client is using unique block in the back-end storage when Global dedupe is involved ?So If I deleted the server for Commvault what’s going to be the free space free up ?

4
Mike Struening
Vaulter
2 years ago
B
Bit
BartsBit
asked in Storage and Deduplication

Import backup from Disk Library

HiBackground: Our backups are stored on a Data Domain and the Data Domain replicates itself to a remote site, additionally we've got daily snapshots on the data domain itself to prevent backup data deletion (these snapshots can only be deleted using the sysadmin account).Because we use Data Domain we are storing our backups without compression or deduplication. But my question can be the same for the following situation:Lets assume I've got a media agent, with a data disk (where the disk library is on) attached to it. the building catches fire and I am only able to unplug the data drive. I loose everything expect for the data drive. If I install a new commcell, can I then import the backups from that data drive somehow?

4
Mike Struening
Vaulter
2 years ago
U
Byte
UpenByte
asked in Storage and Deduplication

Commvault are aware of any issues with routing Commvault Traffic through the local internet in China.

Hello All, We have configured the Aux copy with AWS cloud storage library destination, we are facing Auxcopy slowness issue only for China location. Other locations are working fine. (US & UK).Any one facing same issue in China location…? Commvault are aware of any issues with routing Commvault Traffic through the local internet in China. 

4
Damian Andre
Vaulter
2 years ago
T
Byte
TP_EricksonByte
asked in Storage and Deduplication

Separating a monthly full backup from Weekly full, best practice?

We are using a tape environment for our backups. One of the issues i have with commvaults storage policy is that it doesn't really have a difference on how it does full backups. Our retention cycles are a daily backup (Differentials) of 7 days 1 cycle, weekly full 28 days 1 cycle, and a monthly full with 1095 days +. Currently with how the storage policy is set up it is running to the default, all the data is being dumped to one tape and usually has monthly, daily and weekly data on the same tape. I notice when i pull my monthlies i sometimes will see that the weekly fulls and daily are eating up space that could be used to fill more monthly fulls unto the tape.I was wondering what would be the best practice to separate the monthly full away from the other backup retentions of the storage policy?  Would it be something along th3e lines of creating an aux copy in the storage policy and just copy the last weekly full to the aux copy to separate the monthly full from the other data? or is

4
Mike Struening
Vaulter
2 years ago
neuwiesener
Byte
neuwiesenerByte
asked in Storage and Deduplication

Usage of mount points in a disk library

We have a partitioned DDB that uses a Disk library with 12 mount points. Spill and fill has been configured.An oracle DB is backed up with 4 streams/channels. The backup allocates 4 streams but these streams are allocated to one mount point and via one MA. How can the streams be spread across multiple mountpoints such that 2 go via MA1 and 2 via MA2.===Second Oracle DB is being backed up. This takes the same partition as the above job and uses another mount point with all 4 streams going to the same mountpoint. Any ideas how the streams to make Commvault distribute the streams evenly?

4
Mike Struening
Vaulter
2 years ago
A
Bit
AsyrafBit
asked in Storage and Deduplication

Failed to mount media error

We are working on Commvault with Falconstor VTL POC. Our Commserve running on SP20.17. At first we have been provided with emulated HP tape library with LTO4 drives. When we initiate the backup, it failed with below error Then, we also try with emulated HP tape library with LTO7 drives. Then we received almost the same previous error.  We also already update Tape Drive driver on Windows, but still the same. FYI, we are using Windows 2016 with Commvault SP20.17 on the Commserve server which running on VM. Need someone opinion. Please help. Thanks.

4
Onno van den Berg
Commvault Certified Expert
2 years ago
P
Byte
Paul HutchingsByte
asked in Storage and Deduplication

Failed to process chunk since 11.24.19 upgrade

Yesterday our environment did an automatic upgrade from 11.20.xx to 11.24.29.Previously I have had absolutely zero issues with data verification and backups and aux copies and all jobs show as passing data verification.Now I’m seeing errors/issues on aux copies and data verification along the lines of:Failed to process chunk [2840311] in media [V_98073], at the time of error in library [Disk Library] and mount path [[ma02] C:\Mount\maglib04], for storage policy [Backup to Disk] copy [Primary] MediaAgent []: Data read from media appears to be invalid..We’re using global dedupe and lots of synthetic full backups so I’m trying a proper full backup on a problem job to see what happens.Before I raise with support does anyone have any suggestions or thoughts please?This is a Windows MA environment where there have been zero issues this literally started to happen after the 11.24.29 install.Obviously this doesn’t seem good :(

4
Mike Struening
Vaulter
2 years ago
D
Byte
drPhilByte
asked in Storage and Deduplication

DDB Verification Schedule Policy

Hi there! There is a System Created DDB Verification schedule policy (Data Verification). In our case it starts everyday at 6AM. Is it possible to decrease the frequency of the schedule to e.g. once a week without any risk?What is the optimum value of the System Created DDB Verification schedule policy? I am asking because there is a quit big amount of data to be proceess during this task, which can reduce the performance of other tasks.

4
D
Byte
2 years ago

Badge winners

  • Topic Starter 5
    Michal Osewskihas earned the badge Topic Starter 5
  • Contributor 1
    LeoLamhas earned the badge Contributor 1
  • Contributor 5
    tonytonyhas earned the badge Contributor 5
  • Contributor 5
    JulienWhas earned the badge Contributor 5
  • Contributor 1
    Murfhas earned the badge Contributor 1
Show all badges
Terms & ConditionsCookie settings