Skip to main content

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 997 Topics
  • 4,404 Replies
997 Topics
D
Byte
drPhilByte
asked in Storage and Deduplication
Badly marked LTO8 tapes

Hi all, We have a following issue. The LTO8 tapes were badly marked with LTO6 barcodes. Then, the tapes have been remarked with right barcode. However, Commvault can not recognise the newly remarked tapes - Commvault says that the barcodes had been already used and tapes were moved to retired group. We tried to perform Discover,  Full Scan (inventory) and Update barcode for the given tape without success. Is there any workaround for the issue? Is there only one way to somehow fix the tapes within the tape library?

5
D
Byte
3 years ago
Ken_H
Byte
Ken_HByte
asked in Storage and Deduplication
DR site media agent much smaller than primary site.

Hello everyone,All my backups are set to replicate from my primary site to my DR site and all copies have the same retention.  Weirdly, the Disk Library Growth report shows the media agent at my primary site has 178TB worth of data but my DR site is only 132TB so I’m wondering where the 46TB difference comes from.Question:  Is there a way to compare the contents of two media agents to see where discrepancies are coming from?ThanksKen

3
Ken_H
Byte
3 years ago
ApK
Byte
ApKByte
asked in Storage and Deduplication
Restore from offsite private cloud with no direct connection

Hi All. I have a question regarding restore of data which resides on a offsite private cloud where clients have no access. Setup is:On prem Client network with servers in backup.→ Firewall in between with port open for backup traffic.On prem Backup network with MediaAgents and storage.→ Firewall in between with port open for aux copy data.MediaAgents with offsite private cloud storage containing Aux copies of client data. Clients do not have access to the offsite MediaAgents/copy, so my question is, how do I make a restore of data from the offsite cloud, when the On prem clients and the offsite MediaAgents cannot talk to each other directly? Is it possible to route restore traffic via the on prem MediaAgents acting as a proxy some how? Would the network gateway via outgoing routes be the solution?  Any suggestion would be appreciated. Thanks for helping.-Anders

2
ApK
Byte
2 years ago
V
Byte
virgilByte
asked in Storage and Deduplication
error 13:138 on auxiliary copy between 2 MA

HelloI have a problem of auxiliary copy between two media agents with HP StoreOnceI have a 2*100MB WAN link between the two MA.I got 13:138 errors but job is still runningSee attachments for detailsIf someone could help meSP11.22No firewallingFirewall is Off on the two MA Regards  

1
J
Vaulter
3 years ago
L
Byte
Lionel DByte
asked in Storage and Deduplication
Remove DDB with no associated jobs

Hi, I’ve an old sealed DDB with no more jobs associated to it, it only shows some number of unique blocks left ( for a size of 1,18TB ) , secondary blocks is 0 ,  application size is already at 0. How can I then do what you proposed to do: “then remove ALL of the blocks for that store in one big macro prune.”?Cause I’d like to get totally rid of that sealed DDB ?

5
Mike Struening
Vaulter
3 years ago
L
Byte
LaurentByte
asked in Storage and Deduplication
Windows MA to migrate to Linux MA

Hello ! In the next days, I have the opportunity to replace an existing Windows MA (with VSA) with a Linux MA (also with VSA).The windows MA has a local (internal) disk library hosting deduplicated backups of a single storage policy. The target Linux MA also has internal disks library + an LTO8 tape library.Both MAs are online and can communicate over the IP network. It looks possible to perform a move of the DDB of the windows MA to the Linux MA, but it is not possible to perform a move of the windows Mount Path to a linux server. I would like to keep my existing Storage policy (that of course can be edited for this purpose) and existing backups so they could age normally (ideally) without manual action at the expected end date of retention. Has anyone already performed in real such action ?How have you done this ? Or would you ?   Of course, I can create a new storage policy with deduplication targetting the linux MA, and attach all the clients to this new SP, but this is what I wish

4
S
Vaulter
3 years ago
B
Byte
BloopaByte
asked in Storage and Deduplication
add a FC tape library

Hello Community ! I am trying to add a tape library HP MSL G3 Series to Commvault.I am using the Expert Storage Configuration. i have selected the Two Media agents (they are already zone with the tape libraries)I have followed the procedure. Now it asks if the library have a barcode reader and I don’t know :)can you help me please ? Thanks !

1
MichaelCapon
Vaulter
3 years ago
D
DanielDai
asked in Storage and Deduplication
where to config "preferred setting" in the "Select mount path for MediaAgent according to the preferred setting" of the Library properties

I’d like to consult where to config “preferred setting” mentioned in “Select mount path for MediaAgent according to the preferred setting” option of the library properties? thank you in advanceBest regards

9
D
2 years ago
D
Byte
drPhilByte
asked in Storage and Deduplication
Force using all tape drives

Hi all,I would like to ask you about utilization of tape drives in the tape library. In our situation, however there are 4 tape drivers in the master pool, the Commvault is choosing only 2 of them. The rest of them is idle. Is there any way to force using the tape drive with the given storage policy? Can be helpful to associate the tape drive with only one media agent, that can only use that tape drive? Is the number of streams a variable in this case? Thanks for any suggestions!

2
D
Byte
3 years ago
J
Byte
JM-Byte
asked in Storage and Deduplication
Dedupe & gzip compression. Does the --rsyncable option help?

Anybody used gzip with --rsyncable to increase dedupe efficiency and does it actually help?  People still like to do app/database dump and pickups its all good until they compress the dumps and you convert the pickup backup from tape to disk dedupe.  Since dedupe doesn’t like compressed files as a source there’s rumors that --rsyncable option will help here.This option uses a totally different compression algorithm that's rsync friendly and only increases the compressed size by about 1% when compared to the regular flavoured gzip file.     

13
Mike Struening
Vaulter
2 years ago
I
Byte
Ingo MausByte
asked in Storage and Deduplication
MCSS storage estimation

Hi everyone.how do you estimate MCSS storage requirements? MCSS (cool) would be our customers’ cloud secondary copy in their existing Commvault environment. So there are values available like local block size (128KB), deduplication factor, baseline size and such for estimation  We’re seeing around 1.2 to 1.3 x in MCSS demand compared to local disk with customers who set it up recently. As MCSS secondary copies “must have a minimum retention of 30 days", reducing retention (which oftentimes is the customer’s choice for solving storage issues) is apparently not an option here.While of course we cannot provide a 100% estimation, we intend to not be too much off.Thanks.  

11
I
Byte
2 years ago
A
Bit
AZOPSBit
asked in Storage and Deduplication
Change AWS Storage Tier on Existing Copies

Hey Community,2 QuestionsIs it possible to change the AWS storage tier from Glacier to Deep Archive on copies that already exist beside running an aux copy? We ran 7 months of aux copies to Glacier until we were told to send it to Deep Archive.. Now we have 500TB sitting in the Glacier class and of course, costing money. I’ve started the process of just aux coping them, but it is tedious to do one job ID at a time on the Cloud Storage Archive Recall workflow. Is there a way to add multiple job IDs to the workflow?Thanks in advanced~John

2
A
Bit
3 years ago
Fernando Souza
Byte
Fernando SouzaByte
asked in Storage and Deduplication
Library cleaning tape procedure

Hello,The customer has purchased a tape library Fujitsu LT20.Is there an automatic tape cleaning procedure?

2
Fernando Souza
Byte
3 years ago
A
Byte
AviorByte
asked in Storage and Deduplication
Separate T-Log from copy to Auxiliary Copy

Hi Alli have a question for the expert's :) we using Metallic Storage for secondary copy.we backup SQL Instance’s there, with T-Log (lot of jobs) and Daily Full.i want to ask if i can somehow to exclude only the T-Log from going to the Second copy.i want only the Daily Full will go to the Auxiliary Metallic Storage.is it possible? (without create a new policy of course). thanks in advance 

5
Sunil
Vaulter
3 years ago
S
Byte
Sudharshan KumarByte
posted in Storage and Deduplication
Double DeDupe for Aux Copy?

Is there any reason we are doing the Double Dedupe for Aux Copy(DASH Copy)? What is the benefits for us.   

6
Scott Moseman
Vaulter
2 years ago
C
Commvault Certified Expert
ChristoCommvault Certified Expert
asked in Storage and Deduplication
VTL Performance Best Practice

Hi,has anyone experiences with VTL self Deduplication Backup Appliances, like Quantum DXi4800 for Example (smaller Modells ~27 TB)? The deveices are non Deduped backuptargets for commvault. Later Aux-Copy to a physical Tape-Library is performed.I got a Performance Best Practice Guide from Quantum. They said use small cartridge size 50/100 GB (like Ultrium 1) but not how many Tape Deveices in parallel and how this relates in backup and restore performance. To much Tape-Drives maybe slow down the throughput but i have no idea which throughput per drive stream is possible comparred to a physicale tape drive which normaly only receive 100-200mb/s.Would be nice if someone else use this "old"stuff and can explain something in correlation with commvault. My last VTL implementation was 10 years ago.ThanksChristoph

3
Damian Andre
Vaulter
3 years ago
S
Byte
SHASHAByte
asked in Storage and Deduplication
Maglib status implementation in Grafana

Hi All,Has anybody worked on bringing in the Commvault maglib status and tape media usage status to Grafana dashboard? Is there anyway to showcase the usage trend and capacity reporting based on maglib utilization and publish in Grafana?Possibly if we can take the real time data from Commvault then we can pretty much show this metric in Grafana. Any leads?

9
M
Bit
1 year ago
Henke
Byte
HenkeByte
asked in Storage and Deduplication
Network Throttling Aux copies

Since the other thread was stated as solved I’ll start a new one. From What I understand the Network Throttling on the media agent only effects backup jobs, not Aux copies jobs bandwidth.There is an option to limit the Aux copy bandwidth usage by setting the Advanced setting "Throttle Network Bandwidth(MB/HR)" on the stg policy copy.Unfortunately that effects the usage all day as there is no possibility to set it per time interval.I have two Aux Copy jobs running for two different Storage Policy copies with the setting for bandwidth limitation set to 5000 MB/HR which is roughly 11 Mbit/s.So running two of those shouldn't use more then 22 Mbit/s.Looking at the Current Through put they are 3,92 GB/hr and 2,97 GB/hr in Comccell console. Those combined gives 6,89 GB/hr roughly 15 Mbit/s. I understand that it's not 100% accurate as the data is deduplicated.But looking at our monitoring I see two streams going to Azure one using 30 Mb/s and the other at 20 Mb/s.In fact the Aux copies tend to

8
M
Vaulter
2 years ago
D
Byte
drPhilByte
asked in Storage and Deduplication
DDB verification job performance - Verification of Existing Jobs on Disk and Deduplication Database

Hi there,I would like to ask you, in general, which elements are in play during the DDB verification? Is there communication between the DDB database and the disk library during the DDB verification job?In documentation, there is written that "Verification cross-verifies the unique data blocks on disk with the information contained in the DDB and the CommServe database." So, it means that there is communication between media agent and master server… The thing is, that in our case this verification job even Incremental takes a very long time. However, the performance of the disk with DDB database looks quite good.

3
Mike Struening
Vaulter
3 years ago
Henke
Byte
HenkeByte
asked in Storage and Deduplication
Command syntax explained

Hello,Is there someone that can interpret and let me know my assumption on the switches in the below command to are.-j = jobId-i = Deduplication Partition-c = ??-in = CV Instance-cn = Client-group = ??“C:\Program Files\Commvault\ContentStore\Base\SIDB2.exe -j 0 -i 74 -c 178 -in Instance001 -cn client-server 1 -group 0”Also, if anyone know why the above doesen’t have a JobId, or rather why it’s 0. Is it just an internal thing to the SIDB2 process?I’ve seen the command have -j 0 as well as a -j xyz jobId that is searchable. BRHenrik 

3
Henke
Byte
3 years ago
F
Byte
Farmer92Byte
asked in Storage and Deduplication
Cache-Database and Deduplication-Database are out of sync

Do you see these error for your jobs?When we updated from 11.20.32 to 11.20.60 we started getting Cache-Database errors on various backup types, FileSystem idata agent, NDMP backups and others.The exact error we get is:Error Code: [40:110]Description: Client-side deduplication enabled job found Cache-Database and Deduplication-Database are out of sync.I have a ticket open with support, but I am wondering if the issue is unique to us or if it is happening to other customers as well. Thank you,

7
Mike Struening
Vaulter
2 years ago
Fernando Souza
Byte
Fernando SouzaByte
asked in Storage and Deduplication
Create a tape job for new full backup

Hello,I need to create a backup job with all full backups to tape in a physical library(new library) that the customer has purchased.Today all backups are on disk (File Library).After the new Jobs to tape has been succesfully executed (3 backup jobs to tape will be done), i need to erase the full backup, which today is very old and needs to be done a new full backup, because the size will be smaller and will free up more space in disk.Wait guys for the best practices to do this.Another question: i will create the Storage Police for the library with permanente retention and include all tapes in the same SP or create other for example: Database, Exchange, etc.@Mike Struening 

25
Fernando Souza
Byte
3 years ago
R
Bit
Rajesh KumarBit
asked in Storage and Deduplication
any how i can set a limit Auxiliary copy jobs, once fist 5 jobs get copied then only next copy job should start. Using stand alone tape library

lets say there are 1000 jobs needs to move on tape, i want to take the secondary copy of jobs on date wise it should not pic random jobs for aux copy.

2
Mike Struening
Vaulter
3 years ago
D
Byte
drPhilByte
asked in Storage and Deduplication
Drives in the tape library went offline

Hi there, could you please help me what to do if all drives within the tape library went offline? The offline reason seems to be very strange: [Cannot communicate with Media Mount Manager Service.Please ensure that.a. The MediaAgent is reachable from CommServe.b. All MediaAgent services are running.] A - Checked that MA is reachableB - Checked that all services are running What can help us to make drives online? Also verified in Windows device manager that drives are present and visible.

3
Mike Struening
Vaulter
3 years ago
N
Bit
Nedal1993Bit
asked in Storage and Deduplication
DDB with secondary copy

Hi Commvault Team how DDB works with the secondary copy (New Copy) to another disk library? assuming that we have two sites, each one has its own MA, DDB, Disk pool. and DASH copy is enabled.​​​​​​

5
Scott Moseman
Vaulter
1 year ago

Badge winners

Show all badges
Terms & ConditionsCookie settings