Skip to main content
commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 1,124 Topics
  • 4,829 Replies
1124 Topics
L
Byte
LaurentByte
asked in Storage and Deduplication
My daily incremental DDB Verification job uses more than the max streams / readers

Hi ! I’ve noticed a strange behaviour of a daily DDB incremental verification job, normally set to 30 readers, but getting much higher than this since a few days.. See below How can this be possible ? I thought that the limit was.. a limit So, what has changed ? Well, not sure it is related, but since sept9, I upgraded from v11FR21HP20 to v11FR21HP53, and no other change. The Gridstor of 4 hosting this DDB also host another DDB, whose verification job runs without getting (or printing only) the maximum 30 readers limits. That’s a bit annoying because the first job goes pending for a while with : Error Code: [19:1105] Description: No Resources Available. Please check the Streams tab for details. Of course no ressources are available, as it’s trying to allocated more than 30.. A few details about this job and blocks to process : Should I log a case or, have you already been used to such ?

5352
L
Byte
T
Byte
TheseekerByte
asked in Storage and Deduplication
Local MA RAID Died; taking both DDB and Index cache with it along with the data;

This is just a question about how we could have better way to rebuild MA. We have a windows based local ma and the data is aux copied to another media agent at a secondary site (different city); The RAID on the local MA was returning errors; so we replaced one of the faulty disk which caused the whole raid configuration to fail. We had to rebuild the whole virtual disk again. Unfortunately since there were only 3-6TB disks; everything OS/DDB/IndexCache/Libraries were in the same Virtual disk and we lost everything. Since we had a copy of the backup data at the secondary location; the quickest way was to rebubuild the MA. The RAID controller was not showing any error; and it was not feasible to send another MA to the site due to lockdown So we rebilt the virutal disk again; installed/upgraded OS to Windows 2019; kept the same hostname/ip configuration; installed Commvault agent and it made the MA online on Commserve. created index cache and DDB added the new mount path in the existing l

3143
Mike Struening
Vaulter
M
Byte
MansoorByte
posted in Storage and Deduplication
Please help to understand media agent with deduplication. Unable to understand Commvault documentation link

Please help me to understand commvault media agent with deduplication

7738
M
Byte
neuwiesener
Byte
neuwiesenerByte
asked in Storage and Deduplication
Decommisioning a DDB to reclaim space on the DDB SSD

We want to use space on an SSD for a new DDB (horizontal scaling) and the old DDB is not being used. It only has jobs with long term retention as it was used for file archiving(onepass). The onepass jobs are not active anymore. Data only needs to be restored. If Commvault doesnt need the DDB for restores, how can I get rid of the DDB as we dont have any backups running. Sealing could be an option. However BOL mentions: The sealed DDB is automatically deleted only after all the jobs (with their data block signatures stored on the DDB) are aged or deleted and the corresponding volumes are deleted from the disk. So the DDB is required for purposes other than the backup. https://documentation.commvault.com/commvault/v11/article?p=12591.htm For now we will be moving the partition to a different drive. Any ideas?

12402
J
Vaulter
S
Commvault Certified Expert
SSchmidtCommvault Certified Expert
asked in Storage and Deduplication
DDB Sealing and new version

Hi All, we have an running DDB from 2018. We have Running 11.24.12 as Version on all Mas and Cs. After we sealed thed DDb have the new one the latest DDb version 6 automactially ?

2332
J
Vaulter
ApK
Byte
ApKByte
asked in Storage and Deduplication
Restore from offsite private cloud with no direct connection

Hi All. I have a question regarding restore of data which resides on a offsite private cloud where clients have no access. Setup is: On prem Client network with servers in backup. → Firewall in between with port open for backup traffic. On prem Backup network with MediaAgents and storage. → Firewall in between with port open for aux copy data. MediaAgents with offsite private cloud storage containing Aux copies of client data. Clients do not have access to the offsite MediaAgents/copy, so my question is, how do I make a restore of data from the offsite cloud, when the On prem clients and the offsite MediaAgents cannot talk to each other directly? Is it possible to route restore traffic via the on prem MediaAgents acting as a proxy some how? Would the network gateway via outgoing routes be the solution? Any suggestion would be appreciated. Thanks for helping. -Anders

802
ApK
Byte
A
Vaulter
Abdellatif AITELBACHAVaulter
asked in Storage and Deduplication
Exagrid : best practices

HI There IHAC that will use exagrid as backup storage with Commvault. Exagrid states that they can add to Commvault deduplication to obtain a higher dedup ratio (up to 20:1 for long term retention data). I couldn’t find any information on Exagrid on BoL and my understanding was that we do not use CV deduplication when using a deduplication storage as primary target. Did anyone implemented CV with Exagrid ? and if so any specifics/culprit or best practices ? Thanks Abdel

26067
Mike Struening
Vaulter
A
Byte
AmitByte
asked in Storage and Deduplication
how to RELABEL SCRATCH tapes in VTL

Hello All, I am from TSM background and when VTL was introduced in TSM, the scratch tapes were not automatically deleted in VTL. Later, RELABELSCRATCH parameter was introduced and it allows to automatically relabel volumes when they are returned to scratch. I remember that specific settings we have do in Backup Exec and HP data Protector backup software too. → I want to know whether any similar setting is there in Commvault? More details as per TSM perspective → Virtual Tape Libraries (VTLs) maintain volume space allocation after Tivoli Storage Manager has deleted a volume and returned it to a scratch state. The VTL has no knowledge that the volume was deleted and it keeps the full size of the volume allocate. This can be extremely large depending on the devices being emulated. As a result of multiple volumes that return to scratch, the VTL can maintain their allocation size and run out of storage space. Relabel processing on the Tivoli Storage Manager server are started for libraries

3621
Mike Struening
Vaulter
M
Byte
MansoorByte
posted in Storage and Deduplication
How to calculate sizing for Media agent deduplication partition

How to calculate sizing for Media agent deduplication partition

36002
M
Byte
D
Byte
drPhilByte
asked in Storage and Deduplication
Badly marked LTO8 tapes

Hi all, We have a following issue. The LTO8 tapes were badly marked with LTO6 barcodes. Then, the tapes have been remarked with right barcode. However, Commvault can not recognise the newly remarked tapes - Commvault says that the barcodes had been already used and tapes were moved to retired group. We tried to perform Discover, Full Scan (inventory) and Update barcode for the given tape without success. Is there any workaround for the issue? Is there only one way to somehow fix the tapes within the tape library?

25555
D
Byte
S
Byte
Spartan9Byte
asked in Storage and Deduplication
Auxcopy optimization

Hello community , We are trying to migrate SAN storage to S3 cloud library . Per suggestions followed these steps . 1. configured new global dedupe storage policy using your new S3 bucket and MA2. configured new secondary copies in your existing storage policies pointing to your new S3 dedupe storage3. ran aux-copy We have huge data and contacted commvault support to determine the timelines to know when the aux copy will get complete . Currently aux-copy is running for more than 4 months. Support has mentioned below points .-Your current configuration is allowing the selection and prioritization of new backups over older data-You are also configured to copy all data to cloud and mentioned we are not using dedupe for aux copy. How to make sure have optimal Aux copy configurations Please share your inputs . Thanks in advance Spartan9

14387
Mike Struening
Vaulter
Fernando Souza
Byte
Fernando SouzaByte
asked in Storage and Deduplication
Copy of config of Backup jobs to a new servers

Hello, The customer bought new servers MS SQL and migrate to new 2 servers. Scenery today: 2 servers MS SQL 1 production 2 copy New Scenery: 2 servers MS SQL (New Version of O.S. and Database) 1 production 2 copy and i need to copy the config of backup jobs, with the same configuration of current backup: retention, backups jobs, DDB, schedulers. Does anyone have any procedure? the best practices to do.

1187
Mike Struening
Vaulter
Ken_H
Byte
Ken_HByte
asked in Storage and Deduplication
DR site media agent much smaller than primary site.

Hello everyone, All my backups are set to replicate from my primary site to my DR site and all copies have the same retention. Weirdly, the Disk Library Growth report shows the media agent at my primary site has 178TB worth of data but my DR site is only 132TB so I’m wondering where the 46TB difference comes from. Question: Is there a way to compare the contents of two media agents to see where discrepancies are coming from? Thanks Ken

693
Ken_H
Byte
D
Byte
drPhilByte
asked in Storage and Deduplication
Force using all tape drives

Hi all, I would like to ask you about utilization of tape drives in the tape library. In our situation, however there are 4 tape drivers in the master pool, the Commvault is choosing only 2 of them. The rest of them is idle. Is there any way to force using the tape drive with the given storage policy? Can be helpful to associate the tape drive with only one media agent, that can only use that tape drive? Is the number of streams a variable in this case? Thanks for any suggestions!

9052
D
Byte
L
Byte
LaurentByte
asked in Storage and Deduplication
Windows MA to migrate to Linux MA

Hello ! In the next days, I have the opportunity to replace an existing Windows MA (with VSA) with a Linux MA (also with VSA). The windows MA has a local (internal) disk library hosting deduplicated backups of a single storage policy. The target Linux MA also has internal disks library + an LTO8 tape library. Both MAs are online and can communicate over the IP network. It looks possible to perform a move of the DDB of the windows MA to the Linux MA, but it is not possible to perform a move of the windows Mount Path to a linux server. I would like to keep my existing Storage policy (that of course can be edited for this purpose) and existing backups so they could age normally (ideally) without manual action at the expected end date of retention. Has anyone already performed in real such action ? How have you done this ? Or would you ? Of course, I can create a new storage policy with deduplication targetting the linux MA, and attach all the clients to this new SP, but this is what I wis

3684
S
Vaulter
V
Byte
virgilByte
asked in Storage and Deduplication
error 13:138 on auxiliary copy between 2 MA

Hello I have a problem of auxiliary copy between two media agents with HP StoreOnce I have a 2*100MB WAN link between the two MA. I got 13:138 errors but job is still running See attachments for details If someone could help me SP11.22 No firewalling Firewall is Off on the two MA Regards

39131
J
Vaulter
L
Byte
Lionel DByte
asked in Storage and Deduplication
Remove DDB with no associated jobs

Hi, I’ve an old sealed DDB with no more jobs associated to it, it only shows some number of unique blocks left ( for a size of 1,18TB ) , secondary blocks is 0 , application size is already at 0. How can I then do what you proposed to do: “then remove ALL of the blocks for that store in one big macro prune.”? Cause I’d like to get totally rid of that sealed DDB ?

22885
Mike Struening
Vaulter
Robert Horowski
Commvault Certified Expert
Robert HorowskiCommvault Certified Expert
asked in Storage and Deduplication
How many DDB partitions are supported on single MA?

I’m a little confused about multiple partitions and or DDBs limitation. There are several places when limits are mentioned like the one and only Hardware Specifications for Deduplication Mode 1) https://documentation.commvault.com/11.24/expert/111985_hardware_specifications_for_deduplication_mode.html which mentions “2 DDB Disks” per MA and Configuring Additional Partitions for a Deduplication Database 2) https://documentation.commvault.com/11.24/expert/12455_configuring_additional_partitions_for_deduplication_database.html which mentions “30 DDB partitions” per MA. Also, In my recent discussion with PS member I was told that a partition should be treated as DDB itself. All of this creates a lot of confusion like a) is “DDB Disk” the same as DDB? b) is “DDB partition” the same as DDB? If you look at 1) /Scaling and Resiliency there is a information The back-end size of the data. For example: Each 2 TiB DDB disk holds up to 250 TiB for disk and 500 TiB for cloud extra large MediaAgent.

370113
P
Vaulter
B
Byte
BloopaByte
asked in Storage and Deduplication
add a FC tape library

Hello Community ! I am trying to add a tape library HP MSL G3 Series to Commvault. I am using the Expert Storage Configuration. i have selected the Two Media agents (they are already zone with the tape libraries) I have followed the procedure. Now it asks if the library have a barcode reader and I don’t know :) can you help me please ? Thanks !

1791
MichaelCapon
Vaulter
Henke
Byte
HenkeByte
asked in Storage and Deduplication
Command syntax explained

Hello, Is there someone that can interpret and let me know my assumption on the switches in the below command to are.-j = jobId-i = Deduplication Partition-c = ??-in = CV Instance-cn = Client-group = ?? “C:\Program Files\Commvault\ContentStore\Base\SIDB2.exe -j 0 -i 74 -c 178 -in Instance001 -cn client-server 1 -group 0” Also, if anyone know why the above doesen’t have a JobId, or rather why it’s 0. Is it just an internal thing to the SIDB2 process?I’ve seen the command have -j 0 as well as a -j xyz jobId that is searchable. BRHenrik

7063
Henke
Byte
A
Bit
AZOPSBit
asked in Storage and Deduplication
Change AWS Storage Tier on Existing Copies

Hey Community, 2 Questions Is it possible to change the AWS storage tier from Glacier to Deep Archive on copies that already exist beside running an aux copy? We ran 7 months of aux copies to Glacier until we were told to send it to Deep Archive.. Now we have 500TB sitting in the Glacier class and of course, costing money. I’ve started the process of just aux coping them, but it is tedious to do one job ID at a time on the Cloud Storage Archive Recall workflow. Is there a way to add multiple job IDs to the workflow? Thanks in advanced ~John

3322
A
Bit
C
Commvault Certified Expert
ChristoCommvault Certified Expert
asked in Storage and Deduplication
VTL Performance Best Practice

Hi, has anyone experiences with VTL self Deduplication Backup Appliances, like Quantum DXi4800 for Example (smaller Modells ~27 TB)? The deveices are non Deduped backuptargets for commvault. Later Aux-Copy to a physical Tape-Library is performed. I got a Performance Best Practice Guide from Quantum. They said use small cartridge size 50/100 GB (like Ultrium 1) but not how many Tape Deveices in parallel and how this relates in backup and restore performance. To much Tape-Drives maybe slow down the throughput but i have no idea which throughput per drive stream is possible comparred to a physicale tape drive which normaly only receive 100-200mb/s. Would be nice if someone else use this "old"stuff and can explain something in correlation with commvault. My last VTL implementation was 10 years ago. ThanksChristoph

3573
Damian Andre
Vaulter
Fernando Souza
Byte
Fernando SouzaByte
asked in Storage and Deduplication
Library cleaning tape procedure

Hello, The customer has purchased a tape library Fujitsu LT20. Is there an automatic tape cleaning procedure?

7372
Fernando Souza
Byte
A
Byte
AviorByte
asked in Storage and Deduplication
Separate T-Log from copy to Auxiliary Copy

Hi All i have a question for the expert's :) we using Metallic Storage for secondary copy. we backup SQL Instance’s there, with T-Log (lot of jobs) and Daily Full. i want to ask if i can somehow to exclude only the T-Log from going to the Second copy. i want only the Daily Full will go to the Auxiliary Metallic Storage. is it possible? (without create a new policy of course). thanks in advance

1575
Sunil
Vaulter
DaysAndCycles
Byte
DaysAndCycles
posted in Storage and Deduplication
Commvault Official Deduplication Limits

I think there are several deduplication-related subjects that require thorough documentation by Commvault. 1.) There is a long-standing recommendation to limit deduplication database disks to TWO PER MEDIA AGENT.’ I was able to track this recommendation as far back as Simpana 9.0, but I’m not sure if it pre-dates that. This limit feels rather arbitrary, and it doesn’t take into account the performance capabilities of the host platform, or advances in computing kit since the original recommendation was made. I can’t find any references showing WHY such a limit should exist. In my case, I have three Deduplication disks on my media agents (all NVMe SSD), and that runs with zero issues. The Media Agents are spec’d over the recommended Extra Large spec, and they don’t even sweat. I would like to issue a call to Commvault to really explain why this limitation is in place. The Deduplication Building Block section of the documentation would be an ideal place for this information. The cost of s

37739
S
Byte
description of image

Popular tags

Badge winners

Show all badges
Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings