commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication with fellow community members

  • 667 Topics
  • 3,370 Replies

667 Topics

K
Byte
KamilByte
asked in Storage and Deduplication

Commvault Deduplication activity while Windows Deduplication is running

Hello Commvault Community,  I have questions for you about the operation of the Commvault Deduplication mechanism on the server (Windows Server 2012) where the Windows Deduplication mechanism is also working. I realize that it is not recommended to use both mechanisms at the same time. My guess is that if files are deduplicated by Windows Deduplication then when backed up by Commvault they are deduplicated again by Commvault's Deduplication mechanism. If not, please explain to me what it looks like. What if the Client wants to use the Restore jobs to recover such deduplicated (possibly double files)? Are they recoverable or if there are problems and you find that the files are unrecoverable. Another question, what in the case of archiving on data deduplicated by Windows Deduplication, will they be able to be re-duplicated and later archived by Commvault? Can only new files that are not deduplicated by Windows Deduplication be backed up? From the Commvault archiving documentation I foun

3
K
Byte
1 year ago
DaysAndCycles
Byte
DaysAndCycles
asked in Storage and Deduplication

Does anyone have a write-up on DDB Version 5?

Hi!Commvault FR 11.20.    We’ll be upgrading to FR 11.24 in the Fall.    We’ll also be standing up new Media Agents, with new DDBs.   Is anyone aware of a write-up on DDB Version 5?   All I can find are references to upgrading from DDB Version 4 to Version 5 (though it doesn’t tell you how to identify what version you’re currently using).  https://documentation.commvault.com/11.24/expert/134342_upgrading_deduplication_database_to_v5.htmlI also can’t find any references in it in the release notes, though I think it first shows up in FR11.20.   It appears to be far more scalable than previous versions.   I just want to read an explanation of how it works.  Thanks!  

5
Mike Struening RETIRED
Vaulter
1 year ago
D
Byte
drPhilByte
asked in Storage and Deduplication

Inline Copy caveats

Hi all,please make me the topic of inline copy clear. I understand, that if primary copy fails, secondary copy (aux copy) fails as well. However, if for some reason the storage for the secondary copy was not accessible and secondary copy was not able to carry on, what would be with the primary copy?

2
D
Byte
1 year ago
A
Vaulter
akirbyVaulter
asked in Storage and Deduplication

Limiting the data ports used to send data between Media Agents

Hi.  We have a complicated setup where we are using a Topology Group to send data between Media Agents through a Firewall and Proxy.  Once the data hits the Firewall all data is forced into 2 tunnel ports.In addition to this control we would like to reduce the number of source ports being used so that these can be monitored for backup flow.  Currently using the Dynamic Port Range 49152 and 65535 does not allow us to do this.Is it as simple as forcing all data traffic into the tunnel (8403 by default) and if so will this create a bottleneck.Thanks, Andy

6
Mike Struening RETIRED
Vaulter
1 year ago
D
Byte
drPhilByte
asked in Storage and Deduplication

Synchronous Copy to Selective Copy

Hi there, I have a synchronous copy to tape (aux copy job is scheduled every day). Now, I want only one weekly full backup to be copied to tapes. Is there only way to create new selective copy to achieve that?Am I right, that only changing schedule for synchronous copy from every day to every week can not help - in that case all jobs from the previous week would be copied once a week at a given time ?

3
Mike Struening RETIRED
Vaulter
1 year ago
J
Byte
johanningkByte
asked in Storage and Deduplication

Using ClusterSharedVolumes with Ransomware Protection ?

Hi,Is there a way to use Ransomeware Protection on Windows MediaAgents, using a Disklibrary with Cluster Share Volumes ?Once Ransomeware Protection is activated, the filter driver “CVDLP” with the altitude of 145180 (encryption) is added to the Filesystem Filter.this results in redirected I/Os to all  ClusterSharedVolumes :BlockRedirectedIOReason      : NotBlockRedirectedFileSystemRedirectedIOReason : IncompatibleFileSystemFilterName                         : volume21Node                         : node1StateInfo                    : FileSystemRedirectedas a result the Clusted Events are flooded with Warnings:Cluster Shared Volume 'volume21' ('volume21') has identified one or more active filter drivers on this device stack that could interfere with CSV operations. I/O access will be redirected to the storage device over the network through another Cluster node. This may result in degraded performance. Please contact the filter driver vendor to verify interoperability with Cluster Shared

18
Mike Struening RETIRED
Vaulter
1 year ago
P
Bit
PatricGBit
asked in Storage and Deduplication

List all backups currently on tape outside 'Media in Library'

Hi there,We’re running Commvault v.11.21.34Is there a way to get a list of all backups currently on tapes outside the ‘Media in Library’.Some report or other way to get this list. Best regardsPatricG.

1
Sean Crifasi
Vaulter
1 year ago
F
Byte
faiezByte
asked in Storage and Deduplication

Auxiliary Copy slow performance

Hi AllI’m having performance issue with the auxiliary copy. This log capture from media agent. Having low data transfer rate. There is 2 media agent installed in this site, one is working fine, another one got issue. |*5850951*|*Perf*|592185| =======================================================================================|*5850951*|*Perf*|592185| Job-ID: 592185            [Pipe-ID: 5850951]            [App-Type: 0]            [Data-Type: 1]|*5850951*|*Perf*|592185| Stream Source:   xxxxx|*5850951*|*Perf*|592185| Simpana Network medium:   SDT|*5850951*|*Perf*|592185| Head duration (Local):  [29,June,21 11:58:57  ~  30,June,21 05:31:55] 17:32:58 (63178)|*5850951*|*Perf*|592185| Tail duration (Local):  [29,June,21 11:58:57  ~  30,June,21 05:32:31] 17:33:34 (63214)|*5850951*|*Perf*|592185| ----------------------------------------------------------------------------------------------------------------------------------------|*5850951*|*Perf*|592185|     Perf-Counter                  

4
R
Vaulter
1 year ago
M
Byte
MountainGoatByte
asked in Storage and Deduplication

Calculating the rate of change

Hi Everyone, I need to provide figures on the rate of change for our backup data, as we are looking to send data to another location with two weeks retention. I have a mature, deduplicated environment so the figures I am seeing on reports and the like, are not too much use at the moment. I need to really factor in two things:-1 - Expected size of the baseline (I will be created a new copy, targeting the new location)2 - The rate of change of future backups. So I have two main questions:- 1 - How do I calculate my expected dedupe and compression savings for my first Auxcopy.I realize this will effectively be copying over an equivalent full backup, since it will be seeding the new library.I am thinking along the lines of assuming a 50% saving (compression and some dedupe combined) but I am wondering if there a better or more accurate way of doing this? My data is largely filesystem, so OS and server, but I may need to look at application data too (SQL\ Oracle). 2 - How do I calculate my

3
M
Vaulter
1 year ago
Patrick Dijkgraaf
Commvault Certified Expert
Patrick DijkgraafCommvault Certified Expert
asked in Storage and Deduplication

Does convert to DDBv5 also enable Horizontal Scaling?

Hi all,Sorry for yet another question. But I love the quick feedback I get on this platform! :-)I have a customer running DDBv4 who wants to leverage DDBv5 with Horizontal Scaling.I know that we have the ConvertDDBToV5 workflow, or alternativelywe could convert the DDB manually.But would that also enable Horizontal Scaling automatically? Or is there some separate procedure required for getting horizontal scaling?Thanks in advance for your reply!

6
Mike Struening RETIRED
Vaulter
1 year ago
K
Bit
Kevin O'NeillBit
asked in Storage and Deduplication

On Prem Aux copy to S3?

We are looking into adding an additional layer of offsite backup storage. Amazon S3. The current idea would be add a 3rd copy to an existing storage policy. This copy would reflect the AWS S3 library. Can I Aux copy on premise backup data using physical on premise media agents directly to S3 Any suggestions would be appreciated. Thank you

6
L
Byte
1 year ago
C
Byte
christopheByte
asked in Storage and Deduplication

new global deduplication database separation

Hi All,i have created some new GDSP and i notice that DDB are separate in 3 ID by type of backup (Files, Databases and VM)i have created this commserve (CS2) in FR20.11.22, (currently the commserve is in FR20.11.55).i have another commserve CS1 in the same version 11.20.55 but created in SP16. on this CS1 when i create a new GDSP there is only one ID for the DDB.Why i can’t create a DDB like in the CS2 ?How can i have the same type of DDB on all my Commserve ? Do they need to run a converison script ? or a patch ?Kind regards,Christophe

2
C
Byte
1 year ago
E
Byte
elizabetaByte
asked in Storage and Deduplication

Question -Aux copy LTO4 tape from one Tape library to tape LTO7 on other Tape library

Hello,I have two Tape library, old with LTO4 tapes and new Tape library with LTO7 tapes.I created an Aux copy separately for each storage policy and successfully copied the content from LTO4 tapes from old Tape library to LTO7 tapes on new Tape library.We plan to shut down the old Tape library soon.When that happens, will I be able to do a Restore normally from LTO7 tapes to which content from old LTO4 tapes has been copied?Best regards,Elizabeta 

15
Mike Struening RETIRED
Vaulter
1 year ago
D
Byte
drPhilByte
asked in Storage and Deduplication

DDB Verification Schedule Policy

Hi there! There is a System Created DDB Verification schedule policy (Data Verification). In our case it starts everyday at 6AM. Is it possible to decrease the frequency of the schedule to e.g. once a week without any risk?What is the optimum value of the System Created DDB Verification schedule policy? I am asking because there is a quit big amount of data to be proceess during this task, which can reduce the performance of other tasks.

4
D
Byte
1 year ago
N
Bit
nerdgirlBit
asked in Storage and Deduplication

determine cause of DDB reconstruction

After updating one of my Media Agents to service pack 22.27 this morning, Commvault decides it needed to reconstruct the DDB on that MA.  How can I tell what instigated/initiated the rebuild?

1
Mike Struening RETIRED
Vaulter
1 year ago
T
Bit
TinketBit
asked in Storage and Deduplication

WHAT HAPPEN IF AUXCOPY HAS BEEN COPY TO TAPE

Goodmorning family pls am kind of new to commvault, Now my question is what happen once AUXCopy has been copy to tape will data on media server  backup still remain?and if it remain then can i manually delete those data on it? because most of the mounth path luns has been fill up waiting for ageing to effect and the rate by which our data increase is too fast because is a big environment. i check our VM retention policy is set to 30day am thinking if it less risky to manually delete some data off from this disknote we have 5 HQ media server with 80TB each with 10TB each LUNs 2 DR media servers also.

3
T
Bit
1 year ago
W
Byte
WaynByte
asked in Storage and Deduplication

Tape not available

Nice day, some tapes are not available in the scratch pool, although they are physically present in the library. He tried to move them to the library and did a full scan, but it didn't help. What can be done to make them available? 

18
L
Byte
1 year ago
T
Byte
TP_EricksonByte
asked in Storage and Deduplication

Separating a monthly full backup from Weekly full, best practice?

We are using a tape environment for our backups. One of the issues i have with commvaults storage policy is that it doesn't really have a difference on how it does full backups. Our retention cycles are a daily backup (Differentials) of 7 days 1 cycle, weekly full 28 days 1 cycle, and a monthly full with 1095 days +. Currently with how the storage policy is set up it is running to the default, all the data is being dumped to one tape and usually has monthly, daily and weekly data on the same tape. I notice when i pull my monthlies i sometimes will see that the weekly fulls and daily are eating up space that could be used to fill more monthly fulls unto the tape.I was wondering what would be the best practice to separate the monthly full away from the other backup retentions of the storage policy?  Would it be something along th3e lines of creating an aux copy in the storage policy and just copy the last weekly full to the aux copy to separate the monthly full from the other data? or is

4
Mike Struening RETIRED
Vaulter
1 year ago
J
JamieK
asked in Storage and Deduplication

Enable Physical Pruning equivalent in v10?

Hi all,I have a client still running v10 (yes, I know ...their call) and last year new additional storage was configured in their CommCell (2 sites). A new library and mount paths were created in each of the sites and new Primary and DASH copies created with data paths to the new storage in the respective sites.I’m finding that the storage for the Primary copy in their main site is filling up and there is nothing obvious in the forecast report. Is there such a setting in v10 which corresponds with the Enable Physical Pruning in v11? Thanks in advance.JamieK  

3
Mike Struening RETIRED
Vaulter
1 year ago
Henke
Byte
HenkeByte
asked in Storage and Deduplication

Using imutable storage data volume increase

Hello,I’m trying to do some math over effects of changing 2:nd copy to be stored on immutable volumes in azure.I have retention of 365 days, currently no seal of db database but seems recommendation is 180 days. According to the formula in another post, that would give me that I should have 545 days as immutable days on the storage volume.Our baseline is 18TB.Since there is 18TB as baseline and there will be 3 seals of the DDB, does that mean that I will add 3 times 18TB to the volume since no data pruning will happen for 545 days?//Henke

1
Mike Struening RETIRED
Vaulter
1 year ago
J
Byte
Jean-PaulByte
asked in Storage and Deduplication

How to create GridStor®️ (Alternate Data Paths)

Hello All, I would like to know if there is a procedure how to do GridStor®️ (Alternate Data Paths).I want to link a secondary Media Agent to primary(first) Media Agent.I want that the Round Robin will work with both of the Media Agent.

3
Mike Struening RETIRED
Vaulter
1 year ago
N
Bit
norBit
asked in Storage and Deduplication

Cloud Library with s3 bucket using Azure-based access

I am currently using cloud storage libraries configured with AWS IAM accounts. Our organization uses Azure for SSO to AWS.Is it possible to reconfigure the cloud libraries to use Azure credentials?

7
Mike Struening RETIRED
Vaulter
1 year ago
Fernando Souza
Byte
Fernando SouzaByte
asked in Storage and Deduplication

Additional Partitions for a Deduplication Database

HelloScenary: 2 MA´s in a CommCell.The Customer has bought 1 more MA and he wants to add the SSD disk space to the existing DDB. I was reading the manual(Commvault site) and have a question, the site says “before you start”.Where can i get this “Authenticate Code”?https://documentation.commvault.com/m/commvault/v11_sp5/article?p=features/deduplication/t_configuring_additional_partitions.htm 

13
Mike Struening RETIRED
Vaulter
1 year ago
B
Byte
BloopaByte
asked in Storage and Deduplication

Extended retention or not?

Hello,Sorry I can’t correct the title are/or :)On a Storage policy that has deduplication enabled I have this message and I understood why.My question is :can I unselect the Extended Retention Rule 1 set for 90 daysand increase the basic one to for example to 90 days, if yes, how many cycle is good to have for 90 ?   Thanks

5
Mike Struening RETIRED
Vaulter
1 year ago
downhill
Byte
downhillByte
asked in Storage and Deduplication

LTO-8 drive compatibility etc..

The Tape Storage Matrix is getting quite “interesting” over time. I am not sure why there are still references to outdated unsupported OS’s and architectures, but that’s more of an comment than a question. I’m trying to verify whether a drive is on the matrix and not coming up with anything. Under the filter section there’s no windows OS. Hmm. If I search for T50e, Windows 2008R2 is the newest “supported” OS for it? What? Is this to say if I call in a ticket for a newer OS on that autoloader might support tell me “sorry Charlie”? Latest code for that unit is BlueScale12.7.07.03-20180817F, it’s not in the Matrix at all. Not sure how to take this or not. Anyone have a similar situation. Plenty of life left in these units and still fully supported by Spectra. Will LTO-8 work?thanks

3
downhill
Byte
1 year ago

Badge winners

Show all badges
Terms & ConditionsCookie settings