commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication with fellow community members

  • 621 Topics
  • 3,252 Replies

621 Topics

E
Byte
EldanByte
asked in Storage and Deduplication

Restore from tape of a closed site

Hi, one of my site has been closed. I took the last backup tapes from this site and put them in a tape library of current site.how can I restore (a VM in this instance) from the tapes of the old site while they are in the library of the current site?now the tapes from the old site are marked with no entrance sign

1
S
Vaulter
1 year ago
D
Byte
drPhilByte
asked in Storage and Deduplication

Drive allocation policy discrepancy

Hi all,in Master Drive Pool Properties there is set Drive Allocation Policy to Use All Drives. In our case, we have 4 drives fully accessible. However, only 2 drives are in use. Is it possible that this settings is somehow and somewhere overriden? Is there way to figure out why are some of the drives idle? There is a lot of running jobs accros the multiple storage policies so it would be good to utilize all drives. 

5
Mike Struening
Vaulter
1 year ago
K
Byte
KelvinByte
asked in Storage and Deduplication

Auxiliary copy is stuck at 30%

Our weekly secondary AuxCopy is stuck at 30% since this weekend (so that it is blocking all the primary disk to disk incremental copies), with the below 2 error messages Thinking it might be some ports communication issue between the Media Server (S01190) where the tape library is attached to, and the CommCell Server (S02116), so I did the below ports check between the 2 Servers: Telnet from the Media Server (S01190) to the CommCell Server (S02116)Port 8400        OKPort 8401        OKPort 8403        OK Telnet from the CommCell Server (S02116) to the Media Server (S01190)Port 8400        OKPort 8401        Not OKPort 8403        Not OK Now, before I speak to our Network/Security administrator who have recently installed SentinelOne AV on both of the above 2 Servers, I’m wondering if I’m heading the right direction, and if I have done all the ports checking ?  Thanks,Kelvin

29
Mike Struening
Vaulter
1 year ago
P
Bit
PatricGBit
asked in Storage and Deduplication

List all backups currently on tape outside 'Media in Library'

Hi there,We’re running Commvault v.11.21.34Is there a way to get a list of all backups currently on tapes outside the ‘Media in Library’.Some report or other way to get this list. Best regardsPatricG.

1
Sean Crifasi
Vaulter
1 year ago
Ken_H
Byte
Ken_HByte
asked in Storage and Deduplication

Possible to increase the Aux Copy anomaly threshold?

I do full backups of production servers on Friday night and non-production servers Saturday night.  Every Monday my inbox has roughly 20 anomaly emails about aux copy jobs running longer than usual.  This has been going on for months now.  Is it possible to tweak the anomaly thresholds in CommVault so I get fewer emails?Ken 

6
Mike Struening
Vaulter
1 year ago
B
Byte
bc1410Byte
asked in Storage and Deduplication

Critical Event - DDB reaching QI time threshold...

Still a noice commvault user..  Noticed that we have been getting the following Event in the evvent viewer.. DDB(s) reaching QI time threshold for adding new Subclients [{DDB [XXXXXX-GlobalDedup_Databases_5] MediaAgent [XXXX-cv1a] Path [D:\XXXX-DDP] AvgQITime [1153] Free Space Percentage [94] }]. New DDB(s) may gets created if it crosses threshold. Please review the DDB configuration, for more details refer Deduplication Building Block Guide on Books Online. Can anybody help me understand this and how to correct this.   Our small environment is all on AWS. Thanks BC 

5
M
Vaulter
11 months ago
Ken_H
Byte
Ken_HByte
asked in Storage and Deduplication

Showing library storage use over time

Hello everyone,At my DR site I use HP MSA disk devices for CommVault backup storage and they are currently over 86% full.  I have asked my manager to add the cost of another MSA to the budget and she’s asking for growth rates to ensure that one MSA will be sufficient.  I’m searching for that information and am not able to find it even though (I would have thought) that this is a pretty basic information.  I did find the “Disk Library Growth Trend” report but don’t trust its numbers as the used space and free space increase at the same time despite the fact that the total storage has remained constant.  I’m not sure where it’s getting its information but, well, it just doesn’t make sense.  Screen capture below.So my question is:  How can I find a storage growth rate to use for media agent capacity planning?Ken 

9
Mike Struening
Vaulter
1 year ago
DaysAndCycles
Byte
DaysAndCycles
asked in Storage and Deduplication

Does anyone have a write-up on DDB Version 5?

Hi!Commvault FR 11.20.    We’ll be upgrading to FR 11.24 in the Fall.    We’ll also be standing up new Media Agents, with new DDBs.   Is anyone aware of a write-up on DDB Version 5?   All I can find are references to upgrading from DDB Version 4 to Version 5 (though it doesn’t tell you how to identify what version you’re currently using).  https://documentation.commvault.com/11.24/expert/134342_upgrading_deduplication_database_to_v5.htmlI also can’t find any references in it in the release notes, though I think it first shows up in FR11.20.   It appears to be far more scalable than previous versions.   I just want to read an explanation of how it works.  Thanks!  

5
Mike Struening
Vaulter
1 year ago
D
Byte
drPhilByte
asked in Storage and Deduplication

Inline Copy caveats

Hi all,please make me the topic of inline copy clear. I understand, that if primary copy fails, secondary copy (aux copy) fails as well. However, if for some reason the storage for the secondary copy was not accessible and secondary copy was not able to carry on, what would be with the primary copy?

2
D
Byte
1 year ago
D
Byte
drPhilByte
asked in Storage and Deduplication

Synchronous Copy to Selective Copy

Hi there, I have a synchronous copy to tape (aux copy job is scheduled every day). Now, I want only one weekly full backup to be copied to tapes. Is there only way to create new selective copy to achieve that?Am I right, that only changing schedule for synchronous copy from every day to every week can not help - in that case all jobs from the previous week would be copied once a week at a given time ?

3
Mike Struening
Vaulter
1 year ago
K
Byte
KamilByte
asked in Storage and Deduplication

Commvault Deduplication activity while Windows Deduplication is running

Hello Commvault Community,  I have questions for you about the operation of the Commvault Deduplication mechanism on the server (Windows Server 2012) where the Windows Deduplication mechanism is also working. I realize that it is not recommended to use both mechanisms at the same time. My guess is that if files are deduplicated by Windows Deduplication then when backed up by Commvault they are deduplicated again by Commvault's Deduplication mechanism. If not, please explain to me what it looks like. What if the Client wants to use the Restore jobs to recover such deduplicated (possibly double files)? Are they recoverable or if there are problems and you find that the files are unrecoverable. Another question, what in the case of archiving on data deduplicated by Windows Deduplication, will they be able to be re-duplicated and later archived by Commvault? Can only new files that are not deduplicated by Windows Deduplication be backed up? From the Commvault archiving documentation I foun

3
K
Byte
1 year ago
F
Bit
faiezBit
asked in Storage and Deduplication

Auxiliary Copy slow performance

Hi AllI’m having performance issue with the auxiliary copy. This log capture from media agent. Having low data transfer rate. There is 2 media agent installed in this site, one is working fine, another one got issue. |*5850951*|*Perf*|592185| =======================================================================================|*5850951*|*Perf*|592185| Job-ID: 592185            [Pipe-ID: 5850951]            [App-Type: 0]            [Data-Type: 1]|*5850951*|*Perf*|592185| Stream Source:   xxxxx|*5850951*|*Perf*|592185| Simpana Network medium:   SDT|*5850951*|*Perf*|592185| Head duration (Local):  [29,June,21 11:58:57  ~  30,June,21 05:31:55] 17:32:58 (63178)|*5850951*|*Perf*|592185| Tail duration (Local):  [29,June,21 11:58:57  ~  30,June,21 05:32:31] 17:33:34 (63214)|*5850951*|*Perf*|592185| ----------------------------------------------------------------------------------------------------------------------------------------|*5850951*|*Perf*|592185|     Perf-Counter                  

4
R
Vaulter
1 year ago
A
Vaulter
akirbyVaulter
asked in Storage and Deduplication

Limiting the data ports used to send data between Media Agents

Hi.  We have a complicated setup where we are using a Topology Group to send data between Media Agents through a Firewall and Proxy.  Once the data hits the Firewall all data is forced into 2 tunnel ports.In addition to this control we would like to reduce the number of source ports being used so that these can be monitored for backup flow.  Currently using the Dynamic Port Range 49152 and 65535 does not allow us to do this.Is it as simple as forcing all data traffic into the tunnel (8403 by default) and if so will this create a bottleneck.Thanks, Andy

6
Mike Struening
Vaulter
1 year ago
M
Byte
MountainGoatByte
asked in Storage and Deduplication

Calculating the rate of change

Hi Everyone, I need to provide figures on the rate of change for our backup data, as we are looking to send data to another location with two weeks retention. I have a mature, deduplicated environment so the figures I am seeing on reports and the like, are not too much use at the moment. I need to really factor in two things:-1 - Expected size of the baseline (I will be created a new copy, targeting the new location)2 - The rate of change of future backups. So I have two main questions:- 1 - How do I calculate my expected dedupe and compression savings for my first Auxcopy.I realize this will effectively be copying over an equivalent full backup, since it will be seeding the new library.I am thinking along the lines of assuming a 50% saving (compression and some dedupe combined) but I am wondering if there a better or more accurate way of doing this? My data is largely filesystem, so OS and server, but I may need to look at application data too (SQL\ Oracle). 2 - How do I calculate my

3
M
Vaulter
1 year ago
N
Byte
Nico BassonByte
asked in Storage and Deduplication

Possible to reset media refresh tag on tapes?

Hi,Is there a way to “reset” the ‘Picked for Refresh / Prevented’ status of media? Some media was marked as prevented, and then the auto refresh criteria was changed after. How do I see which of these “Prevented” media should be auto picked now, I can only flip the manually  “prevented” media back to manually “picked” Thanks.

15
Mike Struening
Vaulter
1 year ago
K
Bit
Kevin O'NeillBit
asked in Storage and Deduplication

On Prem Aux copy to S3?

We are looking into adding an additional layer of offsite backup storage. Amazon S3. The current idea would be add a 3rd copy to an existing storage policy. This copy would reflect the AWS S3 library. Can I Aux copy on premise backup data using physical on premise media agents directly to S3 Any suggestions would be appreciated. Thank you

6
L
Byte
1 year ago
DaysAndCycles
Byte
DaysAndCycles
posted in Storage and Deduplication

Commvault Official Deduplication Limits

I think there are several deduplication-related subjects that require thorough documentation by Commvault.     1.) There is a long-standing recommendation to limit deduplication database disks to TWO PER MEDIA AGENT.’ I was able to track this recommendation as far back as Simpana 9.0, but I’m not sure if it pre-dates that.   This limit feels rather arbitrary, and it doesn’t take into account the performance capabilities of the host platform, or advances in computing kit since the original recommendation was made.   I can’t find any references showing WHY such a limit should exist.In my case, I have three Deduplication disks on my media agents (all NVMe SSD), and that runs with zero issues.  The Media Agents are spec’d over the recommended Extra Large spec, and they don’t even sweat.  I would like to issue a  call to Commvault to really explain why this limitation is in place. The Deduplication Building Block section of the documentation would be an ideal place for this information.  Th

9
S
Byte
1 year ago
C
Byte
christopheByte
asked in Storage and Deduplication

new global deduplication database separation

Hi All,i have created some new GDSP and i notice that DDB are separate in 3 ID by type of backup (Files, Databases and VM)i have created this commserve (CS2) in FR20.11.22, (currently the commserve is in FR20.11.55).i have another commserve CS1 in the same version 11.20.55 but created in SP16. on this CS1 when i create a new GDSP there is only one ID for the DDB.Why i can’t create a DDB like in the CS2 ?How can i have the same type of DDB on all my Commserve ? Do they need to run a converison script ? or a patch ?Kind regards,Christophe

2
C
Byte
1 year ago
D
Byte
drPhilByte
asked in Storage and Deduplication

DDB Verification Schedule Policy

Hi there! There is a System Created DDB Verification schedule policy (Data Verification). In our case it starts everyday at 6AM. Is it possible to decrease the frequency of the schedule to e.g. once a week without any risk?What is the optimum value of the System Created DDB Verification schedule policy? I am asking because there is a quit big amount of data to be proceess during this task, which can reduce the performance of other tasks.

4
D
Byte
1 year ago
S
Byte
SkarraByte
asked in Storage and Deduplication

Data Domain BoostFS with HyperScale X?

Is it possible to install the BoostFS library on a HyperScale X Media Agent, and if so is it supported?I’m looking to write a additional backup copy to storage outside of the appliance and hope I can do it in a deduplicated manner rather than having to send a full copy to the data domain.  The topic of BoostFS is discussed on https://documentation.commvault.com/commvault/v11/article?p=9404.htm#o132281, but nothing specific to HyperScale X and BoostFS at https://documentation.commvault.com/commvault/v11/article?p=128105.htm.Thanks

7
S
Byte
1 year ago
N
Bit
nerdgirlBit
asked in Storage and Deduplication

determine cause of DDB reconstruction

After updating one of my Media Agents to service pack 22.27 this morning, Commvault decides it needed to reconstruct the DDB on that MA.  How can I tell what instigated/initiated the rebuild?

1
Mike Struening
Vaulter
1 year ago
T
Bit
TinketBit
asked in Storage and Deduplication

WHAT HAPPEN IF AUXCOPY HAS BEEN COPY TO TAPE

Goodmorning family pls am kind of new to commvault, Now my question is what happen once AUXCopy has been copy to tape will data on media server  backup still remain?and if it remain then can i manually delete those data on it? because most of the mounth path luns has been fill up waiting for ageing to effect and the rate by which our data increase is too fast because is a big environment. i check our VM retention policy is set to 30day am thinking if it less risky to manually delete some data off from this disknote we have 5 HQ media server with 80TB each with 10TB each LUNs 2 DR media servers also.

3
T
Bit
1 year ago
S
STR
asked in Storage and Deduplication

Adding new Library to deduplication database

Hello, We have created a new library. we were trying to associate it to an existing deduplication engine (new data path) but its not avaiable.Can anyone help understand why? Regards,

9
Mike Struening
Vaulter
1 year ago
Henke
Byte
HenkeByte
asked in Storage and Deduplication

Using imutable storage data volume increase

Hello,I’m trying to do some math over effects of changing 2:nd copy to be stored on immutable volumes in azure.I have retention of 365 days, currently no seal of db database but seems recommendation is 180 days. According to the formula in another post, that would give me that I should have 545 days as immutable days on the storage volume.Our baseline is 18TB.Since there is 18TB as baseline and there will be 3 seals of the DDB, does that mean that I will add 3 times 18TB to the volume since no data pruning will happen for 545 days?//Henke

1
Mike Struening
Vaulter
1 year ago
J
JamieK
asked in Storage and Deduplication

Enable Physical Pruning equivalent in v10?

Hi all,I have a client still running v10 (yes, I know ...their call) and last year new additional storage was configured in their CommCell (2 sites). A new library and mount paths were created in each of the sites and new Primary and DASH copies created with data paths to the new storage in the respective sites.I’m finding that the storage for the Primary copy in their main site is filling up and there is nothing obvious in the forecast report. Is there such a setting in v10 which corresponds with the Enable Physical Pruning in v11? Thanks in advance.JamieK  

3
Mike Struening
Vaulter
1 year ago

Badge winners

Show all badges
Terms & ConditionsCookie settings