commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication with fellow community members

  • 675 Topics
  • 3,384 Replies

675 Topics

A
Byte
AviorByte
asked in Storage and Deduplication

Failed to fetch valid sas token

Hi all, i will try here, We have 2 MA in Azure that acts as proxy as well.. When we tried to backup VM from azure (to cloud storage) , if we configured MA 1 as proxy job completed, when we try to configure MA 2 as proxy its failed with "failed to fetch a valid sas token" error. Anyone had a clue what cause this error? Both MA with same OS, Disks, Permission, Version..No drops from FW  & Network settings are configured (client/CS) 

8
Mike Struening RETIRED
Vaulter
1 year ago
B
BenLee
asked in Storage and Deduplication

Compression/dedupe ratio

Hello,I want to use Commvault to backup 10 laptops.The files used are :Vidéo : .MOV, MP4, .RAW, .BRAW, AVCHD, BOO, DOO, TBL,  Editing files:  .FCP ou .SRT Audio : .MP3, WAVE, AACCould I use the deduplication and compression on these files? If yes then what will be the ratio? Thanks.Best Regards,Ben

3
S
Vaulter
1 year ago
D
Byte
drPhilByte
asked in Storage and Deduplication

DDB Verification Schedule Policy

Hi there! There is a System Created DDB Verification schedule policy (Data Verification). In our case it starts everyday at 6AM. Is it possible to decrease the frequency of the schedule to e.g. once a week without any risk?What is the optimum value of the System Created DDB Verification schedule policy? I am asking because there is a quit big amount of data to be proceess during this task, which can reduce the performance of other tasks.

4
D
Byte
1 year ago
G
Bit
Glenn NgobeniBit
asked in Storage and Deduplication

The job has failed because the VSS snapshot could not be created.

Good day,Please Advise.Error Code: [7:314] The job has failed because the VSS snapshot could not be created.I have checked vssadmin list writers: No errors found.  State: [1] Stable  Last error: No errorDDB Backup Disk free space is 260 GBProcess Manager service: VSS Provider Service is running.Warm regardsGlenn Ngobeni

2
G
Bit
10 months ago
T
Byte
Tom EvansByte
asked in Storage and Deduplication

Network Bandwidth Throttling

Hi,Im having issues with throttling network utilisation for aux copies. I have about 10 Storage Policies all with Secondary copies.I’ve configured “Throttle Network Bandwidth (MB/HR)” to 25000 for the secondary copy for all storage policy. If my maths is correct that would be approx 50Mbps per aux copy. Even with all 10 running at the same times utilisation shouild only be approx 500Mbps.However through network montioring i can see when these aux copies are running they are using well over the 50Mbps configured (and saturating the network).Is my maths wrong is or the throttling configuration not  working how i expect it to work?Thanks in advance for any responses.

6
Mike Struening RETIRED
Vaulter
1 year ago
A
Vaulter
akirbyVaulter
asked in Storage and Deduplication

Limiting the data ports used to send data between Media Agents

Hi.  We have a complicated setup where we are using a Topology Group to send data between Media Agents through a Firewall and Proxy.  Once the data hits the Firewall all data is forced into 2 tunnel ports.In addition to this control we would like to reduce the number of source ports being used so that these can be monitored for backup flow.  Currently using the Dynamic Port Range 49152 and 65535 does not allow us to do this.Is it as simple as forcing all data traffic into the tunnel (8403 by default) and if so will this create a bottleneck.Thanks, Andy

6
Mike Struening RETIRED
Vaulter
1 year ago
V
Byte
virgilByte
asked in Storage and Deduplication

Move tape to default scratch pool automaticly when data is aged

Hi, i would like to know if is possible to move tape to default scratch pool automaticly when data is agedRegards 

11
Mike Struening RETIRED
Vaulter
1 year ago
DaysAndCycles
Byte
DaysAndCycles
asked in Storage and Deduplication

Does anyone have a write-up on DDB Version 5?

Hi!Commvault FR 11.20.    We’ll be upgrading to FR 11.24 in the Fall.    We’ll also be standing up new Media Agents, with new DDBs.   Is anyone aware of a write-up on DDB Version 5?   All I can find are references to upgrading from DDB Version 4 to Version 5 (though it doesn’t tell you how to identify what version you’re currently using).  https://documentation.commvault.com/11.24/expert/134342_upgrading_deduplication_database_to_v5.htmlI also can’t find any references in it in the release notes, though I think it first shows up in FR11.20.   It appears to be far more scalable than previous versions.   I just want to read an explanation of how it works.  Thanks!  

5
Mike Struening RETIRED
Vaulter
1 year ago
K
Byte
KamilByte
asked in Storage and Deduplication

The difference in the number of unique blocks in deduplication databases

Hello Commvault Community,  Today I come with a question about the Commvault deduplication mechanism. We noticed that there are two deduplication base engines with identical values but differing in one parameter - unique blocks.(engine1.png)(engine2.png)The difference between these engines is close to 1 billion unique blocks, where other values are almost identical to each other. Where could this difference come from? Is there any explainable reason why there is such a difference considering the rest of the parameters? DASH Copy is enabled between the two deduplication database engines that are managed by different Media Agents.Below I am sending examples from the other two DDB engines where the situation looks correct - the DASH Copy mechanism is also enabled.(otherengine1.png)(otherengine2.png)I am asking for help in answering what may be caused by such differences in the number of unique blocks between DDB engines.---Another issue is whether, in the case of this deduplication databa

22
Mike Struening RETIRED
Vaulter
1 year ago
A
Byte
Abdul WajidByte
asked in Storage and Deduplication

Network Throttling for Aux Copies

Hello, We have multiple sites and all these sites have different WAN bandwidths. All are DASH copying to  a single location. All these locations have different working hours. We want to create multiple bandwidth throttling rules. What would be the best way to approach this? Should we create the rules at the source Media Agent with throttling the send traffic? Thank You 

5
J
Vaulter
2 years ago
T
Byte
thomas.SByte
asked in Storage and Deduplication

Aux Copy performance

Hello, we would like to tier out the data, wich is stored on the disk library to an Huawei Object Storage. I created a secoundary copy and configured an aux copy schedule. The problem is that the disk library disc space is running low because the job is not as fast as I was hoping.The amount of data for the copy job can be up to 10 TB.Is there a solution to speed up the aux copy job ? The Media Agents provide 2x10 Gbit cards.RegardsThomas

10
Mike Struening RETIRED
Vaulter
2 years ago
F
Byte
faiezByte
asked in Storage and Deduplication

Auxiliary Copy slow performance

Hi AllI’m having performance issue with the auxiliary copy. This log capture from media agent. Having low data transfer rate. There is 2 media agent installed in this site, one is working fine, another one got issue. |*5850951*|*Perf*|592185| =======================================================================================|*5850951*|*Perf*|592185| Job-ID: 592185            [Pipe-ID: 5850951]            [App-Type: 0]            [Data-Type: 1]|*5850951*|*Perf*|592185| Stream Source:   xxxxx|*5850951*|*Perf*|592185| Simpana Network medium:   SDT|*5850951*|*Perf*|592185| Head duration (Local):  [29,June,21 11:58:57  ~  30,June,21 05:31:55] 17:32:58 (63178)|*5850951*|*Perf*|592185| Tail duration (Local):  [29,June,21 11:58:57  ~  30,June,21 05:32:31] 17:33:34 (63214)|*5850951*|*Perf*|592185| ----------------------------------------------------------------------------------------------------------------------------------------|*5850951*|*Perf*|592185|     Perf-Counter                  

4
R
Vaulter
1 year ago
R
Byte
Rahul18081Byte
asked in Storage and Deduplication

AWS S3 as Cloud Library security requirement

To connect to S3 bucket as cloud library from Media Agent (on-premises) we can use below options:1.AWS Direct Connect2.VPN Gateway3. InternetMy query is if we are using option 3 internet to connect to S3 bucket how can we protect/secure S3 bucket from outside attackers or any non authorized users accessing the S3 bucket over internet. 

14
Mike Struening RETIRED
Vaulter
1 year ago
T
Byte
thomas.SByte
asked in Storage and Deduplication

Migrate a Data Path

Hi, we just started to use an object storage to tier out the data after 7 days. We created one bucket and added it to commvault as backup target. Den we changed the config and created another bucket but forget to delete the first one and now commvault is using both buckets to store the data. How can I migrate the already stored data in bucket 2 (data path 1) into bucket 1 (data path 2) ?After I could migrate the data I would like to delete the second data path and then remove the bucket in the Object Storage.RegardsThomas

7
P
Vaulter
8 months ago
W
Vaulter
Winston WVaulter
asked in Storage and Deduplication

Failing DDB Backup on a Linux-based MA due to thin pool/volume threshold

Hi Team, My DDB Backup operations are failing with the following error message: Snap creation failed on volumes holding DDB paths. A quick review of the job logs points to some sort of free space threshold being reached. What could this mean? RegardsWinston 

3
Matthew M. Magbee
Byte
2 years ago
A
Vaulter
Abdellatif AITELBACHAVaulter
asked in Storage and Deduplication

Exagrid : best practices

HI ThereIHAC that will use exagrid as backup storage with Commvault.Exagrid states that they can add to Commvault deduplication to obtain a higher dedup ratio (up to 20:1 for long term retention data).I couldn’t find any information on Exagrid on BoL and my understanding was that we do not use CV deduplication when using a deduplication storage as primary target.Did anyone implemented CV with Exagrid ? and if so any specifics/culprit or best practices ? ThanksAbdel

7
Mike Struening RETIRED
Vaulter
1 year ago
A
Byte
AlexzyByte
asked in Storage and Deduplication

DDB RECONSTRUCTION

Hello, please i have an issue with my DDB reconstruction. Not quite long when i move my DDB to another folder e.g folder1 to folder2 but on same server. 3 days later, my colleague wants to restart the server and force kill the SID process for process manager. and now the server went into DDB recovery. since one week now file system recovery will complete but adding records will fail . now today i found out the revoery process is taken from folder1.reason becuase after DDB move the new path has not done DDB weekly backup.now my question is according to commvault  https://documentation.commvault.com/11.24/expert/12582_moving_deduplication_database_to_another_location.htmlnow the file system recovery is pointing to folder1 instead of folder2 what do you suggest.can i move DDB back to his previous folder1 ? and what could happen since it keep doing reconstruction and failing. i log a ticket against support a lady came help still is still failing.what other way can i move this DDB folder ba

15
H
Vaulter
11 months ago
J
Byte
johanningkByte
asked in Storage and Deduplication

How is backup encryption handled ?

Hi guys,I’m struggeling with encryption in a mixed environment.On the GlobalDedupePolicyCopy, I did not activate encryption.on the Client Advanced Property I enable encryptionon the subClient Property I enable encryption on Network & Media.executed Jobs are listed as ecryption enabled.does this mean, that the backups have been encrypted ? are the backups deduplicated against unencrypted backups within the same StoragePolicy ? (which might result in a mix of encrypted and unencrypted data for the same job) Since encryption is defined in the GDP and I already have two DDB partitions per MediaAgent, do I have to deploy additional MediaAgents to host the dedicated encryption backups, in case I want to enable that on the Storage Policy ?best regardsKlaus

5
Mike Struening RETIRED
Vaulter
1 year ago
K
Bit
KennethLeungBit
asked in Storage and Deduplication

Sudden low throughput & high DDB Lookup (~99%) for all backup job

We suddenly encountered low throughput & high DDB Lookup (~99%) for all backup job.We have remove a obsolete Media Server this week.  We also deleted some Storage Policy & Aux copy with no sub-client associated with.  I would like to ask if anyone encountered similar situation?  is our DeDup database corrupted?  Please help.  Many thanks

1
Edd Rimmer
Vaulter
2 years ago
K
Bit
KevinHBit
asked in Storage and Deduplication

Maximum size of a mount path on a disk library

Hello,We are in the process of migrating to a new disk library.  This disk library is a pair of NAS devices with 300 TB on each NAS.We can carve out the NAS into multiple volumes with a maximum size of 150 TB per volume.When we first setup our disk library about 10 years ago, the maximum recommended size of a mount path was 4 TB.  I know that is old guidance and I am sure this has increased over the years.We were trying to find something on the documentation and the closest we found was a reference to the maximum mount path being 25 TB, but it appears that the limitation can be overridden with a registry setting.So a few questions:Is there a maximum mount path size in a disk library? If there is, what is it? If there is, what happens if you hit the limit without adjusting the registry and can it be overridden with a registry setting? Regardless of a maximum mount path size, from a performance and management perspective is there a best practices on sizing the mount paths. We have thre

3
K
Bit
2 years ago
B
Byte
Baba ImaniByte
asked in Storage and Deduplication

Creating a Selective Copy Using a Library (Enable Deduplication)

Hi Guys, I finally found the exact article that describes a solution I wanted to implement and am seeking opinions to do this or not. Basically I want to create multiple Selective Copies under a storage policy and associate with different subclients/computers to meet a client’s tiering model and different retention. Because I also want to implement Deduplication between the Primary and each selective copy, Weekly and Monthly, I’m weighing an option to Create Selective Copy using a Library instead of using a Storage Pool. In the article below;Article: https://documentation.commvault.com/commvault/v11/article?p=119730.htmStep 17b, can I select Partition Path as a normal Windows folder e.g. D:\<randomFolder>. If I create additional selective copies under the same storage policy, can I use the same D:\randomFolder> to deduplicate data between Primary Copy and additional selective copies or I have to create a D:\<randomFolder1> and so forth for each copy. I ask because I do n

17
Sean Crifasi
Vaulter
2 years ago
J
Vaulter
jgeorgesVaulter
asked in Storage and Deduplication

I am getting Data Path Not found errors?

Hello World, I’ve recently replaced my media server and noticed my auxiliary copy jobs is getting this error whenever i try running the backup:User specified a data path which is not part of the data paths in the storage policy copy. Advice: Please specify a job data path which is part of the Storage Policy copy. Can see that the new media server has access to the library, but not sure what else to check.

4
D
Bit
10 months ago
C
Byte
Chr...Byte
asked in Storage and Deduplication

Drill holes / spares files

Hi,does anyone knows how to test if my storagesystem is supporting drill holes?..Chris

2
C
Byte
2 years ago
K
Bit
Kegan LevettBit
asked in Storage and Deduplication

Drive stuck at the "Media is being Unmounted" status

Hello,I have a tape that appears to be stuck in one of the library drives. The tape itself  reports that it is stuck in the drive. I have tried the Clean / Reload / Unload Drive options to do effect. I also restarted the Quantum tape library to see if that helps, again no luck.     Cheers  

6
K
Bit
1 year ago
B
Byte
BloopaByte
asked in Storage and Deduplication

Extended retention or not?

Hello,Sorry I can’t correct the title are/or :)On a Storage policy that has deduplication enabled I have this message and I understood why.My question is :can I unselect the Extended Retention Rule 1 set for 90 daysand increase the basic one to for example to 90 days, if yes, how many cycle is good to have for 90 ?   Thanks

5
Mike Struening RETIRED
Vaulter
1 year ago

Badge winners

Show all badges
Terms & ConditionsCookie settings