commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication with fellow community members

  • 588 Topics
  • 3,129 Replies

588 Topics

T
Byte
thomas.SByte
asked in Storage and Deduplication

Aux Copy performance

Hello, we would like to tier out the data, wich is stored on the disk library to an Huawei Object Storage. I created a secoundary copy and configured an aux copy schedule. The problem is that the disk library disc space is running low because the job is not as fast as I was hoping.The amount of data for the copy job can be up to 10 TB.Is there a solution to speed up the aux copy job ? The Media Agents provide 2x10 Gbit cards.RegardsThomas

10
Mike Struening
Vaulter
1 year ago
E
Byte
elizabetaByte
asked in Storage and Deduplication

How to move data from LTO4 (from one Tape library) to LTO7 on another Tape library?

Hello,I have old Tape library TS3200 with LTO4 tapes and new Tape library HPE with LTO7 tapes. I would like to copy data from LTO4 to LTO7 tapes.I worked according documentation Media Refresh (commvault.com) .I have Enabled Media Refresh on Storage policy copy, media for Refresh I have marked Full, and Pick for Refresh. I have run Media Refresh job and choose tab Start new media…No, I have error “There are not enough drives in the drive pool. This could be due to drive limit set on master pool if this failure is for magnetic library.”I don’t know where the problem is?Is there anything else to do for Media refresh operation?Best regards,Elizabeta 

27
Mike Struening
Vaulter
1 year ago
K
Bit
KennethLeungBit
asked in Storage and Deduplication

Sudden low throughput & high DDB Lookup (~99%) for all backup job

We suddenly encountered low throughput & high DDB Lookup (~99%) for all backup job.We have remove a obsolete Media Server this week.  We also deleted some Storage Policy & Aux copy with no sub-client associated with.  I would like to ask if anyone encountered similar situation?  is our DeDup database corrupted?  Please help.  Many thanks

1
Edd Rimmer
Vaulter
1 year ago
R
Bit
RolandasBit
asked in Storage and Deduplication

Object storage vs File storage (S3 vs NFS)

Hi all, we are looking into our backup strategy and investigating few scenarios of backend storage. Right now we are considering object storage via S3 protocol and file storage (JBOD) over NFS protocol. The data which will be send there is on-prem filesystems, databases, VM’s etc. Total capacity - over 10 PB.Currently we tested some object storage over S3 protocol but we faced issues with data reclamation (garbage collection for expired objects taking way too long and capacity reclaimed wait time takes over month or few). Can you share your experience with back-end storage, what challenges you faced or how you solved my mentioned issues, also, what advantages you see comparing S3 & NFS protocols for backups. All feedback is very appreciated.Thanks! 

4
Mike Struening
Vaulter
1 year ago
G
Byte
gary mcneelyByte
asked in Storage and Deduplication

Aux copy job shows running after operational window

Aux copy job shows running after operational window.The aux copy job stops running at 7am due to blackout window then Automatically resumes and the job is killed by the System ( reason the job has exceeded the total running time.)The answer I am looking for is does it pass traffic after the blackout window is in place  

1
C
Vaulter
1 year ago
L
Byte
Lubos Dvorak
asked in Storage and Deduplication

Microsoft OneDrive Cloud Storage

Hi All,I have an issue when adding a OneDrive cloud storage.I am configuring via CommCell Console. If I enter Application ID, Tenant ID and Shared Secret and then click the Detect button I receive an error “ ### EvMMConfigMgr::onMsgCloudOperation() - Failed to check cloud server status, error = [[Cloud] The requested URI does not represent any resource on the server.  Message: Invalid hostname for this tenancy ”Commvault support answer is “The cloud vendor should be able to help you with the right URL. This is outside Commvault unfortunately ”.Does anybody have any experience using Microsoft OneDrive as a cloud storage?Thank you,Lubos 

13
Mike Struening
Vaulter
1 year ago
G
Bit
gibby101Bit
asked in Storage and Deduplication

question about setting up exchange db client to backup all passive DBs.

We have four Exchange servers. Each DB has a passive and active copy with them being on different servers. We installed the media agent and a backup disk on the exchange db server. Usually i know what DBs are passive on each server so i setup a subclient on each one so the back up will run from the passive disk directly over the SAN to the backup disk without using the network. However sometime exchange admins will do patching late at night and the DBs will failover and they wont fail them back til later. when this happens the db backups are much slower. I want to avoid this by configuring each subclient to only backup the passive DBs that are on the same server as the media agent/backup disk. my goal is to never run backups over the network even when DBs are failed over to other servers. is this possible? 

6
Mike Struening
Vaulter
1 year ago
T
Byte
TP_EricksonByte
asked in Storage and Deduplication

No Index Backup in last 30 days

So the ticketing service is kind of being slow with this process, and i want to know if I can do this on my own. We have an alert for No Index Backup in the last 30 days. I don't know why they are not storing the index information on the media agents but storing the index data to tape. How do i get a client that is on this list for no index backup to get the index to backup to the media agent so i can get rid of this list?

1
Damian Andre
Vaulter
1 year ago
F
Francisco_Vasconcelos
asked in Storage and Deduplication

DDB corrupted on Windows server and sealed DDBs

Hello,  I would like to request your help as i’m quite new and have only basic knowledge of backup systems.After reading the commvault documentation available online and tried to troubleshoot the issues, they were narrowed down to 3: Sealed DDB are not aging out. When I try to run a verification of existing jobs on disk and deduplication database it says DDB is corrupted. we have our disks full, as the backups all have stopped.When i run the data retention forecast and compliance report it says “BASIC CYCLE” as reason why jobs are not aged out, i have this dedup policy to age out jobs after 1 cycle, so i guess that if i do a full backup, the previous will be aged out.. except i dont have any available disk space. Also I was unable to find a DDB backup as it seems there was never one to begin with. Should i reconstruct one new from the group up? How can i reduce the size of sealed DDBs as they are quite old.

12
Anthony.Hodges
Commvault Certified Expert
1 year ago
S
Bit
Steven503Bit
asked in Storage and Deduplication

Migrating to new Media Agent Server

I’m looking to migrate to new Server Hardware for one of my Media Agents and looking for best approach and minimal downtime.Was thinking I could setup the new hardware with the media agent role/software and start to move mount paths to the new server.  Once all mount paths have been moved to the new MA I can then update my storage policies to point to the new MA.  Is there anything else I need to look out for or would need to do?Any advice or knowledge on this would be great.Thanks 

2
S
Bit
1 year ago
Ken_H
Byte
Ken_HByte
asked in Storage and Deduplication

Metallic Cloud Storage solution (MCSS) shows offline

My CommVault cloud media agent is offline.  Is there a problem with the CV cloud services?  I’m in Canada if that makes any difference.Ken

8
Mike Struening
Vaulter
1 year ago
S
Byte
Sudharshan KumarByte
asked in Storage and Deduplication

Media Retirement

Hello Team,  Just thought to discuss with everyone, we have lots of medias thats turn into "Deprecated” moved to Retire Pool which are very less usage. When am looked the information in Media Properties shows below message,   When I could see Side information, shows ver less usage info : As per the default CommVault Media Hardware Maintenance shows as below,  Here my question is : Whether those medias mark as good and re-use for future its advisible? Can you someone clarifity from MM. @Christian Kubik 

6
Mike Struening
Vaulter
1 year ago
Henke
Byte
HenkeByte
asked in Storage and Deduplication

Change path

We have some trouble with paths to a Synology nas going offline.Currently we have the DNS name in the path. I’d like to change that to referring the IP address instead. I’m pretty sure I can do it without any issues but better safe then sorry. Anyone see any risks of changing the \\DNSname to \\IPaddress for the path(s)? //Henke 

2
Scott Moseman
Vaulter
1 year ago
D
Byte
DannyByte
asked in Storage and Deduplication

Deduplication transaction log backup

Hi,We have a little discussion going on if transaction log backups are non-dedup by default despite the StoragePolicyCopy has deduplication enabled.Or do we need to configure a non dedup storage policy for this?In my believe a Log Storage Policy is there for other retention times and copies. The backup type decides if the data must be dedupped or not.Can someone clarify for me?Kind regards,Danny

1
Sunil
Vaulter
1 year ago
D
Bit
djustisBit
asked in Storage and Deduplication

The SDT data transfer was terminated on a request from the Job Manager on 11.20.40

Running v11SP20.40.  We’re having a ton of occurrences in the last 3 weeks of this error across multiple environments:[The SDT data transfer was terminated on a request from the Job Manager.]I work in a MSP environment with the CS in one datacenter and the MAs spread out around the country.  We have a minimum of 10GB on our datacenter links from MA-MA and MA-CS.  I’m curious if anyone has seen this and has any resolution or troubleshooting steps.Thanks!

5
Damian Andre
Vaulter
1 year ago
G
Giri
asked in Storage and Deduplication

DDB can be create the shared datastore ?

Can we use the Shared disk to create the DDB on Linux machines 

2
Mike Struening
Vaulter
1 year ago
A
Anonymous
asked in Storage and Deduplication

HyperScale X performance went time come to auxcopy to tape ?

Hi guys,  I'm having a customer who is actually using Standard MA with Commvault to back up to copy 1 to disk (PureFlash with NVMe Drives), copy 2 (and other PureFlash) and a copy 3 to Tape around 350 TB per week to send to tapes (LTO7) 4 tape drives (weekly Full) at a sustain throughput of 700 GB/Hour per drive (4 drive in parallel). We are looking to replace both MA with two HyperScaleX clusters.  The questions are ! How we need to configure the HyperScaleX (reference architecture) to sustain the weekly tape creation of 350 TB per week with the same throughput knowing that we are going to use NearLine SAS in the HyperscaleX Cluster !  Or ca we use SSD for the Storage Pool drive in a HyperScaleX. 

18
Marco Lachance
Byte
1 year ago
I
Bit
IgorBit
asked in Storage and Deduplication

After data clean-up and aging the Disk Library shows the same Free Space??

Hello all,I ran into a bit of an issue… Yesterday, one of the Disk Libraries got filled up and the backups went into waiting status. After haveing a look at the utilization, indeed it turned out to be 99,7% full.The main culprit were SQL server backups: There were some backup jobs with an extended retention - so I’ve deleted those, and some more of the old backup jobs to make space. I also ran Data Aging and could clearly see data chunks being deleted in SIDBPhysicalDeletes.log and after a while I got this:  So, I assume quite a bit of data was deleted. The Primary copy (blue) went from 52.95TB down to 19.81 TB. However, when I check the Free Space on the Library I got very little: So I checked the Mountpaths Space Usage for that DL: Data Written corresponds to amount of space used by the Primary copy: 19.8 TBHowever Size on Disk, which takes into account Data Written + aged jobs which are still referenced by valid jobs is still very high. Almost unchanged. I am quite confused by this.

11
Mike Struening
Vaulter
1 year ago
M
Bit
Mahmoud RoshdyBit
asked in Storage and Deduplication

commvault exam and certificates

hi, i need to take commvault certificate. how can i exam and there is dump file for exam to study? Thanks

2
MichaelCapon
Vaulter
1 year ago
K
Bit
KevinHBit
asked in Storage and Deduplication

Maximum size of a mount path on a disk library

Hello,We are in the process of migrating to a new disk library.  This disk library is a pair of NAS devices with 300 TB on each NAS.We can carve out the NAS into multiple volumes with a maximum size of 150 TB per volume.When we first setup our disk library about 10 years ago, the maximum recommended size of a mount path was 4 TB.  I know that is old guidance and I am sure this has increased over the years.We were trying to find something on the documentation and the closest we found was a reference to the maximum mount path being 25 TB, but it appears that the limitation can be overridden with a registry setting.So a few questions:Is there a maximum mount path size in a disk library? If there is, what is it? If there is, what happens if you hit the limit without adjusting the registry and can it be overridden with a registry setting? Regardless of a maximum mount path size, from a performance and management perspective is there a best practices on sizing the mount paths. We have thre

3
K
Bit
1 year ago
V
Bit
VedamurthyBit
asked in Storage and Deduplication

Could not connect to the DeDuplication Database process for Store Id [1].

Backups failing with error,  Could not connect to the DeDuplication Database process for Store Id [1]. +   unable find any KB article for the same,      can some1 suggest on this

1
MichaelCapon
Vaulter
1 year ago
T
Bit
TomasBit
asked in Storage and Deduplication

DDB creation "The specified path is already in use"

Hi,I’ve needed to delete - create again the DDB and I need to use same partition paths as they were used before (disk was formatted). Currently I cannot create a DDB as I have message: “The specified mount path os already in use”Well I know that it’s described here:http://kb.commvault.com/DD0051 But do you know somebody if there is way to force cleanup and do not wait 24h ? The data aging is not doing the trick. Thanks

2
P
Vaulter
1 year ago
Fernando Souza
Byte
Fernando SouzaByte
asked in Storage and Deduplication

DDB - Cluster Windows - Doubts

Hello,I have a doubt in setting up DDB Creation in awindows cluster environment.2 physical servers with installed media agent and a virtual storage (starwind)1) can the DDB be on the storage shared by the nodes of the cluster?2) Can I use only 1 DDB for all nodes (MA) or should I have a DDB for each MA? 

6
L
Vaulter
1 year ago
K
Bit
Karamveer SinghBit
asked in Storage and Deduplication

chunk commit process during backup job using ddb

Hi all,Is it possible if some explain the process of committing chunks to lib and signature in ddb. I read somewhere that chunk will keep on noting all data blocks even it is repeated. Actually m confused with that statement . Might b my understanding is wrong but need help to understand exactly when ddb signatures will be committed to ddb and when will chunk will get committed ?

1
Damian Andre
Vaulter
1 year ago
G
Byte
Gabriele PalumboByte
asked in Storage and Deduplication

Configure two tape libraries in one storage policy

Hi to All,Can I configure two tape libraries in one storage policy, in order to balance the load or in case of failure? 

1
sbhatia
Vaulter
1 year ago

Badge winners

Show all badges
Terms & ConditionsCookie settings