Skip to main content
commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 1,141 Topics
  • 4,868 Replies
1141 Topics
J
Byte
justin000Byte
asked in Storage and Deduplication
Space reclamation / orphan data cleaning against cloud storage library

Hi all,Wondering if by chance anyone has experience running DDB space reclamation with orphan data cleanup against a cloud library. We have a cloud library in Azure cool tier which we expect may have some data that was not pruned successfully, thus increasing our storage consumption in Azure. The deduplication database for this data lives on local storage.We’d love to run a space reclamation with orphan data cleanup against this cloud library, but we’re concerned about the possible cost of storage transactions against the Azure cool library.Has anyone performed this operation before and observed the related cloud storage costs? For reference, we have just under 100 million blobs and a total of about 400TB of storage utilization in Azure. Many thanks for any input folks may have!

6832
J
Byte
G
Bit
GordABit
asked in Storage and Deduplication
Settings for WInSCP and HyperscaleX

Hi, for connecting to a HyperscaleX appliance to drop and pickup files, are there any tweak settings?I’ve been toggling between \bin\bash and default for shell and using SCP/22 and authentication works but the session never gets going. ThanksG

1275
G
Bit
K
Bit
kumaraBit
asked in Storage and Deduplication
Disk storage occupied

Hi Team,As per the snapshot, total data written 1.33 TB  out of 10TB . But free space showing me 46 GB only.The same like showing me other mount points. But when check the physical size it is occupied around 10 TB only. Please help me on this.

883
Zubair Ahmed Sharief
Vaulter
A
Byte
AjalByte
asked in Storage and Deduplication
Reclaiming disk space

hello ,  we are standardizing our storage policies as part of that we are changing the retention set for the storage policies , most of them are lower retention than previously set if i run data aging job will it help to reclaim the storage space 

2701
O
Vaulter
S
Bit
SomeUniqueName
asked in Storage and Deduplication
New E2812/Media Agents recommendation

I’m slogging through a CV hardware upgrade.  My company is “trying” to find $$ for training...but so far no joy, so I’m winging it.I have a new NetApp E2812, two new media agents, and a shiny Brocade FC switch to bind them all together.My immediate question is, do I create two volumes on the E2812 and mount one on each MA?  Or can I create just one volume and let both MAs read/write to it simultaneously?  Typically, sharing a volume like that across multiple Windows servers leads to trouble, but can the CV media agents handle that sharing?I like the idea of a single volume letting both MAs access all of the available disk space. That alleviates the need to balance my backups across the different volumes. Does anyone have any helpful pointers for me?  Much obliged.

873
S
Bit
P
Byte
Pedro LagesByte
asked in Storage and Deduplication
Reporting CLI

Good afternoon,I am trying to create a report on the occupancy of our libraries. However, the report coming from Commvault has a lot of information.Would it be possible to use CLI to extract only the information I want?My idea is to create a script and run it every month without having to manually organize the data.

931
Damian Andre
Vaulter
K
Byte
Kyle32043Byte
asked in Storage and Deduplication
Clarification on Deleting Jobs on Tape

 Hello, I am updating some our documentation on our best practices to securely delete files from file server's backups.The file server backups in questions are only stored on a primary copy residing on tape, encrypted via AES 256 per the storage policy, and using the built in key management server. Normally if we need to delete a file, we follow the documentation  and use the delete data by browsing option. For clarification, if I use the "delete data by browsing option" and delete a file that resides offsite on tape, there is no way to recover that file, correct? There is no way to "Un-Age" or catalog operation on the tape I could perform if I were to insert it back into my tape library? I assume that the CommCell destroys the indexed data/encryption keys associated with that file and cannot read that block of data on the tape? Recently I noticed an option in the CommCell browser where I can delete content of an entire tape. Storage Resources > Libraries > Tape Library > Medi

4291
Jos Meijer
Commvault Certified Expert
K
Bit
kumaraBit
asked in Storage and Deduplication
DDB threshold reached max limit

Hi Team,The DDB partition Q&I time is very high post changed the DDB partition location. I have moved the DDB partition recently from one drive to another due to space was full.As per storage team, we are using Lun assigned NLSAS_SSD drives on our MA. Now all the backups are running very slow. I want to reduce the Q&I time or else want to run the DDB on single (T:\ DDB) partition. because the backups are running fine using that DDB(when i was moved the DDB that time it was used another partition) Please suggest on this.I have raised a case to vendor, they are suggesting to run the ConvertDDBToV5 workflow job and waiting for the steps and DT. 

2811
M
Vaulter
B
Bit
BillKBit
asked in Storage and Deduplication
DDB reconstruction

Hello,During a DDB reconstruction process, how does it reconstruct the missing data?  In our case, it first performed a restore of the last backup which was from sometime early morning.  Does it then access the library storage directly to reconstruct the missing data or does it access the Commserve?  I’m asking because I’ve been told conflicting information from different Commvault technicians.  I just want to make sure that I understand this process clearly.  Thank you. Bill

43594
F
Byte
G
Byte
gogi100Byte
asked in Storage and Deduplication
problem with Aux copy job Failedi have [13:138] [40:91] [40:65]

i have next problem Alert:Aux copy job FailedType:Job Management - Auxiliary CopyDetected Criteria:Job FailedIs escalated:Detected Time:Wed Dec 28 23:42:51 2022CommCell:CommServeUser:AdministratorJob ID:63139Status:FailedStorage Policy Name:CommServeDRCopy Name:SecondaryStart Time:Wed Dec 28 23:00:11 2022Scheduled Time:Wed Dec 28 23:00:08 2022End Time:Wed Dec 28 23:42:51 2022Error Code:[13:138] [40:91] [40:65]Failure Reason:Error occurred while processing chunk [245216] in media [V_845], at the time of error in library [RezervnaKopija] and mount path [[CommServe] \\192.168.99.51\RezervnaKopija], for storage policy [CommServeDR] copy [Secondary] MediaAgent [CommServe]: Backup Job [62773]. Cannot impersonate user. User credentials provided for disk mount path access may be incorrect. Failed to Copy or verify Chunk [245216] in media [CV_MAGNETIC], Storage Policy [CommServeDR], Copy [Primary], Host [DRI-COMMVAULT.dri.local], Path [\\192.168.99.51\RezervnaKopija\MX19RW_07.26.2022_08.59\CV_M

145914
Damian Andre
Vaulter
K
Vaulter
KaranVaulter
asked in Storage and Deduplication
Restore from Combined Storage Tier Cool/Archive

Hi All,I have question regarding the Restore process specially for the VM Gues File system restore when done from the combined Storage Tier Cool-Archive being as used as end for long term Library.As understand, the Index and Meta data in this case will be in Cool storage and hence we would be able to Browse the data without having to run the recall workflow.Having selected the folders to restore, will the complete VM data/disk data be rehydrated from archive to tier or just the selected data?    

4044
Nikos.Kyrm
Byte
Michal128
Byte
Michal128Byte
asked in Storage and Deduplication
Immutable storage for Commvault in Azure with on-permises Media Agent.

Hello,Today we would like to check the working solution for immutable storage in Azure. And I am really wondering how to configure that type of access: If the access node is local server and resource is not appeared in Azure. Regards, Michal 

7284
Michal128
Byte
R
Byte
RitwickByte
asked in Storage and Deduplication
/ws/ddb and /opt/commvault/MediaAgent64/IndexCache are not mounted anymore after the faulty SSD replacement

/ws/ddb and /opt/commvault/MediaAgent64/IndexCache are not mounted anymore after the faulty SSD replacementSSD has been replacedNode has been rebooted oncethe entry is in the /etc/fstab

722
R
Byte
S
Byte
Srikanth KByte
asked in Storage and Deduplication
AUX copy jobs failing

Error Code: [13:138] Description: Error occurred while processing chunk [79458260] in media [V_4661435], at the time of error in library [DiskLib_ca-VMAPool-1] and mount path [[ca-vma1] \\xxxxip\cvlt_maglib_01], for storage policy [Plan-ca-vma-VM-90Local-365Cloud] copy [2-DASH-privateStore] MediaAgent [ca-vma1]: Backup Job [8531530]. Cannot impersonate user. User credentials provided for disk mount path access may be incorrect. Source: ca-vma1, Process: CVJobReplicatorODS  Failed to Copy or verify Chunk [79458260] in media [CV_MAGNETIC], Storage Policy [Plan-ca-vma-VM-90Local-365Cloud], Copy [Primary], Host [ca-vma1.green.xxx], Path [\\xxxxip\cvlt_maglib_01\CWKROQ_03.16.2023_08.40\CV_MAGNETIC\V_4661435], File Number [1], Backup Jobs [ 8531530]. Cannot impersonate user. User credentials provided for disk mount path access may be incorrect. Cannot impersonate user. User credentials provided for disk mount path access may be incorrect. Source: ca-vma1, Process: CVJobReplicatorODS    

2351
S
Byte
R
Bit
rutynaBit
asked in Storage and Deduplication
Problem with media agent

Hello Occured today on a strange error:HP Ultrium 7-SCSI_2 - A SCSI command to the drive is stuck on the active drive controlling MediaAgent.Id restarted tape libary but this problem is not resovled i assume i need to restart MediaAgent but dont know exacly how anyone can help?

6973
D
Byte
M
Byte
MOGFREYByte
asked in Storage and Deduplication
failed to read db error when adding nfs mountpath

Hi team  I am trying to add an network mount path to commvault storage library. I assign the mediaagent then choose network then pick the credential and input the path. When I click OK it takes a long time to load then gives the error: "Failed to read db". This is commvault version 11.24.94 recently upgraded from SP16. I tried looking at the logs but I can't se to find the relevant logs. Anyone with an idea?

642
M
Byte
A
Byte
Allan0105Byte
asked in Storage and Deduplication
Mount path is showing offline

Hi Team,we have a MA, which has four mount points all comes from backend SAN. out of four, one mount points are showing error while writing the data. i checked the disk management, disk was showing as read only than i have rebooted the MA and made the disk read/write. created test folder on the disk which working fine. but when i run the storage validation, it gives below error. did anyone had these kind of issue ? 7944  173c  09/09 10:20:44 685427 Scheduler  Set pending cause [Failed to mount the disk media in library [LIB05] with mount path [C:\CommVaulttLibrary\503] on MediaAgent [cv5]. Operating System could not find the path specified. Please ensure that the path is correct and accessible.

60809
H
Bit
N
Bit
Nedal1993Bit
asked in Storage and Deduplication
DDB with secondary copy

Hi Commvault Team how DDB works with the secondary copy (New Copy) to another disk library? assuming that we have two sites, each one has its own MA, DDB, Disk pool. and DASH copy is enabled.​​​​​​

3185
Scott Moseman
Vaulter
B
brucquat
asked in Storage and Deduplication
DDB Verification Operation failed

Hi,We have the following environment:Commserve 11.28 on W2K22 3 Physical Media Agents (MA) on W2K22 Each physical MA has its own DDB partition disk (D:\) and its own Disk library volume (G:\) → there is no sharing of the disks between the physical MA The DDB has 3 partitions: one on each physical MA One disk library with 3 mounth paths (one per MA) but each MA has its own disk library volume not sharedBackups are going well but we have issues with “DDB Verification” operation.The error messages are the following:“Error Code: [62:2687] Description: Export / Mount failed for mount path [G:/dl_ssd_aalst/CV_MAGNETIC], please check if the mount path is accessible on Data Server [appwbck003]. Check the logs for detailed error. Source: appwbck002, Process: ScalableDDBVerf  Library [dl_ssd_aalst], MediaAgent [appwbck002], Drive Pool [], MountPath[\dl_ssd_aalst]: Mount failed for mount path, please check if the mount path is accessible on Data Server. Check the Media Agent logs for detailed err

12995
Jos Meijer
Commvault Certified Expert
0
Byte
0ber0nByte
asked in Storage and Deduplication
DDB Verification for Private Cloud Library

Hi Team,We created Private Cloud Library using Dell EMC ECS S3 protocol. However, today I noticed that the DDB Engines of the related libraries are unchecked in the DDB Verification schedule created automatically by the system.Is this the default behavior?Is it not recommended for DDB Verification Cloud Libraries ?Is DDB Verification recommended even if our private cloud data is still in our own DataCenter? Best Regards.

912
0
Byte
B
Byte
benjaminasByte
asked in Storage and Deduplication
Full backup or synthetic for streaming on agent-based backups?

Hi guys, What is better: Full backup or synthetic full for streaming on agent-based backups for file systems? I get the point of synthetic full being better in terms that we are not using client machine’s resources, but are there any disadvantages of it?Would the normal full be saver..? If so - why?

2238
Zubair Ahmed Sharief
Vaulter
E
Byte
eduardo.jimenezByte
asked in Storage and Deduplication
Doubt about MA architecture

I will soon have to implement Commvault on a site consisting of the following elements:- 2 MediaAgent- A NetApp storage array presenting file per block via iSCSIThe idea is that the MAs work on the same storage and that when one goes down the other continues to provide availability to the infrastructure for both backup and restore operations and reading a lot I think that the best for my case would be to implement GridStor: https://documentation.commvault.com/2022e/expert/10842_gridstor_alternate_data_paths.htmlFor my knowledge and experience, reading it makes me a somewhat complicated configuration and I don't know if it fits the needs I am looking for.This is the procedure that is the most difficult for me because I do not understand very well why: https://documentation.commvault.com/2022e/expert/9788_san_attached_libraries_configuration.htmlI thought that presenting the LUN to the MA and formatting it and sharing the data path with the other MA would be enough but I see that it is n

3196
E
Byte
B
brucquat
asked in Storage and Deduplication
Deduplication block level factor

Hello,In  the documentation Deduplication Building Block Guide (commvault.com), it is mentioned that:“The DDBs created for Windows Media Agent should be formatted at 32 KB block size to reduce the impact of NTFS fragmentation over a time period.”Is the format at 32 KB referring to the block size of the disk itself (NTFS block size) or referring to the “Block Level Deduplication Factor” parameter of the Storage Policy as shown below ?Thanks  

9073
N
Vaulter
B
Bit
Bri-mhemailBit
asked in Storage and Deduplication
DDB Sealed after corruption and data is not deleting from disk

We had an FM200 release in our data center.  DDBs became corrupt and restore failed.  Sealed and started new DDB to get backups running.  Now all jobs have aged out of the sealed DDB, but I still have 387TB of data on disk and I need the space back ASAP.  SIDBPHysicalDeletes not showing continuous activity.  Data aging ran multiple times.

1283
N
Vaulter
S
Bit
Storage Limit Over-NotifyBit
asked in Storage and Deduplication
DD backup

clarify DD backup in server. We need to finalized data quota limit.

762
N
Vaulter
description of image

Badge winners

Show all badges
Terms & ConditionsCookie settings