Skip to main content

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 999 Topics
  • 4,414 Replies
999 Topics
Mohit Chordia
Byte
Mohit ChordiaByte
asked in Storage and Deduplication
Large S3 Bucket Backup

Hi Community ,Can we take a backup of S3 bucket which is 80 TB in size using Commvault ?Consider 10-15% daily change of data. How does Commvault takes backup of S3 . IIs it streaming backup , reading objects 1 by 1 which i expect would be very slow or some sort of Intellisnap capability is available for S3 backup ?Regards, Mohit

7
Onno van den Berg
Commvault Certified Expert
2 years ago
A
Bit
AbdulWajidBit
asked in Storage and Deduplication
Best practices to ensure maximum streams for Aux to MCSS

Hello Community We are doing a pilot by pushing around 50t of data over to MCSS. We have noticed that when the jobs are progressing, there are multiple streams of different sizes at the beginning of the job and as the job progresses the number of streams go down. Is there a way to ensure that the data that is being pushed to MCSS is distributed among multiple stream equally so that we get consistent performance out of the job till the end?  

2
Scott Moseman
Vaulter
2 years ago
LukeBrett
Byte
LukeBrettByte
asked in Storage and Deduplication
Error Code: [19:861] Could not connect to the DeDuplication Database process

Hi,We’ve been having this Error (Error Code: [19:861] Could not connect to the DeDuplication Database process for Store Id [xxx], Process:clBackupChild, JobManager or clBackup) on multiple clients recently (agents seem random : Linux FS, Windows FS, Oracle RAC… v. 11.24.34). Our network team did not change any FW rules.The only temporary solution we found for backups to complete is disabling Client Side Dedup on all clients having the error, but we would prefer not having our MAs do the dedup.If anyone had a similar problem, any suggestion and ideas would be appreciated!Regards

3
Mike Struening
Vaulter
2 years ago
D
Byte
drPhilByte
asked in Storage and Deduplication
Description: Error occurred while processing chunk - error Code: [13:138]

Hi all!could you advice me how to troubleshoot following types of error: Error Code: [13:138] Description: Error occurred while processing chunk [xxx] in media [xxx], at the time of error in library [disklib01] and mount path [[xxx] /srv/commvault/disklib01/xxx], for storage policy [XXX] copy [Xxx] MediaAgent [svma1]: Backup Job [xxx]. Unable to setup the copy pipeline. Please check connectivity between Source MA [svma1] and Destination MA [svma1].  At a glance, it seems that it is not possible for CV to process chunk from the (index?)/disk library...However, the issue is connected with storage policy copy, that moves data from the disk library to the tape library (secondary copy). The main problem for us is that it is not possible to copy data to the tapes. Therefore, it may say Unable to setup the copy pipeline. The media agent is one server/device, that communicates with both disk and tape library. Lastly, the files in the related directories dont seem to be corrupted...Any suggesti

23
K
2 months ago
M
Byte
MountainGoatByte
asked in Storage and Deduplication
DDB V5 Conversion - how was it for you?

Hi Team, We are about to embark on the V4 to V5 DDB conversion process, but I thought I would ask here and see how it went for those that have completed this. We have a few partitioned DDB’s with a reasonable amount of size, and I am trying to gauge how long our backup-outage might be, as we have to guesstimate on behalf of our customer. I can see that the pre-upgrade report does give estimates, so I’m wondering how ball-park they might be. One more thing … is there a way if identifying what version of DDB we have> Thanks

6
Surendra Nadh Arla
Vaulter
1 year ago
A
Adel BOUKHATEM
asked in Storage and Deduplication
Catalog jobs from a cloud storage object

Hi Guys,Is there a way to catalog jobs from a bucket within a cloud storage library, like below:The tool offers only a Tape or a Disk as a Media. How do we retrieve our DR backups from a Cloud storage in case we lose everything in order to perform a Disaster Recovery.I found the link below, however it doesn’t show how to retrieve the DR DB.https://documentation.commvault.com/11.24/expert/43588_retrieving_disaster_recovery_dr_backups_from_cloud_storage_using_cloud_test_tool.htmlI’ve also found the below note:Does this mean that if deduplication is enabled, there is no way to retrieve the DR DB?Thanks a lot. Best Regards

7
Mike Struening
Vaulter
2 years ago
E
Byte
Eduardo BragaByte
asked in Storage and Deduplication
Drive reported that media is physically bad

What happens to backup contents from media that an LTO drive reported that It is physically bad? Does the Commvault copy those not-aged jobs from source copy to other media (tape) again or It just prevent reuse the media and retire it after expiring jobs?     

1
Jos Meijer
Commvault Certified Expert
2 years ago
R
Byte
RandomCustomerByte
asked in Storage and Deduplication
Please confirm that the 11.28 version contains all of the fixes found in 11.26.

Below is the analysis from commvault: - StoreOnce Aux copy failing due to "Unexpected copy parameters. SFileNum [1] != [1] || CcId [2] != [2] || Offset [0] + [71680] != [73728]."- FR25 MR23 contains the fix for the issue you are seeing.https://documentation.commvault.com/11.25/assets/service_pack/updates/11_25_23.htm3395 -- AuxCopy jobs from HPE StoreOnce catalyst libraries as source and destination may fail with Error "Unexpected copy parameters. SFileNum [1] != [1] || CcId [2] != [2] || Offset [610712232] + [378000] != [611279232].- Customer to install MR23 on source MA.So we decided to upgrade to 11.26 as it is the latest and has all fixes as 11.25.32. But can we wait for 11.28 and upgrade to 11.28. Will it have same bug fixes as that of 11.26. 

2
Damian Andre
Vaulter
2 years ago
ZachHeise
Byte
ZachHeiseByte
asked in Storage and Deduplication
Unable to change value of "sparse support" checkbox in Disk Library

Hello,We just added more storage to a mediaagent, via a new mount path in an existing disk library. The new mount path is an SMB share from a Dell Isilon, and the admin of the isilon confirmed they had enabled sparse support for the share - but he turned it on, after I’d already added the mount path.As this user in the Commvault forums described, I should just be able to check/uncheck the checkbox for ‘sparse support’ right? It is not working for me though. What is the trick to changing the status of this checkbox? Are there other ways via the Web Command Center, or CLI, to do the same thing?I also don’t see any means in the ‘properties’ of this mount path to enable this.  

6
Jos Meijer
Commvault Certified Expert
2 years ago
A
Adel BOUKHATEM
asked in Storage and Deduplication
Backup job for empty DDB completed immediately as none of the stores are eligible for backup

Hi Guys, Hope you’re doing well !We have some DDB backup jobs that completes with errors.The job lasts 1 seconds only. In the events, it shows the below message:“job completed immediately as none of the stores are eligible for backup” Do you have any idea on what could be the reason?Thanks a lot for your usual help. Best Regards

6
A
2 years ago
E
Byte
Eduardo BragaByte
asked in Storage and Deduplication
Full backup of associated subclients manually immediately after sealing

On Sealing the Deduplication Database page there is a note. Can I perform Synthetic Full Backups of associated subclients manually instead of traditional Full Backups? 

1
Mike Struening
Vaulter
2 years ago
E
Byte
Eduardo BragaByte
asked in Storage and Deduplication
Move sealed DDB

Can I move a partition from a SEALED DDB to the same partition path where the active DDB is located? I just sealed the database before move the partition.   

1
Mike Struening
Vaulter
2 years ago
T
Byte
tsmtmillerByte
asked in Storage and Deduplication
Removing Data from Tapes

Hello, if you have backup jobs on tape and want to delete the contents and reuse the tape, can you just right click the tape and delete contents? I do not know if you right click delete contents will cause any issues in CV with the jobs associated to the tape contents.  

1
Mike Struening
Vaulter
2 years ago
N
Byte
NikkyArtByte
asked in Storage and Deduplication
Delete DDB

Hello!How I can just delete DDB when server with this DDB no longer exists? and these DDB are no longer needed. Why do simple actions in Commvault cause “pain”?

3
Mike Struening
Vaulter
2 years ago
J
Bit
JanErikBit
asked in Storage and Deduplication
The media side mounted is write-protected

HiI'm not an expert user.After the automatic upgrade job to version 11.28.8, the backup jobs failes with the following error:Error Code: [62:308] Description: The media side mounted is write-protected. Source: backupserver, Process: cvdStatus: Mount ErrorLibrary Name: AutoDiskLibDrivepool: DrivePool(backupserver)1Drive: Folder_03.28.2019_11.26Media label: CV_MAGNETICFailure Reason: The media side mounted is write-protected.Under the library all mount paths have Read/Write AccessProperties for the mount path under Allocation policies are marked Maximum Allowed Writers.Tried manually upgrade to version 10.28.10, but nothing changed.This is a disk library, not tape. The library is about 89% full, but still have about 7,5 TB free space on the given mount path. How to enable read write? 

6
Lukas3D
Byte
1 year ago
G
Bit
Glenn NgobeniBit
asked in Storage and Deduplication
The job has failed because the VSS snapshot could not be created.

Good day,Please Advise.Error Code: [7:314] The job has failed because the VSS snapshot could not be created.I have checked vssadmin list writers: No errors found.  State: [1] Stable  Last error: No errorDDB Backup Disk free space is 260 GBProcess Manager service: VSS Provider Service is running.Warm regardsGlenn Ngobeni

2
G
Bit
2 years ago
G
Byte
GavaskarByte
asked in Storage and Deduplication
Aux copy finished with completer error

 We do see aux copy completed with error because of skipped jobs But we dont see the job id gui  not even in the logs. is there any way to see the job when it say job is skipped ?    

6
Mike Struening
Vaulter
2 years ago
M
Byte
Mateusz SlezakByte
asked in Storage and Deduplication
Restores from Azure Cloud Storage

Hello,Our client ask me how restores from Azure cloud storage works when data is located on cool tier and on archive tier on Azure.We have tested the archive tier first. We copied the data to the cloud archive storage, and performed an restore for a database. We selected only one (of many) database which should have size lower then 10GB, but the full job backup size is 8,5TB (Size of application) - Recall archive workflow is working for 3days and completed only 30% - is it recalling all 8,5TB of data from archive storage?And how it would work if we use a cool tier cloud storage - when data is phisically available (online). If we copy a job which have 8TB and we will perform an restore only for one database (~10GB) from this huge backup - will it download all 8TB of data or will only choose this chunks which actually contains the data of this small 10GB database?Thanks in advance for help :)Have a nice day !Regards,Mateusz

4
M
Byte
2 years ago
P
Vaulter
PremVaulter
asked in Storage and Deduplication
New DDB stores gets Auto-created.. Horizontal scaling enabled..

The other day I noticed a Critical item in health dashboard under DDB backup section stating one of the store isn't protected.. Noticed the DDB store itself got auto created a day back keeping the old one active..  I noticed this across various environments where we have multiple DDB store with different ID gets created and all of them are actively used.. Couldn't find any documentation that explains it.. It would be helpful if someone throws some light here.. Thanks.. Below is the one i was referring to where DDB store 72 got auto created and if you notice for FS and DB agent store we have multiple ID’ present... 

12
B
Vaulter
1 year ago
J
Byte
JohanaByte
asked in Storage and Deduplication
CV_MAGNETIC Folder with Files of 2018

Hi, We have holds configured in the storage policies to reflect backups to be retained for about 7 days, 1 cycle. Now, when I browse the CV_Magnetic folder, I still see V_## folders from years and months ago in them? shouldn't they be automatically deleted after the 7day retention period or am I just missing a configuration setting somewhere?Can old folders be deleted? Regards,Johana

1
L
Vaulter
2 years ago
Torsten
Torsten
asked in Storage and Deduplication
How to Reduce Random Read Load on NL-SAS Storage Arrays?

Hello,We are seeing a very large random read load on our Hitachi G350 backup storages with NL-SAS disks. These random reads are completely consuming our backup storage performance. We have two G350s on campus and a third at a remote site. Commvault runs copy jobs between these three G350s.DDB is on NVMe locally in the Media Agent, also the Index Cache Disk.We ran several analyses and Live Optics showed us that the daily change rate is 334.9%, which is mainly due to the Windows File System policy, for which we see 2485.1% daily change rate.Does anyone know how the random read load could be reduced since our disk backup is otherwise unusable. What steps could we take to optimize the Commvault configuration?Screenshot: Thanks for your help! 

8
C
Vaulter
1 year ago
C
Bit
CVmjrBit
asked in Storage and Deduplication
Using multiple drives for an aux copy job

Hi all,we would like to enable parallel copying, so that one aux copy job writes to multiple tapes at the same time to speed up the copy but also restore process.I have already increased the device stream in the copy to 2, but it continues to copy with only one drive.  Are there any other settings to be made for this?Thanks in advance

2
C
Bit
2 years ago
F
Byte
FergusByte
asked in Storage and Deduplication
Problem creating new storage copy - Internal Error. Incorrect parameter passed to the SIDB engine

Hello,I’ve set up a new media agent, v 11 SP24.34 and installed the CV MA software. I’ve created my Maglib also. I’ve created a storage policy and my primary copy. What i want to do now is to create a secondary copy. I’ve done that but when i click ok i get an error : “Internal Error. Incorrect parameter passed to the SIDB engine”. When i click ok to that error, i get another error : “Invalid library []”. My secondary copy does not get created. Has anyone experienced this before?RegardsFergus

1
Mike Struening
Vaulter
2 years ago
C
Byte
chris_ahnByte
asked in Storage and Deduplication
Media Reset

I want to release it [recalled for restore] what should i do?  

1
O
Vaulter
2 years ago
Melissa Adams
Commvault Certified Expert
Melissa AdamsCommvault Certified Expert
asked in Storage and Deduplication
Conversion to DDBv5

Hey all -Should we be recommending that our customers run this workflow?  I do see that upgrade is listed in the DDB health page, but not sure if this is required or what the best practice is???ThanksMelissa

10
J
1 year ago

Badge winners

Show all badges
Terms & ConditionsCookie settings