commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication with fellow community members

  • 647 Topics
  • 3,299 Replies

647 Topics

B
Byte
benjaminasByte
asked in Storage and Deduplication

Full backup or synthetic for streaming on agent-based backups?

Hi guys, What is better: Full backup or synthetic full for streaming on agent-based backups for file systems? I get the point of synthetic full being better in terms that we are not using client machine’s resources, but are there any disadvantages of it?Would the normal full be saver..? If so - why?

6
Zubair Ahmed Sharief
Vaulter
3 months ago
G
Byte
GavaskarByte
asked in Storage and Deduplication

Aux copy finished with completer error

 We do see aux copy completed with error because of skipped jobs But we dont see the job id gui  not even in the logs. is there any way to see the job when it say job is skipped ?    

6
Mike Struening RETIRED
Vaulter
6 months ago
E
Byte
Eduardo BragaByte
asked in Storage and Deduplication

DDB Verification and Aux Copy Jobs impact on DDB disk

Could the DDB Verification and the Auxiliary Copy jobs impact on DDB disk in terms of Query & Insert time (the calculation)? We have some Database's Average Q&I Times across Partitions in the last 3 and 14 days with very high values. Backups jobs are running fine. No Performance degradation during backups with a good Deduplication ratio. There are no significant events. Most of the time we’re doing Database Log backups (So, no dedup here) and running Admin Jobs to copy data onto tapes or to create secondary copies. At night, we're doing incremental backups (VMware and FS agents). We have an issue with Synthetic Full backups (https://community.commvault.com/commvault-q-a-2/synthetic-full-is-not-running-based-on-automatic-schedule-settings-2744) and I'm wondering about how this issue also can impact on those times. Some info:VMware VM Media Agents are running updated Linux. 8 CPU cores, 32 GB RAM. DDB Flash disk. Kernel Parameter Configuration done. DDB Verification: Incremental

6
christopherlecky
Byte
10 months ago
C
Commvault Engineer
asked in Storage and Deduplication

S3-compatible Object Storage configuration

Hi Community, Recently we acquired an Object storage library, which is compatible with CV (Oceanstore 100D), I was wondering how should it be configured.Should it be configured as a cloud library ? How can it be mapped to our MA ?Sorry if these questions may sound a bit silly, am a nooby regarding object storage, am only used to the classic NAS/SAN storage. Any step by step recommendations would be much appreciated to get a better understanding. Best regards.

6
C
10 months ago
C
Byte
chris_ahnByte
asked in Storage and Deduplication

Aux copy Oralce Not selected

Hi, I have a question.Current state I tried Aux copy “ use most recent Full backup For Aux copy”I don't know why DB can't be automatically selected.Only DB (not file) What sholud i do?

6
Mike Struening RETIRED
Vaulter
1 year ago
E
Byte
Eduardo BragaByte
asked in Storage and Deduplication

Total Blocks to Process during Data Verification

How can I confirm how many blocks a DDB data verification job processed after it is finished?We have a scheduled policy to check data consistency with the following options. It seems to me that the job is processing all single blocks.    

6
Mike Struening RETIRED
Vaulter
6 months ago
E
Byte
eduardo.jimenezByte
asked in Storage and Deduplication

Doubt about MA architecture

I will soon have to implement Commvault on a site consisting of the following elements:- 2 MediaAgent- A NetApp storage array presenting file per block via iSCSIThe idea is that the MAs work on the same storage and that when one goes down the other continues to provide availability to the infrastructure for both backup and restore operations and reading a lot I think that the best for my case would be to implement GridStor: https://documentation.commvault.com/2022e/expert/10842_gridstor_alternate_data_paths.htmlFor my knowledge and experience, reading it makes me a somewhat complicated configuration and I don't know if it fits the needs I am looking for.This is the procedure that is the most difficult for me because I do not understand very well why: https://documentation.commvault.com/2022e/expert/9788_san_attached_libraries_configuration.htmlI thought that presenting the LUN to the MA and formatting it and sharing the data path with the other MA would be enough but I see that it is n

6
E
Byte
3 days ago
M
Byte
MountainGoatByte
asked in Storage and Deduplication

MA Decommission hosting GDSP - Is there a way to migrate but keep the Storage Policies in tact?

Hi Commvault People, I have a tidying up exercise to do, which will ultimately involve this:- 1 - Decommission two MA’s currently working as partitioned dedupe  (lets call, them MA3 and MA4)2 - Migrate workloads to remaining MA’s, also with their own partitioned GDSP configs.     Lets call them MA1 and MA2.3 - Noting that Storage Policies on MA1\MA2 versus MA3\MA4 have very different retention. I know that generally speaking, you can easily reassociate to another SP and away you go, but that’s only useful if you have matching retention.The issue I have is that my MA3 and MA4 Storage Policies (whose ma’s I want to retire) are set to Infinite retention.  The Storage Policies on the remaining ma’s (MA1\MA2 are not). So If I want to migrate the workloads away from MA3 and MA4, is it possible to somehow keep the Storage Policies in tact that were previously associated with MA3 and MA4. I would prefer to keep them in tact to avoid yet more legacy and historical SP’s clogging up the environme

6
V
Vaulter
1 year ago
A
Adel BOUKHATEM
asked in Storage and Deduplication

Enable worm on Cloud storage library

Hi Guys,We have a Huawei Object Storage and would like to enable WORM on it.We found out that there is a Workflow to achieve that:https://documentation.commvault.com/11.26/expert/9251_configuring_worm_storage_mode_on_cloud_storage.htmlHowever, the link is a bit confusing: It says that the Workflow is compatible with cloud storage vendors that support the WORM and at the same moment it gives a list of vendors.My question is: Can I use the Workflow with my Huawei Cloud Storage (WORM Compatible)? Also, the link says : “If you have multiple storage policies/copies created using the cloud storage pool, make sure to set the same number of days as retention in all the copies.”Does it mean that the Cloud library will host only copies with the same Retention when WORM enabled? Thanks in advance for your usual help. Best Regards  

6
A
7 months ago
P
Bit
pirxBit
asked in Storage and Deduplication

HSX: failed disk was not correctly replaced

We seem to run into multiple problems in our new HSX environment. Metadata disk d2 silently filled 100% on one of three nodes, data disks are all 90-95%, but in GUI only 550 of 720TB are shown as used. Not a single alert for this, all green in GUI. An then there is disk d22 / sdv on one node that failed a few weeks ago and was replaced together with support. In GUI it’s shown as mounted but in reality its not. sdu                            65:64   0  16.4T  0 disk /hedvig/d21sdv                            65:80   0  16.4T  0 disksdw                            65:96   0  16.4T  0 disk /hedvig/d23 I followed Replacing Disks in an HyperScale X Reference Architecture Node (commvault.com) but the disk is not mounted. Nov 9 11:22:38 sdes1701-dp systemd: Dependency failed for /hedvig/d22. Nov 9 11:22:38 sdes1701-dp systemd: Job hedvig-d22.mount/start failed with result 'dependency'. Nov 9 11:22:38 sdes1701-dp systemd: Job dev-disk-by\x2duuid-dfcc3e6c\x2d8152\x2d42b2\x2db0a1\x2d6742d4748d3c.d

6
Mike Struening RETIRED
Vaulter
4 months ago
T
Byte
Tom EvansByte
asked in Storage and Deduplication

Network Bandwidth Throttling

Hi,Im having issues with throttling network utilisation for aux copies. I have about 10 Storage Policies all with Secondary copies.I’ve configured “Throttle Network Bandwidth (MB/HR)” to 25000 for the secondary copy for all storage policy. If my maths is correct that would be approx 50Mbps per aux copy. Even with all 10 running at the same times utilisation shouild only be approx 500Mbps.However through network montioring i can see when these aux copies are running they are using well over the 50Mbps configured (and saturating the network).Is my maths wrong is or the throttling configuration not  working how i expect it to work?Thanks in advance for any responses.

6
Mike Struening RETIRED
Vaulter
10 months ago
P
Byte
Pascal ZachByte
asked in Storage and Deduplication

3DFS Share for a NDMP Intellisnap Backup Copy

I have some "NAS/network shares" with different backup types (network share CIFS/NFS or NDMP).The backup copies for shares using FileSystem Agent via "Network Share" can use 3DFS and those using NDMP once cannot use 3DFS. Unfortunately, I have a requirement/need to be able to use 3DFS. How can I share backups of NDMP NAS shares via 3DFS? Am I missing something, is there a setting or do I have to live with it?

6
P
Byte
9 months ago
A
Adel BOUKHATEM
asked in Storage and Deduplication

Backup job for empty DDB completed immediately as none of the stores are eligible for backup

Hi Guys, Hope you’re doing well !We have some DDB backup jobs that completes with errors.The job lasts 1 seconds only. In the events, it shows the below message:“job completed immediately as none of the stores are eligible for backup” Do you have any idea on what could be the reason?Thanks a lot for your usual help. Best Regards

6
A
8 months ago
Melissa Adams
Commvault Certified Expert
Melissa AdamsCommvault Certified Expert
asked in Storage and Deduplication

AWS Object Lock issue

Hey all -I have created a bucket with OL enabled, created a new library, storage pool, secondary policies and ran the Enable WORM Storage workflow.  Everything went great but now as I’m starting my Aux Copy, I’m getting this error:12504 1938  05/12 12:07:09 4148  [DEVICE_IO] CVRFAMZS3::SendRequest() - Error:  Message: Content-MD5 OR x-amz-checksum- HTTP header is required for Put Object requests with Object Lock parameters12504 1938  05/12 12:07:09 4148  [DEVICE_IO]  Message: Content-MD5 OR x-amz-checksum- HTTP header is required for Put Object requests with Object Lock parametersI’m not sure how to fix this issue.  Anyone have ideas?

6
M
Vaulter
10 months ago
ZachHeise
Byte
ZachHeiseByte
asked in Storage and Deduplication

Unable to change value of "sparse support" checkbox in Disk Library

Hello,We just added more storage to a mediaagent, via a new mount path in an existing disk library. The new mount path is an SMB share from a Dell Isilon, and the admin of the isilon confirmed they had enabled sparse support for the share - but he turned it on, after I’d already added the mount path.As this user in the Commvault forums described, I should just be able to check/uncheck the checkbox for ‘sparse support’ right? It is not working for me though. What is the trick to changing the status of this checkbox? Are there other ways via the Web Command Center, or CLI, to do the same thing?I also don’t see any means in the ‘properties’ of this mount path to enable this.  

6
Jos Meijer
Commvault Certified Expert
8 months ago
M
Byte
MaxJamakovicByte
asked in Storage and Deduplication

DDB Disk Library Migration

Our new SAN for CommVault Disk library is Dell PowerScale H7000 OneFS, the library in production is NetApp 2750. We use Windows 2019 MA and ISCSI LUNS on NetApp. Since PowerScale H7000 doesn't support iSCSI LUNS  and Sealing DDB or Creating new Disk Library > Global DDB > New Primary is not the preferred path.  Is it possible to create new path on current disk library the path on SMB share on DELL OneFS and disable the writes on all local ISCSI path’s with option checked  “Prevent data block references for new backup” we could do this to all local disk at once or gradually. Our retention is 90 days on this SP. So could I delete those paths after jobs age out and continue using path on SMB share.  

6
M
Byte
4 months ago
M
Bit
Michal DolezalBit
asked in Storage and Deduplication

Could not connect to the DeDuplication Database process for Store Id

Hi, I am facing error regarding connection to DeDuplication Database. It can be caused by many reason but my specific problem is that the directory with DDB is locked for write. This was confirmed by SIDBEngine.log and simply you cannot create folder in DDB folder.Status of DDB is ONLINE. I can freely read from it, I can freely travers through it, I can copy the folder to different place and here I can create files/folders inside without limit. There is no way to manage from CMV - it is not possible to backup, restore, seal, verify etc. I cannot move the partition. It seems as Windows/Hardware problem but….I checked windows logs - no events from disk, scsi etc.I checked filesystem - all looks fineI checked hardware events (it is HPE server, so iLO log, IML log, I checked smart array status)It seems that it is limited only to this DDB folder. On the same drive, same volume, different directory all working as usual. So there is no write protection on drive or volume level (checked by dis

6
L
Byte
11 months ago
M
Byte
MountainGoatByte
asked in Storage and Deduplication

DDB V5 Conversion - how was it for you?

Hi Team, We are about to embark on the V4 to V5 DDB conversion process, but I thought I would ask here and see how it went for those that have completed this. We have a few partitioned DDB’s with a reasonable amount of size, and I am trying to gauge how long our backup-outage might be, as we have to guesstimate on behalf of our customer. I can see that the pre-upgrade report does give estimates, so I’m wondering how ball-park they might be. One more thing … is there a way if identifying what version of DDB we have> Thanks

6
Surendra Nadh Arla
Vaulter
1 month ago
F
Federico
asked in Storage and Deduplication

Difference between Assigned media (active) and Appendable Media

Hellowhat is the main difference between the two tapes media status? if both are in the library?RegardsFederico

6
S
Vaulter
25 days ago
Pasqual Döhring
Byte
Pasqual DöhringByte
posted in Storage and Deduplication

Understanding DDB Statistics

Hello there. In the last couple of months I was asked by a few customers where all the data growth on their disk libraries came from. And by digging deeper into that topic I tried to understand the data and statistics from the DDBs. I had to realize that some of those statistics seem to be very odd and that I don’t understand them. So maybe someone can enlighten me. Let’s take a look at a screenshot from statistics of a “normal” DDB: So what do we got here:Deduplication Engine Name: self-explanatoryCreation Time: self-explanatoryVersion: I just take this as it is but is there anything out there but Version 11? Does it refer to Commvault 11? I thought a recent DDB should be Version 5 (or 4.2 if you prefer) and a somewhat older DDB should be version 4. So what does “11” mean”?Total Application Size: AFAIK this is the total data that got backed up into this DDB. All fulls, incrementals and so on before compression and dedupe.Total Data Size on Disk: Seems to be self-explanatoryDeduplicati

6
Pasqual Döhring
Byte
10 months ago
B
Byte
Backup files corruptionByte
asked in Storage and Deduplication

Possibly corrupted files

Hello,I have found ntfs disk errors ot commvault disk library.The library was offline. I have performed check disk on the volume and errors have been fixed.How to check health and data integrity  of the backup files and directoriesThank you!

6
B
Byte
9 months ago
K
Bit
Kegan LevettBit
asked in Storage and Deduplication

Drive stuck at the "Media is being Unmounted" status

Hello,I have a tape that appears to be stuck in one of the library drives. The tape itself  reports that it is stuck in the drive. I have tried the Clean / Reload / Unload Drive options to do effect. I also restarted the Quantum tape library to see if that helps, again no luck.     Cheers  

6
K
Bit
10 months ago
T
Byte
tigger2Byte
asked in Storage and Deduplication

Aux copy properties showing Media Not copied "Stream No./Sequence" column containing "stream" 0/1?

I have some Aux copies that have this, for example:The Aux copy is configured to use 8 streams via “Combine source data streams = 8”.  Multiplexing is not enabled.  When it runs (in properties → Streams tab)  it has 8 “Destination Streams” running (“Number of readers in use = 8 ). BUT when I look at properties → “Media not Copied” tab, it shows 9 streams in the "Stream No./Sequence" column, where it is:what's “0/1” → Stream Number 0? but if so then there’s 9 streams to copy?  I wanted to make sure something was not misconfigured somewhere and Stream No 0 wasn’t some default to handle an oddity/overflow of data or something strange.  I was under the impression the streams were to be combined to 8 (all data broken up into 8 chunks to be streamed/read/copied) … yet the UI is telling me I have 8 streams “to copy” and another one named 0, though it actually only runs 8 streams/readers. For reference, here's the active streams of the same job showing 8 readers/streams 

6
Mike Struening RETIRED
Vaulter
9 months ago
E
Eyal
asked in Storage and Deduplication

Auxiliary copy jobs slow performance

Hi  All,After installing a new library (NAS with CIFS share) with new storage policy (no compression , no encryption) –Backup jobs are running fine, but aux copy jobs (replication to the DR site) are much slower than before , about x10 times slower.We checked the network performance between MA and repository and between MA production and MA DR site – all working well.What can be the problem? Is there any fine tuning for the aux copy wo work faster?Thanks.

6
L
Byte
9 months ago
E
Bit
ErezBit
asked in Storage and Deduplication

export media based on job available

Hey,There is a way to export media to the mail slot after the aux copy is done? so there is no more “copy to” or  “partially copy” only “available” 

6
E
Bit
4 months ago

Badge winners

  • Topic Starter 1
    Ameya Bapathas earned the badge Topic Starter 1
  • Topic Starter 1
    Upadhyahas earned the badge Topic Starter 1
  • Topic Starter 1
    UP_E13has earned the badge Topic Starter 1
  • Topic Starter 1
    andylaihas earned the badge Topic Starter 1
  • Topic Starter 10
    PedroRochahas earned the badge Topic Starter 10
Show all badges
Terms & ConditionsCookie settings