Skip to main content

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 1,011 Topics
  • 4,454 Replies
1011 Topics
C
Byte
Carlos GonzalezByte
asked in Storage and Deduplication
MSSQL not deduplicating with Commvautl unless using VSS.

Hi,I am running Commvault with MSSQL, but these backups do not deduplicate; the only savings we get are from compression. None of our MSSQL backups deduplicate at all (+200 DB Clients), we made sure we did not have anything affecting deduplication, like db side encryption etc.If you run a Commvault backup, and then run another one after the previous has finished on a system with no activity, we would expect 99% dedup savings, but instead of that we have between 50% to 70% cause it is only compressing and the new compressed data has new signatures every time. Our workaround is to use VSS, that works as a file backup, The MSSQL backup with VSS enabled deduplicate with almost 99.9% savings doing the same test. VSS also comes with its own problems like slow backup performance and MSSQL with VSS is not considered best practice for Commvault.We have over 200 Commvalt clients with MSSQL, and this happens to all of them, we have all with VSS enabledI opened a ticket in November 2022 and it was

1
A
Vaulter
4 hours ago
J
Byte
Joan MasByte
asked in Storage and Deduplication
Secondary Copy Cloud to Secondary Copy Cloud

HiI would like to execute a secondary copy from a S3 bucket to another secondary copy S3 bucket. I created and configured buckets and its working. But the issue is the mediaagent is in our local infraestructure and data travels a lot instead of going to bucket to bucket directly is any way to configure this ease or i need to put a MA in our AWS infraestructure instead of locally? Thanks!!Joan Mas

2
J
Byte
1 day ago
M
Byte
Marcel GeisenByte
asked in Storage and Deduplication
Set preferred Media Agent for Agent Backup

Hello,we have scenario that we have two Media Agent in an OnPrem Location for customer.ma01 is used for infrastructure Backup mainly VSA Backup etc.(direct connection to CS)ma02 shoud be used for Agent Backup (SQL ;SAP etc..) in Customer Network (direct connection to Clients / Connection to CS via Topology)ma01 with VSA Backup is working fine.ma02 if we select manually for Agent Backup also works fine, but for scheduled Jobs always ma01 is selected and not ma02.So we found following Additional setting:https://documentation.commvault.com/additionalsetting/details?name=PreferredMediaAgentGroup“ PreferredMediaAgentGroup“We activate this Additional Setting on both groups for MA and Agents with same value “ma02” but it does not work still ma01 is picked. Question: Has anybody used this setting or can explain what we do wrong the explanation in documentation is not that clear: https://documentation.commvault.com/2022e/expert/setting_up_client_and_mediaagent_pairing_for_data_protection_operat

2
M
Byte
1 day ago
D
Bit
davegrayBit
asked in Storage and Deduplication
Report of all SQL database restore points?

Hi, Was wondering if there’s a report I can use that will list server, database and all the restore points we have available. I know I can go into each database recovery in the portal and use the calendar but we have 5000+ databases so looking for the raw data if poss. Something like this would be great, if it exists.   Many thanks 

2
D
Bit
2 days ago
J
Byte
Jose Alberto Gonzalez LunaByte
asked in Storage and Deduplication
objects with error, remote I/O error

We are experiencing a behavior only in some full jobs of a particular schedule, this happens in protected objects, the error messages are Remote I/O error, what we have detected is that the next incremental backup takes the objects that marked error in the full backup, we have moved the schedule backups but the failure continues, the backups are directed to disk libraries, has anyone had this behavior that can help us solve it.

3
CV_GK
Vaulter
3 days ago
A
Bit
AlanKenoBit
asked in Storage and Deduplication
Data Aging Major Event Codes

Hello All,I’m a newbie, starting with CommVault and see these “Event Codes” on a Data Aging Job every day.Event ID 97531656 Event Code 13:6 (Exiting with errors - some files may not have been pruned) Event ID 9753162  Event Code 13:48 (Data is partially pruned due to database problem)As stated, I’m a newbie at this and don’t know if there is something I can do about this or should do about this.Any insight would be great.TIA, AlanKeno

2
A
Vaulter
3 days ago
J
Bit
jlintsi
asked in Storage and Deduplication
Clean orphan data when multiple pools use same S3 buckets?

Hi,Is it safe to run space reclamation with clean orphan data option checked when using cloud library and s3 buckets shared by multiple pools/DDB’s from different grids? Or will it clean the data from the other pools as there are no references to that data in the DDB being cleaned?Thanks

3
A
Vaulter
3 days ago
G
Bit
Gianluca RossiBit
asked in Storage and Deduplication
Extract the total number of files with retention greater than 6 monts

Hi all,we need to extract some useful information from our commserve: we would like to know the total number of files (or jobs if number of files is not available) that have a retention greater or equal to 6 months and are stored in our libraries.Is there an SQL query or a report that can give us this information ? I don’t want to perform several queries on all the different storage policies that we have, I just need the numbers (if available).Any suggestion is appreciated,RegardsGianluca

6
A
Vaulter
4 days ago
M
Byte
Marcos SilvaByte
asked in Storage and Deduplication
disk space on Deduplication DDB

We are experiencing issues with our HyperScale cluster. Backups seem to be working, but we are getting the following error message during backup:Description: [Media write operation failure] [Dedupe disk media] [The request could not be performed because of an I/O device error.]Source: SRV1092b, Process: cvdAt first it seems to be disk space in hyperscale, but I would like to know if there is any documentation talking about the limit space required to operate hyperscale.

1
A
Vaulter
7 days ago
B
Bit
bdnBit
asked in Storage and Deduplication
Units on report

Hello!What  is mean MB in Reports?1 MiB (Mebibytes) = 1,048,576 bytesor1 MB (Megabytes) = 1,000,000 bytes

1
S
Vaulter
9 days ago
Veerasak
Byte
VeerasakByte
asked in Storage and Deduplication
I have question encryption network and media

I have a question about encryption for networks and media. I'm not sure what type of encryption it is, such as AES or Blowfish. Could you provide an answer? 

1
Erase4ndReuseMedia
Byte
10 days ago
D
Dvir Berko
asked in Storage and Deduplication
Trying to download several files from the OneDrive backup and it doesn't download them.

Hello everyone, I would appreciate your help.I am trying to download several files from my OneDrive backups, I choose to download it in a different location and not in the original location.What happens is that an empty folder is downloaded.What could be the problem?

1
A
Vaulter
10 days ago
Gerard Murphy
Byte
Gerard MurphyByte
asked in Storage and Deduplication
Quick erase v Full erase

Hello,I am curious to know, if I manually erase a tape using Quick Erase, are there any tools that can recover the data? I know Media Explorer cannot.Context - I am contracting with a customer who has not erased tapes and there are years worth. Of the latest LTO8’s we have decided to recycle those that are expired. I am trying to help with a decision as to use Quick Erase or Full Erase in advance of recycling them.The documentation describing these options has the following under Full Erase:  “You want to delete sensitive data”.Does this mean that sensitive data, or any data, can be recovered by any means using Quick Erase?System in use is self hosted v11.32.59 across 15 sites each with a media agent and tape library.Thank you in advance for your help.RegardsGerry  

3
A
Vaulter
10 days ago
P
pma
asked in Storage and Deduplication
Delete duplicated library

Hi, came across on a issue with a cloud library. I had the need to reconfigure the cloud library and remove it and add it again with the same name. the issue is that from the DR backup option it shows two: from command line I can also tell that there are two   from the Storage Menu, I can see only oneis it secure to delete the one that ends with _1724845300? is there any way to tell the creation timestamp of both ? version is 11.34.36 regards

9
P
10 days ago
A
Bit
AbdulIkramBit
asked in Storage and Deduplication
CSDB restore from media explorer on HPE catalyst

CSDB restore from media explorer on HPE catalyst?We are using hpe catalyst library and DR storage policy is configured to write to HPE catalyst.If in case of disaster how do we recover most recent backup using media explorer.https://documentation.commvault.com/2023e/expert/retrieval_of_disaster_recovery_dr_backups_from_storage.htmlI dont see such option in BoL.Please advise. Even though command center shows the HPE storonce as cloud we cannot run cloudtesttest on this storage I believe,

2
A
Bit
12 days ago
J
Byte
JeremyByte
asked in Storage and Deduplication
Issue with creating a recovery point for Exchange database

Hi! We trying to create a Recovery Point to recover a specific e-mail but the job fails after a couple of seconds. We do see a “ Error Code [655362] returned - [Error decrypting password]. “ in the logs. Not sure what password is referenced here. It concerns a intellisnap snapshot which is available on the storage. Has anyone seen this error before?

7
J
Byte
13 days ago
S
Bit
saul_kBit
posted in Storage and Deduplication
IntelliSnap and ISHDM IntelliSnap Linux Host Device Manager

Hello Community Members. We are using Commvault IntelliSnap with Infinidat storage. Everything works fine except the device cleanup on the Linux hosts. Most of the hosts are getting alerts for path failure and IO errors at the end of the IntelliSnap backup while the unmap and device cleanup is performed.   We did check the difference between the servers which are not alerting, and which are alerting.  The main difference we can see in the IntelliSnap log is about “ISHDM IntelliSnap Linux Host Device Manager”. But I can’t get any explanation about ISHDM on Commvault site or on RedHat. Can you guys help me to understand what does this value /settings does better than normal “classic OS utility interface” If the above setting is not related to IO error/ path error / device cleanup, please let me know if someone experienced these types of issues on Linux hosts while performing IntelliSnap backup.  Logs found on the server with no IO error / path error. 3724588 38d52c 09/04 19:45:21 1701177

5
S
Bit
13 days ago
G
Bit
GeorgiosBit
asked in Storage and Deduplication
Create Storage Policy with Deduplication and Compression on Storeonce Appliance.

Hello Community,Recently, we connected an FC HBA 3660 StoreOnce appliance to our Commvault v11.32 backup server. The catalyst store on the StoreOnce is configured for low bandwidth, meaning the backup server (media agent) performs deduplication and compression, sending only new data to the StoreOnce.We have created a storage pool that uses StoreOnce as the backup target, followed by a storage policy based on the StoreOnce storage pool.However, it appears that Commvault, by default, disables deduplication and compression on the storage policy.Could anyone advise on how we can enable the deduplication and compression? As StoreOnce is configured for low bandwidth, we want the backup server (media agent) to handle deduplication and compression, rather than StoreOnce.Thank you,

1
A
Vaulter
14 days ago
M
Byte
Mateusz SlezakByte
asked in Storage and Deduplication
Is it possible to change Azure Cloud Archive library into Azure Cloud Combined Storage Archive/Cool Library

Hello Commvault Community!,I have a question in the name of one of our client.We have created a Cloud Library (Azure Archive) - and copied around 40TB of data into the Cloud.It tooks us over 2 months to transfer this amount of data, when it completes we then realize that there is a problem with Cloud Recall workflow - when we try to “Browse and Restore” from CopyPrecedense (Azure Archive) - It is trying to reach an Index from this archive cloud (it runs a job “Index Restore” and it can’t find index data because it is archive storage, so it runs a Archive Recall workflow to recall an index data to be able to list the backup data - this worlflow fails after few seconds and we can find an error in Browse and restore window: “The index cannot be accessed. Try again later. If the issue persists, contact support.”.We decided that restoring an index from archive cloud isn’t good idea, because even if it would work - it would take too much time (few hours just to list backup content (index res

3
S
Vaulter
14 days ago
B
Vaulter
Balaji-FMVaulter
asked in Storage and Deduplication
Does Storage Accelerator feature works for VSA (VMware) backups which has access to Dell Data Domain client library

Backup Type: Virtualization VMwareProxy: VSA WindowsStorage: Dell Data Domain Client LibraryQuestion: Customer would like to use the client (VSA) direct mode (storage accelerator) backups for VMware virtual machine backups. The CS, MA and VSA are in same subnet and the VSA has direct connectivity to DD Boost Client Library. 

2
Johannes Keil
Vaulter
14 days ago
S
Bit
SollyKBit
asked in Storage and Deduplication
Restore failing with error Error Code: [13:244] Description: [Media read operation failure] [Dedupe disk media] [Access to the file/media denied.]

Restore failing(goes to Pending) with error Error Code: [13:244]Description: [Media read operation failure] [Dedupe disk media] [Access to the file/media denied.]When running on Media agent 01 but goes through when running on Media Agent 02

8
Erase4ndReuseMedia
Byte
15 days ago
M
matisardi
asked in Storage and Deduplication
Gridstor configuration in Commvault 11.36

Hi,I am testing 11.36 version and realized Commcell Console is not installed anymore with new installations.I you need to use Commcell Console you have to request to technical support.Is there a way to configure Gridstor from Command Center? Regards, Matias

6
Erase4ndReuseMedia
Byte
16 days ago
D
Byte
Dipayan SarkarByte
asked in Storage and Deduplication
Multipart upload with respect to nonworm policy and WORM enabled policy

When I use WORM-enabled storage policy to backup a file. I can see from the Object store logs that the PUT requests include partNumber and uploadID. See the example below.PUT /2.6wormtest/Z5YO4V_09.06.2024_10.43/CV_MAGNETIC/V_342/CHUNK_1294/SFILE_CONTAINER_020?partNumber=1&uploadId=7ffffe6e38ff88e4 HTTP/1.1When using a NONWORM policy to backup the same file, the received PUT request does not include the partNumber or uploadID. See the example below.PUT /windowsnonworm/1DWYIV_09.11.2024_10.49/CV_MAGNETIC/V_8220/CHUNK_84999/SFILE_CONTAINER_001.FOLDER/0 HTTP/1.1" 200My question is, does Commvault not employ multipart upload during a backup with the standard (WORM disabled) policy?

1
N
Vaulter
21 days ago
T
Tapeman
asked in Storage and Deduplication
Auxcopy from tape to Storeonce

I have a bunch of data in a very end of support tape library. I need to get it out of teh tape library and into somewhere else. If I configure an HPE Storeonce library and use that as an auxcopy target will the storeonce be able to deduplicate the data coming off tape? I’m unfamilair with Catalyst - and I vaguely recall that in an aux copy scenario chunks are moved from place to place without any actual processing that might be required for catalyst/dedupe processing.

2
A
Vaulter
21 days ago
A
Byte
Amin91Byte
asked in Storage and Deduplication
DDB size

Hello,I have a I have a small customer who has a secondary media agent that receives aux copy. its DDB size is over 2,5 TB.What is commvault recommendations about that?We plan to perform a hardware refresh of the Media agent maybe be I can reduce the DDB size during this operation ?Thanks !

2
A
Vaulter
23 days ago

Badge winners

  • Contributor 5
    AnandKhas earned the badge Contributor 5
  • Topic Starter 1
    michaelfhas earned the badge Topic Starter 1
  • Topic Starter 1
    jlerouxhas earned the badge Topic Starter 1
  • Topic Starter 1
    lee.kerseyhas earned the badge Topic Starter 1
  • Solver 5
    mikevghas earned the badge Solver 5
Show all badges
Terms & ConditionsCookie settings