commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 888 Topics
  • 4,076 Replies

888 Topics

C
Commvault Engineer
asked in Storage and Deduplication

Secondary copies ports requirement

Hi Commvaulters, Can someone advise me with the needed network ports to be open in order to perform an aux copy between 2 MAs.We installed a new MA on a remote site, and we want to open only the needed ports between it and the CS (For communication) and between it and the MAs located on the main site.Please to note that we are running CV version 11.24, I know that the main ports are 8400 for communication and 8403 for data transfer.Is there any other once that needs to be opened ? We want to minimize port opening in order to fully secure the remote MA. Regards.

5
Nikos.Kyrm
Byte
3 months ago
E
Byte
Eduardo BragaByte
asked in Storage and Deduplication

Set Location of exported Tape

Is there a command line or script to set just the Location property of a previously exported tape? The below Command did not work. ./qoperation media -o export -b 000298L6 -l RLS-0 -el "xxx - 05" -m xxx-ma-01 -v -tf /home/xxx/tokenfile.cvltRequest successful.[xxx@xxx-ma-01 Base]$ CommVault 11.24.12 

12
Mike Struening
Vaulter
2 years ago
L
Byte
LukasMByte
asked in Storage and Deduplication

Merge mount paths?

Hello,I’ve some older data at one mount path and want to move it to different host where new storage has been already configured and it’s up and running. Is there a way to somehow merge the data from old MP into new one? So I want to move data from Host1 - “D:\MP1” to Host2 - “D:\New MP” to keep everything in single place. Simple move is enough?   

8
J Dodson
Vaulter
1 year ago
D
Byte
drPhilByte
asked in Storage and Deduplication

System Created DDB Verification schedule policy - use of streams

Hi there, is it safe to limit the number of streams to be used in parallel for System Created DDB Verification schedule policy? I am asking because in our case this verification policy consumes 30 streams out of 30 streams. However, there is set up use maximum number of streams, why is 30 limit then?Secondly, I would like to discuss Data Verification Options. Which option do you use preferably? Would it be enough to use only Verification of Deduplication Database instead of Verification of existing jobs on disk and deduplication database?  

3
L
Byte
2 years ago
P
Commvault Certified Expert
PatrikCommvault Certified Expert
asked in Storage and Deduplication

Restore from Commcell Migrated Tape Library

Hi, I am performing a Commcell Migration and in the source Commcell there is a TapeLibrary that we need to migrate to the target Commcell. My question is if the historical data will be available for restores (i.e tapes will be migrated/re-labled as well).  And if using the option “Allow imported media to be reused on this Commcell” means that append will work once the TapeLibrary is migrated or if it is read only and tapes will be reused (moved to scratch) only once all data on them has expired. Regards, /Patrik

3
Mike Struening
Vaulter
2 years ago
A
Bit
AbdulWajidBit
asked in Storage and Deduplication

Best practices to ensure maximum streams for Aux to MCSS

Hello Community We are doing a pilot by pushing around 50t of data over to MCSS. We have noticed that when the jobs are progressing, there are multiple streams of different sizes at the beginning of the job and as the job progresses the number of streams go down. Is there a way to ensure that the data that is being pushed to MCSS is distributed among multiple stream equally so that we get consistent performance out of the job till the end?  

2
Scott Moseman
Vaulter
1 year ago
Mohit Chordia
Byte
Mohit ChordiaByte
asked in Storage and Deduplication

Impact of Enabling WORM on NON DEDUPE PRIMARY or SECONDARY BACKUP COPY

Hi Team,My Primary Copy is not using deduplication . If i enabled WORM at storage policy copy level , would there be any impact on backup library storage consumption .I guess 2x to 3x additional capacity is required only when we enable WORM on deduplicated backup copies.Please let me know if my understanding is right ?

5
O
Vaulter
2 years ago
D
Bit
DanielKBit
asked in Storage and Deduplication

Optimized tape utilization

We make daily backups of our servers.Every month we write the backup data on tapes.The retention period for these tapes is one year.For December, we create an end-of-year backup with unlimited retention time.Our goal is to have an annual backup for December and reuse the remaining months' tapes after one year.Due to server retirement, there are monthly tapes that we cannot reuse without first deleting the contents (Retain time until: infinite). If we do so, we lost data.Is there a solution to this problem?

1
Mike Struening
Vaulter
2 years ago
D
Byte
drPhilByte
asked in Storage and Deduplication

Temporarily disabled deduplication - make it enabled again

Hi all,some days ago we have temporarily disabled deduplication only under storage policy copy (Storage policy tab). Now, we want to allow deduplication again, however if we uncheck the option (temporarily disable deduplication) we see the message - Deduplication cannot be enabled on dependent copy when disabled on Storage Pool. And this is very strange. Under Storage Pool there have been no changes made, moreover, there is no option to uncheck temporarily disable deduplication (Storage Pool tab). Maybe, only one thing can be in play, the DDB is in Maintenance state because of verification in progress.  Storage Pool window - no option to switch disabled deduplication   

1
D
Byte
2 years ago
C
Commvault Engineer
asked in Storage and Deduplication

Why seal Cloud based DDBs?

Hi All, Came across this thread, and all the replies were very helpful, had another question regarding DDB sealing.Why do we need to seal the DDB when using Cloud library ? And can we defer its execution as far back as possible ?  Kind regards.

4
C
1 year ago
L
Byte
Lubos Dvorak
asked in Storage and Deduplication

Microsoft OneDrive Cloud Storage

Hi All,I have an issue when adding a OneDrive cloud storage.I am configuring via CommCell Console. If I enter Application ID, Tenant ID and Shared Secret and then click the Detect button I receive an error “ ### EvMMConfigMgr::onMsgCloudOperation() - Failed to check cloud server status, error = [[Cloud] The requested URI does not represent any resource on the server.  Message: Invalid hostname for this tenancy ”Commvault support answer is “The cloud vendor should be able to help you with the right URL. This is outside Commvault unfortunately ”.Does anybody have any experience using Microsoft OneDrive as a cloud storage?Thank you,Lubos 

13
Mike Struening
Vaulter
2 years ago
E
Byte
Eduardo BragaByte
asked in Storage and Deduplication

Is it worth deduplicating Transactional Logs?

We think that there is no real benefit for the Commvault to deduplicate Transaction Log data. Maybe some compression benefit, but today we deduplicate practically everything. I started another topic (Difference between Incremental Storage Policy and Log Storage policy) to ask about the differences between Log Storage Policy and Incremental Storage Policy. The idea is to have a specific Storage Policy for Database Agents Transactional Logs with deduplication disabled. By examining some backups jobs, we noticed that Savings Percentage comes entirely from Compression. Due to its nature, It seems that there is no gain when deduplicating variable data like Transactional Logs. By disabling deduplication for those data, in theory, we can keep DDB smaller and reduce Q&I times. Am I right?  

4
Mike Struening
Vaulter
2 years ago
T
Tomipe
asked in Storage and Deduplication

network path on disk library

Hi everyone After successful installation of commvault, i am unable to add disk library using Network path from a shared folder. it keeps giving me the error “Failed to verify the device from Media Agent with the error (failed to log on user to write file…….)  .  the user has been given full permission right as admin but not working out.  what could be the problem?

4
T
1 year ago
Kamil W
Commvault Certified Expert
Kamil WCommvault Certified Expert
asked in Storage and Deduplication

Some question about Cloudian S3

Hi Guys,I have some questions about Cloudian S3 storage.Does Commvault fully support Cloudian S3 storage? If so, is ‘object lock’ functionality also supported?I cannot find any information about it in the BOL.Rgds,Kamil 

6
Kamil W
Commvault Certified Expert
2 years ago
J
Byte
justin000Byte
asked in Storage and Deduplication

Space reclamation / orphan data cleaning against cloud storage library

Hi all,Wondering if by chance anyone has experience running DDB space reclamation with orphan data cleanup against a cloud library. We have a cloud library in Azure cool tier which we expect may have some data that was not pruned successfully, thus increasing our storage consumption in Azure. The deduplication database for this data lives on local storage.We’d love to run a space reclamation with orphan data cleanup against this cloud library, but we’re concerned about the possible cost of storage transactions against the Azure cool library.Has anyone performed this operation before and observed the related cloud storage costs? For reference, we have just under 100 million blobs and a total of about 400TB of storage utilization in Azure. Many thanks for any input folks may have!

2
J
Byte
11 months ago
E
Byte
Eduardo BragaByte
asked in Storage and Deduplication

Drive Cleaning - On sense code option

Hi,Does anyone know what sense codes CVLT interprets to start a drive cleaning job?We suspect that CVLT is starting tape drive cleanup jobs under unexpected and undesired conditions.The option “Set drive as needs on CRC errors” is not checked. In two days we got one new cleaning universal tape that expired. There's another one on the way. A new cleaning tape has 50 cycles. We have a Qualstar model RLS-87120 LTO6 with 5 drives.  There is no automatic/schedule cleaning at the Library side. There is drive cleaning schedule on CVLT. We would greatly appreciate it if someone could contact the developers and find out this information.  The Tape Library supports a specific sense code to inform a system that its drives needs cleaning. 

1
Jos Meijer
Commvault Certified Expert
1 year ago
B
Byte
benjaminasByte
asked in Storage and Deduplication

Selective copies using same Global Deduplication Copy

Hello, When using plans we would like to extend the retention time for some client using a selective copies and reuse the same Global deduplication policy. Most of our backups are IntelliSnap snapshots. Is this possible, how would we best do it? Are there any best practices for this?

7
Mike Struening
Vaulter
1 year ago
T
Byte
TommyByte
asked in Storage and Deduplication

Tape Library Drive Troubleshooting

Hi,I have so far replaced three drives in our DELL/EMC ML3 Tape Lib and still experiencing the same problem. Currently, there’s one valid drive that is working fine - when it comes to the other one, it is mounted and immediately unmounted after a couple of seconds - one try after another in an endless loop.According to DELL, there’s nothing in the library log that would indicate the root of the problem (the log is clean) - they send me another drive and then the case is closed until the issue rises again.I tried swapping the drives in slots but the problem is following the same drive no matter the slot. At this point, I’d like to exclude software-related cause of the issue.Currently, the number of errors associated with mounting and unmounting the drive is way over its threshold; that might be the reason why CV is ignoring the drive completely - how can I reset the counter? Is there a particular procedure I should follow when replacing a drive? I can see there’s an option ‘Mark drive a

2
T
Byte
7 months ago
D
Bit
doms24Bit
asked in Storage and Deduplication

Changing Azure Storage Tiers

We have been using Azure Storage accounts as offsite libraries for years.   We fully take advantage of cool storage tier, but with our usage history, I would like to start setting the Commvault Azure Libraries to archive storage tier.   What is the best way to get the blobs assigned to the archive tier?  I assume that only new written data will have archive and the rest will have COOL, until it is pruned.  Retention varies from 1 year to upwards of 10years.  Is there a native workflow available, or should I think about creating a new library and AUX copy the data into the new configuration.  

2
Henke
Byte
2 years ago
E
Byte
Eduardo BragaByte
asked in Storage and Deduplication

Drive reported that media is physically bad

What happens to backup contents from media that an LTO drive reported that It is physically bad? Does the Commvault copy those not-aged jobs from source copy to other media (tape) again or It just prevent reuse the media and retire it after expiring jobs?     

1
Jos Meijer
Commvault Certified Expert
1 year ago
K
Bit
Kevin O'NeillBit
asked in Storage and Deduplication

DR backup to CV cloud

We are currently preforming a DR backups to On-Prem (multiple locations) and CV cloud. As viewed in cloud.commvault.com it appears that we are limited to only 5 iterations of the CV DBs. In “DR backup” options we have 20 set, but that seems to only be On-PremQuestion> Is there a way to expand the amount of CV cloud backups retained? 

5
K
Bit
2 years ago
J
Byte
JSNOPUDByte
asked in Storage and Deduplication

Settings for Archiver data Retention

I am attempting to replicate an existing Storage Policy with some differences associated with Media Agents for the copies. There is a existing setting called Archiver data Retention with a setting of 63 days for certain copies, but looking at the Copy properties for Retention, I am unable to find that setting.As a result, in my replicated Storage Policy, the default Archiver data Retention value is Infinite.Do you know how to set the settings for  Archiver data Retention?  

2
J
Byte
1 year ago
M
Byte
Michal128Byte
asked in Storage and Deduplication

The best configuraion for Commvaul Immutable soluion in Azure

Hello, I am looking for the best solution for immutable copy of data built on Commvault in Azure. We have some configuration, but I would like to see what Commvault Community can propose. I am looking for few approaches: First copy of data is in local. Azure copy is working as DR site. Dedicated storage for Immutable in Azure per site (locally).  First copy of data is in local. Azure copy is working as DR site. Shared storage for Immutable in Azure per site (locally).In that both approach I would like to know about the cost and how to estimate decrease usage storage between dedicated - shared storage ? What will be the best storage configuration for that solution Deduplicated or Not-deduplicated?  Retention for Immutable is 14 days and 2 cycles. Storage usage for Immutable solution (Hot or Cool)?And I think the most important how to calculate cost for those solutions if I have only local backup solution in current state. Regards, Michal 

5
M
Byte
7 months ago
E
Byte
elizabetaByte
asked in Storage and Deduplication

Selective Aux Copy reached Pending status at 98%

Hello,There still seem to be more problems :-(Next time I launched an aux copy for two more tapes of the same Storage policy.It reached 98% and Pending status. no error at allHe took the same tape as in the previous process.I killed the process.…I have delete content of new LTO7 tape because, process aux copy not finished to 100%Now, I run auxilliary copy with Backup period in which there are backups for four tapes, but Job is completed and “no more data copied”Whether it is possible to run Aux copy  from same tapes LTO4 twice to a new different LTO7 tape???   

11
Mike Struening
Vaulter
2 years ago
E
Eyal
asked in Storage and Deduplication

Backup job with no compression

Hi,we installed a new dedupe appliance as a new library. we are now configure a new SP with no compression and no encryption (commvault dedupe in on).we need to replicate the data using aux copy to the DR site with a straight disk library (JBOD).my question - if we backup with no compression ‘ will aux copy also transfers uncompressed data to the DR site? because in this case , we’ll be run out of capacity in the DR library.thanks.

4
Scott Moseman
Vaulter
1 year ago

Badge winners

  • Contributor 1
    PPChas earned the badge Contributor 1
  • Contributor 1
    ACTREChas earned the badge Contributor 1
  • Contributor 1
    Waleed Al Mansorihas earned the badge Contributor 1
  • Topic Starter 1
    ACTREChas earned the badge Topic Starter 1
  • Solver 50
    Emilshas earned the badge Solver 50
Show all badges
Terms & ConditionsCookie settings