commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 895 Topics
  • 4,095 Replies

895 Topics

M
Byte
MubaraqByte
asked in Storage and Deduplication

LTO8 and LTO6 cartridges not writing compressed data

Hello, TeamI have a customer who is writing directly to the tape library with any dedupe in place. Their challenge is, for their LTO8 and LTO6, the data writing to tape is making use of the native capacity instead of the compressed capacity.  They have the hardware compression enabled on each of their storage policy and they confirmed that before moving to commvault, their previous backup solution makes use of the compressed capacity when writing data. Is there any settings that can be done on commvault to ensure that the data is compressed so it can write full capacity of the data?Please, advise

3
Onno van den Berg
Commvault Certified Expert
8 months ago
M
Byte
mzatorByte
asked in Storage and Deduplication

CV/Netapp A700 config permits only 36 concurrent sessions for backup copy jobs to a FAS8700: Is there a way to increase this ?

  CV is configured with a cluster ndmp client and the nodes for the cluster are added in the ndmp client configuration. There are 6 physical nodes in the cluster. Source netapp is an a700 and the destination netapp is a FAS8700.Issue:   For a backup copy job hundreds of jobs running but only a max of 36 transfer data. Hundreds of jobs trying to make a connection to the filer, but they can’t.  These jobs are each grabbing a stream but only 36 at a time are moving data. Increasing streams helps but then more backup copy jobs that can run launch and consume streams.There is a snap primary, storagegrid backup copy, vault replica copy,  and streaming data protection jobs that are very behind because of the supposed concurrent session limit (36 ?) from the source a700: streams keep being eaten up by backup copy jobs, but only 36 move data concurrently, thereby causing jobs for other copies to not run including the snap primary source copy for the storagegrid backup copy jobs. Misc.From the c

3
S
Vaulter
5 months ago
S
Vaulter
Sunil RVaulter
asked in Storage and Deduplication

LTO tapes - 20 TB maximum capacity

There is a new physical tape library configured in this environment (HPE MSL G3 2024) with 2 tape HPE Ultrium 8-SCSI FC drives. The tape library was added in Commvault and few auxiliary copy jobs performed:1. With the hardware compression disabled in Commvault storage policy copy data path configuration. The size of data on the first tapes was 10 TB.2. With the hardware compression enabledin Commvault storage policy copy data path configuration. The size of data on each tapes was 20-21 TB.The backup data type is VMware backups.Our question is why Commvault is not placing more than 30 TB on each tape, considering they are LTO8 and hardware compression is enabled? This customer has another Commvault environment  , with similar backup devices and same settings, they are able to accommodate between 30 -40 TB.

3
J
Bit
7 days ago
PedroRocha
Byte
PedroRochaByte
asked in Storage and Deduplication

Data Written x Size on Media

I've seen several discussions regarding this topic. But I still don't get it. From the docs:Application Size: The size of the data that needs to be backed up from a client computer. Application size is not always identical to the size reported by file or database management tools.Data Written: New data written on media by each backup job.Size on Media: Size of deduplicated data written on the media. Consider the following real job:Job 1 (deduped disk lib is the destination): App Size: 33.4TBData Written: 24.93Size on Media: 7.30 1st question: what is the total size occupied by this job in the dedup disk lib?2nd question: is data written size, before dedup? Does it account for sw compression only? both?3rd question: is size on media just the size of unique blocks for the job (disregarding the baseline?)? regards,Pedro

3
N
Vaulter
7 months ago
C
Bit
Christian MoisanBit
asked in Storage and Deduplication

recopying contents from a tape that was physically dropped and is no longer usable

Hello! This morning I was all thumbs and dropped a tape. This caused the little pin inside to come loose and the tape was barely holding. I have to consider it dead now. Is there a way to flag the data inside to be recopied to another tape? Thanks!

3
C
Bit
1 year ago
R
Bit
rutynaBit
asked in Storage and Deduplication

Problem with media agent

Hello Occured today on a strange error:HP Ultrium 7-SCSI_2 - A SCSI command to the drive is stuck on the active drive controlling MediaAgent.Id restarted tape libary but this problem is not resovled i assume i need to restart MediaAgent but dont know exacly how anyone can help?

3
D
Byte
1 year ago
S
Bit
SB_KAVBit
asked in Storage and Deduplication

New mount path don´t show correct size

Hello, I´m pretty new to Commvault and starting with the first steps.I have the problem that I have 8TB local storage in my media agent and formatted as 64k. Created a mount path but it shows only a couple of GBs usable. What can I do to recognize it correctly?The old hardware is the same way connected.  Thanks in advance for your help. Greetings from a newbie

3
S
Bit
4 months ago
B
brucquat
asked in Storage and Deduplication

Deduplication block level factor

Hello,In  the documentation Deduplication Building Block Guide (commvault.com), it is mentioned that:“The DDBs created for Windows Media Agent should be formatted at 32 KB block size to reduce the impact of NTFS fragmentation over a time period.”Is the format at 32 KB referring to the block size of the disk itself (NTFS block size) or referring to the “Block Level Deduplication Factor” parameter of the Storage Policy as shown below ?Thanks  

3
N
Vaulter
1 year ago
A
Aglidic
asked in Storage and Deduplication

s3 worm and infinite retention

Hello is it possible to enable worm on a s3 bucket with infinite retention? If we want to worm only for 30 days with infinite retention what is the best way?Just create a copy with infinite retention and worm enabled on  it Create a copy of 30 days with worm and add extended retentionthanks in advance

3
N
Vaulter
6 months ago
L
Byte
LahariByte
asked in Storage and Deduplication

question on cycles and days

scenario: I have a WORM storage policy (deduplication enabled) of retention 3 days 1 cycleI have run 2 full backups to my storage on same day which completed 1 cycle of retention and with deduplication 7 days of retention is added so total (3+7) 10 days of retention. Will my first set of data be deleted on 11th day since it completes retention on both cycles and days or kindly correct if there is any gap in my understanding here ?

3
L
Byte
6 months ago
T
Byte
ThomasGByte
asked in Storage and Deduplication

WORM and Dell Powerscale/Isilon Smartlock

Hello,just one question:If Commvault WORM copy with Dell Powerscale/Isilon Smartlock is enabled, will the data be pruned after the retention of the copy has met? Thank you.Regards,Thomas

3
S
Bit
6 months ago
M
Bit
Marek OplotnyBit
asked in Storage and Deduplication

Migrating Clients/Subclients after enabling horizontal scaling

Hi,I want to enable Horizontal Scaling but I don’t know how Commvault will handle old clients and subclients.Do I need to create new client/subclient?

3
Scott Moseman
Vaulter
6 months ago
M
Byte
MauroByte
asked in Storage and Deduplication

Device_Label deleted

I understand the DEVICE_LABEL file is used for pruning so it missing could be an issue.I have a customer who's deleted the file off a volume.Will this affect pruning and would there be any other potential issues that could arise?Is there a way to recreate the file if it is required, without recreating the volume?The volume is configured as a WORM device for compliance.Thanks so much.

3
O
Vaulter
1 year ago
G
Byte
G2TByte
asked in Storage and Deduplication

Netapp Intellisnap can't find the right vserver/SVM

After adding the array into array management and triggering a intellisnap backup.  Commvault is failing to create snapshot due to not finding the specified vserver.Error Code: [32:392] Description: Snap creation failed. : [Unable to create snapshot for FileServer:[192.168.1.65] Volume:[/vol/vmware_nfs] SnapName:[SP_2_1075_4_1693309853]. Return code:[15698][Specified vserver not found]] Source: cvcs, Process: vsbkpI’ve checked the vsbkp logs...ManageONTAP::SetVserverForTunneling() - Using SVM[vol] for tunnelingIt appears to be searching for vserver called “vol”, which i’m not sure where this comes from, there is only one vserver on this netapp and it called SVM0.Anyone run into this?  

3
Emils
Vaulter
7 months ago
D
Donnie D
asked in Storage and Deduplication

AWS S3 - Dash copy between buckets and promote copy?

Hi,  I could not find anywhere that adressed this, so asking here. I read that the only way to “migrate data” between storage classes would be as documented. However, can this be done? I have a Hyperscale as a Primary Copy I have an existing AWS S3 Standard bucket as a Dash Copy with Deduplication.  I want to create another Dash Copy to an AWS S3-IA Bucket with Deduplication.  I want to promote that copy to be the secondary copy and get rid of the existing bucket. Effectively, this seems like migrating the data just as good as going through the process described with the Cloud Tool.  Am I wrong? Can this be done?  

3
Damian Andre
Vaulter
1 year ago
YYZ
Byte
YYZByte
asked in Storage and Deduplication

Expire uncompleted "To Be Copied" - Selective Copy - First Full of the Year

I’d like to create a single beginning of year (Jan 2023)  selective copy (to Tape)Settings are Selective : Yearly Full, First Full of the YearWhat I’d ideally like to achieve is to capture only those Full backups that took place in the first 2 weeks of the new year - which is ‘easy’ to do. What happens though is:If some ‘new data’ or new subclient is created and it obtains a first full in say February 2023, that data will ‘wait’ until it can be written to tapeBut no physical Tape will be made available until Jan 2024(eg 10 Tapes are put in on 1 January 2023 , 10 Tapes are removed 31 Jan 2023, and no further Tapes will be inserted until 1 Jan 2024) What I’d like to do is:If There are AUx Copies waiting (specific to Storage Policy and Storage Policy Copy), if the Aux has been waiting for more than (say) 60 days, is change the job to ‘DO NOT COPY That is ‘almost’ have an expiry data on waiting copies for Aux to Tape  or an option that the ‘First Full of the Year’ has a validity period of

3
V
Vaulter
1 year ago
S
Bit
SomeUniqueName
asked in Storage and Deduplication

New E2812/Media Agents recommendation

I’m slogging through a CV hardware upgrade.  My company is “trying” to find $$ for training...but so far no joy, so I’m winging it.I have a new NetApp E2812, two new media agents, and a shiny Brocade FC switch to bind them all together.My immediate question is, do I create two volumes on the E2812 and mount one on each MA?  Or can I create just one volume and let both MAs read/write to it simultaneously?  Typically, sharing a volume like that across multiple Windows servers leads to trouble, but can the CV media agents handle that sharing?I like the idea of a single volume letting both MAs access all of the available disk space. That alleviates the need to balance my backups across the different volumes. Does anyone have any helpful pointers for me?  Much obliged.

3
S
Bit
1 year ago
K
Bit
kumaraBit
asked in Storage and Deduplication

Disk storage occupied

Hi Team,As per the snapshot, total data written 1.33 TB  out of 10TB . But free space showing me 46 GB only.The same like showing me other mount points. But when check the physical size it is occupied around 10 TB only. Please help me on this.

3
Zubair Ahmed Sharief
Vaulter
11 months ago
T
Byte
Tomer AByte
asked in Storage and Deduplication

Re-Copy bad chunks on secondary copy

Here is the situation: Primary copy - main siteSecondary Copy - DR site Tape Copy - DR Site We are doing Aux copy from Primary > Secondary and Secondary > TapeWe got alot of errors reading chunks when doing Aux to Tape. we noticed that those jobs fail to restore from Secondary copy also , on Primary site , jobs can restore Can i mark chunks/jobs as bad on secondary copy and have commvault recopy the jobs INCLUDING the bad chunks from Primary copy again and not save bad chunks due to dedup ?

3
Damian Andre
Vaulter
8 months ago
W
Byte
Ward DuncanByte
asked in Storage and Deduplication

How can I verify manually verify contents in cloud

I am manually running an aux copy to an S3 bucket but don’t know how to verify that everything has been copied.  How do I verify that the source library and the cloud copy have the same contents?

3
D
Byte
1 year ago
R
Byte
Rehan BariByte
asked in Storage and Deduplication

Is it possible that high Q&I times can cause the following error message: Description: Timeout while waiting for a reply from DeDuplication Database engine for Store Id [X]

Hello,  I have Oracle backups running which are scheduled through RMAN which occasionally fail with the following error code: “Error Code: [82:177] Description: Timeout while waiting for a reply from DeDuplication Database engine for Store Id [X]” Steps that I have taken to troubleshoot the issue: Dedupe engine is active and running Created a one way persistent tunnel from the client to the commserve and Media agentsas suggested by another thread pertaining to the same issue “ERROR CODE [82:172]: Could not connect to the DeDuplication Database process for Store Id [xx]. Source: xxxx, Process: backint_oracle | Community (commvault.com)”Our Q&I times across the board for our media agents are quite high. For this particular engine the times are 6,416 microseconds (307%). I believe the ddb is not running on SSD, but regular disk. Is it possible that this could be causing the above error? If not I’m not sure what else could be the reason for this. 

3
R
Byte
1 year ago
B
Bit
Bri-mhemailBit
asked in Storage and Deduplication

DDB Sealed after corruption and data is not deleting from disk

We had an FM200 release in our data center.  DDBs became corrupt and restore failed.  Sealed and started new DDB to get backups running.  Now all jobs have aged out of the sealed DDB, but I still have 387TB of data on disk and I need the space back ASAP.  SIDBPHysicalDeletes not showing continuous activity.  Data aging ran multiple times.

3
N
Vaulter
1 year ago
C
Carl Brault
asked in Storage and Deduplication

Azure cloud lib with significant iterative read operations

Hello community,I have a customer whose backing up in a disk lib, then auxcopies to an Azure Cloud lib.However, when customer looks at his Azure costs for the last 5 days, they spend over 100 dollars a day in Iterative read operations. I’m trying to figure out what is reading so much from the cloud library. The total written size for a day is 200GB. why 41 million read requests? The DDB Verification is disabled for this library.Is there anything else I should look into?Thanks in advance.

3
C
1 year ago
N
Bit
Nik14Bit
asked in Storage and Deduplication

Restore Performance

HI All, We have introduced Exagrid storage system as our backup storage solution, after the implementation we have noticed that the restore job is taking longer time than the expected one.We used Netapp as storage solution before Exagrid and also at the current setup with Exagrid we have enable the dedupe in both CommVault and Exagrid as well. How to identify where is the bottleneck. We have enabled the encryption and compression also in the Exagrid system. 

3
T
Vaulter
8 months ago
P
Bit
pingsoonBit
asked in Storage and Deduplication

Tape Library support

We are in the process of replacing a tape library with another. How many tape libraries can be configured on a mediaagent? We would like to have both attached at the same time for a transition period. The old one has LTO6 drives and the new one has LTO9 drives.

3
Rajiv
Vaulter
8 months ago

Badge winners

  • Contributor 1
    jxbhas earned the badge Contributor 1
  • Contributor 1
    Artem Veselovhas earned the badge Contributor 1
  • Solver 1
    Nondashas earned the badge Solver 1
  • Contributor 5
    PPChas earned the badge Contributor 5
  • Topic Starter 1
    jxbhas earned the badge Topic Starter 1
Show all badges
Terms & ConditionsCookie settings