commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 900 Topics
  • 4,109 Replies

900 Topics

E
Byte
Egor SkepkoByte
asked in Storage and Deduplication

DDB Full

One of our DDB getting full, what is the best practis to make some space on DDB? 

13
Mike Struening
Vaulter
2 years ago
L
Bit
LucasBit
asked in Storage and Deduplication

AWS Glacier data removal

We copy data to AWS S3 for long term retention and let it age to glacier after 30 days. In order for this data to be restorable I first have to rehydrate it with a workflow as Commvault only expects to work with S3 storage tier. This works fine for the occasional restores. We are now looking into a larger data removal as part of a cleanup project to reduce AWS glacier storage costs. My questions: If I delete jobs from the Commcell that have aged to glacier, does Commvault have to rehydrate this data back to the S3 tier to be purged from AWS? If so, is this done with the same restoration job Cloud Recall workflow? 

1
B
Vaulter
2 years ago
E
Byte
EldanByte
asked in Storage and Deduplication

Can't do Online Full SAP for Oracle backup

getting the following errorError Code: [82:172]Description: Could not connect to the DeDuplication Database process for Store Id [44].Source: sapdrfr7, Process: backint_oracle don’t find the backing oracle processany suggestions? 

6
Mike Struening
Vaulter
2 years ago
K
Bit
Karamveer SinghBit
asked in Storage and Deduplication

Any Details on 3dfs solution and object storage?

Hi all, I’m looking more information on 3dfs and object storage. commvault document doesn’t seems to be sufficient on this. Any link or video or article reference will be helpful. 

7
Mike Struening
Vaulter
2 years ago
L
Bit
lowey71Bit
asked in Storage and Deduplication

DDB storage for DR restore only

Doing some preparation of our DR environment and wondering, if we intend to only do restores in the DR environment, is SSD still a requirement? My thoughts were the performance is required to do signature lookups (for writes), but for restores this would not be required. Thanks!

1
B
Vaulter
2 years ago
B
Byte
Baba ImaniByte
asked in Storage and Deduplication

Creating a Selective Copy Using a Library (Enable Deduplication)

Hi Guys, I finally found the exact article that describes a solution I wanted to implement and am seeking opinions to do this or not. Basically I want to create multiple Selective Copies under a storage policy and associate with different subclients/computers to meet a client’s tiering model and different retention. Because I also want to implement Deduplication between the Primary and each selective copy, Weekly and Monthly, I’m weighing an option to Create Selective Copy using a Library instead of using a Storage Pool. In the article below;Article: https://documentation.commvault.com/commvault/v11/article?p=119730.htmStep 17b, can I select Partition Path as a normal Windows folder e.g. D:\<randomFolder>. If I create additional selective copies under the same storage policy, can I use the same D:\randomFolder> to deduplicate data between Primary Copy and additional selective copies or I have to create a D:\<randomFolder1> and so forth for each copy. I ask because I do n

17
Sean Crifasi
Vaulter
2 years ago
P
Commvault Certified Expert
PatrikCommvault Certified Expert
asked in Storage and Deduplication

Dedup Data Written expands with new DD-engine

Hi, We are setting up a new Windows MA with new DD-Engine and a new DiskLib. The DDB disk has been configured with recommended 32k block size and the DiskLib volumes with 64k block size. We have run a new DASH Copy in the SP to create a new dedup baseline from the previous backed up data. And the plan is to make this DASH Copy the new Primary once all data is available. A standard re-baseline operation, that usually get better dedup ratio with an updated DD-Engine. The backup data is mostly Hyper-V vm’s. In this case the Data Written in the old copy was 9TB and the Copy stopped att 18TB in the new MA as it ran out of resources - DiskLib Full. This was unexpected. Now we are thinking about doing Move DDB and MountPath but if there is a general Deduplication degration we are not sure if this will work, and if we will run into the same issues again. Does anyone have a similar experience or knowledge about this issue and a recommendation on how to move forward?I have done both new baseline

6
Mike Struening
Vaulter
2 years ago
J
Byte
jparaujoByte
asked in Storage and Deduplication

run auxiliary copy when full backup is done

Hi guys, I have storage policy SP_A that run daily monday-saturday incremental and sunday FULL.I have a secondary copy in this SP_A that run a scheduled at MONDAY 23h a selective copy of a full weekly backup.I wonder if I can get this behaviour: the same auxiliary copy of a secondary copy with the last full backup of week but that runs just after primary copy finishes.Is it possible get this?

6
Mike Struening
Vaulter
2 years ago
R
Bit
RSJ
asked in Storage and Deduplication

Is it possible to create a storage policy to backup data to tape library in weekly basis with manual barcode/media labels?

I am looking for a documents that we can setup storage policy to backup data to tape on a scheduled basis like tape#1 for week1 of the month, tape#2 for week2 of the month etc.. in round robin scenario from 1 backup job only Thank you

10
Mike Struening
Vaulter
2 years ago
O
Bit
OmarBit
asked in Storage and Deduplication

Mount Path move failed

We are trying to move a mount path to a new media agent, but it’s failing ever since we stopped the job. The disk became full resulting the data migration job being stuck for weeks, so we stopped the job and freed up space. However, every time we try to restart the mount path move it fails.We did the following to troubleshoot:Run disk defragmentation Verify disk and mouth path are online Validate mouth path Verify no disk maintenance task is running General sanity checks The error that we get is:Move Mount Path Job Failed, Reason : The mount path is under maintenance and hence cannot proceed with the move operation. Source: <MediaAgentName>, Process: LibraryOperation Can anyone tell how to fix this error? How do we get Commvault to see that the disk is not in maintenance mode?

8
Mike Struening
Vaulter
2 years ago
Ken_H
Byte
Ken_HByte
asked in Storage and Deduplication

CommVault cloud service down for maintenance?

Since noon on Saturday (May 15), my Disaster recovery Backup admin jobs have been failing with this error:Error Code: [34:85]Description: CommServeDR: Error Performing Transfer: Error : [Failed to initialize with Commvault cloud service, The service may be down for maintenance.].Source: inf-srv57, Process: commserveDRIs anyone else having issues with the CommVault cloud service?Ken

8
S
Vaulter
2 years ago
D
Datec
asked in Storage and Deduplication

Standalone tape backup on ESXI environment

getting error in Commvault configuration only,  

1
S
Vaulter
2 years ago
Marco Lachance
Byte
Marco LachanceByte
asked in Storage and Deduplication

Aux Copy Job missing ?

Hi, I have a customer with 2 copies :1-Primary dedup on disk with 66 jobs.2-Secondary dedup on disk with 133 jobs He created a copy 3 to replace the secondary but he chose #1 for the source, but there are jobs only in the secondary copy, is there a way to pick the missing jobs by changing the source of copies #3 for source = #2 ? If I change it and run and Aux Copy the missing jobs are not picked ? Or I have to delete the copy #3 and start over !?

3
Mike Struening
Vaulter
2 years ago
I
Commvault Certified Expert
iConsultantCommvault Certified Expert
asked in Storage and Deduplication

Tape usage - Size of Stored Data

Hi,Until recently, ~1 TB of data was stored on all our LTO4 tapes.I recently changed 2 things:I created a Global Secondary Copy Policy I enabled software encryption for the (secondary) backups to tape (Re-encrypt, BlowFish, Key length 128, No Access)Now, only ~750 GB of data is stored on all tapes before they are marked full. A decrease of 25%.Is one of these two changes a known, proven and expectedcause for this decreased usage of the tapes?Thanks!

6
Mike Struening
Vaulter
2 years ago
V
Byte
virgilByte
asked in Storage and Deduplication

Can't Move Tape to an appropriate scratch pool

Hi ,just a simple question.i  try to copy data to a assigned media but can’t move the tape to appropriate scratch pool.the media is mark to appendable.there is an option or a prerequisites to do this actionthanks for anwers.regards

6
Mike Struening
Vaulter
2 years ago
E
Byte
elizabetaByte
asked in Storage and Deduplication

Selective Aux Copy reached Pending status at 98%

Hello,There still seem to be more problems :-(Next time I launched an aux copy for two more tapes of the same Storage policy.It reached 98% and Pending status. no error at allHe took the same tape as in the previous process.I killed the process.…I have delete content of new LTO7 tape because, process aux copy not finished to 100%Now, I run auxilliary copy with Backup period in which there are backups for four tapes, but Job is completed and “no more data copied”Whether it is possible to run Aux copy  from same tapes LTO4 twice to a new different LTO7 tape???   

11
Mike Struening
Vaulter
2 years ago
B
Byte
Baba ImaniByte
asked in Storage and Deduplication

Deduplication on Independent Copies for Azure Cloud Backups

Hello guys. I’m looking for some advice/tips on how best to configure additional selective copies in a storage policy and ensure they are deduplicated to avoid rewriting the same blocks on cloud storage. The Primary Copy is deduped and goes to Library 1. I want Weekly and Monthly copies to go on Library 2 and 3 respectively with each copy disabled. I noticed I can’t use the Global Deduplication Policy being used by the Primary Copy on the additional copies. Anyone has some thoughts on how to tackle this? I’m not a fan of using Extended Retention on the Primary Copy as and set Weekly and Monthly retention on one media/point of failure. 

6
Sean Crifasi
Vaulter
2 years ago
B
Byte
Baba ImaniByte
asked in Storage and Deduplication

Creating a Storage Policy Copy with Deduplication vs Creating a Deduplication Enabled Storage Policy Copy

Hi guys,This might seem stupid but I’m a bit confused by these two documents on the Commvault website that talk about deduplicating policy copies. If I’m getting the below articles correctly, the difference between; Creating a Storage Policy Copy with Deduplication https://documentation.commvault.com/commvault/v11/article?p=12446.htmand Creating a Deduplication Enabled Policy Copy https://documentation.commvault.com/commvault/v11/article?p=14132.htmis that the former is created using a Storage Pool (dedup engine exists) whilst for the latter the Deduplication location is not an existing dedup engine (storage pool) but just a local folder on the media agent? If the latter is correct and I want to use it to deduplicate additional independent copies e.g. Weekly Fulls and Monthly Fulls on independent libraries against the Primary Copy data, is there a  downside to it?Need some assistance on this. 

3
B
Byte
2 years ago
E
Byte
elizabetaByte
asked in Storage and Deduplication

How to move data from LTO4 (from one Tape library) to LTO7 on another Tape library?

Hello,I have old Tape library TS3200 with LTO4 tapes and new Tape library HPE with LTO7 tapes. I would like to copy data from LTO4 to LTO7 tapes.I worked according documentation Media Refresh (commvault.com) .I have Enabled Media Refresh on Storage policy copy, media for Refresh I have marked Full, and Pick for Refresh. I have run Media Refresh job and choose tab Start new media…No, I have error “There are not enough drives in the drive pool. This could be due to drive limit set on master pool if this failure is for magnetic library.”I don’t know where the problem is?Is there anything else to do for Media refresh operation?Best regards,Elizabeta 

27
Mike Struening
Vaulter
3 years ago
K
Bit
KennethLeungBit
asked in Storage and Deduplication

Sudden low throughput & high DDB Lookup (~99%) for all backup job

We suddenly encountered low throughput & high DDB Lookup (~99%) for all backup job.We have remove a obsolete Media Server this week.  We also deleted some Storage Policy & Aux copy with no sub-client associated with.  I would like to ask if anyone encountered similar situation?  is our DeDup database corrupted?  Please help.  Many thanks

1
Edd Rimmer
Vaulter
3 years ago
R
Bit
RolandasBit
asked in Storage and Deduplication

Object storage vs File storage (S3 vs NFS)

Hi all, we are looking into our backup strategy and investigating few scenarios of backend storage. Right now we are considering object storage via S3 protocol and file storage (JBOD) over NFS protocol. The data which will be send there is on-prem filesystems, databases, VM’s etc. Total capacity - over 10 PB.Currently we tested some object storage over S3 protocol but we faced issues with data reclamation (garbage collection for expired objects taking way too long and capacity reclaimed wait time takes over month or few). Can you share your experience with back-end storage, what challenges you faced or how you solved my mentioned issues, also, what advantages you see comparing S3 & NFS protocols for backups. All feedback is very appreciated.Thanks! 

4
Mike Struening
Vaulter
3 years ago
G
Byte
gary mcneelyByte
asked in Storage and Deduplication

Aux copy job shows running after operational window

Aux copy job shows running after operational window.The aux copy job stops running at 7am due to blackout window then Automatically resumes and the job is killed by the System ( reason the job has exceeded the total running time.)The answer I am looking for is does it pass traffic after the blackout window is in place  

1
C
Vaulter
3 years ago
L
Byte
Lubos Dvorak
asked in Storage and Deduplication

Microsoft OneDrive Cloud Storage

Hi All,I have an issue when adding a OneDrive cloud storage.I am configuring via CommCell Console. If I enter Application ID, Tenant ID and Shared Secret and then click the Detect button I receive an error “ ### EvMMConfigMgr::onMsgCloudOperation() - Failed to check cloud server status, error = [[Cloud] The requested URI does not represent any resource on the server.  Message: Invalid hostname for this tenancy ”Commvault support answer is “The cloud vendor should be able to help you with the right URL. This is outside Commvault unfortunately ”.Does anybody have any experience using Microsoft OneDrive as a cloud storage?Thank you,Lubos 

13
Mike Struening
Vaulter
3 years ago
G
Byte
gibby101Byte
asked in Storage and Deduplication

question about setting up exchange db client to backup all passive DBs.

We have four Exchange servers. Each DB has a passive and active copy with them being on different servers. We installed the media agent and a backup disk on the exchange db server. Usually i know what DBs are passive on each server so i setup a subclient on each one so the back up will run from the passive disk directly over the SAN to the backup disk without using the network. However sometime exchange admins will do patching late at night and the DBs will failover and they wont fail them back til later. when this happens the db backups are much slower. I want to avoid this by configuring each subclient to only backup the passive DBs that are on the same server as the media agent/backup disk. my goal is to never run backups over the network even when DBs are failed over to other servers. is this possible? 

6
Mike Struening
Vaulter
3 years ago
T
Byte
TP_EricksonByte
asked in Storage and Deduplication

No Index Backup in last 30 days

So the ticketing service is kind of being slow with this process, and i want to know if I can do this on my own. We have an alert for No Index Backup in the last 30 days. I don't know why they are not storing the index information on the media agents but storing the index data to tape. How do i get a client that is on this list for no index backup to get the index to backup to the media agent so i can get rid of this list?

1
Damian Andre
Vaulter
3 years ago

Badge winners

Show all badges
Terms & ConditionsCookie settings