Skip to main content
commvault.com commvault.com

Storage and Deduplication

Discuss any topic related to storage or deduplication best practices

  • 1,128 Topics
  • 4,835 Replies
1128 Topics
N
Bit
NG_PawelBit
asked in Storage and Deduplication
Front end data report

Hello, I need your help ;-) i was asked to prepare tabled report showing Front End data stored in local library (NetApp). I already explained the difference in logical and physical use, but my management still wants to see the list of everything that will sum-up to 297 TB. I tried the chargeback report but it's showing me data from Jun last year. Does anyone know how can I achieve this goal?

4405
Mike Struening
Vaulter
V
Byte
VBalazsByte
asked in Storage and Deduplication
When start using drilling holes?

I have a productive commcell, where all mount path supports drilling of holes (Sparse). When I open a mount path property in Windows, I can see "Size on disk" is much more smaller than the "Size" of the folder. The whole partition smaller than the "Size" of the folder, but of course, larged than "Size on disk".I installed a test environment, where all mount path also supports drilling of holes (Sparse). Scheduled or manual backups are succeed and stored on mount paths. But when I open a mount path property in Windows on test MA, then I can see the "Size" and the "Size on disk" are the same. Or "Size on disk" is a bit larger. If I check a file with "fsutil sparse queryflag", then I get the response: "This file is NOT set as sparse"My question is, when backend file sizes start to decrease? When will be sparse set on backup files, what stored on a sparse supported mounth path?

7043
V
Byte
E
Bit
ErezBit
asked in Storage and Deduplication
export media based on job available

Hey, There is a way to export media to the mail slot after the aux copy is done? so there is no more “copy to” or “partially copy” only “available”

996
E
Bit
V
Byte
VBalazsByte
posted in Storage and Deduplication
Disk library and physical Media Agent change as disaster recovery.

Hi all! My company, using six MA to create and store backups. One MA with a separated storage for long term retention outside, and an another one for create local backups on a branch office site. On the main site there are four MA in two node grids. MA1 & MA2 is a grid and MA3 & MA4 is an another. They are sharing their libraries and DDBs.From the branch office, local backups are copied to the main site and main backups are copied to long term site as DR backups. MAs are physical on main site and virtual on others, and disk storages are used on all sites. Currently, we are planing to change our disk storages and physical MAs on main site. And of course, it is a good chance to upgrade OS on MAs from Win2012R2 to Win2019. During the process, library content should be moved from the old disk storage to the new one, and DDBs from old MA to new. One MA stores 40 - 60 TB backup data, and of course, I would like to do it with minimum downtime. I have found descriptions about library move and

8388
V
Byte
I
Byte
IggyByte
asked in Storage and Deduplication
Disk Pruning Not Running on DDB

Hi All. I have a DDB on a Linux Media Agent running in Azure. The “CommServe Job Records to be Deleted” is very high and reporting as Critical in the Command Center Health Report. I have confirmed that the Storage Policies associated to this DDB is enabled for Data Aging. Physial pruning is also enabled on the DDB. When running Data Aging to this specific DDB/Copy there is no entry in the MediaManagerPrune log on the CommServe for this DDB ID. All the other DDBs are listed. There is also no SIDBPhysicalDeletes log file on the MA. I have checked the jobs and no jobs are retained past the retention period. Any idea what would cause the records to remain on this DDB? Let me know if you require any additional information that could assist. Thank you. Ignes

23477
Mike Struening
Vaulter
M
Byte
Muhammad AbdullahByte
asked in Storage and Deduplication
DDB QI time threshold.

Hello I have an issue related to DDB as shown below the q&i time is very high, known that the media agent is serving Oracle and SAP dbs only with daily full backup around 23 oracle rac and 18 sap client. library is from flash storage. DDB Disks is ssd and moved to pure storage [ NVMe disks] due to insufficient space on local disks any idea how to maintain this ?

216218
Onno van den Berg
Commvault Certified Expert
J
Byte
jps666Byte
asked in Storage and Deduplication
tape data verification problem

Hi team. I have a question about data verification on sec tape copy: How to exclude a specific tape from the data verification process ? Or how to address problems as below: My setup is simple - primary copy on disk lib and secondary copy to LTO. Both copies are verified. From time to time I see a tape that generates a lot of CRC errors during data verification. The verification process takes a long time blocking tape drive and is either completed or sometimes stuck. After that, dozens of jobs on the tape have the partial verification status. Next scheduled verification process repeated with the same results.What surprises me even if the tape exceeds the threshold of w/r errors and has the condition status of “bad” - it is still subject to verification. Why such verification should not finish for some jobs as failed and that’s it. I have such a nasty tape quite often and then a lot of problems. Manually checking and excluding from verification dozens of jobs on tape is practically impo

3311
Mike Struening
Vaulter
M
Byte
MubaraqByte
asked in Storage and Deduplication
Storage Policy not changing for subclient

Hello, Team So I am trying to change storage policy for an oracle subclient. The storage policy changes but when the job runs, it goes back to the old storage policy. Kindly advise. This is urgent!!

13267
Mike Struening
Vaulter
A
Adel BOUKHATEM
asked in Storage and Deduplication
Object Storage library block size

Hi Guys, I would like to know whether there are recommendations on the block size of the cloud library? We have a Cloud Storage in our data center, and we would like to use it for backup. On the storage, we have the ability to choose the block size. Do we need to specify the block size or keep it default (32 KB). Note: On disk library, we are used to formatting our local drive to 64 kb, however we didn’t find anything for cloud libraries. Thanks in advance. Best Regards

14968
M
Bit
E
Bit
Elijah MussBit
asked in Storage and Deduplication
DDB Media agent role on SunOS Media agent

I have a media agent installed on sparc with SunOS 5.11 operating system on it, and it does not have DDB MediaAgent role assigned, thus i cannot create local deduplication database partition. Is there a way to assign a DDB MediaAgent role to this media agent?

775
E
Bit
R
Byte
RobAbateByte
asked in Storage and Deduplication
Command Center - Adding Tape Library doesn't allow for other scratch pools? Barcode patterns?

Someone on my team wanted to try to add a new Tape Library to the environment using Command Center. I had never done this in Command Center before, so I watched the user go through the steps. We found that it had created the library and the storage pools. But we could not find any way to create barcode patterns or to create another scratch pool from the Command Center. We are an MSP and this is an essential step in being able to use the library. We then tried to create the barcode patterns and other scratch pools from the CommCell Console. We created the entities but then found we could not associate it to the pool/plan. It appears that the option to change the scratch pool is greyed out in this case. Is it expected that you cannot edit the scratch pool when the library/storage policy/plan is created from the Command Center? Or are we missing something here? Furthermore I was expecting a much more user-friendly approach to adding tape to the environment. For example, the user had to st

1484
Mike Struening
Vaulter
S
Bit
SmartoddBit
asked in Storage and Deduplication
Use tapes from another Commcell

I have LTO 7 tapes from another Commcell that I’d like to format and use in our new Commcell. Is it possible to Format / erase these tapes and import them into the new Commcell?

1551
Mike Struening
Vaulter
Onno van den Berg
Commvault Certified Expert
Onno van den BergCommvault Certified Expert
asked in Storage and Deduplication
Size on disk value related to cloud libraries is incorrect

While trying to figure out how to gather BET for charging purposes I noticed that the size on disk as displayed both in Command Center and CommCell console for cloud libraries to be incorrect. I have opened a ticket for it and in particular referred to S3 buckets, but I was wondering it other customers see the same and if it also occurs on libraries using Microsoft Azure Storage or other types/vendors. Please comment in case you see identify the same. I noticed it while running FR26 and FR28 (2022e).

52811
Onno van den Berg
Commvault Certified Expert
D
Byte
drPhilByte
asked in Storage and Deduplication
Cloud storage adding and troubleshooting

Hi there, I am trying to add a new cloud storage (S3 compatible), however I am unable to do so. Moreover, I don’t see any asociated log files. I only see this error message: “Failed to verify the device from MediaAgent [xxxxxx] with the error [Failed to check cloud server status, error = [[Cloud] The server failed to do the verification. Error = 44037]]. “ My question is: Which logs should I add to Logging setting? And how to troubleshoot this stuff in general? PS. As workaround I used this - https://documentation.commvault.com/commvault/v11/article?p=51230.htm but it didn’t help. Thanks for any ideas

99525
Mike Struening
Vaulter
N
Byte
naraharshaByte
asked in Storage and Deduplication
Which library holds pending delete records

Hi Team, When we have multiple libraries associated with a GDP, then how can we identify which library is holding the ‘pending delete records’ and ‘Data size to be freed’. Thanks, Harshavardhan.

4044
Mike Struening
Vaulter
G
Bit
gnussbaumBit
asked in Storage and Deduplication
Can't lower reserve space in Commcell console

Hi, I came into work and noticed dozens of jobs in a waiting state due to the mount path not having enough free space. I am aware that we need to add more storage and we are going to, but in the interim I tried lowering the reserve space from 6TB to 2TB.so that the jobs can finish, and I also see what can be cleared. It’s not letting me change it. It will only go to 5960 GB. I currently have a ticket in with CV. 221017-401. Is there a way to fix this?

1501
Mike Struening
Vaulter
C
Byte
CVbackupByte
asked in Storage and Deduplication
DDB Network interface

I am creating a partitioned DDB with two media agents. What interface of the media agent should i Add? I have dedicated NIC available.Do in need ta add the IP-address of the media agent? What happens if i leave it to default? I have implemented this in the past but I cannot remember this part.

2572
C
Byte
V
Bit
vtulerBit
asked in Storage and Deduplication
Errors CloudTestTool OCI object storage

Hello all, I’m trying to configure my OCI into Commvault to test this tool (I’m using trial licence) but I’m dealing with some errors as shown bellow: What certificate is this? How can I install it? And where? Then, I use the CloudTestTool and it shows this: Look at the log file: 4228 2274 10/12 12:54:02 ### GetTenancy() failed. Error: Message: The required information to complete authentication was not provided or was incorrect.4228 2274 10/12 12:54:02 ### Failed to get the namespace. Error: Message: The required information to complete authentication was not provided or was incorrect.4228 2274 10/12 12:54:02 ### CheckServerStatus() - Error: Message: The required information to complete authentication was not provided or was incorrect.4228 2274 10/12 12:54:02 ### EvMMConfigMgr::onMsgConfigStorageLibrary() - CVMACMediaConfig::AutoConfigLibrary returns error creating Library [Failed to verify the device from MediaAgent [dphwinbkpprd] with the error [Failed to check cloud server status,

3431
Mike Struening
Vaulter
Ken_H
Byte
Ken_HByte
asked in Storage and Deduplication
DDB increase in (CommServe Job Records to be Deleted)

I’m getting the following alert email roughly once an hour: > Anomaly Notification > The system detected an unusual drop in the pruning performance for the following databases in commcell <CommServer_Host> > Deduplication Database Reason > HyperScale_Primary inrease in (CommServe Job Records to be Deleted) > CV Cloud Storage increase in (CommServe Job Records to be Deleted) > Please click here for more details. When I follow the “click here” link, I see: > 1 CommServe Job Records to be Deleted This has been going on for a couple of weeks. I don’t think an annoying email is a big enough deal to open a ticket for but I’d still like to clean this up. Does anyone know what the problem is and how to fix it? I’m sorry to say the CommVault help pages for this are not very useful. Ken

109314
Ken_H
Byte
Torsten
Torsten
asked in Storage and Deduplication
How to Reduce Random Read Load on NL-SAS Storage Arrays?

Hello, We are seeing a very large random read load on our Hitachi G350 backup storages with NL-SAS disks. These random reads are completely consuming our backup storage performance. We have two G350s on campus and a third at a remote site. Commvault runs copy jobs between these three G350s. DDB is on NVMe locally in the Media Agent, also the Index Cache Disk. We ran several analyses and Live Optics showed us that the daily change rate is 334.9%, which is mainly due to the Windows File System policy, for which we see 2485.1% daily change rate. Does anyone know how the random read load could be reduced since our disk backup is otherwise unusable. What steps could we take to optimize the Commvault configuration? Screenshot: Thanks for your help!

2598
C
Vaulter
M
Byte
MubaraqByte
asked in Storage and Deduplication
Failed to mount media drive

Hello, Team I am getting the error below on majority of jobs running. I have checked the storage end and also the media agents (The LUNS are attached to the Media Agent) Everything looks good. What could be the cause of the error. Failed to mount the disk media in library [ARCHIVE_DISKPROD] with mount path [B:\Archive_DiskLibrary\MP10] on MediaAgent [hq_media_svr3]. Operation could not be completed in timeout interval. Please check the following: 1. Library and drive is functioning correctly. 2. Library and Drive management services are running. 3. All other MediaAgent services are running. 4. The time out period on the Expert Storage Configuration Properties Window in the CommCell Console. 5. Cleaning media in Assigned Media Group. Source: hq-vm-commserv, Process: MediaManager

42797
G
Byte
J
Byte
jparaujoByte
asked in Storage and Deduplication
Can I have two aux copies to the same tape library?

We have a tape library with two drives, Is it possible to have two secondary copies aimed to this same tape library and to start two auxiliary copies at the same time? My desired goal is to have at final two tapes with the same data so way to keep one of them on another safe offsite location.

881
Jos Meijer
Commvault Certified Expert
K
Vaulter
KyungKee KimVaulter
asked in Storage and Deduplication
WORM on VTL

Hello Expers, Recently, customers want to apply WORM function to VTL storage in order to respond to ransomware issue. I searched BOL and the Commvault community, but I could not find a guide on how to configure and operate in detail except for WORM media configuration. https://documentation.commvault.com/2022e/expert/10496_worm_media_configuration.html I hope I get detailed guide information for implementing WORM function in VTL or Tape Library. For example, once the WORM media is fully used, It is moved automatically to the Retired Media pool. https://documentation.commvault.com/2022e/expert/10493_worm_media.html And then is this media reusable? If possible, through what procedure can it be reused? Regards Kim KK

2715
Onno van den Berg
Commvault Certified Expert
S
Byte
Steve PByte
asked in Storage and Deduplication
Unusual performance drop detected in pruning

Hey good people at CV! We are getting hourly “Unusual performance drop detected in pruning” event viewer events. I have noticed there was a hotfix here: https://kb.commvault.com/article/77146 , however it seems that 11.28.10 is the currently installed version. At first glance and after reading a few threads here concerning the same issue before posting a repeat topic, I figured it might work itself out. Is there anything else that can be done? Just trying to be proactive. Here is the message to follow, and there seems to be a single Job Record to be Deleted when viewing the DDB Pruning Performance Anomaly Report. Unusual performance drop detected in pruning for following deduplication databases due to increase in (CommServe Job Records to be Deleted) Thanks in advance!

6674
S
Byte
T
Byte
thomas.SByte
asked in Storage and Deduplication
Moving long-term backups to another library

Hello all, is there a possibility to move the saved data from one library to another ?We have two full backups on which we have set the retention until next year. The rest of the backups continue with the normal retention of 30 days and 4 cycles. However, I would like to move the backups that need to be retained until next year to our object storage. I have already prepared the connection to the object storage. I just need to know how to move the data. Kind RegardsThomas

3252
T
Byte
description of image

Popular tags

Badge winners

  • Topic Starter 50
    Dennishas earned the badge Topic Starter 50
  • Contributor 25
    Dheeraj Shettyhas earned the badge Contributor 25
  • Contributor 10
    Sougato Royhas earned the badge Contributor 10
  • Contributor 1
    jc4570has earned the badge Contributor 1
  • Solver 1
    Putrahas earned the badge Solver 1
Show all badges
Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings