Storage and Deduplication

Good morning I have a customer that is backing up in car videos (local sheriff’s dept) and he is deduping this data.  We have created a new stand alone dedupe database for this data and are using a selective copy to copy weekly fulls to another target.  We have set up another stand alone dedupe database for this copy.  The customer is having issues getting this data copied over - it’s taking multiple days.  The full backup is about 40 TB in size.  We have recommended not using dedupe for this copy, but the customer does not have enough capacity for non-deduped copies.  Are there any optimizations that can be made to speed up this aux copy?  They currently have only 1 subclient backing up all the data - if they split this out, would that help in using multiple streams for the aux copy?  Any other suggestions? Thanks

Hi! Some time ago we set up Commcell dedicated to Hadoop environment. One media agent, one DDB (two partitions, hosted on local SSDs), deduplication block size increased to 512KB, disk library from few external SAN attached storage arrays. And it keep growing :) Few incremental jobs a day, writing ~10TB, synthetic full each 10 days. Without any performance issues so far. DDB Q&I ~ 500ns. Both backup and restore time acceptable. It’s kind of archive, not typical backup solution. Last month I was asked to disable retention, because ongoing migration activities. And it keep growing faster. I assume until 2PB on disk library by the end of year.  So wondering when I’d hit the ceiling for this setup? I know it breaks media agent and deduplication sizing, but until Q&I time are fine everything is acceptable? Or i would hit other limit? It need to survive until end of this year! :)  Some numbers below :

Hi,i have a question about DDB data verification on a Scality ring S3 cloud (on premise).We have around 800TB of stored data on S3.Today the ddb verification move on average 1000 TB every month (1.5X as the volume of data stored on S3 scality).We have set the DDB data verification option to “Quick Verification of Deduplication Database”it is possible to reduce the number of GET per month by changing the way DDB verification run?regards,  

Every time I send an auxiliary copy to tape, it tells me that the Chucks are not available for the operating system.  The end user put the MA installation path inside the drive where the backups are located, can this be the cause

Hi,Does anyone know what sense codes CVLT interprets to start a drive cleaning job?We suspect that CVLT is starting tape drive cleanup jobs under unexpected and undesired conditions.The option “Set drive as needs on CRC errors” is not checked. In two days we got one new cleaning universal tape that expired. There's another one on the way. A new cleaning tape has 50 cycles. We have a Qualstar model RLS-87120 LTO6 with 5 drives.  There is no automatic/schedule cleaning at the Library side. There is drive cleaning schedule on CVLT. We would greatly appreciate it if someone could contact the developers and find out this information.  

Hi, i have more tape mark FULL, but if I see the contents, tape have more data expired and only 3gb not expired!It’s correct that tape remains FULL until everything data has expired?I can work around the problem configuring Media refresh? if this is solution i see on my copy of storage policy and the flag on tag media “Enable media refresh” are greyed out!!Thanks

Hello all, I have an auxiliary copy with deduplication running to a Glacier and i would like to run a DDB Verification on it, just to see an estimate cost for future verifications.What i would like to know is how do i use the workflow Cloud Storage Archive Recall for every job id that is referenced in that DDB, since in the workflow window it makes me choose a backup job id. Kind regards,Jmiamaral 

Hi Guys, I hope everybody is fine !So I ran a health report on my Commserve and on the “DDB Performance and Status” section in the “readiness” column, it shows: Needs resync.When I try to resynchronize the DDBs from Storage Resources→ Deduplication Engines,  the “Synchronize All DDBs” is grayed out.The DDB status is showing active.Does it mean that as long as it is online I can’t run the synchronization, or I missed something? Thanks !

Hello Community, We have a VTL configured, which backups are saved to it, we want to decommission the VTL while preserving the data backed up.Is there any way to move/migrate the data saved in the VTL to a Disk Library ? And if so, is it possible to enable deduplication on the data migrated from the VTL to the Disk Library to save more space. Kind regards.

Hi, Please diagnose incomplete data transfer between mount points.At the turn of February and March, we migrated a dozen or so mount points between arrays.All tasks were successful. Old data was not deleted on one of the mount points.There is much more to the target mount point.View from the catalogs side.How can we confirm that the data has been migrated correctly?

Hello, we currently have a server where AD and File System backups are performed (Disk D: and Disk F:). The customer has asked us to copy to tape the F: Disk, how is it done, with an auxiliary copy? Thanks 😊

we are setting up AUX copy to MCSS cold storage for one of my customer and have used IN premise DDB to send dash copy to cloud Storage.I have confusion here.Support our In premise Site/Server goes down.Will i be able to recover my data from cloud after rebuilding CV server? because both in DDB were in local storage only.or Does it copies DDB to MCSS also? 

Hello Team,We are planning to configure two different NAS disk libraries with three media agent physical servers.Each media agent server is having dedicated two SSD drives and configuration of RAID1.We want to know each disk library will use seperate DDB or will use single DDB.DDB disk is only one in each media agent server.Thanks and Regards,Anand 

Hi everyone. Customer runs several tape libraries in their commcell domain.One of them is configured with LTO8 tape drive and LTO7 M8 tape media which is known for 9TB tape.Tape drives are well configured just by performing detection and it showed tapes in library with “OOOOOOL8”. (but it’s a M8 media, 9TB capacity)I tried some configuration for tape media - LTO7, LTO8, LTO7M8 … but the same result.It failed to mount the tape on a drive and it showed same error msg … (illegal request ...) Anyone who experienced this?

Dear All,Please I need help in resolving an issue with my commvault server. This is the error am getting;Error Code: [62:342] Description: Failed to mount media with barcode [A99801], side [A_780], into drive [IBM ULTRIUM-TD5_20], in library [STK L180 1] on MediaAgent [TMwas02]. SCSI Operation: Open Drive Device. Reason: Encountered an I/O error while performing the operation. Advice: Please use the following troubleshooting utilities 1.TapeTool for Tape device-related problems. 2.LibraryTool for Library-related problems provided in the MediaAgent's installation folder to perform diagnostics on this device. Source: backup, Process: MediaManagerPrior to this issue, the backup schedules run smoothly. I have noticed this error only comes up when I run back jobs on media agents ( I have eleven) in the commcell with exception of the commserv’s media agent.The status of the media library attached to these media agents shows “ready”An

Do you see these error for your jobs?When we updated from 11.20.32 to 11.20.60 we started getting Cache-Database errors on various backup types, FileSystem idata agent, NDMP backups and others.The exact error we get is:Error Code: [40:110]Description: Client-side deduplication enabled job found Cache-Database and Deduplication-Database are out of sync.I have a ticket open with support, but I am wondering if the issue is unique to us or if it is happening to other customers as well. Thank you,

Interestingly enough there are 2 conflicting theories regarding SQL and ORA transaction log deduplication and pruning question. There is one from CV support engineer:  “We discussed high Q&I times and any way to reduce the load on the DDB.We both acknowledged that SQL Transaction Logs are not deduplicated, however you were curious if the T-Log backups communicated in anyway to the DDB which may impose any, albeit minimal, load or processing on the DDB.I was able to confirm that SQL Transaction Log backups do not communicate with the Deduplication process and therefore will not have any effect on Q&I times: https://documentation.commvault.com/11.24/expert/12434_deduplication_support.html””…………………………...But but but, other CV engineer says if the storage policy used fo

DDB lookup times spiked, SSD are old SATA and under heavy load seem to be very slow. Is pruning only related to a data that is deduplicated? If ORA or SQL DB transaction logs being written to non deduplicated storage policy is pruning at all relevant to that data? How much DDB is being used during pruning? Is it very DDB intensive process?

Is there a command line or script to set just the Location property of a previously exported tape? The below Command did not work. ./qoperation media -o export -b 000298L6 -l RLS-0 -el "xxx - 05" -m xxx-ma-01 -v -tf /home/xxx/tokenfile.cvltRequest successful.[xxx@xxx-ma-01 Base]$ CommVault 11.24.12 

We have a Media agent MA1 (Physical Server) located at Site A with disk libarary still having jobs under retention till next one year. However, siteA is now decomissioned. We would like to rebuild MA1  and use storage at another site SiteB, but would like retain jobs which are still under retention.  Doing a backup job of CV_magnetic files to another disk library a good option What would be a best approach

Hi, I am facing error regarding connection to DeDuplication Database. It can be caused by many reason but my specific problem is that the directory with DDB is locked for write. This was confirmed by SIDBEngine.log and simply you cannot create folder in DDB folder.Status of DDB is ONLINE. I can freely read from it, I can freely travers through it, I can copy the folder to different place and here I can create files/folders inside without limit. There is no way to manage from CMV - it is not possible to backup, restore, seal, verify etc. I cannot move the partition. It seems as Windows/Hardware problem but….I checked windows logs - no events from disk, scsi etc.I checked filesystem - all looks fineI checked hardware events (it is HPE server, so iLO log, IML log, I checked smart array status)It seems that it is limited only to this DDB folder. On the same drive, same volume, different directory all working as usual. So there is no write protec

Hello, We have very bad performance for our backup environment.  Slow running DDB’s, high Q&I etc. We found out that we have 10 times lessor IOPS for our Media Agents .  What is the procedure to increase IOPS for the existing Media agents ?

Hello All, I'm working on getting government certification with Commvault 11.24.I have been asked to confirm the requirements for some entities in Commvault. - Confirmation request: 1) maximum character length, 2) Input ConstraintsRequirements max characters Input Constraints User User name 　 　 Password 　 　

Noticed FR26 delivered a cloud library configuration setting seen from within Command Center named "Cache configurations".Can someone enlighten me what it is and what it does? I can't find any information on the documentation site. 

We have been using Azure Storage accounts as offsite libraries for years.   We fully take advantage of cool storage tier, but with our usage history, I would like to start setting the Commvault Azure Libraries to archive storage tier.   What is the best way to get the blobs assigned to the archive tier?  I assume that only new written data will have archive and the rest will have COOL, until it is pruned.  Retention varies from 1 year to upwards of 10years.  Is there a native workflow available, or should I think about creating a new library and AUX copy the data into the new configuration.