DDB and disk library limits

Question

Hi!

Some time ago we set up Commcell dedicated to Hadoop environment. One media agent, one DDB (two partitions, hosted on local SSDs), deduplication block size increased to 512KB, disk library from few external SAN attached storage arrays.

And it keep growing :) Few incremental jobs a day, writing ~10TB, synthetic full each 10 days. Without any performance issues so far. DDB Q&I ~ 500ns. Both backup and restore time acceptable. It’s kind of archive, not typical backup solution.

Last month I was asked to disable retention, because ongoing migration activities. And it keep growing faster. I assume until 2PB on disk library by the end of year.

So wondering when I’d hit the ceiling for this setup? I know it breaks media agent and deduplication sizing, but until Q&I time are fine everything is acceptable? Or i would hit other limit? It need to survive until end of this year! :)

Some numbers below :

Thanks!

icon

Best answer by Mike Struening RETIRED 22 April 2022, 15:30

View original

Mike Struening RETIRED · Accepted Answer

Query and Insert time (Q&I to those following along) is your best indicator of performance. As long as that’s low, you should be ok.

All the DDB is doing (when backups run) is checking if a block exists and either adding a Secondary reference, or creating a Primary record (aka querying and inserting).

As long as that stays low and you have plenty of space for the DDB and disk drive, you should be fine.

DDB and disk library limits

1 reply

Reply

Reply

Sign up

Login to the community

Scanning file for viruses.

This file cannot be downloaded