Solved

Migrate Cloudlib from AWS to Azure

  • 25 November 2021
  • 1 reply
  • 93 views

Badge

Hi Community -

 

We have a circa 2PB Cloudlin currently writing to AWS S3.  Our customer is asking if we can migrate this data into Azure.

 

Has anyone out had experience of the best way to accomplish this - I am thinking doing this using AUX copies is going to take rather a long time to copy 2 PB!!

icon

Best answer by jgeorges 26 November 2021, 00:36

View original

1 reply

Userlevel 5
Badge +9

Hey @MarkRelf-DB 

 

Unfortunately it does not seem possible to move S3 Storage class to Azure Storage class.
Leveraging Auxiliary copy will be lengthy, however the biggest benefit will be ensuring data integrity during the move.

 

To limit data travelling over the network and reduce egress costs, I would recommend setting up a Cloud MA on the AWS side to perform reads from AWS Storage, and host a DDB for the Azure Storage. This way DDB Signature look ups can occur locally. You’d also want to migrate (if not already) the DDB assocaited with the AWS library and ensure the disk hosting these DDBs is capable of the required IOPs. 
This will help ensure as little data as neccessary is being moved across the network, again, keeping costs down but also helping improve throughput and migration times.

This MA would be temporary and removed on completion of the migration after the Azure DDB is migrated back to your on-prem MA (the AWS DDB can be deleted along with the storage once all data is migrated accordingly).

 

Cheers
Jase

Reply