Backup media library high availability using Commvault and GCP multi-region GCP storage buckets

  • 5 August 2022
  • 2 replies
  • 186 views

Userlevel 2
Badge +3

As a part of the architecting media library for GCP cloud to ensure redundancy, availability across regions, low latency, and cost optimization have selected GCP cloud storage multi region nearline buckets.

Considerations:

  1. In GCP there are 4 types of storage class and differentiated in terms of cost of storage, location, retrieval, and operations, you can choose best as per your requirement for retention data.
  1. For high availability of storage, GCP provides multi-regional buckets in which objects are geo-redundant stored redundantly in at least two separate geographic places separated by at least 100 miles. As multiregional storage is geo redundant no need to setup secondary copy for high availability purpose this will also save the storage cost. This also enables you to share same storage to media agents in another region to restore data from same buckets if required.

Configuring GCS bucket:

In order to secure data, we have restricted public access and configured permissions which restrict access to the bucket. In addition, we have also removed bucket delete permissions from IAM roles to avoid data deletion.

 

Sharing GCS buckets to media agents:

1. To share GCS buckets to media agents which belong to different zones/regions to provide high availability of cloud media library and able to access across zones and regions.

2. Below screen shot captures configuration for multi-regional GCS buckets (example-bucket-bkt6) to access between different media agents using GCP storage API’s.

 

Media Agent belongs to different zone/regions :

Cloud Storage bucket configuration — media agent (agent001):

References and links:

https://cloud.google.com/storage/docs/storage-classes

https://documentation.commvault.com/11.25/essential/117105_cloud_storage.html

https://documentation.commvault.com/11.25/expert/9110_configuring_cloud_network_storage_pool.html


2 replies

Userlevel 7
Badge +23

Nice!  How’s it working out so far?

Userlevel 2
Badge +3

Hello Mike,

In GCP different type of storage class buckets are available in which we have used multi-regional buckets .

also we have region and zone specific media agents. so multi-regional buckets can be accessible using storage.googleapis.com by putting necessary access information.

To configure and access media agents as well as clients in CommServe you will require network access across the zone/region. other side if you have setup in different zone/region within same project, It can be achieve using VPC peering across the zone/region which is GCP function for free as far as I know.

same setup will help you to restore backup from one zone to other zone/region without copying data to other zone/region as buckets are multi-regional.

 

Reply