Replicate volumes asynchronously

This page shows you how to set up and perform asynchronous replication of Google Distributed Cloud (GDC) air-gapped block storage volumes.

Asynchronous replication is used to replicate data from one GDC zone to another. This replicated data can be used in a failover scenario in case the data in the source zone is unavailable. Note that once a failover has been created, the original volume can't be set up to replicate to the same destination volume. Instead, a new replication relationship must be created.

Before you begin

In order to use asynchronous block replication, your Infrastructure Operator (IO) must first set up the storage infrastructure between the two zones in which replication is required. Specifically, they first need to peer the relevant storage clusters from each zone. Next, they need to peer the storage virtual machine associated with the organization in which the block storage is provisioned.

After, ensure you have the volume-replication-admin-global role to administer the VolumeReplicationRelationship resource. In cases where the global API is unavailable, the app-volume-replication-admin role can be used to directly modify the zonal VolumeReplicationRelationshipReplica resource.

Set up replication

The VolumeReplicationRelationship Custom Resource (CR) services the asynchronous block replication API. This CR exists in the global management API. In order to enable replication for a given block device, a VolumeReplicationRelationship CR needs to be created on the global management API:

apiVersion: storage.global.gdc.goog/v1 kind: VolumeReplicationRelationship metadata:  name: my-pvc-repl  namespace: my-project spec:  source:  pvc:  clusterRef: my-pvc-cluster  pvcRef: my-block-pvc  zoneRef: xx-xxxx-zone1  destination:  pvc:  clusterRef: my-pvc-cluster  zoneRef: xx-xxxx-zone2 

This example assumes that a project named my-project is created in an org named my-org and that a PVC named my-block-pvc has already been provisioned. The clusterRef is the name of the cluster on which the PVC exists.

The source and destination fields of the specification indicate where the data is being replicated from and to respectively. In this example, the data is replicated from xx-xxxx-zone1 to xx-xxxx-zone2.

Check the status of the replication relationship by retrieving the VolumeReplicationRelationship CR from the global API. Reference the following example. Note that the output has been truncated for simplification:

apiVersion: storage.global.gdc.goog/v1 kind: VolumeReplicationRelationship metadata:  name: my-pvc-repl  namespace: my-project spec:  destination:  pvc:  clusterRef: my-pvc-cluster  zoneRef: xx-xxxx-zone2  source:  pvc:  clusterRef: my-pvc-cluster  pvcRef: my-block-pvc  zoneRef: xx-xxxx-zone1 status:  zones:  - name: xx-xxxx-zone1  replicaStatus:  message: SnapMirror relationship has been established. Please check the destination  zone for relationship state  replicationID: a096621e-f062-11ef-ad24-00a0b89f23fb  state: Established  - name: xx-xxxx-zone2  replicaStatus:  exportedSnapshotName: snapmirror.c34f8845-e8c0-11ef-ad24-00a0b89f23fb_2150007868.2025-02-21_150000  message: SnapMirror relationship has been successfully established  replicationID: a096621e-f062-11ef-ad24-00a0b89f23fb  state: Idle 

Create failover

In case the source zone is unavailable for any reason, a VolumeFailover CR can be created in the organization's management plane of the destination zone. For a v2 organization, this would be the management API server. For a v1 organization, this would be the organization admin cluster. For example, if a VolumeReplicationRelationship was created which specifies xx-xxxx-zone2 as the destination zone and PVC exists in the my-org organization, then the VolumeFailover CR is created in the my-org management plane in xx-xxxx-zone2. This breaks the replication relationship between the two zones, and allows the PVC in the destination zone to be mounted by a workload:

apiVersion: storage.gdc.goog/v1 kind: VolumeFailover metadata:  name: my-pvc-failover  namespace: my-project spec:  volumeReplicationRelationshipRef: my-pvc-repl 

After, a successful failover is reflected in the status of the CR:

apiVersion: storage.gdc.goog/v1 kind: VolumeFailover metadata:  name: my-pvc-failover  namespace: my-project spec:  volumeReplicationRelationshipRef: my-pvc-repl status:  state: Completed 

After the failover is created, the my-pvc-repl VolumeReplicationRelationship transitions to a Broken Off state. The PVC in xx-xxxx-zone2 is now mountable.

At this point, the VolumeReplicationRelationship will look similar to the following example. Again, this output has been truncated for simplification:

apiVersion: storage.global.gdc.goog/v1 kind: VolumeReplicationRelationship metadata:  name: my-pvc-repl  namespace: my-project spec:  destination:  pvc:  clusterRef: my-pvc-cluster  zoneRef: xx-xxxx-zone2  source:  pvc:  clusterRef: my-pvc-cluster  pvcRef: my-block-pvc  zoneRef: xx-xxxx-zone1 status:  zones:  - name: xx-xxxx-zone1  replicaStatus:  message: SnapMirror relationship has been broken off  replicationID: a096621e-f062-11ef-ad24-00a0b89f23fb  state: Broken Off  - name: xx-xxxx-zone2  replicaStatus:  exportedSnapshotName: snapmirror.c34f8845-e8c0-11ef-ad24-00a0b89f23fb_2150007868.2025-02-21_150000  message: SnapMirror relationship has been broken off  replicationID: a096621e-f062-11ef-ad24-00a0b89f23fb  state: Broken Off 

Now, it's safe to delete the VolumeReplicationRelationship as it's the only action remaining that can be done on this CR.

Resize volumes

If at any point the source volume is resized, the corresponding volume in the destination zone, which is created on behalf of the user when a VolumeReplicatioRelationship is created, should also be resized to match.