cloud-slashOffline Restoration - Non Autoscaling

Locally convert Datafy snapshots to a regular non-autoscaling volume

New volumes that are created directly from a Datafy snapshot cannot be read without Datafy AutoScaler installed. If you wish to access the data on these volumes when AutoScaler cannot be installed, you can use the Datafy restoration tool to migrate the data to a new, full sized volume (similarly to when autoscaling is deactivated by AutoScaler). After this, the resulting volume can be used as-is for any purpose.

The tool does not require any permissions on your AWS account, and only performs local copy operations.

circle-exclamation

Offline Restoration of Datafy Snapshots

Before you get started, make sure you meet the following conditions:

  1. Access to snapshots in the AWS console

  2. SSH access and root/sudo permissions on a Linux instance where the volumes will be attached

1

Create new volumes from snapshots

  • For a given source volume ID and desired timeframe, find all of the snapshots that have a matching datafy:source-volume:id tag and timestamp. All the snapshots should have the same datafy:snapshot:id tag, and all of snapshots with this tag should be used.

  • Create new volumes from these snapshots through AWS, and attach them to the desired instance.

2

Set up restoration tool

Download and run the restoration tool, on the instance the volumes are attached to. The downloader automatically retrieves the latest version that matches the instance type and architecture.

curl -sSfL https://artifacts.datafy.io/restore_tool | sh

To install a specific version, use

 curl -sSfL https://artifacts.datafy.io/restore_tool | sh -s -- --version <version>
3

Create a new full-sized volume

  1. Create a new volume, with a size equal to the original size of the snapshots' source volume (the size of the filesystem). You can find this original size in several ways:

    • If the original volume still exists:

      • If it is autoscaling, you can view its size in the Datafy dashboard or check the size of its filesystem.

      • If it is not autoscaling, you can check its size in the AWS console as well

    • Save the size returned when creating snapshots

    • Use the restoration tool to check the required size, with:

      sudo ./run_restore_tool.sh \
        --restoration_source_volume_ids vol-source456 vol-source789 \
        --get_size

      The required size will be printed to the console, for example:

      ✅ Required destination volume size: 100.00 GB
         Exact size in bytes: 107,374,182,400
         Chunk count: 3,276,800
         Chunk size: 32.00 KB
         RAID stripe size: 1.00 MB
  2. Attach the new volume to your instance

4

Complete restoration

  • Run the restoration tool, providing the IDs of the restored and new volumes. You can identify the volumes using their IDs (preferred) or their device names

sudo ./run_restore_tool.sh \
  --new_vol_id vol-destination123 \
  --restoration_source_volume_ids vol-source456 vol-source789
  • Monitor the progress of you restoration in the console output

  • After the restoration is complete, mount the full-sized volume, and delete the volumes created from the snapshots

Last updated

Was this helpful?