Backup file with Kopia and Rclone to Storj

Because of Storj lack of support MOVE, check it out here:

Step 1 Setup personal S3 compatible bucket on Storj

Therefore, for the best compatibility, I configured bucket with my own custom passphrase with S3 compatible Access Key with the same custom passphrase.

Step 2, Setup Rclone with S3 compatible target and mount it.

rclone mount --vfs-cache-mode writes storj-s3:jp4 /mnt/storj-s3 --daemon --allow-non-empty

Step 3, Setup kopia backup file to local file system

# Setup kopia backup on your local machine
kopia repository create filesystem --path /root/tmp-backup-server/

Enter password to create new repository:
Re-enter password for verification:
Initializing repository with:
  block hash:          BLAKE2B-256-128
  encryption:          AES256-GCM-HMAC-SHA256
  splitter:            DYNAMIC-4M-BUZHASH
Connected to repository.

# Connect to kopia repo
kopia repository connect filesystem --path /root/tmp-backup-server/

Check Kopia current status

kopia repository status
Config file:         /root/.config/kopia/repository.config
Description:         Repository in Filesystem: /root/tmp-backup-server/
Hostname:            jp4
Username:            root
Read-only:           false

Storage type:        filesystem
Storage config:      {
                       "path": "/root/tmp-backup-server/",
                       "dirShards": null,
                       "fileMode": 384,
                       "dirMode": 448

Unique ID:           00a89dc324c4de4fxxxxxx7f9fdf3eaaf98dd3c
Hash:                BLAKE2B-256-128
Encryption:          AES256-GCM-HMAC-SHA256
Splitter:            DYNAMIC-4M-BUZHASH
Format version:      1
Max pack length:     20 MiB

Create Kopia snapshot and sync Rclone to Storj


kopia snapshot create /data/wwwroot
rclone sync /root/tmp-backup-server/ storj-s3:jp4/kopia -v -c

Grep repository with Unique ID and mount

mkdir /tmp/mnt

## Grep snapshot ID and mount
kopia mount $(kopia snapshot list | tail -1 |awk '{print $4}') /tmp/mnt &

# Cd into directory
cd /tmp/mnt

Kopia delete snapshot

## List all snapshot
kopia snapshot list -m

>[email protected]:/data/wwwroot
  2021-08-24 18:42:59 CST kad87db458ecf6656eb17fc40053a51ae 10 GB drwxr-xr-x manifest:63465ec8b4c11ef89e09d211ce2ea1e2 files:195320 dirs:26901 (latest-1,annual-1,monthly-1,weekly-1,daily-1,hourly-1)

## Delete snapshot 
kopia snapshot delete kad87db458ecf6656eb17fc40053a51ae --delete

## One key delete
kopia snapshot delete $(kopia snapshot list -m | awk '{print $4}') --delete
kopia maintenance run --full --safety=none

Kopia .kopiaignore

Put it on your root directory