Remote backup query #15
Description
Hi,
First of all this is great and unique project no doubt!
Thanks for this.
-
Implementation - some issues while installing due to some dependencies. I wanted to make/insert it in a bootable iso but had lots of issue doing so.
-
I have VM infra mostly kvm, vcenter etc. I wanted to use this tool for migration and backup but i had few set backs
a) Only for Linux and not for windows as i have 95% of windows -
In my infra i have a hypervisor or kvm server which have disk on lv's (lvm) now they are raw disk i tried to take backup of them and incremental backup too but what i found is taking incremental backup takes similar of max to max half of the time as full backup. Can u shade some light on it.
-
I want to do remote backup of linux system with incremental block sync. How can i effectively do that because i fear that when the first backup is completed and the copy is stored on the target when the next incremental happen it will read the remote full backup and it will take a lot of WAN bandwidth doing do might be even full backup size = wan bandwidth ? So what is the better method in case of SSH to remote or ISCSI to remote need to know both method because ssh for different country and iscsi for between AZ. Also this are raw disk we are talking abt unless used inside vm linux system (os).
Currentl using this config. for in network backup and restore but due to the incremental HALF time of full backup left it..
using this settings in my py program for taking backup and incrmeental backup..
BLOCK_SIZE = "16M"
BUFFER_SIZE = "128M"
print(f"Starting Initial copy (seed) of Disk {iscsi_device} ...")
blocksync_cmd = (
f"time blocksync-fast "
f'-s "{iscsi_device}" '
f'-d "{raw_file_path}" '
f'-f "{digest_file_path}" '
f"-b {BLOCK_SIZE} "
f"--buffer-size={BUFFER_SIZE} "
f"--algo XXH128 " # Fastest algorithm
f"--progress "
f"--sync-writes "
)
print("Generating delta diff...")
delta_cmd = (
f"time blocksync-fast "
f'-s "{iscsi_device}" '
f'-f "{digest_file_path}" '
f"--make-delta "
f'-D "{delta_file_path}" '
f"-b {BLOCK_SIZE} "
f"--buffer-size={BUFFER_SIZE} "
f"--algo XXH128 " # Fastest algorithm
f"--progress "
)
# Apply delta
print("Applying delta to the raw file...")
apply_delta_cmd = (
f"time blocksync-fast "
f'-d "{raw_file_path}" '
f"--apply-delta "
f'-D "{delta_file_path}" '
f"-b {BLOCK_SIZE} "
f"--buffer-size={BUFFER_SIZE} "
f"--algo XXH128 " # Fastest algorithm
f"--progress "
f"--sync-writes "
)```