Debian – How To dd or cp Entire Disk On Debian Remote Machine To Local Machine

backupcpdddebianrsync

I have read this post – How to dd a remote disk using SSH on local machine and save to a local disk

However, the following code doesn't work:

"dd if=/dev/sda | gzip -1 -" | dd of=image.gz

As I do not have any /dev/sda directory. I'm assuming this is because I'm using Debian 7.0.

Any help to take a complete copy of my vps is highly appreciated.

Best Answer

The device name of a disk depends on what type of disk it is (more precisely, on what type of bus and controller the disk is connected to, and what driver handles them). /dev/sda is the typical name for the first disk in a PC (other names can be used depending on the driver, e.g. for some older types of disk controllers or some hardware RAID controllers). In a VPS, the disk is normally a virtual one, and the device name depends on the virtualization technology, e.g. /dev/vda or /dev/xvda. You can find the block device names on your system with df or lsblk.

But do not use this to make a backup from a live system! You are very likely to end up with an unreadable backup. If the disk content changes while you're making the backup, which is unavoidable on a live system (e.g. a log gets written somewhere), then your image will be inconsistent — a bit of the old state, a bit of the new state — and may not be recoverable.

The preferred way to make a backup is to make a snapshot, i.e. a view of the filesystem that's frozen and doesn't change even as the real system keeps changing. How to do that, and whether it is at all possible, depends on how your system is set up. Some filesystem types such as btrfs and zfs have a built-in snapshot ability. LVM also can make snapshots of a volume.

If you can't make a snapshot (or even if you can) make a file-level backup. A file-level backup from a system that changes will be inconsistent, but if you don't make “important” changes then the backup will be usable. For example, if you move files around, they may be omitted from the backup if they happen to be moved from a directory that the backup program has not traversed yet to one that it has already traversed. On the other hand, if a log file keeps growing, you'll have some intermediate version of that file, but you won't have a damaged filesystem image. If a file is deleted and another file is created, you may have none of those files, or either one, or both, but you won't have the directory entry of the old file pointing at some data in the new file.

You can use GNU tar (as root!) to back up a Linux system complete with important metadata.

ssh root@vps 'tar -cJf - --acls --selinux --one-file-system /' >vps.tar.xz

Examples

run from remote computer

$ dd if=/dev/sda | gzip -1 - | ssh user@local dd of=image.gz

run from local computer

$ ssh user@remote "dd if=/dev/sda | gzip -1 -" | dd of=image.gz

Live example

$ ssh skinner "dd if=/dev/sda5 | gzip -1 -" | dd of=image.gz
208782+0 records in
208782+0 records out
106896384 bytes (107 MB) copied, 22.7608 seconds, 4.7 MB/s
116749+1 records in
116749+1 records out
59775805 bytes (60 MB) copied, 23.9154 s, 2.5 MB/s

$ ll | grep image.gz
-rw-rw-r--.   1 saml saml  59775805 May 31 01:03 image.gz

Methods for monitoring?

Login via ssh in another terminal and ls -l the file to see what it's size is.
You can use pv to monitor the progress of a large dd operation, for instance, for the remote example above, you can do:
```
$ dd if=/dev/sda | gzip -1 - | pv | ssh user@local dd of=image.gz
```
Send a "SIGUSR1" signal to dd and it will print stats. Something like:
```
$ pkill -USR1 dd
```

References

The methods mentioned above for monitoring were originally left via comments by @Ryan & @bladt and myself. I've moved them into the answer to make them more obvious.

Looking for a way to backup/mirror a drive by swapping

My recommendation would be to do the dd over the network. I've used that method to back up laptop hard drives (much easier than pulling it out, or getting an external drive), and as long as you have a decently fast network, it's generally not TOO slow. It'll certainly be far more convenient than anything involving manual switching.

Omit the of= parameter to dd and it'll write the content to stdout; then pipe that into ssh user@othercomputer 'cat >disk.img' to push it over the network and save it.

Best Answer

Related Solutions

SSH – How to DD a Remote Disk Using SSH and Save to Local Disk

Examples

Live example

Methods for monitoring?

References

Looking for a way to backup/mirror a drive by swapping

Related Question