Re: [Nolug] Fastest way to create a local mirror of a huge tree?

From: Jimmy Hess <mysidia_at_gmail.com>
Date: Wed, 7 Sep 2011 00:23:28 -0500
Message-ID: <CAAAwwbUhAaP83WWaJG3VywFLGwJA15T_Uy+rsr42VKEkDK7rjA@mail.gmail.com>

On Tue, Sep 6, 2011 at 10:21 PM, Ron Johnson <ron.l.johnson@cox.net> wrote:
> The mirror doesn't exist yet, so rsync's clever data-minimizing algorithms
> aren't valid.  (Also, there are lots of symlinks that need be preserved.)
> 1. cp -av /data /mnt/backups/data
> 2. cd /data && tar -cvf – . | (cd /mnt/backups/data && tar -xpvf -)
> 3. rsync -avz --stats --progress /data /mnt/backups/data
>
Netcat + XZ or gzip + CPIO or tar.

nc otherhost portnumber | xz -d | cpio -idm
find pathname -print | cpio -o -Hnewc | xz -1 | nc -l portnumber

Then rsync to reconcile.

If on a dedicated partition, consider a block-based tool that won't
need to traverse the filesystem
directory structure and won't need to copy unused disk blocks, e.g. partimage.

--
-JG
___________________
Nolug mailing list
nolug@nolug.org
Received on 09/07/11

This archive was generated by hypermail 2.2.0 : 09/07/11 EDT