Splitting large directory tree into specified-size chunks

backupburningdisk-usagesplit

I have a directory tree that I would like to back up to optical disks. Unfortunately, it exceeds the size of any one disk (it's about 60GB). I am looking for a script that would split this tree into appropriately sized chunks with hard links or whatnot (leaving the original untouched). I could then feed these bite-size trees into the backup process (add PAR2 redundancy, etc.).

It's not a fancy script, but it seems like it might have already been done. Suggestions?

(Spanning and writing in one step is a no-go because I want to do more stuff before the files get burned.)

Best Answer

There exists an application designed for this: dirsplit

It usually lives in cdrkit or dirsplit packages.

It can create ready-to-use folders with links to easily create DVDs with K3b or other GUI software

Related Solutions

Disk Usage – Print Size of Directory Content with Tree Command

Only for tree 1.6 and above

You might want to look at:

man tree

--du For each directory report its size as the accumulation of sizes of all its files and sub-directories (and their files, and so on). The total amount of used space is also given in the final report (like the 'du -c' command.) This option requires tree to read the entire directory tree before emitting it, see BUGS AND NOTES below. Implies -s.

So you should use:

tree --du -h

How to split a large text file into chunks of 500 words or so

Must it be done with wc? Because here I've ran into a very nice attempt to use regex as a csplit pattern. I don't have a system to test it right now but the regex itself seem to do the job.

The expression looks like that:

 csplit input-file.txt '/([\w.,;]+\s+){500}/'

Best Answer

Related Solutions

Disk Usage – Print Size of Directory Content with Tree Command

How to split a large text file into chunks of 500 words or so

Related Question