Bash – Create symlink tree in existing directories

bashfindshell-scriptsymlink

I carry all of my music around on a 1TB USB drive and have a udev rule to symlink it to $HOME/Music/ when I plug it in to one of my laptops, which it does.

The issue I have is that this works fine where the directory does not exist on the laptop, but it doesn't create the requisite tree where there is a pre-existing directory of the same name (Artist/Album/*.flac) on the laptop.

The script I currently run is this one:

#!/usr/bin/env bash
# repopulate music links when drive plugged in

shopt -s nullglob
export DISPLAY=:0
export XAUTHORITY=/home/jason/.Xauthority

music=(/media/Apollo/Music/*)

find /home/jason/Music -type l -exec rm {} \;
for dirs in "${music[@]}"; do
  ln -s "$dirs" /home/jason/Music/ 2>/dev/null
done
status1=$?

mpc update &>/dev/null

status2=$?
if [[ "$status1" -eq 0 && "$status2" -eq 0 ]]; then
  printf "%s\n" "Music directory updated" | dzen2 -p 3
fi

How can I ensure that where a directory exisits on both the laptop and the USB drive, but the contents are slightly different, the files are correctly symlinked? For example:

USB drive:

Music -- Matthew Shipp -- Patoral Composure -- Track 1
                                            -- Track 2 etc...
                       -- Strata            -- Track 1
                                            -- Track 2 etc...
                       -- Equilibrium       -- Track 1
                                            -- Track 2 etc...

Laptop:

Music -- Matthew Shipp -- Patoral Composure -- Track 1
                                            -- Track 2 etc...

In this case, no symlinks to the albums Strata or Equilibrium will be created, presumably because the parent directory (Matthew Shipp) exists.

I would prefer not to use rsync to copy the actual data across as I have limited space on the laptops and with mpd able to follow symlinks, I have no need to copy the files across.

Is it possible to tweak my script to propagate symlinks into pre-exisiting directories on the laptop?

Best Answer

Since your primary aim is to have a combined view of your local and external Music folder, I think a union mount via overlayfs could be used, especially if the files are not being written to.

The basic command is, in older kernel versions (<3.18):

mount -t overlayfs -o lowerdir=/read/only/directory,upperdir=/writeable/directory overlayfs /mount/point

For example:

$ ls Documents
374620-63301.pdf        My Kindle Content   scan0005.jpg
BPMN2_0_Poster_EN.pdf   scan0003.jpg        StrongDC++
$ ls devel
cse           ossec     ubuntu-14.04-desktop-amd64-ssh.iso
nexus         scripts   zsh-syntax-highlighting
$ sudo mount -t overlayfs -o lowerdir=$PWD/Documents,upperdir=$PWD/devel overlayfs ~/Documents
$ ls Documents
374620-63301.pdf        scan0003.jpg           
BPMN2_0_Poster_EN.pdf   scan0005.jpg    
cse                     scripts
My Kindle Content       StrongDC++
nexus                   ubuntu-14.04-desktop-amd64-ssh.iso
ossec                   zsh-syntax-highlighting

One drawback is the need for sudo, which can perhaps be taken care of using a careful NOPASSWD rule.

In light of Jason's blog post, the mount command for newer kernels changes to using overlay as the filesystem, instead of overlayfs, and using an additional workdir. The kernel documentation now codifies this:

At mount time, the two directories given as mount options "lowerdir" and "upperdir" are combined into a merged directory:
mount -t overlay overlay -olowerdir=/lower,upperdir=/upper,\
  workdir=/work /merged
The "workdir" needs to be an empty directory on the same filesystem as upperdir.

Related Solutions

List files by symlink target

You can use find to fetch all files of type symlink and add the -ilname option to search by name of the link destination. This works just like -iname but for the link target name instead of the link name.

find -type l -ilname "*bar*"

That will still print out the name of the link, not the target. If you want to print the names of the targets, try this:

find -type l -ilname "*bar*" -printf "%l\n"

Or get a full ls style output

find -type l -ilname "*bar*" -ls

What you mean by "do something with the list" is unclear, but if you wanted to operate on the link files, you could use the -exec argument to find:

find -type l -ilname "*bar*" -exec touch {} \;

But if you need to operate on the link targets, you will need to use the -printf to get the target values and then xargs or some loop yourself to operate. You could do something like this:

find -type l -printf "%l\n" | grep bar | xargs touch

... which also demonstrates how to use grep instead of find -ilname to do your name matching, although you could do that either way.

`ln -s` creates a symlink inside an existing folder instead of failing

When the last argument to ln is a directory, the links are made in that directory. The man page says:

SYNOPSIS
    ln [OPTION]... TARGET... DIRECTORY     (3rd form)
In the 3rd and 4th forms, create links to each TARGET in DIRECTORY.

It doesn't matter whether you're creating a hard or symbolic link. cp and mv behave similarly.

Best Answer

Related Solutions

List files by symlink target

`ln -s` creates a symlink inside an existing folder instead of failing

Related Question