Linux – I would like to pipe output of find into input list of scp, how

findlinuxpipescp

I'm a novice linux user and I am trying to send a long list of files from one computer to another. The argument list is too long, so I am using find. I am having trouble setting up the expression, though. Can someone help?

Here is what I would normally type for a short argument list.

scp ./* phogan@computer/directory...

Here's I think this might translate into with find.

scp find . -name "*" phogan@computer/directory...

Maybe I could use piping? Any suggestions would help. Thanks in advance.

Best Answer

find . -name "*" -exec scp '{}' phogan@computer:/directory ';'

Normally I would 'tar' all the files together into one huge blob and call 'scp' just once. Something like this:

tar czfv - file1 file2 dir1 dir2 | ssh phogan@computer/ tar xvzf - -C directory

One could play around with the --exclude= or --include= parameters of tar.
Another option would be to use rsync.

Related Solutions

How to feed grep output into scp

No need to use xargs:

for file in $(grep <some-pattern> <filelist>); do scp $file <remote>; done;

Where

<some-pattern> is your grep pattern
<filelist> is your list of files
<remote> is your remote end of the scp command

The for loop will iterate over each line produced by grep and pass this to $file, which you can re-use in the commands executed between do and done.

Also see: Advanced Bash-Scripting Guide: – Loops

How to pipe awk output (with periodic, continuous input) to output file

You have to flush the buffer to see something in memOut during the execution:

free -mto -s 1 | awk '/Mem/ { print strftime("%r") "," $4; fflush(stdout) }' >> memOut

Here's an alternative version:

while sleep 1; do sed -n "s/MemFree: */`date`, /p" /proc/meminfo; done >> memOut

Best Answer

Related Solutions

How to feed grep output into scp

How to pipe awk output (with periodic, continuous input) to output file

Related Question