Find unique values from find

cshfind

I want to find unique files inside a directory, which also have sub directories.

There are specific types of files, say .lib files.

There are same .lib file inside different sub directoris. I need to find the list of .lib files inside my home directory, but only unique names. Are there any method to do so ?

Currently I am using

find -name "*.lib" > lib_file_list

But it gives duplicate results as some of the .lib files are in multiple sub directories. I am using CSH.

Best Answer

With GNU tools:

find . -name '*.lib' -print0 | awk -v RS='\0' -F/ '! seen[$NF]++'

Example

Sample data.

.
|-- 1
|   |-- 1.mp3
|   `-- 1.txt
|-- 2
|   `-- 2.mp3
|-- 3
|   `-- 3.txt
|-- 4
|   `-- 4.txt
|-- 5
|   `-- 5.mp3
|-- 6
|   `-- 61
|       `-- 61.mp3
|-- 7
|   `-- 71
|       `-- 71.txt
`-- deletenomp3.bash

Sample run

If I were to run it it would delete the following:

$ ./deletenomp3.bash 
./7 no mp3
./7/71 no mp3
./4 no mp3
./3 no mp3

Other file types

You can simply extend this by adding more -name arguments to the 2nd find command in the script. Example, to add .wav files:

 v=$(find "$D" -iname '*.mp3' -o -iname '*.wav');

That says *.mp3 OR *.wav. To add more or others:

 v=$(find "$D" -iname '*.mp3' -o -iname '*.flac' -o -iname '*.m4a');

I'm sure this block could be condensed if you had a lot more file types using alternative switching to find.

Bash – Using find to list all files under certain directory

With -path, you could try:

find ~ -path '*/bin/*' -type f

This won't list bin itself, so to get both:

find ~ \( -path '*/bin/*' -type f \) -o \( -name bin -type d \)

Best Answer

Related Solutions

Find directories without music files

Example

Sample run

Other file types

Bash – Using find to list all files under certain directory

Related Question