Bashscripts.org

Hi all,

I need a nifty bash script for finding and removing duplicate mp3, ogg, wma files in a directory each time i connect my ipod

Thanks in advance for your help!

tsairox

ummmmm huh ?

You can't HAVE duplicate files in the same directory anyway ........ at least not with the same filename.... or are we comparing 2 directories ???? or are we comparing filename.mp3 to see if we have filename.ogg ?? I think you'll need to be a bit more specific ....

What I mean is that when I connect my ipod or my IAudio, other external hard drive, I can see several directories. In some directories or folders if that helps, I have mistakenly placed more than one of the same song by the same artist. This has occurred quite a bit for me. So instead of manually deleting each dupe, I need a script which will do it for me. I even thouhgt maybe of using wget. I know that it has a command that lets you search blogs for new mp3s without downloading ones you already have.

Say that one of your directories is named Music. You go into that directory and say there is another directory named "Pop." Then say you have three songs by Prince called PurpleRain.mp3 which are exactly the same,(which I do). Is there a bash script that will look through all directories and remove the dupes? There surely must be a bash script that allows removing dupe files by comparing the name, size and type, etc.

thanks again,

tsairox

so you mean remove duplicate files, not nec. in the same directory... right? because as crouse said, you can't have two files with the same name in the same directory, if you do, duplicate songs is the least of your worries

So, you would need to compare 2 different directories, and remove duplicates from one of them..... correct ? (I think i'm getting the big picture now )

Are the directories the same all the time ? If so, could you list the full paths to the ones you want to compare, and tell us from WHICH one would you want to remove the duplicates and WHICH one would stay the same......

I would be interested in a script like this.
Rather than delete the duplicate entries,have it port the outcome omitting duplicate entries using >filename.txt.
My interest would be in finding duplicate bookmarks from several browsers.
An example would be:
in /mnt/hdb7/backups/bookmarks I may have entries like:
firefox9272007.html,firefox10272007.html,opera10272007.html,opera11272007.html.

A script that would compare the addresses from all the files(the Opera and Firefox html backup files)which are located in the same directory(bookmarks)for duplicate IP addresses,
then,
create a text file(>bookmarks.txt).
Or using >bookmarks.html?Would be better yet as to import back into a browser.

I know,Midnight Commander has a feature to find duplicate entries,but a bash script would be better.Makes one look and feel cool. Ha!

whether duplicate songs are wth same name or not u can use it like
$./dupfind.sh /media/iPOD

There is a utility called fdupes for this. If you use Archlinux, it's packaged (In AUR I think), if not check your package manager. Otherwise google for it.

yeah i know that. but as you see; http://premium.caribe.net/~adrian2/prog ... .40.tar.gz it s a C code . we bash fu here
fdupes also use md5 hashes, u cant expect a better performence.