Free tech support header

How do I de-dupe (remove duplicate) tracks in Apple iTunes?

I don't know how it's happened, but I seem to have a bunch of duplicate tracks in my (huge) iTunes library and it's annoying as heck. I can remove them by hand, but it's tedious and I'm afraid of user error. I checked out the "Show Duplicates" feature in iTunes, but it seems to think that songs with the same name by different artists on different albums are dupes. Uh, no. So what's the solution, Dave? Oh, if it matters, I'm on an iMac.


Dave's Answer:

This is a common problem for those of us who have big music libraries on our computers, and there must be millions of us given the popularity of iPods, iPhones, and such! I have the very same problem you do, and I also am puzzled how I ended up with duplicate tracks, but there are definitely albums where every single track appears twice in my library. Not what I want, and a clear waste of disk space.

There is indeed a "Show Duplicates" feature in iTunes, but it seems to just operate on the song title, so if you have multiple covers of the same song, or different songs with the same name, then you're hosed. The good news, though, is that the feature isn't "remove dupes", which would be 1000x more annoying!

There is a "Show Exact Duplicates" option but let me also demonstrate a very slick third-party set of scripts called Dupin too. It's really slick and perfect for our task.

To start, though, try File --> Show Duplicates. You'll see something like this in iTunes:

apple itunes show duplicate tracks

Look closely and you'll see that, for example, there are three versions of Ain't Nobody But Me, by Supertramp, but it's on two different albums. Worse, All The Things You Are by Ella Fitzgerald is only on separate albums, and is actually different recordings. So we don't want to blindly delete these tracks.

What's more confusing to me is that it's not showing duplicates, it's showing both the original and the duplicate: if you blindly just select them all and delete them, you'll have lost both copies of the track. Not at all what you want!

Here's a secret trick, though: hold down the Option key then click on File and you'll see that the menu option has changed from "Show Duplicates" to "Show Exact Duplicates". Do that and the results are a bit more logical:

apple itunes show exact duplicate tracks

That's better! Now it's just true duplicated files, both the original and the duplicate. If you look closely, notice that for some reason my copy of the Genesis album Invisible Touch seems to have three copies of Anything She Does!

Problem is, you're still stuck with no easy way to weed out the dupes. There's a further nuance too: what if you have two versions of a song in a compilation, same name, same album, same artist, but different track lengths? That's where Dupin comes in so handy, and for $15 it's a small investment for your sanity.

Download, install, and get your registration key and you'll be able to launch it and see, well, not much:

apple itunes duplication dupin

Look at the criteria on the left, however. Here you can define what it should take into consideration when it tries to figure out if one track is a duplicate of another or not. I chose to have it check song title, artist, album and track length. Now, click on "Get Dupes" on the toolbar and after a few seconds (or possibly longer), you'll get a list of the duplicates base on your filtering criteria:

apple itunes duplication dupin 2

That looks accurate! Here's where Dupin is cool: instead of making me select every other track as I would have to do in iTunes itself, Dupin lets you specify exactly how it should choose between the original and the duplicate by choosing Tools --> Filter Controls, which brings up this window:

apple itunes duplication dupin 3

The app says it clearly: select the keeper in a dupe group. Do that based on whatever criteria you want to use, I use "Most Recently Played", then click on "Filter". The result:

apple itunes duplication dupin 4

Notice the tracks checked? Those are the keepers out of the batch. It's a bit tricky but you're denoting which ones to keep, not which ones to delete or remove. Ready to axe the dupes and keep the keepers?

Go to Tools --> Purge... and you can have Dupin do the heavy lifting, trashing the tracks that you've ascertained are duplicates:

apple itunes duplication dupin 5

I'll go for it, what the heck. Click on "Remove" and you get another choice:

apple itunes duplication dupin 6

Oh, okay, we'll keep the files "just in case" by choosing "Keep Files". Next thing ya know...

apple itunes duplication dupin 7

and it's done! Now, did it really work? Did we really get rid of the dupes? Easiest way to find out is to switch back to iTunes and choose "Show Duplicates" again. If you're like me, there are still dupes, but look closely and you'll find that they're different duration, on different albums, performed by different musicians, or otherwise not actually duplicates. Easy!

I hope that helps you figure things out. As always, if you find shareware useful, don't forget to pay and support the programmer's efforts!



Help others find this article at Del.icio.us, Digg, Netscape, Reddit, and Stumble Upon    

Subscribe!
Never miss another Q&A article! Click to subscribe: Add to Google Reader Add to My Yahoo! Subscribe in NewsGator RDF XML
Comments

That's all fine and good, but this is something I can perform through iTunes itself. Maybe it's a little more work, but not that much.

The real problem with duplicates is in iTunes not recognizing certain ones. Like upper case versus lower case letters. Being able to find similar tracks if there is a slight misspelling or forgetting conjugation. Having titles possibly missing a word like "the" but all else is the same. There's many other examples where I find dupes but iTunes doesn't. I want that tool!

Posted by: BoBo at February 3, 2010 11:55 AM

So if I have an exact duplicate of a song, how do I know which one of the copies is in my playlists?

It would be crummy to have to review and rebuild all my playlists after getting rid of my duplicates. The option to delete by "most recently played" may help, but I'm still worried.

Posted by: Dan at February 3, 2010 6:26 PM

This is a cool tool, and I defintely can use this. I have multiple versions of songs in the library, because I made copies, made new copies, imported from a friend, all those reasons that lead to dupe copies. Then when you look at the list, it gets confusing, so when I add songs to my Ipod, I sometimes get 2 or three of versions (same length) because they were on several different CDs. So this offers a great solution. and cheap too. Thanks!

Posted by: Jeffrey Meier at February 6, 2010 10:50 AM

Dan, that's a great question and one that I don't know the answer to. Anyone else?

Posted by: Dave Taylor at February 8, 2010 12:15 PM

Nice tool.
I will surly use that.
Its a big problem for me to delete duplicates songs in itunes.
That tool will make it easier.

Posted by: Vilyanur Chandra at February 11, 2010 12:58 PM

Dan: Dupin has a tool called "Re-Playlist" which will re-populate selected playlists with the tracks you have decided to keep.

Posted by: Doug Adams at February 14, 2010 5:27 PM

I have something to say, now that you mention it, but ...
Starbucks coffee cup I do have a lot to say, and questions of my own for that matter, but first I'd like to say thank you for all your efforts on this Web site by buying you a cup of coffee!

I do have a comment, now that you mention it!











Remember personal info?


Please note that I will never send you any unsolicited email. Ever.

While I'm at it, please note that by submitting a question or comment you're agreeing to my terms of service, which are: you relinquish any subsequent rights of ownership to your material by submitting it on this site.






Recent Entries
Search
I Need Help!



Join The Club!
Sign up and get free weekly updates, news on my speaking schedule, seminars, workshops and more. It's cool. Just do it. :-)

© 2002 - 2010 by Dave Taylor. All Rights Reserved.

Note: This web site is for the purpose of disseminating information for educational purposes, free of charge, for the benefit of all visitors. We take great care to provide quality information. However, we do not guarantee, and accept no legal liability whatsoever arising from or connected to, the accuracy, reliability, currency or completeness of any material contained on this web site or on any linked site.

[whiteboard marker tray]
"Ask Dave Taylor®" is a registered trademark of Intuitive Systems, LLC.