Industry guru Dave Taylor offers tech support on technical and business topics, including iPhone, iPod, Microsoft Windows, Sony PSP, cellphones, online advertising, CSS, Web design, business, Unix, Linux, SEO, Mac OS X, and shell script programming.     


Minimize blog spam in MovableType?

Dave, I use two different versions of MovableType for my weblogs, one on each of two different servers, and am wondering what your best recommendations are in terms of limiting my comment spam? One is 3.17 and the other is the latest 3.2 release.


Dave's Answer:

By darn good luck, colleague and blog wizard Josh Hallett of Hyku | blog just recently answered a very similar question, and with his kind permission, I quote his excellent answer:

I recently upgraded to MT 3.2 but preferred my anti-spam settings of 3.17. I'll talk a bit about both. Ultimately, however, most comment and trackback spam is run via scripts.

MovableType 3.17

With 3.17 I had three primary tools in use:

MT Blacklist
MTBL was one of the first anti-spam measures and did an excellent job, however it is not compatible with 3.2, I wish it was. MTBL would prevent the majority of stuff making it thru. What was nice is that you never had to deal with it. Sort of an out-of-sight-out-of-mind thing.

SpamLookup
Rather than running a simple blacklist like MTBL SpamLookup runs the comment/trackback thru a series of tests; if the item does not meet a certain threshold then it will not be posted. For example if a post has too many links in it or the IP address of the trackback does not match the IP address of the blog domain the comment will be denied. In combination these two items did a good job.

Occasionally a large comment spam run would make it through because it had one or two URLs or, in the case of one batch, had links to google.com. All these were run via scripts. To stop that brute-force attack I....

Changed the name of the default mt-comments.cgi and mt-tb.cgi
There are a few steps involved with this, but the primary purpose is to defeat the script attacks running against your mt-comments.cgi file. If you look at your log files you'll see that the comment spammers are simply posting directly to the mt-comments.cgi file. Changing the name of the file can help stop this. It was always fun to look at my log files and see a few thousand 404's when a spammer was trying to post to my mt-comments.cgi file.

At best the name-changing step would beat them for a while. With the three things above I enjoyed a few months with no major spam problems. From time-to-time I would get a single post, which upon investigation (via logs, etc..) turned out to be an actual person posting a single item at a time.

All that changed when I upgraded to 3.2

MovableType 3.2

Like I mentioned earlier, MT-Blacklist does not work with version 3.2. Your primary line of defense is MT's built-in SpamLookup system. MTBL used to stop the spam before I saw it, now with 3.2 I see it in the 'Junk' list which I am forced to review frequently. Yes MT will auto-delete this queue, but I still get false-positives.

This is especially true for Trackbacks. It seems that every Trackback I get from TypePad hosted blogs does not make it through. The reason? The IP address of the trackback server does not match the IP address of the blog's domain. It seems like SixApart would have this covered since they wrote both pieces of software.

I have attempted to update the name of my .cgi files but the spam appears just as quickly again. When I say appear I mean in the junk area, so it never makes it to my blog, but it's still there. Since the name-change doesn't work anymore my theory is that there is another way to post trackbacks, perhaps via an API or the scrips have become smart enough to look-up the exact name of the .cgi script on your blog and then post away. My guess is the latter.

Anyway that's what I do for myself and all my clients. I also have a number of specific plugins for MovableType and some custom modifications I have created that make things like tagging very easy for the basic user.

Thank you for your expert insight on this, Josh. I'm in the middle of migrating from this ancient version of MT to the very latest, on a new, faster server, so I'll be able to add my own experiences in this regard soon enough.


More Useful Blogs and Blogging Articles:
✔   Get my shopping cart plugin to work with WordPress?
We've put in a shopping cart for a client that's not working, and we need some help! The cart is currently using the...
✔   Embed an audio player on a blog or web page?
I have some mp3 audio files I've recorded and would like to have people who visit my site be able to listen to...
✔   Can I write a guest review for AskDaveTaylor.com?
Hi Dave. I'm a big fan of your site and love that you're doing so many reviews now. I've noticed, however, that there...
✔   Change author on WordPress blog post?
I have two accounts set up for my WordPress blog and I'd like to be able to have all my posts from a...
✔   How do I restructure my Wordpress blog without losing SEO?
I have a wordpress blog that was using categories in the url structure like this: /category_name/post_name/ Then I had read somewhere that if...

Let's stay in touch!
Sign up for my weekly AskDaveTaylor Newsletter and you'll receive even more tech and gadget help right to your inbox, along with exclusive news and industry updates. It's good stuff. I promise!
    Enter your name: and your email addr:  









Reader Comments To Date: 2

Erik Weibust said, on October 20, 2005 7:19 PM:

What is the process of changing the name of mt-comments.cgi and mt-tb.cgi? I assume after changing the file names there will be changes that need to be made to the existing MT code.

Erik

Jack Vinson said, on October 20, 2005 11:02 PM:

When renaming scripts for comments and trackbacks (and others), you need to change the appropriate variable in mt-config.cgi (or mt.cfg before MT 3.2). These are CommentScript and TrackbackScript.

Starbucks coffee cup I do have a lot to say, and questions of my own for that matter, but first I'd like to say thank you, Dave, for all your helpful information by buying you a cup of coffee!

I do have a comment, now that you mention it!











I will never send you any unsolicited email. Ever.






Check This Out Too...

 
Look for Answers
Need Help? Ask Dave Taylor!


Follow Me on Pinterest

Find Me on Google+
ADT on G+
© 2002 - 2013 by Dave Taylor. All Rights Reserved.

Note: This web site is for the purpose of disseminating information for educational purposes, free of charge, for the benefit of all visitors. We take great care to provide quality information. However, we do not guarantee, and accept no legal liability whatsoever arising from or connected to, the accuracy, reliability, currency or completeness of any material contained on this web site or on any linked site. Further, please note that by submitting a question or comment you're agreeing to my terms of service, which are: you relinquish any subsequent rights of ownership to your material by submitting it on this site. My lawyer says "Thanks".
"Ask Dave Taylor®" is a registered trademark of Intuitive Systems, LLC.