Industry guru Dave Taylor answers free tech support questions about a wide variety of business and technical topics, including blogging, Google AdSense, MySpace, Sony PSP, Apple iPod, Mp3 players, management, Linux, SEO, Mac OS X, Facebook, Twitter, LinkedIn and Microsoft Windows.

What is the Taguchi method?

I've been doing lots of online marketing and have recently started using a/b testing to figure out whether a particular picture or headline is going to help with my conversion. it's going well, but there are so many different variables to test. A PPC expert told me that I needed to use something called the Taguchi method to test more variables simultaneously? Can you tell me a bit about this Taguchi method stuff and why it'd be useful?


Dave's Answer:

I had no idea about Taguchi methods of statistical analysis until I heard a splendid talk from David Bullock at the System Seminar a few months ago, and even then, I kept thinking that it was somehow related to the popular Japanese Tamagotchi toys.

But more seriously, the Taguchi method was developed by statistician Genichi Taguchi to improve the quality of manufactured goods and it proves to be more widely applicable to a variety of situations where you're testing more than one variable simultaneously. The key question that Genichi was trying to address was: how many different conditions do you need to experience to be able to reliably ascertain whether "a" is better than "b" or not.

An interesting article on this subject is at Offermatic, where they offer this explanation:

"The Taguchi Method ... has been employed with great success to optimize automobile and product manufacturing. Genichi Taguchi devised a methodology for testing multiple variables in the manufacturing process using a subset of the number of tests required by traditional testing methods. In large-scale production scenarios, every test is expensive so the Taguchi Method proved extremely valuable. In addition to reducing the number of sequential test, the Taguchi Method discriminates between signal and noise and estimates the positive or negative value of each element (factor) in each alternative (level). The Taguchi Method works so well in manufacturing that it is now being applied to traditional advertising, Internet PPC advertising and Landing Pages."

They break down application of the Taguchi method to landing page design into four steps:

  1. Select elements on the landing page that we believe will influence sign-up
  2. Create alternatives for each element
  3. Create test "recipes" that combine these elements according to the Taguchi Methodology
  4. Set up and run a concurrent multi variable test using the Offermatica ASP testing framework.

What can you test? The most obvious is headlines, but really just about any element of the page you might want to vary, from graphics to font, colors to background images, ordering of bullet list items, whatever. Indeed, the most elements you seek to test, the more valuable that Taguchi testing proves to be, because you really don't want to a/b test, say, twenty variables in less than six months!

David, who I learned about Taguchi from in the first place, recommends Vertster as his choice of tool for automating Taguchi testing. He offers the following benefits:

  • Nothing to load on your server.
  • Template driven experiment design. (Walks you through step by step)
  • Great online documentation
  • Enterprise Level Application
  • Many of the features and functions that I require for my testing are built in.
  • Real time stats
  • Ease of use. You can click and create a creative after you setup your template.
  • You can change the configuration of your test with a few clicks of your mouse.
  • This is a hosted solution.
  • SEO protection - you can test without degrading your search engine rankings.
  • Profit protection
  • Monthly subscriptions are available.

Again, the method itself is really focused on helping you test a variety of different elements simultaneously, so you can ascertain the best possible combination in the shortest possible time. And, if you're testing, isn't that just what you want to do anyway?



Help others find this article at Del.icio.us, Digg, Netscape, Reddit, and Simpy.

Subscribe!

Never miss another useful Q&A article again! Subscribe to AskDaveTaylor with Google Reader.

Comments
Rather amazingly, there are no comments on this article yet.

I have a lot to say, but ...
Starbucks coffee cup I have a lot to say, and questions of my own for that matter, but most of all I'd like to say thank you for all your efforts on this Web site by buying you a chai!

I do have a comment, now that you mention it!









Remember personal info?


Please note that I will never send you any unsolicited commercial email. Ever.

While I'm at it, please note that by submitting a question or comment you're agreeing to my terms of service, which are: you relinquish any subsequent rights of ownership to your material by submitting it on this site.









Search
Find just the answers you seek from among our 1700+ free tech support articles by using our Lijit search engine.


Help!





Subscribe to
Ask Dave Taylor!

Add to Google Reader
Add to My Yahoo!
Subscribe in NewsGator Online

RDF   XML

Free Updates!
Sign up and get free weekly updates and special offers on books, seminars, workshops and more.


Recent Entries
Join the List!
Join my author info mailing list, where you'll learn about my upcoming books, speaking gigs, and more!


Book Links
© 2002 - 2008 by Dave Taylor. All Rights Reserved.

Note: This web site is for the purpose of disseminating information for educational purposes, free of charge, for the benefit of all visitors. We take great care to provide quality information. However, we do not guarantee, and accept no legal liability whatsoever arising from or connected to, the accuracy, reliability, currency or completeness of any material contained on this web site or on any linked site.

[whiteboard marker tray]