Industry guru Dave Taylor answers free tech support questions about a wide variety of business and technical topics, including blogging, Google AdSense, MySpace, Sony PSP, Apple iPod, Mp3 players, management, Linux, SEO, Mac OS X, Facebook, Twitter, LinkedIn and Microsoft Windows.

Does Googlebot visit more often because of my blog?

If I place a link on my business' home page to my weblog and then make sure to update my weblog frequently, will the "Googlebot" come a-knockin' on my home page just as frequently as my blog?

The reason I ask is because in your book Growing Your Business with Google you indicate that Google cares about pages, not sites. This seems to suggest to me that if I update my blog frequently, Google will come to my blog page frequently, but not to my site.


Dave's Answer:

The answer is that you really need to realize that Google views every page of a Web site as an autonomous entity, so if you have pages that aren't updated for months at a time, they'll only be spidered infrequently, whereas pages that are updated every day or two (e.g., a weblog, etc) can end up being spidered every day.

From an efficiency perspective, this makes a lot of sense: one of the goals of a spider is to visit as infrequently as possible while still ensuring that the search engine database has the most recent copies of all Web pages possible.

That's one reason why you need to pollinate your content changes throughout your site. On my Intuitive Life Business Blog site, for example, every page has a "latest entries" box which changes each time a page is added to the weblog. On the home page for my Intuitive Systems site -- http://www.intuitive.com/ -- you'll notice that I actually slip in the titles of the two most recent entries from my three main weblogs, meaning that the page content changes a couple of times a day sometimes!

Brief geeky interlude: this is accomplished through server-side includes (SSI) and a custom Movable Type template in my weblog tool.

Search engines like content that's fresh, so that index page is spidered quite frequently (in fact, a measurable percentage of my server's bandwidth goes to search engine spiders!)

What I suggest you need to do is figure out a way that when you update your weblog, something can change on the other pages on your site, esp. your home page. Then have a bit of patience and you'll find that all of the pages on your site are being spidered every day or two.

Hope that helps clarify things.



Help others find this article at Del.icio.us, Digg, Netscape, Reddit, and Simpy.

Subscribe!

Never miss another useful Q&A article again! Subscribe to AskDaveTaylor with Google Reader.

Comments

Great book Dave. I hope you are right!

Ken

Posted by: Fishing at May 15, 2006 12:46 PM

Google love’s fresh content, using blogs you can meet the same purpose and it can be considered as the best way to attract spiders. most webmaster try to have blogs in their website and work hard to update it's content regularly.
You should use XML sitemap to inform the spiders about the updates and changes of your blog.

Posted by: Harry W. at January 6, 2007 4:16 AM

I have a lot to say, but ...
Starbucks coffee cup I have a lot to say, and questions of my own for that matter, but most of all I'd like to say thank you for all your efforts on this Web site by buying you a chai!

I do have a comment, now that you mention it!









Remember personal info?


Please note that I will never send you any unsolicited commercial email. Ever.

While I'm at it, please note that by submitting a question or comment you're agreeing to my terms of service, which are: you relinquish any subsequent rights of ownership to your material by submitting it on this site.









Search
Find just the answers you seek from among our 1700+ free tech support articles by using our Lijit search engine.


Help!





Subscribe to
Ask Dave Taylor!

Add to Google Reader
Add to My Yahoo!
Subscribe in NewsGator Online

RDF   XML

Free Updates!
Sign up and get free weekly updates and special offers on books, seminars, workshops and more.


Recent Entries
Join the List!
Join my author info mailing list, where you'll learn about my upcoming books, speaking gigs, and more!


Book Links
© 2002 - 2008 by Dave Taylor. All Rights Reserved.

Note: This web site is for the purpose of disseminating information for educational purposes, free of charge, for the benefit of all visitors. We take great care to provide quality information. However, we do not guarantee, and accept no legal liability whatsoever arising from or connected to, the accuracy, reliability, currency or completeness of any material contained on this web site or on any linked site.

[whiteboard marker tray]