Industry guru Dave Taylor offers tech support on technical and business topics, including iPhone, iPod, Microsoft Windows, Sony PSP, cellphones, online advertising, CSS, Web design, business, Unix, Linux, SEO, Mac OS X, and shell script programming.     


Accuweather changed, and now the 'weather' script is broken!

A reader writes in to report that Accuweather has changed their Web page layout and the shell script from Wicked Cool Shell Scripts that returns the weather forecast (script #63, weather.sh), is broken.

Dave's Answer:
He's right, but amazingly, the fix is less than 25 characters long!

Instead of the embedded sed statement containing:

sed -n '/<font class="sevendayten">/,/[^[:digit:]]<\/font>/p' | \
it should now be replaced with:
sed -n '/Start - Forecast Cell/,/End - Forecast Cell/p'
That's all there is to it.

Of course, this doesn't mean that the scripts that are scraping Web sites from my book won't break again as formats change, but that's why it's so helpful for you to try and step through the scripts so you can understand how the script parses the source and extracts the information needed.

And if something else does break, you can always contact me with specific questions!


Related Shell Script Programming articles:
✔   Secretly capture screenshots on my Mac?
When I used to work on a Linux system, there was a utility we had that would let me take screen captures every...
✔   Parsing "id" strings in a Shell Script?
Hello Dave. I need a Bash shell script that creates a directories with the group names automatically when user logs in to the...
✔   Copy and Paste from the Mac OS X Command Line?
I am constantly running commands in Terminal.app on my MacBook and then copying and pasting the results into email messages or documents. Yes,...
✔   Script to test line lengths for Twitter compatibility?
I've been tasked with writing a series of tweets for a Black Friday marketing campaign and am finding it a bit tricky because...
✔   Shell script to convert lowercase to title case?
As part of a project I'm working on, I find myself deep in a Linux shell script, needing to have a subroutine that...

Let's stay in touch!
Sign up for my weekly AskDaveTaylor Newsletter and you'll receive even more tech and gadget help right to your inbox, along with exclusive news and industry updates. It's good stuff. I promise!
    Enter your name: and your email addr:  








Reader Comments To Date: 2

Paco said, on November 10, 2005 2:18 PM:

Looks like Accuweather has entered some embedded comments with Real????[TM] in the source. The do not show up in the rendered html page, but they are in the source as comments.

Example:
96. Max. UV 6.-->

Since the script is not set to parse out the comment I get this garbage:

Today
Sunshine, very warm and humid - High 89
96. Max. UV 6.-->

Is there a way to fix it where I can display the "Real" info properly?

Also can I scrub it so it does not appear in the output? Just in case the "Real" info is not wanted.

Thanks - Paco

Jim said, on February 17, 2010 11:21 AM:

Does accuweather.com have an imbedded virus/popup problem in Adobe reader from some company trying to sell a virus checker program?

Starbucks coffee cup I do have a lot to say, and questions of my own for that matter, but first I'd like to say thank you, Dave, for all your helpful information by buying you a cup of coffee!

I do have a comment, now that you mention it!











I will never send you any unsolicited email. Ever.






Check This Out Too...

 
Look for Answers
Need Help? Ask Dave Taylor!


Follow Me on Pinterest

Find Me on Google+
ADT on G+
© 2002 - 2013 by Dave Taylor. All Rights Reserved.

Note: This web site is for the purpose of disseminating information for educational purposes, free of charge, for the benefit of all visitors. We take great care to provide quality information. However, we do not guarantee, and accept no legal liability whatsoever arising from or connected to, the accuracy, reliability, currency or completeness of any material contained on this web site or on any linked site. Further, please note that by submitting a question or comment you're agreeing to my terms of service, which are: you relinquish any subsequent rights of ownership to your material by submitting it on this site. My lawyer says "Thanks".
"Ask Dave Taylor®" is a registered trademark of Intuitive Systems, LLC.