Industry guru Dave Taylor offers tech support on technical and business topics, including iPhone, iPod, Microsoft Windows, Sony PSP, cellphones, online advertising, CSS, Web design, business, Unix, Linux, SEO, Mac OS X, and shell script programming.     


How do I rotate files in Unix?

On Solaris I have cron job which creates some log files and it puts it under a directory, this directory name is created based on system date for example directory name are like 08162005, 08172005 so on..

What I need is I want to do a rotation for these log directories every 14 days since these are directories with system dates, I am having little trouble getting this done,

Is there any way you can solve this for me??


Dave's Answer:

If you're trying to figure out how to do date math, then this is going to seem like a very difficult task. But, in fact, what you're talking about is a perfect job for one of the Swiss Army Knives of the Unix command line: find.

Specifically, find has a flag -ctime which lets you test how long ago the file was created. The notation that the program uses for specifying dates is a bit confusing, but I'll give you a shortcut: "-ctime" lets you specify the number of days, so the command "-ctime 14" sounds right, but it actually will only match files that are exactly fourteen days old.

What we want instead, however, is "fourteen days or older", which is done by prefacing the number with a "+".

Put everything together with the peculiar syntax of find and, if you're looking for files in the directory "/var/log/test", you could use:

find /var/log/test -ctime +14 -print

That'll work to identify these files, but what you're actually asking me is about directories that have this naming scheme, and it turns out that you can add another constraint to find that'll limit its results to just directories.

For this, I'm going to assume that your directories all live under the "/var/log/test" directory, but that's easily changed, of course.

To constrain results to just directories, use -type d ("-type f" is just files, for example). Put it together and:

find /var/log/test -ctime +14 -type d -print

That should identify the files you want. To automatically delete them, use "xargs" thusly:

find /var/log/test -ctime +14 -type d -print |
xargs /bin/rm -f

That should do exactly what you seek!


More Useful Shell Script Programming Articles:
✔   Secretly capture screenshots on my Mac?
When I used to work on a Linux system, there was a utility we had that would let me take screen captures every...
✔   Parsing "id" strings in a Shell Script?
Hello Dave. I need a Bash shell script that creates a directories with the group names automatically when user logs in to the...
✔   Copy and Paste from the Mac OS X Command Line?
I am constantly running commands in Terminal.app on my MacBook and then copying and pasting the results into email messages or documents. Yes,...
✔   Script to test line lengths for Twitter compatibility?
I've been tasked with writing a series of tweets for a Black Friday marketing campaign and am finding it a bit tricky because...
✔   Shell script to convert lowercase to title case?
As part of a project I'm working on, I find myself deep in a Linux shell script, needing to have a subroutine that...

Let's stay in touch!
Sign up for my weekly AskDaveTaylor Newsletter and you'll receive even more tech and gadget help right to your inbox, along with exclusive news and industry updates. It's good stuff. I promise!
    Enter your name: and your email addr:  









Reader Comments To Date: 6

Erik Weibust said, on August 29, 2005 5:59 PM:

One question. Can't you leave the "-print" arg off? It seems to default to print in all environments I've used (Solaris, Fedora, cygwin).

Erik

Dave Taylor said, on August 29, 2005 7:09 PM:

You're correct, Erik. I'm just an old-fashioned purist about this stuff. :-)

Jim said, on May 7, 2007 8:32 AM:

Erik-

I would suggest that the most portable way to write the script is to use the -print option to expressly state your intent.

If you assume that it works in all environments, it may behave unexpectedly.

We always use -print even if it is the default because we have multiple versions of OS's and not all of them support it by default.

It makes it easier to develop scripts this way.

Al said, on June 22, 2008 7:33 AM:

If that pipe comes back empty, won't the rm -f act on the contents of whatever the current directory is?
Thanks,
Al

Dave Taylor said, on June 24, 2008 11:24 AM:

Good question, Al, but actually "xargs" shouldn't even invoke the given command if there's no data sent to it in the first place. Kind of breaks the pipe metaphor, but in a good way.

Man page:

"The xargs utility exits immediately (without processing any further input) if a command line cannot be assembled"

Jason Fare said, on May 1, 2009 11:04 AM:

Thanks so much! This is exactly what I was looking for. :)

Starbucks coffee cup I do have a lot to say, and questions of my own for that matter, but first I'd like to say thank you, Dave, for all your helpful information by buying you a cup of coffee!

I do have a comment, now that you mention it!











I will never send you any unsolicited email. Ever.






Check This Out Too...

 
Look for Answers
Need Help? Ask Dave Taylor!


Follow Me on Pinterest

Find Me on Google+
ADT on G+
© 2002 - 2013 by Dave Taylor. All Rights Reserved.

Note: This web site is for the purpose of disseminating information for educational purposes, free of charge, for the benefit of all visitors. We take great care to provide quality information. However, we do not guarantee, and accept no legal liability whatsoever arising from or connected to, the accuracy, reliability, currency or completeness of any material contained on this web site or on any linked site. Further, please note that by submitting a question or comment you're agreeing to my terms of service, which are: you relinquish any subsequent rights of ownership to your material by submitting it on this site. My lawyer says "Thanks".
"Ask Dave Taylor®" is a registered trademark of Intuitive Systems, LLC.