Re: Hacked version of wwwstat - new version, or new name?

Rob (wlkngowl@unix.asb.com)
Fri, 22 Aug 1997 00:34:09 -0500


On 21 Aug 97, David Welton wrote:

> On Thu, 21 Aug 1997, Rob wrote:
> 
> > Sounds interesting! Why not add something that shows the URLs of 
> > referring pages from the another site.
> 
> This is a different log, usually, and can't be easily correlated with the
> main one.

That's right. I forget referrers don't have a time stamp.

> > Another option would be to show or not show robots and spiders (based 
> > on hits to robots.txt, side.idx but also from exploring most of the 
> > site--ie, probably robots).
> 
> robots.txt?  Is this part a robot 'convention'?  I'm not really familiar
> with robots, other than the basics.

Yes, it is. It's contains information telling conforming robots what  
directories or files not to index, or even which robots should stay 
out of the site etc.

> > Heck, to make it more compex, analysis of how many visitors use 
> > graphical browsers or style sheets is useful too.
> 
> Once again, another log.
> 
> I suppose it would be possible to create some helper applications...
> infact it would be quite easy.  I suppose I could do this, while I'm at
> it...

I've got a referer.pl hack I wrote a while ago (check my page at 
http://www.asb.com/usr/software.htm - it should still be online from 
that page...).


Rob
 
---
Robert Rothenburg Walking-Owl (wlkngowl@unix.asb.com)
(Se habla PGP.) http://www.wusb.org/mutant/