robots.txt

[M.W. Chang]

I have deleted apache from my linux server. will not bother to look back.

Ken Moffat wrote:
> Ken Moffat wrote:
>> Anyone know the function of robots.txt? I have seen attempted access to 
>> it in my apache logs.
> 
> 
> Ah, never mind, I found a page describing this functionality.
> 
> 
> http://www.robotstxt.org/wc/exclusion.html
> 

-- 
  .~.    Might, Courage, Vision. In Linux We Trust.
 / v \   http://www.linux-sxs.org
/( _ )\  Linux 2.4.20
  ^ ^    2:24am up 16 days, 19:29, 0 users, load average: 0.00, 0.00, 0.00