This is the mail archive of the
mailing list for the Cygwin project.
Re: Wget ignores robot.txt entry
On Fri, Feb 14, 2003 at 03:04:10AM -0000, Max Bowsher wrote:
>Randall R Schulz wrote:
>> Wget is orphaned? That's bad news, since it seems to have it all over
>> cURL. (Sure. Go ahead and prove me wrong. I might as well get it over
>> with... for now.)
>cURL doesn't do recursive web-suck (does it?)
>Yes, wget is orphaned. There's no one on the wget mailing list who has CVS
>write access. Which is a great shame, as there are a surprising amount of
>patches being sent in.
Sounds like one of you should volunteer for this duty. :-)
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
Bug reporting: http://cygwin.com/bugs.html