Re: How to 'solve' 401 HTTP-errors?

• Messages sorted by: [ date ][ thread ][ subject ][ author ]
• Next message: Robin Berjon: "Re: How to 'solve' 401 HTTP-errors?"
• Previous message: =cw4t7abs: "Re: How to 'solve' 401 HTTP-errors?"
• In reply to: Eric J. Schwertfeger: "Re: How to 'solve' 401 HTTP-errors?"
• Reply: Eric J. Schwertfeger: "Re: How to 'solve' 401 HTTP-errors?"

On Tue, 9 Feb 1999, =cw4t7abs wrote:

> >"Larry W. Virden" wrote:
> >>
> >> My first thought was that it might be _intentional_ - some people put
> >> a lot of work into keeping web crawlers off their system...
> >
> >This was my first thought as well, and if that is the reason that I
> >cannot request pages on these sites then I'll respect that.
> >However, that still keeps me wondering how the server 'knows' that the
> >page is NOT being requested by a Web browser, but rather by a robot...
> >Does anybody have the answer to that question?
> 
> 
> agent

And in some cases, you must handle their cookies.

• Next message: Robin Berjon: "Re: How to 'solve' 401 HTTP-errors?"
• Previous message: =cw4t7abs: "Re: How to 'solve' 401 HTTP-errors?"
• In reply to: Eric J. Schwertfeger: "Re: How to 'solve' 401 HTTP-errors?"
• Reply: Eric J. Schwertfeger: "Re: How to 'solve' 401 HTTP-errors?"