Re: Emulate browser request

• Messages sorted by: [ date ][ thread ][ subject ][ author ]
• Next message: Sunil Dua: "SSL Layer"
• Previous message: White, Solomon: "Emulate browser request"

The "Referer:" header is your friend.

D

At 11:37 AM 7/13/99 -0600, White, Solomon wrote:
>Hi all--
>
>I'm a newbie to libwww.  I want to build a script to send a query to a
>search engine, get all the results (send more requests to get all the
>pages), then parse/sort/process the results.  I was able to connect to the
>search engine, but it responds to please access through the main page of the
>search engine.  I assume this means I'm not passing some of the right HTTP
>headers that the script on the other side is looking for.  Is there a way to
>capture exactly what my browser is sending when I submit the form on the
>main page and then duplicate that in my script?
>
>Thanks in advance,
>
>Solomon

• Next message: Sunil Dua: "SSL Layer"
• Previous message: White, Solomon: "Emulate browser request"