Can LWP/libwww to "streaming" read?
John Chambers (jmc@nexen.com)
Thu, 2 Oct 1997 15:49:34 -0400 (EDT)
The application I'm looking at needs to grovel thru a bunch of URLs,
looking for specific things of interest. In most cases, it can
determine by some simple heuristics that the file it's looking at
isn't worth any further examination, and can close the connection,
saving time and net traffic.
Can LWP support this sort of access? Or does it have to read the
entire thing in first before returning to the caller?
If so, are there any code examples that illustrate this? Say, a
little test that will look for "fubar" in the first 10 lines, and if
that string isn't there, closes the connection and goes on to the
next URL in <>.