"403 forbidden" when recursive download

Boerge Haga (etobhag@eto.ericsson.se)
Tue, 08 Jul 1997 18:39:47 +0200


I wonder if there is any way to circumvent the problems
that arise when you're trying to download multiple files
from a site by using e.g. webmirror (or I guess lwp-rget
would do the same) and the remote server responds by saying:
=================
403 Forbidden

Your client does not have permission to get URL 
/somedir/somewhere/ from this server.
=================
When using a web-browser one can easily download
e.g. the following file:

/somedir/somewhere/somefile.html

but not list the content on /somedir/somewhere/.

Any way to circumvent this problem?

The angel in me (?) tells me that this is probably
because the site don't want people to download without
using a web-browser.
The devil/problem-solver in me tells me to investigate
this and try to solve the problem.

A trace of the commmand would look like:

MyMachine:someplace {116} > webmirror --from
http://www.somewhere.com/somedir/somewhere/ --verbose --to somedir
Getting http://www.somewhere.com/somedir/somewhere/
Setting baseurl to http://www.somewhere.com/somewhere/somedir/
  Error: 403 Forbidden
  Linked from: command line
MyMachine:someplace {117} >
-- 
import	java.standard.disclaimer.*;
B o e r g e   H a g a, (Ph)+47 66 84 26 34, (Fax)+47 66 98 28 20
Ericsson AS,Norway,etobhag@eto.ericsson.se,(memo)ERI.ETO.ETOBHAG
I went to a garage sale.  "How much for the garage?"  "It's not
for sale."