Roy T. Fielding,
Maintaining Distributed Hypertext Infostructures:
Welcome to MOMspider's Web.
# MOMspider-0.1a Avoid File: Lists URL prefixes to avoid or leaf. # New URL prefixes can be added when the program is not running. # The file format is: EntryType URLprefix [ExpireDate] # where EntryType = "Avoid" or "Leaf" # URLprefix = the full URL prefix for which this entry applies # ExpireDate = [*] for never expire # or [date] (see wwwdates.pl for valid date formats) # This file is automatically generated, so don't bother changing the format. Avoid http://www.ncsa.uiuc.edu:8001/ [*] Avoid http://www.w3.org:8001/ [*] Avoid http://www.contrib.andrew.cmu.edu:8001/sokoban/ [*] Leaf http://www.ncsa.uiuc.edu/SDG/Software/Mosaic/Docs/whats-new.html [*] Leaf http://www.ncsa.uiuc.edu/SDG/Software/Mosaic/MetaIndex.html [*] Leaf http://www.w3.org/hypertext/DataSources/ByAccess.html [*] Leaf http://www.w3.org/hypertext/DataSources/bySubject/Overview.html [*] Avoid http://www.whitehouse.gov/ [*] Leaf http://www.ics.uci.edu/Admin/ [*] Avoid http://www.ics.uci.edu/Test/momtest.html [Sat, 02 Apr 1994 00:00:00 GMT] Avoid http://betelgeuse.com/name.html [Fri, 31 Dec 1999 09:30:00 GMT] Avoid http://simplon.ics.uci.edu:8001/ [Thu, 29 Sep 1994 23:59:59 GMT]
[Back to MOMspider Design or Up to Contents]