Roy T. Fielding,
Maintaining Distributed Hypertext Infostructures: Welcome to MOMspider's Web.

Appendix D

# MOMspider-0.1a Sites File:  Lists IPaddress:port locations we've checked
# for a /RobotsNotWanted.txt file and followed its directions.
# New sites can be added when the program is not running.
# The file format is:  EntryType  IPaddress:Port  [ExpireDate]
# where EntryType   = "Site"
#       IPaddress   = the full hostname or IP address for the site
#       Port        = the numeric TCP port for the site (write 80 for default)
#       ExpireDate  =  [*] for never expire (i.e. never check this site)
#                   or [date] (see wwwdates.pl for valid date formats)
#                      Entries are automatically cleared after 7 days
# This file is automatically generated, so don't bother changing the format.

Site www.ics.uci.edu:80 [*]
Site betelgeuse.com:80 [Fri, 31 Dec 1999 09:30:00 GMT]
Site simplon.ics.uci.edu:8001 [Thu, 29 Sep 1994 23:59:59 GMT]

[Back to MOMspider Design or Up to Contents]