# City of Batavia robots.txt
# Revised: 2006-06-09
# Existing links a robot can find in the pages are OK.
# But we need to exclude some directory structures from the old Web site
# so that robots quit generating false information in the logs
# (they're stuck on a few old files that don't exist any more, but since we're using a
# custom error page, they're not getting an HTTP 404 error back)
#
# Revised 2007-03-23
# Explicity block some of our "include" scripts as well, as some bots are getting stuck on them.
# One (Onvia.com) got so bad that it was unintentionally creating a denial-of-service attack!
#
# Revised 2008-05-01
# Added /employee (article 1425) to the list

User-agent: *
Disallow: /Content/COBBuildMenu.aspx
Disallow: /Content/COBBuildMoreInfo.aspx
Disallow: /Content/VONBuildfooternav.aspx
Disallow: /Content/VONBuildMoreInfoHTML.aspx
Disallow: /depts
Disallow: /permits
Disallow: /triathlon
Disallow: /city
Disallow: /projects
Disallow: /community
Disallow: /citycouncil
Disallow: /history
Disallow: /currents
Disallow: /employee
Disallow: /Content/templates/?a=1425