# www.hear.org/robots.txt # # maintained by PHILIP THOMAS # # update history: # 20080410/pt@hear.org excluded ISC and CGAPS "index.html"s ONLY (decommissioning those sites in favor of new hawaiiinvasivespecies.org pages) # 20080228/pt@hear.org excluded /hawaiiantgroup/ (this should only be crawled as www.hawaiiantgroup.org) # 20071009/pt@hear.org excluded /gcw/html/autogend/species/ (live pages now replaced by /gcw/species/) # 20070816/pt@hear.org excluded /pier/database/ # 20070704/pt@hear.org un-Disallowed "/ants/" [when this was changed from a redirect to a real subsite] # 20070117/pt@hear.org excluded PIER pohreports, sprep report, gisp toolkit (because they're copies from elsewhere) # 20061121/pt@hear.org allowed PPH to be indexed per LLL e-mail # previously updated: # 20060823/pt@hear.org # # HEAR web managers: Please DO NOT update this file yourself! # Send requests for updates to PT@HEAR.ORG # User-agent: * Disallow: /.ssh/ Disallow: /_derived/ Disallow: /_private/ Disallow: /_vti_cnf/ Disallow: /_vti_script/ Disallow: /admin/ Disallow: /alternatives2invasives/ Disallow: /archives (permanent)/ Disallow: /arundo/ Disallow: /aspnet_client/ Disallow: /bananapoka/ Disallow: /bimac/ Disallow: /biisc/index.html Disallow: /bts/ Disallow: /catherinepuckett/ Disallow: /cgaps/index.html Disallow: /conferences/miconia2009/ Disallow: /drliu/ Disallow: /drziller/ Disallow: /feralcats/ Disallow: /fiddlewood/ Disallow: /fireweed/ Disallow: /Folder Settings/ Disallow: /gcw/html/autogend/species/ Disallow: /hawaiiantgroup/ Disallow: /honeysuckle/ Disallow: /ironwood/ Disallow: /ironwoods/ Disallow: /ivygourd/ Disallow: /javascript/ Disallow: /juniperberry/ Disallow: /kisc/index.html Disallow: /kisc/presentations/ Disallow: /kudzu/ Disallow: /mcac/ Disallow: /mcerc/ Disallow: /misc/index.html allow: /misc/coquifreemaui/ Disallow: /momisc/index.html Disallow: /oisc/index.html Disallow: /pampasgrass/ Disallow: /pier/database/ Disallow: /pier-redirects-KeepForever/ Disallow: /pier/pdf/gisp_toolkit.pdf Disallow: /pier/pdf/invasive_species_technical_review_and_strategy.pdf Disallow: /pier/pdf/pohreports/ Disallow: /rifa/ Disallow: /stats/ Disallow: /temp/ Disallow: /usgs-brd-pierc-hnpfs/ Disallow: /www.hear.org_stagingarea/