# Define access-restrictions for robots/spiders # http://www.robotstxt.org/wc/norobots.html # By default we allow robots to access all areas of our site # already accessible to anonymous users User-agent: * Disallow: # Add Googlebot-specific syntax extension to exclude forms # that are repeated for each piece of content in the site # the wildcard is only supported by Googlebot # http://www.google.com/support/webmasters/bin/answer.py?answer=40367&ctx=sibling User-Agent: Googlebot Disallow: /*sendto_form$ Disallow: /*folder_factories$ Disallow: /author Disallow: /*search Disallow: /*None Disallow: /*searchterm Disallow: /*login_form Disallow: /*search_form Disallow: /*mail_password_form Disallow: /*folder1 Disallow: /*folder2 Disallow: /*folder3 Disallow: /*folder4 Disallow: /*folder6 Disallow: /*deep1 Disallow: /*deep2 Disallow: /*deep3 Disallow: /*listings Disallow: /*finance Disallow: /*sell Disallow: /*buy Disallow: /*services Disallow: /*credit Disallow: /*rent Disallow: /*residential Disallow: /*commercial Disallow: /*realtors Disallow: /*finance Disallow: /*contact-info Disallow: /schools/news Disallow: /twirl/news Disallow: /brenda/news Disallow: /business4/news Disallow: /sunrain/news Disallow: /techlight/news Disallow: /flow/news Disallow: /chameleon/news Disallow: /greenjet/news Disallow: /lite/news Disallow: /whiteblack/news Disallow: /brenda/sitemap Disallow: /estate/about-us/careers Disallow: /estate/about-us/company Disallow: /flow/welcome-portlet Disallow: /chameleon/help Disallow: /estate/buy-form Disallow: /estate/sell-form Disallow: /estate/about-us/company Disallow: /chameleon/help Disallow: /flow/welcome-portlet Disallow: /estate/about-us/careers