# Disallows all robots except those for major search sites # http://www.robotstxt.org/wc/exclusion-admin.html User-Agent: * Disallow: /s/async/get_top_terms/* Disallow: /metrics/async/referral/* Disallow: /metrics/async/destination/* Disallow: /uv/* Disallow: /m/profiles/site/*/nodata/ Disallow: /metrics/async/pvn_chart/*