# Grouped User-agents User-agent: Googlebot User-agent: Bingbot User-agent: Baiduspider User-agent: Yahoo! Slurp User-agent: DuckDuckBot User-agent: YandexBot ### Exclude Non-Primary JS ### Disallow: */js/excluded ### Disallow /test /draft /staging ### Disallow: /test Disallow: /draft Disallow: /staging ### Disallow wp- & preview ### Disallow: /wp-admin/ Disallow: /wp-login/ Disallow: /xmlrpc.php Disallow: /cgi-bin/ Disallow: *&preview= ### Disallow feed, trackback, query string ### Disallow: */comments Disallow: */feed Disallow: */search Disallow: */trackback Disallow: *? Disallow: *&p= ### Allow amp ### ### To put as comment when Disallow everything ### Allow: */amp$ Allow: */?amp$ # Disallow everyone else User-agent: * Disallow: /