Advertisement
shakil97bd

Best robots.txt file example for WordPress website

Jun 6th, 2017
530
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.28 KB | None | 0 0
  1. ******************** Best robots.txt file example for WordPress website *********************
  2.  
  3. User-Agent: *
  4. Allow: /?display=wide
  5. Allow: /wp-content/uploads/
  6. Disallow: /wp-content/plugins/
  7. Disallow: /readme.html
  8. Disallow: /refer/
  9.  
  10. Sitemap: http://www.website.com/sitemap.xml
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement