You should create robots.txt in the root of your wordpress installation if you don’t have this file.
Typical Example of WordPress robots.txt
sitemap: https://wbxpress.net/sitemap.xml User-agent: * # disallow all files in these directories Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /archives/ Disallow: /*?* Disallow: *?replytocom Disallow: /comments/feed/ User-agent: Mediapartners-Google* Allow: / User-agent: Googlebot-Image Allow: /wp-content/uploads/ User-agent: Adsbot-Google Allow: / User-agent: Googlebot-Mobile Allow: /
Bro ! What is the use of this robots file ?
Better idexing ??
This file helps search engine robots, what to index and what not.
how we can use it on blogger
hi how can i change my robot.txt so that it will not show my backlinks in moz and ahref.
hey how to use robot txt file and how can i use…
can we use same for blogspot blogs. ?
yes you can.