You should create robots.txt in the root of your wordpress installation if you don’t have this file.
Typical Example of WordPress robots.txt
sitemap: https://wbxpress.net/sitemap.xml User-agent: * # disallow all files in these directories Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /archives/ Disallow: /*?* Disallow: *?replytocom Disallow: /comments/feed/ User-agent: Mediapartners-Google* Allow: / User-agent: Googlebot-Image Allow: /wp-content/uploads/ User-agent: Adsbot-Google Allow: / User-agent: Googlebot-Mobile Allow: /
Bro ! What is the use of this robots file ?
Better idexing ??
This file helps search engine robots, what to index and what not.