how to set custom robots.txt in blogger

How To Add Custom robots.txt To Blogger Blog?

by
How To Add Custom robots.txt To Blogger Blog?
Image Credits To :-https://www.freepik.com
Image Credits To :-https://www.freepik.com
Detailed explanation of each step:
  1. Log in to your Blogger dashboard: Go to blogger.com and enter your username and password.
  2. Go to Settings > Search preferences: This will take you to the Search Preferences section of your Blogger dashboard.
  3. Scroll down to the “Custom robots.txt” section: Here you will find a text box where you can add your custom robots.txt content.
  4. Past your custom robots.txt content into the text box: The robots.txt file is used to give instructions to search engine crawlers about which pages or sections of your blog should not be crawled or indexed. A typical robots.txt file will contain the following lines:

User-agent: [User Agent Name]

Disallow: [URL to be blocked from indexing]

  • The “User-agent” line is used to specify which crawler should receive the instructions, and the “Disallow” line is used to specify the URL that should be blocked from indexing. For example:

User-agent: *

Disallow: /search

  • This will prevent all crawlers from indexing the /search page on your blog.
  • Save your changes: Once you have added your custom robots.txt content, click the “Save Changes” button to publish your changes.
  • Your custom robots.txt file is now live and accessible at yourblog.com/robots.txt.
  • It is important to be careful when editing your robots.txt file, as it can have a significant impact on your blog’s visibility to search engines.
  • If you’re not sure what to do, it’s always a good idea to consult with a professional.

User-agent: *

Disallow: /search/

Disallow: /blog/page/

Allow: /

Sitemap:https://hykengamer.blogspot.com/sitemap.xml

Very Important (Note:- Replace This URL To Your URL Of Blog/Website.)

CLICK ON THE LINK BELOW TO GET MORE INFORMATION