How To Create Robots txt File | Custom Robots Header Tags In Bloggers Blog In 2023

Hello Users Welcome To The Queiry.com

Today We Are Going To Discuss About The Robots.txt File For Blogger.In Wordpress There Are Many Plugin Like Yoast SEO And Rank Math These Are Very Premium Plugin Also Available Free To Download In Wordpress For Making Easy SEO(Search Engine Optimazation).These Plugin Generate Sitemap And Robots.txt File In Just One Click But In Blogger There Is No Plugin Can Not Be Used So You Can Not Generate In Blogger So Users Needs To Generate/Create It Manually And Add It To Blogger/Blogspot.com.

How To Create Robots txt File | Custom Robots Header Tags In Bloggers Blog In 2023

What Is Robots.txt File?

Robot.txt File Is File/Folder/Link Where Access Of Your All Content Permission Of Your Website To The Crawler/Robots/Bots Of Search Engines Are Managed.

Users/You Can Access Your Robots.txt File In Bloggers Setting Option And in Wordpress User Can get In Yoast Or Rank Math Seo Plugin.

Here Is Example Of Queiry.com Websites Robots.txt File https://www.queiry.com/robots.txt

https://www.YourDomainName.com/robots.txt

Below There Is A Example Of Our Blog Robots.txt File

User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow: /search
Allow: /

Sitemap: https://www.queiry.com/sitemap.xml
Sitemap: https://www.queiry.com/atom.xml?redirect=false&start-index=1&max-results=150

What Is Importance Of Robots.txt File?

Robots.txt File Is Usually Created For Crawler And Robots Of Search Engine I.e Google,Duck Duck Go,Bing.Yahoo

These Crawler Usually Before Visiting To Users/Your Blog Visit The Blogs/Website's Robots.txt File/Link For Getting Permission Of Crawling The URL 's.In Robots.txt File user Give Access Or Denied The Permission To Crawlers.

How To Create Robots.txt File For Blogger?

First Of All Go Yourdomain.com/robots.txt.

Here You Can See Automatic Created Blogger Robots.txt File.

Now Just Copy Whole Code.

Go To Your Blogger Dashboard.

Then Just Click On Setting Option.

Now Scroll Down Or Just Press "Ctrl+F" From Keyboard And Search Robots.txt.As Shown Below

Here You Can Get Robot.txt Toggle Button Just On It.

Then An Option Just Below It Activated Now Click On it.

A Pop up Window Open Paste Whole Code Recently You copied And Save It. As Shown In Images

Alert: In Robots.txt File You/users Can Add Multiple Manually Generated Sitemap.If You/User Have Not Generated yet It Then Just Click Here Of Link Given Just Below To Generate.

All Done.

https://www.queiry.com/2021/03/how-to-generate-xml-sitemap-for.html

What Are Custom Robots Header Tags In Blogger And How to Manage Them?

Just Below The Robots Txt Option There Is An Option Also Custom Robots Header Tags Just On It As Shown In The Pictures.

Here Now All The Options

Home Page Tags

Archive And Search Page Tags

Post And Page Tags

Now Activated Now Manage As Given Below And Also Show In Pictures.

Custom Robot Tags Setting For Blogger

Custom Robots Header Tags Are Specially For Giving Permission To The Crawler/Bot Of Search Engine.

We Have Created/made Best Setting For Blogger Indexing

In Home Page Tags Just On The Two Toggle Option One Is " All " And Second Is "noodp" As Shown Below In Images

Custom Robot Tags For Whole Home Page

It Means You /Users Are Giving Pemission To Crawl The All Page/Post/Article Of Your Blog's Homepage With No Directory.

In Secon Option Archive and search Page tags You Can Just On The Two Option One Is "Noindex" And Second " Noodp" As Shown In Images

Custom Robot Tags For Search Page And Archive Pages

It Means You Are Dening To Crawling the Search Page And Archive Pages.If In other Condition You On The " All" Toggle option Then It May Not Make any kind Of issue But In Google Search Console In Covrage Section May Google Show Some Issue.

In Third Option Post and page tags Just On Both Toggle option Like As Home Page Tags One Is "All" And Second One Is " Noodp"

Custom Robot Tags For Post Page or Article

Both Option Are best For good SEO .

What If I You/user Do Not Want to Index A Single Page/Post/Article?

But If You/Users Created Some Page/Post/Article Which You Do Not Want To Index In Google Then Before Publishing On Write Site Of Your Bloggers Edit Post Dashboard There Is An Option name As Custom Robot Tags.Where You Can select All Noindex Nofollow None Noarchive Nosnippet Noodp Notranslate Noimageindex Unavailable_after