Skip to content Skip to sidebar Skip to footer

How To Create Robots txt File | Custom Robots Header Tags In Bloggers Blog In 2023

 Hello Users Welcome To The Queiry.com

Today We Are Going To Discuss About The Robots.txt File For Blogger.In Wordpress There Are Many Plugin Like Yoast SEO And Rank Math These Are Very Premium Plugin Also Available Free To Download In Wordpress For Making Easy SEO(Search Engine Optimazation).These Plugin Generate Sitemap And Robots.txt File In Just One Click But In Blogger There Is No Plugin Can Not Be Used So You Can Not Generate In Blogger So Users Needs To Generate/Create It Manually And Add It To  Blogger/Blogspot.com.

How To Create Robots txt File | Custom Robots Header Tags In Bloggers Blog In 2023

What Is Robots.txt File?

Robot.txt File Is File/Folder/Link Where Access Of Your All Content Permission Of Your Website To The Crawler/Robots/Bots Of Search Engines Are Managed.

Users/You Can Access Your Robots.txt File In Bloggers Setting Option And in Wordpress User Can get In Yoast Or Rank Math Seo Plugin.



Here Is Example Of Queiry.com Websites Robots.txt File https://www.queiry.com/robots.txt
https://www.YourDomainName.com/robots.txt

Below There Is A Example Of Our Blog Robots.txt File
User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow: /search
Allow: /

Sitemap: https://www.queiry.com/sitemap.xml
Sitemap: https://www.queiry.com/atom.xml?redirect=false&start-index=1&max-results=150

What Is Importance Of Robots.txt File?
Robots.txt File Is Usually Created For Crawler And Robots Of Search Engine I.e Google,Duck Duck Go,Bing.Yahoo
These Crawler Usually Before Visiting To Users/Your Blog  Visit The Blogs/Website's Robots.txt File/Link For Getting Permission Of Crawling The URL 's.In Robots.txt File user Give Access Or Denied The Permission To Crawlers.

How To Create Robots.txt File For Blogger?
First Of All Go Yourdomain.com/robots.txt.


Here You Can See Automatic Created Blogger Robots.txt File.
Now Just Copy Whole Code.
Go To Your Blogger Dashboard.




Then Just Click On Setting Option.
Now Scroll Down Or Just Press "Ctrl+F" From Keyboard And Search Robots.txt.As Shown Below







Here You Can Get Robot.txt Toggle Button Just On It.
Then An Option Just Below It Activated Now Click On it.
A Pop up Window Open Paste Whole Code Recently You copied And Save It. As Shown In Images


Alert: In Robots.txt File You/users Can Add Multiple Manually Generated Sitemap.If You/User Have Not Generated yet It Then Just Click Here Of Link Given Just Below To Generate.
All Done.


What Are Custom Robots Header Tags  In Blogger And How to Manage Them?
Just Below The Robots Txt Option There Is An Option Also Custom Robots Header Tags  Just On It As Shown In The Pictures.


Here Now All The Options 
Home Page Tags
Archive And Search Page Tags
Post And Page Tags 
Now Activated Now Manage As Given Below And Also Show In Pictures.

Custom Robot Tags Setting For Blogger
Custom Robot Tags Setting For Blogger


Custom Robots Header Tags Are Specially For Giving Permission To The Crawler/Bot Of Search Engine. 
We Have Created/made Best Setting For Blogger Indexing 
In Home Page Tags Just On The Two Toggle Option One Is " All " And Second Is  "noodp" As Shown Below In Images

Custom Robot Tags For Whole Home Page
Custom Robot Tags For Whole Home Page



It Means You /Users Are Giving Pemission To Crawl The All Page/Post/Article Of Your Blog's Homepage With No  Directory.

In Secon Option Archive and search Page tags You Can Just On The Two Option One Is "Noindex" And Second " Noodp" As Shown In Images


Custom Robot Tags For Search Page And Archive Pages
Custom Robot Tags For Search Page And Archive Pages


It Means You Are Dening To Crawling the Search Page And Archive Pages.If In other Condition You On The " All" Toggle option Then It May Not Make any kind Of issue But In Google Search Console In Covrage Section May Google Show Some Issue.

In Third Option Post and page tags Just On Both Toggle option Like As Home Page Tags One Is "All" And Second One Is " Noodp"


Custom Robot Tags For Post Page or Article
Custom Robot Tags For Post Page or Article


Both Option Are best For good SEO .

What If I You/user Do Not Want to Index A Single Page/Post/Article?
But If You/Users Created Some Page/Post/Article Which You Do Not Want To Index In Google Then Before Publishing On Write Site Of Your Bloggers Edit Post Dashboard There Is An Option name As Custom Robot Tags.Where You Can select All Noindex Nofollow None Noarchive Nosnippet Noodp Notranslate Noimageindex Unavailable_after


Custom Robot Tags For Single Post Page or Article
Custom Robot Tags For Single Post Page or Article



In Robots.txt File User Can Add One Or More Sitemap If They Want And Manage Permission Of  Crawling.


Thanks For Visiting Queiry.com Keep Smilling :)
 Keep Sharing.
 Regards Queiry.com

Post a Comment for "How To Create Robots txt File | Custom Robots Header Tags In Bloggers Blog In 2023"