Robots.txt ko kaisa apna Website/Blog ma add kara

Robots.txt ko kaisa apna Website/Blog ma add kara
Ager apna apna khud ki website banaya h aur app apna site pr regular article dalta rahata h to app chahata h ki uss article ka jariya appka site pr jayada sa jayada log aya aur appki site popular ho mager isska liya appko apna site ki sitemap aur robots.txt file honi bahut jaruri h. Aj mai iss post(Article) ma robots.txt file ka bara ma hi bt karna wala hu. Ager app Sitemap kya h ussa Google sa kaisa jora isska bara ma janna chata h to niche click kara

Robots.txt Kya Hai
Robots.txt ak simple .txt file hoti h jo kisi v search engine (eg. Google,Bing,Yahoo) spider ko ya batata h ki hamara Website ma sa kon kon si chiz ko index karna h aur kon kon si chiz ko index nhi karna h.

Blogger ma Custom Robots.txt add kara
Step 1: sabsa pahala appko .xml sitemap generate kara nicha click kr ka
Step 2: Sitemap generate hona ka bad ussa copy kr la ab apna Blogger Dashboard>>Settings>>Search Preference>>Costom robots.txt ma jaka Edit>>Yes pr click kr ka wo Generated sitemap ko Paste kr ka Save kr da.

Step 3: Ab app chake kr la ki appka Robots.txt file acchi taraha sa upload hua h ya nhi uska liya app nicha ki formation ko follow kara aur issa browser ma open kara app dakhanga ki appna jo robots.txt file upload kiya h wahi open hoga.
http://Your website URL/robots.txt

Robots.txt ki Parameter ki jankari

# Blogger Sitemap generated on 2016.05.19
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://YOURBLOGNAME.blogspot.com/atom.xml?redirect=false&start-index=1&max-results=500
 

User-agent: *
Robots.txt file ma iska matlab ya h ki ya section ma savi kuch robots.txt ka dawara crawler ka liya allow hai.

Disallow: /search
Iss parameter ka matlab ya h ki /search root disallow hai isiliya search engine spider isko crawl nhi karaga q ki ya Disallow hai.

Allow: /
Iss parameter ka matlab ya h ki appka website ki sabhi “/” wali root search engine spider crawl karaga.
Issko search engine index karaga qki “/” root allow h.

Sitemap:

Sitemap: http://YOURBLOGNAME.blogspot.com/atom.xml?redirect=false&start-index=1&max-results=500
Isska bara ma maina niche ki post ma details ma bataya h ussa pada.

By Default robots 25 post ko hi index kr pata h mager Sitemap ka jariya app 500 posts ko index kr sakta h jab appka website ma 500 sa jayada posts ho jaya to app ak aur sitemap bana la jo 1000 tk ki post ko index kr saka nicha example dakha.

Sitemap: http://YOURBLOGNAME.blogspot.com/atom.xml?redirect=false&start-index=1&max-results=500
Sitemap: http://YOURBLOGNAME.blogspot.com/atom.xml?redirect=false&start-index=501&max-results=1000
 

Disallow Page, Post 

Ager app chaya to robots.txt ki madat sa kisi v post ya page ko disallow kr sakta h taki Search Engine ussa index na kara aur wo Search engine ma Show na ho. 

Post Disallow Example:
Disallow: /2016/03/http://hindimapada.blogspot.in/2016/06/android-smartphone-ma-facebook-twitter.html
Formation: Disallow: /Year/Month/Post url

Page Disallow Example:
Disallow: /p/about.html
Formation: Disallow: /p/Page url without domain name

                    Android smartphone ma 2Whatsup/Facebook/Twitter chalaya
 


Agar apko ya blog sa related aur v kuch jankari chaiya to please comment kara aur ager ya post acchi lagi ho to issa share jarur kara.

Comment Rule:
1. Aap direct comment ma apna link nhi da sakta h lakin ager aap kisi ki help karna ka liya ussa reply ka jariya koi v link provide kar sakta h.
2. Ager aap koi problem ka solution ka liya comment ker rha h to "Notify Me" per jarur click kara.