Robots.txt kya h bloger blog me robots.txt kaise add kare

Dosto jab hum ek blog banate h to usme article ke saath saath kai pages bhi banane hote h . Un pages  me se kai pages ko hume Google me show karana hota h aur kuch pages ko hume Google me show nahi karana hota h . Robots txt asi hi file hoti h jo ki hamare blog ya website ke root file me ek chota file hota h . Jo ki search engines ko batata h kin pages ko crawl karna h aur kis page ko crawl nahi karna h .

Aaj ke post me hum robots txt ke bare me bistar se jankari dene ki koshish karenge . Robots txt ke bare me jaanne ke liye hamari article Robots txt kya h bloger blog me robots.txt kaise banaye ko pura awasya pade .



Blogs ki basic settings kaise kare

Robots.txt kya h 

Robots txt file kya h .

Robots txt file blog ya websites ke root folder me sthith ek chota sa file hota h . Ye ek jaruri file hota h  Jo ki search engines ke bots ko batata h websites ke kin  parts ko crawl karna h aur kin parts ko crawl nahi karna h .

Halaki ye jaruri nahi h ki search engines ko robots txt ke nirdesho ko manna hi padega . Par search engine robots txt ko jarur visit karke jaruri information jutate h .

Search engines ke bots jab bhi kisi websites ya blog me aate h to sabse pahle we websites ke robots txt file ko hi search karke use scan karta h .

Kyuki websites ke pages sambandhit sari jankari robots txt file me hota h isiliye search engines ke bots sabse pahle robots file ko hi search karke . Aur sirf  robots txt file  ke nirdeshit pages aur part ko hi crawl karta  aur  Websites ke baki pages ko yo hi chod deta h .

Search engines robots txt file ke dwara bataye gaye pages ko crawl karke indexed kar deta h . Jisse websites ke indexed pages search engines me show hone lagta h . Ab to aap logo ko robots txt file ke bare me samajh aa gayi hogi . Chaliye aage hum iske bare me kuch aur baate jannevki koshish karenge .

Blog ko google search console me kaise add kare

Label kya h blog me label kaise add kare

Robots txt file blog ya websites ke liye kyun jaruri h 

Search engines ke bots jab bhi kisi blog ya websites par aate h to sabse pahle us blog ya websites ke robots txt file ke bataye anusar pages ko hi crawl aur index karta h . 

Par agar kisi blog ya websites me robots txt file na ho to search engine ke bots us websites ke sare pages ko crawled kar leta h aur usi anusar indexed bhi kar leta h .

Yaani hum kah sakte h robots txt file search engines kecbots ko instruction dene ka kaam karta h ki ek websites ke kin hisso ko crawl aur index karna h aur kin hisso ko crawl nahi karna h .

Jin sites me search engines ke  bots ko koi instruction nahi milti h un sites ke sare hisso yani pages ko crawl karke indexed karne lagta h . Jin pages ko aap indexed nahi karna chahte ho un pages ko bhi indexed karna suru kar deta h . 

Isiliye websites me robots txt file ka hona bahut jaruri h .

Favicon kya h bloger me kaise jode

Robots txt file ke fayde 

Robots txt file ke fayde me se kuch yanha share kar raha hun .

1  . Apne blog ke kisi private page jise publicly na karna chahte ho use crawal karne se rok sakte h .

2 .  Apne important  pages ko fast crawl aur indexed kar sakte h .

3  .  Kam value wale pages par crawling se rok laga sakte h .

4 .   Jaldi crawl aur indexing se blog ko grow karne me madad hoti h .

Robots txt file ke format 

Robots txt file ka format dekhne me kuch aisa hota h .

User Agent – *

Allow : /

Disallow : /

Yaanha User Agent  matlab search engine crawlers . Agar aap jis crawler ko nirdesh dena chahte h us search engine ka name mention kar sakte h . Par agar aap chahte ho ki sabhi search engine apke site ko crawl kare  to aap  ( * ) ka Nissan laga sakte h .

Allow aur Disallow se aap jis pages ko crawal aur index karana chahte h aur jinhe na karana chahte ho unhe mention kar sakte ho .

Jaise niche aap dekh sakte h blog ki robots.txt kuch is tarah ki show hogi .

User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Allow: / Sitemap: http://xyz.com/sitemap.xml

Blog websites ki robots txt file kaise pata kare 

Kisi bhi blog ya websites ki robots txt file check karne ke kiye aapko niche diye gaye tarike ko apply kare .

              https://example.com/robots.txt 

Yaanha example.com ki jagah jis blog ki robots.txt check karna h uski url enter karke search baar me click kare . Aapke samne us site ki robots txt file show hone lagegi .

Robots.txt file kaise banaye 

Robots.txt ko bnane ke liye sabhi tarah ke text editor ka usr kar sakte h . Jaise notepad se sabse pahle ek text file banaye aur uska naam robots.txt se save kar le .

Ab apne websites ke root directory me upload kar le . Ek websites me sirf ek hi  robots.txt file hona chahiye.

Bloger blog me robots txt kaise add kare 

Kisi bhi bloger site me robots .txt file add karne ke liye .

•  Sabse pahle bloger ke dashboard me settings ke option par click kare .

•  Ab page ko niche scroll karte huye niche crawler and indexing ke option me aaye .

Robots.txt

•   Ab custom robots.txt ko enable kare .

•   Custom robots.txt me click kare aapke samne ek window khulegi.

Custom robots.txt

•    aapke dwara banaye huye robots.txt file ko enter kijiye .

Ab finally save button par click kare ab aapke blog me robots.txt sucessfully     add ho chuka h .  

Aaj aapne kya sikha -- Robots.txt file kya h kaise kaam karta h blog keviyevkyun jaruri h . Bloger blog me custom robots.txt kaise add kare .

Dosto umeed karta hun ab aap ko Robots.txt ke bare me acchi jankari ho chuki hogi . Agar aap ko meri ye post robots.txt kya h bloger blog me robots.txt kaise add kare acchi aur jankari purn lagi ho to apne dosto aur naye blogers ke saath jarur share kare . Post sambandhit comment ya phir koi suggestion ho to comments box mevjarur likhe .