What is robots.txt?

Report
Question

Please briefly explain why you feel this question should be reported .

Report
Cancel

Want to know about Robot.txt.

in progress 0
SEO 3 months 1 Answer 48 views Pioneer 0

About priya12Pioneer

Answer ( 1 )

  1. arohi

    Please briefly explain why you feel this answer should be reported .

    Report
    Cancel

    Robots.txt is a text file to put into your site to tell search robots which pages you would like them not to visit . Robot.txt is mandatory for search engine because it prevents search engines from crawling your site.

    The location of file is most important it must in the main directory otherwise user agents will not be able to find it. This file consist of list of user agents , files and directories.

Leave an answer

Browse

Captcha Click on image to update the captcha .

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>