Why Robot.txt file is used?

  1. Home

Question:Why Robot.txt file is used?

1.To block the crawler from crawling a particular portion of the website

2.To block Home page of the website

3.To Pass link juice when given link in other website

4.None of the above

Posted by R4R Team
  1. Why Robot.txt file is used?
Search
R4R Team
R4Rin Top Tutorials are Core Java,Hibernate ,Spring,Sturts.The content on R4R.in website is done by expert team not only with the help of books but along with the strong professional knowledge in all context like coding,designing, marketing,etc!