What will the following robots.txt file do? User-agent:Googlebot Disallow:/*? User-agent:Scooter Disallow:

  1. Home

Question:What will the following robots.txt file do? User-agent:Googlebot Disallow:/*? User-agent:Scooter Disallow:

1.It will allow Google to crawl any of the dynamically generated pages. It will also allow thealtavista scooter bot to access every page

2. It will disallow Google from crawling any of the dynamically generated pages. It will also disallow the altavista scooter bot from accessing any page

3.None of the above

4. It will disallow Google from crawling any of the dynamically generated pages. It will allow the altavista scooter bot to access every page d. None of the above

Posted by R4R Team
  1. What will the following robots.txt file do? User-agent:Googlebot Disallow:/*? User-agent:Scooter Disallow:
Search
R4R Team
R4Rin Top Tutorials are Core Java,Hibernate ,Spring,Sturts.The content on R4R.in website is done by expert team not only with the help of books but along with the strong professional knowledge in all context like coding,designing, marketing,etc!