google snippet optimization tool - An Overview

To dam Googlebot from crawling your page, make a robots.txt. A robots.txt is just not a mechanism for keeping a Web content outside of Google. To maintain a Web content out of Google, use the noindex tag or directives, or password-guard your webpage. To block Googlebot from indexing your web page but nevertheless permit crawling, include a noindex

read more