Disallowed URLs will still collect links says Google
If you are into SEO, you would know that there is a concept of Disallowing links. This basically means that you are telling Google not to index the URL in their search results. To do this, you have to add some tags to your robots.txt and then Google’s crawler bots will not be able to […]