So Google are now offering a great new free tool in there webmaster area. Some webmasters may still find creating a perfectly structured Robots.txt file quite difficult. With the new tool on offer you can now create one simply by entering the file names or directories which you wish not to be displayed.
Although this is not a totally new idea or concept, Google have created this tool so its trustworthy, reliable and dependable just like myself 
- Ok so now all webmasters should have no reason for not blocking duplicate linked content on your sites and from stopping spiders indexing pages you do want to be.
For more information on how to use this new tool and maybe read abit more about it functions check out Google’s Webmaster Central Blog
Subscribe to our blog to receive new posts and updates by Email