Robots.txt Can be a file that exists on the root directory of each Site and can be employed to instruct engines like google on which directories/files of the website they might crawl and contain of their index. Due to this, an even better intention than hoping for a great deal https://news.rafeeg.ae