Tagged: User-agent in robots.txt file

0

What is the Use of Robots.txt file

This file is used by website owners to give instructions to the search engines about the website. Because as soon as any search engine comes to the website it directly reads the instructions written...