That is a simple text file in which the website owner use to write the commands

Explanation of robots.txt file

for the search engine's crawler. It means that we can instruct the search engine's crawler with that file that we part of our site can be indexed or not. That commands are written in different coding which is only for search engine's crawler. You can see your robots.txt file just by following the below URL.