Create a robots.txt file to control how search engines crawl your site.