Helps You to post a sitemap of your website to Google. A sitemap is sort of a map that assists Google discover and comprehend many of the web pages on your internet site. txt file is then parsed and may instruct the robot as to which pages aren't being crawled. https://www.youtube.com/watch?v=EGBkutWZZTk