This is what our blog sitemap looks like:
semrush blog sitemap
If you are using WordPress, the sitemap will be created automatically.
Otherwise, creating a sitemap is relatively simple if you use a sitemap generator tool .
Once you have your sitemap, submit it to Google Search Console and Bing Webmaster Tools.
Like this:
And you can use Semrush's Site Audit tool to find and fix issues affecting your sitemap, among other things.
Issues tab in Site Audit
- Create a Robots.txt File
Robots.txt is a file that tells search engines which pages and files they should and should not crawl.
This is what it might look like:
Example robots.txt file
They are very important. They coordinate how estonia number data crawlers access your site, index it, and present your content to Internet users.
You can view your robots.txt file by typing in your homepage URL and adding /robots.txt.
To learn more about how to create a robots.txt file, what the syntax (computer language) means, and best practices, take a look at our robots.txt guide .
You can use Semrush Site Audit to help you find and fix issues with your robots.txt file.
Semrush Site Audit, Robots.txt Issues
- Check Manual Actions in Search Console
A clear attempt to violate or manipulate Google Webmaster Guidelines will result in manual action.
If your site is subject to manual action, some or all of your site will not appear in Google search results.
