User-agent: Scrapy
Allow: /

User-agent: SemrushBot
Crawl-Delay: 5

User-agent: SemrushBot-SA
Crawl-Delay: 5

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

Sitemap: https://www.simonconn.com/sitemap_index.xml