User-Agent: * Allow: / Disallow: /admin/* Disallow: /system/* Disallow: /control-panel/* Disallow: /.git/* Disallow: /ajax/* Disallow: /libs* Disallow: /site/* Disallow: /template* User-agent: AhrefsBot Disallow: / Crawl-Delay: 100000 Sitemap: https://www.yorkshireholidays.com/sitemap.xml