User-Agent: * Allow: / Disallow: /shopcars/car-* Disallow: /shopcars/*/?page=* Disallow: /shopcars/?page=* Disallow: /api/ Disallow: /final Disallow: /pending Disallow: /processing Sitemap: https://carhive.com/sitemap.xml