# Version 07.11.2025 # https://www.dhl.com/ # Settings for Norconex Crawler and the Cloud Native Crawler (for GCS) User-agent: dhl-cloud-crawler User-agent: dhl-norconex-crawler Allow: / Disallow: /master/ Disallow: /content/ Disallow: /DatPublic/ Disallow: /v1/mailitems Disallow: /TrackReport/ User-agent: * Allow: / Disallow: /master/ Disallow: /DatPublic/ Disallow: /v1/mailitems Disallow: /TrackReport/ Disallow: /sureroute-test-object.html Disallow: /at-en/home/global-forwarding/help-center/claims-complaints-compliments-form.html Disallow: /at-de/home/global-forwarding/help-center/claims-complaints-compliments-form.html Disallow: /at-de/home/globale-weiterleitung/hilfecenter/claims-complaints-compliments-form.html Disallow: /_sec/* # Discover Disallow: /discover/*/search-results Disallow: /discover/*/download-thanks Disallow: /discover/*/open-an-account/thanks Disallow: /discover/*/open-an-account/*/thank-you # GCCP Disallow: /express/mydhl/perfectyourshipment Disallow: /cp # eCS Finder Disallow: /fragments/dhl-finder-v1 Sitemap: https://www.dhl.com/sitemap-index.xml Sitemap: https://www.dhl.com/discover/sitemap-index.xml