User-agent: * Disallow: /spesial/widgets/ Disallow: /shared/ User-agent: Googlebot-News Disallow: /annonsorinnhold/ # start AI crawler block User-agent: CCBot Disallow: / User-agent: GPTBot Disallow: / User-agent: anthropic-ai Disallow: / # end AI crawler block Sitemap: https://e24.no/sitemap.xml Sitemap: https://e24.no/secondary-sitemap/sitemap.xml