Search Engine Land » SEO » Crawlers, search engines and the sleaze of generative AI companies Crawlers, search engines and the sleaze of generative AI companies AI companies see the openness of the web as permitting large-scale crawling to obtain training data. So what should publishers do? The boom of generative AI products over the past few months has prompted many websites to take countermeasur