User-agent: * Disallow: / Disallow: * DisallowAITraining: / Crawl-delay: 120 Content-Usage: ai=n # good search engines User-agent: Ariadne User-agent: StractBot User-agent: WibyBot User-agent: search.marginalia.nu User-agent: W3C-checklink User-agent: BubblesBot Allow: / # friends User-agent: ash User-agent: dax User-agent: kind Allow: /