User-Agent: * Allow: / Sitemap: https://vidtext.ai/sitemap.xml User-Agent: GPTBot User-Agent: Claude-Web User-Agent: Anthropic-AI User-Agent: PerplexityBot User-Agent: GoogleOther User-Agent: DuckAssistBot LLM-Content: https://vidtext.ai/llms.txt Allow: / Allow: /blog