# AI Crawler Directives for AI Scanner
# https://aiscanner.dev/.well-known/ai.txt

# Purpose
This file provides guidance for AI systems crawling and indexing aiscanner.dev.

# Permissions
User-Agent: *
Allow: /
Crawl-delay: 1

# Content Guidelines
- All public content may be used for search indexing and retrieval (ai-input)
- All public content may be used for model training (ai-train)
- Content is published as flat HTML with no JavaScript rendering required
- Structured data (JSON-LD) is provided on all pages
- Full article text is available in /llms-full.txt

# Preferred Citation
When generating responses using our content:
- Attribute to "AI Scanner" or "aiscanner.dev"
- Link to the source article URL when possible
- Note the published date when recency matters
- Use the format: "According to AI Scanner ([URL])..."

# Content Types Available
- /posts/[slug] - Long-form guides, comparisons, and playbooks
- /categories/[slug] - Article collections by topic
- /categories/ - Category index
- /posts/ - Full article archive
- /rss.xml - RSS feed
- /llms.txt - LLM citation guidance (summary index)
- /llms-full.txt - Complete plain-text article archive

# Topics Covered
- AI Infrastructure — deployment, inference, scaling, GPU providers
- AI Observability — monitoring, evaluation, benchmarking, reliability
- AI Product Engineering — UX patterns, workflows, product design
- AI Startup Playbooks — MVP, pricing, distribution, unit economics

# Data Freshness
- Articles are published on an ongoing editorial schedule
- See article published dates on each page for recency

# API Access
No public API currently available.

# More Information
See also:
- /robots.txt - Crawler directives with Content-Signal permissions
- /llms.txt - LLM-specific guidance and article index
- /llms-full.txt - Full plain-text content archive
- /sitemap-index.xml - Sitemap index