Guides

Technical implementation, pricing strategy, and deal teardowns for the pay-per-crawl era.

Deal Teardown 2026-01-19

AI Content Licensing Models: robots.txt vs. RSL vs. Direct Deals Compared

Complete comparison of AI content licensing approaches. Learn when to block with robots.txt, monetize via RSL marketplace, or negotiate direct deals like News Corp and Reddit.

Read guide →
Implementation 2026-01-19

The Complete AI Crawler Directory: Identification, Behavior, and Blocking Instructions

Comprehensive directory of AI crawlers from OpenAI, Anthropic, Google, ByteDance, and others. Includes user-agent strings, crawl behaviors, robots.txt blocking instructions, and server-level enforcement strategies.

Read guide →
Pricing Strategy 2026-01-19

Pricing Your Content for AI Training: How Publishers Calculate Licensing Value

Publisher valuation framework for AI training data licensing. Industry benchmarks for per-crawl pricing, content uniqueness scoring, and common pricing mistakes to avoid.

Read guide →
Deal Teardown 2026-01-19

Associated Press + OpenAI Licensing Deal: Contract Structure and Lessons for Publishers

Teardown of the AP-OpenAI licensing agreement. Analyze deal structure, content scope, attribution terms, and strategic lessons for publishers pursuing AI licensing deals.

Read guide →
Implementation 2026-01-19

Cloudflare Pay-Per-Crawl Setup: Complete Configuration Guide for Publishers

Step-by-step guide to configuring Cloudflare Pay-Per-Crawl for AI crawler monetization. Learn pricing tiers, Stripe billing integration, and enforcement settings.

Read guide →
Deal Teardown 2026-01-19

Financial Times + Anthropic Partnership: Why FT Chose Claude Over ChatGPT

Complete analysis of the Financial Times and Anthropic licensing partnership. Deal structure, strategic rationale, and lessons for publishers.

Read guide →
Implementation 2026-01-19

llms.txt Specification: The Human-Readable Licensing Standard for AI Systems

Complete guide to implementing llms.txt for AI content licensing. Learn file structure, placement, and how AI systems parse human-readable licensing terms.

Read guide →
Deal Teardown 2026-01-19

News Corp $250M OpenAI Deal: The Largest News Licensing Agreement Explained

Deep analysis of the $250M, 5-year licensing agreement between News Corp and OpenAI. Deal structure, property valuations, and lessons for publishers.

Read guide →
Deal Teardown 2026-01-19

Reddit $60M Annual Google Deal: How User-Generated Content Powers AI Licensing

Teardown of the Reddit-Google AI licensing deal. Analyze UGC valuation, deal structure, content scope, and lessons for platforms monetizing user-generated content.

Read guide →
Implementation 2026-01-19

RSL Protocol Implementation: How Publishers License Content to AI Systems

Complete guide to implementing RSL (Really Simple Licensing) protocol for AI content licensing. Learn file structure, pricing models, hosting requirements, and enforcement strategies.

Read guide →