Getting Started with AIPayPerCrawl
Join the new economy of AI-driven content monetization. Whether you're a publisher looking to monetize your content or an AI company seeking quality data, we'll guide you through every step.
For Publishers
Monetize your content when accessed by AI crawlers. Set your own prices and maintain full control over access.
- Claim and verify your domains
- Set custom pricing per request
- Get paid automatically via Stripe
- Track revenue and analytics
For AI Companies
Access high-quality web data at scale with transparent pricing and easy integration.
- Discover Pay Per Crawl domains
- Get instant pricing quotes
- Pay only for what you crawl
- Use our API or SDKs
Publisher Quick Start Guide
Start monetizing your content in 4 simple steps
Create Your Publisher Account
Sign up for a free AIPayPerCrawl account. You'll need to verify your email address and complete your publisher profile.
Required Information:
- • Business name and contact details
- • Website or domain you want to monetize
- • Preferred payout method (bank account via Stripe)
Claim and Verify Your Domain
Prove ownership of your domain through DNS verification or file upload. This ensures only legitimate owners can set pricing.
Verification Methods:
aipaypercrawl-verify=your-unique-token/aipaypercrawl-verify.htmlConfigure Cloudflare Settings
Set up Pay Per Crawl headers on your Cloudflare account. We provide templates and step-by-step instructions.
Example Cloudflare Worker:
addEventListener('fetch', event => {
event.respondWith(handleRequest(event.request))
})
async function handleRequest(request) {
const userAgent = request.headers.get('User-Agent')
if (isAICrawler(userAgent)) {
return new Response('Payment Required', {
status: 402,
headers: {
'X-Robots-Tag': 'noindex',
'X-Cloudflare-Crawl-Price': 'USD 0.001',
'X-Pay-Per-Crawl': 'active'
}
})
}
return fetch(request)
}Set Pricing and Start Earning
Configure your pricing strategy and watch the revenue flow in. Track performance through your dashboard.
Set Prices
Per request pricing
Control Access
Allow/block crawlers
Track Revenue
Real-time analytics
AI Company Quick Start Guide
Start crawling Pay Per Crawl content in minutes
Sign Up and Add Credits
Create your AI company account and add crawl credits to your balance. Start with our free tier that includes $5 in credits.
Account Tiers:
- • Free: $5 credits, perfect for testing
- • Starter: $29/mo, includes $50 credits
- • Professional: $299/mo, includes $750 credits
- • Enterprise: Custom pricing and limits
Get Your API Key
Generate an API key from your dashboard. This key authenticates your requests and tracks usage.
Example API Usage:
curl -X GET https://api.aipaypercrawl.com/v1/crawl \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"url": "https://example.com/article",
"accept_price": 0.01
}'Discover and Quote Domains
Use our discovery engine to find Pay Per Crawl enabled domains or get quotes for specific URLs.
Discovery API:
Find domains by category, price range, or content type
GET /v1/discoveryQuote API:
Get instant pricing for any URL
POST /v1/quoteStart Crawling
Make crawl requests with automatic payment processing. Monitor usage and costs in real-time.
Pro Tips:
- • Use bulk endpoints for better rates
- • Set price limits to control costs
- • Cache responses to avoid duplicate charges
- • Monitor your dashboard for usage insights