Crawlers are infrastructure, not features
Queues, politeness rules, JS rendering, retries, storage — months of engineering that your users will never see or thank you for.
→ One task_post call starts the crawl. We run the machines.
DataForSEO On-Page API · SEO Audit · Website Crawler
$1 in Free Credits · No Credit Card · No Subscription · Credits Never Expire
The problem
Site audits are table stakes for every SEO tool and agency — and a crawler is the least differentiated, most painful thing you can build.
Queues, politeness rules, JS rendering, retries, storage — months of engineering that your users will never see or thank you for.
→ One task_post call starts the crawl. We run the machines.
Screaming Frog on a laptop doesn’t scale to 50 clients or plug into your product. Exports and re-imports eat entire days.
→ Everything arrives as JSON, straight into your pipeline.
What Google renders and what your basic crawler sees can be very different pages.
→ JS rendering and full browser mode, priced per page.
See it work
Instant Pages returns the full on-page picture — score, checks, timing, and metadata — for any URL, in seconds.
POST https://api.dataforseo.com/v3/on_page/instant_pages
[{
"url": "https://dataforseo.com/",
"enable_javascript": true
}]
// live response, trimmed
{
"items": [{
"url": "https://dataforseo.com/",
"onpage_score": 97.07,
"meta": {
"title": "Powerful API Stack For Data-Driven SEO Tools...",
"internal_links_count": 123,
"cumulative_layout_shift": 0
},
"page_timing": { "time_to_interactive": 185 },
"checks": {
"is_https": true,
"canonical": true,
"seo_friendly_url": true,
"no_image_alt": true
}
}]
}
What's inside
One API covers the whole technical SEO surface — pick the mode that fits the job.
Crawl entire domains with 60+ checks per page: meta, status codes, internal links, duplicates, non-indexable pages, and an overall OnPage score.
See pages the way Google does — JavaScript rendering from $0.0015 per page, full browser rendering with Core Web Vitals from $0.0051.
Google Lighthouse audits and page-timing metrics through the same API — performance data next to your SEO data.
Audit any single URL in seconds, or parse a page’s content structure — both at $0.00015 per page.
Who it's for
SEO software
Ship a full audit module — score, issues, recommendations — on white-label data instead of a year of crawler engineering.
Agencies
Run scheduled crawls across every client site and turn the JSON into branded reports — no desktop exports.
Builders & no-code
Wire Instant Pages into Make, n8n, or Sheets and offer quick technical checks as a productized service.
Enterprise
Crawl large properties on schedule, track regressions, and feed the results into internal dashboards and alerts.
Pricing
No subscription. Pay per crawled page, and only for the mode you actually use.
| Endpoint | Price | Turnaround |
|---|---|---|
| Basic crawl | $0.00015 per page · $0.15 per 1,000 | 60+ checks per page |
| Load JavaScript | $0.0015 per page | JS-rendered crawling |
| Browser rendering | $0.0051 per page | Core Web Vitals included |
| Instant Pages / Content parsing | $0.00015 per page | single-URL, seconds |
Social proof
"I always recommend DataForSEO. No worries about server capacity, no need for maintenance, and splendid possibilities for rapid development."
"We found DataForSEO online while planning our beta. We were impressed by the responsive team and comprehensive APIs."
"DataForSEO has always been in our toolkit. When exploring an API, you see what it's truly capable of. Documentation is awesome."
Implementation
Every endpoint, parameter, and response field documented with live examples.
Read the docs →
Prototype against the Sandbox for free and fire test calls from the browser before you write a line of code.
Open the Sandbox →
Ask it anything about the API — it answers from the docs and drafts integration scripts for you.
Ask the AI assistant →Real engineers on the other end — during evaluation, integration, and every day after.
Talk to us →It’s a website crawler you control through code instead of a desktop app. You post a target and crawl settings; it returns structured data on every page — meta tags, status codes, links, duplicates, speed, and 60+ technical checks — ready for your product or reports.
Basic mode is $0.00015 per crawled page — $0.15 per thousand. JavaScript rendering is $0.0015 per page, and full browser rendering with Core Web Vitals is $0.0051. You pay only for pages actually crawled.
Yes — enable JS loading or full browser rendering per crawl. You can also execute custom JavaScript and capture page screenshots at $0.0048 per page.
Yes. The On-Page API includes Google Lighthouse audits alongside its own page-timing and Core Web Vitals metrics.
Yes — the Instant Pages endpoint returns the full on-page analysis for any URL in seconds, at the same $0.00015 rate.
Yes. Raw JSON in, your scoring and UI out — that’s how most SEO platforms use it.
Yes. Every new account gets $1 in free API credits — thousands of Basic-mode pages — plus free Sandbox access.
Register, grab your free credits, and crawl your first pages today.
$1 in Free Credits · No Credit Card · Pay as You Go from $50