On-Page API endpoints that allow specifying custom_js now include a new field in the responses: custom_js_client_exception. If an error occurs during your custom JavaScript execution, the custom_js_client_exception field will display an error message, allowing you to identify and resolve issues with your script. Here’s the…

Parse tables seamlessly – we’ve just rolled out a new table_content field to Content Parsing and Content Parsing Live endpoints of On-Page API. With this powerful addition, you can: Extract structured content from tables on web pages; Aggregate data from multiple sources in a standardized…

Dive deeper into your content analysis with new urls arrays in the Content Parsing endpoints of On-Page API. These arrays contain comprehensive information on URLs and anchor text embedded within the parsed content. You can locate the new urls arrays within the primary_content and secondary_content…

Excluding multiple words in the DataForSEO Labs API filters just got a lot easier with the introduction of the not_regex operator. UPD: Now also available in On-Page API, Backlinks API, and Content Analysis API. Here’s how it works: Use the not_regex operator to exclude multiple…

We’d like to inform you about a small but valuable improvement in the Content Parsing GET and Live endpoints of On-Page API. Starting today, we have added the status code of the parsed page to the response! You can find the new status_code parameter under…

Today we’d like to inform you that we’ve changed the default sitewide checks settings for single-page crawls via the Task POST endpoint of On-Page API. Earlier, when you set max_crawl_pages to 1 and specified a start_url to crawl only one page, our system still had…

Today, we’re introducing a new feature in On-Page API – www redirect check. It will enable you to determine whether a website has properly configured redirect from the www version of the domain to the non-www version. To use the new feature, simply set enable_www_redirect_check…

We are excited to announce another update in On-Page API! The Waterfall endpoint will now show you if a certain resource blocks page rendering. In this case, the new is_render_blocking field will be true. Render-blocking resources are files such as CSS, JavaScript, and fonts that…

We have an update to share! We’ve added an option that enables you to better control the crawling process with On-Page API. Now you can specify subdomains disallowed for crawling by simply using the disallowed_subdomains parameter. For example: [ { “target”: “site.com”, “max_crawl_pages”: 10, “disallowed_subdomains”:…

We are pleased to announce a small update in the Pages endpoint of On-Page API! This week, we’ve added two new fields to its response: url_length and relative_url_length. These fields enable developers to swiftly receive data on the lengths of website URLs and relative URLs…