Set Disallowed Subdomains in On-Page API!
We have an update to share! We’ve added an option that enables you to better control the crawling process with On-Page API. Now you can specify subdomains disallowed for crawling by simply using the disallowed_subdomains parameter. For example: [ { “target”: “site.com”, “max_crawl_pages”: 10, “disallowed_subdomains”:…
