Traffic and Billing
Last updated
Last updated
Web Scraper API count the number of results. Results refer to distinct entities of content (e.g., web page HTML) that were successfully retrieved from the web.
All results from the target site with 2xx or 4xx status codes are counted as successful.
All other results are counted as unsuccessful.
For more information about response codes, please refer to the Response Codes table.
If the response contains 2xx or 4xx status codes, and the result doesn’t contain expected information, we still count it as a successful result.
You will be billed for the number of results with successfully extracted data.
Failed attempts to scrape due to our system errors (5xx and 6xx status codes) won’t be included, and you won’t be billed for them.
If a request results in a failed attempt due to a fault or error on your side, you will still be billed.
Please find a few billing case examples below:
You create a scraping job, and it takes three attempts for Scraper API to fetch good content from the website successfully. You will be billed only for the result of the last attempt, which was successful.
You create a scraping job that has failed due to our error, e.g., we have reached our internal retry limit. In this case, you will not be billed for the received result.
You create a scraping job that has failed due to an error on your side. You will be billed for this result.
