Integrating Web Unblocker is easy, especially if you have previously used regular proxies for web scraping. The only difference is that we require you to ignore the SSL certificate using the
--insecurecURL flags (or an equivalent expression in the language of your choice).
curl -k -x unblock.oxylabs.io:60000 -U "USERNAME:PASSWORD" https://ip.oxylabs.io
If you are observing low success rates or retrieve empty content, please try adding additional
"x-oxylabs-render: html"header with your request.
Watch the video below for an example of scraping difficult target without getting blocked:
If you want to learn more about getting data on a large scale with Web Unblocker - we suggest watching this Scraping Experts lesson: