Octoparse

Integrate Octoparse with Oxylabs Proxies for no-code web scraping. Set up automatic IP rotation and handle common scraping challenges.

Octoparse is a data extraction tool. It allows you to scrape public data without coding and handle most scraping challenges by enabling automatic IP rotation and extended session time.

Follow the steps below to integrate Octoparse with the following Oxylabs proxies:

• Residential & Mobile Proxies
• Datacenter Proxies
• Dedicated Datacenter Proxies (Enterprise)
• Dedicated Datacenter Proxies (Self-service)
• ISP Proxies
• Dedicated ISP Proxies

Step 1

Download, install, and then open Octoparse.

Step 2

Create a new task by clicking the +New button in the top-left corner, and choosing Custom Task.

Step 3

Type the URL of the webpage you intend to extract data from in the URL Input and click the Save button. We'll use Oxylabs scraping sandbox as an example.

Step 4

After your selected URL loads, go to "Task Settings" and select "Anti-blocking".

Step 5

Now, check Access websites via proxies, enable Use my own proxies, and click Configure.

Step 6

When you click on the Configure button, a pop-up window will appear. Specify your chosen proxy details in the IP/host:port:username:password format:

• Residential & Mobile Proxies
• Datacenter Proxies
• Dedicated Datacenter Proxies (Enterprise)
• Dedicated Datacenter Proxies (Self-service)
• ISP Proxies
• Dedicated ISP Proxies

Residential & Mobile Proxies

IP/host: pr.oxylabs.io

Port: 7777

Username: customer-username

Password: password

Don't forget to add the customer- part to your username.

You can also use country-specific entries to acquire a desired country exit node with a sticky session. For example, to use a US exit node, enter us-pr.oxylabs.io next to Host or IP Address and 10001 next to Port. You can find a complete list of location-specific information in our documentation.

Datacenter Proxies

IP/host: dc.oxylabs.io

Port: 8001

Username: user-username

Password: password

Don't forget to add the user- prefix to the username.

For the Pay-per-IP subscription, the port is the sequential number assigned to an IP address from the given list. Thus, port 8001 uses the first IP address from your list.

For the Pay-per-traffic subscription, port 8001 picks a random IP address but stays consistent during a session.

You can also specify geo-location, for example, the US, within the user authentication string: user-USERNAME-country-US:PASSWORD. See our documentation for more details.

Dedicated Datacenter Proxies (Enterprise)

IP/host: a specific IP address (e.g., 1.2.3.4)

Port: 60000

Username: username

Password: password

For Enterprise Dedicated Datacenter Proxies, you’ll have to choose an IP address from the acquired list.

Dedicated Datacenter Proxies (Self-service)

IP/host: ddc.oxylabs.io

Port: 8001

Username: user-username

Password: password

Don't forget to add the user- part to your username.

You will need to choose a port that's assigned to an IP address from the purchased proxy list, that you can find in Oxylabs dashboard.

ISP Proxies

IP/host: isp.oxylabs.io

Port: 8001

Username: user-username

Password: password

Don't forget to add the user- part to your username.

You will need to choose the port assigned to an IP address from the purchased proxy list, which you can find on Oxylabs dashboard. The 8001 port will pick the first IP address from your list for all requests.

Dedicated ISP Proxies

IP/host: disp.oxylabs.io

Port: 8001

Username: user-USERNAME

Password: PASSWORD

Note: don't forget to add the user- prefix to your username.

The port number indicates which IP address from your acquired proxy list will be used. Use port 8000 for automatic proxy IP rotation.

Step 7

Set up the Switch interval depending on whether you use a rotating or sticky session type.

Step 8

Save changes by clicking the Confirm button and after that, click Save.

Your proxies are now set up!

How to start scraping using Octoparse

Step 1. Select the desirable elements (video game titles) you want to scrape. To extract all elements from the same category, choose Select all similar elements and specify Text.

Step 2. Set up pagination to scrape multiple pages. This particular website uses numbered pages, prompting you to choose Next page button.

Step 3. Choose the exact button in the page layout that opens the following page – Forward – to automate pagination.

Step 4. Complete the scraping setup and press ▶Run.

Step 5. Choose Run on your device with Standard Mode to receive data as a file on your PC.

Step 6. Let the scraping process run until complete. The process will be over when the final product page is reached or when you stop it manually.

Step 7. Extract the collected data and select the file format.

Here's the final result in a spreadsheet.

That’s it – you are all set up and ready to focus on your web scraping tasks with Octoparse.