Documentation has been updated: see help center and changelog in one place.

Web Scraper API Playground

Web Scraper API Playground is an interactive tool available in the Oxylabs dashboard. It allows you to build and test Web Scraper API requests in the simplified environment.

With Web Scraper API Playground, you can try out different targets, adjust request parameters, preview results, and export ready-to-use code snippets. It's designed for both beginner and advanced users, quick prototyping, and verifying request setups.

It also integrates OxyCopilot, an AI-powered assistant that helps generate parsing rules, create parser presets, build scrapers, and generate browser instructions from natural language prompts.

Key features

Web Scraper API Playground is the main environment for experimenting with Web Scraper API requests. Its main functions include:

  • Interactive request builder – choose a source (Universal, Amazon, Google, YouTube, etc.), enter a URL or query, and run a request directly from the dashboard.

  • Parameter customization – adjust options such as JavaScript rendering, geolocation, locale, parsing, user agent type, and more.

  • Result preview – view the response in raw HTML or parsed JSON to confirm your request output.

  • Export options – copy generated code snippets (cURL, Python, etc.) or request payloads for further use.

  • OxyCopilot integration – use the built-in assistant to automatically create scraper request payloads, parsing logic, reusable parser presets, or browser instructions using natural language.

When scraping, Web Scraper API Playground is intended for testing and exploration. For high-volume or automated workflows, use the standard Web Scraper API integration methods (Realtime, Push-Pull, or Proxy Endpoint).

How to use it

Using the Web Scraper API Playground is really easy. Follow these steps:

1

Access Web Scraper API Playground

Log in to the Oxylabs dashboard and open Web Scraper API Playground.

2

Select a source

Choose a dedicated source – specific website (e.g. Google, Amazon, YouTube, and many more) and scraper source (e.g., URL, amazon_product, google_search) or "--Any other website--" for websites not mentioned in the drop-down menu.

3

Enter a query or URL

Provide the search query or page URL you want to scrape.

4

Add additional parameters (optional)

Adjust rendering, parsing, localization, or other options for your use case.

5

Run the request

Submit your request and instantly preview the returned data.

6

Export

If you're happy with the results, copy the generated code snippet or request payload in your preferred coding language and use it in your scripts or applications. You can also export JSON or HTML results using the drop-down menu at the top right corner.

Access & trial

The Web Scraper API Playground is available to all Oxylabs dashboard users with access to the Web Scraper API.

  • Trial users can explore the Web Scraper API Playground using a Free Trial.

  • Paid users can use the Web Scraper API Playground alongside their regular API integrations as a testing and prototyping environment.

Last updated

Was this helpful?