For the complete documentation index, see llms.txt. This page is also available as Markdown.

Changelog

Track the latest Oxylabs product updates, feature releases, and improvements. Stay informed on what's new with our tools and documentation.

Web Scraper API

Granular parsed results for Google Travel: Hotels

google_travel_hotels source now returns a more detailed offers field when parse is set to true, with additional hotel-offer details in every parsed response.

Web Scraper API

Enhanced parsing for Google search news

Parsed output from the google_search source now returns more detailed data for the additional news component by using "parse": true , which appears in searches using the tbm=nws parameter.

Headless Browser

Improved session consistency for Headless Browser

Headless Browser sessions have been improved to stay more consistent while accessing the targeted sites, instead of regenerating it between requests.

Web Scraper API

Google Books dedicated parser

A dedicated Google Books parser is now available through the google_search source using the tbm=bks parameter with parse set to true to receive structured book data in JSON format.

Web Scraper API

YouTube Downloader audio parameter

YouTube Downloader now accepts an optional audio_language parameter for selecting the audio track:

  • original – the creator's original audio track

  • default – the audio track YouTube selects (may be dubbed).

Proxies

New proxy locations

New locations have been added across multiple self-service proxy products:

Web Scraper API

Increased prompt limit for Google AI Mode

The maximum prompt length for Google AI Mode source requests has increased from 4,000 to 8,000 characters.

Web Scraper API

Custom browser instructions for LLM sources

LLM sources now support custom browser instructions, allowing you to define actions (e.g., clicks, scrolls, waits) to control page behavior before content is extracted.

Web Scraper API

Custom parser for Home Depot data

A dedicated parser for Home Depot product pages is now available through the universal scraping source. Enable parsing on your request to receive structured product data (such as title, price, availability, and specifications) instead of raw HTML.

Web Scraper API

Structured Google Scholar results

Google Scholar is now a dedicated parsed source in Web Scraper API. Set source to google_scholar and parse to true to receive parsed JSON directly.

General updates

Improved success rates on hard-to-reach targets

We have rolled out improvements to how requests are handled on sites using CAPTCHA. Success rates on these targets should improve, particularly for jobs that previously saw elevated failure or retry rates. Learn more in our documentation.

Web Scraper API

More accurate Walmart e-commerce pricing

Parsed output from Walmart e-commerce sources now returns pricing data more reliably and consistently. If you're tracking competitor prices or monitoring product catalogs, you'll get cleaner numbers automatically with new requests using "parse": true.

Headless Browser

Improved fingerprint validation and device-memory alignment

Headless Browser now offers more realistic browser fingerprints and continues to align device-memory values with the rest of the emulated fingerprint to lower detection risk for all users. This change applies automatically to all Headless Browser sessions.

General updates

Oxylabs Agent Skills

Oxylabs now offers official Agent Skills – structured skill files that teach AI agents and coding assistants work with Oxylabs products with significantly more accurate code and fewer hallucinations.

Each Oxylabs agent skill is product-specific and tools like Claude, Cursor, or GitHub Copilot can pick the right product and handle all the technical details with up-to-date information.

Find setup instructions and all skill files in the official Oxylabs Agent-Skills repository.

Web Scraper API

ChatGPT source requests with search set to true now retry citation extraction automatically, roughly doubling citation coverage in the parsed citations field.

The overall request success rate is unchanged, and no payload changes are needed for requests already using search: true.

Web Scraper API

Batch requests for LLM targets

LLM sources now support up to 5,000 prompts within a single batch request for chatgpt, gemini, and perplexity sources. Every prompt runs as its own job, so you get one job ID back per prompt. Learn more about batch requests here.

General updates

Dashboard login: Microsoft Entra SSO

Oxylabs dashboard login now supports Microsoft Entra ID (formerly Azure AD) for single sign-on (SSO) in addition to Google and Okta.

To set up Entra SSO, contact your Oxylabs account manager and authenticate the users in your organization to sign in through Entra ID instead of using email and password. Head to dashboard login page to start.

Web Scraper API

New and updated LLM sources for Web Scraper API

Web Scraper API LLM & AI sources now offers a dedicated gemini source together with updated chatgpt and perplexity scrapers. All LLM sources now share a more consistent request structure, streamlined output envelope, and include new response fields (citations, shopping, ads, etc.)

Web Scraper API

Partial download (trimming) for Video Data API

YouTube Downloader can now download a specific segment of a video instead of the full file by adding start_at and end_at to the context array. Both parameters take an hh:mm:ss timestamp format.

Web Scraper API

Video Data API: video quality selection

YouTube Downloader now supports resolution selection for downloaded videos using the context: video_quality parameter with specific resolution from 144p all the way up to 8K.

Web Scraper API

Error codes for Video Data API

Web Scraper API youtube_download source now returns specific error codes in job status response for easier troubleshooting when a video can't be downloaded.

General updates

Top-up flow improvements

Top-ups for Residential Proxies, Mobile Proxies, Datacenter Proxies (per GB), Web Unblocker, and Web Scraper API are no longer restricted to fixed values. You can now enter any amount within the range allowed by your plan instead of choosing from a preset list.

General updates

Oxylabs Dashboard API

Dashboard API allows users to programmatically access product usage statistics of Oxylabs Datacenter Proxies (DC) and Headless Browser (HB) for automated reporting and real-time usage monitoring without using Oxylabs dashboard directly.

Proxies

HTTP/3 protocol support

HTTP/3 protocol is now supported by Residential and Mobile Proxies. Access is available through a dedicated SOCKS5 endpoint with UDP support.

Proxies

Session IP change control

Residential Proxies and Mobile Proxies now support a new sticky session model via sessid_oneip, which allows you to keep the same IP for as long as the original exit node remains available up to the set session duration without assigning a new IP after the session expires.

Proxies

New proxy locations

New locations have been added across multiple self-service proxy products:

Headless Browser

City and state-level targeting for Headless Browser

You can now set the geo-location of your Headless Browser sessions to the city or state level. New parameters include p_city for city and p_state for state or region targeting.

Proxies

Improved proxy upgrade flow

You can now upgrade Dedicated ISP, ISP, Datacenter (per IP), and Dedicated Datacenter Proxy plans starting from just 5 IPs for ranges between 0 and 100 (previously 20-IP minimum requirement).

The upgrade summary now also provides more details, including discount breakdowns and exact billing dates for easier scaling.

Web Scraper API

Google Domain parameter no longer available

Web Scraper API domain parameter for google sources is no longer available. To localize your searches, use the geo_location parameter. For more details, check our geo_location parameter structures here.

Headless Browser

Renaming Unblocking Browser

We’re making a change to our product naming: Unblocking Browser is now Headless Browser. This is a name change only and all core features, functions, and integrations will remain the same as per pre-existing workflows.

Proxies

New ASN providers

IPs from Cox and Deutsche Telekom are now included in ISP Proxy and Dedicated ISP Proxy pools. Dedicated ISP Proxy users can choose their preferred premium ASN provider directly from the Oxylabs dashboard.

Proxies

Dedicated ISP Proxies

Dedicated ISP Proxies are now available in the self-service dashboard. This new proxy type provides fully dedicated, static IPs sourced from premium ISP providers and the ability to freely choose your preferred ASNs. Dedicated ISP proxies offer top-tier speed, stable connections, maximum customizability, and unlimited-duration sessions.

Learn more in the Dedicated ISP Proxies documentation.

Proxies

Advanced filters for Residential Proxies

Residential Proxies support two advanced filters that give you more control:

  • Platform (OS)pl parameter to select the operating system (e.g., Windows, iOS) of the residential proxy for the TCP connection. This lets you improve your scraping success rates by matching your HTTP and TCP fingerprints.

  • IP Version – you can receive only IPv4 or IPv6 addresses from the entire Residential Proxies pool using the ipversion-4 or ipversion-6 parameter.

Web Scraper API

Result Aggregator

Web Scraper API users can now bundle multiple scraping results into large batch files to streamline storage using the Result Aggregator. Create a custom aggregator via the /v1/aggregators endpoint and route jobs to it by adding the aggregate_name parameter to your scraping request payloads.

Headless Browser

Unblocking Browser session inspection

Unblocking Browser now supports real-time visual inspection through a VNC-based Session Inspection Tool. Add o_vnc=true to your connection endpoint (e.g. wss://user:pass@ubc.oxylabs.io?o_vnc=true) to open a live graphical view of the headless browser and interact with it directly.

Proxies

New Datacenter Proxy locations

Five new Datacenter proxy locations are now available for per-traffic (per GB) users: Latvia, Slovenia, Slovakia, Greece, and Austria. Requests can now be routed through these countries to optimize coverage and performance.

Proxies

YouTube Autocomplete scraping source

Web Scraper API can now retrieve YouTube search term suggestions with the new youtube_autocomplete source. It allows users to discover related keywords for any search query, which can then be used with the youtube_search source to discover more relevant videos.

Proxies

Updated Google Shopping sources

Google Shopping sources now use the token-based system, replacing the product_id workflow. google_shopping_search (with render enabled) now provides a token required for google_shopping_product requests.

Additionally, google_shopping_pricing is no longer supported as a standalone source. To extract pricing data, use the google_shopping_product source.

Finally, google_shopping_product can now expand the "More Shops" panel to access additional listings by submitting the job with render: 'html' (only first expansion is available).

Web Scraper API

Self-healing parser presets

Users can now enable self-healing for their parser presets by setting "self_heal": true in the preset configuration. This feature allows Oxylabs to automatically adjust your parser instructions when a parser preset starts to fail due to changes in the target website.

Web Scraper API

YouTube channel

Users can now scrape YouTube channel data with the new dedicated source – youtube_channel. It lets you retrieve all key channel data, including subscriber, video, and view counts, general metadata, and a list of its videos by providing the YouTube channel_handle.

Web Scraper API

YouTube Subtitles

Web Scraper API now supports YouTube subtitles and closed captions (CC) extraction with a new source – youtube_subtitles. Users can now retrieve auto_generated and user_provided captions by providing a YouTube video ID and subtitles language code.

Web Scraper API

Scrape Google AI Overviews with Web Scraper API

The google_search and google_ads sources now return AI Overviews results together with standard SERP data in all available regions, with support for multiple AI blocks per response including “People also ask” and “Things to know.”

Web Scraper API

New dedicated sources available for Web Scraper API

Added 3 new dedicated targets for Web Scraper API: perplexity, chatgpt, google_ai_mode. These targets enable extraction of LLM-generated responses from AI search interfaces. See all available targets in this table.

Web Scraper API

Markdown output

You can now request the markdown output in addition to HTML or parsed JSON. To get the markdown content in the response, set the "markdown": true in your request.

Web Scraper API

Multi-format output in a single API response

Added

  • Ability to retrieve multiple output formats in a single API response

  • Support across Realtime and Push-Pull integration methods

Changed

  • The type URL parameter now supports a list of result types (parsed, markdown, png, xhr, raw) instead of a single value

Web Scraper API

Parser presets

Added the ability to create, reuse, and manage custom parser presets through the Web Scraper API. Parser presets are hosted on our system, allowing you to easily use them across multiple scraping jobs. Additionally, you can monitor usage and performance metrics of each preset.

Proxies

Usage alerts for Datacenter Proxies per traffic

Customers using Datacenter Proxies with a traffic-based subscription will now receive email notifications when 80% and 100% of monthly traffic is used. Visit My AccountEmail Notifications in the dashboard to select the thresholds you'd like to be notified about, add multiple recipient emails, or disable these notifications entirely.

AI Studio

AI Studio – 5th app released

AI Studio now features 5 AI-driven tools you can control using natural language prompts. Each app automates a specific web scraping task while eliminating typical pain points. Our toolkit includes AI-Crawler, AI-Scraper, Browser Agent, AI-Search, and the newly added AI-Map.

Web Scraper API

Feature-based billing for Web Scraper API

With feature-based billing, pricing now adapts to the complexity of scraping, offering different rates based on rendering requirements and target type. Besides, our free trial duration is now unlimited with up to 2,000 results to test our product.

Web Scraper API

File naming templates for Cloud Storage

Added support for custom file naming templates when saving results to Cloud Storage. You can now use submitted job parameters and job_info variables to define file names and directory paths. This makes it much easier to organize and identify your files.

Web Scraper API

Google Reverse Image Search scraping source no longer available

Google Reverse Image Search (google_images) source is no longer supported due to Google decommissioning the feature. You can now use Google Lens (google_lens ) source instead, which delivers an equivalent service and follows the same input and output formats.

Web Scraper API

XHR request capturing

Web Scraper API now supports capturing network requests (Fetch/XHR) for easier scraping of dynamic content from JavaScript-heavy websites. Set the xhr parameter to true to extract data directly from API responses instead of parsing HTML.

Web Scraper API

Alibaba Cloud OSS and other S3-compatible storage

Web Scraper API now supports Alibaba Cloud Object Storage Service and other S3-compatible storage solutions setups. To save scraped results to these buckets, set the storage_type to s3_compatible and provide your storage_url.

Web Scraper API

Added sort_by and refinements parameters to our Amazon Search source for more precise scraping based on price, brand, color, and other filters.

Web Scraper APIGeneral updates

AI-powered browser instructions

Users can now generate browser instructions using AI in the Web Scraper API Playground on our dashboard. Instead of manually selecting each action, you can simply enter a prompt, and the instructions will be automatically generated.

General updatesHeadless Browser

Unblocking Browser documentation

Unblocking browser now available in docs:

See documentation

Find all setup info on CAPTCHA Solving Events, Device Type and more all in one place.

Proxies

High-Bandwidth Proxies for video download

Introducing High-Bandwidth Proxies - scrape video and audio data at scale with 200+ Gbps dedicated bandwidth, smart IP rotation, and long-lived connections built for uninterrupted, high-volume downloads. Fully compatible with yt-dlp and other open-source libraries, easy to integrate, and optimized for speed, stability, and scale with a dedicated proxy exit node.

Web Scraper API

Video scraping & AI-ready data via API

Introducing Video Data API - AI-ready infrastructure to find relevant videos, channels, and playlists, download video/ audio files, extract transcripts, and enrich everything with metadata - no need to build or maintain your own scrapers.

Ethical YouTube video datasets

Access high-quality, creator-approved video datasets with rich metadata, transcripts, and 720p+ resolution - ready for training and fine-tuning AI models. No scraping, no legal headaches, just clean, and scalable video data.

General updates

Documentation improvements

Oxylabs documentation now has all things setup and troubleshooting in one place:

General updates

Clean data with E-Commerce Web Data Platform

Introducing Oxylabs' new product - E-Commerce Web Data Platform. With this platform you will be able to get clean data from Walmart, Amazon, Shopee, and other top marketplaces.

Headless Browser

New product release - Unblocking Browser

We’ve launched Unblocking Browser, a headless, fully managed browser that simulates authentic browsing behavior to handle bot traffic management systems or CAPTCHAs automatically, and access complex, JavaScript-heavy sites with ease.

Web Scraper API

30 new parametrized sources for Web Scraper API

Web Scraper API now supports 30 new parametrized sources - select parameters, such as search term, store ID, or ZIP code, and automate your request construction.

Web Scraper APIWeb Unblocker

Usage limit email notifications for Web Scraper API and Web Unblocker

You can now set up email alerts to be notified when your Web Scraper API or Web Unblocker usage reaches 80% and/or 100% of your monthly subscription limit.

Web Scraper API

Google AI Overviews response schema update

Google AI Overview response structure now supports multiple AI Overview blocks in a single response. Previously limited to a single object, the schema now returns an array of AI Overview objects, ensuring you capture all AI-generated content from Google's search results.

Web Scraper API

We've improved Google Web Search related searches schema with more precise position tracking for multiple related search blocks. You can now get detailed, position-specific related search results directly in their parsed data.

Web Scraper APIGeneral updates

OxyCopilot prompts and code samples' library

We’ve launched the OxyCopilot prompts library with ready-to-use AI prompts and code samples for scraping and parsing tasks. Users can now follow step-by-step guides to generate requests for specific targets and view parsed data examples produced by OxyCopilot.

Web Scraper API

Multimodal video data extraction

Web Scraper API now supports multimodal YouTube data extraction with four new sources: youtube_search, youtube_download, youtube_transcripts, and youtube_metadata. Users can now retrieve video, audio, transcripts, and metadata for AI applications and advanced analytics.

Web Scraper API

New endpoints for Web Scraper API Scheduler

We’ve added two new endpoints to the Web Scraper API Scheduler for better visibility into scheduled jobs. Users can now retrieve any schedule's run history (/runs) and executed job lists (/jobs).

Proxies

Proxies: new countries added

  • Belgium and Canada Proxies now available to purchase via dashboard for ISP proxies.

  • Italy, Singapore and Poland Proxies now available for Datacenter proxies.

  • Italy, Singapore, Spain and Poland location now available for Dedicated Datacenter Proxies.

Web Scraper API

No-code browser instructions

Users can now create browser instructions with a few simple steps in the Web Scraper API Playground on our dashboard, eliminating the need for manual coding - set up actions, generate structured JSON, and export it for further use.

Web Scraper API

Set currency when scraping Amazon

You can now specify the currency when scraping Amazon product, search, pricing, and best-sellers pages! Simply add the context:currency parameter to define the price currency. Find the available values here or refer to the respective Amazon documentation pages.

Proxies

Usage alerts for Residential and Mobile Proxies

Stay informed and avoid service interruptions. You can now receive email notifications when you're approaching the monthly subscription limit for your Residential and Mobile Proxies. To enable or disable this feature, simply go to My Account > Email Notifications in your dashboard.

General updates

Dashboard: Transfer team ownership

You can now transfer team ownership in three steps through the dashboard under "My Account" -> "Team": select the new owner, confirm the transfer, and have the new owner accept the invitation.

Web Scraper API

More localization features for Kroger

You can now set a delivery_zip code for Kroger to specify precise delivery locations and use the fulfillment_type parameter to choose the preferred order method, including ship, pickup, delivery, or in_store.

Proxies

5 free Datacenter IPs

All new signups now get 5 free datacenter IPs to test the service – no credit card needed. Sign up now or check out our docs to get started.

Last updated

Was this helpful?