AI-Search

Learn how to search the web with AI. Describe your needs in plain English, and let the tool handle the search for you.

Overview

The AI-Searcharrow-up-right app by Oxylabs AI Studioarrow-up-right is a web search tool that allows developers to retrieve search results, optionally scrape them, and handle JavaScript-rendered content with ease. It is built to act as an intelligent search agent that simplifies the process of extracting relevant information directly into your Python applications.

Whether you need a simple list of URLs or deep content extraction, AI Search removes the complexity of building custom search scrapers from scratch.

Key features

  • Query web using plain English: Simply provide your search query in natural language and let the agent do the heavy lifting.

  • Control number of search results: Easily define exactly how many results you want to retrieve.

  • Optional content scraping for result pages: Automatically scrape and extract content snippets directly from the returned search results.

  • Python rendering for dynamic content: Enable rendering to seamlessly handle and extract data from JavaScript-heavy websites.

How it works

To use the search agent, follow these simple steps:

  1. Input the search query you want to look up.

  2. Set the desired number of results to limit or expand your search scope.

  3. Toggle content scraping and JS rendering based on whether you need deep content extraction or just URLs and titles.

Installation

To begin, be sure you have access to an API key (or get a free trialarrow-up-right with 1,000 credits) and Python 3.10+ installed. You can install the oxylabs-ai-studio package using pip:

Code example (Python)

The following example demonstrates how to use the AI-Seaerch agent for data retrieval scenarios.

Learn more about AI-Search and Oxylabs AI Studio Python SDK in our PyPI repositoryarrow-up-right. You can also check out our AI Studio JavaScript SDKarrow-up-right guide for JS users.

Request Parameters

Parameter
Description
Default Value

query

What to search for

limit

Maximum number of results to return (Maximum: 50)

10

render_javascript

Enable JavaScript rendering

False

return_content

Whether to return markdown contents in results

True

geo_location

Proxy location in ISO2 format

– mandatory parameters

Note: When limit <= 10 and return_content=False, the search automatically uses the instant endpoint (/search/instant) which returns results immediately without polling, providing faster response times.

circle-info

Note: When limit <= 10 and return_content=False, the search automatically uses the instant endpoint (/search/instant) which returns results immediately without polling, providing faster response times.

Instant search supported parameters:

Parameter
Description
Default Value

query

What to search for

limit

The maximum number of search results to return (Max: 10)

10

geo_location

Google's canonical name of the location. See more herearrow-up-right.

– mandatory parameters

Output Sample

Practical use cases

AI-Search can be applied to a wide variety of data discovery and collection tasks:

  1. Search for latest news or articles on a topic – Quickly gather up-to-date information, headlines, and summaries.

  2. Discover books, movies, or products – Retrieve lists of items matching specific criteria or reviews.

  3. Research competitive offerings – Find and analyze competitor pricing, features, and market positioning.

  4. Aggregate industry updates from multiple sites – Compile relevant industry changes and trends into a single, structured feed.

Last updated

Was this helpful?