Web Search
The google_search
source is designed to retrieve Google Search results (SERPs). This sub-page specifically presents information related to Google Web Search. To explore other result types, read Image Search or News Search.
Request samples
In the samples below, we make a request to get 2
results pages, from number 11
to number 12
, for search term adidas
on google.nl
domain. The SERP will be filtered to contain French-language results only. API will return parsed results.
We use synchronous Realtime integration method in our examples. If you would like to use Proxy Endpoint or asynchronous Push-Pull integration, refer to the integration methods section.
Request parameter values
Generic
Basic setup and customization options for scraping Google Web search results.
Parameter | Description | Default Value |
---|---|---|
source | Sets the scraper. |
|
query | UTF-encoded keyword. | - |
| Enables JavaScript rendering when set to | - |
| Returns parsed data when set to |
|
| URL to your callback endpoint. More info. | - |
| Device type and browser. The full list can be found here. |
|
- mandatory parameter
Google Advanced Search Operators
When scraping, you might find it useful to combine Google advanced search operators with your query. It enables you to customize the scope of the search, ensuring that the results are more relevant and focused. Explore these special commands here and here. See an example below.
Localization
Adapt search results to specific geographical locations, domains, and languages.
Parameter | Description | Default Value |
---|---|---|
| The geographical location that the result should be adapted for. Using this parameter correctly is extremely important to get the right data. For more information, read about our suggested | - |
| Domain localization for Google. The full list of available domains can be found here. |
|
|
| - |
| Results language. List of supported Google languages can be found here. | - |
Pagination
Controls for managing the pagination and retrieval of search results.
Parameter | Description | Default Value |
---|---|---|
| Starting page number. |
|
| Number of pages to retrieve. |
|
| Number of results to retrieve in each page. |
|
| Scrape multiple pages using the same IP address and session (cookie set). By specifying the page numbers in a JSON array with the | - |
Continuous scroll support
The SERP Scraper API fully supports Google Search continuous scroll. It automatically detects continuous scrolling layouts, efficiently loading the requested organic results without any extra parameters required.
Limit per page
To use this feature, include a JSON array with JSON objects containing the following data:
Parameter | Description | Example |
---|---|---|
| The number of the page you would like to scrape. Any integer value greater than |
|
| The number of results on the page in question. Any integer value between |
|
Request sample
Filtering
Options to filter and refine search results based on various criteria.
Parameter | Description | Default Value |
---|---|---|
| Setting the value of this parameter to |
|
| Safe search. Set to |
|
| To-be-matched or | - |
|
| - |
Other
Additional advanced settings and controls for specialized requirements.
Parameter | Description | Default Value |
---|---|---|
| Setting the | - |
|
|
|
Structured data
SERP Scraper API is capable of extracting either an HTML or JSON object that contains Google search results, offering structured data on various elements of the results page.
The composition of elements may differ based on whether it was a desktop or mobile search.
To help you identify certain elements, refer to the data dictionaries for each type of Google search result, whether obtained from desktop or mobile searches.
Output data dictionary
Navigate through the details using the right-side navigation or scrolling down the page.
HTML example
JSON structure
The Google Web Search structured output includes fields like URL
, page
, results
, and others. The table below presents a detailed list of each SERP feature we parse, along with its description and data type. The table also includes some metadata.
The number of items and fields for a specific result type may vary depending on the search query.
Key Name | Description | Type |
---|---|---|
| The URL of the Google search page. | string |
| Page number relative to the Google SERP pagination. | integer |
| A dictionary containing the results of the search. | object |
| A list of product listing ads with their respective details. | object |
| A list of sponsored results with their respective details. | array |
| A list of image results with their respective details. | object |
| A list of flights with their respective details. | object |
| A list of unpaid listings with their respective details. | array |
| A list of organic videos with their respective details. | array |
| A list of notable landmarks or attractions with their respective details. | array |
| A list of jobs listings with their respective details. | object |
| A list of sponsored local service providers. | object |
| A single video item with its respective details. | object |
| A list of recipes with their respective details. | object |
| A list of Twitter (X) results with their respective details. | array |
| A list of relevant information retrieved from the knowledge panel. | object |
| A list containing local business listings relevant to the search. | object |
| A list of illustrative items for informational queries with their respective details. | object |
| A list of videos with their respective details. | object |
| A list of related searches that other people have done. | array |
| A list of hotels relevant to the location used in the search query. | object |
| A list of applications with their respective details. | array |
| A summary of financial data for companies, including stock prices, market cap, and other key metrics. | object |
| Information on recent sports games, detailing scores, teams, game types, and highlights. | object |
| A list of discussion threads and forum posts with URLs, titles, sources, and comment counts. | object |
| A list of specific results retrieved from the organic part of SERPs. | array |
| A list of articles with their respective details when a search query is identified as news-oriented. | object |
| A list of unpaid and organic displays of Google Shopping product listings with their respective details. | object |
| A list of related searches presented at the bottom of the search page. | object |
| A list of related interrogative search queries with their respective details. | object |
| A list of details for the submitted search query. | object |
| The total number of results found for the search query. | string |
| Value identifying the maximum page number visible in the search query results page. (-1 when loading of more results is initiated by scrolling). | integer |
| The status code of the parsing job. You can see the parser status codes described here. | integer |
| The timestamp when the scraping job was created. | timestamp |
| The timestamp when the scraping job was finished. | timestamp |
| The ID of the job associated with the scraping job. | string |
| The status code of the scraping job. You can see the scraper status codes described here. | integer |
| The type of the parser used for breaking down the HTML content. | string |
In the following sections, parsed JSON code snippets are shortened where more than one item for the result type is available.
Product Listing Ads (PLA)
The pla
section of search results refers to Product Listing Ads, also known as Google Shopping Ads, prominently displayed at the top of the search page in a carousel format.
Key (results.pla) | Description | Type | Layout |
---|---|---|---|
| All PLAs available within the page. | array | Desktop and Mobile |
| An indicator denoting the position of a given item among PLA results. | integer | Desktop and Mobile |
| The URL of the product. | string | Desktop and Mobile |
| The price of the product in the listing ad. | string | Desktop and Mobile |
| The title of the product in the listing ad. | string | Desktop and Mobile |
| The seller of the product in the listing ad. | string | Desktop and Mobile |
| The URL of the product image. | string | Desktop |
| The base64-encoded thumbnail image of the product. | string | Desktop and Mobile |
| An indication of the position of the PLA SERP feature within the SERP. | integer | Desktop and Mobile |
Paid
The paid
section refers to advertisements powered by Google Ads, usually appearing above organic (non-paid) results.