URL
The google
source is designed to retrieve content from various Google URLs. This means that instead of sending multiple parameters, you can provide us with a direct URL to the required Google page. We do not strip any parameters or alter your URLs in any other way.
Request samples
In the example below, the API will retrieve a Google Scholar search page.
curl 'https://realtime.oxylabs.io/v1/queries' \
--user 'USERNAME:PASSWORD' \
-H 'Content-Type: application/json' \
-d '{
"source": "google",
"url": "https://scholar.google.com/scholar?hl=en&q=newton&btnG=&as_sdt=1%2C5&as_sdtp="
}'
We use synchronous Realtime integration method in our examples. If you would like to use Proxy Endpoint or asynchronous Push-Pull integration, refer to the integration methods section.
Request parameter values
Generic
Basic setup and customization options for scraping Google URLs.
source
Sets the scraper.
google
url
Direct URL (link) to the Google page.
-
render
-
parse
-
callback_url
-
user_agent_type
desktop
geo_location
-
Output example
{
"results": [
{
"content":"<!doctype html>\n<html lang=\"en\">\n<head>
...
</script></body>\n</html>\n",
"created_at": "2024-05-27 12:28:27",
"updated_at": "2024-05-27 12:28:30",
"page": 1,
"url": "https://scholar.google.com/scholar?hl=en&q=newton&btnG=&as_sdt=1%2C5&as_sdtp=",
"job_id": "7200835246005180417",
"status_code": 200
}
]
}
Last updated
Was this helpful?