Shopping

See how to scrape Google Shopping in two steps: generate tokens from search, then extract detailed product information.

Google Shopping sources are designed to to gather SERP and product listing data through google_shopping_search and google_shopping_product sources respectively. The data extraction is a two-step process displayed below.

Step 1: Generate the Token

First, you need to submit a request to the google_shopping_search source. This step is essential because it generates the product token, which is required to collect product data later. Below is a basic JSON payload for google_shopping_search request:

{
  "source": "google_shopping_search",
  "query": "google_pixel",
  "render": "html",
  "parse": true
}

Important: Only rendered parsed jobs will return product tokens.

Once the job is completed, you’ll find the token in the response, under the organic section:

{
    "results": [
        {
            "content": {
                "url": "https://www.google.com/search?q=google_pixel&gl=us&hl=en&udm=28&sei=1uDkaLnMNPCNxc8P67XmqQg",
                "page": 1,
                "results": {
                    "paid": [],
                    "organic": [
                        {
                            "pos": 1,
                            "url": "https://www.google.com/shopping/product/547163035992318172?q=google_pixel&gl=us&hl=en&udm=28&sei=1uDkaLnMNPCNxc8P67XmqQg&gl=US",
                            "type": "grid",
                            "price": 899,
                            "title": "Google Pixel 9 Pro XL",
                            "token": "eyJjYXRhbG9naWQiOiAiNTQ3MTYzMDM1OTkyMzE4MTcyIiwgImdwY2lkIjogIjQ0MjYwMDg2MDY1MDIwNTc4NTkiLCAiaW1hZ2VEb2NpZCI6ICIxMjMwMTAyNDkzMzk0Mjg2MjY4IiwgIm1pZCI6ICI1NzY0NjI3ODc4NTM5Njc1NDAiLCAicHZvIjogIjIzIiwgInB2dCI6ICJoZyIsICJyZHMiOiAiUENfNDQyNjAwODYwNjUwMjA1Nzg1OXxQUk9EX1BDXzQ0MjYwMDg2MDY1MDIwNTc4NTkiLCAicXVlcnkiOiAiZ29vZ2xlX3BpeGVsIn0=",

Each collected product token in parsed results represents a single organic result.

Note: Without a generated token, it’s not possible to retrieve product or pricing information.

Step 2: Use the Token in the Product Request

To start collecting product data, use the generated token in your request to the google_shopping_product source:

{
  "source": "google_shopping_product",
  "query": "eyJjYXRhbG9naWQiOiAiNTQ3MTYzMDM1OTkyMzE4MTcyIiwgImdwY2lkIjogIjQ0MjYwMDg2MDY1MDIwNTc4NTkiLCAiaW1hZ2VEb2NpZCI6ICIxMjMwMTAyNDkzMzk0Mjg2MjY4IiwgIm1pZCI6ICI1NzY0NjI3ODc4NTM5Njc1NDAiLCAicHZvIjogIjIzIiwgInB2dCI6ICJoZyIsICJyZHMiOiAiUENfNDQyNjAwODYwNjUwMjA1Nzg1OXxQUk9EX1BDXzQ0MjYwMDg2MDY1MDIwNTc4NTkiLCAicXVlcnkiOiAiZ29vZ2xlX3BpeGVsIn0=",
  "parse": true
}

Important: If an invalid or incorrectly generated token is used, the job will fail.

When using localization parameters for google_shopping_product and google_shopping_search sources, make sure to use the same locales (none if not defined). Regional misalignment between the sources may result in incomplete or inaccurate data.