Search

Google Search

google.com

Google is served through a dedicated endpoint rather than the generic page fetch, because SERP scraping needs geo and language pinning to be meaningful. Ask for results as a specific country and language, and you get what a searcher there sees.

What you can extract

• Organic results with position, title, URL and snippet
• Paid results and shopping units
• Featured snippet and people-also-ask blocks
• Local pack entries
• Geo- and language-pinned result sets

How to scrape it

curl -X POST \
  -H "X-ScrapeUnblocker-Key: $SU_API_KEY" \
  "https://api.scrapeunblocker.com/serpApi?keyword=web%20scraping%20api&pages_to_check=1"

import requests

resp = requests.post(
    "https://api.scrapeunblocker.com/serpApi",
    headers={"X-ScrapeUnblocker-Key": SU_API_KEY},
    params={"keyword": "web scraping api", "pages_to_check": 1},
)
print(resp.text)

import { ScrapeUnblockerClient } from 'scrapeunblocker';

const su = new ScrapeUnblockerClient({ apiKey: process.env.SU_API_KEY });

const results = await su.serpApi({ keyword: 'web scraping api', pagesToCheck: 1 });
console.log(results);

Requests are POST and take their parameters in the query string. Browser rendering always happens - there is no flag to enable.

Read the API docs

Related scrapers