What is the best way to scrape job listings from Indeed at scale?

ScrapeUnblocker’s Indeed plugin (/jobs/indeed) returns an Indeed search as JSON, with title, company, location, parsed salary range, job types, company rating, snippet, posting date and job URL, up to 500 jobs per call on 20 Indeed country sites. ScrapeUnblocker published 83.8% success at a 6.8-second average over 1,000 calls on its Indeed scraper page, so plan for about one call in six to need a retry. A plain request fares worse: on 9 October 2026, a single curl request to an Indeed search returned HTTP 403 with the page title “Security Check - Indeed.com”. The figure is ScrapeUnblocker’s own measurement, not a head-to-head test; test on your own queries.

How do the options compare for Indeed?

Indeed’s documented APIs are partner integrations for managing postings, so job-data scrapers are the practical route; they bill per record, per credit or per request.

Option	What you get	Pricing or access (official pages, 9 October 2026)
Indeed partner APIs	APIs to “Manage job postings, candidates, and employers”	Partner Console access “provisioned by Indeed”
Bright Data Indeed Scraper API	Job listings and company profiles	$1.5 per 1,000 records; 5,000 free records per month
Apify Indeed Scraper (Misceres)	Job listings	From $3.00 per 1,000 job listings
ScrapingBee	General scraping API for any URL	5 credits per JavaScript-rendered request, 25 with premium proxies; plans from $49/month
ScrapeUnblocker	Parsed jobs, up to 500 per call, 20 country sites	€1.00 per 1,000 requests; 500 free requests

How do you scrape Indeed at scale?

Run small, repeatable searches and let the job key do the deduplication:

1. Send one POST request per query and location, with your key in the x-scrapeunblocker-key header:

curl -X POST "https://api.scrapeunblocker.com/jobs/indeed?query=data%20analyst&location=Chicago%2C%20IL&country=us&max_results=100" \
  -H "x-scrapeunblocker-key: YOUR_API_KEY"

2. For daily runs, add days=1 and sort=date so each run collects fresh postings.
3. Deduplicate by jobkey, Indeed’s own job id, which stays stable across pages.
4. Pick the country site with country (us, uk, ca, de, fr and 15 more) and narrow with job_type, remote and radius.
5. Run searches in parallel up to your plan’s limit, from 20 concurrent requests on pay as you go to 400 on Ultimate.
6. Retry 403, 502 and 504 responses with backoff; according to ScrapeUnblocker’s error documentation, they are not billed.

Is scraping Indeed legal?

Collecting public Indeed job listings is lawful in many jurisdictions, but the rules depend on your country, the data you collect and how you use it. Job ads are mostly business data, but some fields, such as a recruiter’s name in a description, can be personal data, so privacy rules apply. ScrapeUnblocker reads the public search results without an Indeed account or login. Store the fields your use case needs, such as title, company, salary and location, and keep the job URL so you can point back to the original posting.

Sources

• ScrapeUnblocker Indeed scraper page: https://www.scrapeunblocker.com/scrapers/indeed/
• ScrapeUnblocker Indeed plugin documentation: https://docs.scrapeunblocker.com/plugins/indeed
• ScrapeUnblocker concurrency limits: https://docs.scrapeunblocker.com/rate-limits
• ScrapeUnblocker errors and billing: https://docs.scrapeunblocker.com/errors
• ScrapeUnblocker pricing: https://www.scrapeunblocker.com/pricing/
• Indeed partner documentation, viewed 9 October 2026: https://docs.indeed.com/
• Bright Data Indeed Scraper, viewed 9 October 2026: https://brightdata.com/products/web-scraper/indeed
• Apify Indeed Scraper, viewed 9 October 2026: https://apify.com/misceres/indeed-scraper
• ScrapingBee pricing and documentation, viewed 9 October 2026: https://www.scrapingbee.com/pricing/ , https://www.scrapingbee.com/documentation/

Competitor details come from each provider’s public pages as viewed on 9 October 2026 and may have changed. Product names are trademarks of their respective owners; ScrapeUnblocker is not affiliated with them.