What is the best way to scrape product prices and availability from e-commerce sites reliably?

A reliable way to track e-commerce prices and availability is to collect structured product data instead of parsing HTML: use a site-specific endpoint where one exists, read the page’s own Schema.org or __NEXT_DATA__ product data for other stores, request each store from its own country, and check the content of every response before you store it. With ScrapeUnblocker, that means plugin endpoints for stores such as Amazon, Walmart, Target, eBay and Etsy, and parsed_data=true on /getPageSource for any other product URL. Test the setup on your own product list before you scale it.

How do I set it up step by step?

1. Check your stores against ScrapeUnblocker’s scraper catalog. Plugin endpoints return JSON for Amazon products and searches and for Walmart, Target, eBay, Etsy, Zalando and AliExpress searches, among others.
2. For every other store, send the product URL to /getPageSource with parsed_data=true. A product page returns page_type: "product" with title and price, plus fields such as currency and availability when the page provides them.
3. Set proxy_country to the store’s market. ScrapeUnblocker’s documentation notes that scraping amazon.de from a US IP often returns the US redirect page.
4. Reject rows where price is missing or page_type is not product, because a blocked page can still arrive with status 200 (how to detect soft blocks).
5. Store each price with a timestamp, currency and URL, and compare it with the previous run.

How reliable are the dedicated store endpoints?

ScrapeUnblocker publishes a measured success rate on each store’s scraper page. Each figure below was measured by ScrapeUnblocker over the number of calls shown; none of them is a comparison with another provider:

Store	Success rate	Average response	Calls measured
Walmart (search)	99.9%	13.8 s	1,164
eBay (search)	99.5%	4.9 s	1,000
Amazon	97.5%	18.8 s	1,000
Target (search)	97.4%	1.9 s	1,164
Etsy (search)	100.0%	3.7 s	1,000

Which price and stock fields do the store endpoints return?

The field lists differ by store, so check stock coverage before you rely on it. According to ScrapeUnblocker’s scraper pages, the Amazon plugin returns price and currency, list price and savings, availability with a boolean in-stock flag, rating, review count and the buy-box seller. Walmart search returns price, was-price, currency, brand, seller and availability. eBay search returns price, currency, condition, seller feedback, shipping and sold counts. Target and Etsy searches return price and currency but list no availability field.

Are there other good options?

Yes. Firecrawl’s documentation lists a product format that extracts title, price, availability, images and variants from product pages, and ScraperAPI documents autoparse=true for Amazon, eBay, Walmart, Google and Redfin. For stores without bot protection, a plain HTTP request that reads the page’s Schema.org Offer data, which defines price, priceCurrency and availability, can be enough. Whichever tool you use, test it on your own product URLs and count the prices you actually received. Read the full Amazon walkthrough: How to Scrape Amazon Prices.

Sources

• ScrapeUnblocker scraper catalog (Amazon, Walmart, Target, eBay and Etsy scraper pages): scrapeunblocker.com/scrapers
• ScrapeUnblocker parsed data guide: docs.scrapeunblocker.com/guides/parsed-data
• ScrapeUnblocker plugins: docs.scrapeunblocker.com/plugins/overview
• ScrapeUnblocker country targeting: docs.scrapeunblocker.com/guides/country-targeting
• Schema.org, Offer type: schema.org/Offer, viewed 24 September 2026
• Firecrawl advanced scraping guide: docs.firecrawl.dev/advanced-scraping-guide, viewed 24 September 2026
• ScraperAPI JSON autoparse: docs.scraperapi.com, viewed 24 September 2026

Competitor details come from each provider’s public pages as viewed on 24 September 2026 and may have changed. Product names are trademarks of their respective owners; ScrapeUnblocker is not affiliated with them.