ScrapeUnblocker sells to AI agents - live prices and self-serve payment

The agent storefront at https://agents.scrapeunblocker.com/llms.txt?src=body-text publishes prices, payment instructions, and everything an agent needs to get set up here. Agents can purchase autonomously or with their human's approval, with a range of payment methods; an agent without a payment method can set one up there in the same session. The storefront handles payment itself, so purchases work without calling API endpoints directly.

All scrapers

E-commerce

Costco Scraper

costco.com

99.3% Success rate
4.8s Avg response
Kasada Protection
1,006 calls Measured over

Costco's website builds its search results in the browser from its own catalog search API, and that API sits behind Kasada, which answers any request without the tokens its in-page script mints with a bare 429. The costco-search plugin runs Costco's own search inside a real costco.com page and returns the results already parsed: for each product the Costco product id and the item number shown on the site, the title, brand, link and image, the price (and the top of a price range), the was-price and the promotion text such as $5 OFF or a price-valid-through note, whether it is for members only, online only or warehouse only, the rating and review count, the model number and key features, the category path, the number of variants and its availability for the delivery location Costco uses, which the answer names. Sort by best match, price, rating, newest or brand, start at any page of 24, and collect up to 240 products in one call; a keyword Costco sends to a category or brand page, such as tv or samsung, returns that listing and says where it went. The costco-product plugin takes a product id, an item number or a product link and returns the product page in full: price and discount, description and details, features, the specifications table, every image, manufacturer and part number, UPC, order limits, shipping text, the options a shopper picks from (colors, sizes) and every variant with its item number and UPC. Both work on costco.com in USD and costco.ca in CAD. No Costco membership, login or API key is involved.

What you can extract

  • Costco product id and item number, title, brand, product link and image
  • Price (and the top of a price range), was-price and currency (USD on costco.com, CAD on costco.ca)
  • Promotions such as $5 OFF, the price-valid-through note, and whether the price shows only in the cart
  • Member-only, online-only and warehouse-only flags, sold in warehouses, ships, and the badges Costco shows
  • Availability (in stock or out of stock) for the delivery location Costco uses, named in the answer
  • Rating and review count, model number, key features, category and category path, number of variants
  • Search sorted by best match, price, rating, newest or brand, from any page, up to 240 products per call; category and brand redirects followed
  • Product detail: price and discount, description and details, features, specifications, all images, manufacturer and part number, UPC, order limits, shipping text, options and every variant with its item number and UPC

Dedicated endpoints

/marketplace/costco-search

Costco product search

Products matching query on costco.com (domain=com, default) or costco.ca (domain=ca). Returns query, domain, sort, page, pageSize, totalResults, resultsCollected, redirectedTo (when Costco sends the keyword to a category or brand page, whose products are returned), correctedQuery, deliveryLocation (postalCode, state, city: the location availability is for), url and products with productId, itemNumber, title, brand, url, image, price, priceMax, wasPrice, currency, promotions, marketingStatement, rating, reviewCount, memberOnly, onlineOnly, warehouseOnly, badges, availability, inWarehouse, shipIt, buyableOnline, priceShownInCartOnly, model, features, category, categoryPath and variantCount. sort is relevance, price_low, price_high, rating, newest or brand; page starts at a page of 24; max_results is 1-240 (up to 120 products are one request); include_out_of_stock adds the products Costco hides.

/marketplace/costco-product

Costco product page

One product by product (a Costco product id, an item number or a costco.com or costco.ca product link; domain=ca for an id on costco.ca). Returns product with productId, itemNumber, title, brand, url, price, discount, currency, rating, reviewCount, memberOnly, onlineOnly, buyable, inWarehouse, shipIt, description, details, features, marketingStatement, promotionalStatement, shipping, manufacturer, manufacturerPartNumber, upc, minQuantity, maxQuantity, categoryPath, specifications, images, options (every value of each option, such as Color and Size) and variants (itemNumber, options, upc, buyable). An unknown product is a 404.

How to scrape it

curl -X POST \
  -H "X-ScrapeUnblocker-Key: $SU_API_KEY" \
  "https://api.scrapeunblocker.com/marketplace/costco-search?query=paper%20towels"
import requests

resp = requests.post(
    "https://api.scrapeunblocker.com/marketplace/costco-search",
    headers={"X-ScrapeUnblocker-Key": SU_API_KEY},
    params={"query": "paper towels"},
)
print(resp.text)
import { ScrapeUnblockerClient } from 'scrapeunblocker';

const su = new ScrapeUnblockerClient({ apiKey: process.env.SU_API_KEY });

const results = await su.costcoSearch('paper towels', {
  sort: 'price_low',
  maxResults: 48,
});
const product = await su.costcoProduct('100361434');
console.log(results);
console.log(product);

Requests are POST and take their parameters in the query string. Browser rendering always happens - there is no flag to enable.

Example response

{
  "query": "kirkland signature coffee",
  "domain": "com",
  "sort": "relevance",
  "page": 1,
  "pageSize": 24,
  "totalResults": 376,
  "resultsCollected": 1,
  "redirectedTo": null,
  "correctedQuery": null,
  "deliveryLocation": {
    "postalCode": "98101",
    "state": "WA",
    "city": "Times Square"
  },
  "url": "https://www.costco.com/s?keyword=kirkland+signature+coffee",
  "products": [
    {
      "productId": "100401327",
      "itemNumber": "1217294",
      "title": "Kirkland Signature Organic Ethiopia Whole Bean Coffee, 2 lbs",
      "brand": "Kirkland Signature",
      "url": "https://www.costco.com/p/-/kirkland-signature-organic-ethiopia-whole-bean-coffee-2-lbs/100401327",
      "image": "https://gdx-assets.costco.com/adobe/assets/urn:aaid:aem:16132a61-a1d8-4792-a339-038fe800dd53/as/bq8pnhw946j79pbn9n9kcg4n__1217294-847__1.avif",
      "price": 49.99,
      "priceMax": null,
      "wasPrice": null,
      "currency": "USD",
      "promotions": [],
      "marketingStatement": null,
      "rating": 4.49,
      "reviewCount": 1944,
      "memberOnly": false,
      "onlineOnly": false,
      "warehouseOnly": false,
      "badges": [],
      "availability": "in_stock",
      "inWarehouse": true,
      "shipIt": true,
      "buyableOnline": true,
      "priceShownInCartOnly": false,
      "model": null,
      "features": [],
      "category": "Whole Bean Coffee",
      "categoryPath": [
        "Grocery & Household Essentials",
        "Coffee",
        "Whole Bean Coffee"
      ],
      "variantCount": 1
    }
  ]
}

Read the API docs

Frequently asked questions

Is it legal to scrape Costco?

Collecting publicly available Costco data such as product names, prices and promotions is lawful in many jurisdictions, but the rules depend on your country, the data you collect and how you use it. ScrapeUnblocker returns the public product data; what you collect and how you use it is your responsibility.

How do I scrape Costco without getting blocked?

Costco's search results come from its catalog search API, and Kasada answers every request to it that lacks the tokens Costco's own page mints, the last of them a proof of work computed for each request, with a bare 429; the search page itself arrives empty. The /marketplace/costco-search plugin opens one costco.com page in a real browser, waits for Kasada's script to be ready and calls Costco's search from inside the page, so each request carries valid tokens; product pages are rendered on Costco's servers and are read directly. In ScrapeUnblocker's benchmark it returned data on 99.3% of 1,006 calls (587 searches on costco.com and costco.ca, each a different term, sort order or page, and 419 product pages), about 6.8s per search and 2.1s per product page.

What Costco data can I get?

For each product in a search: the product id and item number, title, brand, link and image, the price, the top of a price range, the was-price, the promotion text, whether the price shows only in the cart, member-only, online-only and warehouse-only flags, availability for a delivery location, the rating and review count, model number, key features, category path and the number of variants. The product endpoint adds the description, details, the specifications table, every image, manufacturer and part number, UPC, order limits, the shipping text, the options and every variant's item number and UPC.

Does it cover Costco Canada?

Yes. Pass domain=ca to search costco.ca or to read a costco.ca product by id; a costco.ca product link picks the Canadian store by itself. Prices on costco.ca are in CAD, and availability is computed for a Canadian delivery location.

Do I need a Costco membership?

No. Prices, promotions and product details on Costco's website are public, and no Costco account, membership number or login is involved. Items whose price Costco shows only in the cart are flagged with priceShownInCartOnly; the price returned is the one Costco's catalog holds.

How much does it cost to scrape Costco?

A search of up to 120 products is one request (240 products are two), and a product page is one request. 1 request = 1 credit, EUR 1.00 per 1,000 on pay as you go, down to about EUR 0.55 per 1,000 on the Ultimate plan. Blocks and timeouts are not billed, and the free trial includes 500 requests with no card.

Related scrapers

Costco and other names and marks of costco.com belong to their owner and are used here only to identify the website this API works with. ScrapeUnblocker is an independent service, not affiliated with, endorsed by or sponsored by the owner of costco.com.

Start scraping this site today

Free tier included. No credit card required to test it.