How to Track Smyths Toys Prices and Stock Before Black Friday
You point a script at smythstoys.com to see what the LEGO sets cost this week, and you get back a page that says “Pardon Our Interruption”. Try a headless browser and you might get the homepage, but the moment your code asks for a product’s stock, the answer is a 403. Two weeks before Black Friday, that is a bad time to find out.
Smyths Toys is one of the biggest toy retailers in the UK and Ireland, and in November its prices move every few days. This morning, 20 November, the site already had “Black Friday” badges on half of the LEGO Star Wars range. If you sell toys, compare prices, or just want a specific set before it sells out, you want those numbers in a spreadsheet, not in forty browser tabs.
This guide shows what Smyths puts in the way, a short Python script that returns price and stock for any product, real output from today, and how the same calls held up when we pushed thousands of products through them.
What smythstoys.com puts in your way
Smyths uses Imperva (formerly Incapsula) bot protection. A scraper runs into it in layers:
- Plain HTTP clients are stopped at the door.
requests,curlorhttpxget the “Pardon Our Interruption” interstitial instead of HTML. That page runs a JavaScript challenge, and only a browser that passes it gets the session cookies Imperva expects (reese84and friends). - Passing the challenge is not the end. The product page you see in a browser is built from JSON that the storefront fetches from its own data API. That API checks more than cookies: a call that does not look exactly like the site’s own request gets a 403, even from a real browser with valid cookies.
- Cookies belong to one IP. A session earned on one IP address does not carry over to another. Rotate your proxy mid-session and you are back to 403.
- Datacenter IPs rarely get through, and some sessions that load the homepage fine are still refused by the data API.
- Sometimes Imperva raises the bar for everyone. On 17 November it switched on a picture puzzle (“Additional security check is required”, then “select the icons in this order”) for new visitors, three times in one day. A scraper with no way to answer it simply stops.
None of this is aimed at you personally. It is a store protecting itself from bots, and a price checker looks like a bot.
What it takes to get a clean answer
A request that gets Smyths’ JSON back needs a real browser session that passed the challenge, the same IP for the follow-up calls, and a request that matches what the storefront sends, header for header. One session handles a limited number of calls before Imperva gets suspicious, so at any volume you need a steady supply of fresh sessions on clean IPs. When the puzzle shows up, a new session has to solve it before it is any use.
Some things did not work for us, and they may save you an afternoon:
- Residential IPs on their own did not fix the data API. The homepage loaded, the stock call still came back 403.
- Not every puzzle service handles this puzzle. One of the two we tried did not solve a single one in 150 seconds.
- Copy the request exactly. We spent an evening convinced that a solved session could never reach the stock API. It turned out our test script left out one query parameter the storefront always sends, and Imperva refuses that shape of request from anyone, human or not. Capture the real call in your browser’s network tab before you start guessing.
Doing all of this yourself is possible. Keeping it running every day is the expensive part. ScrapeUnblocker has a dedicated Smyths Toys endpoint that does it and hands you Smyths’ own JSON.
A Smyths price and stock tracker in 20 lines of Python
Install the SDK with pip install scrapeunblocker and set SCRAPEUNBLOCKER_KEY (a new account comes with 500 free requests). The script finds products with a search, then asks for each one’s price and stock:
from scrapeunblocker import Client
su = Client() # reads SCRAPEUNBLOCKER_KEY
# 1. Find product codes: one search page = one billed request.
found = su.smyths_search("lego star wars", max_results=60)
# 2. Check price and stock for the first ten matches.
for item in found["products"][:10]:
stock = su.smyths_inventory(item["code"])
prices = stock["prices"]
print(
item["code"],
item["name"][:45].ljust(45),
prices["price"],
"RRP " + (prices["rrpPrice"] or "-"),
"delivery: " + stock["hdSection"]["stockMessage"],
"collect: " + stock["ccSection"]["stockMessage"],
", ".join(item.get("decals") or []),
)
This is what it printed on 20 November 2026 at 10:15 UTC (11 requests, about 9 seconds one after another):
259099 LEGO Star Wars 75456 Advent Calendar 2026 Set £22.99 RRP £29.99 delivery: Out of stock collect: In Stock Black Friday
259132 LEGO Star Wars 75454 Imperial Remnant AT-AT w £111.99 RRP £139.99 delivery: In Stock collect: In Stock
232325 LEGO Star Wars 75375 Millennium Falcon 25th A £49.99 RRP £74.99 delivery: In Stock collect: In Stock Black Friday
254441 LEGO Star Wars 75426 SMART Play: Millennium F £59.99 RRP £89.99 delivery: In Stock collect: In Stock
245082 LEGO Star Wars 75429 AT-AT Driver Helmet Set £69.99 RRP - delivery: In Stock collect: In Stock RARE
259087 LEGO Star Wars 75455 Boba Fett Set for Adults £119.99 RRP £149.99 delivery: In Stock collect: In Stock Black Friday
254452 LEGO Star Wars 75460 New Republic X-Wing Star £56.99 RRP £59.99 delivery: In Stock collect: In Stock RARE
259086 LEGO Star Wars 75453 Offworld Sandcrawler and £134.99 RRP £179.99 delivery: In Stock collect: In Stock Black Friday
208075 LEGO Star Wars 75337 Revenge of the Sith AT-T £109.99 RRP £119.99 delivery: In Stock collect: In Stock Black Friday
259006 LEGO Star Wars 40806 Gingerbread AT-AT Walker £43.99 RRP £54.99 delivery: In Stock collect: In Stock Black Friday
Look at the first line. The 2026 Advent Calendar is out of stock for home delivery but in stock for click & collect. A tracker that only reads the product page’s “Add to basket” state would miss that. The stock answer has two separate sections, hdSection for home delivery and ccSection for collection, and each has its own status, message and pre-order flag.
A few more fields worth keeping:
prices.valueis the price as a plain number ("22.99"), easier to compare than"£22.99".wasPriceanddiscountedPercentagefill in when Smyths marks a reduction.rrpPriceis the recommended retail price, sorrpPriceminusvalueis the real discount even when there is no “was” price.decalsin search results carry badges like “Black Friday” and “RARE”.expectedStockDateandisPreOrdertell you when an out-of-stock item is due back.
For the product page itself (description, key features, safety warnings, the image gallery), call su.smyths_details(code).
How it holds up: the numbers
Ten products is a demo. These are the runs we use to judge the endpoint, all made against the live site through our production API:
| Date | Test | Result | Median response |
|---|---|---|---|
| 13 Oct 2026 | 5,000 different products, stock and price, 20 at a time | 5,000 of 5,000 | 0.64 s |
| 13 Oct 2026 | 3,000 products, 100 at a time | 2,998 of 3,000 | - |
| 13 Oct 2026 | 4,000 products, 200 at a time, starting with no ready sessions | 4,000 of 4,000 | 6.8 s |
| 15 Oct 2026 | 200 random products, full product page details | 199 of 200 | 1.8 s |
| 18 Nov 2026 | 1,000 calls: 880 stock checks, 80 product details, 40 category pages, 10 at a time | 1,000 of 1,000 | 0.8 s (stock) |
The one miss on 15 October was a product Smyths had taken off its catalogue. The slower median at 200 at a time came from requests waiting for free capacity on our side, not from Smyths slowing down.
Real traffic is messier than a test run. Over the seven days to 17 November, 97.9% of about 27,400 production calls to this endpoint returned data. Most of the rest were Smyths’ own error for product codes it no longer sells, which you get back as a 502 with an X-Origin-Status header, and which is not billed.
The bad evening in November
The numbers above are not the whole story, and you should know what a bad day looks like before you build on anything.
On 17 November Imperva started showing the icon puzzle to new sessions: three times that day, the last time for about two hours in the evening, and again on 18 November from early morning until early afternoon. Sessions made before a wave kept working for a while, then expired, and new ones could not be made. During those hours most calls failed. They were not billed, but a nightly price run that comes back empty is still a lost night.
On the afternoon of 18 November we shipped automatic solving. When a fresh session hits the puzzle, it is solved in the background in about 8 to 13 seconds, and the session joins the supply like any other. Your request does not wait for that to happen. We tested it against live puzzles while the wave was still on. To be honest about the limit: that wave ended on its own at about the time the fix went live, and Imperva has not run a full wave in production since, so the real test, two hours of puzzles under full load, is still ahead of us. The 1,000-call run in the table was made that evening, after the wave. We are watching for the next one.
Turning it into a Black Friday tracker
The script above is a snapshot. A tracker needs three more things.
Cover the range, not just a search. Smyths’ search returns its best 240 matches at most. For a whole range, list a category with su.smyths_category(...): a category page has 60 products, comes back with its subcategories and their product counts, and the Toys category alone holds thousands of products. Collect the codes once, then refresh them weekly, because new lines appear all through November.
Check on a schedule and keep history. Run the stock checks every few hours, write one row per product per run (code, value, rrpPrice, delivery status, collect status, timestamp), and the interesting questions answer themselves: when did the price drop, how long did the delivery stock last, which sets went out of stock first.
Alert on what matters to you. A price below a target, a “Black Friday” badge appearing, delivery stock coming back. For a quick personal alert, a free push service such as ntfy is enough.
On cost: each stock check or product details call is one request, and each search or category page is one request for up to 60 products. Watching 2,000 products every six hours is about 8,000 requests a day. Pricing starts from €0.55 per 1,000 requests, and failed requests are not billed.
Prefer no code?
The same data is available as the Smyths Toys Stock & Price Scraper on Apify: paste product codes or links, run it, download a CSV. You can also try single products in the ScrapeUnblocker dashboard, which shows the result and a copy-paste code snippet. The Smyths Toys scraper page lists every field.
FAQ
Does Smyths Toys have a public API?
No. The JSON this guide uses is the storefront’s own data API, the one the website calls when it renders a product page. It is not documented for outside use and it is protected by Imperva.
Do I need a Smyths account?
No. Prices and stock are what any visitor sees without logging in, and the endpoint never logs in.
Does it work for Smyths Ireland and other countries?
The endpoint covers Smyths Toys UK (smythstoys.com/uk/en-gb), with prices in GBP.
Why does my own Playwright script get the homepage but not the stock?
Because the data API checks more than cookies. The call has to match the storefront’s own request and come from the same IP that earned the session. See the first section of this guide.
What happens when Smyths removes a product?
Smyths answers with its own error for codes it no longer knows. You get a 502 with an X-Origin-Status header and Smyths’ error body, and the call is not billed. Drop the code from your list.
Try ScrapeUnblocker free
95%+ success rate · from 0.55€ per 1,000 calls (VAT may apply) · 500 free requests on signup.