Checking a competitor's pages by hand costs you an hour a week and still misses the change that mattered. Here is how to watch public pages properly and be told only when something moves.
Stop looking. Start being told.
Everything you want to know about a competitor's public position — what they charge, what they stock, what they have stopped selling, what they have started promising — is on their website, visible to anybody. The information is not hidden. The problem is that it changes on their schedule, not yours.
So the useful method is not to visit more often. It is to have something watch the pages continuously and alert you the moment a page is different from the last time it was checked.
Say you follow six competitors, three pages each. Eighteen pages.
Opening eighteen pages, scanning them, and trying to remember what they looked like last week takes twenty to thirty minutes if you are quick. Do it weekly and it is around twenty hours a year — most of a working week, spent mostly confirming that nothing has changed.
That is the smaller cost. The larger one is that it does not work.
You are comparing a page in front of you against a memory from seven days ago. You will spot a redesign. You will not spot a price moving from one number to a slightly different one, a delivery promise shortening from five days to three, a product quietly disappearing, or a new line added at the bottom of a category. Those are exactly the changes worth knowing about, and they are exactly the ones the human eye skips.
And you find out on your schedule. If you check on Mondays and they changed their prices on a Tuesday, you have been quoting against stale information for six days.
Worth being clear about, because the word "competitor" makes people uneasy.
Everything discussed here is a public page. The same page any customer sees. Reading a competitor's price list is not intelligence work; it is what every shopkeeper has done since there were two shops on the same street. The only thing that has changed is that the street is now large enough that walking down it takes a week.
What is not on the table: anything behind a login you were not given, anything that requires pretending to be someone else, and hammering a small business's server with requests. A sensible checking interval — a few times a day at most — puts less load on a site than one curious customer.
Not everything. A page that changes constantly generates noise and you will start ignoring the alerts within a fortnight.
Price pages, and individual product pages for the items you compete on directly. This is the highest-value watch and the one that pays for itself first.
Category or shop pages, where new products appear and discontinued ones vanish. A competitor adding a line is a signal about where they think the market is going.
Service and delivery pages. Lead times, guarantees, coverage areas, minimum orders. These change rarely and mean a lot when they do.
Careers pages. An underrated one. A company hiring three installers is expanding. A company that has stopped hiring anybody, after months of adverts, has hit something.
What to leave alone: home pages full of rotating banners, anything with a live feed, blog indexes, and pages carrying a visitor counter or a date stamp. They change every hour and tell you nothing.
A competitor drops the price on a product you both sell, on a Tuesday afternoon.
Checking manually on Mondays, you find out six days later — after you have sent four quotes at a price the market has moved away from, and after you have lost two of them without knowing why.
Watched automatically, you know within hours. You still might do nothing: matching a price is not always the right answer, and sometimes the right answer is to leave them to it. But you make that decision knowing, instead of discovering it in your win rate a month later.
The mechanism is simple, which is why it is reliable.
You give it the addresses you care about. It fetches each page on a schedule and stores what it found. On the next check it compares the new version against the stored one. If they are identical, nothing happens and you hear nothing. If they differ, you get an alert telling you which page changed and what changed on it.
That last part is what separates a useful tool from a noisy one. Being told "something on this page is different" sends you back to reading the whole page. Being told which line moved, and from what to what, is an answer.
Everything gets logged, which turns out to matter more than the alerts. After six months you can see that a competitor has raised prices twice, that one product has been out of stock for weeks, or that their delivery promise has crept from three days to five. None of that is visible in a single snapshot. It only exists if something was writing it down.
Competitive Intelligence Scrapper does this: you add the pages, it watches them on a schedule, it alerts you when something moves, and it keeps the history so you can export it and look at the pattern rather than the moment.
How often should pages be checked?
Daily is enough for almost everything. Prices in a fast-moving market might justify a few times a day. Anything more frequent produces noise, not insight.
What if the site changes its layout?
Then everything looks different at once and you get one large, obviously cosmetic alert. Annoying for a day. It also tells you they have redesigned, which is itself worth knowing.
Can they tell I am watching?
A page fetch looks like a visit, and a handful of visits a day from one place is invisible in any site's traffic. There is nothing to hide — you are reading a public page — but nor is there a notification on their end.
Is it worth it if I only have two competitors?
Two competitors and six pages is fifteen minutes a week by hand, which is manageable. The reason to automate it is not the time. It is that a machine notices a price moving by a small amount, and you do not.
Pick the six pages you would genuinely want to know about within a day, and stop checking the rest.
Competitive Intelligence Scrapper is a Windows application that watches the pages you choose, tells you when something changes, and keeps the full history so you can export it and see the pattern. It runs on your own machine — no account, no subscription to a monitoring service, no data leaving your desk.
See Competitive Intelligence →