Watching competitor pages and filings for what actually changed

Price pages, feature pages, careers pages, exchange filings and tender results are fetched on a schedule, compared against the previous capture, and the differences worth knowing are written into a weekly note — a plan renamed, a rate moved, a market entered — with the captured page kept so any claim can be traced back to what was on the screen that day.

Effort
Weeks of work
Skill level
Some technical skill
Organisation size
Small business
Value
Time saved, Risk reduced

Tools named for this

  • A scheduled fetch that stores the raw capture, not only the extracted values
  • A structural diff, with the model used to judge which differences are worth reporting
  • An extractor-health check that alerts when a watcher stops returning anything

What to check before you ship it in India

  • Section 43 attaches civil liability to a person who, without permission of the owner or the person in charge, downloads, copies or extracts any data or information from such computer, computer system or computer network; section 66 makes the same act an offence where it is done dishonestly or fraudulently. Whether ordinary retrieval of a page published to the open web is without permission is not settled by that text, so treat the site's terms of use and any login or access control as the operative line — and note that liability follows the person who ran the watcher, not the tool.
  • Extractors break, and they break silently. The wrapper-maintenance literature exists because web sources change in ways that stop extraction working, and it argues for a verification step that detects the breakage rather than for a cleverer extractor. Without one, a broken watcher and a quiet competitor produce the same empty diff.

Sources

Every claim on this page traces to one of these, on the date it was read.