Tony realized a while back after working at an agency how much time it takes each day to monitor competitors and keep an eye on what they're doing. In certain markets it's important to know when a competitor releases a new feature, gets new press coverage, He figured that he could automate the process to save people hundreds of man hours.
How it works
- Sign up
- Add the page you wish to monitor, if there’s only a specific area of the page you wish to monitor then you add that.
- KeepUpdated sends you an updated as soon as there is a change.
There is a lot that you can learn from simply knowing what to track. For example, tracking a company's hiring page can tell you a lot about your competitor's revenue growth. You can usually estimate about 150K-200K in revenue growth (or investment) for every new hire.
Challenges we ran into
The problems with monitoring thousands of pages are numbered:
Some sites are poorly built with js memory leaks so we figured out a way to deploy our robots in manner that fires up a new machine before process and kills it after the process ends meaning that bad code, malicious code, or any other problems created in the scan are destroyed the moment the page is scanned.
Some pages change daily or make small changes that are hard to quantify for a user. So we implemented change differential percentages that both state the percentage of change that a page has made as well as highlight
Accomplishments that we are proud of
Well the entire backend is written in Go and the frontend of the app is written in Marionette. It makes for an extremely fast experience for the user and enables us to handle massive amounts of processing with very little memory.
What we learned
That the update of a competitor's movement is useful, but more useful is helping users understand what those updates mean.
What's next for KeepUpdated
We are very excited to launch some new features including a text API and SMS updates.