Udemy Price Tracker

Inspiration

While browsing Udemy, I realized that there wasn't an easy way to monitor course prices without visiting the website manually. This led me to build a solution that could automate this process and notify me when course prices change.

Challenges

• Dealing with anti-bot detection and browser delays
• Parsing complex DOM structures to locate accurate price and title elements

Lessons Learned

• How to automate browsers using Pyppeteer
• Fundamentals of web scraping, including DOM traversal and handling dynamic content
• How to send SMS messages using the Twilio API

The Service

1. The program launches a headless browser using Pyppeteer.
2. It visits the Udemy course page(s) and scrapes course titles and prices.
3. The data is formatted and sent as an SMS using Twilio.

Built With

• python