Amazon Web Scraper

E-commerce is becoming more popular each day, so we need solutions to make it more convenient. The Amazon Web Scraper grabs all the informaiton you need from world's largest online retailer.

Comment

Inspiration

What inspired me to make this project was the increase in online shopping. Since Amazon.com is the world's largest online retailer, I thought this project would be the most applicable to many online shoppers. I did a little online shopping myself on Amazon and realized that it's very tiring to browse through each item on a particular product page. The Amazon Web Scraper makes the browsing process way faster and displays the information most online shoppers care about. This project would be especially helpful during the holiday season where people are trying to find the best gift at the cheapest price with limited time.

What it does

The Amazon Web Scraper allows the user to input any Amazon product page URL and it will grab the name, price, and the link to each product and neatly store it in a CSV file (e.g. Microsoft Excel).

How I built it

This project was built using the BeautifulSoup framework, which is an HTML parser that allows you to iterate, search and modify HTML. It was coded in Python and I stared at HTML from an Amazon product page for hours, which was a pain, but still fun and interesting.

Challenges I ran into

Staring at HTML code was very challenging for my eyes. Also, debugging the project was a pain as well because it resulted to more staring at HTML.

Accomplishments that I'm proud of

The project works and it runs. It was also very fun and helped me better understand how to use a framework.

What I learned

I further developed my Python programming, HTML, Linux, and using a framework skills.

What's next for Amazon Web Scraper

Based on the feedback I get, I will add new modifications and features to make the online shopping experience on Amazon.com more informative and easier.

Share this project:

Updates