Reddit Scraper
A web scraper that extracts posts from Reddit and stores the title and description of each post in a separate file. Great tool to use if you need Reddit's data in CSV format on your next project!
How I built it
This scraper was built with Node.js JavaScript Starter Kit. Source: https://hack.mlh.io/learn/
Getting started
Run the following command
$ node app/controllers/index.js
A post.csv file will be generated in the app folder.
What I learned
I learned about the common issues faced when scraping from a website, such as having to deal with dynamic websites that have infinite scrolling.
Built With
- javascript
- node.js
- puppeteer
Log in or sign up for Devpost to join the conversation.