Inspiration
We thought that there should be an easier way for everyone (who is not familiar with programmer) to be able to scrape the web for information they find handy and easily accessible to them. The Dropbase API allowed us to do this. Anyone can now scrape daily COVID cases, their favorite stock prices or just the score of their favorite sports games.
What it does
Allows users to scrape any information off the web to their liking. The user can then easily access that information through Dropbase The user can set a timer on how often the program should scrape the data. So a sports fan could get the score every minute, or a scientist could get the daily COVID cases every day.
How I built it
Built using a React front end and a Django back end. We used celery to handle asynchronous tasks.
Challenges I ran into
Dealing with the API endpoints when connecting the back end to the front end.
Accomplishments that I'm proud of
We were able to build something that is easily accessible to anyone, regardless of technical background so that they can use and access the information that is important to them. We were able to potentially help someone who does not know much about programming accomplish a very useful task in web scraping.
What I learned
We learned how to do pair programming and asynchronously execute tasks with celery.
What's next for SheetScrape
Deploy to AWS.

Log in or sign up for Devpost to join the conversation.