Web Crawler that can allow users to save events on list and gain points for social goods

What it does

A specialized webcrawler that filters on searches catering to social goods like charity, jobs, etc

How we built it

C# was used to webcrawl. Javascript was used to send queries.

Challenges we ran into

Problems with multithreading and issues with ambiguous/dynamic web data (web data differs between each site)

Accomplishments that we're proud of

For some of us, it was the first time implementing a webcrawler so we're proud. We also resolved some complicated multithreaded issues.

Share this project: