ZZ

Inspiration

Search engines are good enough, but is there a faster way to search for data. We came up with the idea of using crawlers.

What it does

Instead of using what we learned in class, we learned the usage of python from scratch and wrote a crawler to crawl the top five movies on movie sites.

How we built it

We parsed the source code composition of many websites, analyzed which frames and headings the information we needed was under, and then tried to read it in python and store it locally.

Challenges we ran into

Every website is built differently in code almost every time, and every information we want to crawl is stored differently. This means we need to frequently find and change the way that works for us. This is very time consuming.

Accomplishments that we're proud of

We learned new technologies from scratch and succeeded in achieving our goals!

What we learned

We have mastered the basic syntax of python and learned more about the wide variety of powerful libraries available in python. We tried to use scripts with the website (which didn't work because of time), but we learned some rules for using HTML.

What's next for ZZ

This is certainly not our ultimate goal, we want to crawl the content on the school's website and implement a syllabus that will get all relevant courses by just typing in the major

Built With

• html
• python