We have observed that many people complain about the fact that they have to waste too much time to go to every company and deal with queues just to move their package or sign a new contract with a company.
What it does
Helps you compare prices of some mobile network, Internet, television, energy or gas providers.
How we built it
We have some scrapers which extracts data from some providers websites, a server which save those informations into a database and a website where you can compare those providers packages characteristics and prices.
Challenges we ran into
It was a real challenge to scrape different templates of telecommunication sites as they all have a different structure, so we have created different templates of scraping them. Another interesting challenge we ran into it was that when we had to map all the data and realize all the relationships and perform CRUD operations on the tables.
Accomplishments that we're proud of
We are proud of our scraping method because it's fast, easy to handle and efficient. We can handle lots of data in no time and we can serve them to the end-user fast and easy.
What we learned
We have learned that an AGILE methodology is efficient and helpful, for this we have used Trello to manage our tasks and move a specific Task in different stages, giving us time to have a highly maintainable and scalable code. We have learned that ORM is very important in developing fast and consistent queries.
What's next for Gator
Next we will have to: - Implement an authentication system and let the user complete his profile with his actual providers in the telecommunication or energetic area. - Add more search criteria - Generate tendencies of search - Create more scraping templates (more companies and domains) - Create an administration panel to manage the users, preferences and offer acceptance - Fixing some visual bugs on the mobile devices