Inspiration
My inspiration for this project stems from my desire to create a unique portfolio project for my remote software developer job search. As someone passionate about leveraging data to empower individuals, I noticed a significant lack of data-driven insights available to help high school students and professionals update their skill sets and knowledge to stay competitive in the job market. This led me to realize that by harnessing the data from a popular freelance job board telegram channel in Ethiopia, which has connected over 300,000+ users to exciting job opportunities, we can create a valuable resource for job seekers in Africa. Our Freelance Job Market Analysis aims to provide real-time trends, in-demand skills, and emerging opportunities, enabling job seekers to make informed decisions about their careers. I am thrilled to utilize my software development skills to bring this project to life and positively impact the lives of others.
What it does
Our Freelance Job Market Analysis project fetches job data from the popular telegram channel in real-time. Leveraging this data, we provide users with up-to-date insights on trends in the job market, in-demand skills, and emerging opportunities. By analyzing and processing the data, we generate valuable reports and visualizations that help job seekers make informed decisions about their career paths.
How we built it
We built this project by developing a robust data pipeline that fetches job data from the telegram channel. We implemented data sanitization techniques to ensure consistency and reliability in the dataset for analysis and prediction. To accomplish this, we utilized Google Cloud's powerful services, including BigQuery for data storage and querying, the Natural Language API or AI Platform for data analysis and sentiment analysis, and MongoDB Atlas charts for generating insightful visualizations.
Challenges we ran into
Throughout the development process, we encountered several challenges. One significant challenge was the lack of a reliable electricity supply, which affected our ability to work consistently on the project. Additionally, ensuring the consistency and quality of the data fetched from the telegram channel posed another obstacle. However, through perseverance and innovative problem-solving, we overcame these challenges and successfully addressed them.
Accomplishments that we're proud of
We take pride in successfully implementing the data fetching process from the telegram channel and ensuring the consistency and reliability of the dataset for analysis. Furthermore, we are proud to have made the dataset publicly accessible on Google Cloud, fostering a collaborative environment for creativity and exploration.
What we learned
Throughout this project, we gained valuable experience in building robust data pipelines, utilizing Google Cloud services effectively, and handling data sanitization challenges. We also developed a deeper understanding of the freelance job market and the importance of data-driven insights in supporting job seekers' decision-making process.
What's Next for Freelance Job Market Analysis in Africa
Looking ahead, our plan is to expand the scope of our analysis by incorporating data from different countries across Africa. We aim to collaborate with fellow Africans and enthusiasts in the field to refine and enhance this project. By doing so, we can ensure that all African talents, particularly the youth, have access to valuable information to make informed decisions regarding their career choices. Through partnerships and continuous improvement, we strive to make a meaningful and lasting impact on the job market in Africa.
Log in or sign up for Devpost to join the conversation.