Inspiration
The need for real-time environmental data is critical for public health, climate awareness, and proactive community response. EnviroTrack aims to provide easy access to accurate, real-time data on air quality, weather, and environmental conditions, empowering communities to make informed decisions for a healthier environment.
What it does
EnviroTrack collects live data from the OpenWeather API on weather conditions, air pollution, and geographical location. This data is continuously processed, cleaned, and transformed in Microsoft Fabric, and updates are pushed to a real-time dashboard. The dashboard enables users to monitor environmental factors as they change, offering valuable insights that help individuals, organizations, and communities take action for a sustainable future.
How we built it
The project was built using Microsoft Fabric as the core platform for data handling and visualization: Data Collection: Integrated the OpenWeather API to gather live data on weather, air quality, and geolocation. Data Processing: Utilized Microsoft Fabric Notebooks for data cleaning and transformation to prepare data for analytics. Data Storage: Stored processed data in the Fabric Lakehouse, ensuring an organized structure for historical data access. Real-Time Updates: Leveraged Dataflow Gen 2 to continuously push updates to the Eventstream. Visualization: Developed a real-time dashboard using Eventstream, providing users with intuitive visual insights into environmental data.
Challenges we ran into
Data Latency: Ensuring minimal delay between data fetching, processing, and dashboard updates was challenging. Optimizing Fabric's event processing pipeline helped overcome this issue. API Rate Limits: Managing the rate limits of the OpenWeather API required careful planning and efficient data handling to prevent throttling. Integration Complexities: Integrating multiple Microsoft Fabric components (Notebooks, Lakehouse, Eventstream) posed challenges in ensuring seamless data flow, requiring a well-coordinated approach.
Accomplishments that we're proud of
Successfully implemented a fully integrated, real-time environmental monitoring system within Microsoft Fabric. Designed an intuitive dashboard that provides actionable insights and allows users to monitor real-time environmental conditions. Achieved efficient handling of live data streams with minimal latency, ensuring a responsive user experience for the dashboard.
What we learned
Gained a deeper understanding of Microsoft Fabric’s real-time analytics and integration capabilities. Enhanced skills in managing live data streams and optimizing data flow. Improved abilities in data cleaning, transformation, and dashboard design for real-time applications.
What's next for EcoSense: Real-Time Environmental Monitoring System
Predictive Analytics: Incorporate machine learning models to predict trends in air quality and weather conditions for better decision-making. User Notifications: Implement real-time alerts for specific conditions (e.g., high pollution levels), notifying users of dangerous environmental events. Expansion: Add more environmental factors like soil quality or noise pollution, enhancing EnviroTrack into a comprehensive environmental monitoring solution.
Built With
- dataflowgen2
- eventstream
- lakehouse
- microsoftfabric
- notebook
- openweathermap
- powerbi
- pyspark
- realtimedashboard
Log in or sign up for Devpost to join the conversation.