I was inspired by various websites presenting Statistics of Covid19 Data around the world. So I wanted to visualize data of vaccination going around India. Since Elastic Stack is a great tool for data analytics and visualization, I used it for my project.
What it does
Using Kibana it presents and Visualize Vaccination Data in India.
How I built it
It was built using Elasticsearch, logstash and Kibana. Firstly Elasticsearch, Kibana was configured. Custom Logstash Pipeline Configuration pipeline was created for CSV dataset. Detailed process about the creation of project is provided in the Readme of Github Repository.
Challenges I ran into
It was difficult to find good dataset of vaccine since official numbers are not released. The data was used from a static csv file which comes from Govt. So update in the dataset cannot be visualized easily. Constant updates in the dataset created difficulty in efficient results.
It was my first time using elastic technology so it took time how to deploy and use the tools. Whenever the instance was stopped the IPv4 changed so I have to configure the files again to access the dashboard, it was time consuming which could be easily resolved by using static IP address but it would cost extra.
What I learned
I learned quite a lot about Elasticsearch technology and its different tools. This was my first time visualizing data using any tool. I learnt how to deploy the services and configure files for ELK. Also understood how to use NGINX for accessing services and deploying it.
What's next for Covid Vaccination in India Visualization
In future when dataset is expanded and several discrepancy are removed then visualization can be expanded. Also Realtime data analysis can also be done using Beats.
Custom Docker Image can also be created so that people could use the docker image, provide their port and access the dashboard and its tools.