Inspiration

Using Kafka to host data stream and ElasticSearch for real-time monitor

What it does

We built an algorithm that helps us to make decisions on each message from API that can maximize revenues.

How we built it

Using WebSocket to call API, Node.js to host app and convert data and post it to Kafka in real-time. And we used ElasticSearch to build a real-time querying monitor.

Challenges we ran into

To convert API callback data to Kafka stream. And we also had a hard time linking all the services.

Accomplishments that we're proud of

The visualization of data allows us to get insights into our algorithm of water distribution. And the platform also allows doing real-time queries without changing our code.

What we learned

Tried to link all the frameworks and packages using APIs and JSON format.

What's next for EOG Water Monitor

We used the front-end to call EOG API that is vulnerable and not necessary. Those code needs to be refactored.

Built With

Share this project:

Updates