Inspiration
Today, big data is everywhere but hidden in plain sight. Most of us use machine learning without knowing it, but there aren't a lot of options to do data science if you're not a data scientist. Data science tools available are often limited only to business use cases for big corporations with stacks of money. Is there anything for everyday, personal use?
We wanted to make data science accessible to everyone. We believe you shouldn't have to know how to use IPython/numpy/Jupyter/Spark/Hadoop/etc to get started with machine learning. Data is also rapidly becoming a greater part of our lives.
DataTron is a modern web-enabled data science toolkit for normal people. It lets you easily reveal insights from your data with just a drag-and-drop. Our vision is to make data science accessible to all, including your parents!
DataTron is built on Electron, Node, D3.js, and Javascript.
What Datatron does
- Drop a CSV file and let DataTron do all the data science work for you. It’s like having your own personal data scientist! DataTron automagically parses and trains classifiers on your data.
- Reveal the underlying insights hidden inside of your data through a Decision Tree classifier. Try it out at our booth!
- Get live predictions of your future data points using state-of-the-art Bayesian supervised learning. Try it out at our booth!
- Upload your dataset and share your link code with others!
How we built it
We used Electron (which powers the desktop Atom & Slack app, ), Node, and vanilla Javascript. We wrote our own classifier, wrote the desktop app, wrote an Ruby API for upload/sharing, rendered some visualizations using D3.js and C3.js, and debugged some nasty nasty bugs. In less than 24 hours.
Challenges we ran into
This project is technically challenging due to the number of moving parts and Machine Learning. We also worked on:
- Writing our own Bayesian Machine Learning classifier from scratch!
- Data visualization of complex machine learning hypothesis representations (Decision Tree)
- Building cross-platform desktop apps with Electron + Node
Accomplishments that we're proud of
- We wrote a full Naive Bayes classifier with Laplace smoothing and support for numeric attributes as a Node.js module over the hackathon. It's open source at https://github.com/Leventhan/node-bayes.
- We developed a zoomable/pannable Decision Tree visualizer using D3.js and SVG.
- We spent time and effort making sure our UI/UX is as intuitive and straightforward as possible.
- DataTron is our first Electron project.
What's next for DataTron - Data Science for Everyone
After the hackathon, we plan to refactor and continue working on the app depending on public interest. Yos also plans to publish his node-bayes module to npm.
Screenshots
Built With
- c3.js
- d3.js
- decision-trees
- electron
- javascript
- jquery
- machine-learning
- naive-bayes
- node.js
Log in or sign up for Devpost to join the conversation.