Our inspiration for this project was Siri, but we wanted a helper that was more useful and able to access more commands.
What it does
Secretary can remote control your computer, Nest, and other Internet-of-Things devices through SMS. It uses natural language processing to parse what you say and interpret it as a command.
How I built it
We built Secretary using LUIS, Microsoft's Language Understanding Intelligence Service as our backend, and a Twilio + Node.JS server to interact with our user through SMS.
Challenges I ran into
It was difficult to implement Twilio because we wanted Secretary to be able to control the computer. Also, working with LUIS on natural language processing and on Cylon with Nest/Bluetooth because of the poor documentation. We had to teach LUIS a lot of sentences so that it would parse things correctly, which took plenty of time.
Accomplishments that I'm proud of
I'm really proud that Secretary works. All of its features are fully functional and it's really cool that it can control things through text. I actually plan on using this in my personal life after this hackathon.
What I learned
I learned how to use Twilio, Cylon, Node, and LUIS.
What's next for Secretary