Audientia

Inspiration

Movies spend a lot of time on audio, so it is clearly important for story telling. We thought people could become more immersed in books if they heard audio relevant to what they are reading.

What it does

It uses Amazon's Comprehend Machine Learning API to scan pages of books for keywords, then plays ambient audio which matches what is going on in the book.

How we built it

We used SwiftUI for the user interface and a python webserver built with flask to interact with the Amazon Web Services API.

Challenges we ran into

We initially tried to use react native, but decided it was going to complex to learn so quickly, so we pivoted to using SwiftUI.

Though SwiftUI was praised for being intuitive online, we had a hard time adapting to it and figuring out how to get it to suit our needs. Everything we built was a first for us, so we learned a lot and made tons of mistakes along the way.

Accomplishments that we're proud of

Figuring out how to build a webserver using Flask and interacting with it via Swift. Learning Swift with 0 prior knowledge. Interfacing AWS with a SwiftUI.

What we learned

How to use Swift. Some react native. Basic JavaScript. How to work with Flask to create a Restful API.

What's next for Audientia

Enhancing our key phrase detection Filtering json files Allowing user uploads

Built With

• amazon-web-services
• aws-comprehend
• flask
• json
• python
• swift
• swiftui