FillNova

Inspiration

Filling Forms is always a chore and I always wished for a bot that would help me fill forms in hands free manner. When I started experimenting with Nova Sonic , this struck me as a very natural use case. and hence got started on this project.

What it does

It uses Nova Sonic to Converse with the user to get information needed to fill the given form. These could be simple forms or complex. The longer the more this makes sense.

How we built it

I got started from the code already available in https://github.com/aws-samples/sample-serverless-nova-sonic-chat . Added Websocket Lambda to enable 2 way information sync between Nova and the Form State. The rest is Nova Sonic doing its thing.

Challenges we ran into

Multiple Architectures had to be tried and this itself is my fifth attempt. The solution is extremely Latency sensitive and this imho was something I learnt the hard way.

Accomplishments that we're proud of

Now we know how to keep the voice traffic and the form service traffic separate and thereby achieve a workable solution.

What we learned

1) Keep Nova Sonic Traffic isolated from other data 2) AI code generation has its limits. Don't completely rely on it.

What's next for FillNova

Lots 1) Convert to more easy to use Library 2) More Robust Design 3) Support for Non- ReactJS Frameworks including vanilla JS 4) Integration with Amazon Connect

Built With

• amazon-web-services
• appsync
• bedrock-nova-sonic
• lambda-websocket
• nextjs
• react