Inspiration

In 20 years of retail and customer experience I have learned the most incredible customer experiences are ones where the customer and the human helping them are connected and present. Unfortunately, retail KPIs are lopsided. Retail workers are asked to accurately and quickly enter orders and this detracts from the experience of connecting with customers. This results in a disconnected experience.. and one we see everyday, you have left your home, gone to the coffee shop, and the barista is heads down in a screen converting your words into a data structure. I wanted to make this better.

What it does

ConversationalForms is a SwiftUI package which wraps a form and makes it ambiently intelligent. The system listens to the conversation and updates the form. The system uses on device transcription, to retrieve the words spoken, and then on-device inference to convert those words into proposed form inputs.

How we built it

I used Codex to research what packages were available and develop the thought process. It helped me come to the conclusion that a package was the right decision, since building an app would mean that distribution would be my bottleneck. I built then iterated, testing and retesting with GPT 5.6 to sharpen the process. Finally, I designed documentation, and used Codex to refine it into useful, agent friendly reference.

Challenges we ran into

Honestly, the hardest part was choosing what to build. This idea was one I have had for years, but never thought was possible. After I used Codex to get a first MVP developed, I realized it was possible and was thrilled.

Accomplishments that we're proud of

I am proud I was able to build something so refined so quickly. I really think that real developers will find use in this project and I intend on working on this for years to come.

What we learned

I learned that with LLMs, the opportunities are wide. Iteration is cheap and leaving code on the cutting room floor is fine.

What's next for Conversational Forms - A SwiftUI Package to Make Forms Great

I intend on adding additional platforms, and working on implementation across multiple POS plugin systems. The SwiftUI packaging is great for a hackathon, but in the future, I see every retail experience being able to be conversant and more connected as a result.

Built With

Share this project:

Updates