Inspiration

At my company, we were interviewing a new developer, and there wasn't a good way to measure their prompt generation skills and how the person interacted with AI. I wanted a way to capture the essence of how well people do in generating prompts.

What it does

List of problems that required only using prompts to solve at varying difficulties. Gives feedback and score their result. It provides a way to measure their prompt engineering skills, improve them, and to show them off.

How we built it

Project was built entirely in Bolt with Supabase integration and deployed on Netlify directly from Bolt.

Challenges we ran into

How to make the problem itself intuitive enough so that it requires users to think about the problem instead of copying and pasting the description and the guideline of the problem.

Accomplishments that we're proud of

Having a judge AI that acts on its own to determine pass or fail and provide feedback on their responses and giving the score.

What we learned

In the future, humans will be directing the problem solving rather than implementation. Describing the problem coherently is the ultimate skillset.

What's next for vibetest.io

Adoption of enterprises/companies to use it as their interview skills and internal training. Have more people contributing with submission of problems and voting them.

Built With

  • bolt.new
  • netlify
  • porkbun
  • supabase
Share this project:

Updates