Photo And Analyze

Inspiration

Had idea similar to this (except that one is AR version) for some time, so by turn of events it got into what I submitted.

What it does

Allows user to take images and then analyze them using Perplexity API. Images can also be captured using speech to text (powered by Oracle Speech to Text) and subsequent prompt detected with it. There is also instant analysis button, which send images to analysis instantly upon capture. Deep Analysis button allows for selecting multiple images and adding (additional) prompt for Deep analysis using Perplexity. Also allowing for multiple such analysis with different images and prompts selected.

How we built it

Using React Native (Expo), Oracle Cloud (for speech to text and server hosting) and Perplexity API. All the while using Copilot (besides some other in the browser llms), Perplexity Docs etc.

Challenges we ran into

Speech to text was first using native module on Android, then Azure and settled for Oracle Cloud due to it's features being most on par with what I was looking for. There were some other things, but there is submission, so I'll leave it here on this topic.

Accomplishments that we're proud of

What we learned

More around React, Android and other stuff that was part of submitting this.

What's next for Photo And Analyze

For now, results, but after there is slight (keyword) chance to explore publishing this with some adjustments/using some insights from this into something else

Built With

• android
• copilot
• expo.io
• github
• oracle
• perplexity
• react-native