Locallens AI is an innovative mobile application designed to change how users interact with their physical environment and understand. Taking advantage of state-of-the-art artificial intelligence, especially in the fields of computer vision and natural language processing, Locallens AI provides real-time, reference-individual information about only interesting points by pointing to a smartphone camera on them.

The main functionality revolves around visual recognition. When a user indicates his camera on an object - it processes visual input to identify a restaurant, a historic monument, a road sign, or even a specific plant - localles AI object. Once identified, it recurs and presents relevant, up-to-date information on the user's screen, often as a promotional reality (AR) overlay.

Main features and functionality:

Object Identification and Information Recovery:

Restaurant and Cafe: Real -time information such as current waiting time, menu highlights, daily special, review and direct links for reservation or distribution.

Historical sites and sites: brief historical facts, importance, visitor hours, and more intensive articles or links of virtual tourism.

Public art and murals pictures: details about the artist, inspiration behind the piece, and information about the same functions.

Shops and Business: Commercial hours, customer rating, ongoing sales and contact information.

Natural elements (future scope): Identification of plant species, trees, or even local bird life with basic information.

Promoted reality (AR) overlay: Information is originally displayed as overlay on live camera feed, providing a spontaneous and immersive user experience.

Hyper-local reference: AI can take advantage of GPS data and user preferences to offer highly localized and individual

Built With

  • blot.new
  • geocoding
  • github
  • google-cloud-vision-ai-(for-object/landmark-recognition)-google-cloud-natural-language-api-(for-text-understanding)-vertex-ai-(for-custom-model-deployment
  • if-needed)-openai-gpt-models-(via-api-for-content-generation/summaries)-serverless-functions:-google-cloud-functions-/-firebase-functions-api-gateway:-google-cloud-endpoints-/-api-gateway-databases:-firestore-(for-real-time-data
  • javascript
  • mapping)-google-places-api-(for-business/poi-information)-tripadvisor-api-/-zomato-api-(for-reviews
  • menus)-openstreetmap-api-(for-general-geographic-data)-arcore-(android)-/-arkit-(ios)-(for-augmented-reality-overlays)-version-control:-git-/-github-development-tools:-vs-code
  • postman-/-insomnia
  • saved-locations)-google-cloud-storage-(for-media-assets)-apis-&-data-sources:-google-maps-platform-apis-(for-location
  • typescript
  • uiux
  • user-profiles
  • vscode
Share this project:

Updates