CultureTap

Inspiration

The inspiration for CultureTap stemmed from a real-life scenario where a South Korean student, despite being warmly welcomed by his Indian roommates, faced difficulties integrating into the group due to cultural and language differences. This challenge made us realize how common it is for people to struggle with cultural adaptation, even when there's a genuine effort to connect. CultureTap was born out of the need to bridge these cultural and linguistic gaps quickly and meaningfully. We envisioned a solution that would help individuals from diverse backgrounds connect and communicate more effortlessly through fun, interactive, and educational tools, fostering more natural relationships and breaking down language and cultural barriers.

What it does

CultureTap is an iOS app that facilitates cultural exchange and helps people connect across linguistic and cultural divides. Users can:

• Connect instantly by tapping their phones using NFC (Near Field Communication), allowing for quick exchanges of profiles and cultural data.
• Take fun, personalized quizzes powered by LangChain and OpenAI, helping users learn interesting facts about their peers’ cultures.
• Learn languages with phonetic guidance and AI-driven suggestions, making it easier to understand and speak key phrases in different languages.
• Earn badges and rewards by completing cultural quizzes and language challenges, gamifying the experience to encourage deeper engagement.

How we built it

We built CultureTap using Swift for the iOS platform, focusing on an intuitive user interface with SwiftUI and leveraging Apple’s ecosystem for seamless device interactions. Key technologies and components include:

• NFC and Multipeer Connectivity: We used NFC for quick device pairing and discovery, and Multipeer Connectivity for secure, real-time data sharing between users. This allows users to exchange their profiles and start interacting by just tapping their phones.
• AI-driven quizzes: The quiz generation system is powered by LangChain, orchestrating retrieval-augmented generation (RAG) to create personalized cultural quizzes based on user preferences and backgrounds. We combined this with OpenAI’s GPT-3 to ensure quizzes are dynamic and interactive.
• Language learning with AI: We utilized OpenAI’s language models to offer personalized language suggestions and pronunciation tips, enabling real-time language learning. Phonetic guidance helps users confidently engage in conversations, even with unfamiliar languages.
• User interface: The UI is designed in SwiftUI, focusing on simplicity and accessibility to ensure users from all backgrounds can easily navigate the app. We used Figma for prototyping and design iterations, ensuring the app feels approachable while remaining feature-rich.

Challenges we ran into

• Multipeer Connectivity: One of the significant challenges was ensuring seamless data sharing over Multipeer Connectivity, particularly due to NFC’s limitations, which do not support simultaneous data transfers. We had to manage the handoff between NFC discovery and subsequent data sharing over Multipeer networks, ensuring the connection remains stable and user-friendly.
• SwiftUI integration: Designing a highly dynamic, intuitive UI using SwiftUI posed some challenges, especially when coordinating between reactive UI elements and real-time quiz generation from the AI models.
• LangChain integration with OpenAI: Orchestrating the LangChain framework with OpenAI’s GPT-3 required fine-tuning the interaction between multiple APIs to ensure quiz content was contextually accurate and updated in real time based on users’ profiles.

Accomplishments we’re proud of

We’re proud of several key accomplishments:

• AI-powered quizzes: Our quiz system dynamically adapts to user profiles and event contexts, offering a personalized, fun, and engaging experience that goes beyond static content.
• Multipeer Connectivity: Successfully implementing a smooth user discovery and interaction mechanism that integrates NFC and peer-to-peer communication to foster real-time cultural exchanges.
• User-centered UI: Our design is simple yet effective, making it easy for users from various technical and cultural backgrounds to connect, learn, and engage with each other in a meaningful way.
• Fast connection: The app allows users to quickly connect and build relationships, even when they don’t speak the same language, thanks to the built-in AI tools that assist with language and cultural understanding.

What we learned

Developing CultureTap provided key insights into the nuances of cross-cultural communication. We learned that:

• Phonetic accuracy and context-specific phrases can make a significant difference in how confident users feel when interacting in a new language or culture.
• Designing for inclusivity is critical—features need to be accessible to people with varying levels of technological proficiency and language skills. This was particularly important when developing the UI and AI-driven content.
• We also gained a deeper understanding of how to leverage AI effectively in real-time, personalized contexts. AI integration enabled us to create culturally relevant content dynamically, tailoring it to each user’s experience.

What’s next for CultureTap

In the future, we aim to expand CultureTap by:

• Gamification: Adding badges, rewards, and achievements for users who complete quizzes or learn new languages, encouraging continuous learning and engagement.
• Expanded language support: Incorporating more languages, especially underrepresented ones, ensuring that users from diverse linguistic backgrounds can participate in meaningful exchanges.
• Text-to-Speech and Speech Recognition: Adding voice features to allow users to hear and practice pronunciations, making language learning more interactive and immersive.
• Community features: Building out features for group discussions, shared cultural events, and collaborative challenges. We aim to turn CultureTap into a hub for fostering DEI (Diversity, Equity, and Inclusion) initiatives in both professional and social settings.

These future updates will enhance the platform’s ability to connect people from all walks of life, making it an essential tool for anyone looking to build cross-cultural relationships in academic, professional, or personal settings.

Built With

• amazon-web-services
• figma
• langchain
• mongodb
• python
• swift