AR Kart

Inspiration

We were inspired by a video featuring entrepreneurs who recreated the experience of driving a real car using toy vehicles on a physical track. Instead of sitting inside the vehicle, players controlled it remotely through a simulator, creating a unique blend of digital and real-world interaction. We expanded on that concept by incorporating the exciting gameplay mechanics of racing games like Mario Kart, where players can collect power-ups, gain advantages, and strategically disrupt their opponents. By combining physical RC racing, augmented reality, and interactive power-up systems, we created a more immersive and social racing experience.

What it does

AR Kart transforms any space into an interactive racing track. Players control a physical kart using their smartphone while viewing augmented reality effects and game elements through the mobile app. Infrared transmitters placed around the course act as checkpoints and power-up stations, allowing players to collect boosts, activate special abilities, and interact with the track in real time. The system blends physical racing, digital gameplay, and location-based interactions to create an immersive, arcade-style experience.

How we built it

We built AR Kart using an ESP32 microcontroller as the central controller for the vehicle. The ESP32 manages both the motor controls and onboard camera, allowing players to remotely operate and view the kart through a mobile device. To create interactive gameplay, we integrated infrared transmitters around the track that serve as power-up and event triggers, enabling real-world interactions that affect the in-game experience. We also designed and assembled the vehicle's electronics through extensive circuit design, wiring, and soldering to ensure reliable communication between the hardware components.

Challenges we ran into

One of our biggest challenges was diving into hardware development without a background in electrical engineering. We had to learn many concepts on the fly, from circuit design and soldering techniques to troubleshooting electronic components and wiring. Acquiring the right tools and materials also proved difficult, and we occasionally lost small but critical components during assembly. Building the kart itself required working with tiny screws, bolts, and delicate electronics, which demanded precision and patience. Another challenge was navigating the learning process under tight time constraints. We frequently relied on AI tools to help us understand unfamiliar concepts, but finding the most effective solutions often required long iterations, experimentation, and careful verification. Despite these obstacles, each challenge became a valuable learning opportunity that helped us improve both our technical skills and problem-solving abilities.

Accomplishments that we're proud of

Despite having little to no background in electrical engineering, we learned how to design circuits, solder components, integrate an ESP32 microcontroller, and troubleshoot hardware issues under tight time constraints, and there was never a moment where we were too lost that we'd stop taking the next step even when it seemed like everything was out of control. Most importantly, we proved to ourselves that we could learn new skills quickly and build something ambitious from the ground up.

What we learned

Through this project, we learned a tremendous amount about hardware engineering, embedded systems, and rapid prototyping. Many of us started with little experience in electronics, but by the end of the project we had gained hands-on experience with circuit design, soldering, wiring, and integrating an ESP32 microcontroller with motors, cameras, and infrared communication systems. We also learned the importance of persistence and adaptability when solving complex problems. Hardware issues rarely worked perfectly on the first attempt, so we developed troubleshooting, testing, and debugging skills while working under time constraints. Additionally, we learned how to leverage AI tools effectively to accelerate learning and overcome technical roadblocks, while still validating solutions through experimentation. Most importantly, we learned that ambitious ideas become achievable when a team is willing to learn quickly, collaborate, and iterate continuously.

Built With

• esp-32
• rc
• swift