Sweet Dreams

Inspiration

During our research, we found out that Insomnia is one of the most common sleep disorder which makes it hard for people to fall asleep. Usually when we go for massage, we realise that most of the time you will fall asleep almost instantly due to the comfort of the masseur pressing your muscles and also the background audio playing. We decided to incorporate the same elements into a pillow with the extra function of a heater as research shows that it helps to provide comfort, pain relief and relexation in terms of both body and mind.

What it does

Our pillow will have vibration simulating the masseur massaging you and also heater to warm your head for extra relaxation. We also have a standalone device to enable user to choose different presets of combination to suit their needs. The device is also able to detect your emotions from your voice, face and can also reply to you using Gemini AI, acting like a chatbot.

How we built it

We use 1 ESP-32 to connect to the motors simulating the vibrations and heating element, another ESP-32 connected to a external speaker via bluetooth to play whitenoise. For the standalone device, we use python and flash for backend stuff (running a small server, talking to the ESP32, connecting to Gemini AI for chat) and javascript for frontend (webpage to display the chat, emotions).

Challenges we ran into

We had a difficult time trying to get the boards and standalone device to talk with one another. We wanted to play a binaural audio using the ESP32 but due to lack of storage we were unable to execute it. The ESP32 that was provided also lack the ability to support the audio portion of the ESP32 which we had to use a spare ESP32 just to integrate the audio portion. We also at first try to use APIs to fetch the emotion detector from online but it keeps having error, similar to Gemini AI.

Accomplishments that we're proud of

the standalone device was able to communicate with the ESP-32s
the standalone device was also able to recognise keywords with the help of text to speech to control the vibrations and temperature with presets.
generating a lullaby using frequency with arduino
able to use Gemini AI to act like a chatbot

What we learned

We learn that we can use frequency to generate lullabies and play it on an external speaker with ESP-32 which for our project, we use "twinkle twinkle little star" to demostrate. We also learn that you can use classes in arduino to create different presets for users to control the motor and heat. We also learn how to integrate python to arduino.