All content and demos should be made available here: https://devsoph.tech/ DevSoph is all about information and education, helping minorities across the world targeting: police brutality, re-offenders, incarcerated, afri-centric businesses and disadvantage students across the world with one solution.
Cultural Preservation Alternative Link to Preservation Platform:https://c5886f0ac8084ce0a16bc256ed19fda4.us-east-1.sumerian.aws/? Last year after a trip abroad , my family and I planned to visit many monuments and landmarks, but due to unforeseen circumstances we were not able to visit the institution. Inaccessibility, from unforeseen circumstances or even renovations, could cause a huge loss of tourism coming at a huge cost for these institutions.
The second issue which I came across was the damage caused by tourism in certain cultural/historic institutions, which caused negative effects to the institution physically and financially. Whilst many solutions for virtual museums and tours are available, there is market gap for immersive experiences which allows for user inputs (e.g. Q and A).
However, whilst these gaps existed, one of the biggest issues arose when we arrive back home. Many of my classmates and friends did not know the stories behind these landmarks with many believing they were created and designed by colonisers not the colonies themselves. Many would never be able to access these institutions and see the fruits of minorities in person. This inspired me to develop a solution to solve this predicament.
A solution which could help provide an immersive experience to act as a hub for information is needed for cultural institutions to provide a more accessible service. For many having the opportunity to visit these places can be amazing and possibly change the experience with education.
Ultimately these cultural institutions can make a huge effect on education worldwide, and despite 3D solutions on the market, very few truly offer an immersive feature.
Today, we have seen two problems caused by COVID-19 which has negatively affected these institutions, which find it hard to make money and survive without any customers. Moreover, COVID-19 has impacted immersive education more than every before, and many look to these cultural institutions for inspiration to help enhance their education. A solution to help students to achieved immersive education at home is required.
Another big issue with COVID-19 is logistics and shopping. In many developing countries high demand has increased lines and transmission rates. A recent case study is in India where the demand for alcohol led to high lines with no planing and increased transmission.
Many developing countries have access to an SMS device. The solution to this problem is an SMS based logistics planner to automatically schedule timings for users to buy and/or pick up goods at their store. Store owners (communal) share the device and users simply text the shop they require and the time intervals that best suites them via a special SMS message. The device automatically provides them with a booking (if available or otherwise schedules the next most appropriate time).
What it does
Cultural Preservation The solution is a AR/VR solution which helps to solve issues with both cultural institutions and education and can be applied to multiple fields, from site heritage to immersive educational experiences, it offers a unique solution to revitalise cultural institution and education in the digital era. The features are as below:
1) AI-Powered Chatbot Host for the Tour
2) 3D Visualisation
3)Q/A with the virtual host Please note the demo used was for a Greek Temple for simplicity purposes
The SMS platform allows students, learners and more to access information via SMS technology anywhere in the world simply by texting to a special number. The design currently works with an information chatbot about space and also provides them access to answer any questions they may have. All conversations are stored and can even be accessed by teachers to help track and monitor progress of students.
The SMS Business platform inform users via SMS about inventory, as well as offering them the opportunity to book ahead to collect the order if a slot is available. The demo currently has 24/7 coverage with all time slots free indefinitely, but restrictions take place as per the user's liking. All content is stored on Twilio to be accessed if needed.
How I built it
Cultural Preservation Chatbots were created using Amazon Lex, with around 2-3 questions for each intent, to ensure the chatbot could understand them with a high success rate. I then added responses for each of the instances, providing answers to the different questions. Currently, there are a few available, but this can be added later on.
Greek Temple : For the demo, I created the model using blender where I added a few materials, manipulating planes, cubes and spheres. This took around an hours to make ! The pillars were made using cylinders and edge loops, and extruded inwards.
Sumerian: I brought it all together using Amazon Sumerian, which allowed for the linking of the amazon lex bot to a demo host model. In this case, I had to simply connect the dialogue from Lex through the bot, and create a simple flow between asking the question and responses.
SMS Platform : The design was then linked to Twilio, where I could text and even make calls to the number to communicate any questions and answers. The design uses a twilio trial account, and is currently an American number. The SMS platform was tested but the telephone call was not tested due to cost issues.
Challenges I ran into
Where should I begin ? :)
Cultural Preservation Chatbot : Parts of the section of Lex included debug errors in the host's speech, to change this I had to change the order of the responses and reduce certain aspects, eventually solving the issue. Additionally, certain phrases were not being picked up hence I was forced to make more questions to train the model. By adding more data, the bot was more responsive and achieved higher fidelity in understanding responses. More can be added !
Importing the Blender model in Sumerian: The imported model caused huge amounts of errors, with textures not importing properly along with incorrect lighting. As a result, I spent time altering the textures and lighting until the model was similar to the blender model.
Controlling Movement: Originally, for class-platform use, I added the ability to touch to call the host. However, this made it impossible for the user on a mobile to travel around the model without triggering the chatbot ! To alter this I change the input.