Vertical Name - HealthCare

Automated health care VR Apps for evaluation and treatment for Amblyopia

Amblyopia is the most common cause of visual impairment among children and the most common cause of monocular visual impairment among young and middle-aged adults.

Common treatment is patching (wearing a patch over a stronger eye) or Atropine (drops of drug ). Those treatment have several drawbacks - age limitation and so-called reverse amblyopia among them.

An attempt to use VR to deliver specific stimuli without harming the healthy eye, or overcome the age limit by increasing the effect with all those incredible tools is evident for anyone familiar with both VR technology and ambylopia. There is even one startup, Vivid Vision (ex Diplopia ). They created special VR games, and they sell licenses to clinics, so the clinics could provide a service to their clients.

Our first obvious goal is to make such treatment accessible, so that any kid or adult with amblyopia could use it. Our multi platform solution includes GearVR, HTC Vive and Cardboard.

To make our solution a full automated healthcare case we need automated diagnosis. Lang stereo test, a broadly used amblyopia test can be implemented inside VR, and so we did, adding this feature to our app. But this test is reliably exclusive only to one of the three amblyopia types. The most advanced technique to test other types is retinal birefringence scanning. We read two science papers describing this method, and both of them note that it is similar to the techniques you would use for eye-tracking interfaces. That means that if we hack an eye-tracking system we could use it for amblyopia diagnostics.

Our environment adds many tools to collaborate on amblyopia research projects, including testing, same treatment games mentioned above, adding treatment using any user content (eg movies, pictures, books) and treatment using any app on your computer. All those procedures have statistics and are programmable to follow treatment schedule.

Our system consist of App that lets user play games, watch youtube video and use any desktop app in VR, Based upon diagnosis and user inputs, we apply various effect to left or right eye. Effects such as Blur, reduced brightness, saturation are applied to strong eye, this helps our brains to concentrate more on side which has better view helping the weaker eye to be used more.

We used TouchDesigner to create a demo for HTC Vive and Unity3D to demo for cardboard and GearVR. We used Unity3D post processing image effects as well as added our own effects to control brightness, saturation, Hue. Most of the challenge was writing Shaders that could do custom effects based upon research paper we read.

We learned more about lazy eye problem and how doctors used to solve it in past. We also read various research paper that lead us to use Unity3D image effects and required us to learn various shading techniques and integrating shaders in Unity3D.

Finally we want our App system to act as a platform that can be used to watch any VR content and play any VR games so that it can be used for treatment of Amblyopia while users can enjoy their favorite VR content.

Github links
We have used two separate tools for prototyping

HTC Vive & Oculus Rift demo using TouchDesigner
GearVR and Cardboard app using Unity3D used as VR Video Player (With Various ImageShader effects)
Simple VR Demo with Blur and Brightness Shader effects

Contact Info

ildar iakubov : 857-247-9473

Preetish Kakkar : 515-771-5771

Built With

Share this project: