TextMapper

TextMapper is an interactive assistant which helps you to work with complex texts in mixed reality, in three-dimensional comfort of your own room.

The nature of mixed reality allows us to interact with text in a very new, innovative way. Spatial arrangement of information was always believed to be the most efficient way to memorise information (“memory palaces”). Modern research takes a step further and suggests that embodiment of information (via movement and gestures) can improve our cognitive abilities. Passive consumption of text becomes active interaction and leads to creating a new personalised reality.

Hololens mobility, power and user-friendliness encouraged us to experiment with texts and information.

Short interaction scenario:

—User uploads any text from his OneDrive/DropBox account.

—User can then pin pages or pieces of text anywhere in the room, using Hololens’ spatial mapping feature

—User can interact with the BookMapper using voice and gestures

—User clicks keywords in the text

—Assistant connects the keywords and creates interactive map of the text key concepts in 3D.

—In the future, cognitive services may be connected to provide additional contextual information, like Wikipedia excerpts, videos and pictures related to concept / topic.

TextMapper is helpful for better summaries, language learning, memorising complex information and brainstorming.

Built With

• c#
• holo-toolkit
• microsoft-hololens
• unity