Encounter

Case Study

Encounter

In collaboration with Youhan Guan & Rose Mengmei Zhou

Encounter is an installation where participants can interact with artificial creatures and environments using mixed reality modes of interaction. It was created for the Digital Media Project course as part of the Digital Media Program.

It consists of two zone for interaction: The Tangible Objects Station and the Projection Zone. In the Tangible Objects Station participants have a map of the environment, where they become “city planners”. Participants can physically move objects on the map and shape the virtual world. Using a smartphone/tablet device and a custom app participants can find out more information about the environment using augmented reality. The app recognizes various objects and images and communicates any changes the “city planners” make.

In the projection zone, participants are invited to walk and explore the virtual world, as if they are walking through a park. A view of virtual world is projected onto a wall (or displayed on a monitor). Participants gain an avatar simply by walking into the space. Through the use of the Microsoft Kinect, participants are able to control these avatars via body gestures. The environment and creatures of this ecosystem are responsive to their gestures. Any changes made by the city planners are reflected in the projected view in real time.

For this Project, my primary focus were the participant’s interactions in the projection space, projection design and world modelling.

Date

April 2016

Exhibitions

York university undergraduate research fair (february 2016)

Digital media showcase (april 2016)

Computational beauty exhibition(april 2016)

Digifest festival (april 2016)

Tools

  • Unity3d (c#)
  • Cinema4d
  • Microsoft kinect
  • Smartphones
  • Projector

Category

Related projects