FYP2008 TangiCube: Introducing Bi-Directional Interactivity with an Autonomous Agent in a Tangible Mixed Reality Environment

Project Members:Derek Tan, Zhou ZhiYing and Yuta Nakayama

Idea:
Abstract:

TangiCube introduces bi-directional interactivity with a virtual autonomous agent in a tangible mixed reality environment. While the virtual agent interacts with the user, the user is able to react to the agent with the help of physical output modality. Likewise, the user can interact with the virtual agent and the agent behaves and reacts as if it has a physical embodiment. This two-way interaction process is mediated by a tangible hardware cube. A user study conducted showed how the introduction of bi-directional interaction, especially with the haptics from the cube and physical embodiment of the virtual agent, improves the overall experience within the augmented space, as well as narrows the reality-virtuality gap in the user’s perception of the augmentation. This opens up new form of experiences and applications in the tangible mixed reality domain, allowing it to utilize more of its affordances to support and enhance interactions in its own unique ways.

For more details, please download the paper (paper currently being vet by Dr Zhou)