FYP2008 TangiCube: Introducing Bi-Directional Interactivity with an Autonomous Agent in a Tangible Mixed Reality Environment
Project Members:Derek Tan, Zhou ZhiYing and Yuta Nakayama
Idea:
Abstract:
TangiCube introduces bi-directional interactivity with a virtual autonomous agent in a tangible mixed reality environment. While the virtual agent interacts with the user, the user is able to react to the agent with the help of physical output modality. Likewise, the user can interact with the virtual agent and the agent behaves and reacts as if it has a physical embodiment. This two-way interaction process is mediated by a tangible hardware cube. A user study conducted showed how the introduction of bi-directional interaction, especially with the haptics from the cube and physical embodiment of the virtual agent, improves the overall experience within the augmented space, as well as narrows the reality-virtuality gap in the user’s perception of the augmentation. This opens up new form of experiences and applications in the tangible mixed reality domain, allowing it to utilize more of its affordances to support and enhance interactions in its own unique ways.
For more details, please download the paper (paper currently being vet by Dr Zhou)
|
|
Last Updated on Wednesday, 18 November 2009 21:09 |
|
FYP2008 Realistic Virtual Lighting and Shadow are crucial to the realism of the Mixed Reality scene
Project Members:
Yeoh ZhenTing Ryan Christopher
Idea:
In Mixed Reality (MR) applications, realistic virtual lighting and shadow are crucial to the realism of the Mixed Reality scene. Current methods of recovering a scene’s illuminant distribution and virtually lighting and shadowing the MR environment require extensive calibration techniques and special equipment, such as multiple cameras, fish-eye lenses and high dynamic range (HDR) cameras. Other methods might have less stringent equipment requirements but are unable to achieve real-time frame rates. This project aims to achieve photorealistic virtual lighting and shadow for virtual objects by heuristically recovering the real world’s illuminant distribution, aligning the virtual light sources with real-world light sources in 3D space, and finally lighting virtual elements in the scene with these virtual light sources. The method proposed is to place a known object , such as a small needle, in the scene at a known location (referenced by a marker) and, via vision-based tracking and observation of its shadow(s), recover the positions of any real-world light source(s) illuminating the scene. It is hoped that this will allow subsequent applications to achieve realistic interactive lighting and shadow in MR and allow virtual objects to respond to interactive changes in real-world lighting, without complex equipment.
|
FYP2008 Educational PC Game with the Wii Remotes
Project Members:
Ho Jeng Hong
Idea:
Research have show that both computer games and TUIs can leadto higher learning and complement education. The synergy that may result from them can be largely beneficial in the academic aspect. Therefore, in my project, I intend to design an educational computer game which uses the Nintendo Wii remote (Wii mote) as the tangible user interface. There are several milestone that I have set for my project. The first milestone which I had achieved is to identify a topic in the current curriculum in which the Wii mote can contribute in achieving better teaching and learning results. I have chosen the primary school Health Education from the level of Primary 2 to Primary 4 as my target curriculum. Thereafter, I will design a game which will encompass certain parts of the syllabus and make use of the Wii mote as the user interface. Finally, this game will be tested on primary school students to evaluate whether computer games with tangible user interfaces can actually lead to more efficient learning. |
|
Last Updated on Wednesday, 18 November 2009 21:06 |
FYP2008 Tangible Operating System
Project Members:
Yeo Daniel Lida
Idea:
Today’s computer operating systems uses the conventional mouse + keyboard Graphical User Interface (GUI) for its daily operations. This project, Tangible Operating Systems, aims to transform all these intoa two-handed Tangible User Interface (TUI), using physical cubes to manipulate and control digital information.
The objective is to demonstrate a new paradigm of file management and computer operational functions via the affordances of the physical cube; instead of just clicking and dragging files using the mouse, users now interact and manipulate files by simply rotating, translating, or even shaking the physical cube to perform various actions and commands.
Instead of interfacing with the digital desktop on the monitor screen, the ordinary tabletop now becomes the virtual desktop itself! Tangible Operating Systems transforms computer use from a time-multiplexing to a space-multiplexing one, and ultimately aims to minimize some of the problems that computer users face with the current GUI system.
|
FYP2008 Vision-based Marker Tracking Using Multiple Cameras
Project Members:
Chee Hui Ching
Idea:
Most of Mixed Reality applications are using a single camera for tracking target marker. Single camera has a limited field of view subject to the different lens used. A single camera can be used to cover a working area in which the fiducially marker will be placed for tracking. Working area coverage can be enlarged by placing the camera further away from the working area. However, this reduces the pixel size of the marker in the video captured by the camera. This will also further lead to the instability of the tracking since the available pixels of the marker to be tracked are getting less.
The aim of this project is to use multiple cameras to solve this problem. Each camera will be assigned to cover different working area. Therefore, multiple camera tracking will greatly widen the working area. However, proper calibration needs to be done among all cameras. The challenge of this project is to make the calibration process automatic. After getting the relationship among cameras, tracking transition from one camera to the other should be smooth. |
|
Last Updated on Wednesday, 18 November 2009 21:06 |
|
|
|
|
<< Start < Prev 1 2 Next > End >>
|
|
Page 1 of 2 |
