Home Projects Multimodel HCI
Aug 01
Sunday

Welcome to Interactive Multimedia Lab!

Multimodel HCI

Multiplayer First Person Shooting Game with Tangible and Physical Interaction

Project Members:
Jefry Tedjokusumo, Steven Zhou

Idea:
First Person Shooting game is a popular computer game genre. The game required high level accuracy of aiming, which currently is provided by mouse. This traditional method lacks physical and social interaction.

We present a new application of multiplayer FPS game. In our system, the players wear head tracking, Head Mounted Display (HMD), and wand tracking (see Figure below). With these tracking devices we change the way multiplayer FPS
games are played. The player’s view orientation and position tracked by the head tracker. His hand holds a wand tracking device. This wand’s orientation corresponds to the gun aiming orientation in the game. In our system it is possible for the player to shoot backward, even though his head facing forward. To make this feasible, we give a small screen showing the
gun point of view in the player’s eye view.

Our system gives new perspective of how multiplayer FPS games are played. It provides tangible and physical interactions among users both collaboratively and competitively.

In-game screenshots and corresponding player poses. We separate the weapon and head view; hence the player can aim using their hand. The small window on the right corner is the weapon point of view. This separation gives ability for the player to shoot enemies outside his/her view range (even at the backside).

MFPSG

 

What You Write Is What You Get: A Novel Mixed Reality Interface

Project Members:
Syed Omer Gilani, Steven Zhou

Idea:
Children develop their understanding of the world by means of physical and social interaction. This cognitive development process can be further enriched through the use of interactive multimedia technology. We propose a novel interactive system which seamlessly combines the flexibility of the virtual world with real world handwriting to realize a tangible mixed reality learning scenario. User’s handwriting is translated in to multimedia contents (like audio, text, 3D graphics and animation) and is registered with the mixed reality environment in real-time. In addition the system can be deployed on a desktop personal computer (PC) with a normal webcam and without the need for special equipment.

WYWIWYG

 

Architectural Fly-Thru™

Project Members:
Jefry Tedjokusumo, Steven Zhou

Idea:
Engineers, designers and architects now have a tool in which they can see and navigate through a building before the construction has even begun. The Architectural Fly-Thru takes blue-prints and renders them into full scale 3D models on the computer.

Once the rendering is complete, the user can then use a 'virtual-camera' to navigate through the building in a manner than a conventional mouse would find cumbersome. By tilting the camera like you would in real life in all directions, the 'virtual-camera' will guide the user through the building like he or she is actually walking though it.

Architectural Fly-Thru™

Last Updated on Monday, 07 December 2009 15:16
 


Home Projects Multimodel HCI