• 
  • News
  • About
  • Contact
  • Location
• 
  • Alumni
  • People
• 
  • Projects
  • Software
  • Gallery
• 
  • Articles
  • Libraries
• 
  • Topics for Student Projects
  • Lectures
  • Computer-Aided Geometric Design
  • - Photorealism
  • - Design and Implementation
  • - Simulation and Animation
  • - Digital Libraries
  • - AK Computer Graphics
• 
  • Dave
  • HEyeWall
  • Davelib
  • Multitouch

• 
  • Extended Search

User: anonymous

---

some links

Hand Gesture Interaction

Hyosun Kim, Dieter Fellner

Computer Graphics and Knowledge Visualization, Graz University of Technology, Austria, www.cgv.tugraz.at

Overview

User interaction is one of the most basic but also critical components for a three-dimensional virtual environment. The interaction tasks can be classified into four main categories: object manipulation, selection, system control, scene navigation. When we define gestures as specific behaviors involving meanings and intentions, almost all the actions/movements that the user performs the interaction tasks can be considered as the gestures.

Communication: User expresses visually his/her idea in front of the screen by moving the hand, like drawing on paper.	Manipulation: User interacts with a 3D virtual model by using non-instumented hand gestures.

Communicative Hand Gestures

Most of the interaction tasks can be supported by 6DoF manipulation and selection input. But the system control task can hardly be expressed through such direct spatial interaction because of its linguistic/communicative property. Thus it had been implemented with additional interaction methods to represent the system commands and to control them, e.g. voice commands, physical/virtual tools and graphical menu system. We take notice of hand gesture interaction, which effectively supports both direct manipulation and communication work. With its factorized property the gestures can allow users to express their idea and intention while directly manipulating the objects. In order to reduce user’s cognitive load, we chose some alphabet letters to represent the system commands respectively and symbolized them as dynamic gestures to communicate with the system.

Symbolic gestures: For example, ‘S ’ drawn by hand movement changes the sharpness of object. Gesture ‘W’ renders the object in wireframe mode.

Manipulative Hand Gestures

How to model hand postures/gestures is basically determined by the application scenario within the HCI context. Since our chosen application field is shape modeling, the mapping from gestures to interaction modes should mimic the way how hands are used for sculpting and manipulating objects in the real world. Our system provides five hand gestures (postures) for interacting with virtual objects and virtual cursor.

Interaction with a virtual cursor: Release the pinching states.

• Point: Close the hand except for the thumb and index finger, which points straight at the target object. This orders a cursor to move to the position indicated by the index finger.
• Pause: Open the whole hand to stop the user interaction.

Interaction with virtual objects: Pinch the thumb and another finger after pointing to a target object. The selected objects are manipulated in the same way with the hand motions.

• Grab: Close the hand while pinching the thumb and index finger, then move it for translating the object.
• Rotate: Open the hand while pinching the thumb and index finger, then rotate it. Cumulative rotations are allowed by repeating rotate-and-pause gestures.
• Scale: Open the hand while pinching the thumb and middle finger, and then move it along z-direction for uniform scaling.

Gesture interaction and object modeling: pause, point(object), rotate, translate(z-direction), point(object’s vertex), translate(object’s vertex), and rotate.

User Inteface for Hand Gesture

Since our main premise for the interface devices is to be as minimalistc as possible on the user requirement, the markers for a hand are designed like a thimble and placed on just four fingertips (thumb, index, middle and little finger). These compact interfaces can allow the users comfortable and natural motion.