Gestural Narrative Interactive Expression (GeNIE) Project

The Gesell Narrative Interactive Representation (GeNIE) Project (NEH Digital Humanities' Initiative Fund) aims to develop and better understand the gesture interface used to express interactive narrative works. As the popularity of Nintendo Wii, Microsoft Kinect for Xbox 360, mobile phones with multi-touch screen, built-in gyroscopes and accelerometers, notebooks with touchpads, etc. gesture interfaces are becoming more common . However, most interactive narrative systems in the past used menu - based or text - based interfaces for communication between roles. In contrast, the GeNIE project formed a platform for building gesture-led narratives. Imagine using a doll showing "yes" reaction by manipulating your character's nodding and always coping with the problem of another character by sliding your finger up and down. Or, draw a shape of "^" using your fingers, express your doubt by raising your eyebrows, and kneading with your fingers makes your character's mood more isolated. The expression of the computer-controlled character constantly changes according to your movement. Based on my previous research, the GeNIE platform combines this feature with the mobile device's story system. This interface has several advantages. They are more familiar to the user and provide a very intuitive input mechanism. In addition to this, this interface allows for multiple forms of non - verbal input. A nonverbal gesture input can be either a universal one (like a smile) or a culturally peculiar thing (like a shoulder of a shoulder), but in either case, use it everyday How to communicate. In a wide range of interactive stories and creative calculations, the gesture interface has not been studied well yet, and the GeNIE project is a step in this direction.

Like Genie, Isabel is completely isolated from the world of speech and imprisoned in the mother of hearing impaired. Unlike Genie, she has not received cruel treatment, she interacted with her mother using her gesture. At the age of six when she was discovered she was deemed unable to receive education in 1938, but began using the sentence within a week. She noticed that she experienced the usual stages of language acquisition, but at a much faster rate, she caught up with her age group two years later. The fact that Genie is more than twice the age of Isabelle is not necessarily a deciding factor here. Isabelle was not bothered by her growing experience and was not a nonsocial creature like an elf. She understood the concept of communication and got a gesture to use with her mother. Her mission is not as strong as elves, so her greater achievement can only prove that 6 years old, not 13 years old, can master the language.

The Gesell Narrative Interactive Representation (GeNIE) Project (NEH Digital Humanities' Initiative Fund) aims to develop and better understand the gesture interface used to express interactive narrative works. For systems with Nintendo Wii, Microsoft Kinect for Xbox 360, a system with a multi-touch screen, a system with a built-in gyroscope and accelerometer, and a laptop with a touch pad, the system becomes more general and gestures The interface will be more general.

Gesture recognition is an unsolved problem in the field of machine vision, machine vision is the field of computer science, which allows the system to imitate human vision. Gesture recognition has many uses in improving human-computer dialogue, one of which is in the field of sign language translation where the video sequence of symbol gestures is translated into natural language. Self.label_encoder = LabelEncoder (). Once fit () completes this operation, you can use scikit to learn the multiclass classification algorithm training model selected in the toolbox. We trained the linear kernel using support vector classification.