Sep 2024 ~ Oct 2024

Gesture Interaction Design

Gesture Interface | User Experience | Presentation Tools | Smoke and Mirrors

In this project I explored the possibilities between gestural interaction and stage presence. GrinMo is designed to enable presenters to control slides more confidently and fluently through touchless gesture operations. I used “Smoke and mirrors” to show the final effect of the idea.

My Role

Gesture Designer
Video Editor

Responsibilities

Experience Design
Edit Video
Make Animation

Course

College: California College of the Arts
Course: NUI and Object Fall 2024
Professor: Graham Plumb

The part I like

I think the project revolves around the theme of gestures well from start to finish. Why do we need gesture interaction, who needs gesture interaction, why do they need it, and how do we as designers practice the whole process.

Challenges

I think challenge part for me in this project is the gesture design part, how to make the gesture easy to recognize while meeting the user’s intuitiveness. I did a lot of testing in the project to see if the user can use it easily.

GrinMo - designed to enable presenters to control slides more confidently and fluently through touchless gesture operations.

Problem

Presenters struggle to smoothly navigate their presentations while maintaining focus on the content and engaging the audience.

They need a hands-free, gesture-controlled solution that allows for seamless slide transitions and real-time audience interaction. This would reduce technical distractions and foster a more dynamic, engaging experience for both the presenter and the audience, enhancing overall presentation effectiveness.

What I Did

Design process includes problem analysis, research, prototype testing, and optimization. First, I analyzed the difficulties that speakers encountered when operating slides and determined that a touchless gesture control solution was needed. Then, I studied common presentation gestures to ensure the naturalness and intuitiveness of the interaction.

During the prototype testing phase, I used paper prototypes to let testers experience functions. Optimized gestures based on feedback to ensure that they were simple and intuitive.

The entire presenting process was sorted out through a user flow diagram to ensure clear interaction logic, thus creating a smooth and intuitive gesture presentation control system.

Gesture Library

This is the final gesture guide to all gestures selected after adjusting the test results and the overall tone of the picture.

There's echo and semantic feedback. Echo means that when you use a gesture to make a corresponding action, the screen will respond with an animated effect, while semantic means that when you make a gesture, there will be an icon of the corresponding gesture displayed on the screen, indicating that the device recognizes that you are making the gesture. Most of the time I use echo as a gesture feedback. However, only the beginning and end of the slideshow use semantic feedback, which is a more formal notice.

Demonstration for Several Movements

Some detailed descriptions of how people are using this. Here are just a few examples.

Style Guide

A style guide is a document that defines the design standards for a project, including typography, colors, logos, and other visual elements. It's essential for ensuring consistency, especially in long, large projects with multiple designers.

The style guide I've made just shows the duplicate elements used in the existing interface. Facilitate future expansion.

Future Concern

So far, I personally think that there is no very good way to test the practicality of this, and I really want to know whether this is feasible. In addition, I think this project is relatively incomplete, because it only shows the effect and does not do the teaching process. If I have more time, I would like to make this project more complete and credible.

Gesture Interaction Design

+

Copy Right © Yujie Yin

+