The gesture interface recognizes the following 9 types of gestures, allowing you to operate the monitor and express your intentions.
To use it, please read the following recognition module and terms of use, agree to the disclaimer, and contact our customer service.

Please also check the End User License Agreement (EULA).

・Example of use

Grid3

Mind Express

FIFA22

Please contact our customer service for examples of actual use.

For use

・Preparation

Please feel free to contact us by email.First, online (Teams, Zoom, etc.), tell us about your current PC usage and desired gestures, and we will screen if it is suitable.At that time, if you can show us a video of the desired part, we will proceed smoothly.

・Rental of cameras and PCs

After considering the compatibility with this system, we will lend the camera & cable and software free of charge if the person with a disability uses it. In addition, if you are going to a hospital, etc., we will lend you a notebook PC with all software installed, a camera, a camera arm, and a set of cables. First, check with your occupational therapist to see if you are compatible. If you want to continue using it after trying it out and confirming its operation, please purchase a camera (around 50,000 yen) and use it. The software is provided free of charge.

・PC operating conditions

It is used by connecting the distance camera “Intel RealSense Depth Camera D415/D435/D405” to a Windows 11 Home/Pro 64bit PC with USB 3.0. * In order for RealSense to work without problems, it is recommended that the PC has a CPU equivalent to Intel Core i7/5 (over 8 threads) and a main memory of 8GB or more.

Please check the conditions in the table below when selecting a camera.

Intel RealSense products were transferred to RealSense Inc., a company spun off from Intel, in July 2025. Although Intel announced the discontinuation of future product development in August 2021, the D4xx series continued to be sold as a core product line. The D415 and D405 models currently used with this software will continue to be supplied by the new company.
In Europe, the devices are available for purchase at prices ranging from approximately €340 to €430. In the United States, they can be purchased directly from the company’s website at the list price of US$272.
In any case, the depth camera used with this software has already changed four times over the course of development, so the software is not dependent on any specific depth camera model. Please feel confident in continuing to use the system.

・Application of the UVC Camera to the “Slight” module

Only the “Slight” module can use a UVC camera for more subtle movements (e.g. ALS patients).

A UVC camera with a zoom lens to be specified can be used to show close-ups of faces, fingers, etc. Using a UVC camera with a specified zoom lens, close-up images of faces, fingers, etc. can be used.

・Support for Dual-Camera Configurations (Version released on July 10, 2025 and later)

To better support users whose voluntary motor control is divided between the upper and lower body, AAGI has been updated to support the use of two cameras.

The following camera configurations are supported:

• 1 RealSense camera + 1 UVC camera
• 2 UVC cameras
• 1 RealSense camera
• 1 UVC camera

Disclaimer

This system does not completely guarantee the operation of the user’s communication function. If there is a defect that impairs the health or property or safety of the users or the other people in this system, the Institute does not take any responsibility for any damage caused by this defect.

Recommended Software

You can find a list of software that complements this system here.