Software Release

The gesture interface recognizes the following 9 types of gestures, allowing you to operate the monitor and express your intentions. To use it, please read the following recognition module and terms of use, agree to the disclaimer, and contact our customer service.

Please also check the End User License Agreement (EULA).

Recognition Engine Module

Released recognition modules

 
  • foot gesture
  • finger
  • head
  • Front object
  • wink
  • knee
  • Mouse tongue
  • Slight Movement
  • Shoulder
  • Gesture Music
 

・Example of use

Grid3
Mind Express
FIFA22

Please contact our customer service for examples of actual use.

Here is a usage example.

 

For use

・Preparation

Please feel free to contact us by email.First, online (Zoom, Skype, etc.), tell us about your current PC usage and desired gestures, and we will screen if it is suitable.At that time, if you can show us a video of the desired part, we will proceed immediately.

 

・Rental of cameras and PCs

After considering the compatibility with this system, we will lend the camera & cable and software free of charge if the person with a disability uses it. In addition, if you are going to a hospital, etc., we will lend you a notebook PC with all software installed, a camera, a camera arm, and a set of cables. First, check with your occupational therapist to see if you are compatible. If you want to continue using it after trying it out and confirming its operation, please purchase a camera (around 50,000 yen) and use it. The software is provided free of charge.

 

・PC operating conditions

It is used by connecting the distance camera “Intel RealSense Depth Camera D415/D435/D405” to a Windows 10/11 Home/Pro 64bit PC with USB 3.0. * In order for RealSense to work without problems, it is recommended that the PC has a CPU equivalent to Intel Core i7/5 (over 8 threads) and a main memory of 8GB or more.

   

Please check the conditions in the table below when selecting a camera.

Camera type Angle of view Minimum Distance Note
D415 Narrow 30cm Suitable for waist shots (head to waist)
D435 Wide 15cm Suitable for bust shots (head to chest)
D405 Wide 7cm Closer than above
D435i/f These cameras are not used
 
 

* In August 2021, Intel announced that the development of Intel RealSense would be discontinued. However, as of June 2024, the sale has not been canceled and a certain number of lots are still being imported. The price has increased by about 25,000 yen (about 50,000 yen), but it can be purchased from various distributors via the Internet without problems. The model of the distance camera of this software has already been switched to 4 units, and it does not depend on a specific distance camera. We will continue to support the RealSense series even after the end of sales, and we are preparing to support new models, so please use it with confidence.

 

・Application of the UVC Camera to the “Slight” module

Only the “Slight” module can use a UVC camera for more subtle movements (e.g. ALS patients).

A UVC camera with a zoom lens to be specified can be used to show close-ups of faces, fingers, etc. Using a UVC camera with a specified zoom lens, close-up images of faces, fingers, etc. can be used.

 

Disclaimer

This system does not completely guarantee the operation of the user’s communication function. If there is a defect that impairs the health or property or safety of the users or the other people in this system, the Institute does not take any responsibility for any damage caused by this defect.