EXTENSION OF THE HUMAN SENSES GROUP
NEURO-ENGINEERING
COMPUTATIONAL SCIENCES DIVISION
NASA AMES RESEARCH CENTER

EHS Group Lead: Dr. Kevin Wheeler


The EHS Group Team: Mark Allen, Jack Culpepper, Charles Curry, Dr. Chuck Jorgensen, Dr. Roman Rosipal, Dr. Leonard Trejo, Bryan Matthews, Dr. Kevin Wheeler.

GOAL:
The goal of the Extension of the Human Senses project is to advance man machine interfaces by directly connecting a person to a computer via the human electrical nervous system. This involves measuring Electromyogram (EMG) and Electroencephalogram (EEG) signals and applying intelligent pattern recongition software to interpret these signals as computer control commands.
To date we have used EMG signals to eliminate the need for mechanical joysticks and keyboards. As an example of this we have flown a Class IV simulation of a transport aircraft to landing with our EMG based "joystick". We have also demonstrated virtual typing on a keypad using EMG. Our current work is focusing on using brain waves (EEG) to control computer software and the necessary algorithms to support this work.

Group Research Areas:

EEG Pattern Recognition
This project aims to improve performance of NASA missions by developing brain-computer interface (BCI) technologies for augmented human-system interaction. BCI technologies will add completely new modes of interaction, which operate in parallel with keyboards, speech, or other manual controls, thereby increasing the bandwidth of human-system interaction. The research will extend recent feasibility demonstrations of electromyographic (EMG) methods for neurocontrol to the domain of electroencephalographic (EEG) methods of neurocontrol. These methods will bypass muscle activity and draw control signals directly from the human brain. BCI technologies will provide powerful and intuitive modes of interaction with 2-D and 3-D data, particularly for visualization and searching in complex data structures, such as geographical maps, satellite images, and terrain databases.

EMG Pattern Recognition
Electromyogram (EMG) signals are representative of the electrical energy present during muscle activation. These signals are may be sensed non-invasively by placing sensors on the skin which form a low impedance electrical connection with the tissue. These sensors can be either wet or dry, where the wet sensors use a conductive gel between the electrode and skin. We have developed pattern recognition software which can recognize EMG signals resulting from specific hand gestures. Examples of these gestures include pretending to move a joystick and pretending to type. We are thus able to "type" and use joysticks without having the mechanical joystick and keyboard devices physically present. Our future work includes developing improved electrodes, and further research and development into algorithms intrinsic to adaptive time-series analysis.


 

Intelligent Data Understanding
The Intelligent Data Understanding project is researching and developing machine learning algorithms designed to work with streaming Earth science data. The developing framework has been designed to allow users to graphically program sophisticated algorithms which use data distributed on different machines. The goals of the analysis are to extract the interesting components of the datasets to reduce the amount of transmitted data, to automatically diagnose the instrumentation, and to provoke more science questions. The algorithms are being developed as part of a larger framework incorporating data flow programming, interactive graphics, and support for third party software as a plug-in module such as Matlab.

Biologically Inspired Algorithms
Through out history people have taken inspiration from nature and sythesized practical implementations. The history of artificial neural networks is an example of this process. We know from nature that very sophisticated pattern recognition is performed reliably and quickly with slow and noisy systems. In this project we are looking at the current state of machine learning algorithms and modifying the assumptions which cause a departure from nature. For example many pattern recognition systems assume stationarity along with Gaussian priors. We are investigating techniques which are inherently suited to non-stationary, non-Gaussian systems.

EMG Course Grained Motor control

EMG Fine Grained Motor Control
EMG quicktime movie
ABC World News video
EEG quick time video
ABC WorldNews Tonight
NASA Press Release
NASA Ames

Neuro Engineering Technical Area
Extension of the Human Senses Group
Information Physics Group
Intelligent Flight Control Group

Research in Intelligent Vehicle Automation Group
Smart Systems Group

System Health And Safety Group

Kevin's Home Page


Comments and Suggestions
Marianna Yarovskaya
Responsible NASA Official
Joe Totah