STUDENTS | CARNEGIE MELLON ENGINEERING
EEG and Student Innovation
“THE BRAIN IS BASICALLY JUST A SYSTEM THAT GIVES OFF ELECTRICAL SIGNALS,” SHI JOHNSON-BEY EXPLAINS. “SENDING THOSE
EEG FOR VIRTUAL REALITY
identify and diagnose neurological disorders like epilepsy, Shi Johnson-Bey is a master’s student in biomedical
resolution, and accessibility, with magnetic resonance
engineering whose research focuses on EEG sensing as
imaging (MRI) machines as the most effective for the
an input method for virtual reality (VR) modules. This
highest price but also the most difficult to maintain.
means that a user can interact with a virtual world without
Electroencephalography (EEG) machines are at the other
making use of hand-held controllers—an ideal situation
end of the range as the most affordable and portable but at
for individuals who have limited mobility without a loss
a lower resolution—usually.
of mental capabilities, such as patients with amyotrophic Johnson-Bey was a Journeyman Fellow for the U.S.
number of sensing nodes that are attached to a patient’s
Army Research Laboratory both in the summer of 2017
scalp—10 to 40 electrodes—is too low. For this reason,
and again for his final year of study. In his summer
EEG as a neural imaging technique is often replaced with
experience, Johnson-Bey learned about various brain-
more invasive, risky, and expensive methods. But Pulkit
computer interfaces and created a P300 speller application
Grover, an assistant professor of electrical and computer
that allowed users to type text by using brain activity. He
engineering (ECE) at CMU, still has faith in EEG. His group’s
continued this research to develop a system where users
research predicts that current theories about EEG severely
can interact with objects in VR settings by using audio cues. or layout, such as a menu of options. In addition to wearing
offers clearer images that better send and receive signals
a VR headset, which includes immersion by sight and
through human skulls. Even more effective are UHD EEG:
sound, the user would also be hooked up to EEG nodes that
ultra-high-density EEG with up to 1,000 electrodes.
connect with the VR system. When hearing or seeing certain
TELEVISION OR CHANGE THE LIGHTS JUST BY THINKING A CERTAIN WAY.”
sounds or icons next to menu items, the EEG nodes would
as figuring out how to attach all of them and how to get the
pick up electrical signals from the brain when the user is
most out of each node. To address these problems, Grover’s
paying more attention, a reaction they have when they want
lab includes a group of instrumentation engineers, led by
to select an option. Reading that signal, the VR system can
post-doctoral researcher Ashwati Krishnan and doctoral
then select that item, essentially reading the user’s mind.
candidate Ritesh Kumar in collaboration with Shawn
TURN ON THE
Within a virtual system, a user would see an environment
postulate that high-density EEG, with 64 to 256 electrodes,
Of course, with more nodes come new problems, such
SOMEONE TO
lateral sclerosis (ALS).
resolution to get highly detailed brain scans because the
underestimate their capacity for spatial resolution. They
A DEVICE COULD ALLOW
sleep disorders, strokes, and more. Devices vary in cost,
Typical EEG machines often do not have high enough
SIGNALS TO
This technology could open up the world of video games
Kelly, senior systems scientist in the Engineering Research
to those who previously did not have access, can provide
Accelerator. Rounding out the team, are students who are
simulations for medical and emotional treatment, and can
providing crucial insight into how to make EEG as accessible
lead to better understanding of how neurological patients
as possible for a variety of people.
with low communication skills function. Johnson-Bey also gave the example of using this kind of technology as something of a universal remote. PA GE 4 1
A variety of neural imaging techniques are used to
