Sergio Pulido - MindSense

About

MindSense combines biomedical engineering and gaming to revolutionize stroke rehabilitation. Using EEG technology, players control a majestic pigeon through the power of their thoughts. Collect rings and embark on a captivating journey of recovery, where determination meets innovation.

Info

Role: Solo developer

Team size: 1

State: Completed

Time frame: 3 year

Introduction

MindSense marks a transformative journey, bridging biomedical engineering with the world of gaming. This innovative project emerged as a beacon of hope for stroke patients seeking engaging motor rehabilitation therapies.

Following a stroke, many individuals grapple with paralysis. Hebbs' principle suggests that persistent neural stimulation can create new pathways, fostering the recovery of motor function. Traditional rehabilitation therapies, which also leverage Hebbs' principle, often prove disheartening, as progress remains hidden from view.

In this unique endeavor, MindSense integrates cutting-edge EEG technology. Users, empowered by motor imagery signals detected near the primary motor cortex, steer a majestic pigeon within a captivating video game. By visualizing or ceasing motor imagery, players guide the pigeon to collect rings, embarking on a journey where determination fuels recovery.

Welcome to a world where biomedical engineering meets gaming to redefine the path to rehabilitation. Prepare to take flight and embrace the future of stroke therapy with MindSense.

What I Learned...

MindSense marked the genesis of my game development journey, and it's remarkable how it introduced me to a world of possibilities and newfound skills. For this project, I delved into the realm of game development to make motor rehabilitation therapies engaging for stroke patients, and the experience left a profound impact on me.

It was here that I ventured into uncharted territories, using MATLAB for brain signal processing and serial communication to link MATLAB with Unity. A distinctive aspect of this journey was that I navigated the intricate game development process independently. With no guiding professors for this specific facet of the project, I turned to online tutorials, embarking on a self-guided odyssey.

MindSense opened the door to an enchanting realm that I now hold dear – the world of game development. I'm profoundly grateful for the opportunity this project provided, as it ignited a passion that has become an integral part of my journey. The magic of game development has since been a guiding star, inspiring my future endeavors and enhancing the way I perceive the intersection of technology, creativity, and innovation.

Track to transverse in MindSense.

Player doesn't get enough rings in MindSense and the game is restarted.

Results

Input Accuracy: Achieved an impressive ~75% accuracy in detecting motor imagery for game control.
Surprising Insights: Conversations with study participants revealed that individuals who frequently meditate can more easily control the game compared to those who do not meditate.
Published Papers:
- Main Paper: This comprehensive publication provides a detailed account of the project's methodology and complete results:
  - Pulido, S.D., López, J.M. Interfaz Cerebro-Máquina con base en Detección de Intención de Movimiento y Técnicas de Aprendizaje Automático. In: Encuentro Internacional de Educación en Ingeniería ACOFI 2017, Cartagena, Colombia (2017).
- Additional Paper: This paper explores the intriguing connection between meditation and the ease of using brain-computer interfaces for brain wave modulation enhancement:
  - Pulido, S.D., López, J.M. Brain-computer interface based on detection of movement intention as a means of brain wave modulation enhancement. In: 13th International Symposium on Medical Information Processing and Analysis, San Andrés, Colombia (2017).

Wavelet analysis in MindSense to detect motor imagery.

Use of Support Vector Machines to differentiate between rest and motor imagery.

Basic setup for MindSense. The user is controlling the pigeon using motor imagery.