Artificial Intelligence Enables Real-Time and Intuitive Control of Prostheses via Nerve Interface

Diu Khue Luu, Anh Tuan Nguyen, Ming Jiang, Markus W. Drealan, Jian Xu, Tong Wu, Wing kin Tam, Wenfeng Zhao, Brian Z.H. Lim, Cynthia K. Overstreet, Qi Zhao, Jonathan Cheng, Edward Keefer, Zhi Yang

Research output: Contribution to journalArticlepeer-review

Abstract

Objective: The next generation prosthetic hand that moves and feels like a real hand requires a robust neural interconnection between the human minds and machines. Methods: Here we present a neuroprosthetic system to demonstrate that principle by employing an artificial intelligence (AI) agent to translate the amputees movement intent through a peripheral nerve interface. The AI agent is designed based on the recurrent neural network (RNN) and could simultaneously decode six degree-of-freedom (DOF) from multichannel nerve data in real-time. The decoder's performance is characterized in motor decoding experiments with three human amputees. Results: First, we show the AI agent enables amputees to intuitively control a prosthetic hand with individual finger and wrist movements up to 97-98% accuracy. Second, we demonstrate the AI agent's real-time performance by measuring the reaction time and information throughput in a hand gesture matching task. Third, we investigate the AI agent's long-term uses and show the decoder's robust predictive performance over a 16-month implant duration. Conclusion & significance: Our study demonstrates the potential of AI-enabled nerve technology, underling the next generation of dexterous and intuitive prosthetic hands.

Original languageEnglish (US)
JournalIEEE Transactions on Biomedical Engineering
DOIs
StateAccepted/In press - 2022

Keywords

  • artificial intelligence
  • Artificial intelligence
  • Decoding
  • Deep learning
  • deep learning
  • Electromyography
  • Implants
  • information throughput
  • information transfer rate
  • motor decoding
  • neural decoder
  • neuroprosthesis
  • peripheral nerve
  • Prosthetic hand
  • reaction time
  • Real-time systems

ASJC Scopus subject areas

  • Biomedical Engineering

Fingerprint

Dive into the research topics of 'Artificial Intelligence Enables Real-Time and Intuitive Control of Prostheses via Nerve Interface'. Together they form a unique fingerprint.

Cite this