A learning framework for controlling spiking neural networks

Vignesh Narayanan, Jason T. Ritt, Jr Shin Li, Shinung Ching

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

Controlling a population of interconnected neurons using extrinsic stimulation is a challenging problem. The challenges are due to the inherent nonlinear neuronal dynamics, the highly complex structure of underlying neuronal networks, the underactuated nature of the control problem, and adding to these is the binary nature of the observation/feedback. To meet these challenges, adaptive, learning-based approaches using deep neural networks and reinforcement learning are potentially useful strategies. In this paper, we propose an approximation based learning framework in which a model for approximating the input-output relationship in a spiking neuron is developed. We then present a reinforcement learning scheme to approximate the solution for the Bellman equation, and to design the control sequence to achieve a desired spike pattern. The proposed strategy, by integrating the reinforcement learning and system theoretic approaches, provides a tractable framework to design a learning control network, and to select the hyper parameters in deep learning architectures. We demonstrate the feasibility of the proposed approach using numerical simulations.

Original languageEnglish
Title of host publication2019 American Control Conference, ACC 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages211-216
Number of pages6
ISBN (Electronic)9781538679265
DOIs
StatePublished - Jul 2019
Event2019 American Control Conference, ACC 2019 - Philadelphia, United States
Duration: Jul 10 2019Jul 12 2019

Publication series

NameProceedings of the American Control Conference
Volume2019-July
ISSN (Print)0743-1619

Conference

Conference2019 American Control Conference, ACC 2019
Country/TerritoryUnited States
CityPhiladelphia
Period07/10/1907/12/19

Fingerprint

Dive into the research topics of 'A learning framework for controlling spiking neural networks'. Together they form a unique fingerprint.

Cite this