en
Scientific article
Open access
English

Insights from a simple expression for linear fisher information in a recurrently connected population of spiking neurons

Published inNeural computation, vol. 23, no. 6, p. 1484-1502
Publication date2011
Abstract

A simple expression for a lower bound of Fisher information is derived for a network of recurrently connected spiking neurons that have been driven to a noise-perturbed steady state. We call this lower bound linear Fisher information, as it corresponds to the Fisher information that can be recovered by a locally optimal linear estimator. Unlike recent similar calculations, the approach used here includes the effects of nonlinear gain functions and correlated input noise and yields a surprisingly simple and intuitive expression that offers substantial insight into the sources of information degradation across successive layers of a neural network. Here, this expression is used to (1) compute the optimal (i.e., information-maximizing) firing rate of a neuron, (2) demonstrate why sharpening tuning curves by either thresholding or the action of recurrent connectivity is generally a bad idea, (3) show how a single cortical expansion is sufficient to instantiate a redundant population code that can propagate across multiple cortical layers with minimal information loss, and (4) show that optimal recurrent connectivity strongly depends on the covariance structure of the inputs to the network.

Keywords
  • Action Potentials/physiology
  • Models, Neurological
  • Nerve Net/physiology
  • Neural Networks (Computer)
  • Neurons/physiology
Citation (ISO format)
BECK, Jeffrey, BEJJANKI, Vikranth R, POUGET, Alexandre. Insights from a simple expression for linear fisher information in a recurrently connected population of spiking neurons. In: Neural computation, 2011, vol. 23, n° 6, p. 1484–1502. doi: 10.1162/NECO_a_00125
Main files (1)
Article (Published version)
accessLevelPublic
Identifiers
ISSN of the journal0899-7667
603views
626downloads

Technical informations

Creation11/19/2012 2:53:00 PM
First validation11/19/2012 2:53:00 PM
Update time03/14/2023 5:49:04 PM
Status update03/14/2023 5:49:04 PM
Last indexation01/16/2024 12:44:43 AM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack