Implicit encoding of prior probabilities in optimal neural populations

D Ganguli and E P Simoncelli

Published in Adv. Neural Information Processing Systems (NIPS*10), vol.23 pp. 658--666, Dec 2010. Presented at NIPS, Dec 2010.

Download:
  • Reprint (pdf)
  • Official (pdf)

  • Optimal coding provides a guiding principle for understanding the representation of sensory variables in neural populations. Here we consider the influence of a prior probability distribution over sensory variables on the optimal allocation of neurons and spikes in a population. We model the spikes of each cell as samples from an independent Poisson process with rate governed by an associated tuning curve. For this response model, we approximate the Fisher information in terms of the density and amplitude of the tuning curves, under the assumption that tuning width varies inversely with cell density. We consider a family of objective functions based on the expected value, over the sensory prior, of a functional of the Fisher information. This family includes lower bounds on mutual information and perceptual discriminability as special cases. In all cases, we find a closed form expression for the optimum, in which the density and gain of the cells in the population are power law functions of the stimulus prior. This also implies a power law relationship between the prior and perceptual discriminability. We show preliminary evidence that the theory successfully predicts the relationship between empirically measured stimulus priors, physiologically measured neural response properties (cell density, tuning widths, and firing rates), and psychophysically measured discrimination thresholds.
  • Superseded Publications: Ganguli10a
  • Ganguli PhD Thesis: Ganguli-phd
  • Related Publications: Ganguli13, Stocker06
  • Listing of all publications