PSYCH-GA.2211 / NEURL-GA.2201, Fall Semester 2017

Mathematical Tools for Neural and Cognitive Science

Instructor(s): Mike Landy  &  Pascal Wallisch  &  Eero Simoncelli
Teaching Assistant(s): Charlie Burlingham (charlie DOT burlingham AT nyu DOT edu),
Pierre Fiquet (fiquet AT nyu DOT edu)
Time: Lectures: Tuesday/Thursday, 10:00-12:00
Labs: selected Fridays, 9:30-12:00
Location: Lectures: Meyer Hall (4 Washington Place), Rm. 815
Labs: Meyer Hall, Rm. 815

Description: A graduate lecture course covering fundamental mathematical methods for visualization, analysis, and modeling of neural and cognitive data and systems. The course was introduced in Spring of 1999, became a requirement for CNS doctoral students in 2000, and for Psychology doctoral students in the Cognition and Perception track in 2008. The course covers a foundational set of mathematical and statistical tools, providing assumptions, motivation, intuition, and simple derivations for each. Concepts are reinforced with extensive computational exercises in the Matlab programming language. The goal is for students to be able to understand, use and interpret these tools.

Topics include: Linear algebra, least-squares and total-least-squares regression, eigen-analysis and PCA, linear shift-invariant systems, convolution, Fourier transforms, Nyquist sampling, basics of probability and statistics, hypothesis testing, model comparison, bootstrapping, estimation and decision theory, signal detection theory, classification, linear discriminants, clustering, models of neural spike generation, white noise (reverse-correlation) analysis.

Prerequisites: Algebra, trigonometry, and calculus. Some experience with matrix algebra and/or computer programming is helpful, but not required. The real prerequisites are an aptitude for logical and geometric reasoning, and a willingness to work hard!

Announcements: We will be using Piazza for online class announcements, questions, and discussion. Rather than emailing the instructors or TAs, we encourage you to post your questions/comments on Piazza, where they can be discussed and/or answered by any of us or your fellow classmates. Our Piazza class page is: https://piazza.com/nyu/fall2017/psychga2211neurlga2207/home

Schedule:   (labs in green, content will appear incrementally...)

Date Topic (Videos) Handouts Homework
Tue, Sep 5 Introduction to the course
Linear algebra I: vectors, vector spaces, inner products
(video)
Course description (pdf)  
Thu, Sep 7 Linear algebra II: projection, linear systems
(video)
 
Fri, Sep 8 Matlab I: Vectors, vector operations, plotting
(audio recording)
Lab1 script (m)
Matlab installation (txt)
Matlab primer (pdf)
(also, see Resource links below)
Homework formatting instructions: see Piazza
Tue, Sep 12 Linear Algebra III: orthogonal/diagonal matrices, geometry
(video)
Homework 1 (online 9/11, due 9/26) - (pdf)
mtxExamples (mat)
Thu, Sep 14 Linear Algebra IV: SVD, null and range spaces, inverses
(video)
Slides: Linear algebra (pdf)
Notes: Geometric review of linear algebra (pdf)
 
Fri, Sep 15 Matlab II: Functions, matrices and matrix operations
(video)
Lab2 files (folder)
Tue, Sep 19 Matlab III: SVD, projections and basic control of program flow
(video)
Lab3 files (folder)
Thu, Sep 21 Linear Algebra, extended example: Trichromacy
(video)
Fri, Sep 22
Regression I: Least squares regression
(video)
Tue, Sep 26 Regression II: weighting, outliers
(video)
  Homework 2 (online 9/27, due 10/10) - (pdf)
colMatch (mat), humanColorMatcher (p-file)
regress1 (mat), regress3 (mat)
constrainedLS (mat)
Thu, Sep 28 Regression III: incorporating linear/quadratic constraints
(video)
   
Fri, Sep 29 [no lab]
Tue, Oct 3 Regression IV: TLS regression, eigenvalues/eigenvectors,
(video)
Slides: Least squares (pdf)
Notes: Least squares (pdf)
Thu, Oct 5 LinSys I: LSI systems, convolution
(video)
   
Fri, Oct 6 Lab: Regression/PCA, elliptical geometry
(video)
Lab4 files (folder)
Tue, Oct 10 LinSys II: Sinusoids, Discrete Fourier transforms
(video)
   
Thu, Oct 12 LinSys III: Convolution Theorem
(video)
  Homework 3 (online 10/12, due 10/26) - (pdf)
PCA (mat), unknownSystem1 (p-file),
unknownSystem2 (p-file), unknownSystem3 (p-file)
Fri, Oct 13 [no lab]
Tue, Oct 17 Lab: Convolution, 1D and 2D
(video)
Lab5 files (folder)  
Thu, Oct 19 LinSys IV: Fourier Examples, sampling, aliasing
(video)
Slides: LSI, convolution, Fourier (pdf)
Notes: LSI, convolution, Fourier (pdf)
 
Fri, Oct 20 Lab: Fourier Transforms
(video)
Tue, Oct 24 Prob I: Descriptive statistics, basics of probability
(video)
   
Thu, Oct 26 Prob II: 1D distributions, joint, marginal, conditional distributions
(video)
   
Fri, Oct 27 [no lab]   Homework 4 (online 10/30, due 11/10 11/16) - (pdf)
Tue, Oct 31 Prob III: Sums of RVs, basics of statistical inference
(video)
   
Thu, Nov 2 Prob&Stats IV: Overview/context: probability models, sampling, inference
(video)
   
Fri, Nov 3 Lab: Frequency analysis
(video)
Slides: Probability-I (pdf)  
Tue, Nov 7 Prob&Stats V: samples, histograms, expectations, multi-D Gaussians
(video)
   
Thu, Nov 9 Stats I: multi-D Gaussians / Frequentist statistical tests
(video)
   
Fri, Nov 10 [no lab]  
Tue, Nov 14 [no class - SfN]    
Thu, Nov 16 Stats II: Frequentist stats / Correlation
(video)
   
Fri, Nov 17 Lab: Simulations, Power, Reproducibility
(video)
  Homework 5 (online 11/19, due 12/1 12/4) - (pdf),
psychopathy (mat)
Tue, Nov 21 Stats III: Correlation and its (mis-)interpretation
(video)
   
Thu, Nov 23 [no class - Thanksgiving]    
Fri, Nov 24 [no lab - Thanksgiving]    
Tue, Nov 28 Stats IV: Correlation / cross-validation, regularization, bootstrap
(video)
Slides: Probability-II (pdf)
Handout: Bootstrapping (pdf)
 
Thu, Nov 30 Stats: Rest of bootstrapping, Example I: Fitting a neural LNP model
(video)
   
Fri, Dec 1 Lab: simulation and resampling
(video)
Lab9 files (folder)
Tue, Dec 5 Example II: Signal Detection Theory (SDT) and psychophysical experiments
(video)
Slides: LNP model (pdf) Homework 6 (online 12/6, due 12/19) - (pdf),
runGaussNoiseExpt (m), runBinNoiseExpt (m),
fisherData (mat)
Thu, Dec 7 Example III: Signal Detection Theory, Multi-dimensional decision
(video)
   
Fri, Dec 8 [no lab]    
Tue, Dec 12 [no class - NYU operates on a Monday schedule!]
Thu, Dec 14 Example IV: Multi-dimensional classification, clustering
(video)
   
Fri, Dec 15 Lab: Signal Detection Theory Lab: Signal Detection Theory (folder)
Slides: Decision/classification (pdf)
 

Resources (Electrons):

Resources (Dead Trees):

Scroll to top of page