VS298: Natural Scene Statistics: Difference between revisions

From RedwoodCenter
Jump to navigationJump to search
No edit summary
No edit summary
Line 26: Line 26:
| Feb. 3
| Feb. 3
| '''Redundancy reduction, whitening, and power spectrum of natural images'''
| '''Redundancy reduction, whitening, and power spectrum of natural images'''
* Barlow:  Theory of redundancy reduction [https://www.dropbox.com/s/y7qgngopjrf5pvs/barlow61.pdf paper] <br />
* Barlow (1961):  Theory of redundancy reduction [https://www.dropbox.com/s/y7qgngopjrf5pvs/barlow61.pdf paper] <br />
* Atick:  Theory of whitening [https://www.dropbox.com/s/xr9k56bxwc4bj9d/atick-redlich92.pdf paper]  <br />
* Atick (1992):  Theory of whitening [https://www.dropbox.com/s/xr9k56bxwc4bj9d/atick-redlich92.pdf paper]  <br />
* Field:  1/f<sup>2</sup> power spectrum and sparse coding [https://www.dropbox.com/s/jenlrgxxvm4h539/field87.pdf paper]
* Field (1987):  1/f<sup>2</sup> power spectrum and sparse coding [https://www.dropbox.com/s/jenlrgxxvm4h539/field87.pdf paper]
| <br />
| <br />
Anthony DiFranco<br />
Anthony DiFranco<br />
Line 36: Line 36:
| Feb. 10
| Feb. 10
|  '''Whitening in time and color; Robust coding''' <br />
|  '''Whitening in time and color; Robust coding''' <br />
* Dong & Atick:  spatiotemporal power spectrum of natural movies <br />
* Dong & Atick (1995):  spatiotemporal power spectrum of natural movies <br />
* Ruderman:  statistics of cone responses <br />
* Ruderman (1998):  statistics of cone responses <br />
* Karklin & Simoncelli:  noisy population coding of natural images
* Karklin & Simoncelli (2012):  noisy population coding of natural images
|
|
|-
|-
Line 47: Line 47:
| Feb. 24
| Feb. 24
|  '''Higher-order statistics and sparse coding''' <br />
|  '''Higher-order statistics and sparse coding''' <br />
* Barlow (1972) <br />
* Barlow (1972): sparse coding <br />
* Field (1994) <br />
* Field (1994): What is the goal of sensory coding? <br />
* Bell & Sejnowski (1996)
* Bell & Sejnowski (1996):  Independent components analysis.
|  
|  
|-
|-
| March 3
| March 3
|  '''ICA and sparse coding''' <br />
|  '''ICA and sparse coding''' <br />
* Olshausen & Field (1997) <br />
* Bell & Sejnowski (1997): ICA of natural images <br/>
* Bell & Sejnowski (1997)
* Olshausen & Field (1997):  sparse coding of natural images <br />
* van Hateren & Ruderman (1998), Olshausen (2003):  ICA/sparse coding of natural video
|  
|  
|-
|-

Revision as of 07:22, 3 February 2014

This seminar will examine what is known about the statistical structure of natural visual and auditory scenes, and theories of how sensory coding strategies have been adapted to this structure.

Instructor: Bruno Olshausen

Enrollment information:

VS 298 (section 4), 2 units
CCN: 66489

Meeting time and place:

Monday 6-8, Evans 560

General reading:

  • Natural Image Statistics by Hyvarinen, Hurri & Hoyer
  • Geisler WS (2008) Visual perception and the statistical properties of natural scenes, Annual Review of Psychology paper

Schedule:

Date Topic/Reading Presenter
Feb. 3 Redundancy reduction, whitening, and power spectrum of natural images
  • Barlow (1961): Theory of redundancy reduction paper
  • Atick (1992): Theory of whitening paper
  • Field (1987): 1/f2 power spectrum and sparse coding paper

Anthony DiFranco
Dylan Paiton
Michael Levy

Feb. 10 Whitening in time and color; Robust coding
  • Dong & Atick (1995): spatiotemporal power spectrum of natural movies
  • Ruderman (1998): statistics of cone responses
  • Karklin & Simoncelli (2012): noisy population coding of natural images
Feb. 17 ** Holiday **
Feb. 24 Higher-order statistics and sparse coding
  • Barlow (1972): sparse coding
  • Field (1994): What is the goal of sensory coding?
  • Bell & Sejnowski (1996): Independent components analysis.
March 3 ICA and sparse coding
  • Bell & Sejnowski (1997): ICA of natural images
  • Olshausen & Field (1997): sparse coding of natural images
  • van Hateren & Ruderman (1998), Olshausen (2003): ICA/sparse coding of natural video
March 10 Statistics of natural sound and auditory coding
  • Clark & Voss: '1/f noise and music'
  • Smith & Lewicki: sparse coding of natural sound
  • Klein/Deweese: ICA/sparse coding of spectrograms
March 17 Higher-order group structure
  • Geisler: contour statistics
  • Hyvarinen: subspace ICA/topgraphic ICA
  • Lyu & Simoncelli: radial Gaussianization
March 24 ** Spring recess **
March 31 Energy-based models
  • Osindero & Hinton
  • Roth & Black
April 7 Learning invariances through 'slow feature analysis'
  • Foldiak/Wiskott: slow feature analysis
  • Hyvarinen: 'Bubbles'
  • Berkes et al.
April 14 Manifold and Lie group models
April 21 Hierarchical models
  • Shan & Cottrell: stacked ICA
April 28 Deep network models
May 5
May 12