Bruno A. Olshausen


Research papers    Review articles     Commentaries     Thesis

Research papers:

Computing with Residue Numbers in High-Dimensional Representation

Kymn CJ, Kleyko D, Frady EP, Bybee C, Kanerva P, Sommer FT, Olshausen BA (2023). arXiv:2311.04872

Bispectral Neural Networks

Sanborn S, Shewmake C, Olshausen BA, Hillar C (2023) ICLR Proceedings. arXiv

Disentangling images with Lie group transformations and sparse coding

Chau HY, Qiu F, Chen Y, Olshausen BA (2022). NeurIPS Workshop on Symmetry and Geometry in Neural Representations. Proceedings of Machine Learning Research 197. pdf.

Learning and Inference in Sparse Coding Models with Langevin Dynamics.

Fang MYS, Mudigonda M, Zarcone R, Khosrowshahi A, Olshausen BA (2022) Neural Computation, 34, 1675-1700. pdf.

High Fidelity Eye, Head, Body and World Tracking with a Wearable Device.

DuTell, V., Gibaldi, A., Focarelli, G., Olshausen, B.A., & Banks, M. S. (2022). Behavior Research Methods. pdf .

High-density analog image storage in an analog-valued non-volatile memory array.

Zheng, X., Zarcone, R. V., Levy, A., Khwa, W. S., Raina, P., Olshausen, B. A., & Wong, H. P. (2022). Neuromorphic Computing and Engineering2(4). pdf .

Selectivity and robustness of sparse coding networks.

Paiton DM, Frye CG, Lundquist SY, Bowen JD, Zarcone R, Olshausen BA (2020). Journal of Vision, 20(12):10. jov open access.

Resonator Networks, 1: An Efficient Solution for Factoring High-Dimensional, Distributed Representations of Data Structures.

Frady EP, Kent S, Olshausen BA, Sommer FT (2020). Neural Computation, 32(12). pdf

Resonator Networks, 2: Factorization Performance and Capacity Compared to Optimization-Based Methods.

Kent S, Frady EP, Sommer FT, Olshausen BA (2020). Neural Computation, 32(12). pdf

High-Acuity Vision from Retinal Image Motion.

Anderson AG, Ratnam K, Roorda A, Olshausen BA (2020) Journal of Vision, 20(7), 34. jov open access

Subspace Locally Competitive Algorithms.

Paiton DM, Shepard S, Chan KHR, Olshausen BA (2020) NICE '20 Proceedings. pdf

Analog Coding in Emerging Memory Systems.

Zarcone RV, Engel JH, Eryilmaz SB, Wan W, Kim S, BrightSky M, Lam C, Lung HL, Olshausen BA, Wong HS (2018) Scientific Reports, 10. pdf

Error-Resilient Analog Image Storage and Compression with Analog-Valued RRAM Arrays: An Adaptive Joint Source-Channel Coding Approach.

Zheng X, Zarcone R, Paiton D, Sohn J, Wan W, Olshausen BA, Wong HSP (2018) In: 2018 IEEE International Electron Devices Meeting (IEDM). pdf

The Sparse Manifold Transform.

Chen Y, Paiton DM, Olshausen BA (2018) In: Advances in Neural Information Processing Systems, 31. pdf

Joint Source-Channel Coding with Neural Networks for Analog Data Compression and Storage.

Zarcone R, Paiton D, Anderson A, Engel J, Wong HP, & Olshausen BA (2018) Data Compression Conference Proceedings. pdf

High-dimensional Computing as a Nanoscalable Paradigm.

Rahimi A, Datta S, Kleyko D, Frady EP, Olshausen BA, Kanerva P, Rabaey JM (2017) IEEE Transactions on Circuits and Systems I: Regular Papers, 64(9), 2508-2521. DOI: 10.1109/TCSI.2017.2705051

Vector-Symbolic Representations for Visual Scene Analysis.

Weiss E, Olshausen B (2017) Conference on Cognitive Computational Neuroscience 2017 pdf

Emergence of foveal image sampling from learning to attend in visual scenes.

Cheung B, Weiss E, Olshausen BA (2017) International Conference on Learning Representations (ICLR) Conference. arXiv:1611.09430

A Neural Model of High-Acuity Vision in the Presence of Fixational Eye Movements.

Anderson AG, Ratnam K, Roorda A, Olshausen BA (2016) 50th Asilomar Conference on Signals, Systems and Computers, November 6-9, 2016. IEEE Signal Processing Society. (pdf)

Discovering hidden factors of variation in deep networks.

Cheung B, Livezey JA, Bansal AK, Olshausen BA (2015) International Conference on Learning Representations 2015 Workshop. arXiv:1412.6583)

Capacity optimization of emerging memory systems: A Shannon-inspired approach to device characterization.

Engel JH, Eryilmaz SB, SangBum Kim, BrightSky, M, Chung Lam, Hsiang-Lan Lung, Olshausen BA, Wong H-SP (2014) Electron Devices Meeting (IEDM), 2014 IEEE International, pp.29.4.1,29.4.4, 15-17 Dec. 2014 doi: 10.1109/IEDM.2014.7047134 (pdf)

Modeling higher-order correlations within cortical microcolumns.

Koster U, Sohl-Dickstein J, Gray CM, Olshausen BA (2014) PLOS Computational Biology, 10(7): e1003684. doi:10.1371/journal.pcbi.1003684

Scene analysis in the natural environment.

Lewicki MS, Olshausen BA, Surlykke A, Moss CF (2014) Frontiers in Psychology, 5, article 199. (pdf)

Perception as an inference problem.

Olshausen BA (2014) In: The Cognitive Neurosciences V, M. Gazzaniga, R. Mangun, Eds. MIT Press. (pdf)

Testing our conceptual understanding of V1 function

Koster U, Olshausen BA (2013) arXiv:1311.0778

Highly overcomplete sparse coding.

Olshausen BA (2013) In: SPIE Proceedings vol. 8651: Human Vision and Electronic Imaging XVIII, (B.E. Rogowitz, T.N. Pappas, H. de Ridder, Eds.), Feb. 4-7, 2013, San Francisco, California. (pdf)

Learning intermediate-level representations of form and motion from natural movies.

Cadieu CF, Olshausen BA (2012) Neural Computation, 24(4):827-66 (pdf)

Learning sparse codes for hyperspectral imagery.

Charles AS, Olshausen BA, Rozell CJ (2011) IEEE Journal of Selected Topics in Signal Processing, 5, 963-978. (IEEE reprint)

Learning sparse representations of depth.

Tosic I, Olshausen BA, Culpepper BJ (2011) IEEE Journal of Selected Topics in Signal Processing, 5, 941-952. (pdf)

Lie Group Transformation Models for Predictive Video Coding.

Wang CM, Sohl-Dickstein J, Tosic I, Olshausen BA (2011) In: Data Compression Conference 2011 proceedings. (pdf)

Group Sparse Coding with a Laplacian Scale Mixture Prior.

Garrigues PJ, Olshausen BA (2011). In: Advances in Neural Information Processing Systems, 23, J. Lafferty, C.K.I. Williams, J. Shawe-Taylor, R.S. Zemel, A. Culotta, Eds. (NIPS reprint)

Building a better probabilistic model of images by factorization.

Culpepper BJ, Sohl-Dickstein J, Olshausen BA (2011) IEEE International Conference on Computer Vision. 6-13 Nov. 2011. pp. 2011-2017. (pdf)

An Unsupervised Algorithm For Learning Lie Group Transformations

Sohl-Dickstein J, Wang CM, Olshausen BA (2010) arXiv:1001.1027v5

Learning transport operators for image manifolds.

Culpepper BJ, Olshausen BA (2010) In: Advances in Neural Information Processing Systems, 22, Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, A. Culotta, Eds. (pdf)

Higher-order scene statistics of breast images.

Abbey CK, Sohl-Dickstein JN, Olshausen BA, Eckstein MP, Boone JM (2009) In: Proc. SPIE 7263, Medical Imaging 2009: Image Perception, Observer Performance, and Technology Assessment, 726317 (pdf)

Learning real and complex overcomplete representations from the statistics of natural images.

Olshausen BA, Cadieu CF, Warland DK (2009) In: SPIE Proceedings, Vol. 7446: Wavelets XIII, (V.K. Goyal, M. Papadakis, D. van de Ville, Eds.), August 2-4, 2009, San Diego, California. (pdf)

Learning transformational invariants from time-varying natural images.

Cadieu CF, Olshausen BA (2009) In: Advances in Neural Information Processing Systems, 21, D. Koller, Y. Bengio, D. Schuurmans, L. Bottou, A. Culotta, Eds., Curran Associates. pp. 209-216. (NIPS reprint) [Movies: Figure 2 mov, 4a mov, 4b mov, 4c mov, 4d mov]

Sparse Coding via Thresholding and Local Competition in Neural Circuits.

Rozell CJ, Johnson DH, Baraniuk RG, Olshausen BA (2008).  Neural Computation, 20, 2526-2563. (pdf)

Learning Horizontal Connections in a Sparse Coding Model of Natural Images.

Garrigues P, Olshausen BA (2008).  In: Advances in Neural Information Processing Systems, 20, J.C. Platt, D. Koller, Y. Singer, S. Roweis, Eds., MIT Press. pp. 505--512. reprint (pdf)

Bilinear Models of Natural Images.

Olshausen BA, Cadieu C, Culpepper J, Warland DK (2007).  SPIE Proceedings vol. 6492: Human Vision Electronic Imaging XII, (B.E. Rogowitz, T.N. Pappas, S.J. Daly, Eds.), Jan 28-Feb 1, 2007, San Jose, California. reprint (pdf)

How Close Are We to Understanding V1?

Olshausen BA, Field DJ (2005) Neural Computation, 17, 1665-1699.  pdf
(a previous version of this article was published as a chapter entitled "What is the other 85% of V1 doing," in 23 Problems in Systems Neuroscience.  T.J. Sejnowski, L. van Hemmen, eds.  Oxford University Press. pdf)

The Recognition of Partially Visible Natural Objects in the Presence and Absence of their Occluders.

Johnson JS, Olshausen BA (2005).  Vision Research, 45, 3262-3276. reprint (pdf)

The Earliest EEG Signatures of Object Recognition in a Cued-Target Task are Postsensory.

Johnson JS, Olshausen BA (2005).   Journal of Vision, 5: 299-312.  pdf/html

Convergent Evidence for the Visual Analysis of Optic Flow Through Anisotropic Attenuation of High Spatial Frequencies

Barlow HB, Olshausen BA (2004).  Journal of Vision, 4: 415-426.  pdf/html | abstract

Timecourse of Neural Signatures of Object Recognition

Johnson JS, Olshausen BA (2003).  Journal of Vision, 3: 499-512.  pdf/html  |  abstract

Learning Sparse, Overcomplete Representations of Time-Varying Natural Images

Olshausen BA (2003).  IEEE International Conference on Image Processing.  Sept. 14-17, 2003. Barcelona, Spain.  reprint (pdf) | abstract

Learning Sparse Multiscale Image Representations

Sallee P, Olshausen BA (2003).  Advances in Neural Information Processing Systems, 15, S. Becker, S. Thrun, and K. Obermayer, eds., MIT Press, 2003. pp 1327-1334.  reprint (pdf) | abstract

Processing Shape, Motion, and Three-dimensional Shape-from-Motion in the Human Cortex

Murray SO, Olshausen BA, Woods DL (2003).  Cerebral Cortex, 13(5): 508-16.  reprint (pdf) | abstract

Shape Perception Reduces Activity in Human Primary Visual Cortex

Murray SO, Kersten D, Olshausen BA, Schrater P, Woods DL  (2002).   Proceedings of the National Academy of Sciences, 99(23): 15164-15169.   reprint (pdf)   |   description  |  abstract

Sparse Codes and Spikes

Olshausen BA  (2002).    In: Probabilistic Models of the Brain: Perception and Neural Function.   R. P. N. Rao, B. A. Olshausen, and M. S. Lewicki, Eds.  MIT Press.  pp. 257-272.   reprint (pdf)  |  abstract

A Graphical Anatomical Database of Neural Connectivity

Press WA, Olshausen BA, Van Essen DC  (2001)  Philosophical Transactions of the Royal Society, London, B, 356, 1147-1157. reprint (pdf)  |  abstract

Learning Sparse Image Codes Using a Wavelet Pyramid Architecture

Olshausen BA, Sallee P, Lewicki MS  (2001).  Advances in Neural Information Processing Systems, 13: 887-893.  reprint (ps)  |  abstract

Learning Sparse Codes with a Mixture-of-Gaussians Prior

Olshausen BA, Millman KJ (2000). Advances in Neural Information Processing Systems, 12, Ed. by S.A. Solla, T.K. Leen, and K.R. Muller, MIT Press, pp. 841-847.   reprint (ps.gz | pdf)  |  abstract

Probabilistic Framework for the Adaptation and Comparison of Image Codes

Lewicki MS, Olshausen BA (1999).   Journal of the Optical Society of America, 16(7): 1587-1601reprint (pdf) | abstract

Sparse Coding with an Overcomplete Basis Set: A Strategy Employed by V1?

Olshausen BA, Field DJ (1997).  Vision Research, 37: 3311-3325.   reprint (pdf)  |  abstract

Learning Linear, Sparse, Factorial Codes

Olshausen BA (1996).   A.I. Memo 1580, Massachusetts Institute of Technology.  reprint (ps)  | abstract

Emergence of Simple-Cell Receptive Field Properties by Learning a Sparse Code for Natural Images

Olshausen BA, Field DJ (1996).   Nature, 381: 607-609.  reprint (pdf)  |  abstract

Natural Image Statistics and Efficient Coding

Olshausen BA, Field DJ (1996).   Presented at the Workshop on Information Theory and the Brain , September 4-5, 1995, University of Stirling, Scotland. Published in Network, 7: 333-339.   reprint (pdf)  |  abstract

A Nonlinear Hebbian Network that Learns to Detect Disparity in Random-Dot Stereograms

Lee CW, Olshausen BA (1996).   Neural Computation, 8: 545-566.   reprint (pdf) | abstract

A Multiscale Routing Circuit for Forming Size- and Position-Invariant Object Representations

Olshausen BA, Anderson CH, Van Essen DC (1995).  The Journal of Computational Neuroscience, 2, 45-62.  reprint (pdf) | abstract

A Neurobiological Model of Visual Attention and Invariant Pattern Recognition Based on Dynamic Routing of Information

Olshausen BA, Anderson CH, Van Essen DC (1993).  The Journal of Neuroscience, 13(11), 4700-4719.  reprint (pdf) | abstract

Pattern Recognition, Attention, and Information Bottlenecks in the Primate Visual System

Van Essen DC, Olshausen B, Anderson CH, Gallant JL (1991).   In: Proc. SPIE Conf. on Visual Information Processing: From Neurons to Chips, 1473, p. 17-28.   reprint (pdf) | abstract

Review articles:

What natural scene statistics can tell us about cortical representation.

Olshausen BA, Lewicki MS (2013) In: The New Visual Neurosciences. J. Werner, L.M. Chalupa, Eds. MIT Press. (pdf)

20 years of learning about vision: Questions answered, Questions unanswered, and Questions not yet asked.

Olshausen BA (2012) In: 20 Years of Computational Neuroscience. J. Bower, Ed. (pdf)

Sparse Coding of Sensory Inputs  

Olshausen BA, Field DJ (2004).  Current Opinion in Neurobiology, 14: 481-487. (pdf)

Directed Visual Attention and the Dynamic Control of Information Flow

Anderson CH, Van Essen DC, Olshausen BA (2004)  In:  Encyclopedia of Visual Attention, L. Itti, G. Rees, J. Tsotsos, Eds.  Academic Press/Elsevier.  (pdf)

Principles of Image Representation in Visual Cortex

Olshausen BA  (2003)  In:  The Visual Neurosciences, L.M. Chalupa, J.S. Werner, Eds.  MIT Press,  pp. 1603-15.   (.ps.gz | pdf)

Natural Image Statistics and Neural Representation

Simoncelli EP, Olshausen BA  (2001)  Annual Review of Neuroscience, 24, 1193-1215.  (reprint)
Vision and the Coding of Natural Images
Olshausen BA, Field DJ (2000).   American Scientist, 88(3): 238-245.  (reprint + obscured text)

Selective Visual Attention

Olshausen BA, Koch C (1995).   In M. Arbib (Ed.), The Handbook of Brain Theory and Neural Networks. MIT Press.


Sparse codes from memristor grids.

Olshausen BA, Rozell CJ (2017) Nature Nanotechnology, 12(8): 722-723. (html)

Does the brain de-jitter retinal images?

Olshausen BA, Anderson CH (2010) Proceedings of the National Academy of Sciences (Commentary), 107(46):19607-8. (pdf)

The statistics of style.

Olshausen BA, DeWeese MR (2010) Nature (News & Views), 463: 1027-8. (pdf)

A New Window on Sound

Olshausen BA, O'Connor KN  (2002).  Nature Neuroscience, 5, 292-293.  (html/pdf)

Forward to Map-Seeking Circuits in Visual Cognition

Olshausen BA (2002).  In:  Map-Seeking Circuits in Visual Cognition by David Arathorn.  Stanford University Press.  (pdf)

Review of Theoretical Neuroscience

Olshausen BA (2002).  Journal of Cognitive Neuroscience. (pdf)


Neural Routing Circuits for Forming Invariant Representations of Visual Objects

Olshausen BA (1994)  Ph.D. Thesis, Computation and Neural Systems, California Institute of Technology.  (single-spaced version | official Caltech double-spaced version)