The Genomic Bottleneck Algorithm for Faster Learning and Better Generalization

Event Description

Join Zoom Meeting
https://stonybrook.zoom.us/j/98079526509?pwd=Wkt5eURhVDN5VE56TUloS2h5V1Jodz09

Meeting ID: 980 7952 6509
Passcode: 949941



Abstract Over the last decade, artificial neural networks have undergone a revolution, catalyzed by better
supervised learning algorithms. However, in stark contrast to young animals (including humans), training such
networks requires enormous numbers of labeled examples, leading to the belief that animals must rely instead
mainly on unsupervised learning. The reason is that most animal behavior is not the result of clever learning
algorithms--supervised or unsupervised-- but is encoded in the genome. Specifically, animals are born with
highly structured brain connectivity, which enables them to learn very rapidly. Because the wiring diagram is
far too complex to be specified explicitly in the genome, it must be compressed through a genomic
bottleneck. I will describe results showing how the genomic bottleneck algorithm can lead to dramatic
compression of networks and better generalization, particularly for rapid transfer in supervised and
reinforcement learning.

Anthony Zador is professor of neuroscience at CSHL.

Date Start

Date End