Visual cortex emerges from training parallel pathways with self-supervised predictive learning

Speaker: Blake Richards, MILA Title: The functional specialization of visual cortex emerges from training parallel pathways with self-supervised predictive learning Date Recorded: Wednesday 21st July 2021 Abstract: The visual system of mammals consists of parallel, hierarchical specialized pathways. Different pathways are specialized in so far as they use representations that are more suitable for supporting specific downstream behaviours. In particular, the clearest example is the specialization of the ventral (``what’’) and dorsal (``where’’) pathways of the visual cortex. These two pathways support behaviours related to visual recognition and movement, respectively. To-date, deep neural networks have mostly been used as models of the ventral recognition pathway. However, it is unknown whether both pathways can be modelled with a single deep ANN. Here, we ask whether a single model with a single loss function can capture the properties of both the ventral and the dorsal pathwa