Video lectures for "Efficient coding in vision".
this is for chapter 3 of the book "Understanding Vision: theory, models, and data" .
Understanding principles of efficient coding can enable you to answer questions such as: why should the input contrast response function of a neuron take its particular form? Why do retinal ganglion cells have center-surround receptive fields? How correlated or decorrelated should the visual responses from different retinal ganglion cells be? Why do receptive fields of retinal ganglion cells increase their sizes in dim light? How could visual coding depend on animal species? Why are color selective V1 neurons less sensitive to visual motion signals? How can one predict the ocular dominance properties of V1 neurons from developmental conditions? How should neurons adapt to changes in visual environment? This tutorial guides you on how to answer such questions.For ease of learning, other than the first two videos (one is a summary lecture, and the other describes the hihglights and organization of the 44 short video clips), the rest of the video clips below are listed by the rough order in which their topics appear in the textbook. It is feasible, although much less convenient, to learn all the essentials of the materials without access to the textbook (which is available in many university libraries).
The next two videos can be skipped to directly go to the detailed shorter video clips
A CVPR 2022 tutorial lecture on this topic
The detailed shorter video clips
Chap 3: Efficient coding, 1: motivation (4:15 minutes)
Chap 3: Efficient coding, 2: Information theory: bits and entropy (9:45 minutes)
Chap 3: Efficient coding, 3: Information theory: mutual information & channels (7:59 minutes)
Chap 3: Efficient coding, 4: Information theory: Gaussian distributions (6:49 minutes)
Chap 3: Efficient coding, 5: Information theory: redundancy & efficiency (10:17 minutes)
Chap 3: Efficient coding, 6: formulation of the principle (6:57 minutes)
Chap 3: Efficient coding, 7: formulation elaboration (11:29 minutes)
Chap 3: Efficient coding, 8.1: contrast sampling in fly's compound eye (5:33 minutes)
Chap 3: Efficient coding, 8.2: distribution of cones on the retina (8:02 minutes)
Chap 3: Efficient coding, 8.3: color sampling by retinal cones (4:48 minutes)
Chap 3: Efficient coding, 9_2: general solution (simplified) (16:30 minutes)
Chap 3: Efficient coding, 9: general solution for receptive fields (39:06 minutes)
Chap 3: Efficient coding 10: ocularity coding: a gist ( 9:29 minutes).
Chap 3: Efficient coding, 11.1: ocularity coding: (1) decorrelation (7:19 minutes)
Chap 3: Efficient coding 11.2: ocularity coding: (1) decorrelation, continued (9:04 minutes)
Chap 3: Efficient coding, 12.1: ocularity coding: (2) gain control (7:21 minutes)
Chap 3: Efficient coding, 12.2: ocularity coding: (2) gain control, continued (11:14 minutes)
Chap 3: Efficient coding, 13: ocularity coding: (3) Multiplexing (10:50 minutes)
Chap 3: Efficient coding, 14: ocularity coding: adaptation (13:22 minutes)
Chap 3: Efficient coding 15: ocularity coding: experimental tests (10:33 minutes)
Chap 3: Efficient coding, 16: retinal (space, time, color) coding, a gist (7:47 minutes)
Chap 3: Efficient coding, 17.2: retinal spatial coding -1: decorrelation -2 (17:09 minutes).
Chap 3: Efficient coding, 18: retinal spatial coding-2, gain control (6:21 minutes).
Chap 3: Efficient coding, 19: retinal spatial coding-3, multiplexing (13:25 minutes).
Chap 3: Efficient coding, 21.1: temporal coding, part 1 (7:47 minutes).
Chap 3: Efficient coding, 21.2: temporal coding, part 2 (6:46 minutes).
Chap 3: Efficient coding, 22.1: color coding, part 1, decorrelation (11:19 minutes)
Chap 3: Efficient coding, 22.2: color coding, part 2, gain control and adaptation (5:40 minutes)
Chap 3: Efficient coding, 23: coupling color coding and spatial coding on retina (19:07 minutes)
Chap 3: Efficient coding, 24.1: Spatial coding in V1, part 1 (15:53 minutes)
Chap 3: Efficient coding, 24.2: Spatial coding in V1, part 2 (14:09 minutes)
Chap 3: Efficient coding, 25.1: coupling space and color in V1, part 1 (15:36 minutes).
Chap 3: Efficient coding, 25.2: coupling space and color in V1, part 2 (14:59 minutes).
Chap 3: Efficient coding, 30: unsupervised learning for efficient coding (12:23 minutes)
Chap 3/4: 31: problems with understanding V1 by efficient coding principles (15:20 minutes)