L2 From perceptron learning rule to backpropagation in feedforward networks - supervised learning

Lecture slides (Lecture 2 Download Lecture 2)

Date and venue: Jan 16, 8:15-12:00, Lecture hall K2 (L2a-b)                                 

Before the lecture

Short introduction to L2a (slides Download slides) and pre-recorded video material focused on perceptrons (L2a)

Short introduction to L2b (slides Download slides, video) and pre-recorded video material focused on backprop (L2b)

Discussions during the lecture: L2a Download L2a, L2b Download L2b

After the lecture

Lecture 2a material:  Zoom recording L2a

Lecture 2b material: Zoom recording L2b

                                          

Scope, topics covered:

• perceptron, delta rule
• correlational memory
• multi-layer perceptron, backpropagation

Reading material:

• S. Marsland: 2.1-2.3 (perceptron), 3 (multi-layer perceptron); (2nd ed.: 3, 4)
• R. Rojas: 3.1-3.3, 4.1-4.2 (perceptron), 7.1-7.3 (multi-layer perceptron)
• I. Goodfellow, Y. Bengio, A. Courville: 5.7, 5.9, 6.5