L2 From perceptron learning rule to backpropagation in feedforward networks - supervised learning

Lecture slides (Lecture 2 Download Lecture 2)

Date and venue: Feb 17, 10:15-12:00, Lecture hall K1 (L2a) 
                                Feb 18,   8:15-10:00, Lecture hall D2 (L2b)

Before the lecture

Short introduction to L2a (slides Download slides) and pre-recorded video material focused on perceptrons (L2a)

Short introduction to L2b (slides Download slides, video) and pre-recorded video material focused on backprop (L2b)

Discussions during the lecture: L2a Download L2a, L2b Download L2b

After the lecture

Lecture 2a material: Lecture 2a video recording is missing for the same reason as for Lecture 1 (it was the same session).

Lecture 2b material: Lecture 2b video recording

                                          

Scope, topics covered:

• perceptron, delta rule
• correlational memory
• multi-layer perceptron, backpropagation

Reading material:

• S. Marsland: 2.1-2.3 (perceptron), 3 (multi-layer perceptron); (2nd ed.: 3, 4)
• R. Rojas: 3.1-3.3, 4.1-4.2 (perceptron), 7.1-7.3 (multi-layer perceptron)
• I. Goodfellow, Y. Bengio, A. Courville: 5.7, 5.9, 6.5