PS12_material

Slides

The full slides are here Download here

We will use this page to post material that we work with during the second session on day 1. We make more material available as we proceed through the session.

• Retrieval on L3-4 Download Retrieval on L3-4
  and a discussion on train/dev/test sets
• PI1 Download PI1: how to improve on model performance.
• Discussion Download Discussion on why we use mini-batches.
• Problem 1: backprop on computational graphs
  • Problem formulation Download Problem formulation (separate pdf with all tasks),
  • Problem formulation Download Problem formulation (slides) and a slide where you can solve part a,
  • Slide Download Slide to solve to the main parts of part b-e.
• Mini-batches to approximate batch gradients Download Mini-batches to approximate batch gradients. (Not covered in the session)
• Number of forward-propagation operations Download Number of forward-propagation operations. (Not covered in the session)
• Problem 2: 
  • Problem formulation Download Problem formulation
  • Slide Download Slide to draw illustration
  • Notebook Download Notebook for playing around with problem 2.