Advanced topics in Deep Learning, ESPCI

This 3rd-year course is a follow up of an introduction to deep-learning in 2nd year. It covers some advanced topics in deep-learning with guest lectures and lab sessions in pytorch (python module). The plenary session include exercises ( or TD).


  • First course: January the 9th. Early in the morning !

Expected schedules

It starts in january 2023 (the 9th). The course is scheduled on monday, starting at 8:30 in the morning.

  • 9/01, course: introduction, reminder and exercises
  • 16/01, course:
    • Reminder - 2
    • Adversarial attack and defense
    • Pytorch
  • 23/01, lab session 1
    • Refresher on pytorch
    • Convolution on CIFAR10
  • 30/01, lab session 2
    • ResNet
    • Adversarial attacks and defense
  • 06/02, course:
    • Sequence and convolution 1D
    • Recurrent Network
    • Optimization
    • Project
  • 13/02, lab session 3
    • Recurrent Network
  • 20/02, course:
    • Generative models (TBC)
  • 13/03, guest course: Applications to Biology

Vaitea Opuu

  • 20/03, guest course: Deep Learning for Astro-Physics

David Cornu

  • 27/03, guest course: Machine Learning, Physics and Fluid Mechanics

Lionel Mathelin

python and Notebooks: how to

We will use python 3, pytorch and notebooks. If you need to work with own computer, there are 2 ways:

  • install anaconda 3 on your computer: see this page.
  • use colab with a google account (the easiest, nothing todo)

To use files stored on your google drive you can add in your colab notebook:

from google.colab import drive

# in my drive, I have a directory "Colab Notebooks"
# the dataset is uploaded there
root_path = 'gdrive/My Drive/Colab Notebooks/'

If you are not familiar with python notebooks, see this page.


Here, you can find a list of possible projects. Feel free to interact with me. For some of them, just ask me the data, otherwise a link is provided. Of course, you can also propose a project. This section is under construction and maybe some projects will be added as soon as I will have more feedbacks from my colleagues.

  • Reconstruction of the vorticity field of a flow behind a cylinder from a handful sensors on the cylinder surface
Velocity fields Sea surface temperature
  • Using seismic signals to predict the timing of laboratory earthquakes.
  • Quantum-mechanical molecular energies prediction from the raw molecular geometry: see the QM7 database.
  • Classify Molecule polarization: the data comes from time-lapse fluorescence microscopy images of the bacterium Pseudomonas fluorescens SBW25. Each image is an individual bacterial cell. These bacteria produce a molecule called pyoverdin which is naturally fluorescent, so the images show the distribution of this molecule inside the cells. We have discovered that there are two distribution patterns of this molecule: homogeneous, or accumulated at the cell pole ("polarized").

Date: 2023-01-09

Author: A. Allauzen

Created: 2024-06-24 lun. 17:13