Pierre Wolinski
I am currently a post-doctoral researcher in the Probability and Statistics team,
Institut de Mathématiques d'Orsay, Université Paris-Saclay (France).
My supervisors are Gilles Blanchard and Christophe Giraud.
I completed my PhD in Machine Learning in March 2020, supervised by Guillaume Charpiat and Yann Ollivier, at the TAU team, LRI.
Here is my CV: [fra], [eng].
Thesis: Structural Learning of Neural Networks
[final version].
Defense carried out on March 6th, 2020.
Interest
- deep learning, neural networks (NNs);
- theory: optimization, Bayesian/Variational inference;
- hyperparameter search, tuning or removal: neural network pruning, learning rate tuning;
- other: neural tangent kernels, random weights, weight initialization...
Publications
- Adapting Newton's Method to Neural Networks through a Summary of Higher-Order Derivatives (2023),
P. Wolinski
[link]
[code]
- Efficient Neural Networks for Tiny Machine Learning: A Comprehensive Review (2023),
M. T. Lê, P. Wolinski, J. Arbel
[link]
- Rethinking Gauss-Newton for learning over-parameterized models (NeurIPS 2023, poster),
M. Arbel, R. Ménégaux, P. Wolinski
[link]
- Gaussian Pre-Activations in Neural Networks: Myth or Reality? (2022),
P. Wolinski, J. Arbel
[link]
[code]
- An Equivalence between Bayesian Priors and Penalties in Variational Inference (2020),
P. Wolinski, G. Charpiat, Y. Ollivier
[link]
- Learning with Random Learning Rates (ECML 2019), L. Blier, P. Wolinski, Y. Ollivier
[link]
[code]
- Asymmetrical Scaling Layers for Stable Network Pruning,
P. Wolinski, G. Charpiat, Y. Ollivier
[draft]
- Consistance des méthodes RKHS dans le cadre de la minimisation d’un risque convexe (Master thesis, 2015),
P. Wolinski, supervised by F. d'Alché-Buc, E. Moulines, F. Roueff [link]
Curriculum Vitae
- PhD in Computer Science, University Paris-Saclay (formerly University Paris-Sud).
- Graduate degree in Mathematics (Physics option) at the École Normale Supérieure (Paris).
- Master degree in Mathematics (Probability and Statistics), University Paris-Sud.
Study
2023 - now: post-doctoral researcher in the Probability and Statistics team, Université Paris-Saclay, France.
2021 - 2023: post-doctoral researcher in the Statify team, Inria Grenoble-Alpes, France (supervised by Julyan Arbel).
2020 - 2021: post-doctoral researcher at the Department of Statistics of the University of Oxford, UK (supervised by Judith Rousseau).
2016 - 2020: PhD student in Computer Science at the team TAU, LRI, University Paris-Sud/Inria, France (supervised by Guillaume Charpiat and Yann Ollivier).
2011 - 2016: Math student at the École Normale Supérieure, Paris, France.
2008 - 2011: Physics/Chemistry student in "classe préparatoire".
2008: Baccalauréat.