Samy Bengio - Résumé

Education

Ph.D. in Computer Science, 1989-1993. Optimization of a Parametric Learning Rule for Neural Networks
Université de Montréal
M.Sc. in Computer Science, 1986-1989. Integration of Traditional and Intelligence Tutoring Systems
Université de Montréal
B.Sc. in Computer Science, 1983-1986
Université de Montréal

Employment History

Senior Director, AI and Machine Learning Research
Apple Inc
2021-Present

Long term curiosity-based foundational research in machine learning.

Research Scientist in Machine Learning
Google Inc
2007-2021

Research on machine learning algorithms and deep architectures for large scale ranking problems involving images, videos, texts, voice.

Senior Researcher in Machine Learning
IDIAP Research Institute
1999-2007

Research on machine learning algorithms. Supervision of Ph.D. students and postdoctoral fellows. Research projet management.

Research Director
Microcell Labs
1997-1999

Direction of a research team focusing on the development and the application of various learning algorithms to exploit many dataware houses regarding the internal processes and client behaviors of a telecommunication company. Problems tackled: fraud dectection, churning and traffic prediction.

Researcher
Centre Interuniversitaire de Recherche en ANalyse des Organisations, CIRANO
1996-1997

Development of various machine learning and statistical models that make predictions and take decisions on financial markets: portfolio management, asset prediction, portfolio selection. In an other project, development of a machine learning model that simulates an agent on various types of auctions (buy at the best price given known information).

Postdoctoral Fellow
Institut National de la Recherche Scientifique - Télécommunications
1995-1996

Development and use of an Asynchronous Input/Output Hidden Markov Model (which can also be viewed as a connectionist recurrent mixture of experts) for speech recognition. This model was particularly well suited for non-stationary temporal problems.

Postdoctoral Fellow
Centre National d'Etudes des Télécommunications, France Télécom
1994-1995

Time series prediction with Neural Networks. Series were taken from a physical domain (sunspot-related) as well as a telecommunication domain. Various mixture models were proposed.

Research Assistant
Centre de Recherche sur les Transports, Université de Montréal
1993-1993

Use of Genetic Algorithms and Tabu Search for a Combinatorial Optimization Problem: the Vehicle Routing Problem with Time Windows.

Part Time System Administrator and Research Assistant
Department of Computer Science, Université de Montréal
1986-1993

Sysadmin for the intelligent tutoring systems and multimedia laboratories of the computer science department.

Projects Funded and Managed

Swiss National Science Foundation Projects:
IM2.ACP, IM2.MI, IM2.BMI and IM2.MPR - Interactive Multimodal Information Management, 4 PhD, 2 postdocs.
MULTI - Multimodal Interaction and Multimedia Data Mining, several PhDs.
KerSpeech - Kernel Methods for Speech and Video Sequence Analysis, 1 PhD.
ADASEQ - Ensemble Methods for Sequence Processing, 1 PhD.
CARTANN - Cartography by Artificial Neural Networks, 1 PhD thesis finished.
Divide and Learn I and II - Mixture models for large datasets, 3 PhD, 1 thesis finished.
GLAD - Use of Boolean Methods for Classification, 1 PhD thesis finished.
KERNEL - Kernel Methods for Sequence Processing, 1 PhD.
SCRIPT - Cursive Handwriting Recognition, 1 PhD thesis finished.
European Projects:
PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning, 6th Framework Programme, Information Society Technology, Network of Excellence. Member of the steering committee
BANCA - Biometric Access Control for Networked and e-Commerce Applications, 5th Framework Programme, Information Society Technology, 2 researchers
EDAM - Environmental data mining: machine Learning algorithms and statistical tools for monitoring and forecasting, INTAS foundation, 1 invited researcher
LAVA - Learning for Adaptable Visual Assistants, 1 postdoc and 2 PhD
COST-275 - Biometric-Based Recognition of People over the Internet, 1 PhD

Scientific Duties

Action Editor
Journal of Machine Learning Research
since 2012
Member of the Editorial Board
Journal of Machine Learning Research, 2009-2012
Machine Learning Journal, 2010-2020
Associate Editor
Journal of Computational Statistics, 2002-2011
Journal of Selected Topics in Signal Processing, 2009
Member of the Board
ICLR: International Conference on Learning Representations, 2018-2020
NeurIPS: Neural Information Processing Systems, 2019-.
Member of the Scientific Advisory Board
Simons Institute for the Theory of Computing, 2018-2020
MLMI, 2009
NSF ID4: Institute for Data Driven Dynamical Design, 2022-
Member of other Advisory Boards
University of Montreal International Advisory Committee to the Rector, 2022-
General Chair
NeurIPS: Neural Information Processing Systems (2018).
Programme Chair
NIPS: Neural Information Processing Systems (2017).
ICLR: International Conference on Learning Representations (2015, 2016).
Chair of International Conferences and Workshops
BayLearn: a new Workshop in Machine Learning in the Bay Area (BayLearn'2012-2016).
BigVision 2012: a NIPS Workshop on Big Data for Computer Vision (NIPS'2012).
BigVision 2014: a CVPR Workshop on Big Data for Computer Vision (CVPR'2014).
BigVision 2015: a CVPR Workshop on Big Data for Computer Vision (CVPR'2015).
Webvision: ECCV Workshop on Computer Vision for the Web (ECCV'2012)
Workshop on Multimodal Interaction and Related Machine Learning Algorithms, MLMI, 2004, 2005,2006
NIPS Demonstration Chair, NIPS 2011
NIPS Workshop on Efficient Machine Learning, NIPS 2007
NIPS Workshop on Learning to Compare Examples, NIPS 2006
NIPS Workshop on Multimodal Signal Processing, NIPS 2004
NeurIPS Ethics Review co-chair, NeurIPS 2021.
Programme Committee Chair - Senior Area Chair
International Conference on Learning Representations (ICLR) 2022, 2023, 2024
International Conference on Machine Learning (ICML) 2019, 2021, 2022, 2023
Neural Information Processing Systems (NeurIPS) 2020, 2022, 2023
Programme Committee Chair - Area Chair
European Conference on Machine Learning (ECML-PKDD) 2010
IEEE Workshop on Neural Networks for Signal Processing, NNSP, 2002
International Conference on Learning Representations (ICLR) 2019, 2021
International Conference on Machine Learning (ICML) 2009, 2012, 2015, 2016, 2020
International Joint Conference on Artificial Intelligence (IJCAI) 2011, Senior Program Committee
International Joint Conference on Artificial Intelligence (IJCAI) 2005, Poster Track
Neural Information Processing Systems, NIPS, 2003, 2006, 2012, 2014, 2015
Reviewer - Programme Committee Member - International Conferences
European Symposium on Artificial Neural Networks, ESANN, 2004, 2005
Extraction et Gestion des Connaissances (EGC) 2006
IEEE Conference on Face and Gesture Recognition (FG) 2006
IEEE Workshop on Machine Learning for Signal Processing, MLSP, 2004, 2005, 2006
IEEE International Conference on Acoustic, Speech and Signal Processing, ICASSP
IEEE International Conference on Robotics and Automation, ICRA
IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS
International Conference on Artificial Intelligence and Statistics, AISTATS, 2009
International Conference on Audio and Video Based Biometric Person Authentication, AVBPA, 2003
International Conference on Biometrics, ICB2006, 2009
International Conference on Biometrics Authentication, ICBA
International Conference on Computer Vision, CVPR
ICLR: International Conference on Learning Representations (2014, 2017).
International Conference on Machine Learning, ICML, 2004, 2006
International Workshop on Multiple Classifier Systems, MCS
International Joint Conference on Neural Networks, IJCNN
International Conference on Pattern Recognition, ICPR
Neural Information Processing Systems, NIPS
Reviewer - Programme Committee Member - International Workshops
AAAI Spring Symposium on Knowledge Representation and Reasoning (2015)
AAAI Spring Symposium on Human Behavior Modeling (2009)
ACM Symposium on Applied Computing - Special Track on Applied Biometrics (2010)
CVPR Workshop on Biometrics (CVPR'2006)
CVPR Workshop on Beyond Patches (CVPR'2006)
International Workshop on Biometric Recognition Systems (IWBRS) 2005
ICML Extreme Classification Workshop, 2015
Workshop on Multimodal Interaction and Related Machine Learning Algorithms, MLMI, 2007,2008, 2009
Multimodal User Authentication Workshop, MMUA, 2006
Morpho Challenge Workshop, 2005, 2007
NIPS Workshop on Machine Learning for Implicit Feedback and User Modeling (NIPS'2005)
SIGIR 2007 Workshop on Searching Spontaneous Conversational Speech
Spatial Interpolation Comparison, SIC, 2004
Session Chair
Eurospeech, 2003
ICASSP, 2006
ICML, 2012
NNSP, 2002
Reviewer for many journals
Computer Speech and Language
EURASIP Journal of Applied Signal Processing
IEEE Transactions on Biomedical Engineering
IEEE Transactions on Evolutionary Computation
IEEE Transactions on Neural Networks
IEEE Transactions on Pattern Analysis and Machine Intelligence
IEEE Transactions on Speech and Audio Processing
IEEE Transactions on Systems, Man and Cybernetics - Part B
Information Fusion
International Journal of Neural Systems
International Journal of Pattern Recognition and Artificial Intelligence
Journal of Machine Learning Research
Journal of Pattern Recognition Letters
Machine Learning Journal
Neural Computing Surveys
Neural Computation
Neural Networks
Neurocomputing Journal
Pattern Recognition
Pattern Recognition Letters
Signal Processing
Speech Communication
Member of Ph.D. thesis juries
Francoise Fessant, Université de Rennes, 1995
Sébastien Marcel, Université de Rennes, 2000
Miguel Moreira, EPFL Lausanne, 2001
Pierre-Edouard Sottas, EPFL Lausanne, 2002
Nicolas Gilardi, Université de Lausanne, 2002
Todd Stephenson, EPFL Lausanne, 2003
Katrin Weber, EPFL Lausanne, 2003
Torsten Butz, EPFL Lausanne, 2003
Liva Ralaivola, Université de Paris 6, 2003
Ronan Collobert, Université de Paris 6, 2004
Vlad Popovici, EPFL Lausanne, 2004
Mathieu Ben, Université de Rennes, 2004
Fabien Cardinaux, EPFL Lausanne, 2005
Serghei Kosinov, Université de Genève, 2005
Jean-Julien Aucouturier, Université de Paris 6, 2006
Sylvain Ferrandiz, Université de Caen, 2006
Silvia Chiappa, EPFL Lausanne, 2006
Norman Poh, EPFL Lausanne, 2006
Alexei Pozdnoukhov, EPFL Lausanne, 2006
Mikaela Keller, EPFL Lausanne, 2006
Christos Dimitrakakis, EPFL Lausanne, 2006
Dong Zhang, EPFL Lausanne, 2006
Gianluca Monaci, EPFL Lausanne, 2007
Ivana Arsic, EPFL Lausanne, 2007
David Grangier, EPFL Lausanne, 2008
Jean-Francois Paiement, EPFL Lausanne, 2008
Marie Szafranski, Université de Technologie de Compiègne, 2008
Mihai Gurban, EPFL Lausanne, 2008
Jie Luo, EPFL Lausanne, 2011
Majid Yazdani, EPFL Lausanne, 2013
Pierre-Michel Bousquet, Université d'Avignon, 2014
Seungyeon Kim, Georgia Tech, 2015
Dimitri Palaz, EPFL Lausanne, 2016
Hieu Pham, CMU, 2021
Paul Best, University of Toulon, 2022
Member of other academic juries
Hervé Glotin, HDR, Université Sud Toulon Var, 2007
Vincent Lemaire, HDR, Université de Paris Sud, 2008

Teaching Experience

Course IC-49 on Statistical Machine Learning from Data, EPFL - Computer, Communication and Information Sciences Doctoral Program, 2005-2006
Lecture notes available at http://bengio.abracadoudou.com/lectures.
Advanced lectures on Statistical Machine Learning, IDIAP Research Institute, 2002-2003
Lecture notes available at http://bengio.abracadoudou.com/lectures/old.
Teaching replacement for M.Sc./Ph.D. lectures, Université de Montréal, 1992-1993,1996
Several lectures given in Artificial Neural Networks, Genetic Algorithms and Hidden Markov Models
Sprint School on Learning Algorithms, Université de Montréal, 1996
Various lectures on Hidden Markov Models and Input/Output Hidden Markov Models

Publications

Available at http://www.idiap.ch/~bengio/cv/samy.html

Computer Science Technical Knowledge

Development of several simulators
of machine learning algorithms, including many types of neural networks, support vector machines, [input/output] hidden Markov models, Gaussian mixture models, and other statistical models, genetic algorithms, genetic programming, simulated annealing, tabu search, and expert systems. See for instance the recent Torch library at http://www.Torch.ch.
Many years experience in system administration
on multi-platform environments (UNIX, Linux, Macintosh, Windows, etc..).
Known computer languages
C, C++, Java, Lisp, Mathematica, Matlab, Objective C, Pascal, Prolog, Splus, Smalltalk.

References

Available upon request.