Samy Bengio - Résumé

Education

Ph.D. in Computer Science, 1989-1993. Optimization of a Parametric Learning Rule for Neural Networks
Université de Montréal
M.Sc. in Computer Science, 1986-1989. Integration of Traditional and Intelligence Tutoring Systems
Université de Montréal
B.Sc. in Computer Science, 1983-1986
Université de Montréal

Employment History

Research Scientist in Machine Learning
Google Inc
2007-Present

Research on machine learning algorithms for large scale ranking problems.

Senior Researcher in Machine Learning
IDIAP Research Institute
1999-2007

Research on machine learning algorithms. Supervision of Ph.D. students and postdoctoral fellows. Research projet management.

Research Director
Microcell Labs
1997-1999

Direction of a research team focusing on the development and the application of various learning algorithms to exploit many dataware houses regarding the internal processes and client behaviors of a telecommunication company. Problems tackled: fraud dectection, churning and traffic prediction.

Researcher
Centre Interuniversitaire de Recherche en ANalyse des Organisations, CIRANO
1996-1997

Development of various machine learning and statistical models that make predictions and take decisions on financial markets: portfolio management, asset prediction, portfolio selection. In an other project, development of a machine learning model that simulates an agent on various types of auctions (buy at the best price given known information).

Postdoctoral Fellow
Institut National de la Recherche Scientifique - Télécommunications
1995-1996

Development and use of an Asynchronous Input/Output Hidden Markov Model (which can also be viewed as a connectionist recurrent mixture of experts) for speech recognition. This model was particularly well suited for non-stationary temporal problems.

Postdoctoral Fellow
Centre National d'Etudes des Télécommunications, France Télécom
1994-1995

Time series prediction with Neural Networks. Series were taken from a physical domain (sunspot-related) as well as a telecommunication domain. Various mixture models were proposed.

Research Assistant
Centre de Recherche sur les Transports, Université de Montréal
1993-1993

Use of Genetic Algorithms and Tabu Search for a Combinatorial Optimization Problem: the Vehicle Routing Problem with Time Windows.

Part Time System Administrator and Research Assistant
Department of Computer Science, Université de Montréal
1986-1993

Sysadmin for the intelligent tutoring systems and multimedia laboratories of the computer science department.

Recent Projects Funded and Managed

Swiss National Science Foundation Projects:

IM2.ACP, IM2.MI, IM2.BMI and IM2.MPR - Interactive Multimodal Information Management, 4 PhD, 2 postdocs.

MULTI - Multimodal Interaction and Multimedia Data Mining, several PhDs.

KerSpeech - Kernel Methods for Speech and Video Sequence Analysis, 1 PhD.

ADASEQ - Ensemble Methods for Sequence Processing, 1 PhD.

CARTANN - Cartography by Artificial Neural Networks, 1 PhD thesis finished.

Divide and Learn I and II - Mixture models for large datasets, 3 PhD, 1 thesis finished.

GLAD - Use of Boolean Methods for Classification, 1 PhD thesis finished.

KERNEL - Kernel Methods for Sequence Processing, 1 PhD.

SCRIPT - Cursive Handwriting Recognition, 1 PhD thesis finished.
European Projects:

PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning, 6th Framework Programme, Information Society Technology, Network of Excellence. Member of the steering committee

BANCA - Biometric Access Control for Networked and e-Commerce Applications, 5th Framework Programme, Information Society Technology, 2 researchers

EDAM - Environmental data mining: machine Learning algorithms and statistical tools for monitoring and forecasting, INTAS foundation, 1 invited researcher

LAVA - Learning for Adaptable Visual Assistants, 1 postdoc and 2 PhD

COST-275 - Biometric-Based Recognition of People over the Internet, 1 PhD

Scientific Duties

Action Editor

Journal of Machine Learning Research
since 2012
Member of the Editorial Board

Journal of Machine Learning Research
2009-2012
Member of the Editorial Board

Machine Learning Journal
since 2010
Associate Editor

Journal of Computational Statistics
2002-2011
Associate Editor

Journal of Selected Topics in Signal Processing
2009
Chair of International Conferences and Workshops

BayLearn: a new Workshop in Machine Learning in the Bay Area (BayLearn'2012).

BigVision: a NIPS Workshop on Big Data for Computer Vision (NIPS'2012).

Webvision: ECCV Workshop on Computer Vision for the Web (ECCV'2012)

Workshop on Multimodal Interaction and Related Machine Learning Algorithms, MLMI, 2004, 2005, 2006

NIPS Demonstration Chair, NIPS 2011

NIPS Workshop on Efficient Machine Learning, NIPS 2007

NIPS Workshop on Learning to Compare Examples, NIPS 2006

NIPS Workshop on Multimodal Signal Processing, NIPS 2004
Programme Committee Chair - Area Chair

European Conference on Machine Learning (ECML-PKDD) 2010

IEEE Workshop on Neural Networks for Signal Processing, NNSP, 2002

International Conference on Machine Learning (ICML) 2009, 2012

International Joint Conference on Artificial Intelligence (IJCAI) 2011, Senior Program Committee

International Joint Conference on Artificial Intelligence (IJCAI) 2005, Poster Track

Neural Information Processing Systems, NIPS, 2003, 2006, 2012
Reviewer - Programme Committee Member - International Conferences

European Symposium on Artificial Neural Networks, ESANN, 2004, 2005

Extraction et Gestion des Connaissances (EGC) 2006

IEEE Conference on Face and Gesture Recognition (FG) 2006

IEEE Workshop on Machine Learning for Signal Processing, MLSP, 2004, 2005, 2006

IEEE International Conference on Acoustic, Speech and Signal Processing, ICASSP

IEEE International Conference on Robotics and Automation, ICRA

IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS

International Conference on Artificial Intelligence and Statistics, AISTATS, 2009

International Conference on Audio and Video Based Biometric Person Authentication, AVBPA, 2003

International Conference on Biometrics, ICB 2006, 2009

International Conference on Computer Vision, CVPR

International Conference on Machine Learning, ICML, 2004, 2006

International Conference on Pattern Recognition, ICPR

International Conference on Biometrics Authentication, ICBA

International Joint Conference on Neural Networks, IJCNN

International Workshop on Multiple Classifier Systems, MCS

Neural Information Processing Systems, NIPS
Reviewer - Programme Committee Member - International Workshops

AAAI Spring Symposium on Human Behavior Modeling (2009)

ACM Symposium on Applied Computing - Special Track on Applied Biometrics (2010)

CVPR Workshop on Biometrics (CVPR'2006)

CVPR Workshop on Beyond Patches (CVPR'2006)

International Workshop on Biometric Recognition Systems (IWBRS) 2005

Workshop on Multimodal Interaction and Related Machine Learning Algorithms, MLMI, 2007, 2008, 2009

Multimodal User Authentication Workshop, MMUA, 2006

Morpho Challenge Workshop, 2005, 2007

NIPS Workshop on Machine Learning for Implicit Feedback and User Modeling (NIPS'2005)

SIGIR 2007 Workshop on Searching Spontaneous Conversational Speech

Spatial Interpolation Comparison, SIC, 2004
Advisory Boards

MLMI, 2009
Session Chair

Eurospeech, 2003

ICASSP, 2006

ICML, 2012

NNSP, 2002
Reviewer for many journals

Computer Speech and Language

EURASIP Journal of Applied Signal Processing

IEEE Transactions on Biomedical Engineering

IEEE Transactions on Evolutionary Computation

IEEE Transactions on Neural Networks

IEEE Transactions on Pattern Analysis and Machine Intelligence

IEEE Transactions on Speech and Audio Processing

IEEE Transactions on Systems, Man and Cybernetics - Part B

Information Fusion

International Journal of Neural Systems

International Journal of Pattern Recognition and Artificial Intelligence

Journal of Machine Learning Research

Journal of Pattern Recognition Letters

Machine Learning Journal

Neural Computing Surveys

Neural Computation

Neural Networks

Neurocomputing Journal

Pattern Recognition

Pattern Recognition Letters

Signal Processing

Speech Communication
Member of Ph.D. thesis juries

Francoise Fessant, Université de Rennes, 1995

Sébastien Marcel, Université de Rennes, 2000

Miguel Moreira, EPFL Lausanne, 2001

Pierre-Edouard Sottas, EPFL Lausanne, 2002

Nicolas Gilardi, Université de Lausanne, 2002

Todd Stephenson, EPFL Lausanne, 2003

Katrin Weber, EPFL Lausanne, 2003

Torsten Butz, EPFL Lausanne, 2003

Liva Ralaivola, Université de Paris 6, 2003

Ronan Collobert, Université de Paris 6, 2004

Vlad Popovici, EPFL Lausanne, 2004

Mathieu Ben, Université de Rennes, 2004

Fabien Cardinaux, EPFL Lausanne, 2005

Serghei Kosinov, Université de Genève, 2005

Jean-Julien Aucouturier, Université de Paris 6, 2006

Sylvain Ferrandiz, Université de Caen, 2006

Silvia Chiappa, EPFL Lausanne, 2006

Norman Poh, EPFL Lausanne, 2006

Alexei Pozdnoukhov, EPFL Lausanne, 2006

Mikaela Keller, EPFL Lausanne, 2006

Christos Dimitrakakis, EPFL Lausanne, 2006

Dong Zhang, EPFL Lausanne, 2006

Gianluca Monaci, EPFL Lausanne, 2007

Ivana Arsic, EPFL Lausanne, 2007

David Grangier, EPFL Lausanne, 2008

Jean-Francois Paiement, EPFL Lausanne, 2008

Marie Szafranski, Université de Technologie de Compiègne, 2008

Mihai Gurban, EPFL Lausanne, 2008

Jie Luo, EPFL Lausanne, 2011

Majid Yazdani, EPFL Lausanne, 2013
Member of other academic juries

Hervé Glotin, HDR, Université Sud Toulon Var, 2007

Vincent Lemaire, HDR, Université de Paris Sud, 2008

Teaching Experience

Course IC-49 on Statistical Machine Learning from Data, EPFL - Computer, Communication and Information Sciences Doctoral Program, 2005-2006

Lecture notes available at http://lectures.idiap.ch/ic-49/.
Advanced lectures on Statistical Machine Learning, IDIAP Research Institute, 2002-2003

Lecture notes available at http://www.idiap.ch/~bengio/lectures/.
Teaching replacement for M.Sc./Ph.D. lectures, Université de Montréal, 1992-1993,1996

Several lectures given in Artificial Neural Networks, Genetic Algorithms and Hidden Markov Models
Sprint School on Learning Algorithms, Université de Montréal, 1996

Various lectures on Hidden Markov Models and Input/Output Hidden Markov Models

Publications

Available at http://www.idiap.ch/~bengio/cv/samy.html

Patents

Process for the renewal -during communication- of the traffic parameters of an ATM network

S. Bengio, F. Clérot, A. Gravey and D. Collobert, 1997. France Télécom. United States Patent 6018517, International Patent WO 97/31456.

Computer Science Technical Knowledge

Development of several simulators

of machine learning algorithms, including many types of neural networks, support vector machines, [input/output] hidden Markov models, Gaussian mixture models, and other statistical models, genetic algorithms, genetic programming, simulated annealing, tabu search, and expert systems. See for instance the recent Torch library at http://www.Torch.ch.
Many years experience in system administration

on multi-platform environments (UNIX, Linux, Macintosh, Windows, etc..).
Known computer languages

C, C++, Java, Lisp, Mathematica, Matlab, Objective C, Pascal, Prolog, Splus, Smalltalk.

References

Available upon request.