• People
  • Courses

Machine Learning and Pattern Recognition


  • The mailing list for this course: csci_ga_2565_001_fa12
  • Graduate Course on machine learning, pattern recognition, neural nets, statistical modeling.
  • Fall 2012 instructor: Yann LeCun, 715 Broadway, Room 1220, 212-998-3283, yann [ a t ] cs.nyu.edu
  • Teaching Assistant: Xiang Zhang xiang.zhang [ a t ] nyu.edu, and Durk Kingma dpkingma [ a t ] gmail.com
  • Classes: Mondays 5:00 to 6:50 PM, Room 1302 Warren Weaver Hall.
  • Office Hours for Prof. LeCun: Tuesdays 4:00-6:00 PM. Please send an email to Prof. LeCun prior to an office hour visit.
  • office hours for the TA: Anounced at the mailing list.
  • The exam will be on December 17th, 5:00-7:00 pm.


  • The exam will be on December 17th, 5:00-7:00 pm.


Course Material

click here for a list of textbooks, Wikipedia articles, on-line courses, conference proceedings, etc

Course Description

The course covers a wide variety of topics in machine learning, pattern recognition, statistical modeling, and neural computation. It covers the mathematical methods and theoretical aspects, but will primarily focus on algorithmic and practical issues. Machine Learning and Pattern Recognition methods are at the core of many recent advances in “intelligent computing”. Current applications include machine perception (vision, audition, speech recognition), control (process control, robotics), data mining, time-series prediction (e.g. in finance), natural language processing, text mining and text classification, bio-informatics, neural modeling, computational models of biological processes, and many other areas.

Who Can Take This Course?

This course can be useful to all students who would want to use or develop statistical modeling methods. This includes students in CS (AI, Vision, Graphics), Math (System Modeling), Neuroscience (Computational Neuroscience, Brain Imaging), Finance (Financial modeling and prediction), Psychology (Vision), Linguistics, Biology (Computational Biology, Genomics, Bio-informatics), and Medicine (Bio-Statistics, Epidemiology). The only formal pre-requisites are familiarity with computer programming and linear algebra, but the course relies heavily on such mathematical tools as probability and statistics, multi-variate calculus, and function optimization. The basic mathematical concepts will be introduced when needed, but students will be expected to assimilate a non-trivial amount of mathematical concepts in a fairly short time.

Although this is a graduate-level course, highly motivated undergraduates at the senior level with a good math background can take this class. A few juniors have even taken this class successfully in the past.


The topics studied in the course include:

  • the basics of inductive inference, learning, and generalization.
  • linear classifiers: perceptron, LMS, logistic regression.
  • non-linear classifiers with linear parameterizations: basis-function methods, boosting, support vector machines.
  • multilayer neural networks, backpropagation
  • heterogeneous learning systems
  • graph-based models for sequences: hidden Markov models, finite-state transducers, recurrent networks.
  • unsupervised learning: density estimation, clustering, and dimensionality reduction methods.
  • introduction to graphical models and factor graphs
  • approximate inference, sampling.
  • optimization methods in learning: gradient-based methods, second-order methods, Expectation-Maximization.
  • objective functions: maximum likelihood, maximum a-posteriori, discriminative criteria, maximum margin.
  • the bias-variance dilemma, regularization, model selection.
  • applications in vision, speech, language, forecasting, and biological modeling.

By the end of the course, students will be able to not only understand and use the major machine learning methods, but also implement, apply and analyze them.

/srv/www/cilvr/htdocs/data/pages/mlpr/start.txt · Last modified: 2012/12/11 12:52 by durk
Recent changes RSS feed Creative Commons License Valid XHTML 1.0 Valid CSS Driven by DokuWiki
Drupal Garland Theme for Dokuwiki