Syllabus
General Information
Location: | Strathcona Anatomy & Dentistry 1/12 - McConnell Engineering Building 11 |
Times: | Mondays - Tuesdays, 2:35-3:55pm |
Instructor: | Guillaume Rabusseau and Riashat Islam, School of Computer Science |
Office: | McConnell Engineering building, Guillaume: room 104N (left from the elevators), Riahsat: TBA |
Email: | guillaume.rabusseau@mail.mcgill.ca - riashat.islam@mail.mcgill.ca |
Office hours:
|
4pm-5pm Mondays and Wednesdays (TA's offices hours TBA)
Meetings at other times by appointment only! |
Class web page: | TBA
IMPORTANT: This is where class notes, announcements and homeworks are posted! |
Course Description
The goal of this class is to provide an overview of the state-of-art algorithms used in machine learning. The field of machine learning is concerned with the question of how to construct computer programs that improve automatically with experience. In recent years, many successful applications of machine learning have been developed, ranging from data-mining programs that learn to detect fraudulent credit card transactions, to autonomous vehicles that learn to drive on public highways, and computer vision programs that can recognize thousands of different object types. At the same time, there have been important advances in the theory and algorithms that form the foundation of this field. During this course, we will study both the theoretical properties of machine learning algorithms and their practical applications.
Prerequisites
Basic knowledge of a programming language is required. Knowledge of probabilities/statistics, calculus and linear algebra is required. Example courses at McGill providing sufficient background in probability are MATH-323 or ECSE-305. Some AI background is recommended, as provided, for instance by COMP-424 or ECSE-526, but not required. If you have doubts regarding your background, please contact Doina to discuss it.
Reference Materials
There is no required textbook. However, there are several good machine learning textbooks describing parts of the material that we will cover. The schedule will include recommended reading, either from these books, or from research papers, as appropriate.- Christopher M. Bishop, "Pattern Recognition and Machine Learning", Springer, 2006.
- Trevor Hastie, Robert Tibshirani and Jerome Friedman, "The Elements of Statistical Learning", Springer, 2009.
- Richard S. Sutton and Andrew G. Barto, "Reinforcement learning: An introduction", MIT Press, 1998.
- Richard O. Duda, Peter E. Hart & David G. Stork, "Pattern Classification. Second Edition", Wiley & Sons, 2001. David J.C. MacKay, "Information Theory, Inference and Learning Algorithms", Cambridge University Press, 2003.
- Kevin P. Murphy, "Machine Leanring: a Probabilistic Perspective", MIT Press, 2012.
Class Requirements
The class grade will be based on the following components:
- Three assignments - 40%. The assignments will contain a mix of
theoretical and experimental questions.
- A midterm in-class examination - 30%.
- A final project - 30%.
- Participation in class discussions - up to 1% extra credit.
Homework Policy
Assignments should be submitted electronically on the day when they are due, through MyCourses. For late assignments, 10 points will be deducted from the grade for every late day, for the first 5 days. No credit is given for assignments submitted more than 5 days late, unless you have a documented problem.
All assignments are INDIVIDUAL! You may discuss the problems with your colleagues, but you must submit individual homeworks. Please acknowledge all sources you use in the homeworks (papers, code or ideas from someone else).
McGill University values academic integrity. Therefore all students must understand the meaning and consequences of cheating, plagiarism and other academic offenses under the Code of Student Conduct and Disciplinary Procedures (see www.mcgill.ca/students/srr/honest for more information).
In accord with McGill University's Charter of Students' Rights, students in this course have the right to submit in English or in French any written work that is to be graded.
In the event of extraordinary circumstances beyond the University's control, the content and/or evaluation scheme in this course is subject to change.
Tentative Course Content
- Introduction, linear models, regularization, Bayesian interpretation (3 lectures)
- Large-margin methods, kernels and non-parametric methods (3 lectures)
- Latent variables, unsupervised learning (2 lectures)
- Non-linear models (3 lectures)
- Analyzing temporal and sequence data (3 lectures)
- Probabilistic graphical models (4 lectures)
- Semi-supervised learning, active learning (1 lecture)
- Computational Learning Theory (1 lecture)
- Midterm examination (1 lecture)
- Reinforcement learning (2 lectures)