Machine Learning and Inductive Inference (B-KUL-H02C1A)

4.0 ECTS English 34.5 First termFirst term Advanced Cannot be taken as part of an examination contract
POC Artificial Intelligence

This course will familiarise the students with the domain of machine learning, which concerns techniques to build software that can learn how to perform a certain task (or improve its performance on it) by studying examples of how it has been accomplished previously, and in a broader sense the discovery of knowledge from observations (inductive inference).
After following this course, students will:

  • have a basic understanding of the general principles of learning
  • have an overview of the existing techniques for machine learning and data mining
  • understand how these techniques work, and why they work
  • be able to implement programs that learn or exhibit adaptive behavior, using these techniques
  • be up-to-date with the current state of the art in machine learning research
  • be able to contribute to contemporary machine learning research

Students should be familiar with:

  • algorithms and programming
  • some elements from higher mathematics, probability theory and statistics
  • predicate logic

Introductory courses on these topics (at the Bachelor level) suffice.

Slides, transparencies, courseware
Toledo / e-platform
Syllabus


This course unit is a prerequisite for taking the following course units:
H05N0A : Capita selecta computerwetenschappen: Artificiële intelligentie

Activities

1.0 ects. Machine Learning and Inductive Inference: Exercises (B-KUL-H00G6a)

1.0 ECTS English 15.0 First termFirst term
POC Artificial Intelligence

Exercises are made on the subjects discussed during the lectures. These are mostly pen-and-paper exercises where students gain insight in the workings of learning algorithms by manually mimicking the computations of certain learning algorithms, graphically describing the result of a learning algorithm (by drawing decision
surfaces), etc.  There are also exercises on evaluation of machine learning models and algorithms.

Students try to independently solve the exercises during some time.  A teaching assistant provides help where necessary, and discusses the solution afterwards.

  • A list of exercises.
  • Solutions are made available on Toledo.

3.0 ects. Machine Learning and Inductive Inference: Lecture (B-KUL-H02C1a)

3.0 ECTS English 19.5 First termFirst term
POC Artificial Intelligence

1. introduction to machine learning, connections with other subjects
2. general principles of learning:
- concept learning, version spaces
- evaluation of learning algorithms
- theory of learnability
- representation of inputs and outputs of learning algorithms
3. specific learning approaches:
- decision trees
- rules, association rules
- instance based learning
- clustering
- neural networks
- support vector machines
- Bayesian learning
- genetic algorithms
- ensemble methods (bagging, boosting, ...)
- reinforcement learning
- inductive logic programming
 

Ten lectures of 2 hours each.

Course Text
Lecture slides

Evaluation

Evaluation : Machine Learning and Inductive Inference (B-KUL-H22C1a)

Mode of evaluation : Oral with written preparation
Category : final examination during examination period
Type of evaluation : Open book

The exam consists of questions about the theory as well as some exercises.  The course text and lecture slides can be consulted during the exam.  Students have about 2 hours time for preparing their answers, followed by an ten minute oral interrogation.