Universiteit Leiden

nl en

Statistical Learning and Prediction

In this course we aim to give the student a firm theoretical basis for understanding and evaluating statistical learning techniques and teach the students skills to apply statistical learning techniques in empirical research.

Target group
PhD candidate
Teachers
Marjolein Fokkema  (Associate professor) Tom Wilderjans  (Associate professor)

Registration is closed.

Description

Statistical learning refers to a vast set of tools for understanding data. Two classes of such tools can be distinguished: “supervised” and “unsupervised”. Supervised statistical learning involves building a statistical model for predicting an output (response, dependent) variable based on one or more input (predictor) variables. There are many areas of psychology where such a predictive question is of interest. For example, finding early markers for Alzheimer’s or other diseases, selection studies for personnel or education, or prediction of treatment outcomes. In unsupervised statistical learning, there are only input variables but no supervising output (dependent) variable; nevertheless we can learn relationships and structures from such data using cluster analysis and methods for dimension reduction.

In this course we aim to give the student a firm theoretical basis for understanding and evaluating statistical learning techniques and teach the students skills to apply statistical learning techniques in empirical research. Techniques often referred to as ‘machine learning’ (though we prefer the name ‘statistical learning’, because the basic problems of sampling and probability have not changed with the newer algorithms) will be discussed, including: cross-validation, elastic net regression, clustering (k-means, hierarchical), partial least squares, k-nearest neighbours, decision trees, gradient boosting, random forests, smoothing splines and support vector machines.

Preparation

Students receive a list of online videos and associated parts and exercises of the book of James et. al, 2021 (see below) that should be prepared before the course starts. This will take about 20 – 25 hours, depending on current statistical knowledge and R skills.

Mode of instruction and assessment

  • Mode of instruction: Lab sessions, in which lectures are combined with computer assignments.
  • Assessment mode: Active participation.

Recommended reading list

Additional suggested material (not required)

  • Berk, R. A. (2008). Statistical learning from a regression perspective. New York, Springer. (freely accessible within the Leiden network)
  • Kuhn, M. & Johnson, K. (2013). Applied predictive modelling. New York, Springer. (freely accessible within the Leiden network)

Fees

Target group One day Two days Three days
PhD candidates FSW FREE FREE FREE
Staff FSW €300 €400 €500
Other Leiden University PhD candidates €215 €315 €415
Externals €450 €600 €750
This website uses cookies.  More information.