Policy Evaluation (B-KUL-HMA74A)
Aims
This course evaluates the following learning outcomes:
The student
1.1 Understands the complexity of the evaluation problem, adopts a critical stance towards evaluation results and is capable of explaining in applied settings to what extent evaluation results depend on assumptions
2.1 Has experience with conducting policy evaluation analyses and with the presentation of evidence to inform policy debates
2.2. Has experience with conducting policy evaluation analyses and with the presentation of evidence to inform policy debates
3.1 Selects appropriate methods of policy evaluation and can apply these methods to real-life applications
3.2. Assesses the strengths and weaknesses of an empirical policy evaluation study
1. The student can select appropriate methods of policy evaluation and can apply these methods to real-life applications.
2. The student can assess the strengths and weaknesses of an empirical policy evaluation study.
3. The student understands the complexity of the evaluation problem, adopts a critical stance towards evaluation results and is capable of explaining in applied settings to what extent evaluation results depend on assumptions (a.o. relating to omitted variables or behavioral responses).
4. The student has experience with conducting policy evaluation analyses and with the presentation of evidence to inform policy debates.
Previous knowledge
If you want to follow this course, it is advisable to have completed Research Methods 3 (BBA, HBA27C) or an equivalent course that includes an introduction to econometrics or regression analysis.
Is included in these courses of study
- Master handelsingenieur (Leuven) 120 ects.
- Master handelsingenieur (Leuven) (Minor: European affairs management) 120 ects.
- Master in de communicatiewetenschappen (Leuven) (Afstudeerrichting media, cultuur en beleid) 60 ects.
- Master of Business Engineering (Leuven) (Minor: European Affairs Management) 120 ects.
- Master in de handelswetenschappen (dag + avond, programma voor studenten gestart vóór 2024-2025) (Brussel) 60 ects.
- Master of Business Administration (Brussels) 60 ects.
- Master of Business Administration (Brussels) (Track European Public Policy and Management) 60 ects.
- Courses for Exchange Students Faculty of Economics and Business (Brussels)
- Master of Management Engineering (Brussels) 120 ects.
- Master in de handelswetenschappen (programma voor studenten gestart in 2024-2025 of later) (Brussel) 60 ects.
Activities
6 ects. Policy Evaluation (B-KUL-HMA74a)
Content
- The policy evaluation problem
- Randomized experiments for policy evaluation
- Standard regression methods and matching
- Regression discontinuity
- Difference-in-differences, synthetic controls and fixed effects
- Instrumental variables
- Ex-ante evaluation: cost-benefit analysis and the valuation of impacts
- Ex-ante evaluation: microsimulation and model-based ex-ante analysis
Course material
The recommended textbooks are:
- (main textbook) Angrist, J. D., & Pischke, J. S. (2014). Mastering'metrics: The path from cause to effect. Princeton University Press.
- Gertler, P., Martinez, S., Premand, P., Rawlings, L., Vermeersch, C. (2011). Impact evaluation in practice. World Bank. openknowledge.worldbank.org/handle/10986/2550
- Boardman, A.E.G., Vining, D.H., Weimer, A.R. and David, L. (2011). Cost-benefit analysis: concepts and practice. Pearson.
Other course materials (course slides, journal articles, ...) are distributed via Toledo.
https://webapps.odisee.be/Ancor/SSM/Pages/BekijkSSM.aspx?OID=24075
Format: more information
During classes theory and methods are introduced with a focus on applications. Computer lab sessions give students hands-on experience with conducting these types of analyses. During the semester the students make an assignment of a practical research problem. Individual help and feedback from the lecturer is available during weekly office hours.
Evaluation
Evaluation: Policy Evaluation (B-KUL-H75075)
Explanation
Evaluation characteristics
The evaluation contains of two parts: a written exam and an assignment.
- The written exam takes place in the computer rooms and consists of both practical questions (in which students are required to use Stata software to conduct appropriate policy evaluation analyses), as well as open questions about the course materials (the exam is closed-book, but the Stata 'help files' are accessible and can be used for solving the practical questions).
- In the assignment students carry out and write a report on a policy analysis based on one of the methods discussed in class (the default assignment is to replicate an existing policy analysis). The deadline will be determined by the lecturer and communicated via Toledo. Detailed guidelines for the assignment are available via Toledo.
Determination final result
The grades are determined by the lecturer as communicated via Toledo and as stated in the examination schedule. The result is calculated and communicated as a whole number on a scale of 20. The final grade is a weighted score and consists of the written exam (which counts for 50%) and the assignment (50%). If the student does not hand in the assignment or does not respect the set deadline, then a 0-grade will be used for the assignment in the calculation of the final grade. If the student does not participate in the written exam, then the final grade of the course will be NA (not attended) for the whole course.
Second exam opportunity
The deadline for the assignment will be determined by the lecturer and communicated via Toledo. The evaluation structure in the second exam opportunity is identical to the first exam opportunity.