The value of large-scale randomised control trials in system-wide improvement : the case of the Reading Catch-Up Programme

Date
2017
Journal Title
Journal ISSN
Volume Title
Publisher
Education Association of South Africa
Abstract
This article illustrates the value of large-scale impact evaluations with counterfactual components. It begins by exploring the limitations of small-scale impact studies, which do not allow reliable inference to a wider population or which do not use valid comparison groups. The paper then describes the design features of a recent large-scale randomised control trial (RCT) evaluation of an intermediate phase literacy intervention that we evaluated. Using a rigorous sampling process and randomised assignment, the paper shows the value of the approach, and how the RCT method prevents researchers from reaching potentially harmful false positive findings. The paper also considers some of the limitations of the RCT method and makes recommendations to mitigate these.
Description
CITATION: Fleisch, B., et al. 2017. The value of large-scale randomised control trials in system-wide improvement : the case of the Reading Catch-Up Programme. South African Journal of Education, 37(1):Art. # 1248, doi:10.15700/saje.v37n1a1248.
The original publication is available at http://www.sajournalofeducation.co.za
Keywords
Intermediate phase literacy, Literacy programmes, Reading difficulty -- Survey, Large-scale control trials, Sampling (Statistics), Scientific surveys
Citation
Fleisch, B., et al. 2017. The value of large-scale randomised control trials in system-wide improvement : the case of the Reading Catch-Up Programme. South African Journal of Education, 37(1):Art. # 1248, doi:10.15700/saje.v37n1a1248