Running Randomized Evaluations : A Practical Guide

**A comprehensive guide to running randomized impact evaluations of social programs in developing countries** This book provides a comprehensive yet accessible guide to running randomized impact evaluations of social programs. Drawing on the experience of researchers at the Abdul Latif Jameel Poverty Action Lab, which has run hundreds of such evaluations in dozens of countries throughout the world, it offers practical insights on how to use this powerful technique, especially in resource-poor environments. This step-by-step guide explains why and when randomized evaluations are useful, in what situations they should be used, and how to prioritize different evaluation opportunities. It shows how to design and analyze studies that answer important questions while respecting the constraints of those working on and benefiting from the program being evaluated. The book gives concrete tips on issues such as improving the quality of a study despite tight budget constraints, and demonstrates how the results of randomized impact evaluations can inform policy. With its self-contained modules, this one-of-a-kind guide is easy to navigate. It also includes invaluable references and a checklist of the common pitfalls to avoid. * Provides the most up-to-date guide to running randomized evaluations of social programs, especially in developing countries * Offers practical tips on how to complete high-quality studies in even the most challenging environments * Self-contained modules allow for easy reference and flexible teaching and learning * Comprehensive yet nontechnical This Book Provides A Comprehensive Yet Accessible Guide To Running Randomized Impact Evaluations Of Social Programs. Drawing On The Experience Of Researchers At The Abdul Latif Jameel Poverty Action Lab, Which Has Run Hundreds Of Such Evaluations In Dozens Of Countries Throughout The World, It Offers Practical Insights On How To Use This Powerful Technique, Especially In Resource-poor Environments. This Step-by-step Guide Explains Why And When Randomized Evaluations Are Useful, In What Situations They Should Be Used, And How To Prioritize Different Evaluation Opportunities. It Shows How To Design And Analyze Studies That Answer Important Questions While Respecting The Constraints Of Those Working On And Benefiting From The Program Being Evaluated. The Book Gives Concrete Tips On Issues Such As Improving The Quality Of A Study Despite Tight Budget Constraints, And Demonstrates How The Results Of Randomized Impact Evaluations Can Inform Policy. With Its Self-contained Modules, This One-of-a-kind Guide Is Easy To Navigate. It Also Includes Invaluable References And A Checklist Of The Common Pitfalls To Avoid. It Provides The Most Up-to-date Guide To Running Randomized Evaluations Of Social Programs, Especially In Developing Countries. It Offers Practical Tips On How To Complete High-quality Studies In Even The Most Challenging Environments. It Includes Self-contained Modules That Allow For Easy Reference And Flexible Teaching And Learning. It Covers Comprehensive Yet Nontechnical--provided By Publisher. The Experimental Approach -- Foundations : Why Experiment? -- Asking The Right Questions -- Randomizing -- Outcomes And Instruments -- Power -- Threats -- Analysis -- Policy Lessons -- Appendix 1 -- Appendix 2 -- Index. Rachel Glennerster And Kudzai Takavarasha. Includes Bibliographical References And Index. This book provides a comprehensive yet accessible guide to running randomized impact evaluations of social programs. Drawing on the experience of researchers at the Abdul Latif Jameel Poverty Action Lab, which has run hundreds of such evaluations in dozens of countries throughout the world, it offers practical insights on how to use this powerful technique, especially in resource-poor environments. This step-by-step guide explains why and when randomized evaluations are useful, in what situations they should be used, and how to prioritize different evaluation opportunities. It shows how to prioritize different evaluation opportunities. It shows how to design and analyze studies that answer important questions while respecting the constraints of those working on and benefiting from the program being evaluated. The book gives concrete tips on issues such as improving the quality of a study despite tight budget constraints, and demonstrates how the results of randomized impact evaluations can inform policy. With its self-contained modules, this one-of-a-kind guide is easy to navigate. It also includes invaluable references and a checklist of the common pitfalls to avoid Preface vii Abbreviations and Acronyms ix 1 The Experimental Approach 1 2 Why Randomize? 24 3 Asking the Right Questions 66 4 Randomizing 98 5 Outcomes and Instruments 180 6 Statistical Power 241 7 Threats 298 8 Analysis 324 9 Drawing Policy Lessons 386 Appendix 421 Glossary 443 Index 453 Provides a guide to running randomized impact evaluations of social programs. This book explains why and when randomized evaluations are useful, in what situations they should be used, and how to prioritize different evaluation opportunities.