콘텐츠 바로가기
로그인
컨텐츠
  • HOME
  • SEARCH
PLUS Text Size MINUS RESET
FACEBOOK TWITTER Linked In

Category Open

Events

tutorial

Information on development assistance programs in Korea

home

Events
Official Aid Workshop

Print

Workshop

Title

[Workshop] Evaluating the Impact of Development Programs
(Turning Promises into Evidence)

Type Workshop
Venue Seoul, Korea Date 2012-12-03 ~ 2012-12-06
Host World Bank; Korean Development Institute Organizer
Sponsor Strategic Impact Evaluation Fund Contact

Background and Purpose:


The objective of this course is to give participants an overview of impact evaluation. This includes cutting-edge methods for conducting impact evaluation, an understanding of its importance for policymaking and program design, techniques on how to construct a results chain, and practical skills in the application of impact evaluation techniques to participants own projects.
The workshop is a highly interactive mix of small and large group sessions involving the “hands on” application of what is learned throughout the week.  The first day is a plenary discussion for all participants.  On days 2 and 3, participants choose between parallel tracks -- one targeted to policy makers, one targeted to researchers –- which cover the same topics, but with different degrees of econometrics.  Both tracks are designed to ensure consistency and the diffusion of key messages to both groups. From the very first day of the workshop until the last one, participants (policymakers, technical staff and World Bank task team leaders) will work together as project teams with expert moderators on the “hands-on” design of a high quality impact evaluations and implementation plans for their projects.  On the final day of the workshop, the teams present their proposed evaluation plans to the whole group and receive guidance from each other and the course moderators.

 

Program Schedule:


 

Monday, December 3, 2012


8:30 - 9:00 AM  Registration
9:00 - 9:30 AM
(Plenary Session)
 Welcome and Introductory Remarks
- Tae-Jong Kim, KDI School
- Laura Rawlings, World Bank
9:30 - 11:00 AM
(Plenary Session)
 Evaluating Impact: From Promise to Evidence
- Paul Gertler, University of California - Berkeley
  • Why evaluate?
  • The policy impact of rigorous evaluation
  • Types of evaluations
  • Counterfactuals
  • Introduction to quantitative methods for evaluating development programs
11:00 – 11:30 AM  Coffee Break
11:30 - 12:30 PM
(Plenary Session)
 Monitoring and Evaluation: The Foundation for Results
- Laura Rawlings, World Bank
  • Global Focus on Results
  • Monitoring vs. Evaluation
  • Using a RESULTS Chain
  • Results in Projects
  • Moving Forward
12:30 - 2:00 PM  Lunch
2:00 - 2:15 PM
(Plenary Session)
 Plenary Exercise: Where in the World?
- Adam Ross, World Bank
2:15 - 2:30 PM
(Plenary Session)
 Introduction to Group Work and the IE Clinics
- Adam Ross, World Bank
2:30 – 6:00 PM
(Group Session)
 
(Coffee Break
3:30 – 4:00)
 Group Work 1: Establishing a Results Chain
Moderators: Impact Evaluation Specialists
 Participants will be assigned to sectoral groups. Each group will select one project on which it will work for the remainder of the week. In this session, the group will establish a results chain for the chosen project. At the end of the session, each group will submit their results chain in electronic format to their moderator, using a Powerpoint template.
6:00 – 7:30 PM  Group Dinner(Welcoming)
 

Tuesday, December 4, 2012


9:00 – 9:30 AM  Measuring Impact - Introduction to the Parallel Sessions
- Benedicte de la Briere, World Bank
9:30 - 12:30 PM
(Parallel Session)
 
(Coffee Break
10:30 – 11:00)
 POLICYMAKER SESSION
- Benedicte de la Briere, (WB)
- Nazmul Chaudhury (WB)
 
  Measuring Impact I
  • Impact Evaluation
  • Efficacy vs.Scalability
  • Causality
 TECHNICAL SESSION
- Andrew Beath, World Bank
- Julieta Trias, World Bank
 
  Measuring Impact I:
  • Causal Inference
  • Experimental Design
12:30 - 2:00 PM  Lunch
2:00 - 2:30 PM
(Plenary Session)
 Plenary Exercise: Where in the World (Results from Exercise)
- Adam Ross, World Bank
2:30 - 4:00 PM
(Plenary Session)
 Using Impact Evaluation to inform HD Policy
Chair: Laura Rawlings, World Bank
 
 Evaluating the short-run impacts of a community-driven ECED project in Indonesia
- Amer Hasan, World Bank
 
 Evaluating the Impact of the Philippine Conditional Cash Transfer Program: Pantawid Pamilyang Pilipino Program
- Nazmul Chaudhury, World Bank
 
4:00 - 4:30 PM  Coffee Break
4:30 - 6:00 PM
(Group Session)
 Group Work II: Research Questions, Indicators and Data
Moderators: Impact Evaluation Specialists
 Each project group will continue to work on their chosen project. The group will determine the research questions to be answered by the impact evaluation and the corresponding indicators and data. The results will be recorded in the project’s Powerpoint template.
 
Wednesday, December 5, 2012

9:00 - 12:30 PM
(Parallel Session)
 
(Coffee Break 10:30 – 11:00)
 POLICYMAKER SESSION
- Benedicte de la Briere, (WB)
- Nazmul Chaudhury (WB)
 
  Measuring Impact II
  • Identification Strategies
  • Designing an Evaluation in an Operational Context
 TECHNICAL SESSION
- Andrew Beath, World Bank
- Julieta Trias, World Bank
 
  Measuring Impact II:
  • Difference in Difference
  • Regression Discontinuity
  • Matching
12:30 - 2:00 PM  Lunch
2:00 – 3:00 PM  Sampling and Power Calculations for Impact Evaluation
- Prateek Tandon, World Bank
3:00 - 4:30 PM
(Group Session)
 
 Group Work III: Telephone Campaigns to Encourage Child Vaccination (courtesy of MIT-JPAL)
Moderators: Impact Evaluation Specialists
 The theoretical concepts discussed in Day 2 and Day 3 in the policy and technical sessions will be reinforced through group work on a case study. The case study will focus on the various identification strategies and methodologies for constructing a counterfactual.
4:30 - 5:00 PM  Coffee Break
5:00 - 5:30 PM  Telephone Campaigns to Encourage Child Vaccination: Plenary discussion of Group Work III
5:30 - 6:30 PM  Evaluation Clinic – Group Work III
Moderators: Impact Evaluation Specialists
 
 Project teams will work in small groups, along with moderators, to design an impact evaluation strategy for their chosen project, They will also think through the sampling, rollout and other design issues. The proposed design will be recorded in the project’s Powerpoint template.


Thursday, December 6, 2012


9:00 - 10:30 AM  Cost Analysis for Impact Evaluation
- Benedicte de la Briere, World Bank
10:30 - 11:30 AM  Operational Issues: How to Incorporate Impact Evaluation into Projects
- Paul Gertler, University of California – Berkeley
11:30 - 11:45 AM  Coffee Break
11:45 - 12:30 PM  Evaluation Clinic – Group Work IV
Moderators: Impact Evaluation Specialists
            
 Project teams will work in small groups, along with moderators, to design an impact evaluation strategy for their chosen project, They will also think through the sampling, rollout and other design issues. The proposed design will be recorded in the project’s Powerpoint template
12:30 - 2:00 PM  Lunch
2:00 - 3:00 PM
(Group Session)
 Evaluation Clinic – Group Work V (Continued)
Moderators: Impact Evaluation Specialists
3:00 - 3:30 PM  Coffee Break
3:30 - 5:30 PM
(Plenary Session)
 Project Evaluation Proposals: Group Presentations
Moderators: Impact Evaluation Specialists
 
 Project teams will present their results to the plenary group using their Powerpoint template. Practical feedback on the designs, and implementation and monitoring arrangements will be given by the moderators and the other teams. Moderators will verify that the proposed impact evaluation design is robust and that a well specified process exists for mainstreaming the impact evaluation into project  implementation.
Each team will leave with a fully developed evaluation design and  implementation plan.
5:30 - 6:30 PM  Closing and Certificates
7:30 – 9:00 PM  Farewell Dinner
 
 

 


 

Resources