Rigorous Impact Evaluation in Europe

Torino, Italy
May 20-22, 2018

 

Sunday, May 20
 
19:30

Business Dinner
Ristorante Solferino
Hosted by Collegio Carlo Alberto

Welcome and Introductions:
Douglas J. Besharov, University of Maryland and Atlantic Council
Petro Terna, Collegio Carlo Alberto (TBC)

Rigorous Impact Evaluation: The Impact Assessment Office of the Italian Senate
Sen. Laura Bottici, Questore del Senato della Repubblica

Open Discussion

Monday, May 21
9:00-9:10

Opening Remarks
Douglas J. Besharov, University of Maryland and Atlantic Council

9:10-9:55

Impact Evaluation at Cross National Organizations

Policy Evaluation at the OECD
Stefano Scarpetta,
Organisation for Economic Co-operation and Development

Reactors: Massamiliano Bratti, Competence Centre on Microeconomic Evaluation, European Commission and Universita di Milato; and Neil Gilbert, University of California, Berkeley (invited)

9:55-10:40

The International Audience for Policy Research Methods and Results
Jacob Klerman,
Abt Associates and Editor, Evaluation Review (video link)

 
10:40-11:00

Coffee Break

11:00-11:45

Rigorous Impact Evaluation in Europe? Motives for Optimism and Reasons for Pessimism
Alberto Martini, Universita del Piemonte Orientale

11:45-12:30

Impact Evaluation without a(n) (Expressed) Counterfactual
Douglas J. Besharov, University of Maryland and Atlantic Council


12:30-14:00

Systematic Reviews

Chair: David Meyers, American Institutes for Research

The Four Waves of the Evidence Revolution: Lessons and Challeneges for Research and Policy
Howard White, Campbell Collaboration (Video Link)

Federal Efforts to Build Evidence Base on Teen Pregnancy Prevention in the United States
Amy Feldman Farb, US Department of Health and Human Services

(Meta Evaluation) -- Or: What Can We Learn fro Meta-Evaluations and Systematic Reviews?
Stefan Silvestrini, Center for Evaluation


Sunday, May 20
15:20-16:40

Parallel Panels I

Panel 1: Workforce Development

Chair: Stephen H. Bell, Westat

Does Federally-Funded Job Training Work? Non-Experimental Estimates of WIA Training Impacts Using Longitudinal Data on Workers and Firms
Jeffrey Smith, University of Wisconsin

Lower Caseload of Placement Officers and Unemployment Outcomes -- New Evidence from a Randomized Control Trial
Helmut Mahringer, Austrian Institute of Economic Research

'Private Good, Public Bad?' Delivering UK Employment Programmes for Disabled People
Bruce Strafford, University of Nottingham

 

Panel 2: Elementary/Primary Education

Chair: Daniela del Boca, Universita di Torino and Collegio Carlo Alberto (invited)

Financial Literacy and Saving Attitudes of Primary School Children, The Joint Effect of Formal Training and Domestic Financial Education
Flavia Coda Moscarola, Compagnia di San Paolo and Collegio Carlo Alberto

Parental Love is Not Blind
Ainhoa Aparico Fenoll, Collegio Carlo Alberto

High Dosage Math Tutoring in Rotterdam: A Randomization SAGA
Mario Maggioni, Universita Cattolica del Sacro Cuore

16:40-17:00

Coffee Break

17:00-18:20

Parallel Panels II

Panel 3: Welfare Polices and Unemployment

Chair: Elsa Fornero, Universita di Torino (invited)

The Impact of Welfare Reform on Single Parent Employment in the UK (2008-2014)
Anthony Rafferty, Work and Equalities Institute, Alliance Manchester Business School

Disability Status and Long-Term Employment Outcomes: The Case of Italian Injured Workers
Lia Pacelli, Universita di Torino

Conditional Cash Transfers and Family Well-Being
Chiara Pronzato, Universita di Torino and Collegio Carlo Alberto

 

Panel 4: Employment Protection and Contracts

Chair: Lia Pacelli, Universita di Torino (invited)

Employment Protection, Temporary Contracts and Firm-Provided Training: Evidence from Italy
Massimiliano Bratti, Competence Centre on Microeconomic Evaluation, European Commission and Universita di Milano

Young In, Old Out? Evidence from a Reform
Chiara Ardito, Universita di Torino

Employment Protection Legislation and Mismatch: Evidence from a Reform
Fabio Berton, Universita di Torino

19:45

Business Dinner
Circolo dei Lettori
Hosted by Collegio Carlo Alberto

Better, Quicker, Cheaper Impact Evaluations to Inform Public Policy and Improve Practice: Lessons (for Europe) from Half a Century of Experience in the United States
Rebecca Maynard, University of Pennsylvania

Tuesday, May 22
9:30-9:35

Opening
Douglas J. Besharov, University of Maryland and Atlantic Council

9:35-10:20

The Implications of Heterogeneity for Internal and External Validity
Jeffrey Smith, University of Wisconsin

10:20-11:05

Regional Economic Development Policies. A Second Look at Discontinuity Designs
Daniele Bondonio, Universita del Piemonte Orientale

11:20-12:40

Parallel Panels III

Panel 5: Challenges and Strategies for Evaluating Policies Targeting Refugees and Migrants

Chair: David Seidenfeld, American Institutes for Research

The Impact of Multimedia Toolkits on Refugee and Vulnerable Host Populations: Evidence from Jordan
Thomas de Hoop, American Institutes for Research

Economic Transfers and Social Cohesion in a Refugee Housing Setting
Elsa Valli, United Nations Children's Fund (UNICEF)

No Lost Generation: Supporting the School Participation of Displaced Syrian Children in Lebanon
Jacobus de Hoop, UNICEF, Mitchell Morey, American Institutes for Research, and David Seidenfeld, American Institutes for Research (presenting)

 

Panel 6: Secondary and Post-Secondary Education

Chair: Douglas Call, University of Maryland

Testing a Social Innovation that Provides Financial Aid to Low-Income Students: Lessons from an EU-Funded Randomised Controlled Trial Conducted in Italy
Barbara Romano, Associazione per lo Sviluppo della Valutazuine e l'Analisi delle Politiche Pubbliche (ASVAPP)

Repetita Luvant? Lessons from Repeated RCT's on the Effectiveness of a Teacher Professional Development Program
Gianluca Argentin, Universita Cattolica del Sacro Cuore

Let's Tweet Again? Social Networks and Grades in Literature of High School Students. Results of a Randomized Contolled Trial
Gian Paolo Barbetta, Universita Cattolica del Sacro Cuore

12:40-14:00 Lunch
14:00-14:45

Difficulties in Cross-National Generalizability of Education Evaluations
Eric Hanushek, Stanford University

14:45-15:45

Addressing Cross-National Generalizability in Impact Evaluation

Chair: Eric Hanushek, Stanford University

External Validity Bias in Cross-National Generalization of Findings from Experimental Impact Evaluations: Causes, Consequences, and Cures
Stephen H. Bell, Westat

Regional Programme Evaluation: Challenges and Perspectives
Guido de Blasio, Banca d'Italia

15:45-16:00 Coffee Break
16:00-17:00

Parallel Panels IV

Panel 7: Economic Growth/Development

Chair: Helmut Mahringer, Austrian Institute of Economic Research (tentative)

Does EU Enterprise Support Boost High Quality Jobs? Evidence from Linked Employer-Employee Microdata and Natural Experiment Conditions
Daniele Bondonio, Universita del Piemonte Orientale

Broadband Diffusion and Firm Performance in Rural Areas: Quasi-Experimental Evidence
Giulia Canzian, Competence Centre on Microeconomic Evaluation, European Commission

Panel 8: Issues and Approaches to Conducting Rigorous Impact Evaluation in Europe

Chair: Jeffrey Smith, University of Wisconsin

Counterfactual Impact Evaluation and Policy -- Challenges Revisted
Rachel Kahlert, European Centre for Social Welfare Policy and Research

Achieving Rigorous Impact Evaluation Through Conceptual Clarity and Coherence
Alison Wells, University of Cambridge

 

To view Torino Meeting Agenda in PDF version, please click here.