Evaluating Payments for Environmental Services: Methodological Challenges

Over the last fifteen years, Payments for Environmental Services (PES) schemes have become very popular environmental policy instruments, but the academic literature has begun to question their additionality. The literature attempts to estimate the causal effect of these programs by applying impact evaluation (IE) techniques. However, PES programs are complex instruments and IE methods cannot be directly applied without adjustments. Based on a systematic review of the literature, this article proposes a framework for the methodological process of designing an IE for PES schemes. It revises and discusses the methodological choices at each step of the process and proposes guidelines for practitioners.

• Publication year

  2016

• Venue

  PLoS ONE

• Publication date

  2016-02-24

• Fields of study

  Computer Science, Economics, Business, Environmental Science, Medicine

• Identifiers
  DOI 10.1371/journal.pone.0149374PMID 26910850PMCID 4766196
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• PES Impact and Leakages over Several Cohorts: The Case of the PSA-H in Yucatan, Mexico

  2017cited by this paper
• Assignment Procedure Biases in Randomised Policy Experiments

  2017cited by this paper
• How much deforestation do protected areas avoid in tropical Andean landscapes

  2016cited by this paper
• Mainstreaming Impact Evaluation in Nature Conservation

  2016cited by this paper
• REDD+ Impacts: Evidence from Nepal

  2015cited by this paper
• Implications of heterogeneous impacts of protected areas on deforestation and poverty

  2015cited by this paper
• International funding agencies: potential leaders of impact evaluation in protected areas?

  2015cited by this paper
• How Effective Are Biodiversity Conservation Payments in Mexico?

  2015cited by this paper
• Protected Areas’ Impacts on Brazilian Amazon Deforestation: Examining Conservation – Development Interactions to Inform Planning

  2015cited by this paper
• Reductions in emissions from deforestation from Indonesia’s moratorium on new oil palm, timber, and logging concessions

  2015cited by this paper
• Between economic loss and social identity: : The multi-dimensional cost of avoiding deforestation in eastern madagascar

  2015cited by this paper
• Protected area types, strategies and impacts in Brazil's Amazon: public protected area strategies do not yield a consistent ranking of protected area types by impact

  2015cited by this paper
• Integrating impact evaluation in the design and implementation of monitoring marine protected areas

  2015cited by this paper
• Paying smallholders not to cut down the amazon forest: impact evaluation of a REDD+ pilot project

  2015influential reference
• Through what mechanisms do protected areas affect environmental and social outcomes?

  2015cited by this paper
• Evaluating Interactions of Forest Conservation Policies on Avoided Deforestation

  2015cited by this paper
• Protected Area Effectiveness in European Russia: A Postmatching Panel Data Analysis

  2015cited by this paper
• Only One Tree from Each Seed? Environmental Effectiveness and Poverty Alleviation in Mexico's Payments for Ecosystem Services Program

  2015cited by this paper
• Motivation crowding by economic incentives in conservation policy: A review of the empirical evidence

  2015influential reference
• Leadership and the voluntary provision of public goods: Field evidence from Bolivia

  2015cited by this paper
• Achieving Conservation and Equity amidst Extreme Poverty and Climate Risk: The Makira REDD+ Project in Madagascar

  2015cited by this paper
• Effectiveness of Community Forest Management at reducing deforestation in Madagascar

  2015cited by this paper
• Estimating the Counterfactual Impact of Conservation Programs on Land Cover Outcomes: The Role of Matching and Panel Regression Techniques

  2015cited by this paper
• Social and Environmental Impacts of Forest Management Certification in Indonesia

  2015cited by this paper
• Naming and Shaming for Conservation: Evidence from the Brazilian Amazon

  2015cited by this paper
• Estimating the Impacts of Local Policy Innovation: The Synthetic Control Method Applied to Tropical Deforestation

  2015cited by this paper
• Revisiting the concept of payments for environmental services

  2015cited by this paper
• Production forests as a conservation tool: Effectiveness of Cameroon's land use zoning policy

  2015cited by this paper
• Do protected areas reduce blue carbon emissions? A quasi-experimental evaluation of mangroves in Indonesia

  2015influential reference
• Eco-certification and coffee cultivation enhance tree cover and forest connectivity in the Colombian coffee landscapes

  2014cited by this paper
• Governance, Location and Avoided Deforestation from Protected Areas: Greater Restrictions Can Have Lower Impact, Due to Differences in Location

  2014cited by this paper
• Assessing the Effect of Marine Reserves on Household Food Security in Kenyan Coral Reef Fishing Communities

  2014cited by this paper
• Local Effects of Payments for Environmental Services on Poverty

  2014cited by this paper
• Do Protected Areas Reduce Forest Fragmentation? A Microlandscapes Approach

  2014cited by this paper
• Protected Areas' Impacts Upon Land Cover Within Mexico: the need to add politics and dynamics to static land-use economics

  2014cited by this paper
• Impacts of Protected Areas on Local Livelihoods in Cambodia

  2014cited by this paper
• Evolving protected-area impacts in Panama: impact shifts show that plans require anticipation

  2014cited by this paper
• Improving Environmental and Social Targeting through Adaptive Management in Mexico's Payments for Hydrological Services Program

  2014cited by this paper
• Effects of Protected Areas on Forest Cover Change and Local Communities

  2014cited by this paper
• Du mésusage des métaphores. Les paiements pour services environnementaux sont-ils des instruments de marchandisation de la nature ?

  2014cited by this paper
• Have We Managed to Integrate Conservation and Development? ICDP Impacts in the Brazilian Amazon

  2014cited by this paper
• Effectiveness and synergies of policy instruments for land use governance in tropical regions

  2014cited by this paper
• Impact of payments for environmental services and protected areas on local livelihoods and forest conservation in northern Cambodia

  2014cited by this paper
• L' instrumentation de l'action publique : controverses, résistances, effets

  2014cited by this paper
• Do Protected Areas Reduce Forest Fragmentation? A Microlandscapes Approach

  2013cited by this paper
• Cash for Cooperation? Payments for Ecosystem Services and Common Property Management in Mexico

  2013cited by this paper
• Liquidity Constraints and Deforestation: The Limitations of Payments for Ecosystem Services

  2013cited by this paper
• Conditional Cash Transfers and Payments for Environmental Services—A Conceptual Framework for Explaining and Judging Differences in Outcomes

  2013cited by this paper
• High-Resolution Global Maps of 21st-Century Forest Cover Change

  2013cited by this paper
• Ecopayments and Deforestation in Costa Rica: A Nationwide Analysis of PSA’s Initial Years

  2013cited by this paper
• Heterogeneous treatment effects and mechanisms in information-based environmental policies: Evidence from a large-scale field experiment

  2013cited by this paper
• An evaluation of the effectiveness of a direct payment for biodiversity conservation: The Bird Nest Protection Program in the Northern Plains of Cambodia

  2013cited by this paper
• More strictly protected areas are not necessarily more protective: evidence from Bolivia, Costa Rica, Indonesia, and Thailand

  2013cited by this paper
• Payments for ecosystem services and the fatal attraction of win‐win solutions

  2013cited by this paper
• Ex-post Evaluation of Forest Conservation Policies Using Remote Sensing Data: An Introduction and Practical Guide

  2012cited by this paper
• Evaluation of biodiversity policy instruments: what works and what doesn't?

  2012influential reference
• Forest Conservation and Slippage: Evidence from Mexico’s National Payments for Ecosystem Services Program

  2012influential reference
• Impact of Community-Based Forest Management on Forest Protection: Evidence from an Aid-Funded Project in Ethiopia

  2012cited by this paper
• Do Payments for Environmental Services Affect Forest Cover? A Farm-Level Evaluation from Costa Rica

  2012influential reference
• Contrasting treatment‐specific survival using double‐robust estimators

  2012cited by this paper
• Conditions associated with protected area success in conservation and poverty reduction

  2011cited by this paper
• A Spatially Explicit Estimate of Avoided Forest Loss

  2011influential reference
• NBER WORKING PAPER SERIES INSTRUMENTS OF DEVELOPMENT: RANDOMIZATION IN THE TROPICS, AND THE SEARCH FOR THE ELUSIVE KEYS TO ECONOMIC DEVELOPMENT

  2011influential reference
• Evaluating land use and livelihood impacts of early forest carbon projects: Lessons for learning about REDD+

  2011cited by this paper
• The Future of Payments for Environmental Services

  2011cited by this paper
• Impact Evaluation in Practice, First Edition [La evaluación de impacto en la práctica]

  2011cited by this paper
• Payments for environmental services and development. Combining conservation incentives with investment

  2011cited by this paper
• Conservation and Development: Evidence from Thai Protected Areas

  2010cited by this paper
• Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program

  2010cited by this paper
• The Ecological Footprint of Poverty Alleviation: Evidence from Mexico's Oportunidades Program

  2010cited by this paper
• Impact Evaluation in Practice: Second Edition

  2010cited by this paper
• How much green for the buck? Estimating additional and windfall effects of French agro-environmental schemes by DID-matching

  2010influential reference
• Protected areas reduced poverty in Costa Rica and Thailand

  2010cited by this paper
• Global protected area impacts

  2010cited by this paper
• Technical guidelines for research on REDD+ project sites with survey instruments and code book

  2010cited by this paper
• Comparing IV With Structural Models: What Simple IV Can and Cannot Identify.

  2010influential reference
• Show Me the Money: Do Payments Supply Environmental Services in Developing Countries?

  2010cited by this paper
• Park Location Affects Forest Protection: Land Characteristics Cause Differences in Park Impacts across Costa Rica

  2009cited by this paper
• Agricultural Policy, Market Barriers, and Deforestation: The Case of Mexico’s Southern Yucatán

  2009cited by this paper
• Theory-based impact evaluation: principles and practice

  2009cited by this paper
• Institutional dimensions of Payments for Ecosystem Services: An analysis of Mexico's carbon forestry programme

  2009cited by this paper
• Upstream–downstream transactions and watershed externalities: Experimental evidence from Kenya

  2009cited by this paper
• Counterfactual thinking and impact evaluation in environmental policy

  2009cited by this paper
• Protected area effectiveness in reducing tropical deforestation : a global analysis of the impact of protection status

  2009cited by this paper
• Handbook on Impact Evaluation: Quantitative Methods and Practices

  2009cited by this paper
• Asymmetric information and contract design for payments for environmental services

  2008cited by this paper
• Some Practical Guidance for the Implementation of Propensity Score Matching

  2008cited by this paper
• Deforestation Impacts of Environmental Services Payments: Costa Rica’s PSA Program 2000–2005

  2008cited by this paper
• Private Provision of Public Goods: Applying Matching Methods to Evaluate Payments for Ecosystem Services in Costa Rica

  2008cited by this paper
• Payments for Environmental Services : Empirical analysis for Costa Rica

  2008cited by this paper
• Designing payments for ecosystem services: Lessons from previous experience with incentive-based mechanisms

  2008cited by this paper
• Evaluation in the Practice of Development

  2008influential reference
• Measuring the effectiveness of protected area networks in reducing deforestation

  2008cited by this paper
• A spatial analysis of common property deforestation

  2007cited by this paper
• Chapter 59 Evaluating Anti-Poverty Programs

  2007cited by this paper
• Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference

  2007cited by this paper
• Money for Nothing? A Call for Empirical Evaluation of Biodiversity Conservation Investments

  2006cited by this paper
• Evaluating Anti-Poverty Programs

  2005cited by this paper
• Semiparametric Difference-in-Differences Estimators

  2005cited by this paper
• Can Payments for Environmental Services Help Reduce Poverty? An Exploration of the Issues and the Evidence to Date from Latin America

  2005cited by this paper

• Deforestation dynamics post-payment for ecosystem services in Sierra Juárez, Oaxaca, Mexico

  2025cites this paper
• An emergy-based indicator framework for assessing regional ecosystem health and ecological service value: impacts of water conservancy projects

  2025cites this paper
• Overview of Publications on Payment for Environmental Services: Focus on Brazilian Contributions

  2024cites this paper
• Participatory Environmental Governance and Payments for Environmental Services: the Strategic Role of Universities

  2024cites this paper
• Evaluation analysis of the compensation payments schemes for ecosystem services: The case of Czech and Slovak Republic

  2024cites this paper
• Participation, anticipation effects and impact perceptions of two collective incentive-based conservation interventions in Ucayali, Peru

  2024cites this paper
• Evaluating the determinants of participation in conservancy land leases and its impacts on household wealth in the Maasai Mara, Kenya: Equity and gender implications

  2024cites this paper
• The Impact of Payments for Environmental Services in the Atlantic Forest: A Geospatial Study

  2024cites this paper
• O Impacto de Pagamentos de Serviços Ambientais na Mata Atlântica: Um Estudo Geoespacial

  2024cites this paper
• Quantifying population-level conservation impacts for a perpetual conservation program on private land.

  2023cites this paper
• Half-Century of Forest Change in a Neotropical Peri-Urban Landscape: Drivers and Trends

  2022cites this paper
• Does the Selective Erasure of Protected Areas Raise Deforestation in the Brazilian Amazon?

  2022cites this paper
• EU food-system transition requires innovative policy analysis methods

  2022cites this paper
• Evaluating the environmental effectiveness of payments for hydrological services in Veracruz, México: A landscape approach

  2021cites this paper
• Additionality and Leakage Resulting from PES Implementation? Evidence from the Ecuadorian Amazonia

  2021cites this paper
• A Framework for Analysing Ecological Fiscal Transfers: Case Studies from the Brazilian Atlantic Forest

  2021cites this paper
• Adaptive management of jurisdictional REDD + programs: a methodology illustrated for Ecuador

  2021cites this paper
• Estimation of the Rational Range of Ecological Compensation to Address Land Degradation in the Poverty Belt around Beijing and Tianjin, China

  2021cites this paper
• Measurement of total factor productivity of green agriculture in China: Analysis of the regional differences based on China

  2021cites this paper
• Impacts of Payment for Forest Environmental Services in Cat Tien National Park

  2021cites this paper
• Conservation basic income: A non-market mechanism to support convivial conservation

  2020cites this paper
• Effectiveness of Costa Rica’s Conservation Portfolio to Lower Deforestation, Protect Primates, and Increase Community Participation

  2020cites this paper
• Biodiversity and ecosystem services in tropical forests: the role of forest allocations in the Dja area, Cameroon

  2020cites this paper
• KESEDIAAN MASYARAKAT MENERIMA PEMBAYARAN JASA LINGKUNGAN AIR: KASUS DAS WAY SEMAKA KABUPATEN TANGGAMUS

  2020cites this paper
• Scale and landscape features matter for understanding the performance of large payments for ecosystem services

  2020cites this paper
• Do forest-management plans and FSC certification help avoid deforestation in the Congo Basin?

  2020cites this paper
• The politics of numbers and additionality governing the national Payment for Forest Environmental Services scheme in Vietnam: A case study from Son La province

  2020cites this paper
• Do forest-management plans and FSC certification reduce deforestation in the Congo basin?

  2019cites this paper
• Payment for ecosystem services programs in the Brazilian Atlantic Forest: Effective but not enough

  2019cites this paper
• Learning from Failure: Lessons from a Forest Based Carbon and Charcoal Project

  2019cites this paper
• Guideline framework for effective targeting of payments for watershed services

  2019cites this paper
• A regional evaluation of the effectiveness of Mexico’s payments for hydrological services

  2019cites this paper
• Incentives for climate mitigation in the land use sector—the effects of payment for environmental services on environmental and socioeconomic outcomes in low‐ and middle‐income countries: A mixed‐methods systematic review

  2019cites this paper
• Households' Preferences and Willingness to Pay for Hydrological Services in Veracruz, Mexico

  2019cites this paper
• Using Foresight to Gain a Local Perspective on the Future of Ecosystem Services in a Mountain Protected Area in Peru

  2018cites this paper
• Payments for Watershed Services and Practices in China: Achievements and Challenges

  2018cites this paper
• Evaluating the effectiveness of policy instruments for biodiversity: Impact evaluation, cost-effectiveness analysis and other approaches

  2018influential citation
• Assessing The Effectiveness Of Payment For Ecosystem Services In Kenya: A Case Study Of Lake Naivasha Basin

  2018cites this paper
• A tale of REDD+ projects. How do location and certification impact additionality?

  2018cites this paper
• Can ecological fiscal transfers contribute to conservation and well-being? An examination of local interactions in the Atlantic forest region of Brazil

  2018cites this paper
• PROTOCOL: Incentives for climate mitigation in the land use sector: a mixed‐methods systematic review of the effectiveness of payment for environment services (PES) on environmental and socio‐economic outcomes in low‐ and middle‐income countries

  2018cites this paper
• Spatial analysis of ecosystem service relationships to improve targeting of payments for hydrological services

  2018influential citation
• The Different Dimensions of Livelihood Impacts of Payments for Environmental Services (PES) Schemes: A Systematic Review

  2018cites this paper
• ASSESSMENT OF PAYMENT FOR ECOSYSTEM SERVICES IN SASUMUA CATCHMENT, KENYA

  2017cites this paper
• Assessing the effectiveness of payments for environmental services in improving community-based forest conservation in Chiapas, Mexico /

  2017cites this paper
• Heterogeneous Impact of a Collective Payment for Environmental Services Scheme on Reducing Deforestation in Cambodia

  2017cites this paper
• PES Impact and Leakages over Several Cohorts: The Case of the PSA-H in Yucatan, Mexico

  2017cites this paper
• Evaluation of the impacts of Forest Stewardship Council ( FSC ) certification of natural forest management in the tropics : a rigorous approach to assessment of a complex conservation intervention

  2017cites this paper
• Emerging Evidence on the Effectiveness of Tropical Forest Conservation

  2016cites this paper
• Watershed-based payment for ecosystem services in Liberia: Examining prospects and challenges for implementation in the St. Paul River Basin

  2016cites this paper
• The Effectiveness of Payments for Environmental Services in Mexican Community Forests

  2015cites this paper