The Program Sustainability Assessment Tool: A New Instrument for Public Health Programs

Introduction Public health programs can deliver benefits only if they are able to sustain programs, policies, and activities over time. Although numerous sustainability frameworks and models have been developed, there are almost no assessment tools that have demonstrated reliability or validity or have been widely disseminated. We present the Program Sustainability Assessment Tool (PSAT), a new and reliable instrument for assessing the capacity for program sustainability of various public health and other programs. Methods A measurement development study was conducted to assess the reliability of the PSAT. Program managers and staff (n = 592) representing 252 public health programs used the PSAT to rate the sustainability of their program. State and community-level programs participated, representing 4 types of chronic disease programs: tobacco control, diabetes, obesity prevention, and oral health. Results The final version of the PSAT contains 40 items, spread across 8 sustainability domains, with 5 items per domain. Confirmatory factor analysis shows good fit of the data with the 8 sustainability domains. The subscales have excellent internal consistency; the average Cronbach’s α is 0.88, ranging from 0.79 to 0.92. Preliminary validation analyses suggest that PSAT scores are related to important program and organizational characteristics. Conclusion The PSAT is a new and reliable assessment instrument that can be used to measure a public health program’s capacity for sustainability. The tool is designed to be used by researchers, evaluators, program managers, and staff for large and small public health programs.

• Publication year

  2014

• Venue

  Preventing Chronic Disease

• Publication date

  2014-01-23

• Fields of study

  Medicine, Environmental Science

• Identifiers
  DOI 10.5888/pcd11.130184PMID 24456645PMCID 3900326
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Using the Program Sustainability Assessment Tool to Assess and Plan for Sustainability

  2014cited by this paper
• Linking sustainability research to intervention types.

  2013cited by this paper
• Public health program capacity for sustainability: a new framework

  2013influential reference
• Large-system transformation in health care: a realist review.

  2012cited by this paper
• Dissemination and implementation research in health : translating science to practice

  2012cited by this paper
• lavaan: An R Package for Structural Equation Modeling

  2012influential reference
• An agenda for research on the sustainability of public health programs.

  2011influential reference
• Implementation Research in Mental Health Services: an Emerging Science with Conceptual, Methodological, and Training challenges

  2008cited by this paper
• Confirmatory Factor Analysis for Applied Research

  2006cited by this paper
• Is Sustainability Possible? A Review and Commentary on Empirical Studies of Program Sustainability

  2005cited by this paper
• Effect of the Number of Variables on Measures of Fit in Structural Equation Modeling

  2003cited by this paper
• MEASUREMENTS , INSTRUMENTS , SCALES , TESTS ASSESSING THE DIVERSITY OF PERSONAL BELIEFS ABOUT ADDICTION : DEVELOPMENT OF THE ADDICTION BELIEF INVENTORY

  2003cited by this paper
• Organizational Characteristics of Successful Innovative Health Care Programs Sustained Over Time

  2003cited by this paper
• Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy.

  1998cited by this paper
• Fit indices in covariance structure modeling : Sensitivity to underparameterized model misspecification

  1998cited by this paper
• Structural equation modeling: concepts, issues, and applications

  1997cited by this paper
• Uses and abuses of coefficient alpha.

  1996cited by this paper
• Factor analysis in the development and refinement of clinical assessment instruments.

  1995cited by this paper
• Evaluating model fit.

  1995cited by this paper
• An introduction to concept mapping for planning and evaluation.

  1989cited by this paper

• Collection of implementation-related data in pragmatic clinical trials: a cross-sectional study from the NIH Pragmatic Trials Collaboratory.

  2026cites this paper
• Have changes in practice in response to COVID-19 been sustained? A qualitative study of experiences and perceptions of health system stakeholders in Colombia.

  2026cites this paper
• Halk Sağlığı Usul ve Üslubu Beşinci Kitap - Tanzim

  2026cites this paper
• Cultural adaptation and designing for program dissemination and sustainability with Latinas with overweight/obesity at risk for binge eating disorder

  2026cites this paper
• Embedding research in practice: enablers, challenges and pathways to sustainability for embedded health researchers in Canada.

  2026cites this paper
• Psychometric properties of the Clinical Sustainability Assessment Tool (CSAT) short form across three research centers evaluating effectiveness and implementation of a cancer symptom surveillance and management intervention

  2026cites this paper
• Toward sustainable interventions for enhancing vigilance: A scoping review

  2026cites this paper
• Protocol for a process and implementation evaluation of the SMARThealth pregnancy hybrid type 2 cluster randomised controlled trial.

  2026cites this paper
• Protocol for a hybrid type I randomized controlled trial evaluating the effectiveness and implementation of a nurse home visiting program for adolescent pregnancy on maternal and infant outcomes

  2025cites this paper
• Clinical Establishment Act Implementation in Kamrup District, Assam: A Multi-dimensional Analysis of the First DHR Registration in Northeast India

  2025cites this paper
• The sustainability of health interventions implemented in Africa: an updated systematic review on evidence and future research perspectives

  2025cites this paper
• Implementation outcomes of the IMARA-South Africa mother-daughter HIV/STI prevention intervention: A mixed-methods study

  2025cites this paper
• Maintain the gains: methods to evaluate the sustainability and scalability of HIV-related prevention, care, and treatment programs.

  2025cites this paper
• Barriers and Facilitators to Program Evaluation and Dissemination: A Qualitative Study to Inform Implementation Strategies.

  2025cites this paper
• Implementing LGBTQ-affirmative CBT: study protocol for an effectiveness-implementation trial at 90 LGBTQ community centers

  2025cites this paper
• Scaling-up an mHealth system to deliver financial incentives to improve adherence to antiretroviral therapy in Tanzania

  2025cites this paper
• A randomized controlled trial of a family-based HIV/STI prevention program for Black girls and male caregivers in Chicago: IMAGE study protocol paper

  2025cites this paper
• Planning for the sustainability of a youth suicide prevention program in Native American contexts: A modeling study.

  2025cites this paper
• Évaluation de projets visant à favoriser l’accès à la saine alimentation, financés dans le cadre de la mesure 3.1 de la Politique gouvernementale de prévention en santé

  2025cites this paper
• Implementing Patient Navigation for Children With CKD

  2025cites this paper
• Implementation and Effectiveness of the Healthy Weight Clinic Type III Hybrid Trial: Massachusetts CORD 3.0.

  2025cites this paper
• Beyond Survival: Harnessing Sustainability Frameworks to Assess and Support Programs Implementing Bundled Interventions for Black Women With HIV.

  2025cites this paper
• Scaling up home‐visiting to promote early childhood development and prevent violence in Rwanda: a hybrid type‐2 effectiveness‐implementation trial

  2025cites this paper
• Sustainable chronic disease prevention at scale: Evaluation of the Get Healthy Service, a telephone and online coaching service.

  2025cites this paper
• Empowering safety managers to champion the implementation of smoking cessation services in the construction industry: Protocol for a sequential multiple assignment randomized trial.

  2025cites this paper
• Rationale and Protocol Design for the Adaptation and Implementation of a Patient Navigation Program for Cervical Cancer Screening Across Contexts in Senegal

  2025cites this paper
• Study design and procedures for a hybrid effectiveness-implementation incomplete stepped-wedge cluster-randomized trial to evaluate a differentiated point-of-care HIV diagnosis and management model for the prevention of vertical transmission of HIV in Malawi: The PAC-Man trial protocol

  2025cites this paper
• Leveraging infant visit PrEP screening INtegration & tasK shifting to improve post-partum HIV prevention in Malawi (LINK): a cluster-randomized trial evaluation of a postpartum HIV prevention package among breastfeeding women in Malawi

  2025cites this paper
• Implementation determinants of safer smoking supplies in U.S. syringe services programs

  2025cites this paper
• Implementation Factors Influencing Peer-Delivered Behavioral Evidence-Based Interventions for Substance Use Disorders: A Scoping Review

  2025cites this paper
• Exploring a One Health approach to sustainability with international One Health and Global Health Security experts – differences, similarities and trade-offs between sectors

  2025cites this paper
• Evaluating the Implementation and Maintenance of a Breast Cancer Risk-Assessment and Prevention Program

  2025cites this paper
• FAMily Motivational Engagement Strategy (FAMES) for coordinated specialty care programs: study protocol to evaluate a culturally responsive engagement intervention and equity focused implementation strategies in a hybrid type 2 randomized stepped-wedge trial

  2025cites this paper
• Using implementation mapping to optimize the impact of Universal School meals: a type III hybrid implementation-effectiveness study protocol

  2025cites this paper
• Rapid Adaptation to Prevent Drug Use (RAPD): protocol of a pilot randomized trial to enhance the impact of an evidence-based intervention for youth

  2025cites this paper
• Improving the Sustainability of Public Health Interventions: The INNOVATE Model

  2025cites this paper
• Toward the sustainability of health care innovations to “transform our world”: current status and the road ahead

  2025cites this paper
• Qualitative Outcomes of Colorectal Cancer Screening Outreach Using Patient Navigation to Follow-Up Colonoscopy in Rural Primary Care Practices

  2025cites this paper
• A Scoping Review of Noncommunicable Disease Programs Evaluation: Bridging Gaps and Improving Frameworks in Primary Healthcare

  2025cites this paper
• Sustainment and adaptation of systems navigation and psychosocial counseling across HIV testing clinics in Vietnam: A qualitative assessment

  2025cites this paper
• Implementation and Sustainability of Hospital-based Addiction Consultation Services

  2025cites this paper
• Methodological description of knowledge translation: Implementation of clinical practice guidelines into clinical practice

  2025cites this paper
• Sustainability of fall prevention exercise programmes for community-dwelling older adults: a scoping review protocol

  2025cites this paper
• “But Will It Last?”: Examining How Pharmacy Staff Perceptions Influence Beliefs About the Sustainability of a Pharmacy-Based Intervention Targeting Older Adult Over-the-Counter (OTC) Medication Misuse

  2025cites this paper
• Evaluating the feasibility of technology-based interventions in disability and rehabilitation: Definitions, considerations, and dimensions. (Preprint)

  2025cites this paper
• Evaluating the World Health Organization’s Hearts Model for Hypertension and Diabetes Management: A Pilot Implementation Study in Guatemala

  2025cites this paper
• Implementation Mapping to Identify Best Practices for Implementing Population-Wide Genomic Screening Programs: Protocol for the FOCUS (Facilitating the Implementation of Population-Wide Genomic Screening) Study

  2025cites this paper
• Toward a Framework for Understanding Information Systems Degree Program Sustainability

  2025influential citation
• Implementation of two transdiagnostic interventions based on emotional regulation for professionals who treat alcohol addiction in the Spanish mental health system: A multicenter mixed methods pilot study protocol

  2025cites this paper
• Sustainability of Rideshare Programs to Promote Engagement of Underrepresented Populations in Breast Cancer Screening Trials.

  2025cites this paper
• “You need to know that you are not alone”: the sustainability of community-based dance programs for people living with Parkinson’s disease

  2025cites this paper
• Sustainability in translational genomics research with undiagnosed patients: What is it, why do we need it, and how do we do it?

  2025cites this paper
• Pilot optimization trial of a sexual and reproductive health program for Latina teens and their female caregivers: A study protocol

  2025cites this paper
• Characterisation of At‐Scale Community Health Interventions Aimed to Improve Healthy Eating Behaviour in Australia: A Rapid Review

  2025cites this paper
• A cross-sectional study assessing barriers and facilitators to the sustainability of physical activity and nutrition interventions in early childhood education and care settings

  2025cites this paper
• How can cities accelerate, support and evaluate actions for active movement for health: protocol for CITY-MOVE, a multicase implementation research study in six cities in three continents

  2025cites this paper
• Translating malnutrition care from the hospital to the community setting.

  2024cites this paper
• Sustaining sexual health programs: practical considerations and lessons from the President's Emergency Plan for AIDS Relief.

  2024cites this paper
• The Role of Implementation Climate in Moderating Educator Use of Evidence-Based Practices and Outcomes for Autistic Students

  2024influential citation
• Examining the Sustainability of Core Capacity and Evidence-Based Interventions for FIT-Based CRC Screening: California Colorectal Cancer Control Program

  2024cites this paper
• A Science-Informed Sustainability Readiness Strategy to Sustain Health-Related Community Coalitions

  2024cites this paper
• Incorporating implementation science principles into curricular design

  2024cites this paper
• Supporting Teams with Designing for Dissemination and Sustainability: the Design, Development, and Usability of a Digital Interactive Platform

  2024cites this paper
• Integrated Measure of PRogram Element SuStainability in Childcare Settings (IMPRESS-C): development and psychometric evaluation of a measure of sustainability determinants in the early childhood education and care setting

  2024cites this paper
• Evaluating the tailored implementation of a multisite care navigation service for mental health in rural and remote Australia (The Bridging Study): protocol for a community-engaged hybrid effectiveness-implementation study

  2024cites this paper
• A Hybrid Type 1 trial of a multi-component mHealth intervention to improve post-hospital transitions of care for patients with serious mental illness: Study protocol.

  2024cites this paper
• Applying health equity implementation science frameworks to population genetic screening

  2024cites this paper
• Leveling Up PrEP: Implementation Strategies at System and Structural Levels to Expand PrEP Use in the United States

  2024cites this paper
• Advancing Translation of Clinical Research Into Practice and Population Health Impact Through Implementation Science.

  2024cites this paper
• Improving safety and preventing falls using an evidence-based, front-line staff huddling practice: protocol for a pragmatic trial to increase quality of care in State Veterans Homes

  2024cites this paper
• iCogCA to Promote Cognitive Health Through Digital Group Interventions for Individuals Living With a Schizophrenia Spectrum Disorder: Protocol for a Nonrandomized Concurrent Controlled Trial

  2024cites this paper
• Barriers and Facilitators to Program Sustainability Among State Tobacco Control Programs

  2024cites this paper
• Sustainability Planning for a Community Network to Increase Participation in Evidence-Based Lifestyle Change Programs: A Mixed-Methods Approach

  2024influential citation
• Sustaining the collaborative chronic care model in outpatient mental health: a matrixed multiple case study

  2024cites this paper
• A systematic review to determine the effect of strategies to sustain chronic disease prevention interventions in clinical and community settings: study protocol

  2024cites this paper
• Methods for scaling up an outreach intervention to increase colorectal cancer screening rates in rural areas

  2024cites this paper
• Supporting teams with designing for dissemination and sustainability: the design, development, and usability of a digital interactive platform

  2024cites this paper
• An Analysis of National Institutes of Health-Funded Dissemination and Implementation Research in Low- and Middle-Income Countries

  2024cites this paper
• Advancing implementation science in community settings: the implementation strategies applied in communities (ISAC) compilation

  2024cites this paper
• Implementation and sustainability of best practice guidelines: a tale of three hospitals.

  2024cites this paper
• Implementing integrated hypertension and diabetes management using the World Health Organization’s HEARTS model: protocol for a pilot study in the Guatemalan national primary care system

  2024cites this paper
• Evaluating the World Health Organization’s HEARTS Model for Hypertension and Diabetes Management: A Pilot Implementation Study in Guatemala

  2024cites this paper
• Lowering the burden: Shorter versions of the Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT)

  2024cites this paper
• Evaluating Age-Friendly Health Care Approaches in Rural Primary Care Settings: A Multi-Case, Mixed-Methods Hybrid Type 2 Effectiveness-Implementation Study

  2024cites this paper
• A mixed-methods, theory-driven assessment of the sustainability of a multi-sectoral preventive intervention for South Asian Americans at risk for cardiovascular disease

  2024influential citation
• Collaborative sustainability planning for an outcome measure in outpatient stroke rehabilitation: A qualitative description study.

  2024cites this paper
• What happens after the funding ends?: A qualitative sustainability investigation of emergency department-based peer support programs implemented as part of Indiana's opioid state targeted response initiative.

  2024cites this paper
• Implementation characteristics that may promote sustainability of a rural physical activity initiative: examination of Play Streets through the lens of community implementers

  2024cites this paper
• The Commit to Be Fit framework: a community case study of a multi-level, holistic school-based wellness initiative in rural Virginia

  2023cites this paper
• “I decided to participate….because I saw it as benefiting our community and families”: a qualitative study of lay providers’ experiences with delivering an evidence-based mental health intervention for families in Uganda

  2023cites this paper
• Using the project ECHO™ model to teach mental health topics in rural Guatemala: An implementation science-guided evaluation

  2023cites this paper
• A systematic review to determine the effect of strategies to sustain chronic disease prevention interventions in clinical and community settings: study protocol

  2023cites this paper
• Cascade of Care in the Legal System: Best Practices and Goals for Agencies Providing Care to Patients Concurrently Navigating Substance Use Disorders and Criminal Legal Involvement

  2023cites this paper
• “Now is the time for institutions to be investing in growing exercise programs as part of standard of care”: a multiple case study examining the implementation of exercise oncology interventions

  2023cites this paper
• Evaluating the translation of implementation science to clinical artificial intelligence: a bibliometric study of qualitative research

  2023cites this paper
• Sustainability capacity and health worker normalisation of a successful non-communicable disease (NCD) health systems intervention within primary care settings in Uganda: a quantitative approach to a qualitative question

  2023influential citation
• Dissemination, Implementation, and Evaluation of an Effective School-Based Intervention to Promote Physical Activity in Adolescents: A Study Protocol

  2023cites this paper
• Emergency manual peri-crisis use six years following implementation: Sustainment of an intervention for rare crises.

  2023cites this paper
• A conceptual model for building program sustainability in public health settings: Learning from the implementation of the program sustainability action planning model and training curricula

  2023cites this paper
• A Community Paramedic Clinic at a Day Center for Adults Experiencing Homelessness

  2023cites this paper