Abstract Background Proctor and colleagues’ 2011 paper proposed a taxonomy of eight implementation outcomes and challenged the field to address a research agenda focused on conceptualization, measurement, and theory building. Ten years later, this paper maps the field’s progress in implementation outcomes research. This scoping review describes how each implementation outcome has been studied, research designs and methods used, and the contexts and settings represented in the current literature. We also describe the role of implementation outcomes in relation to implementation strategies and other outcomes. Methods Arksey and O’Malley’s framework for conducting scoping reviews guided our methods. Using forward citation tracing, we identified all literature citing the 2011 paper. We conducted our search in the Web of Science (WOS) database and added citation alerts sent to the first author from the publisher for a 6-month period coinciding with the WOS citation search. This produced 1346 titles and abstracts. Initial abstract screening yielded 480 manuscripts, and full-text review yielded 400 manuscripts that met inclusion criteria (empirical assessment of at least one implementation outcome). Results Slightly more than half (52.1%) of included manuscripts examined acceptability. Fidelity (39.3%), feasibility (38.6%), adoption (26.5%), and appropriateness (21.8%) were also commonly examined. Penetration (16.0%), sustainability (15.8%), and cost (7.8%) were less frequently examined. Thirty-two manuscripts examined implementation outcomes not included in the original taxonomy. Most studies took place in healthcare (45.8%) or behavioral health (22.5%) organizations. Two-thirds used observational designs. We found little evidence of progress in testing the relationships between implementation strategies and implementation outcomes, leaving us ill-prepared to know how to achieve implementation success. Moreover, few studies tested the impact of implementation outcomes on other important outcome types, such as service systems and improved individual or population health. Conclusions Our review presents a comprehensive snapshot of the research questions being addressed by existing implementation outcomes literature and reveals the need for rigorous, analytic research and tests of strategies for attaining implementation outcomes in the next 10 years of outcomes research. 

Ten years of implementation outcomes research: a scoping review

OBJECTIVE
To provide guiding principles and recommendations for how approaches from the field of dissemination and implementation (D&I) science can advance healthcare equity.


DATA SOURCES AND STUDY SETTING
This article, part of a special issue sponsored by the Agency for Healthcare Research and Quality (AHRQ), is based on an outline drafted to support proceedings of the 2022 AHRQ Health Equity Summit and further revised to reflect input from Summit attendees.


STUDY DESIGN
This is a narrative review of the current and potential applications of D&I approaches for understanding and advancing healthcare equity, followed by discussion and feedback with Summit attendees.


DATA COLLECTION/EXTRACTION METHODS
We identified major themes in narrative and systematic reviews related to D&I science, healthcare equity, and their intersections. Based on our expertise, and supported by synthesis of published studies, we propose recommendations for how D&I science is relevant for advancing healthcare equity. We used iterative discussions internally and at the Summit to refine preliminary findings and recommendations.


PRINCIPAL FINDINGS
We identified four guiding principles and three D&I science domains with strong promise for accelerating progress toward healthcare equity. We present eight recommendations and more than 60 opportunities for action by practitioners, healthcare leaders, policy makers, and researchers.


CONCLUSIONS
Promising areas for D&I science to impact healthcare equity include the following: attention to equity in the development and delivery of evidence-based interventions; the science of adaptation; de-implementation of low-value care; monitoring equity markers; organizational policies for healthcare equity; improving the economic evaluation of implementation; policy and dissemination research; and capacity building.

https://onlinelibrary.wiley.com/doi/pdfdirect/10.1111/1475-6773.14175

Advancing healthcare equity through dissemination and implementation science.

Testing a Theory of Implementation Leadership and Climate Across Autism Evidence-Based Interventions of Varying Complexity.

Efforts to improve mental health treatment delivery come at a time of rising inequality and cuts or insufficient increases to mental health funding. Public mental health clinicians face increased demands, experience economic stress, and treat underresourced patients disproportionately burdened by trauma. The authors sought to understand clinicians' current economic and psychological conditions and the relationship of these conditions to the delivery of an evidence-based intervention (EBI) designed to treat posttraumatic stress disorder among youths.In July 2020, 49 public mental health clinicians from 16 Philadelphia clinics who were trained in an EBI, trauma-focused cognitive-behavioral therapy (TF-CBT), were surveyed by e-mail. Respondents reported on their economic precarity, financial strain, burnout, secondary traumatic stress (i.e., the stress response associated with caring for people exposed to trauma), and TF-CBT use. Associations between clinicians' job-related stressors and their use of TF-CBT were examined with mixed models. Content coding was used to organize clinicians' open-ended responses to questions regarding financial strain related to the COVID-19 pandemic.Clinicians' economic precarity, financial strain, and job-related stress were high; 37% of clinicians were independent contractors, 44% of whom wanted a salaried position. Of 37 clinicians with education debt, 38% reported owing ≥$100,000. In the past year, 29% of clinicians reported lack of personal mental health care because of cost, and 22% met the cutoff for experiencing secondary traumatic stress symptoms. Education debt was negatively associated with use of TF-CBT (p<0.001).The stress of providing care in underresourced clinical settings may interfere with efforts to integrate scientific evidence into mental health care. 

Economic Precarity, Financial Strain, and Job-Related Stress Among Philadelphia’s Public Mental Health Clinicians

Abstract Background Theory and empirical research suggest organizational climate for evidence-based practice (EBP) implementation may be an important and malleable target to improve clinician use of EBPs in healthcare; however, this work has been criticized for overreliance on self-report measures of implementation outcomes and cross-sectional designs. This study combines data from two studies spanning 7 years to test the hypothesis that higher levels of organizational EBP implementation climate prospectively predicts improved clinician adherence to an EBP, cognitive behavioral therapy (CBT), as rated by expert observers. Methods Biennial assessments of EBP implementation climate collected in 10 community mental health agencies in Philadelphia as part of a systemwide evaluation (time 1) were linked to subsequent observer ratings of clinician adherence to CBT in clinical encounters with 108 youth (time 2). Experts rated clinician adherence to CBT using the Therapy Process Observation Coding System which generated two primary outcomes (a) maximum CBT adherence per session (i.e., highest rated CBT intervention per session; depth of delivery) and (b) average CBT adherence per session (i.e., mean rating across all CBT interventions used; depth and breadth of delivery). Results On average, time 2 clinician adherence observations occurred 19.8 months ( SD = 10.15) after time 1 organizational climate assessments. Adjusting for organization, clinician, and client covariates, a one standard deviation increase in organizational EBP implementation climate at time 1 predicted a 0.63-point increase in clinicians’ maximum CBT adherence per session at time 2 ( p = 0.000), representing a large effect size ( d = 0.93; 95% CI = 0.63–1.24) when comparing organizations in the upper ( k = 3) versus lower tertiles ( k = 3) of EBP implementation climate. Higher levels of time 1 organizational EBP implementation climate also predicted higher time 2 average CBT adherence per session ( b = 0.23, p &lt; 0.001, d = 0.72). Length of time between assessments of climate and adherence did not moderate these relationships. Conclusions Organizational EBP implementation climate is a promising predictor of clinicians’ subsequent observed adherence to CBT. Implementation strategies that target this antecedent may improve the delivery of EBPs in healthcare settings. 

/pdf/linking-organizational-climate-for-evidence-based-practice-2yi9t6m8.pdf

Linking organizational climate for evidence-based practice implementation to observed clinician behavior in patient encounters: a lagged analysis

First-level leadership is uniquely positioned to support evidence-based practice (EBP) implementation for behavioral health due to first-level leaders’ access to and relationship with service providers. First-level leaders are individuals who directly supervise and manage frontline employees who do not manage others. However, first-level leadership is underrepresented in existing reviews of the impact of leadership on EBP implementation. This review describes the relationship between first-level leadership and implementation determinants and outcomes. A scoping review was performed to synthesize the literature on the relationship between first-level leadership and inner-context and implementation outcomes. A literature search was conducted in PubMed, Eric, PsycINFO, CINAHL, Scopus, and Web of Science. To be eligible, studies had to examine first-level leadership, be conducted in settings providing behavioral health services, and examine the relationship between first-level leadership and an implementation or inner-context outcome. Data extraction and synthesis were performed to describe study characteristics, leader-outcome relationships, and overlap in leadership frameworks. Twenty-one records met our inclusion criteria. Studies primarily relied on observational designs and were often cross-sectional. Studies more often examined general leadership rather than leadership strategically focused on EBP implementation (i.e., strategic implementation leadership). Our findings suggest that several forms of first-level leadership are inconsistently related to a broad set of implementation determinants, with infrequent examination of specific implementation outcomes. The broad set of implementation determinants studied, limited number of replications, and inconsistent findings have resulted in sparse evidence for any specific leadership-outcome relationship. The greatest accumulation of evidence exists for general leadership’s positive relationship with providers’ EBP attitudes, most notably in the form of transformational leadership. This was followed by evidence for strategic implementation leadership facilitating general implementation. Our synthesis revealed moderate conceptual overlap of strategic implementation leadership behaviors described in the theory of implementation leadership and theory of middle managers’ role in implementation. Our findings suggest that first-level leadership may play an important role in shaping implementation determinants and outcomes, but consistent empirical support is sparse and confidence dampened by methodological issues. To advance the field, we need studies that adopt stronger methodological rigor, address the conceptual overlap in leadership frameworks, examine a broader set of implementation outcomes, and examine conditions under which leadership impacts implementation. This review was not registered.

/pdf/the-relationship-between-first-level-leadership-and-inner-3pp50xmazu.pdf

The relationship between first-level leadership and inner-context and implementation outcomes in behavioral health: a scoping review

Handle everyday research tasks with reliable, citation-backed results

Your personal Research Agent to handle research tasks with citation-backed results

Popular Tasks used by Researchers

How can I help with your research?

Meet SciSpace

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

Gabrielle Jamora

Author Tools

Chat about Author

Papers

The relationship between first-level leadership and inner-context and implementation outcomes in behavioral health: a scoping review