Dictionary of Statistics and Methodology.

There is paucity of detailed information in the literature on how to develop procedures for estimating content validity to increase trustworthiness of assessment instruments. The authors present three unique examples, interpretation, and application of Tables of Specifications (ToS) for generating these estimates. The development and logic of the ToS requires presenting evidence that has transparency and creates trustworthiness in the validity estimates by maintaining an audit trail and using of triangulation, expert debriefing, and peer review. The argument presented is that content validity requires a mixed methods approach since data are developed through qualitative and quantitative methods that inform each other. This process is iterative and provides feedback on the effectiveness of the ToS through a process of determining consensus.

Content validity using a mixed methods approach: Its application and development through the use of a table of specifications methodology

REALWORLD EVALUATION: WORKING UNDER BUDGET, TIME, DATA, AND POLITICAL CONSTRAINTS Michael Bamberger, Jim Rugh and Linda Mabry Thousand Oaks CA: Sage Publications 2006, PB xxxii + 468 pp, AUD 44.95, ISBN 1412909465The last two years have seen a flowering of fine books on evaluation. These have icluded the 7th edition of the world's top seller in the field (Rossi, Lipsey and Freeman's 2004 Evaluation: A Systematic Approach); the 3rd edition of Australian scholar John Owen's 2006 Program Evaluation: Forms and Approaches; Davidson's 2005 Evaluation Methodology Basics: The Nuts and Bolts of Sound Evaluation (which may well become a core reference for students); and Mathieson's wonderful new 2005 Encyclopedia of Evaluation. These, and other new publications I could mention, support the contention that evaluation has become not only a profession, but also a discipline.Bamberger, Rugh and Mabry's 2006 RealWorld Evaluation: Working Under Budget, Time, Data, and Political Constraints is the latest offering from Sage Publication's evaluation booklist. Bamberger is a private consultant and a former Senior Sociologist at the World Bank; Rugh is with CARE International; and Mabry a Washington State University academic. They have much experience in conducting evaluations and teaching evaluation concepts and practice in developing countries and elsewhere, and this solid experience permeates the book.The title conveys the way in which this book differs from so many others apparently covering similar ground: the numerous how-to evaluation resource books. The authors start with the real world of program evaluators, the world in which there is often insufficient money, time, data and political support to undertake sound evaluations. What, then, is the alternative to the types of evaluation research we would undertake - were there sufficient money, time, data and political support? The authors point out that, for far too many evaluators, the alternative is a 'quick and dirty' study; meaning one which lacks methodological rigour and ignores threats to the validity of the study's findings.'RealWorld evaluation' is defined as 'An approach developed for evaluations operating under budget, time, data and political constraints intended to maximise the rigor of methods and the validity of findings' (p. 439). RealWorld evaluation, as portrayed in this volume, has seven steps:(1) planning and scoping the evaluation;(2-5) directly addressing the budget, time and data constraints, along with the political influences;(6) strengthening the evaluation design and the validity of the conclusions; and(7) helping clients to use the evaluation's processes and products.These are the features, the authors argue, which make this book different from the many others covering program and policy evaluation.An example may assist. The chapter covering 'Critical information is missing or difficult to collect: addressing data constraints', deals seriatim with the following strategies: reconstructing baseline data, identifying and constructing comparison groups, problems of non-equivalent comparison groups, and collecting data on sensitive topics and from difficult-to-reach groups. In each area, specific research strategies to overcome the constraints are described and discussed. …

Realworld Evaluation: Working under Budget, Time, Data, and Political Constraints

Spirituality is a universal phenomenon and an inherent aspect of human nature that unfolds during adolescence as the individual searches for transcendence, meaning, and purpose in life. Recently, spirituality has received attention as a source of resilience for adolescents. Theoretical perspectives and empirical research suggest that spirituality (distinctly and in relation to religiosity) promotes healthy development in adolescents, enhances the ability to cope, and leads to positive outcomes in mental health, psychological well-being, and academic learning. Given the value of spirituality as a source of resilience, implications for educational practices to foster adolescent spiritual development are discussed in the context of school, family, and community settings. © 2011 Wiley Periodicals, Inc.

Adolescent spirituality and resilience: Theory, research, and educational practices

Objectives. We sought a better understanding of how nonprofit hospitals are fulfilling the community health needs assessment (CHNA) provision of the 2010 Patient Protection and Affordable Care Act to conduct CHNAs and develop CHNA and implementation strategies reports.Methods. Through an Internet search of an estimated 179 nonprofit hospitals in Texas conducted between December 1, 2013, and January 5, 2014, we identified and reviewed 95 CHNA and implementation strategies reports. We evaluated and scored reports with specific criteria. We analyzed hospital-related and other report characteristics to understand relationships with report quality.Results. There was wide-ranging diversity in CHNA approaches and report quality. Consultant-led CHNA processes and collaboration with local health departments were associated with higher-quality reports.Conclusions. At the time of this study, the Internal Revenue Service had not yet issued the final regulations for the CHNA requirement. This provides an opportunity t...

Nonprofit hospitals-approach to community health needs assessment

/pdf/youth-participatory-evaluation-strategies-for-engaging-young-rijicx00n3.pdf

Youth Participatory Evaluation: Strategies for Engaging Young People

Background: Since the late 1970s participatory approaches have been widely promoted to evaluate international development programs. However, there is no universal agreement of what is meant by participatory evaluation.  For some evaluators, participatory evaluations involve the extensive participation of all stakeholder groups (from donor to non-recipients) in every phase of the evaluation (from design to dissemination). For others, the participation of donors in the design constitutes a participatory evaluation approach. Participatory evaluation approaches are best considered on a continuum. In other words, there are many gradations to participation and evaluations should be classified accordingly.  Purpose: The lack of shared meaning of participatory evaluation approaches also impedes serious discussion on their use including their merits and demerits, suggestions for their improvement, and their overall effectiveness. The purpose of this article is to present an examination of the literature on participatory evaluation approaches to highlight commonalities and differences. Setting: Not applicable Intervention: Not applicable. Research Design: Not applicable. Data Collection and Analysis: Desk review. Findings: This article clearly demonstrates how broadly participatory evaluation is conceptualized and practiced and underscores the clear need for specification and precision when discussing what is meant by participatory evaluation. Recommendations for how evaluators should describe participatory evaluations are provided. Keywords: participatory evaluation; collaborative evaluation; empowerment evaluation; stakeholder-based evaluation

/pdf/forms-and-functions-of-participatory-evaluation-in-3z3ex9h4qb.pdf

Forms and Functions of Participatory Evaluation in International Development: A Review of the Empirical and Theoretical Literature

In this paper, concept mapping techniques for planning and evaluating energy efficiency initiatives are presented using a case example from an evaluability assessment of a statewide initiative in the USA. Cluster maps, point cluster maps, cluster rating maps, pattern matches, go-zones, and other information are used to demonstrate how concept mapping can inform non-arbitrary, defensible decisions and subsequent actions for energy efficiency and renewable energy financing, program planning, and evaluation.

Using concept mapping for planning and evaluation of a statewide energy efficiency initiative

Participatory approaches to evaluation have long been vogue in the international development evaluation community. However, despite their widespread use, there is a dearth of research on the impact of stakeholder participation in international development evaluations. Although proponents of participatory approaches to international development evaluation assert many advantages of their use, the evidence to support these claims is largely anecdotal. Similarly, critics of participatory approaches do not have empirical data on which to base their assertions. Further confusing the matter are multiple and conflicting definitions of stakeholder and participation. Some interpret stakeholders to mean funders while others view stakeholders as those who are impacted by a program. Similarly, some view participation as any type of consultation with stakeholders, while others only deem side-by-side collaboration to be participation. Without systematic scrutiny, it is difficult to repudiate or substantiate any of these claims. In this dissertation the primary aim is to investigate this matter by undertaking a study that documents current practices and international development evaluators’ perceived consequences of stakeholder participation in development evaluation. The following research questions are addressed: Why are participatory approaches used in international development evaluations? How do evaluators and those who commission them decide which stakeholders should participate and the nature of their participation? What is the impact of participation on (i) validity and credibility, (ii) the usefulness and use of findings, (iii) implementation of the evaluation, (iv) fairness, (v) time and financial resources, (vi) social change, (vii) stakeholders’ technical research skills, and (viii) empowerment of stakeholders? The findings suggest that participatory evaluation approaches are interpreted and practiced in widely differing ways. Despite criticisms that participatory evaluation approaches sacrifice objectivity and validity via the inclusion of stakeholders, the results of this study provide evidence that evaluators typically maintain control of the evaluation process. Donor dominance of the evaluation process is another important finding of this study. These findings underscore the importance of clarity and the need for details when discussing participatory evaluation approaches. Implications for evaluation practice and future research are discussed.

/pdf/the-politics-and-consequences-of-stakeholder-participation-3yy0blcymk.pdf

The Politics and Consequences of Stakeholder Participation in International Development Evaluation

Background: Treatment implementation is not just one thing but rather is a multifaceted process that includes treatment delivery, treatment receipt, and treatment adherence. As such, local variations in implementation and service delivery of interventions are an inevitable. Purpose: To assess implementation fidelity of a multi-site experiential nutrition education program. Setting: Multiple sites throughout the continental United States. Intervention: An experiential nutrition education program. Research Design: A concurrent mixed methods design was used to assess implementation fidelity. Data Collection and Analysis: Multiple methods of data collection and analysis were used including observations, interviews, survey questionnaires, and extant data. Findings: Although implementation fidelity varied over program sites, overall implementation fidelity was very good and when it varied, it varied to local site needs and context. Keywords: program fidelity; program implementation; nutrition education

/pdf/assessing-implementation-integrity-of-a-national-nutrition-4d9bu5c7ml.pdf

Assessing Implementation Integrity of a National Nutrition Education Program: A Case Study of Share Our Strength's Operation Frontline

Handle everyday research tasks with reliable, citation-backed results

Your personal Research Agent to handle research tasks with citation-backed results

Popular Tasks used by Researchers

How can I help with your research?

Meet SciSpace

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

Anne Cullen

Author Tools

Chat about Author