PCD logo

Implementation Evaluation

MANUSCRIPT CHECKLIST

General

checkboxThe title accurately reflects the content of the manuscript.

checkboxThe structured abstract (using the headings Purpose and Objectives, Intervention Approach, Evaluation Methods, Results, and Implications for Public Health) accurately reflects the content of the manuscript.

checkboxThe manuscript adds substantially to what is already known about the topic.

checkboxThe article is of interest to PCD readers.

checkboxThe article fits the mission of the journal to address the interface between applied evaluation and public health practice in chronic disease prevention.

checkboxThe manuscript is clearly and concisely written and is free of jargon.

checkboxEach section of the manuscript — Purpose and Objectives, Intervention Approach, Evaluation Methods, Results, and Implications for Public Health — includes the appropriate information. These sections are clearly delineated.

checkboxThe citations are up to date and relevant.

checkboxAll statements requiring citations have citations.

checkboxThe Acknowledgments identify funding for the study.

checkboxThe article has no more than 4,500 words, 40 references, 5 tables, and 4 figures.

Abstract

checkboxThe abstract accurately reflects the content of the manuscript.

checkboxThe abstract has the following subheadings: Purpose and Objectives, Intervention Approach, Evaluation Methods, Results, and Implications for Public Health.

checkboxThe text has no more than 300 words.

Introduction

checkboxThe public health area(s) of interest is described.

checkboxPurpose and rationale for the evaluation approach is justified by the literature and the circumstances under which implementation and evaluation activities occurred.

checkboxProject staff and partnerships responsible for conceptualizing, implementing, and evaluating efforts are described.

checkboxWhen and how long reported activities were implemented and evaluated are reported.

checkboxWhen data collection was initiated and completed are reported.

checkboxA literature review is provided to identify gaps in knowledge about the evaluation topic and show how the evaluation will add substantially to what is already known.

checkboxThe authors appear to know their subject.

checkboxDefinitions of terms specific to the context of the manuscript are provided.

Purpose and Objectives

checkboxFactors considered in developing the intervention are reported.

checkboxComponents of the intervention are adequately described.

checkboxSpecific objectives or evaluation questions are reported.

checkboxA clear explanation of the systematic planning process used to form the basis of what was implemented and evaluated is provided.

checkboxDetails on how stakeholders and partners were engaged to develop the program’s purpose and objectives are reported.

checkboxCharacteristics of the setting and population are described.

checkboxFactors that influence the intervention’s planning, implementation, and evaluation (eg, staff capacity, evaluation expertise, intervention fidelity) are fully discussed.

Intervention Approach

checkboxAn intervention approach grounded in the literature and the intervention setting is described.

checkboxAssumptions underlying how activities, evaluation approach, and evaluation methods are aligned are presented.

checkboxOutcomes or measurements are adequately described.

checkboxOutcomes (eg, indicators, measures, benchmarks) unfamiliar to a general public health readership are explained.

checkboxIf validation of new and innovative measures is conducted as part of the study, they are described.

checkboxIntervention approach is appropriately linked to results (eg, outcomes, measures, indicators) being reported.

checkboxInformation used to develop the intervention (eg, demographic shifts, setting attributes, stakeholder input, pilot studies) is provided.

checkboxFigures or diagrams describing the intervention logically depict the interrelationship among key components being discussed.

Evaluation Methods

checkboxThe type of evaluation method (eg, qualitative, quantitative, or mixed) used and the rationale for its selection are described.

checkboxAn appropriate evaluation approach (eg, qualitative, quantitative, or mixed) was used to achieve the study objectives.

checkboxThe dates of the study are provided.

checkboxIf the manuscript describes a return on investment design (eg, cost analysis, cost-effectiveness analysis, cost-benefit analysis), it includes a discussion of the evaluation method.

checkboxFor evaluations that report use of a survey, the survey questions are provided.

checkboxThe setting from which the participants are drawn (eg, general community, school, clinic, hospital, worksite) is described, including key sociodemographic features.

checkboxFor participants in the evaluation, detailed inclusion and exclusion criteria are provided.

checkboxParticipants are appropriate to the evaluation question.

checkboxRecruitment of participants in the evaluation and sampling procedures are described.

checkboxIf the manuscript describes evaluation involving human subjects, it includes a statement that the research was approved by an appropriate institutional review board.

checkboxThe participation rate is provided and defined in terms of a numerator and denominator.

checkboxThe participation rate is satisfactory for the evaluation method used.

checkboxIf controls are used, they are adequately described.

checkboxThe pre-evaluation (prestudy) calculation of required sample size is reported.

checkboxThe sample size is appropriate to produce meaningful results.

checkboxA consistent cohort of study participants, for whom all data (qualitative, quantitative, or mixed) are available, is used.

checkboxIf a survey is used, state whether the survey instrument has been shown to have validity.

checkboxThe statistical or qualitative methods are appropriately selected.

checkboxThe statistical or qualitative methods are explained in plain English.

checkboxThe software (statistical or qualitative) is identified.

checkboxEnough information is provided to enable an informed reader to replicate the evaluation.

checkboxThe Evaluation Methods section includes only a description of the methods; it does not include results.

Results

checkboxThe main findings of the evaluation are provided.

checkboxCharacteristics of the study participants are presented (eg, number, age distribution, sex, racial/ethnic characteristics).

checkboxThe results are specific and relevant to objectives and evaluation questions.

checkboxAll results reported have a corresponding section in the Evaluation Methods section.

checkboxFor surveys, the response rate is provided.

checkboxMeasures of data distribution or precision (eg, standard deviation, 95% confidence intervals) are given, if appropriate.

checkboxInformation on how study participants might compare to people not included in the study is provided.

checkboxImplications or weaknesses of the study and the rationale for the statistical procedures used are not discussed in this section.

Implications for Public Health

checkboxA lengthy reiteration of the Results section is avoided.

checkboxThe objectives and evaluation questions are addressed.

checkboxSpeculation and overgeneralization are avoided.

checkboxStrengths and weaknesses of the evaluation are objectively evaluated.

checkboxPositive and negative findings of equal scientific merit are emphasized equally.

checkboxThe conclusions drawn from the statistical or qualitative analyses are justified.

checkboxFindings from the evaluation are compared with findings of similar published evaluation efforts.

checkboxUnexpected findings are mentioned, with suggested explanations.

checkboxLimitations of the evaluation are discussed.

checkboxThe generalizability of the results is discussed.

checkboxImplications for public health are discussed.

checkboxSuggestions on how aspects of evaluation efforts can be used to shape future evaluation efforts in similar real-world settings are discussed.

checkboxThe section ends with a clear, concise conclusion about facilitating diffusion and uptake of similar evidence-based interventions in a comparable real-world setting.

Data Tables and Figures

checkboxThe tables and figures are well constructed, easy to comprehend, and visually appealing.

checkboxInformation in the tables or figures is not duplicated in the text or in other tables or figures.

checkboxInformation in the tables or figures is consistent with information in the text.

checkboxNumbers add up correctly.

checkboxThe tables and figures are able to stand independently; they do not require explanation from the text.

Illustrations in Other Media

checkboxText transcriptions of video and audio files are provided.

checkboxApproval obtained to reproduce newspaper clippings or other print or Internet sources is provided.


The opinions expressed by authors contributing to this journal do not necessarily reflect the opinions of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors’ affiliated institutions.

Page last reviewed: September 19, 2019