Provider Assessment and Feedback Planning Guide

This evidence-based intervention (EBI) assesses providers’ performance in delivering or offering cancer screening to clients and presents providers with the results of this assessment. The goal of provider assessment and feedback is to motivate providers to increase cancer screening recommendations to patients.

Process Flow

Implement and integrate provider assessment process into clinic workflow.

Output: Provider assessments completed

Measure: Provider assessment reports

Example: Number of providers assessed divided by the number of providers in the practice

Example: Number of provider assessments conducted per year

Implement and integrate process to provide performance feedback to providers.

Motivate or incentivize providers through competition. Potential challenges include limited electronic health record system capacity and high cost of manual chart audits.

Output: Increased screening recommendations made by provider

Measure: Provider feedback sessions

Example: Number of providers receiving feedback divided by the number of providers in the practice

Example: Number of provider feedback reports distributed per year

Provider recommends patient for cancer screening, consistent with guidelines and recommendations.

Potential challenges include forget without prompts and time constraints during visit.

Outcome: Increased screening recommendations made by provider

Measure: Screening recommendations, referrals, and orders

Example: Number of patients given a recommendation by a provider divided by the number of patients due for screening with appointments

Example: Number of patients with a screening test ordered divided by the number of patients due for screening with appointments

Patients complete cancer screening.

Outcome: Increased screening and diagnostic tests completed by patients

Measure: Screening completion

Example: Number of patients completing screening divided by the number of patients referred for screening

Example: Number of patients completing diagnostic follow-up divided by the number of patients with positive screening tests

Increased cancer screening.

Outcome: Increased clinic-level rates of cancer screening

Measure: Age-eligible clinic population up-to-date with recommended cancer screening

Example: Uniform Data System (UDS), Healthcare Effectiveness Data Information Set (HEDIS), National Quality Forum (NQF) 12-month measure used to calculate screening rate

Top of Page

Community Guide Recommendation

The Community Preventive Services Task Force (Task Force) recommends provider assessment and feedback interventions to increase screening for breast, cervical, and colorectal cancer.²

Settings Where Intervention Was Studied¹

Rural, urban, and suburban areas in the United States and the United Kingdom.
University-affiliated hospitals, primary care clinics, and Veterans Administration hospitals.

Outcome from the Systematic Review of Effectiveness¹

Completed screenings increased by a median of 13 percentage points for all breast, cervical, and colorectal cancer tests.

Components of the Intervention

Evaluate Provider Performance in Delivering or Recommending Screening to Patients

Can patients due for screening be identified? How will the appropriate data on how the providers performed be obtained?
Have metrics to evaluate (such as percentage of patients who are up-to-date with screening, by provider; percentage of patients receiving a provider recommendation for testing) been selected?
Have the methods on how metrics will be calculated, identified data sources, and ensured data quality been determined?
Can the metrics to assess their accuracy and utility be tested?

Develop a Mechanism to Provide Feedback

What format will be used (report or dashboard)?
How often will feedback be delivered to providers?
Are the data easily interpreted? Which metrics resonate with the providers? (A proportion? Actual numbers of patients?) How can data be presented (a table, using data visualization methods)?

Present Providers with the Results of the Assessment

How will results be delivered to providers? Will results be presented to providers individually or in a group setting?
Will results describe the performance of individual providers or a group of providers (such as the average performance for a practice)?
Which staff members will be allowed to see these data?
Is the process for delivering feedback acceptable to providers and other staff?
Has the person best suited to present the feedback reports been selected?

Track Outputs and Outcomes

Is there a way to track whether the provider recommended or ordered a screening test?
Is there a way to track patients through screening and diagnostic test completion?
Have methods and tools for tracking been identified or created?
Have appropriate and feasible performance measures to monitor potential improvement over time been selected?

Resources to Support Implementation

Partnerships

Internal: across and within clinics, with departments such as billing, claims, radiology, and information technology.
External: patient registries and laboratories.

Staff

Quality improvement (QI) or other staff to define metrics for assessment and determine how they will be calculated.
Staff to conduct the assessment and develop the feedback (reports or dashboards).
QI or other staff to deliver feedback to providers.
Providers that recommend or administer screening tests to patients.

Training or Orientation

For staff on how to conduct assessments and prepare feedback.
For providers being assessed on screening guidelines or recommendations and metrics used in feedback reports.
Designate a point of contact for ongoing implementation support and for providers who have questions about the assessment, metrics in the feedback reports, or their past performance.

Tools

Electronic health records (EHR), if the practice has a system that can be used for this type of assessment.
Reference aids for staff, such as data collection forms, a codebook for analyzing narrative data in health records, quality assurance forms, and practice guidelines and recommendations.

Lessons Learned from the Literature¹

The infrastructure for provider assessment and feedback may already exist for other uses. Before beginning, find out if it is possible to add cancer screening to an existing system.
The term “provider” referred only to physicians in the included studies, but this intervention may work for other types of providers, such as physician assistants or nurse practitioners.
Chart audits of EHRs or other automated methods reduced intervention costs by 90% compared to manual record review in one study.
The intensity and complexity of this implementation were low unless the system involved multiple departments or organizational partners, or feedback was delivered in frequent face-to-face meetings.
The intervention was replicated more easily when feedback was delivered by academic faculty to residents. Assessment was seen as part of the academic role.
Some sensitivity was evident when physicians received feedback from their peers in different specialty areas.
There was a decline in effect over time if the intervention was not maintained.

Ways to Strengthen Performance or Sustainability

Integrate performance targets for cancer screening into training requirements or general workplace policies.
Get buy-in from clinic staff on the frequency of assessing performance and providing feedback, target setting, and the format for providing feedback.
Consider comparing the performance of individual providers within a practice or among practices, or comparing the average performance of practices to one another, to encourage ‘friendly competition’ among peers.
Deliver feedback more than once and at regular intervals, such as monthly or during daily huddles.

References

¹Sabatino SA, Lawrence B, Elder R, Mercer SL, Wilson KM, DeVinney B, Melillo S, Carvalho M, Taplin S, Bastani R, Rimer BK, Vernon SW, Melvin CL, Taylor V, Fernandez M, Glanz K, Community Preventive Services Task Force. Effectiveness of interventions to increase screening for breast, cervical, and colorectal cancers: nine updated systematic reviews for The Guide to Community Preventive Services. American Journal of Preventive Medicine 2012;43(1):765–786.

²Community Preventive Services Task Force. Updated recommendations for client- and provider-oriented interventions to increase breast, cervical, and colorectal cancer screening. American Journal of Preventive Medicine 2012;43(1):92–96.