Validity Conformance Changes

We heard you! You told us about your concern with the inclusion of null values in the nonconforming calculations for Validity, and we listened. Look for significant improvements to the NSSP Monthly Validity Report and NSSP Daily Onboarding Validity Report.

Previously, calculations for conforming and nonconforming statistics for validity included records with null (or missing) values in the denominator. This affected the number and percentage of records and visits shown as conforming or nonconforming to PHIN guide standards. Starting in April 2019, we began to update the reports so that null values will be entirely separate. Null values will not affect the numerator or denominator for calculations of conformance. Only records with a reported code will be used to calculate conforming and nonconforming values. Records with null values will be presented in a separate category. This change will allow for more accurate representation of conforming and nonconforming values and percentages of valid records for coded data elements. Note. This change will apply to both monthly production reports and daily onboarding reports.

The following example illustrates how this change will affect percentage calculations:

Old Facility_Type_Code Validity
Old Facility_Type_Code Validity
Facility Name Value Records %
Records
Facilities ALL_CONFORMING 100 50.0%
A 261QE0002X 70 35.0%
A 261QM2500X 30 15.0%
Facilities ALL_NONCONFORMING 100 50.0%
A $Missing 80 40.0%
A 102-5 20 10.0%

 

New Facility_Type_Code Validity
New Facility_Type_Code Validity
Facility Name Value Records %
Records
Facilities ALL_CONFORMING 100 83.33%
A 261QE0002X 70 58.333%
A 261QM2500X 30 25.0%
Facilities ALL_NONCONFORMING 20 16.667%
A 102-5 20 16.667%
Facilities ALL_Null 80 100.0%
A $Missing 80 100.0%

 

Here’s another example that illustrates the differences between Old and New Conformance calculations:

Differences between Old and New Conformance calculations
Old Overall Conforming Calculation
Numerator 100
Denominator 200
Percent 50%

 

Old Non-Conforming Calculation
Old Non-Conforming Calculation
Numerator 100
Denominator 200
Percent 50%
New Overall Conforming Calculation
New Overall Conforming Calculation
Numerator 100
Denominator 120
Percent 83.33%

 

New Non-Conforming Calculation
New Non-Conforming Calculation
Numerator 20
Denominator 120
Percent