Validity Conformance Changes
We heard you! You told us about your concern with the inclusion of null values in the nonconforming calculations for Validity, and we listened. Look for significant improvements to the NSSP Monthly Validity Report and NSSP Daily Onboarding Validity Report.
Previously, calculations for conforming and nonconforming statistics for validity included records with null (or missing) values in the denominator. This affected the number and percentage of records and visits shown as conforming or nonconforming to PHIN guide standards. Starting in April 2019, we began to update the reports so that null values will be entirely separate. Null values will not affect the numerator or denominator for calculations of conformance. Only records with a reported code will be used to calculate conforming and nonconforming values. Records with null values will be presented in a separate category. This change will allow for more accurate representation of conforming and nonconforming values and percentages of valid records for coded data elements. Note. This change will apply to both monthly production reports and daily onboarding reports.
The following example illustrates how this change will affect percentage calculations:
Old Facility_Type_Code Validity | |||
Facility Name | Value | Records | % Records |
Facilities | ALL_CONFORMING | 100 | 50.0% |
A | 261QE0002X | 70 | 35.0% |
A | 261QM2500X | 30 | 15.0% |
Facilities | ALL_NONCONFORMING | 100 | 50.0% |
A | $Missing | 80 | 40.0% |
A | 102-5 | 20 | 10.0% |
New Facility_Type_Code Validity | |||
Facility Name | Value | Records | % Records |
Facilities | ALL_CONFORMING | 100 | 83.33% |
A | 261QE0002X | 70 | 58.333% |
A | 261QM2500X | 30 | 25.0% |
Facilities | ALL_NONCONFORMING | 20 | 16.667% |
A | 102-5 | 20 | 16.667% |
Facilities | ALL_Null | 80 | 100.0% |
A | $Missing | 80 | 100.0% |
Here’s another example that illustrates the differences between Old and New Conformance calculations:
Old Overall Conforming Calculation | |
Numerator | 100 |
Denominator | 200 |
Percent | 50% |
Old Non-Conforming Calculation | |
Numerator | 100 |
Denominator | 200 |
Percent | 50% |
New Overall Conforming Calculation | |
Numerator | 100 |
Denominator | 120 |
Percent | 83.33% |
New Non-Conforming Calculation | |
Numerator | 20 |
Denominator | 120 |
Percent |