Skip to the toolkit

← Workflow sustainment checklist

Workflow period comparison calculator

Compare the observed event share before and during a workflow test, with reporting completeness alongside each result. Use this as a discussion aid, not proof that the test caused a change.

Compare the same measure before and during a test, and check reporting completeness in both periods.
Use consistent definitions and consider missing reports in both periods.

Enter counts for two periods

Enter nonnegative whole-number counts using digits only (for example, 10 rather than 10.0) for the same event, eligibility rules and collection method in each period. Count eligible opportunities independently of reports. A completed report must have a known yes-or-no event answer; reconcile duplicates and count no more than one report per eligible opportunity. Do not enter identifying information.

Before the test
During the test

For a manual calculation, use the formulas and example below.

Read the comparison

For each period, completeness is completed reports ÷ eligible opportunities, and the observed event share is reports showing the event ÷ completed reports. The difference is the during-test share minus the before-test share, expressed in percentage points. The calculation uses unrounded shares; displayed values are rounded to one decimal place (half away from zero), so the displayed difference can differ slightly from subtracting displayed shares.

A zero denominator makes its share undefined. If either period has no completed reports, the difference is undefined. Opportunities without a known-status report include absent reports and reports with an unknown event answer. They may make the observed share unrepresentative of all eligible opportunities. Check differences in workload, selection, definitions, missingness and staff experience; a before-and-after difference does not establish causation.

Worked example

Before: 10 eligible, 10 completed and 4 event reports: 100% completeness and 40% observed share. During: 10 eligible, 5 completed and 1 event report: 50% completeness and 20% observed share. The observed difference is −20 percentage points; the lower completeness means the observed shares alone cannot explain what happened in missing reports.

Next step

Review the result and its limitations with the team using the workflow test review agenda. Contact Special Learning to discuss group training for your organization.

Tell staff what happens next

Explain a workflow change with the staff update template.

Sources

Informed by the Institute for Healthcare Improvement’s guidance on improvement measures and the Community Preventive Services Task Force’s definition of percentage-point change.