Defining program success: Facilitators’ perceptions of desired military financial education outcomes

Introduction: Financial issues are a salient concern for military families. U.S. federal policies have sought to address this concern by requiring financial literacy training to equip service members with financial knowledge and decision making tools. Specifically, the Department of the Air Force (DAF) has implemented a Personal Financial Readiness (PFR) program for airmen and guardians that provides ongoing training at salient personal and military touchpoints (e.g., promotion, marriage). Ongoing, outcome-focused evaluation efforts are underway to investigate the effectiveness of these trainings. The goal of this study was to assess if program facilitators (those who provide the trainings directly to service members) and program evaluators (those who work alongside DAF policy makers and leadership to identify program goals and evaluate impact) have similar perceptions about intended program outcomes of the DAF PFR program. Shared meaning by stakeholders is essential to meet program outcomes. Methods: This process-focused evaluation elicited insights from DAF PFR program facilitators. Facilitators completed an online survey in June 2023 (N = 46) and responded to an open-ended, qualitative question asking them to identify indicators of program success. Results: There was meaningful overlap in intended program outcomes by facilitators (as gathered through the qualitative data) and program evaluators (as gathered through established program documentation). However, facilitators noted greater emphasis on training compliance and long-term outcomes compared to program evaluators who emphasize the expected, sequential nature of change. Discussion: Incorporating the voices of diverse stakeholders is important for ensuring that program evaluation efforts accurately identify and investigate intended outcomes.