Title: Director of Outcome Measurement
Unit: Evaluation and Quality Improvement
Reports to: AVP of Program Compliance, Evaluation and Quality Improvement
Salary Range: $80,000 - $95,000
Status: Full Time; Regular; Exempt
Location: Long Island City
Date Prepared: April 10th, 2024
Position Summary:
Reporting to the AVP of Program Compliance, Evaluation and Quality Improvement (PCEQI), the Director of Outcome Measurement will develop and provide agency-wide training in the use of the Outcomes Star, ensuring fidelity to the model as determined by the developer, Triangle Consulting to program staff and supervisors. The Director of Outcome Measurement will conduct monthly Outcomes Star unit training meetings to all departments utilizing Outcomes Star (OS) to support staff in mastering key features of the OS approach, periodically test validity of OS, and review OS data with staff. The Director of Outcome Measurement will analyze data (quantitative and qualitative) to produce regular reports for agency leadership on OS implementation and progress across departments with the goal of being able to publish and share results with funders.
Core Competencies:
The Director of Outcome Measurement shall possess the following core competencies which are key to the fulfillment of the requirements for the position:
Mission/Culture
The Director of Outcome Measurement must embody the values and mission of the Fortune Society. This includes meeting our participants where they are in the re-entry process, demonstrating our values through compassion and understanding; and affirming that none of us should be measured against the worst things we have done. The Director of Outcome Measurement supports building a client-centered, strength based, deep change-oriented culture by integrating beliefs, values, and principles into everyday practice to create environments and partnerships that foster hope, personal dignity and respect, possibilities, empowerment and self-direction, informed choice, resiliency, and community integration.
Collaboration and Leadership
The Director of Outcome Measurement should be comfortable collaborating with staff at all levels and all departments of the organization and facilitating discussions to identify root causes of implementation issues and challenges adhering to the OS model. The Director of Outcome Measurement will be asked to solicit feedback from program staff and management on implementation and should be comfortable contributing constructive feedback to agency leadership on recommendations provided to improve fidelity and implementation of OS.
Organizational and Time Management Skills
The Director of Outcome Measurement must be highly organized, in command of key issues, and be able to prioritize effectively as new projects come up. They should be able to manage multiple tasks and deadlines, and also should be able to demonstrate that they can effectively assess quality.
Analysis
The Director of Outcome Measurement must have strong analytical and data management skills to identify model fidelity and data integrity. Additionally, the Director of Outcome Measurement must be able to inform and advise leadership on model fidelity and data integrity issues found through succinct presentation of findings.
Essential Duties and Responsibilities:
- Complete training held by Triangle Consulting to become a certified trainer of Outcomes Star and participate in additional training as required by Triangle Consulting to maintain certification. Collaborate/consult routinely with other certified trainers.
- Develop and provide training in the use of the Outcomes Star to new users that instruct staff in how to complete OS collaboratively with participants; how to use the OS for effective action planning and goal setting; how to understand the Journey of Change that emphasizes intentional change through an individual’s own decision-making; how to build trust & helping relationships; and how to use OS data to inform service delivery.
- Develop and provide training in the use of the Outcomes Star to supervisors of users to increase knowledge about practice methods using case studies; enhance the use of the OS with S.M.A.R.T. goal setting; understand motivational interviewing and to learn the skills of active listening and purposeful practice; and how to analyze OS data to inform program service delivery.
- Hold monthly Outcomes Star unit training meetings to support staff in learning & practicing helpful communication skills with participants in different situations; help staff master key features of the OS approach to goal setting & treatment planning; learn targeted interventions appropriate to each stage of change; periodically test & ensure the validity of the OS; review OS data & apply to refine staff’s work with participants.
- Train and support program management in data collection and management procedures of OS as needed, so program management is equipped with knowledge and resources to train, onboard, and supervise program staff in data collection standards effectively.
- Develop policy and procedure documentation, tools, and reports that will allow program managers to conduct day-to-day quality assurance and ensure fidelity with OS.
- Produce summary reports using Power BI for agency leadership on OS implementation progress and outcomes achieved.
- Conduct root cause analysis to identify operational causes for OS fidelity challenges discovered through quality assurance reviews, and support program leadership in developing and monitoring quality improvement plans that address OS fidelity challenges.
- Provide support to units in development of logic models, ensuring that there is clear and consistent understanding of the differences between outputs and outcomes.