Narrative: III. b. 4. A.

Each core and combined state partner is required by its federal agency to provide performance data annually. Each core partners’ respective federal agency sets the target and timeline for the Workforce Innovation and Opportunity Act (WIOA) measures. The partners work with their federal agency to meet or exceed Missouri’s targets, while working with applicable local and regional entities. 

Missouri Job Centers 

Missouri implemented a job center certification process for comprehensive Missouri Job Centers (MJC) and affiliates under WIOA. Each site that makes available one or more of the one-stop partners’ programs, services, or activities are evaluated based on standards and expectations for service coordination as defined by the State Workforce Development Board (WDB). Certification teams are comprised of one representative from each of the four core partner programs and are charged with conducting independent and objective evaluations. The certification process includes on-site evaluations that incorporate interviews with MJC leaders and evaluation of customer satisfaction surveys, documentation required for state and federal compliance, and physical and programmatic accessibility.

The MJC evaluation and certification process is conducted at least once every three years and review of certification criteria occurs every two years as part of the review and modification of the WIOA State Plan. The team charged with reviewing the certification criteria is comprised of core and combined state plan partner representatives who examine the certification criteria to ensure it is a comprehensive and pragmatic approach to determining customer satisfaction, physical and programmatic accessibility, and continuous improvement.  

The WIOA partnership will assess the progress of meeting its performance goals by looking at performance on a regular basis. While the partners have the ability to look at most of these on a monthly basis, the intention is to view a subset of the following measures monthly and all of them on a quarterly basis. Additionally, updates on performance will be presented to the State on a quarterly basis. This includes whether the targets are met for the following:

•     the WIOA common measures: Employment (Q2 and Q4), Earnings, Credential attainment, Measurable Skills Gain and Employer Effectiveness;

•     total customers to be served; 

•     rate of achieving performance targets (percent of goal attained) and any anomalies in the data; and

•     whether or not the actual data are meeting accuracy of forecasted data.

Additional outcomes beyond the reported performance measures are also reviewed and will be developed with one-stop partners.

Adult Education and Literacy

Title II AEL in Missouri strongly commits to helping local adult education programs provide the highest quality student services. In addition to required annual performance reporting, AEL staff provide continuous monitoring, evaluation, and technical assistance to help improve outcomes, share resources, and grow adult education opportunities based on the needs of the state.

AEL employs a four component monitoring system for ongoing real-time assessment of local service providers.

1. Desk Review: Each month, the AEL team reviews financial and program enrollment/performance data of each local service provider. This real-time review evaluates budgets, actual expenditures, cost per student, persistence of student attendance and combined WIOA performance measures. This process allows AEL to provide immediate technical assistance in areas of concern as opposed to waiting until end-of-year reporting. Local service providers also have access to a dashboard displaying all data reviewed by AEL.
2. Self-Assessment: Based upon a risk assessment, local programs must submit a self-assessment to DESE AEL ensuring compliance with grant/contract requirements.
3. On-Site Monitoring: AEL regularly evaluates the quality of providers on-site each year based on a revolving schedule and risk assessment. The reviews ensure that local programs follow state and federal guidelines, performance measures are on target, program operations are efficient, and instruction is effective.

In addition to mentoring from visiting local program staff, on-site reviews include

3. 1. fiscal/program management and reporting;
   2. teacher certification and professional development requirements;
   3. data entry and management;
   4. student assessment procedures;
   5. student intake and orientation process;
   6. teaching/classroom observation;
   7. instruction;
   8. recruitment and retention;
   9. facilities;
   10. local program policies; and
   11. documentation and record retention requirements.
4. Corrective Action: If monitoring reveals areas of noncompliance or concern, the local service provider must submit a corrective action plan for approval by AEL. 

Vocational Rehabilitation

VR will assess its performance based upon the WIOA common performance measures as well as agency goals and objectives. The VR executive leadership team along with district office management review performance data on a monthly basis to determine progress toward goals and opportunities for improvement. VR’s case services and financial services work in tandem evaluating performance data for short- and long-term decision making. In addition, VR’s statewide quality assurance team evaluates case management providing guidance on program performance.