Narrative: III. b. 4. A.

Each combined partner is required by its federal agency to provide performance data annually. Each combined partners’ respective federal agency sets the target and timeline for WIOA measures. The combined partners work with their federal agency to meet or exceed Missouri’s targets, while working with applicable local and regional entities.

Missouri Job Centers

Missouri implemented a one-stop certification process for comprehensive Missouri Job Centers and affiliates under WIOA. Each site that makes available one or more of the one-stop partners’ programs, services, or activities are evaluated based on standards and expectations for service coordination as defined by the Missouri Workforce Development Board (MOWDB). Certification teams are comprised of one representative from each of the four core-partner programs and are charged with conducting independent and objective evaluations. The certification process includes on-site evaluations that incorporate interviews with One-Stop functional leaders and evaluation of customer satisfaction surveys, documentation required for state and federal compliance and physical and programmatic accessibility.

The One-Stop evaluation and certification process is conducted at least once every three years and review of certification criteria occurs every two years as part of the review and modification of the WIOA State Plan. The team charged with reviewing the certification criteria is comprised of core partner representatives who examine the certification criteria to ensure it is a comprehensive and pragmatic approach to determining customer satisfaction, physical and programmatic accessibility, and continuous improvement.

The WIOA partnership will assess the progress of meeting its performance goals by looking at performance on a regular basis. While the partners have the ability to look at most of these on a monthly basis, the intention is to view a subset of the following measures monthly and all of them on a quarterly basis. Additionally updates on performance will be presented to the State Workforce Board on a quarterly basis. This includes whether the targets are met for the following:

•     the WIOA common measures: Employment (Q2 and Q4), Earnings, Credential attainment, Measurable Skills gain and Employer Effectiveness;

•     total customers to be served;

•     rate of achieving performance targets (percent of goal attained) and any anomalies in the data; and

•     whether or not the actual data are meeting accuracy of forecasted data.

Additional outcomes beyond the reported performance measures are also reviewed and will be developed with One-Stop partners.

Adult Education and Literacy

The state AEL office is strongly committed to helping local adult education programs provide quality student services. AEL staff provides continuous monitoring, evaluation and assistance in activities that help improve outcomes, share resources, and provides technical assistance and support.

Missouri Adult Education has a three component monitoring system to assess the progress of adult education and literacy activities under Title II.

1. Desk Review - a monthly review of AEL grants/contracts that includes review of financial reports and program data. The data will include numbers served, testing data, performance data that includes testing, outcomes, persistence, progression, and enrollment data. Additionally, data quality and professional development are monitored. Based upon monthly reviews, technical assistance is provided to programs.

2. Self-Assessment - for a select number of districts/programs, a self-monitoring report will be submitted to the department for review to determine compliance with grant/contract requirements.

3.  The state office of AEL also regularly evaluates the quality of providers. A number of programs are chosen for on-site review each year based on a revolving schedule and local risk factors. The reviews ensure that state and federal guidelines are followed, program performance is reviewed, and ongoing technical assistance to support improvement and continued compliance is provided. These reviews include assessment of the following areas:

a) Fiscal/program management and reporting

b) Certification and professional development requirements

c) Data entry and management

d) Assessment procedures

e) Intake and orientation processes

f) Teaching/classroom observation

g) Instruction

h) Recruitment and retention

i) Facilities

j) Program policies

k) Documentation requirements

Corrective Action: If any of the monitoring components reveal areas of noncompliance, the local provider will be required to submit a corrective action plan with the Adult Education state office. Ongoing technical assistance is provided by the state staff.

Vocational Rehabilitation

VR will assess its performance based upon the WIOA common performance measures as well as agency goals and objectives. The VR executive leadership team along with district office management reviews performance data on a monthly basis to determine progress toward goals and opportunities for improvement. VR’s case services and financial services work in tandem evaluating performance data for short- and long-term decision making. In addition, VR’s statewide quality assurance team evaluates case management providing guidance on program performance.