Narrative: III. b. 4. C.

Representatives from the WIOA Steering Committee report results of Section 116 performance data to the Missouri Workforce Development Board as do the local WDBs. These results are used to assess program effectiveness of the core partners, one-stop partners and combined state partners. The WIOA Steering Committee uses this data to review trends, look for improvement opportunities and set program and policy direction. The primary responsibilities of the WIOA Steering Committee are to oversee the execution of the combined state plan, oversee and direct subcommittees focused on plan strategies and to evaluate partner performance on a quarterly basis to ensure the quality and effectiveness of service delivery to workforce system participants. The committee also utilizes performance outcomes and quality assessment information to implement strategies and best practices to improve any deficiencies.

MVR and RSB previously used federal standards and indicators to evaluate its performance. With the passage of WIOA, MVR and RSB are now utilizing the required performance indicators found in Section 116 of the Act for program evaluation. The review and analysis of this quarterly data is a valuable assessment tool and aids MVR and RSB in determining goal attainment as well as providing the opportunity for comparison across core partner agencies. MVR and RSB have adjusted their case management systems to support the common performance measures.

Until this plan period, MVR and RSB were only required to report baseline data for the first five performance indicators as performance data collection was not mandatory until PY 2017. The agencies used this transition period to establish baseline measures for future comparison points to aid in performance assessment. For the PY 2020 – 2023 state plan, MVR and RSB were required to only report an expected level of performance for measurable skill gains (MSG).

MVR and RSB use MSG to evaluate how well clients and employers are being served as MSG is a good measure of program effectiveness and success. MVR and RSB analyzed the following MSG data:

RSB

PY 2017: 74.3%

PY 2018: 49.5%

PY 2017 and PY 2018 Average: 61.9%

MVR

PY 2017: 15.9%

PY 2018: 18.0%

PY 2017 & PY 2018 Average: 17.0%

After reviewing its performance on indicator 5, MSG, MVR determined an increase of this measure is necessary. Missouri is working on strategies and developing recommendations to improve clients’ attainment of MSG. Based on PY 2017 and PY 2018 data, Missouri estimated its expected MSG level of performance for PY 2020 would be 18.0% and 18.5% for PY 2021. The agencies negotiated 20.0% for PY 2020 and 20.5% for PY 2021 with RSA.

In Fiscal Year (FY) 2019, 15,632 students enrolled in Adult Education, meaning they were pre-tested and persisted 12 hours or more out of a total of 18,239 reportable individuals, as reported through the Missouri Literacy Adult and Community Education System (LACES). This is an 86% persistence rate.

Also in FY 2019, 70% of the participants were administered post-tests, which is consistent with the previous three years.

In  FY 2019, 82% of post-tested students completed an educational functioning level or advanced to higher educational functioning levels, which is also consistent with the prior three years. Once again, we attributethis This high success rate is attributed to local AEL programs’ focus on quality instruction and preparation.

AEL conducted four on-site Technical Assistance technical assistance visits as well as five on-site reviews in FY 2019 for programs that were determined “at risk." On-site visits included monitoring class sites, interviewing students, teachers, and the director. The on-site visits also included going over the reported data for academic gain targets as well as reviewing fiscal information for the program.

OWD utilized the MoPerforms reporting system to track performance outcomes. OWD was not able to meet 90% of Credential Performance in PY 2018 but have significantly increased performance for PY 2019 and are well above expected performance level. In PY 2018 most local regions were failing (overall at 28.20%), but in PY 2019 there is no region that is failing this measure (now at 70.33%). To effect this change, OWD increased focus on data entry of education level and improved case management.

OWD also shared satisfaction survey results for both customers and business.

Business satisfaction survey results shared by OWD: 

2018  Avg. 74.5%

2019 Avg: 71%

Q1 2020: 81%

A tighter labor market in 2019 - number of candidates and availability of skill-specific job candidates - was often the primary rationale for a less than “Very Satisfied” response, as well as for the occasional Neutral response.  Overall, when combining “Very Satisfied” with “Satisfied” responses, employers told OWD they were “very satisfied” (95%) with the business services delivered through our Missouri Job Centers in 2018 and 2019.

OWD revised the Job Center Certification Issuance to create and centralize the Job Seeker job seeker customer surveys using the Survey Monkey platform. The 14 workforce regions disseminated improved surveys November 2019 after piloting them in their regions.

Job Seeker Satisfaction results have been very strong with a combined statewide “Very Satisfied” / “Satisfied” score of 97%. 

Efforts going forward will be on increased quantity of surveys collected across all regions and job centers as well as heightening interest and skill in the delivery of services from a satisfaction standpoint. 

In early 2020, the WIOA core partners met to design a "WIOA Partner Satisfaction Survey.” This will be completed by both frontline staff and leadership to determine cross-agency satisfaction with not only delivery of services to participants, but the level of engagement and collaboration between partners. These survey results will also be evaluated by the WIOA Steering Committee.

As of May 2020, all core partners have completed performance negotiations with their respective federal agencies; moving forward, progress toward these outcomes will be evaluated by the partners through the WIOA Steering committee.