Narrative: f.

Local providers are accountable to LCTCS, WorkReady U to meet the standards of quality for administration and instruction as outlined by WorkReady U. Program effectiveness, services, and activities of local recipients of funds are assessed through a systematic evaluation of local programs.  Performance outcomes for each provider must meet or exceed the established levels of performance for each core measure each fiscal year to ensure the highest quality service to adult learners who participate in WorkReady U programs. WRU assesses the quality of providers of adult education and literacy activities through data reviews and on-site program reviews.

Performance Accountability assesses the effectiveness of grantees in achieving continuous improvement of adult education and literacy activities. The performance outcome measures shall consist of the following core indicators:

1. Measurable Skills Gains (MSGs);
2. The percentage of program participants who are in unsubsidized employment during the second quarter after exit from the program;
3. The percentage of program participants who are in unsubsidized employment during the fourth quarter after exit from the program;
4. The median earnings of program participants who are in unsubsidized employment during the second quarter after exit from the program;
5. The percentage of program participants who obtain either a recognized postsecondary credential or a secondary school diploma, or its recognized equivalent, during participation in or within one year of exit from the program;
6. The percentage of program participants who, during a program year, are in an education or training program that leads to a recognized postsecondary credential or employment and who are achieving measurable skill gains towards such a credential or employment; and
7. The indicators of effectiveness in serving employers established pursuant to clause (iv).

Setting Performance Targets

Each fiscal year Louisiana negotiates proposed target percentages for each of the core indicators of performance with the U.S. Department of Education, Office of Career, Technical and Adult Education (OCTAE). Each local eligible program is responsible for meeting or exceeding the negotiated performance targets. Each program shall analyze progress towards meeting the targets on an ongoing basis. Each program must utilize Louisiana-approved standardized assessments that provide the framework needed to measure program effectiveness.

Data Collection and Analysis

Local programs are required to collect data on the program’s performance and are required to analyze it to determine progress towards meeting the targets and areas of improvement. Analysis should include a review of academic, employment, secondary credential, and postsecondary measures. Local programs must assure that the National Reporting System of Adult Education data quality standards are met.

Program Evaluation

The State evaluates the effectiveness of the adult education and literacy activities, based on the core performance measures, through activities and processes listed below. Strategies, processes, and barriers to attaining the performance levels are reviewed, as well as qualitative and quantitative data.  The annual evaluation addresses the extent to which local providers implement the activities specified in Sections 225, 231, and 243 of the Workforce Innovation and Opportunity Act.

The purpose of these activities, strategies, and processes is to assess the effectiveness of the State to achieve continuous improvement of adult education and literacy activities and to optimize the return on investment of Federal funds in adult education and literacy activities.  The results of the evaluation will provide relevant information to determine the achievement of levels of performance for each of the core indicators for the local providers.

a. Data Collection.  The state-approved Management Information System (MIS) shall be used by all eligible entities receiving funds under this title.  Providers shall enter data monthly during a program year. Data will be reviewed for compliance with performance measures and expectations for the delivery of services as approved in the individual application. LCTCS and Louisiana Workforce Commission (LWC) will data match placement/wage data for students entered in the state-approved MIS.

LCTCS has instituted a comprehensive data system, Enterprise Resource Planning System (ERP), for all colleges. The ERP system will provide the capability to match data from disparate sources and produce analytical and actionable information to drive programmatic decisions.

b. Review Process.

Desk Monitoring: Desk monitoring is conducted once a year, at a minimum, by WRU staff.  Desk monitoring relies primarily on data that is collected and reported by local programs in the statewide approved data management system.  Using a structured format, local programs provide monthly data to the state office where state staff can review the data to guide program review activities, inform technical assistance, identify risk-assessment areas, and promote program improvement. The system can produce a series of reports that allow WRU staff to examine demographic, assessment, and academic information.

Programmatic/Fiscal Onsite Monitoring:  WRU staff conduct formal monitoring visits of funded programs on a prescribed schedule each year.  Programs are identified for onsite monitoring through a comprehensive risk analysis based on the following factors: (1) desk monitoring; (2) data quality and program expenditures; (3) consistent low performance on core indicators in several categories; (4) prospective non-compliance with grant requirements identified through review of programmatic and fiscal reports, or ongoing communications with the program; (4) unresolved audit findings; (5) ongoing lack of progress in resolving required actions from prior monitoring visit; (6) significant staff turnover in the program; and (7) recent or newly established programs.

The goals for State onsite monitoring visits are to (1) ensure that implementation of the program service/activities as outlined in the RFP have been fully executed; (2) ensure that programs meet AEFLA requirements; (3) improve the quality of federally-funded activities; (4) provide assistance identifying and resolving accountability problems; and (5) ensure the accuracy, validity, and reliability of data collection and data reporting as well as policies and procedures for program accountability.

Corrective Action Plan

Upon completion of the review, a formal written report will be provided to the program administrator.  If a program fails to meet performance goals or other state and/or federal programmatic requirements, a Corrective Action Plan (CAP) will be required to outline the course of action for program improvement.  The local program will be given a period of 30 days to respond in writing to the findings.  WRU provides technical assistance throughout the corrective process and by the end of a designated time frame, programs should be able to correct the identified issues, end their respective CAP and improve the quality of the program. WRU provides ongoing technical assistance, professional development, and other support until the required steps of the plans are completed.

Programs that fail to comply with grant requirements and regulations may not be eligible to receive funding in subsequent years of the cycle and/or funds may be terminated.

Evaluation of Professional Development

WorkReady U will assess the quality and effectiveness of its professional development activities through the feedback of its local programs (instructors, administrators, and support staff). Participant evaluations will be collected for all professional development activities. Participants will respond to items regarding:

• the training as a whole
  • objectives
  • materials
  • environment
  • presentation
• the immediate application in
  • classrooms
  • programs
  • workforce

State staff will review this information to plan for future training and potential technical assistance. The team will assess all professional development activities for:

• cost-effectiveness;
• return on investment;
• transferability of skills/knowledge; and
• the benefit of students/clients from Professional Development outcomes.

Connecting Professional Development to Program Improvement

WorkReady U will ensure that professional development directly contributes to local program performance improvement by:

1. Needs Assessments: Identifying PD needs based on program performance data and feedback from local providers.
2. Targeted Training: Offering PD activities that address specific needs, such as new instructional techniques, technology integration, and program management.
3. Follow-Up Support: Providing ongoing support and follow-up activities, including Communities of Practice and Training of Trainers, to reinforce learning and application of new skills.
4. Performance Monitoring: Continuously monitoring the impact of PD on program performance, adjusting strategies as needed to achieve desired outcomes.

By systematically evaluating and improving professional development efforts, Louisiana will enhance the quality of its adult education programs, ensuring better outcomes for learners and a stronger return on investment for federal funds.