Narrative: f.

ODCTE will evaluate annually the effectiveness of adult education and literacy programs. The annual evaluation is designed to measure the ability of local programs to meet or exceed the established performance levels based on the federal and state Core Indicators of Performance as well as their ability to reach high standards related to Oklahoma’s Indicators of Program Quality and the criteria for funding. Annual evaluation activities will include the following:

1. Performance results achieved on each of the federal and state Core Indicators of Performance will be compiled and compared to the ODCTE’s performance levels negotiated with the United States Department of Education. Progress towards meeting the levels of performance will be tracked through the LiteracyPro Management Information System (MIS) which has been adopted for use statewide by Oklahoma’s adult education and literacy programs. LiteracyPro allows local programs to collect, compile, and report student identification and demographic information, contact hours, placement level at program entry, learning goals, pre and post testing information, student progress and follow-up, and other needed information. ODCTE will build on the National Reporting System (NRS) pilot to identify strategies that local providers can use to obtain follow-up information in students who leave the program and obtain employment, retain employment or job advancement, enter post-secondary education or job training programs, and/or obtain a high school equivalency. These strategies may include sampling techniques which conform to ODCTE’s specifications as identified in the annual performance report and approved by the Office of Management and Budget.

2. On-site evaluations of at least four local programs will be conducted annually. The on-site evaluations will be conducted by a review team consisting of state adult education and literacy staff members, local adult education professionals and/or Title I partners, if appropriate. The on-site evaluations will consist of an entry interview with the local program directors and one or more adult education teachers, a review of documentation which supports the Core Indicators of Performance, the Indicators of Program Quality, and the criteria for funding, visits to adult education classes, student interviews, and an exit interview. Based on the findings of the on-site evaluation, a final evaluation report detailing program strengths and recommendations for improvement will be completed for each program reviewed.

3. ODCTE will perform desk-top monitoring of all local adult education and Literacy programs throughout the entire fiscal year. Based on any potential non-compliant findings of the desktop monitoring, on-site evaluations will be conducted. Monitoring and evaluation of adult education and literacy activities will be conducted through program monitoring visits for each provider and ongoing technical assistance. Regular fiscal reviews for all funded programs will also be conducted. The ODCTE will follow its risk assessment policy and its new monitoring policy. Monitoring visits will regularly be conducted to check student records and other data, support for the ABE program by the organization, staff development, instruction and curriculum, testing, and other areas.

4. The development and implementation of professional development based on the most rigorous or scientifically valid research available and appropriate, in reading, writing, speaking, mathematics, English language acquisition programs, distance education, and staff training will be provided throughout the state. An annual needs assessment will assist in determining PD offerings. The ABE division of the ODCTE will evaluate the professional development through informal and formal surveys and student data to evaluate effectiveness. The surveys utilized will assist the ODCTE in evaluating its professional development activities by allowing feedback from eligible providers. This feedback will be used to improve future professional development activities as well as assist the ODCTE in determining future professional development topics.