Located in:
- Program-specific Requirements for Adult Education and Family Literacy Act ProgramsThe Unified or Combined State Plan must include a description of the following as it pertains to Adult Education and Literacy programs under title II, the Adult Education and Family Literacy Act (AEFLA).
f. Assessing Quality
Current Narrative:
RIDE evaluates programs quarterly through a desk audit by collecting data from its web-based database, the Comprehensive Adult Literacy Information System (CALIS). The data which is analyzed includes student demographics, attendance hours, posttest rates, educational functioning level gains, measurable skill gains, employment outcomes, high school credentials, and transitions to postsecondary education or training. RIDE has a data sharing memorandum of agreement with the RI Department of Labor and Training for employment outcomes. RIDE also conducts data matching with the National Student Clearinghouse database for the postsecondary education outcome and with the GED Testing Services database for GED attainment. The RIDE finance office provides the adult education office with a financial analysis of the amount and percentage of funds expended.
The CALIS database has the full array of National Reporting System (NRS) tables for adult education as well as several customized reports that both the state office as well as local program providers can run to check performance at the state level, program level, teacher level, and student level. These reports can determine areas of both strengths and weaknesses. The state office uses an Educational Functioning Level (EFL) Performance Review spreadsheet as a program-level report card that captures the real time EFL data from local providers in relation to the federally negotiated EFL targets. This spreadsheet allows the state office to determine how programs are doing at any moment in meeting and exceeding the state’s negotiated core indicator of EFL performance. Results for educational gains and follow-up outcome measures are calculated and then weighted by the number of students in each level, or cohort group, and converted into a final percentage expressing the provider’s ability in meeting or exceeding the core indicator targets.
The state has set a minimum of 80% achievement on the EFL Performance Review on the program’s final annual performance results. The EFL Performance Review is also checked in the middle of the fiscal year after the first semester posttests have been administered. Programs that fall below 80% receive technical assistance from the state office to ensure quality improvement. The lowest performing programs are targeted for two-day on-site program reviews, which include a review for compliance with federal and state laws and policies, classroom observations, interviews with program staff and students, and a full financial review. Following the site visit, the programs receive a report from the state office that indicates findings, recommendations, and commendations. Programs that receive any findings are required to submit a Corrective Action Plan on their process for correcting the findings. The Corrective Action Plan is tracked by the state office on a regular basis until all findings are addressed and corrected, the quality of the program improves, and the Corrective Action Plan is closed. The state offers high quality professional development opportunities to assist program directors to ensure program quality improvement and data analysis. Quarterly Leadership Institutes (all directors meetings) and monthly CALIS Users Group meetings are both facilitated by the state office.
The office of adult education also supports a statewide literacy resource center, the RI Adult Education Professional Development Center (PDC), established to improve instruction at all of the AEFLA-funded agencies in the state. The PDC has developed, in collaboration with the state office, a statewide system of professional development to support local activities, including specific focus points on reading instruction, contextualized curriculum as a component of a statewide Career Pathways system, the development of literacy volunteer training, and the increasing ability to virtually share promising practices and research based models. The PDC conducts several Professional Learning Community opportunities for program directors, instructors, and volunteers. Particular attention is given to program quality, proficiency based teaching and learning, transitions to college, learning disabilities, reading strategies and English language teaching strategies.
The PDC uses various evaluation methodologies, both formative and summative, depending on the activity type, to determine the effectiveness of programming. Use of these methodologies also ensures that continuous improvement remains a priority.
Activity Types and Evaluation Methods
| Activity Type | Formative Assessment Tools | Summative Assessment Tools | Guskey/ AALPD alignment |
|---|---|---|---|
| Professional Learning Communities (PLC’s) | Ongoing feedback through direct questioning throughout activities | Annual Survey to evaluate the past year’s curriculum, and to plan for following year’s agenda and curriculum | Guskey: 1 & 2 AALPD Standards: 1, 2, 3, 5, 6, 8, 9, 10 (and 11 for the Directors’) |
| One Time Workshops & Annual Conference | Ongoing feedback through direct questioning throughout activities |
| Guskey: 1, 2, 3 AALPD Standards: 1, 3, 5, 7, 8 |
| Institutes (STAR, LEA*, etc.) |
|
| Guskey: 1, 2, 3, 4 (and 5, if participants track the classroom outcomes of students through CALIS) AALPD Standards: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11 |
| Agency-based TA/ PD |
|
| Guskey: 1, 2, 3 (and 4 if follow-up sessions occur- implementation can then be identified and assessed) AALPD Standards: 1, 2, 3, 4, 5, 7, 8, 9 (and 6 if follow-up sessions occur) |
On-line surveys/ reports:
|
| Guskey: 1, 2, 3, 4 AALPD Standards: 3, 8, 10, 11 |
*Student Achievement in Reading, Leadership Excellence Academy
The current plan on resource sharing includes an annual dissemination and continual curation of proven models - primarily through an annual calendar which includes standards based initiatives, trainings on required standardized assessments and contextualized curriculum, New Practitioner Orientations, and professional learning communities among many other offerings.