U.S. flag

An official website of the United States government

Dot gov

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Https

Secure .gov websites use HTTPS
A lock () or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Plan: Washington PYs 2020-2023
Combined Plan C

Section: Adult Education and Family Literacy Act Program

Narrative: f.

Published
Located in:

f. Assessing Quality

Describe how the eligible agency will assess the quality of providers of adult education and literacy activities under title II and take actions to improve such quality, including providing the activities described in section 223(a)(1)(B) of WIOA.

Current Narrative:

In addition to the WIOA Common Performance Measures, the monitoring and evaluation of the quality of, and improvement in, adult education and literacy activities and the dissemination of information about models and proven or promising practices within the state include the following current efforts in Washington:

  • Quarterly desk monitoring by SBCTC to identify coding issues, system reporting and program outcomes;
  • Biennial Data for Program Improvement (DPI) projects by each provider with the results being shared at various venues, e.g., Council for Basic Skills, committee meetings, trainings etc. Annually, providers are required to include local WDC and one-stop partners in DPI research;
  • Annual focused professional development based on system need, demonstrated through program monitoring visits and provider requests. Professional Development is offered regionally on topics related to the full implementation and continuation of WIOA required programming elements. Each session is followed with participant evaluation, which is reviewed and implemented to improve future training.  Also, SBCTC maintains full participant lists for all trainings to review and gauge provider participation and penetration on the topics;
  • SBCTC also conducts program monitoring visits for each provider every four years and provides ongoing technical assistance. In addition, regular fiscal reviews are done for all funded programs; and,
  • Washington State has established a nationally recognized, comprehensive Student Achievement Initiative(SAI) and performance accountability system comprised of measures to assess the effectiveness of all eligible agencies in achieving continuous improvement in adult education and literacy activities. The Student Achievement Initiative measures levels of performance against the core indicators in the Workforce Innovation and Opportunity Act and builds upon the Workforce Training and Education Coordinating Board Performance Management for Continuous Improvement (PMCI) system.

We also assess the quality of our professional development system. (See Leadership e.2 above.)  The State runs a variety of professional development activities based on WIOA technical and instructional priorities.  We use professionals from the system to assist in developing and running these professional development activities, which are offered in both face-to-face and virtual formats.  To assess the activities, we:

  • Distribute, collect, and review participant evaluations for each training. These are used to gauge the usefulness and relevance of the training to the attendees’ work and other topics they would like to see. This feedback is then used to improve future offerings and inform the next year’s professional development.
  • We review the number of participants registered and attending the trainings. This is used to identify interest, penetration of topics with local programs, and effectiveness of outreach. This then informs topics, offering locations, and methods dissemination in the future.
  • Yearly we have programs write a narrative report and include the professional development their staff attended, how this informed and improved their work with students, and ideas for future training. This is used to review the usefulness of topics to providers and improve the offerings and delivery for the next year.

Eligible Agency Performance Measures

The primary core indicator for measuring the effectiveness of adult education programs is performance in increasing the basic skills and college and career readiness of participants during each program year.

Federal student functioning level criteria are defined in the College and Career Readiness Standards (CCRS). These describe what the basic skills adult learners need to know and be able to do at each Adult Education and English Language Acquisition (ELA) level. Basic skills providers and WIOA partners use high school credit accrual or CASAS as the instrument to standardize protocols for accurately and consistently measuring substantive gain within and completion of Educational Functioning Levels (EFLs).

Performance measures consist of the core performance indicators that at a minimum measure the following:

  • Demonstrated improvement in or completion of EFLs in reading, writing, and speaking the English language, numeracy, problem solving, English language acquisition, and other literacy skills;
  • Placement in, retention in, or completion of postsecondary education, training, unsubsidized employment or career advancement; and,
  • Receipt of a secondary school diploma or its recognized equivalent.

Data is collected and reported through the Washington Adult Basic Education Reporting System (WABERS+). This provides valid, reliable, and consistent data for evaluating performance by all providers.

Upon entry into adult education and literacy programs, all basic skills adults participate in orientation and goal-setting and are screened with the CASAS appraisal exam or placed based on the number of high school credits the individual has upon entry. Students’ assessed entry levels are rarely the same for each discrete content area. For reporting purposes, each student’s entry competency level is their lowest EFL.

Local providers document initial placement, substantive gains, achievements, and completions of basic skills EFLs using mandated standard assessment protocols defined in the Washington State Adult Basic Education Assessment Policy. Data on Follow-up Measures (SPLs, HSD/HSE, entered postsecondary education/training, entered employment, and retained employment) as well as wage progression are obtained through data matching and will be available one year or more after an individual student’s actual participation in adult education and literacy programs.

The Washington State Legislature requires basic skills providers to calculate and report on a quarterly basis “substantive gains” in basic skills EFLs demonstrated by all participants. Substantive gains are defined as completion of an EFL, completion of a contextualized learning project, and/or the attainment of skills associated with a subject area within an EFL.

The SBCTC Research Department in collaboration with BEdA has developed an extensive series of dashboards that provide data on student and course enrollment, demographics, and student progress and completions customized to the reporting for Title II. The information is available in dashboard formats with multiple years. This provides access that allows Title II providers, students, the public, and workforce stakeholders 24/7 access to program data. Dashboards give system, provider, and program level data in both aggregate and disaggregated formats. SBCTC Research also provides focused analyses on Title II topical issues and conducts policy research on BEdA programming that can be used by both the BEdA Office and local providers to monitor programs.

Optional – Additional Indicators

Moving students up in the world – Washington’s nationally renowned Student Achievement Initiative (SAI) rewards colleges and approved community-based organization (CBO) providers for moving all students further and faster in college and increasing student success. Providers earn a portion of their funding based on results, not just enrollments. Providers earn points and funding when students reach key academic momentum points, such as significant basic skills gains, attaining a high school diploma or equivalency certificate, finishing college-level math, completing the first year of college, or earning a degree or certificate. The goal is to propel students to and through the “tipping point” – the level of education that means the difference between struggling in a low-wage job and having a viable career.

Moving students past basic skills and into college – The new approach recognizes that students who have below high school level math, reading and English language skills have a more challenging educational journey. Under this approach, basic skills students who reach academic milestones will be awarded one point more than other students who reach the same levels.

How will momentum points be calculated?

Starting in the 2017-2018 school year, points are awarded each time a college student reaches one of the following momentum points:

Image removed.

1. Basic Skills: Nationally recognized test gains in math, English language, or reading measured by pre- and post-testing as well as competency-based assessments; achieving a high school diploma or equivalency; successful completion of six college-level credits.
2. 15 College Credits (an extra momentum point is added if the student started in Basic Skills, and historically underserved low-income and students of color received additional point upon successful completion of first 15 college credits or apprenticeship completion)
3. 30 College Credits (an extra momentum point is added if the student started in Basic Skills)
4. College-Level English/Communication
5. College Math (an extra momentum point is added if the student started in Basic Skills)
6. 45 College Credits (an extra momentum point is added if the student started in Basic Skills)
7. Completions (an extra momentum point is added if the student started in Basic Skills)

Colleges earn achievement points every time a student reaches a certain level of achievement. These levels of achievement are called momentum points because each achievement is likely to propel students to another achievement.

SAI momentum points work in succession. The steps are:

  • Momentum points start with basic skills students. Colleges earn points when basic skills students make nationally recognized level gains in math, English language, or reading as measured by pre- and post-testing or competency-based High School Credit assessments. Students also earn momentum points by earning a high school diploma or equivalency certificate as well as upon completion of six college-level credits.
  • The next momentum points are completion of the first 15 and 30 college credits.
  • The next momentum point is completion of five college-level credits in English or writing.
  • The next momentum point is completion of five college-level math credits in computation, math or logic.
  • The next momentum point is completion of 45 college credits in either an academic transfer or professional-technical pathway, which is one year.
  • The final momentum point is completion of certificates, degrees and apprenticeships.

In addition, the state recognizes the achievement gaps of our historically underserved students and have followed best practice policy recommendations in performance-based funding by providing a focus on these populations. Basic Skills students, low-income, and students-of-color receive additional points when achieving certain milestones. These milestones include the first 15 college-level credits and completion of apprenticeship awards and associate degrees.

*If the student reaching this momentum point started in basic skills, an additional point will be awarded.