U.S. flag

An official website of the United States government

Dot gov

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Https

Secure .gov websites use HTTPS
A lock () or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Plan: Washington PYs 2016-2017
Combined Plan C

Section: Adult Education and Family Literacy Act Program

Narrative: f.

Published
Located in:

f. Assessing Quality

Describe how the eligible agency will assess the quality of providers of adult education and literacy activities under title II and take actions to improve such quality, including providing the activities described in section 223(a)(1)(B) of WIOA.

Current Narrative:

Assessing the Quality of Providers In addition to the WIOA Common Performance Measures, the monitoring and evaluation of the quality of, and improvement in, adult education and literacy activities and the dissemination of information about models and proven or promising practices within the state include the following current efforts in Washington: • Quarterly desk monitoring by SBCTC to identify coding issues, system reporting accuracy and progress toward meeting program targets and outcomes. Providers are contacted immediately if any compliance issues are found. A virtual desk review is then scheduled so that appropriate technical assistance can be provided. Follow up continues until issues are resolved. • Bi-annual Data for Program Improvement (DPI) projects by each provider with the results being shared at various venues, e.g. Council for Basic Skills, committee meetings, trainings etc. Annually, providers will be required to include local WDC and one-stop partners in DPI research. • SBCTC conducts program review and technical assistance on-site visits for each provider every four years. Technical assistance is offered during a visit to the extent time allows. Providers receive a detailed letter noting commendations, recommendations, and any findings noted during the visit. Follow up on findings can include another visit by the review team, regular desk audit reviews with the program dean or director, and/or connecting a program to other staff with special program knowledge. • SBCTC provides ongoing technical assistance through the WABERS+ Helpdesk, site visits not related to monitoring, and frequent contact over phone and email. In addition, SBCTC provides several listservs and online collaborative spaces to engage communities of practice and reinforce program quality. SBCTC publishes and maintains thorough documentation of federal, state, and local requirements through its website (www.sbctc.edu) and its applications (e.g. WABERS+). • SBCTC conducts regular fiscal and risk assessment reviews for all funded programs and issues are addressed in a corrective action plan as necessary. • Washington State has established a nationally recognized, comprehensive Student Achievement Initiative (SAI) and performance accountability system comprised of measures to assess the effectiveness of all eligible agencies in achieving continuous improvement in adult education and literacy activities. The Student Achievement Initiative measures levels of performance against the core indicators in the Workforce Investment Act and builds upon the Workforce Training and Education Coordinating Board Performance Management for Continuous Improvement (PMCI) system. At the conclusion of a review process, any findings require the provider to create a corrective action plan (CAP). Providers submit a CAP for all areas out of compliance and SBCTC will follow up to ensure appropriate resolution. BEdA also encourages providers to consider and adapt program improvement recommendations included in Program Review and Technical Assistance letters.

Finally, prior to awarding funds each federal grant sub-recipient’s risk is assessed for compliance with Federal statutes and regulations. SBCTC may take the following steps with a provider that is considered a higher risk to fund: • Add program and fiscal requirements • Schedule more frequent Program Review and Technical Assistance visits • Withhold grant funds until compliance issue(s) resolved • Reduce the grant award • Completely defund a provider

Eligible Agency Performance Measures The primary core indicator for measuring the effectiveness of adult education programs is performance in increasing the basic skills and college and career readiness of participants during each program year. Federal student functioning level criteria are defined in the College and Career Readiness Standards (CCRS). These describe what the basic skills adult learners need to know and be able to do at each Adult Education and English Language Acquisition (ELA) level. Basic skills providers and WIOA partners use CASAS as the instrument to standardize protocols for accurately and consistently measuring substantive gain within and completion of Educational Functioning Levels (EFLs). Performance measures consist of the core performance indicators that at a minimum measure the following: • Demonstrated improvement in or completion of EFLs in reading, writing, and speaking the English language, numeracy, problem solving, English language acquisition, and other literacy skills. • Placement in, retention in, or completion of postsecondary education, training, unsubsidized employment or career advancement. • Receipt of a secondary school diploma or its recognized equivalent.

Data is collected and reported through the Washington Adult Basic Education Reporting System (WABERS+). This provides valid, reliable, and consistent data for evaluating performance by all providers. Upon entry into adult education and literacy programs, all basic skills adults participate in orientation and goal-setting and are screened with the CASAS appraisal exam. Students’ assessed entry levels are rarely the same for each discrete content area. For reporting purposes, each student’s entry competency level is her or his lowest EFL. Local providers document initial placement, substantive gains, achievements, and completions of basic skills EFLs using mandated standard assessment protocols defined in the Washington State Adult Basic Education Assessment Policy. Data on Follow-up Measures (SPLs, HSD/HSE, entered postsecondary education/training, entered employment, and retained employment) as well as wage progression are obtained through data matching and will be available one year or more after an individual student’s actual participation in adult education and literacy programs. The Washington State Legislature requires basic skills providers to calculate and report on a quarterly basis “significant and substantive gains” in basic skills EFLs demonstrated by all participants. Significant gains for each program year are defined as either a 5-point score gain for students starting with an initial CASAS assessment score of 210 or below or a 3-point score gain for students starting at a CASAS assessment score of 211 or above. Substantive gains are defined as completion of an EFL, completion of a contextualized learning project, and/or the attainment of skills associated with a subject area within an EFL.

Assessing the Effectiveness of Professional Development The effectiveness of Washington States professional develop activities are comprehensively assessed. The results of the implementation of instructional and curricular actions implemented as a result of trainings are assessed through the monitoring process described above. The trainings themselves are assessed at the: • Local level with individual training assessment tools that record participants’ feedback and additional training need. Assessments are then scanned and stored electronically to guide future training needs and improvements; • Program level through in-depth monitoring and TA visits that assess student progression and completion and the implementation of data flow processes and program and curriculum development that support the required and permissible activities; • Program and system levels through the required Data for Program Improvement research projects (DPI) that are developed, executed, and final analysis submitted for every program annually. These are reviewed and technical assistance provided as needed by SBCTC. The DPI requirement ensures that providers assess their programs on an on-going basis and address the needs that arise through the extensive data collection to inform program design and increased student success; • The state level through the required annual, yearend federal reports summited by providers that outline the positive and negative results of the implementation of professional development initiative implemented with leadership funding at the local program level. These reports are reviewed and assessed for quality of programming and data collection and inform the monitoring process; and • The state level, professional development is evaluated and assessed by monitoring the implementation, growth and success of new programming as well as student progression, completion, and transition. SBCTC data and research departments play a critical role in collecting system wide data for assessment and planning.

Optional – Additional Indicators Moving students up in the world – Washington’s nationally renowned Student Achievement Initiative (SAI) rewards colleges and approved community-based organization (CBO) providers for moving all students further and faster in college and increasing student success. Providers earn a portion of their funding based on results, not just enrollments. Providers earn points and funding when students reach key academic momentum points, such as significant basic skills gains, attaining a high school diploma or equivalency certificate, finishing college-level math, completing the first year of college, or earning a degree or certificate. The goal is to propel students to and through the “tipping point” – the level of education that means the difference between struggling in a low-wage job and having a viable career. Moving students past basic skills and into college – The new approach recognizes that students who have below high school level math, reading and English language skills have a more challenging educational journey. Under this approach, basic skills students who reach academic milestones will be awarded one point more than other students who reach the same levels. How will momentum points be calculated? Starting in the 2013-2014 school year, points will be awarded each time a college student reaches one of the following momentum points. Financial awards will be distributed in October of 2014. *If the student reaching this momentum point started in basic skills, an additional point will be awarded.