U.S. flag

An official website of the United States government

Dot gov

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Https

Secure .gov websites use HTTPS
A lock () or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

2 Year Modification

Plan: Texas PYs 2022-2023 (Mod)
Combined Plan C

Section: WIOA State Plan Common Elements

Narrative: III. b. 4. A.

Published
Located in:
  • III. Operational Planning Elements

    The Unified or Combined State Plan must include an Operational Planning Elements section that supports the State’s strategy and the system-wide vision described in Section II(c) above.  Unless otherwise noted, all Operational Planning Elements apply to Combined State Plan partner programs included in the plan as well as to core programs.  This section must include—

III. b. 4. A. Assessment of Core Programs

Describe how the core programs will be assessed each year based on State performance accountability measures described in section 116(b) of WIOA.  This State assessment must include the quality, effectiveness, and improvement of programs broken down by local area or provider.  Such state assessments should take into account local and regional planning goals.

Current Narrative:

TWC has a strong commitment to the use of performance data to evaluate programs and partners. TWC was an early implementer of the Common Measures and in 2005 extended them beyond Wagner-Peyser and WIA to cover other federal and even state-funded workforce system programs. TWC realized that using the same measures and definitions across programs helped improve program evaluations and removed potential barriers to integration of services by creating common definitions of success.

TWC actively monitors the system through monthly, and in some cases, weekly performance reports. Program staff reviews these reports and communicates with system partners as appropriate to provide technical assistance and obtain information on best practices to share with other partners.

One of the key ways that TWC evaluates programs and partners is by comparing performance to targets. TWC has adopted a system by which performance is compared against performance targets to establish a “Percent of Target” for each measure, and depending on where the Percent of Target falls within a given range, performance is rated as “Meeting” the target (MP) or as being either “Positive Performance” (+P) or “Negative Performance” (-P), as follows:

 Where “High is Good” (e.g., Number Served, %                      Reemployed within 10 Weeks etc.)Where “Low is Good” (e.g., Avg Cost,             Weeks to Reemploy, etc.)
Positive                                        Performance (+P)more than 105% of Targetless than 95% of Target
Meeting                                         Performance (MP)95-105% of Target95-105% of Target
Negative Performance             (-P)less than 95% of Targetmore than 105% of Target

For WIOA measures, however, we have modified this system to align more closely with federal standards:

 WIOA Statutory Measures
Positive Performance (+P)more than 110% of Target
Meeting Performance (MP)90-110% of Target
Negative Performance (-P)less than 90% of Target

This makes target-setting a key part of the evaluation and accountability system. TWC’s I|3 uses a variety of different models to help set performance targets based upon assumed case mixes and economic conditions. These methods continuously evolve based on input from partners through the negotiation process and additional research. This dialog between TWC and its partners represents an important component of continuous improvement.

WIOA, like WIA before it, requires working toward continuous improvement. However, continuous improvement does not simply mean that the system needs to do better on all things every year. Continuous improvement is not as simple as always setting targets a little bit higher than the prior year’s results. The system is better served by setting targets in the areas of great strength at a “maintenance” level to concentrate on improving in areas of lesser strength. In an environment of fewer resources or greater demand for similar resources, simply maintaining performance can represent improvement—improvement in efficiency.

The fact that we operate in a dynamic system makes the development of effective statistical models to guide target setting so important. WIOA provides that the Secretaries of Labor and Education will develop a set of statistical models to help set performance targets for the WIOA measures. As presented at DOL’s Spring 2019 WIOA Performance Meetings in Chicago and Dallas, TWC has embraced use of the federal Statistical Models and modified them to help ensure accountability among local workforce Boards and are pleased that DOL and USED have provided statistical adjustment modeling for all five of the common WIOA participant/exiter-based measures.

The statute provides a set of performance measures to evaluate the six core programs and system partners. The workforce system in 2021 is very different than it was when the WIOA measures were initially developed. WIOA places great emphasis on the importance of the career pathways that a person might follow over a period of many years, while the performance measures and the joint performance reporting constructs are based on the notion of a person losing employment and coming to the one-stop system for a relatively short, finite period, after which they find a job and leave so that his or her outcomes can be measured. The statutory measures do not recognize that post-exit enrollment in education is sometimes an appropriate outcome for non-Youth such as those who are transitioning out of the military and using their GI Bill benefits to attend school. Additionally, the statutory measures do not address the question of whether exiters are able to retain employment even though that is a key concern for TWC customers.

Therefore, while TWC applies the statutorily prescribed performance measures to assess performance across the six core programs, TWC also applies state-prescribed performance measures and—with input from local Boards, grantees, and other partners—will continually develop and test other measures that may provide a more meaningful way of communicating strengths and identifying areas of improvement. For example, TWC developed a set of WIOA- based measures that that focus on either employment or enrollment in education post-exit, regardless of the program, and a retention-like measure that focuses on those employed or enrolled in quarter 2 post-exit, and to see whether they remain employed or enrolled in quarters 3 and 4, post-exit. TWC also plans to return to working on a set of performance measures that focus more on the employment connection made between a worker and employer.

While TWC’s current reports provide some historic trend data to identify improvements over time, they are limited. As part of the Enterprise Data Warehouse (EDW) system, TWC is developing new ways to view, interact with, and evaluate data to identify the quality, effectiveness, and improvement in programs operated by the state, our Boards, and other grantees. The EDW has been instrumental in supporting fraud detection and prevention as well as helping Boards serve those impacted by the pandemic.  An early example of this was the development of a Tableau-based claimant supply dashboard, which allowed local Boards to further examine their customer populations and better understand their needs and current status.