U.S. flag

An official website of the United States government

Dot gov

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Https

Secure .gov websites use HTTPS
A lock () or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Plan: Texas PYs 2024-2027
Combined Plan C

Section: WIOA State Plan Common Elements

Narrative: III. b. 4. A.

Published
Located in:
  • III. Operational Planning Elements

    The Unified or Combined State Plan must include an Operational Planning Elements section that supports the State’s strategy and the system-wide vision described in Section II(c) above.  Unless otherwise noted, all Operational Planning Elements apply to Combined State Plan partner programs included in the plan as well as to core programs.  This section must include—

III. b. 4. A. Assessment of Core and One-Stop Program Partner Programs.

Describe how the core programs will be assessed each year based on State performance accountability measures described in section 116(b) of WIOA. Describe how other one-stop delivery system partner program services and Combined State Plan partner programs included in the plan will be assessed each year. This State assessment must include the quality, effectiveness, and improvement of programs broken down by local area or provider. Such state assessments should take into account local and regional planning goals.

Current Narrative:

TWC regularly uses performance data to evaluate programs and partners. Additionally, TWC was an early implementer of the Common Measures and, in 2005, extended their use beyond that of Wagner-Peyser and WIA to cover other federal and state-funded workforce system programs. TWC realized that using the same measures and definitions across programs would help improve program evaluations and remove potential barriers to the integration of services by creating a common understanding of success.

TWC actively monitors the system through monthly, and in some cases, weekly, performance reports. Program staff reviews the reports and communicates with system partners, as appropriate, to provide technical assistance and obtain information on best practices to share with other partners.

To assess its programs and partners, TWC uses a system that compares performance to targets. The comparison establishes a “Percent of Target” for each measure, and, depending on where the Percent of Target falls within a given range, performance is rated as “Meeting” the target (MP) or as being either “Positive Performance” (+P) or “Negative Performance” (-P), as follows:

Performance Where “High is Good” (e.g., Number Served, % Reemployed within 10 Weeks, etc.) Where “Low is Good” (e.g., Aver. Cost, Weeks to Remploy, etc.)
Positive Performance (+P)more than 105% of Targetless than 95% of Target
Meeting Performance (MP)95–105% of Target95–105% of Target
Negative Performance (-P)less than 95% of Targetmore than 105% of Target

Regarding WIOA measures, however, the system has been modified to align more closely with federal standards:

 Performance RatingsWIOA Statutory Measures
Positive Performance (+P)more than 110% of Target
Meeting Performance (MP)90–110% of Target
Negative Performance (-P)less than 90% of Target

 

Target setting is a key part of TWC’s evaluation and accountability system. TWC’s I|3 Division uses a variety of models to help set performance targets based on assumed case mixes and economic conditions. The evaluation methods are continuously evolving based on input from partners through the negotiation process and additional research. The ongoing dialogue between TWC and its partners represents the agency’s commitment to continuous improvement.

WIOA requires continuous improvement, which TWC adheres to by setting targets in the areas of strength at a “maintenance” level to concentrate on improving in areas of lesser strength. In an environment of fewer resources or greater demand for similar resources, solely maintaining performance may represent an improvement in efficiency.

Developing effective statistical models to guide target setting helps improve program performance. WIOA requires that the US Secretaries of Labor and Education create statistical models to help set targets for WIOA performance indicators for Title I and Title III programs. Since 2019, TWC has embraced the use of Statistical Adjustment Models (SAMs) and has modified them to help ensure accountability among Boards for the common WIOA measures. Starting in 2022, TWC's I|3 Division began creating Performance Assessment Models (PAMs) that use internally produced state data structures to develop models to evaluate WIOA performance measures in Program Years 2024 and 2025, applicable to Titles I, II, III, and IV.

WIOA provides performance measures to evaluate the six core programs and system partners. Additionally, WIOA emphasizes the importance of career pathways that a person might follow over a period of many years. The performance measures and the joint performance reporting constructs are based on the notion that if an individual loses employment, they may use a one-stop system for a relatively short, finite period to find a job. The statutory measures do not recognize that post-exit enrollment in an education program is sometimes an appropriate outcome for non-youth, such as those who are transitioning out of the military and using their GI Bill benefits to attend school. Additionally, the statutory measures do not address whether exiters are able to retain employment, which is a key concern for TWC customers.

Although TWC applies the statutorily prescribed performance measures to assess performance across the six core programs, TWC also applies state-prescribed performance measures and—with input from Boards, grantees, and other partners—works to continuously develop and test other measures that may provide a more meaningful way of communicating strengths and identifying areas of improvement. For example, TWC developed a set of WIOA-based measures that focused on employment and enrollment in education post-exit. The measures addressed individuals who were employed or enrolled in the second quarter post-exit and individuals who remained employed or enrolled in the third and fourth quarters post-exit. TWC is also working to implement a set of new Meaningful Measures that focus on the connection between a worker and their employer and ensure that workers have the skills that employers need.

Although TWC’s current reports provide historic trend data that may help identify improvements over time, the findings are limited. As part of the Enterprise Data Warehouse (EDW) system, TWC is developing new ways to view, interact with, and evaluate data to identify the quality, effectiveness, and improvement made within programs operated by the state, Boards, and other grantees. The EDW has been instrumental in supporting fraud detection and prevention as well as helping Boards serve those impacted by the pandemic. An early example of this was the development of a Tableau-based claimant supply dashboard, which allowed Boards to further examine their customer populations and better understand their needs and status. In 2023, as part of its Career & Training Rosetta Initiative, TWC’s I|3 Division spearheaded the development of modern Tableau-based tools for Board-operated programs. TWC is currently remediating the Career & Training Rosetta to shift its source system to the newly launched case management system replacement, WorkInTexas.com. 

The Rosetta Initiative is being extended to create a WIOA Title IV-focused suite of products that will be launched in early PY’24.  WIOA Title II products will be launched toward the end of PY’24. Like the Career and Training Rosetta, the Title II and IV Rosettas will include a full suite of WIOA-based dashboards that will allow agency management and system front-line staff to monitor their performance and take actions where appropriate to ensure that performance expectations are met.

TWC applies the same assessment process to each of its workforce programs, including all WIOA core programs.  This process includes setting targets, applying targets, comparing performance to the targets, and determining whether the program met performance expectations.  The same methodology is also used to assess the performance of Boards and Title II grantees.