Located in:
- III. Operational Planning ElementsThe Unified or Combined State Plan must include an Operational Planning Elements section that support the State’s strategy and the system-wide vision described in Section II.(c) above. Unless otherwise noted, all Operational Planning Elements apply to Combined State Plan partner programs included in the plan as well as to core programs. This section must include—
- b. State Operating Systems and PoliciesThe Unified or Combined State Plan must include a description of the State operating systems and policies that will support the implementation of the State strategy described in Section II Strategic Elements . This includes—
- b. State Operating Systems and Policies
III. b. 4. A. Assessment of Core Programs
Current Narrative:
TWC has a strong commitment to the use of performance data to evaluate programs and partners. TWC was an early implementer of the Common Measures and in 2005 extended them beyond Wagner-Peyser and WIA to cover other federal and even state-funded workforce system programs. TWC realized that using the same measures and definitions across programs helped improve program evaluations and removed potential barriers to integration of services by creating common definitions of success.
TWC actively monitors the system through monthly, and in some cases, weekly performance reports. Program staff reviews these reports and communicates with system partners as appropriate to provide technical assistance and obtain information on best practices to share with other partners. TWC’s Commissioners hold open, posted, performance and financial briefings on a quarterly basis. TWC has continued these effective practices under WIOA.
One of the key ways that TWC evaluates programs and partners is by comparing performance to targets. TWC has adopted a system by which performance is compared to target to establish a “Percent of Target” for each measure, and depending on where the Percent of Target falls within a given range, performance is rated as “Meeting” the target (MP) or as being either “Positive Performance” (+P) or “Negative Performance” (-P), as follows:
| Where “High is Good” (% Employed, Median Earnings, etc.) | Where “Low is Good” (Avg Cost, Weeks to Reemploy, etc.) | |
|---|---|---|
| Positive Performance (+P) | more than 105% of Target | less than 95% of Target |
| Meeting Performance (MP) | 95-105% of Target | 95-105% of Target |
| Negative Performance (-P) | less than 95% of Target | more than 105% of Target |
This makes target-setting a key part of the evaluation and accountability system. TWC’s DOI uses a variety of different models to help set performance targets based upon assumed casemixes and economic conditions. These methods continuously evolve based on input from partners through the negotiation process and additional research. There is no question that this dialog between TWC and its partners represents an important component of continuous improvement.
WIOA, like WIA before it, requires working towards continuous improvement. However, continuous improvement does not simply mean that the system needs to do better on all things every year. Continuous improvement is not as simple as always setting targets a little bit higher than the prior year’s results. Such a simplistic notion operates under the assumption that other than our results, the system is static, that our customers never change, that our economy never changes, that our funding never changes, that the law of diminishing returns does not apply to the workforce system. The reality is that these things do change, and performance in some areas eventually reaches the point of diminishing returns. When that happens, the system is better served by setting targets in the areas of great strength at a “maintenance” level to concentrate on improving in areas of lesser strength. In an environment of fewer resources or greater demand for similar resources, simply maintaining performance can represent improvement—improvement in efficiency.
It is precisely the fact that we operate in a dynamic system that makes the development of effective statistical models to guide target setting so important. WIOA provides that the Secretaries of Labor and Education will develop a set of statistical models to help set performance targets for the WIOA measures. TWC will use those models as a tool to help it evaluate programs and partners. However, we are concerned that these national models will not be equally accurate for all states; they cannot be because local labor markets are different. Speaking Spanish-only has a lesser impact on employment outcomes in states with large bilingual populations than states where Spanish speaking is far less common. A change in employment in the oil and gas industry may have a huge economic impact in Texas or North Dakota but have little relevance to Illinois performance. As such, TWC will continue to develop its own performance models to use in addition to the national models.
However, while the statute provides a set of performance measures to evaluate the six core programs and system partners, these measures are certainly not the only measures of evaluating the system, nor are they even the best such measures. In addition to having far too much lag to be useful for management purposes, most of the WIOA measures were developed by an National Governors Association workgroup in 2004. The reality is that the workforce system in 2015 is very different than it was in 2004. The job search/recruitment assistance options that job seekers and employers had in 2004 were far more limited than they are today. WIOA places great emphasis on the importance of the career pathways that a person might follow over a period of many years, while the performance measures and the Departments’ proposed reporting constructs are based on the notion of a person losing employment and coming to the one-stop system for a relatively short, finite period, after which they find a job and leave so that his or her outcomes can be measured.The statutory measures also do not recognize that post-exit enrollment in education is sometimes an appropriate outcome for non-Youth such as those who are transitioning out of the military and using their GI Bill benefits to attend school. Additionally, the statutory measures do not address the question of whether exiters are able to retain employment even though that is a key concern for TWC customers.
Therefore, while TWC will apply the statutorily prescribed performance measures to assess performance across the six core programs, TWC will also apply state-prescribed performance measures and—with input from local Boards, grantees, and other partners—will continually develop and test other measures that may provide a more meaningful means of communicating strengths and identifying areas of improvement. Examples include a set of WIOA-based measures that TWC developed that focus on either employment or enrollment in education post-exit, regardless of the program, and a retention-like measure that focuses on those employed or enrolled in quarter 2, post-exit, and to see whether they remain employed or enrolled in quarters 3 and 4, post-exit. TWC also plans to return to working on a set of performance measures that focus more on the employment connection made between a worker and employer during the state plan period.