U.S. flag

An official website of the United States government

Dot gov

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Https

Secure .gov websites use HTTPS
A lock () or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Plan: New York PYs 2024-2027
Combined Plan C

Section: WIOA State Plan Common Elements

Narrative: III. b. 4. B.

Published
Some content in this area is under revision.
Located in:
  • III. Operational Planning Elements

    The Unified or Combined State Plan must include an Operational Planning Elements section that supports the State’s strategy and the system-wide vision described in Section II(c) above.  Unless otherwise noted, all Operational Planning Elements apply to Combined State Plan partner programs included in the plan as well as to core programs.  This section must include—

III. b. 4. B. Previous Assessment Results

For each four-year state plan and state plan modification, provide the results of assessments of the effectiveness of the core programs and other one-stop partner programs and Combined State Plan partner programs included in the Unified or Combined State plan during the preceding 2-year period (i.e. the 2-year period of the plan modification cycle), in accordance with methods described in 4(A). Describe how the State is adapting its strategies based on these assessments.

Current Narrative:

At the conclusion of each fiscal year, report cards for each Title II-funded project are generated from the data in the MIS system and are reviewed and published by NYSED. In addition to measuring progress toward performance benchmarks, the NYS report cards quartile rank all funded programs.  Through this effort, programs are able to see their performance measures against federally negotiated benchmarks but are also able to scale their performance against all other similarly funded projects throughout the State. When a program’s performance places that program in Quartile 1 and the program has missed one (1) or more of the State benchmarks, the program is placed under Corrective Action.  The program is required to submit a program improvement plan and must correspond electronically on the accountability website.  Quarterly data reviews are conducted by the NRS Accountability Office and subsequent conference calls and/or web meetings are scheduled with those programs exhibiting poor performance or inconsistent data patterns.  

NYSED/ACCES-VR uses quarterly data reported to RSA to determine its effectiveness in meeting the performance measures under WIOA.  Data on employment rates 2nd and 4th quarter after exit and median earnings 2nd quarter after exit are obtained from NYSDOL UI data under an MOU.  These measures are reviewed and analyzed quarterly through case management system validation and the use of Power Bi, and are shared with District Offices indicating areas of strength and areas of improvement. 

Additionally, NYSED/ACCES-VR has developed tools to assist the management and staff in its District Offices to assess and evaluate performance as well as to identify specific strategies that may be needed for improvements by District Offices, regionally, and/or Statewide.  NYSED/ACCES-VR District Offices receive comprehensive reports of all findings of a review.  NYSED/ACCES-VR service vendors are also reviewed and provided with a comprehensive case review report that rates each area of service.  If any area falls under the defined compliance rate, a corrective action plan (CAP) is developed to address the deficit.  Guidance is provided through an in-person exit meeting when the findings and recommendations are shared.

OCFS/NYSCB is provided quarterly dashboards from RSA providing data on all performance measures. OCFS/NYSCB reviews that data quarterly and identifies areas of improvement and need. OCFS/NYSCB works with staff and partner agencies to identify strategies to address those needs through quarterly meetings and quality assurance reviews.

OCFS/NYSCB has also worked to implement a new case management system that will assist staff in better tracking and data collection to improve accurate reporting and allow OCFS/NYSCB Home Office to better identify areas of improvement and strategies to support staff in achieving these.

NYSDOL provides quarterly performance reports.  These reports include negotiated goals as well as cumulative information for the PY on participants, exiters, Q2 and Q4 employment rates, median earnings, credential attainment, measurable skills gains, and Adult Priority of Service performance for each LWDA and NYS.  NYSDOL also provides ad-hoc reports for self-evaluation at the request of LWDAs.  These reports allow the LWDA to keep track of its progress and highlight any areas that may need attention before they become a problem.  These reports also allow NYSDOL to see which areas are successful and which areas may need assistance.  If an area looks like it may fail to reach its goals, NYSDOL will reach out to determine if technical assistance or training could help.  If an area is successful, NYSDOL will reach out to document best practices.  These best practices are shared through training and regular meetings with LWDB Directors.

Program performance at the State level is assessed by using individual indicator scores, program scores, and State indicator scores.  State performance is considered unsatisfactory when any of the individual indicator scores fall below 50% for the PY, any program score falls below 90% for the PY, or any State indicator score falls below 90% for the PY.

Program performance at the local level is assessed using only the individual indicator scores and is limited to performance of the Title I programs.  Actual performance outcomes will be compared to the LWDB’s adjusted goals after the close of the PY to determine if local performance goals were achieved.  NYSDOL has set an unsatisfactory performance threshold at an outcome-to-goal ratio of less than 80% per indicator for a PY.  The LWDB must develop a Performance Improvement Plan (PIP) for unsatisfactory performance of an indicator in a PY.  NYSDOL will also provide technical assistance, which may include assistance in the development of the PIP and/or other actions designed to assist the local area in improving performance.  If a local area receives unsatisfactory performance for the same indicator for three (3) consecutive PYs, the Governor will take corrective action, which includes development of a reorganization plan.

Following PY 2022, NYSDOL conducted an analysis of the local areas’ Adjusted Goals to determine which failed one or more of the Primary Indicators of Performance, and would require a PIP.  In most instances, issues were found with the Credential Attainment and MSG indicators.  Requests for PIPs were sent to LWDBs in December 2023, requiring local areas to provide information on how they plan to increase performance in these measures throughout PY 2023.  NYSDOL has also attempted to assist local areas failing these measures by providing lists each quarter of customers in the Credential Attainment and MSG indicators so that data entry may be corrected where necessary, and therefore increase performance.

In its program oversight capacity, OTDA conducts TANF policy reviews on each district every one to four years depending on size, where samples of case-level data are reviewed to ensure recipients are being properly engaged in activities. After the reviews are complete, OTDA develops Corrective Action Plans for the districts to resolve any findings, which are then tracked for implementation. In the interim between reviews, OTDA also conducts regular visits to district employment offices and contracted provider sites to continue monitoring the services they offer from a program compliance standpoint. 

Starting in October 2024, as part of changes made under the federal Fiscal Responsibility Act of 2023, NYS’s TANF program will also be subject to new work outcomes that are similar to WIOA reporting measures. OTDA will be required to collect and report “performance indicator” data on TANF participants, including percentages of work-eligible individuals who maintain employment in the second and fourth quarters after exiting TANF, the median earnings of these individuals, and the percentage of TANF individuals under age 24 in high school or an equivalency program who graduate within one year after leaving TANF.

Partner programs have begun using these previous assessment results as a way to encourage further coordination and ensure services are being provided as seamlessly as possible.  For example, NYS has shifted focus to ensure Adult Priority of Service requirements are being met, and found that much greater collaboration could be taking place between local Social Service district offices and Career Centers.  To foster this, a Workforce Synergy Forum session specific to Adult Priority of Service was held in February 2024, with local area staff providing best practices for collaborating with their local district office and referring customers between partners.  Additionally, the core partners will be coming together over the life of this four-year Plan to collaborate on the shared business indicator, Effectiveness in Serving Employers, to continually assess outcomes and ensure all are successful in its Statewide and local implementation.