Table of Contents
Test Vehicles for Accountability: State Developments
However, while the federal government failed to boost accountability, state governments have embarked on an ambitious, albeit controversial, effort to hold public institutions accountable through performance- or outcomes-based funding (OBF) mechanisms. At least 29 states had such policies in place last year, with several more actively considering, transitioning to, or adopting this approach.1 This is significant in light of the fact that almost three out of four students (73 percent) attend public institutions.2 While there is considerable debate about the impact of such efforts, both intended and unintended, their adoption signals the recognition for greater accountability at the state level. Moreover, given the historical role of states in education policy as laboratories of reform and innovation, this trend merits attention and could help contribute to accountability at the federal level by yielding insights and suggestions about the priorities and overall direction of an accountability system.
The growth of such policies reflects the ongoing search for higher education outcomes-driven accountability at the state level. In 2010, the National Governors Association (NGA) and Complete College America (CCA) announced a core set of metrics of college completion, including progress and outcomes data (see Table 2), which expanded on measures already required by the U.S. Department of Education for financial aid eligibility.3 The metrics are now reflected in the accountability reporting systems of 33 states4 and NGA recommended that states disaggregate performance data according to academic preparation, income, age, and race/ethnicity.
Table 2: Governors’ Task Force on College Completion (NGA/CCA) Metrics (2011)
| Progress Metrics | Outcome Metrics |
|---|---|
| Enrollment and success in remedial education programs | Degrees awarded (annual) |
| Success in first-year college courses (English and math) | Graduation rates |
| Credit accumulation | Transfer rates |
| Retention rates | Time and credits toward degrees |
| Course completion |
The states’ focus on completion is certainly reflected in OBF policies. Two recent analyses by Third Way and HCM Strategists (see Table 3) found that completion is the most prevalent outcome measured by states, followed closely by equity, with priority populations defined primarily as low-income students. Completion metrics are used in the OBF systems of almost all states that employ such a policy. Interestingly, labor market outcomes (such as wages and job placement) are not widely used, not even at the two-year college level; this could be in large part because of challenges in accessing the data necessary to accurately measure labor market success.
Table 3: Metrics Categories in State Outcome-Based Funding Models (2018)
| Four-Year (# of States) | Four-Year (# of States) | Two-Year (# of States) | Two-Year (# of States) | |
|---|---|---|---|---|
| Third Way | HCM | Third Way | HCM | |
| Completion | 20/21 | 17/18 | 25/25 | 19/22 |
| Equity | 17/21 | 16/18 | 19/25 | 19/22 |
| Labor market outcomes | 2/21 | 3/18 | 9/25 | 8/22 |
Overall, while the specifics vary widely among states implementing OBF policies, it is nonetheless quite significant that completion and equity are the top metrics used, reflecting the policy priorities for accountability. As we examine next the appropriate federal accountability framework and metrics, it is helpful to take into consideration the direction states have taken in choosing their categories of metrics and the priority areas chosen by state policymakers, as a significant portion of public colleges and universities operate under such OBF policies.
Citations
- Amy Y. Li, Lessons Learned: A Case Study of Performance Funding in Higher Education (Washington, DC: Third Way, 2018), source; and Martha Snyder and Scott Boelscher, Driving Better Outcomes: Fiscal Year 2018 State Status & Typology Update, (Washington, DC: HCM Strategists, 2018),source
- Institute of Education Sciences, National Center for Education Statistics (website), “Digest of Education Statistics,” Table 303.20, November 2017, source
- Travis Reindl and Ryan Reyna, From Information to Action: Revamping Higher Education Accountability Systems (Washington, DC: National Governors Association Center for Best Practices, 2011), source
- Jane Wellman and Darcie Harvey, Recent Statewide Reforms in Higher Education Financing and Accountability: Emerging Lessons from the States (Oakland, CA: College Futures Foundation, 2016), source