Findings
Existing research on micro-credentials is lacking. Several organizations have published questions for states and LEAs interested in incorporating MCs to consider as they begin the process,1 but few have provided concrete direction to education leaders in approaching this work. Even the design, assessment, and implementation principles for educator MCs released in 2020 by a task force convened by the Chief Council of State School Officers2 (CCSSO)—a nonprofit composed of leaders of U.S. state K–12 education systems—were intentionally left high-level (see full principles list in Appendix B).
Our findings fill this research gap across four key areas: (1) designing and assessing MC offerings; (2) putting educator MCs into practice; (3) developing and implementing state and local policies; and (4) measuring impact on teacher practice and student learning.
First, we provide a comprehensive review of the national landscape, highlighting the similarities and differences that exist within the MCs offered that meet most, if not all, of the CCSSO-developed principles.3 (See a summary of Similarities and Differences within the Educator Micro-credential Ecosystem in Appendix C).
We also offer deep analysis of what has—and has not—led to successfully meeting various policy and practice objectives with educator MCs, in order to provide lessons and best practices to guide future MC efforts.
1. Designing and Assessing Micro-credential Offerings
Landscape Overview
One of the core characteristics that distinguishes a MC from other tools tied to PD and advancement is its assessment component. Nearly every entity engaging with educator MCs agreed that high-quality MCs were a demonstration of competency, but their perspective on what type of evidence is necessary to demonstrate that competency varied. Currently, the assessment of educator knowledge and competence can take several forms. From shallowest to deepest, it could measure: “whether an educator understands an idea or concept, can apply the idea or concept in a mock setting, can implement the idea or concept in the classroom, or can reflect on [their] experience using the idea or concept.”4 Likewise, the type of evidence that an educator would need to provide for each of these assessment types varies.
This is another area where different definitions and uses of terms can cause confusion. For example, even many entities who would agree that “implementation of practice” is a necessary component of the MC often are typically only asking for evidence of “application of competency” as defined above.
Some entities require even greater depth of evidence beyond employing the skill on one discrete occasion (or with one discrete MC) to ensure that the teacher has truly incorporated the competency into instructional practice. This can take the form of issuers requiring longitudinal evidence rather than “point-in-time” evidence. For example, BloomBoard and Digital Promise try, when possible, to require submitted articles of evidence from multiple points in time during the implementation process.5 For a single MC, they may require that a teacher submit a pre-implementation survey or data, then proof of implementation (perhaps a video of practicing that skill in class), and subsequent post-implementation data highlighting impact.
Most MC providers want teachers’ development of evidence to be a professional learning experience in itself. To this end, most providers refrain from providing specific examples of what successful artifacts look like in order to prevent teachers from just trying to recreate the example without significant work and reflection. Instead, providers attempt to set appropriate expectations for what successful submissions should entail by sharing the rubric used to assess the evidence. The level of detail in assessment rubrics varies, with some issuers providing specific descriptions of what the assessors are looking for, and others appearing to just repeat the objective of the competency (e.g., for a “checking for understanding” MC, simply indicating that to earn the MC, the candidate must demonstrate an adequate understanding of the key facets of checking for understanding). When a rubric lacks clarity and detail, it can be difficult for the educator to know (and meet) a given MC’s expectations.
Attempts to ensure quality of the individual assessors differs in many ways, from requiring demonstrated expertise in the competency (often by completing one or more MCs themselves, as Kettle Moraine School District in Wales, Wisconsin does), engaging in formalized training on using the specific MC’s rubric (as BloomBoard, Teaching Matters, etc., do), to initial and ongoing validation of assessment skills through spot-checks relative to a “master rater” or other attempts to ensure inter-rater reliability of scoring and feedback. BloomBoard’s approach is to have each assessor demonstrate the ability to score a given MC with at least 80 percent consistency relative to a “master” scorer.6 Digital Promise leaves the decision of who will assess up to the individual issuers on its platform, but requires each assessor to go through assessor training, and the first 50 MCs submitted must be rated by two assessors in order to help norm and ensure inter-rater reliability.7 Other providers, such as NEA, require that two assessors rate every submission and come to consensus. NEA also attempts to have the individual who developed the MC be one of the initial assessors, and it requires that all assessors be subject-matter experts and take an online course in proper MC assessment practices.8
Responsiveness of evaluators can depend on the issuing organization. Most providers use in-house staff (e.g., Center for Teaching Quality (CTQ), Kettle Moraine, Members Impacting Students; Improving Curriculum (MISIC), Kentucky Valley Educational Cooperative (KVEC), the Friday Institute at North Carolina State), but others hire current or retired educators in a gig-work model (e.g., BloomBoard, NEA, and Teaching Matters).9 Entities who have hired staff dedicated to the review of MCs are typically able to provide earning decisions and feedback on a quicker and more consistent basis than entities using in-house staff for whom assessing MCs represents only a small fraction of their work.
Beyond the assessment process itself, the “grain size” of the skill or competency the MC is assessing is another point of design variation within the field. Currently, the granularity of teaching skills that MCs are being used to assess ranges “from small and specific (e.g., ‘using wait time effectively’) to big and broad” (e.g., “understanding school-based data”).10 There is general agreement that if a MC is too broad it would be overwhelming for the educator and the issuer would not be able to accurately assess the competency. In these instances, several providers we interviewed felt strongly that such a MC needed to be broken down into smaller individual MCs.11
However, it is still unclear how developers actually determine whether MCs are “right sized” and encompass what the CCSSO calls a “substantive yet discrete set of skills that correspond with the demonstrated competency.”12 Without clarity on the appropriate method for determining grain size, some providers are relying upon a time-equivalency approach, as this is the current metric for fulfilling state license renewal requirements. The number of hours being provided for a given MC by the various entities we researched ranged widely, from three to 20, with little clear rationale for the differences. Some providers are backing into grain size, trying to find an evidence-based but sufficiently “micro” competency and estimating the average number of hours they think an educator should take to complete it. Others are looking at a state’s course credit hour requirements for license renewal and providing a constant number hours per MC to align with requirements in an easily divisible way (e.g., if 30 credit hours are required, making all MCs equivalent to five credit hours), regardless of the actual number of hours it will likely take educators to complete it.
While MCs do embed some resources to learn about and develop competencies, the depth and level of quality vary. When MCs were initially launched, providers tended to offer relatively superficial resources for educators to learn about the competency at hand which often proved to be inadequate. Many providers have recognized that teachers need to have deeper, more comprehensive resources integrated into MCs and have put additional emphasis on these in more recent iterations of their offerings.13
In most cases, the MC provider supplies links to selected articles and other resources that are relevant to the competency. However, the depth and form of resources offered differs. Some providers include high-level resources with the expectation that educators will identify additional resources if they need to (e.g., some of Digital Promise’s offerings). Some providers offer specific training materials tied to their MCs (e.g., the Friday Institute’s massive open online courses (MOOC) offerings). Other providers offer opportunities for educators to receive coaching or feedback along the way (e.g., nonprofit organizations that pair MC offerings with other PD opportunities, BloomBoard’s additional-cost virtual coaching option, etc.), whereas others only provide feedback upon formal submission of evidence for review (e.g., NEA and Digital Promise).
As highlighted above, significant variability exists in the grain-size, resources, required evidence, and rubrics across different MC providers. This is true even for MCs with very similar titles. An examination of four formative assessment MCs across several platforms found variance in required articles of evidence, including word length, types of evidence, and rubric rigor. No two sets of learning resources were the same, and they drew from diverse origins and mediums. For example, brief blog posts were presented alongside dense academic articles. Given this variation, it is difficult for state or local education agencies to determine which MCs are most likely to have the desired effects on teacher practice and retention when incorporated into PD and advancement efforts.
Best Practices in MC Design and Assessment
The large variation in MC perspectives and approaches in existence is the driver of a key question on many policymakers, and educators, minds: “What makes a quality micro-credential?” Quality necessitates that the MC itself is backed by research, but also that the skill it represents is discrete (proper grain size), that its required demonstration (via articles of evidence) is rigorous and representative of that skill, and that it is clearly defined in a rubric that can be understood and applied by both candidate and assessor. Such qualities are not automatically “baked in” to every MC. More specific details on the core five aspects of a quality MC follow.
Area of Focus and Level of Specificity
Before any other aspect of a MC can be considered, the topic and scope of what it covers are essential elements to get right.
- The competency being assessed must be shown by research to move teacher practice and thus student learning or, for burgeoning areas in education, have strong evidence indicating that it is likely to do so.
- Prior research on effective teacher PD finds that content-specific PD is most likely to shift practice and student outcomes although many MCs are currently grade- and subject-agnostic.14
- MCs should reflect narrow, discrete, actionable skills. A MC cannot certify, for example, a broad skill like “classroom management,” because classroom management is not in and of itself a measurable skill.
- Because they are meant to be specific, a MC for a very small, single competency may not have a significant impact on teacher practice by itself. Several MCs focused on a common goal (stacking) are necessary to capture a full skill set. For example, a teacher should not be able to earn a MC in classroom management, but could earn a stack of MCs in a set of complementary “micro” skills that as a whole encompass classroom management.
- The name of each MC must accurately and specifically reflect the competency demonstrated in it, both to ensure clarity when educators are searching for an appropriate MC to meet their individual needs, and for recognition and currency purposes. Employers will not—and should not—value MCs if they are not confident that the name of the MC reflects the skill the individual holds.
Quality of Resources and Embedded Supports
Resources provided to aid in demonstration of the given competency should be evidence-based and clearly connected to the competency.
- Resources need to be coherent, focused, and comprehensive enough to provide sufficient assistance to educators with a low starting level of knowledge and skill in the given competency to earn the MC.
- Educators should have a vehicle to ask clarifying questions and receive answers from the provider before submission to help ensure that they are on the right track toward earning the MC.
Quality, Clarity, and Type of Evidence Requested
Any evidence requested must be a valid demonstration of the competency in question, based on the best possible existing research. However, some types of competencies are not sufficient on their own (e.g., demonstration of knowledge), requiring further parameters for evidence.
- Developers should strive to require evidence on several dimensions of competence (knowledge, application, implementation, etc.) to provide a comprehensive picture of the MC candidate's skill, and make quality of MCs more consistent, since right now, some MCs ask for some of these types of evidence, while others ask for other types, making it difficult to compare quality.
- Rubrics need to be transparent and detailed enough that educators’ and assessors’ understanding of expectations are clear and aligned.
- Providers should refrain from providing examples of articles of evidence that met a rubric’s expectations so that educators cannot try to just replicate what a previous educator has submitted.
- The evidence requested should strive to gather information about the characteristics of the teachers’ students and ask teachers to demonstrate that they can successfully employ the competency with all of their students.
Quality of Assessment Process
Ensuring a trustworthy summative MC assessment process requires two elements: high-quality criteria and measurement procedures for evaluating evidence (typically via rubric) and a strong, consistent process for training and fine-tuning the ratings of the assessors themselves.15
- The rubric should identify the criteria for successfully earning the MC, with similarly defined criteria for unsuccessful submissions. The rubric should also clearly indicate how evidence requested is intended to address each of the criteria.
- Determining the appropriate weight for each piece of requested evidence is an important consideration in rubric design.16
- While the earning of MCs is an up-or-down decision, the scale used to assess evidence should be more nuanced (e.g., measured on a five- or seven-point scale) to ensure greater accuracy in rating.
- Ideally, this nuanced data would be shared with MC candidates and earners post-submission, to provide detailed and useful feedback for improvement.17
- Training assessors on how to accurately apply the rubric to evidence submitted is essential for accurate scoring. This requires providing opportunities for assessors to practice applying the rubric and compare their score to a “master” score (i.e., the score given to the same set of evidence by an expert assessor). A reviewer should only be considered calibrated after her or his review and scoring of evidence sources consistently aligns with the “master” score.
- It is also important to develop an ongoing process, potentially annually, for reviewer calibration to ensure reviewers continue to effectively and consistently apply the rubric.
- Given that MC evidence often requires application of skill in practice, assessment of submissions needs to happen quickly to provide initially unsuccessful candidates with an opportunity to resubmit after making improvements.
- BloomBoard found that receiving feedback in less than one week after submission was crucial for educator success and continued engagement, in its survey of 542 MC participants.18 Providers will likely need staff dedicated to the review of submissions in order to provide earning decisions and feedback in a timely way.
- Having the same assessor evaluate re-submissions helps ensure continuity of feedback, and minimize frustration on the part of the candidate. A candidate should not receive new or different feedback on parts of the submission that were initially deemed acceptable.
- Using internal versus external assessors has different advantages. (For more details, see Potential Advantages of Internal vs. External Assessors below.)
- One possible way to capture the best of both approaches is to have an internal coach help provide training and/or feedback to teachers leading up to submission of MC evidence but have a third-party assessor evaluate the submission with sufficient information about the teachers’ context. More research on this area is needed.
Potential Advantages of Internal vs. External Assessors
Advantages of internal assessors:
- Some teachers prefer to have assessors with whom they have formed trusting relationships (peers or coaches) and with whom they can collaborate throughout the process.
- Internal assessors are more likely to understand the context in which a teacher is working.
Advantages of external assessors:
- Some teachers may feel more comfortable and more willing to try and fail with someone outside of their school or LEA.
- External assessors could be more objective because of no prior relationship with those they are assessing.
- External assessors may have a broader perspective of what strong practice looks like across various contexts.
- Some implementing entities, such as HPS, found that external assessors allowed them to scale up teacher MCs without having to hire additional staff to ensure sufficient quality and turnaround time.
Transparency and Comparability of Earned MCs
To allow MCs to provide value to their holders, the requirements and the submitted evidence to achieve those requirements must be transparent and easily comparable by potential recognizers.
- Most major MC providers follow the IMS Open Badges standard for technical specifications.19 However, MC providers must consistently populate the various available badge fields in order to provide the depth of information necessary for adequate review or comparison.
2. Putting Educator Micro-credentials Into Practice
Landscape Overview: Educator Interest, Engagement, and Experience
Teacher Awareness of and Interest in Micro-credentials
While more recent data is lacking, a nationally representative survey of teachers in 2015 by Digital Promise found 15 percent of teachers were “somewhat familiar” with the concept of MCs, and only 4 percent said that they were “extremely or very knowledgeable.”20 The same survey found that once teachers were introduced to MCs as a concept, 31 percent said “they are extremely or very likely” to try them when they become available, and another 34 percent were “somewhat interested.”
Of 19 distinct MC features highlighted in the survey, teachers were least interested in displaying digital badges or sharing them on social media. One teacher observed, “I don’t need to show off badges on Facebook, I need to improve next week’s lessons.”21 The two most appealing factors were the opportunity to learn new skills and the opportunity to hone existing skills, with roughly 70 percent of teachers citing each factor as “appealing or very appealing.”
Most teachers are not stumbling upon MCs when searching for PD and learning opportunities. Digital Promise believes that a majority of educators access a particular MC on their platform because they are directed toward it by an issuer, professional development entity, school, or LEA.22 This is particularly true if it is their first MC engagement. As illustration, the majority of the educators accessing the Friday Institute’s MCs on Digital Promise's platform do so because they are engaged in courses which use those MCs to assess competency on the material they are learning.23
How Many Teachers Have Engaged with Micro-credentials to Date, and Who Are They?
Given that educators may be enrolling in and earning MCs across multiple platforms, it is difficult to calculate the total number of educators who have engaged with and earned MCs to date. Based on our analysis of data provided by Digital Promise and the National Education Association (NEA), two of the largest educator MC platforms, we can say with certainty that thousands of educators across all 50 states and Washington, DC have earned at least one MC.24 New America calculates that, on these two platforms alone, 2,232 educators earned 4,219 MCs between September 2019 and September 2020.25
Within states, LEAs, and schools, MCs are still largely an opt-in approach, which means that those engaging in MCs are not necessarily representative of the teaching population as a whole. For example, to date, Juab School District in Utah is unique in adopting MCs as a district-wide opt-in model supported with financial and PD credit incentives. Since the 2016–17 school year, 50 teachers have earned 300 MCs, but roughly two in three of its teachers have yet to even earn one. A pilot program by the Washington Professional Educator Standards Board (PESB) offers one of the broadest samples of MC participants in a state to date, with teachers from 29 districts participating in a grant program.26 Participating districts ranged from urban to rural and served a diverse range of students.27
The 2015 Digital Promise survey also found that early MC adopters reflected a wider range of experience levels and were less motivated by extrinsic factors compared to later adopters, who were more likely to be older and more driven by extrinsic factors, such as financial incentives.28 Early adopters said that lack of information, cost, and lack of administrator support or knowledge were the three biggest barriers to trying MCs. In general, those less satisfied with current PD activities were also less likely to be early adopters, indicating that cynicism regarding current PD offerings is a likely barrier to adoption.
New America has not been able to secure data from the various MC platforms or providers that would help us further understand the profile of the LEAs, schools, or teachers who are opting in, or the characteristics of their students.29 What is apparent is that which teachers have access to MCs is largely a matter of local leadership and even happenstance.30 However, in at least one state that implemented an “opt-in” MC pilot, SEA staff indicated that the “districts that have been active have been districts with money…mainly medium to large districts."31
Educator Experience with Micro-credentials
The overwhelming take on high-quality MCs from teachers who have engaged with them is that there are significant “pros” to the approach: they offer greater personalization and choice (both in terms of content and in terms of when teachers engage in the experience) and are more likely to have an impact on their practice and student learning.32 On the “cons” side, teachers find MCs more difficult to successfully complete, requiring more time and effort compared to typical PD experiences and requiring a greater level of self-motivation. This feedback dovetails with reviews of competency-based education at the higher education level.33
Some survey data highlight teachers’ general perceptions about the value of engaging in MCs. An exit survey conducted by Washington State’s PESB, after the third iteration of its MC pilot, asked participating educators to respond to the statements: “Working on my micro-credential submission has had a positive impact on my practice as an educator,” “Working on my micro-credential submission has had a positive impact on my students,” and “I would be open to working on another micro-credential in the future.” Educators gave an average response of 3.9 out of five for each of the three questions, where 1 indicated “strongly disagree” and 5 indicated “strongly agree.”34 Another survey by the Friday Institute of individuals who engaged in MCs it offered found that 97 percent of respondents who had completed at least one MC indicated they wanted to pursue more in the future.35
However, educator perceptions of MCs' value, and their eventual success in earning MCs, can be tempered by the relative ease and convenience of their experience, including their use of the digital platform's interface (See Importance of the MC Platform User Experience for more details).
Importance of the MC Platform User Experience
Having an easy-to-navigate, intuitive technological interface is crucial if educators are to be expected to virtually submit their articles of evidence. In Seven Lessons Learned from Implementing Micro-credentials, the Friday Institute, a research institute at North Carolina State focused on innovations that help improve schools, observed that the “online platform matter[s].”36 After receiving feedback from educators that it was difficult to submit all of the necessary materials and to understand the MC earning decision, the Friday Institute adjusted its platform accordingly. Following this change, the number of educators who did not complete the MC they enrolled in decreased from 55 percent to 27 percent. Additionally, 12 of 23 educators resubmitted artifacts after feedback, up from zero resubmissions prior to the platform changes.
Lessons: Necessary Conditions for Successful Implementation
While high-quality MC offerings typically embed some resources and/or supports within them, they are generally insufficient in supporting teachers' professional learning on their own. The MC principles published by CCSSO acknowledge that MCs are just one tool within the larger system of professional learning and advancement for teachers.37 The quality of the implementation and supports for educators occurring outside of the MC offering are just as important as the design and assessment of the MCs themselves, if not more so.
Because of the relatively low level of educator familiarity with MCs, along with the relatively high level of effort and motivation required to earn them, several key conditions will be necessary for authentic, widespread educator engagement and success with MCs: effective communication and local champions; provision of sufficient, regularly available time to work on MCs or related professional learning activities; instructional supports, including coaching and peer collaboration structures; and a culture shift to enable comfort with professional vulnerability, struggle, and even temporary failure.
Effective Communication and Local Champions
The first condition is simple: educators must understand the what, how, and why of MCs. Decades of policies and practices have been implemented without incorporating teacher input and have made teachers wary of the next “fad” in education reform. Teachers need to know what the process of earning an MC entails, and how earning one could benefit them and their students.
Strong school and LEA leader communication about MC’s value and support for successful engagement can lead to greater investment in MCs among teachers. In successful implementation at Walker-Gamble Elementary School in South Carolina, almost every educator and administrator named the LEA superintendent’s involvement and support as a key element in facilitating school-wide buy-in (with the superintendent herself actually joining one of the learning teams).38 Seminole County School District in Florida leveraged principals who volunteered to promote the work among their teachers, and also encouraged principals to look for MCs on educators’ resumes.39 Leaders at Harmony Public Schools (HPS) in Texas indicate that having school leader encouragement is critical for both initial teacher engagement with and successful earning of MCs. As Burak Yilmaz, director of instruction at HPS, explained, MCs got “pushed down [a teacher’s] priority list” when they were not a focus of local leadership.40
Designating and empowering peer advocates is another way to encourage teachers beyond the early adopters to embrace MCs. For example, Teaching Matters found that their MC pilot programs that were most successful had “champions” at the local level advocating for their implementation and promoting them in the school building. Several school systems have developed or are planning to develop MC “ambassador,” “facilitator,” or “navigator” roles for teachers who have completed MCs themselves and are able to encourage and support other teachers through the process.41
Solid communication and support by local education leaders and peer influencers is always important when introducing new initiatives, but especially important in garnering support for MCs because they require a more intensive, higher-caliber effort than what educators have historically encountered in the realm of PD and advancement. This is particularly true for “higher stake” use cases, such as obtaining relicensure credits or advanced roles, especially when more familiar, less risky options are still available. Many teachers view meeting license renewal requirements as a box that they must check to maintain employment that happens to include stipulations to develop professionally.42 Hours-based attainment of PD credit may be largely ineffective and compliance-oriented, but it is certainly easier. To illustrate this, consider: all educators who attend traditional “sit-and-get” PD receive credit for being there regardless of whether they learned anything or ever apply that knowledge in their classroom. In contrast, of the 161 Harmony Public School teachers who earned MCs in the 2018–19 school year, 33 percent earned after the first attempt, 48 percent earned after the second attempt, and the remainder took between three and five attempts.43
Regular, Dedicated Time for PD
Communicating the benefits of MCs from trusted school and LEA leadership can help facilitate teacher buy-in, but more structural changes to the workday will be needed to engage a sizable number of teachers. Results from the U.S. Schools Staffing Survey from either side of the turn of the 21st century showed that those working in high-minority schools participated in more PD but had less scheduled time for PD during their contracted hours than teachers in other schools.44 Linda Darling-Hammond and colleagues posited that this was because federal legislation had increased the funds that could be leveraged for PD in high-need schools, but school schedules and structures had not shifted correspondingly.45
Similar risks exist for the success of educator MCs. Regular, dedicated time to work on MCs was cited nearly unanimously (by interviewees46 and in prior research) as one of the greatest factors determining whether they can fulfill their potential. In a survey of teachers enrolled in their performance assessment MCs, CTQ and Digital Promise found that “every one of the teachers pointed out that they needed more, and different types, of time to learn about and develop the assessment competencies being measured.”47 Separately, teachers who were part of Charleston County School District MC pilot but did not complete a MC cited “lack of time” (59 percent) as the chief reason why they did not submit articles of evidence, far outpacing any other reason.48 A majority of teachers in a 2020 Digital Promise survey also reported that having dedicated time to work on the MC (76 percent) would be “definitely” or “very motivating” to their completing another one.49
The provision of time during contracted hours to work on MCs appears to increase the number of teachers engaging in MCs, as well as the rate of successful completion. For example, South Hamilton CSD in Iowa required all of its teachers to engage in a remote instruction MC with the onset of COVID-19 and almost all completed it.50 HPS prevents its educators’ PD time from being infringed upon by other responsibilities so they can focus on MCs.51 In the first few months of the COVID-19 pandemic in the U.S., Digital Promise observed a 20 percent increase in submissions, and a 135 percent increase in registered users over the same time period, which it partially attributed to teachers having less scheduled instructional time as schools figured out how to serve students in a remote environment.52
The need for additional time aligns with what researchers already know about educator PD—and retention—in the U.S.; American teachers have fewer contracted hours available for planning and professional learning than teachers in almost every other developed country,53 which leads many to plateau in skill or to leave the classroom altogether.54 And, often, a substantial proportion of contracted PD hours occur over the summer, when no students are present. When this occurs, teachers miss out on two critical experiences: engaging in a cycle of inquiry to grow professional practice, and demonstrating competency in an authentic environment (a requirement for most high-quality MCs).
Finally, shifts in communication and time use for other types of training will be necessary to achieve this goal. Currently, required trainings regarding safety, technology use, and a variety of other local policies are often referred to as “PD” and put on the school or district PD calendar on the same footing as developing key instructional practices. While these types of compliance-oriented trainings are necessary, LEAs could shift them to an asynchronous virtual format and achieve the same results, ensuring that they are no longer a core focus of scheduled PD time.
Support from Colleagues: Coaching and Peer Collaboration Structures
Dedicated time to engage in a cycle of inquiry and related PD opportunities is critical, but for the long-term success of MC implementation, teachers will also need ongoing, differentiated support from their colleagues through coaching and peer collaboration. Not every teacher will need the same level of support to earn MCs: much depends on the level of initial knowledge and skill in the given competency area, as well as preferred working styles. It also depends on the resources embedded in the MCs themselves, which are generally not sufficient on their own for developing the competency in question. However, even more experienced and motivated teachers working to achieve MCs to take on teacher leader roles often struggle without targeted support.55
In interviews with state and local education leaders, school instructional leaders, and MC providers, nearly every entity cited individualized coaching as substantially boosting the potential of MCs. Making dedicated coaching available has a significant impact on whether teachers successfully engage in and complete MCs.56 The Center for Teaching Quality (CTQ), a nonprofit focused on improving public school systems (including by providing professional learning services using MCs), found that the earn rate for its MCs increased by 30 percent with targeted support.57 Kelvey Oeser from the Texas Education Agency observed that a key reason its MC pilot was not as successful as anticipated was due to a lack of job-embedded coaching. She said, “there are ways to connect MCs to job-embedded coaching, but the MC [offering] itself does not necessarily ensure that the structures, expertise, and capacity for this coaching will happen, and we found…that many of the districts we worked with did not have those [pieces] in place.”58
Coaches must also be sufficiently familiar with MCs to be able to effectively guide others through the learning and earning process. Interviewees indicated that having colleagues in the building familiar with and able to support work with MCs appears to increase engagement and persistence to completion. But LEA and school administrators and instructional coaches often have difficulty providing meaningful support to teachers engaging in MCs without some deeper exposure and training themselves. Many, therefore, had their coaches and/or other instructional leaders enroll in the MCs they expected teachers to engage in, either first or at the same time.
Because of the rigorous nature of a high-quality MC, it takes teachers longer to successfully complete MCs when they are working on them in isolation.59 Opportunities for peer collaboration and professional learning communities (PLCs)—either within a teacher’s own building, LEA, or virtually with others working on the same MCs—can help. Peers can serve as partners in learning and practicing the necessary skills for a given MC, and can even provide feedback on the evidence before it is submitted for evaluation.60 HPS found the schools that were most successful at incorporating MCs were those with PLCs that encouraged the work and integrated it into what they were already doing.61 Additionally, the value of collective knowledge and skill building is likely much more valuable than individual knowledge and skill building, and this is not an aspect automatically built into the MC process.
More evidence of the value of learning communities for successful MC completion abounds. The NEA observed a positive educator response to the virtual “National and Statewide PLCs,” led by its MC assessors, that it put in place to support educators during the COVID-19 pandemic.62 Washington State identified PLCs as the chief driver of successful completion of MCs: a survey found that MC candidates were more satisfied and more likely to be successful in their submissions when they felt supported by collaborative learning systems rather than working in isolation.63 Washington PESB officials particularly stressed the role of learning communities in building resiliency and support for teachers in re-submitting evidence for MCs for which they were initially rejected. The state viewed PLCs as so important that it required any grantee in its MC pilot to bring teachers together in person at least once.64
Many schools and LEAs already have PLCs or other professional collaborative structures in place but have not figured out a way to fully harness their potential. In these places, MCs can not only benefit from collaboration, it can be the catalyst for it by helping facilitate strong inquiry-based learning practices where they did not previously exist.65 For example, research has identified several features that seem critical for successful professional collaboration, including having teacher-leaders trained to use explicit protocols to guide teams through “a process of identifying student learning problems, selecting instructional strategies, analyzing student work for evidence of impact, and honing strategies until they achieved results.”66 The structure of high-quality MCs could help provide the foundation for teacher leaders to work from. In a 2016 report, CTQ described MCs as offering colleagues a “common currency” for articulating and documenting specific knowledge and skills as they learn and work together.67 KVEC embraces such a community approach, facilitating in-person and remote collaboration for educators pursuing MCs in pursuit of solutions to common school-level problems of practice.68
Culture Shift
As with educator PD as a whole,69 the success of MCs hinges on a growth-focused professional culture. When presented within a compliance-oriented culture or set of policies around PD, it is not surprising that many teachers choose the most straightforward path to fulfill requirements, or at least one unlikely to expose areas of imperfection. For example, when Tennessee implemented its initial MC pilot for license renewal, offering six CEUs for completing a MC, a substantial number of educators chose to pursue a MC in a competency they already held, rather than an area for growth.70
The challenging nature of MCs, combined with entrenched attitudes about traditional PD activities, has necessitated significant culture shifts in schools and LEAs that are implementing MCs. The LEAs that are successfully implementing MCs beyond their most motivated teachers appear to be those that emphasize that professional learning is important for every educator, not just those who are new or “ineffective.” They articulate the goal of teacher PD as authentic and relevant continuous improvement, acknowledging that everyone has areas to grow, while recognizing and rewarding areas of strength. Also, they set expectations up front that MCs are more rigorous than previous PD by making it clear that many educators will not earn an MC on their first attempt; they frame the feedback teachers will receive and incorporate for subsequent resubmissions as an integral part of the learning process. Developing trust and a “not yet” growth mindset in schools, rather than a fear of failure, is essential for building the culture necessary for deep professional learning to take place.
This type of culture shift may well be the “secret ingredient” to implementing MCs successfully. But it is also likely to be one of the most difficult to source, as it must be grown, not bought.
3. Developing and Implementing State and Local Policies
Landscape Overview: Why, Where, and How MCs Are Being Used
Why do States and LEAs Use MCs?
In broad strokes, most states are using MCs to target a specific need or learning area. This is particularly the case when it comes to rolling out new competencies, addressing statewide learning needs, or providing targeted certification for specific labor shortages (for example, a dearth of STEM educators). Others see MCs as a strategy to bring more diversity into the teaching profession by making it more accessible and affordable. For example, “stacks” of MCs could be substituted for higher education credits or in lieu of traditional licensure exams.71
The motivation behind the use of MCs also aligns with the movement toward “competency-based education” in both K–12 and postsecondary education. Since Carnegie units were first developed in 1906,72 credentials have largely been measured using these, which are based on the number of hours expected for someone to physically attend classes in a given course of study. Ongoing professional learning has also been prescribed and documented primarily in terms of time, through continuing education units (CEUs).73 A shift away from Carnegie equivalents began over two decades ago in the postsecondary space, when Western Governors University instituted a self-paced model of learning where moving through the courses and credentialing programs was based on how quickly students met defined competencies rather than a predetermined timeline. The concept has caught on more recently in K–12 schools, with several states engaging in an “Innovative Assessment pilot” with competency-based education through the federal Elementary and Secondary Education Act.74
A significant number of the schools and LEAs that were early adopters of MCs for teachers did so in their quest to move to a personalized student learning model.75 These entities believed that in order to enable a more individualized learning approach for students, teachers needed to use this model for their own learning.
Finally, some smaller LEAs, such as Juab School District in Utah or Mountain Home Public Schools in Arkansas, see MCs as a way for them to compete for educator talent with bigger, higher-paying LEAs by providing motivated teachers with stipends and greater career advancement opportunities.76
Which States Promote MCs and for What Purpose?: Educator Human Capital Policy Type (as of August 2020)
| Any | Career Pathways and Advancement | License Renewal | Ongoing Professional Learning (Developed Own MCs) | Licensure Endorsements | |
|---|---|---|---|---|---|
| Number of States | 26 | 5 | 3 | 15 | 8 |
New America’s analysis found that 26 states have formal educator MC policies or programs in place.77 Six states have laws in place that define and/or outline the use of MCs for educators: Arkansas, Delaware, Mississippi, Oklahoma, Texas, and Virginia. (See “State Laws Regarding Educator Micro-credentials” in Appendix D.)
At least five states have, or are developing, programs that use MCs for career pathways and advancement. Arkansas and Louisiana have implemented state-recognized teacher leadership roles that can be earned by earning MCs, and Oklahoma is currently developing a similar system. Missouri is developing an alternative pathway for principals to earn a career certificate by earning 15 MCs.78 South Carolina is experimenting with MCs for teacher leadership and principal induction.
In three states—Tennessee, Utah, and Massachusetts—educators can count earned MCs toward license renewal through defined “exchange rates” that specify the Carnegie unit equivalent of each earned MC.
Fifteen states have developed or are developing their own MCs for professional learning and/or development, either in partnership with another entity or independently. Eight states allow MCs to be used for specific licensure endorsements.79 While most of these endorsements are focused on a specific educator shortage area, Louisiana has developed two certifications for teacher leaders that are attained via earning a stack of MCs: Content Leader and Mentor Teacher (each with multiple possible concentration areas).
Additionally, a significant number of states—such as Montana, North Carolina, South Carolina, South Dakota, and Texas—provide LEAs wide latitude to define and/or certify PD via relicensure credits. Other states authorize regional education service agencies or other third-party organizations (e.g., MISIC in Iowa) to develop and approve professional learning experiences for meeting state license renewal requirements, which can include MCs.80
How Do States Implement MCs?
States are still experimenting with MCs by piloting them with a subset of educators or LEAs or providing them as one of several options available to all educators. In very few places are MCs mandated. Most states and LEAs lean more toward choice, with educators engaging in MCs on a voluntary basis. This is due in part to an emphasis on local control when it comes to educator professional learning, and even attainment of some advanced roles, giving LEAs wide latitude to adapt MCs to their context.
While educators are mostly engaging in MCs on a voluntary basis, wide variation exists in the level of autonomy and breadth of the MC choice set that educators are provided. Some of the entities employing MCs for teacher leadership roles or other forms of advancement are very prescriptive about which MCs and other requirements candidates must engage in to attain the designation (Louisiana); some are very prescriptive about which MCs and other requirements but allow for choice in provider and approach (Arkansas, which allows several prescriptive pathways for teacher leader licensure); while others are prescriptive about the foundational set of MCs that must be attained, but allow flexibility around which “elective” MCs can fulfill the requirements (the Kentucky Educational Development Corporation (KEDC) and Juab School District). For MCs focused on ongoing professional learning (i.e., not specifically tied to advancement), some LEAs and schools require educators to engage in specific MCs, while others give educators wide latitude to pick MCs that best align with their interests. One unique case is Kettle Moraine School District in Wisconsin, which encourages teachers to develop their own MCs using a district-developed template.81
Across states, LEAs, and even the MC providers themselves, perceptions also vary widely about the need for—and the appropriate currency and level of—incentives offered to educators for engaging in and successfully completing MCs.
Some, such as Digital Promise, believe that providing currency and incentives tied to the earning of MCs is necessary and valuable, but that these decisions should be determined at the local level based on context.82
Others have more prescriptive beliefs about incorporating incentives. For example, NEA believes that the successful earning of MCs should translate into increases in base salary, and this is the approach that Kettle Moraine and Clark County Education Association are taking. Some entities, including but not limited to Arkansas, Louisiana, and Kettle Moraine, are creating opportunities for teachers to advance and take on leader roles in order to promote professional learning for colleagues. BloomBoard has created “role cards,” which are a list of the MCs that an educator would complete to demonstrate required competencies for a particular role or designation. Both Arkansas and Louisiana have worked with BloomBoard to create a set of MCs for designated teacher leader roles, and KEDC has created an approved route to advanced licensure in Kentucky using this type of approach. Harmony Public Schools is providing stipends to teachers who complete MCs and is also providing significant bonus pay for effective teachers who complete MCs and meet other eligibility requirements. Some providers, such as MISIC, are working within current license renewal system policies and taking a CEU-equivalency approach and trying to make each MC a rough estimate of expected number of hours in order to ensure that MCs hold value within the current license renewal system.83
Krystle Bassett from Juab School District shared her view that “incentives are initially important [to drive engagement], but become less important over time, because teachers see the impact and ultimately are driven by doing well by their students.”84 Currently, Juab takes one of the most comprehensive approaches to incentives, including nearly all of the approaches above: each MC is worth 0.5 credits on the district salary schedule, and teachers also have the potential to earn relicensure points. Teachers who complete all 12 of the MCs in a given teacher leader pathway receive a 5 percent increase in base salary. In order to maintain that increase, teachers must renew their advanced credentials with a tapering continuation of engagement with MCs: over the next three years, they have to engage at one-half the previous period’s rate (complete six new MCs), and then over the following three years have to engage at one-half the previous period’s rate (complete three new MCs). After that, the teacher leader base salary increase is permanent.
Lessons Learned: Policy Development and Rollout
Starting with the End in Mind
While states and LEAs have adopted myriad approaches to incorporating educator MCs, those that appear to have experienced the smoothest, most successful implementation (1) began with a clear, realistic idea of what they hoped to achieve by adopting MCs, informed by a deep understanding of this mechanism’s strengths and weaknesses; (2) created a theory of action to realize that objective; (3) discussed their goal(s) and theory of action with stakeholders; and (4) aptly integrated MCs into relevant parts of educator human capital systems.
Understanding where MCs most naturally fit into educator human capital systems is important for ensuring policies are designed in ways that best leverage the potential of MCs. MCs were initially developed as a tool to demonstrate and showcase skills that had already been developed rather than as a way to develop the skills themselves. Initially, MCs were attached to some other formal learning experience, such as a boot camp or a MOOC.85
High-quality MCs can promote professional learning by reflecting a cycle of inquiry where teachers plan how to incorporate a practice into their instruction, utilize the practice, assess its impact, and reflect upon how to further improve—and curate the evidence to show they did so. But, on their own, most MCs are typically not a good mechanism for training on a topic, as the learning experience is rather open-ended and self-directed. To leverage MCs for ongoing professional learning, either current MC offerings will require adaptation to offer more direct development opportunities, or greater outside resources must be provided to fulfill development goals.
On their own, MCs are typically not a good mechanism for training on a topic. To leverage MCs for ongoing professional learning, either current MC offerings will require adaptation to offer more direct development opportunities, or greater outside resources must be provided to fulfill development goals.
Several entities have engaged in processes for creating clear frameworks or maps for how teachers could qualify to take on a particular designation, role, or advanced licensure status. By mapping needs and roles, and what skills are necessary to meet those needs, an entity may also decide a particular goal would not be a good fit for fulfillment with MCs. If an entity determines MCs can play a role in qualifying candidates, stacks of MCs can then either be developed or chosen to meet the necessary requirements—much like how a teacher identifies the skills they want students to exemplify and then creates an assessment to measure them. The work of Arkansas, KEDC, and Louisiana demonstrate how BloomBoard’s “role card” approach aligns with this process. Some other MC providers focused specifically on teacher advancement, such as Teaching Matters, take a similar approach.
Several states have tried to roll out MCs without a clear connection to other human capital policies and found that they had difficulty engaging educators, who viewed them as not worth the time and energy required. One Texas official believes there was lower than expected teacher uptake of MCs during the state’s MC pilot in 2017 because the state did not clearly connect them to existing professional learning systems.86 Education officials in South Carolina offered that “we can’t ask teachers to do more if they don’t know where this is going to show up with renewal and advancement,” and there were also concerns “with ensuring portability from district to district.”87
Even states with a clear purpose, theory of action, and road map for how MCs intersect with other human capital policies in place have had to retroactively adjust their efforts to ensure that the professional learning resources being provided outside of the MCs align clearly with the MC tasks and rubrics. For example, because Louisiana began building out its external training resources prior to finalizing the design of its MCs’ assessment portions, it had to revisit and better align the training to the assessed competencies during the rollout phase.88
And intersection and alignment with human capital policies alone is likely not even sufficient. A report from a Carnegie Corporation working conference on educator MCs explains why, drawing on school improvement research which finds "that interventions that involve and align more aspects of the instructional process are more likely to exert influence. For example, when teachers worked with replacement curricular units aligned with outcome assessments, standards for learning, and professional development (PD), improvements in instruction and student learning were more likely to result than if teachers only worked with one or two of these elements."89 Most states are striving to align MCs with state teaching standards, but not going much beyond that. However, individual LEAs, such as HPS, shared that they have felt the need to customize the MCs they are using to better reflect the language and concepts traditionally used in their ongoing PD, curricula, etc.90
States can also play an important role in setting standards and processes for vetting MCs to ensure they are of sufficient quality, a practice that is currently largely, if not solely, left to the MC providers. (For best practices identified to date, see Designing and Assessing Micro-credential Offerings in Findings section.)
Relevance through Focused “Voice and Choice”
Giving teachers “voice and choice” can be an incentive for them to engage in MCs, as educators cite the ability to choose their own learning path as one of the primary reasons they currently seek out informal PD opportunities.91
But too much freedom could lead teachers to engage in MCs that are either not high-quality or are not critical to improving their practice; either will fail to better promote student success. In fact, in many states, teachers already have substantial freedom to choose their PD activities to satisfy license renewal requirements. However, because these options are so vast, and the tools to vet them almost non-existent, teachers and their students attain little, if any, value from them.92 Acknowledging this, many of the LEAs and states we researched found it beneficial to provide some parameters around which MCs could and should be pursued.93
Why entities select particular MCs in these “guided choice” models varies; some see state standards as driving the choice set, while others believe the options should be more closely aligned with the more focused, granular elements found in teacher observation rubrics. The scope of the choice set is also often determined by the expressed purpose of engaging in MCs, and the level of standardization or customization viewed as appropriate for the “use case.” For example, the menu of curated MCs is typically most limited for new endorsements or paths for advancement, and broader for license renewal— and ongoing PD more generally—to reflect the reality of individualized needs and interests. Even then, states and LEAs often provide guidance to teachers and their supervisors or coaches for how to utilize student data and personal performance data in creating PD goals and selecting MCs that align with them.
Some entities are even using MC data to help identify and support teachers’ development needs and interests, such as Kettle Moraine School District. SkillsForce, a recently launched educator MC platform, has also developed a learning management system (LMS) model to help organizations analyze data on their MCs and their educators and make connections between them.
Selecting Credential Currency and Appropriate Incentives
Due to micro-credentials’ novelty and relative difficulty compared to traditional PD and advancement opportunities, most educators have been unlikely to engage with MCs independent of an appropriate incentive.
Currently, there is no agreed-upon currency or incentives for engaging in MCs. Part of this is due to lack of familiarity with the level of knowledge and skill represented by a given MC or stack of MCs compared to more traditional signals. For example, nearly all employers assume that a master’s degree signifies a higher level of preparation than a bachelor’s degree.
Another reason is the lack of standardization across MCs: the level of knowledge and skill represented by a given MC or stack of MCs varies from one issuer to another, making it difficult to provide value to the earner. Educator MCs are not formally accredited, recognized, or evaluated by third party organizations. The exceptions are postsecondary institutions which have agreed to offer degree credits for MCs, or state entities with authority to provide license renewal credit or certificate endorsements. But even those approaches differ from institution to institution. This means that, similar to many other credentials, educators and recognizers value the MCs as a function of their knowledge of and trust in the developer and/or issuer.
If MCs are to secure clear, consistent value within educator human capital systems, their reliability and validity will need to be assured. Connecting Credentials, a collaborative of more than 3,000 stakeholders in the credentialing ecosystem, released a working report in 2017 that identified quality as one of the three foundations for trust in any given credential.94 One of the most powerful roles states can play is to set standards that secure a minimum level of quality in MCs, which will create trust in the credentials and allow them to hold currency. The state “guarantees” that a given MC holds a certain value by first ensuring it meets a set of standards, and then providing guidance on the appropriate value that the standard-meeting MC (or stacks of MCs) holds for a specific purpose (e.g., license renewal vs. advancement). Educators can then engage in MCs confident that there will be some level of return for their effort.
If MCs are to secure clear, consistent value within educator human capital systems, their reliability and validity will need to be assured.
A 2015 survey found that most teachers are not very interested in the potential for displaying digital badges for MCs earned.95 Our research finds that attaching real currency and value to MCs—such as financial stipends, advanced teaching roles, and/or credit toward re-licensure or required PD—can provide teachers the additional motivation needed to engage. However, the appropriate type, level, and ultimate influence of the chosen currency depends on several factors. Of particular weight is whether the stakes for success are high and whether there is a less challenging or “risky” alternative pathway available. For example, the teachers in Tennessee’s initial MC license renewal pilot who chose to pursue a MC for a skill they already held because they needed a certain number of credits to retain their license (high stakes) were behaving rationally, opting for the “sure thing” over possible failure.96 But this response did little to help them harness MCs for the state’s intended purpose of improving instruction.
State and LEA approaches to incentives and currency for MCs must take into account the current policies and practices surrounding professional learning and advancement. For example, certain supports (coaching, PLCs, and/or other dedicated time for PD, etc.) are not only necessary for MCs’ long-term success, but they are also desired and valued by teachers more generally.97 Offering deeper support to teachers who choose to engage in MCs in lieu of other approaches could be one way to incentivize engagement in LEAs where high-quality coaching and collaborative learning opportunities are lacking, but less of a motivator in an LEA where these supports are already abundant. Another example is the issue of who pays the fee associated with engaging in a MC.98 In some states and LEAs, teachers finance all or most of their own PD activities to fulfill license renewal requirements. In others, teachers expect that their employer will help them satisfy any PD hours they need for relicensure during designated in-service days. Where state or local provision of PD has been the norm, educators will likely be more resistant to MCs if they are expected to cover the cost. Several entities we spoke with shared that educators are unlikely to choose to pay for MCs out of their own pockets to satisfy relicensure requirements, particularly when there are more convenient, cost-effective, and less risky routes available.
The incentives and currency attached to other options for achieving the same goal must also be considered when determining the appropriate incentives and currency for MCs. For example, when educators are presented with equal value for pursuing a typical PD opportunity—such as attending a seminar with no assessment of knowledge gained or practice affected—and completing a rigorous MC to attain relicensure credit, the first option is a no-brainer for most.
The Carnegie Corporation educator MC working conference report contended that “as policy incentives increase in potency, more teachers will respond but with potential adverse consequences on authenticity."99 A few MC providers we interviewed verified this concern, sharing that they sometimes receive submissions where an educator is clearly “throwing out everything in the hope something will stick,” instead of investing deeply in the process.
This dynamic can in part be attributed to human psychology, necessitating a balance between extrinsic motivation and intrinsic motivation. The sweet spot appears to be in supporting teachers in pushing through anxiety or discomfort (a neurological state that is actually necessary to warm up the brain for a highly concentrative state) with a new or difficult task to the point where they begin to see rewards for their efforts, producing low levels of joy.100 But if the extrinsic rewards attached are too great, individuals interpret the “joy” as solely related to the reward, not to the task they are doing. Top neuroscience,101 behavioral psychology,102 and economic103 research indicates that to increase employee productivity and quality, extrinsic rewards should be minimal or even non-existent. Instead, researchers advise setting personal milestones along the way for successfully completing a goal—something that a stack of MCs in a particular competency area naturally helps educators do.
However, for intrinsic motivation to work as it should, employees must feel that they are being adequately compensated for the work they are already doing. It is likely that teachers in many states, some of whom are working multiple jobs to make ends meet,104 do not currently feel this way. This makes it more difficult to predict how they will respond to any incentives and/or currency offered for MCs. But evidence suggests that having more opportunities for ongoing development and advancement tied to adequate salary increases could play a role in retaining effective teachers.105 This approach could be particularly compelling for mid-career teachers (between six and 20 years of experience) who are more likely than other teachers to leave the profession.106
Ensuring Portability
For educator MCs to be successful in the long run, they must be portable, meaning that the currency they hold with employers remains relatively consistent and stable even when teachers move between schools or LEAs.
The most critical condition for portability, at least within a given state, is that the level of quality is relatively high and consistent from MC to MC (see Best Practices in MC Design and Assessment in Findings section for more information). Currently, most LEAs and SEAs are currently relying on third-party MC providers to guarantee quality, and therefore by association, portability as well.
While a few LEAs have developed their own high-quality MCs, portability of these MCs’ to other LEAs remains low, since developing high-quality standards and processes for vetting MC quality is beyond the current capacity of most LEAs. Similarly, when individual LEAs develop policies and practices around currency, it limits teachers’ confidence that an earned MC would hold currency if they were to become employed at another LEA. As a result, teachers are less likely to want to invest in earning MCs, particularly when there are other options available for attaining pay raises or advanced roles. As such, several states have seen the need to take the helm for determining which MCs “count” toward earning advanced designations, such as teacher leader roles.
Some states, including Texas, are discussing how to convey MC value and ensure portability by developing a process by which educators can include MC attainment on their certificates, although none have done so yet. This is most likely to occur via a badge on a digital certificate, so ensuring that MC providers follow IMS’ Open Badge standard for technical specifications will help create transparency and uniformity and facilitate MC portability.107
Creating MC Currency and Portability: The Case of Kentucky
Kentucky is an interesting case study for allowing for local flexibility while still maintaining intrastate portability. It recently adopted regulations enabling teachers to achieve an advanced “Rank 2” license status and accompanying salary increase, through an alternate approach to completing a master’s degree. Kentucky-based LEAs, institutions of higher education, and other education organizations can submit an application to the SEA proposing an alternate approach to meeting the rigorous requirements outlined by the SEA.108 Kentucky Educational Development Corporation (KEDC) is one entity the state has approved to implement an alternative Rank 2 model.109 KEDC has created a three-year, 24-MC pathway that balances a set of core pedagogical practices with room for individualization. Each MC was carefully vetted for quality by KEDC and selected based on alignment with the evidence-based competencies it had determined were most critical for advanced educators. KEDC’s MC Rank 2 pathway costs significantly less than enrollment in a traditional master’s degree program—an incentive likely to motivate teachers to engage in MCs despite their unfamiliarity.110 However, such state-specific advanced designations earned via MCs do not hold currency outside the state the way a master’s degree or National Board certification does.
Ideally, in the longer term, MCs would be portable across state lines, but, without some national standard-setting body for MCs, this seems unlikely. States each have their own initial and ongoing licensure processes, and for years have struggled to figure out simple ways to ensure license “reciprocity” between states. The portability of MCs presents many of the same challenges.111
Sufficient, and Equitable, Allocation of Resources
Developing and implementing clear, coherent, and impactful policies and practices that integrate MCs into human capital systems requires significant capacity (for example, hiring more coaches) and financial resources. But financial and human capital resources are not currently equally available for all schools, with those serving the highest-need student populations often being the most under-resourced. Any implementation of high-quality MCs into educator human capital systems will also be inequitable if the needs and resources of its individual schools and LEAs are not a primary determinant of how much state-based aid is offered and how it is allocated.
Access to sufficient resources for success also impacts school and LEA decisions about whether to apply to participate in pilots. Many smaller and/or less-resourced LEAs will not have the capacity to respond to lengthy applications without support, let alone implement their plans with fidelity.112
Some entities have allocated resources to account for existing inequities in their systems. For example, Louisiana focused its teacher leadership MC pilots on educators in its highest-need LEAs and it provided substantial financial support and technical assistance.113 Instead of punishing schools that were struggling to implement state-required PLCs, Georgia focused technical assistance in those regions to assist with implementation.114 HPS has also been focused on equity in its rollout, monitoring MC implementation at its most struggling schools in comparison to others so it can respond to any challenges that may arise.115 In some places, regional education service agencies, such as KEDC, have stepped in to apply to state innovation programs on behalf of the small, under-resourced LEAs that they serve.
Importance of Iterative Implementation
Arkansas originally made MCs mandatory for its new teacher induction programs. But shortly after, the state had to change course and make MCs voluntary after many educators struggled to earn one, in part because their mentors were not able to adequately support them.116
Arkansas’s experience is the perfect cautionary tale; failing to implement MCs iteratively, via pilots or other small-scale programs, increases the possibility that educators will become frustrated with any initial flaws, and the MC initiative will fail, or at least require greater effort to convince educators to give it another try. With this in mind, most states and LEAs implementing MCs have started by piloting the work with a small population and then scaling up slowly while working out any kinks. Those that did not take this approach found that some educators had already written off MCs by the time they had addressed issues. MCs are new, and capacity building—both in terms of guaranteeing support and ensuring educator comfort with a new approach—is needed prior to any far-reaching mandate.
This paper’s companion Model State Educator Micro-credential Policy Guide explains further how policy choices and implementation can help micro-credentials to meet their potential.117
4. Measuring Impact on Teacher Practice and Student Outcomes
The educator MC theory of change is that a teacher who can demonstrate an evidence-based competency at a given point of time will continue to apply that competency in future practice, leading to better student outcomes. There is little rigorous research to date about if or how MCs impact the quality of ongoing teacher practice or student outcomes in the short or long term. However, a few studies demonstrate at least some correlation between the two.
The Friday Institute studied the effects of providing teachers with feedback and opportunity to earn MCs as part of a MOOC end-of-unit performance assessment (the “treatment” group) as compared to teachers who had to submit the same performance assessment without feedback or the potential to earn a MC (the “control” group).118 Both groups were required to submit evidence (their choice of video, student work, or other documentation of classroom practice) and reflections on their practice, and both had access to the rubric used to evaluate their submissions. The treatment and control groups had similar levels of engagement and persistence in the MOOC. But educators in the treatment group scored higher on the rubric than those in the control group, indicating that feedback and possibility of earning a MC led to better ultimate performance. However, there is no evidence that teachers in either group continued to implement the skill in their classroom upon completion of the assessment.
In her doctoral dissertation, KVEC’s Jennifer Carroll found that students taught by educators participating in MCs performed significantly better on the Northwest Evaluation Association Measures of Academic Progress (NWEA MAP) test, a nationally-normed, adaptive, suite of general knowledge assessments, than peers who did not.119 However, because teachers chose whether to enroll in a MC, there is the possibility that the results are due to selection bias (i.e., more effective teachers were more likely to enroll in a MC than less effective teachers).
One reason we do not have more information about the impact of MCs is their sheer newness, but another is access to data. Several LEAs and states described how they are unable to access their own data on the MC platform that they use. Without it, they are unable to make necessary modifications, or to assess engagement and other outcomes.
Even with more access to data, the variability in MC offerings themselves, in addition to the equally important elements scaffolding MC attainment (e.g., coaching) and the incentives and currency attached to them, would make it very difficult to generalize any findings about MC impact on teacher practice or student outcomes. Any further research on impact must strive to understand how these differences impact the ability of MCs to meet their intended objectives. For example, research should try to assess whether requesting certain types of evidence of competency from educators is more likely to predict ongoing incorporation of this competency into practice.
Citations
- American Institutes for Research (AIR) developed a “Quality Criteria Tool” to help states consider necessary structures for successful MC implementation, as well as criteria for evaluating proposed or offered MCs for quality. See Cross-State Collective Inquiry Project: Micro-Credential Quality Criteria (Washington, DC: American Institutes for Research, 2019), source. The Southern Regional Education Board Micro-credential Work Group brought SEA officials together to discuss pathways for PD, including MCs and ultimately developed a framework with the assistance of South Central Comprehensive Center and the Appalachia and Southeast Comprehensive Centers. Beverly Mattson, John Ross, and Kerri White, Micro-credentialing in an Educational Human Capital System Framework (Fairfax, VA: Cross-Comprehensive Center and SEA Micro-credentialing Work Group, 2019), source. The National Education Association (NEA) and the Center for Great Public Schools (CGPS) has created a “NEA Micro-credential Implementation Planning Toolkit” for NEA affiliates considering MC implementation. The website includes a Readiness Checklist, Planning Guidance, Program Launching Guidelines, Implementation Guidelines, general MC Guidance, a PLC Facilitator Guide, promotional materials and graphics, and general resources to share: see NEA (website), “Micro-credentials,” source
- National Education Association (NEA) and New America’s Education Policy program co-chaired the task force with Digital Promise. See the list at Council of Chief State School Officers (CCSSO website), “Design, Assessment, and Implementation Principles for Educator Micro-credentials,” source
- While this was true of the entities we interviewed for this project, the number of entities issuing something labeled MCs is increasing rapidly, and many do not align with New America’s definition of micro-credentials.
- The Teacher Quality Programs Technical Assistance Center (TQP TA Center), “Designing a Rigorous Micro-Credential Assessment Process to Verify Mastery of Competencies: Key Considerations,” July 2019, source
- “Statistically perfect” in this context is 80 percent reliability. Jason Lange (Co-Founder and President, BloomBoard), in discussion with authors, October 7, 2020.
- Lange in discussion with authors, October 7, 2020; and TQP TA Center, “Designing a Rigorous Micro-Credential Assessment.”
- Odelia Younge (Director, Micro-credentials, Digital Promise) and Christina Luke (Director, Digital Certifications and Credentialing, Digital Promise) in discussion with authors, October 6, 2020.
- Ann Nutter-Coffman (Manager, Teacher Quality, NEA) in discussion with authors, September 23, 2020.
- Series of discussions with authors: Alesha Daughtrey (Executive Director and Partner) and P. Ann Byrd (President and Partner), Center for Teaching Quality, September 17, 2020. Patricia Deklotz (Superintendent, Kettle Moraine School District) and Theresa Ewald (Assistant Superintendent of Teaching & Learning), Kettle Moraine School District, September 25, 2020. Sue Beers (Executive Director) and Ann Bartelt (District Support Team), MISIC, July 24, 2020. Alexandra Manuel (Executive Director) and Maren Johnson (Associate Director, Educator Preparation and Credentialing), October 13, 2020, Washington Professional Educator Standards Board. Robert Brown (Professional Learning Lead for Micro-credential Policy) and Jennifer Carroll (Professional Learning Lead), KVEC, September 21, 2020. Alex Dreier (Instructional Design Lead) and Mark Samberg (Director, Technology Programs), Friday Institute for Educational Innovation, August 28, 2020. Lange, October 7, 2020. Nutter-Coffman, September 23, 2020. Evan O’Donnell (Director of Analytics and Innovation), Teaching Matters, September 9, 2020.
- Melissa Tooley and Taylor White, Rethinking Relicensure: Promoting Professional Learning Through Teacher Licensure Policies (Washington, DC: New America, 2018), source; and Digital Promise (website), “Understanding School-Based Data,” source
- Discussion with authors: Beers and Bartelt, July 24, 2020 and Lange, October 7, 2020.
- CCSSO, “Design, Assessment, and Implementation Principles.”
- Discussion with authors: Lange, October 7, 2020 and Younge and Luke, October 6, 2020.
- Michael S. Garet, Andrew C. Porter, Laura Desimone, Beatrice F. Birman, and Kwang Suk Yoon, “What Makes Professional Development Effective? Results from a National Sample of Teachers,” American Educational Research Journal 38, no. 4 (2001), source
- TQP TA Center, “Designing a Rigorous Micro-Credential Assessment.”
- TQP TA Center, “Designing a Rigorous Micro-Credential Assessment.”
- Jeff Sauro, “Is a Three-Point Scale Good Enough?” MeasuringU, August 13, 2019, source; and Matt Clifford (Principal Research Scientist) and Patricia Garcia-Arena (Principal Researcher), American Institutes for Research, in discussion with Melissa Tooley, November 10, 2020.
- Lange, email message to authors, December 15, 2020.
- For more information see IMS Global (website), “Open Badges v2.0 IMS Final Release,” source
- Grunwald Associates and Digital Promise, Making Professional Learning Count.
- Grunwald Associates and Digital Promise, Making Professional Learning Count.
- Younge and Luke in discussion with authors, October 6, 2020.
- Dreier and Samberg in discussion with authors, August 28, 2020.
- Digital Promise (website), “Micro-credential Policy Map,” source
- Estimate based on aggregating data shared by Digital Promise and NEA. This is the maximum number of educators that earned MCs, as it is possible that some educators earned MCs on both platforms. Correspondence with BloomBoard indicates that in the last year, nearly 6,000 individuals submitted 10,000 MCs via its platform, although it declined to share how many MCs were actually earned, or the number of earners.
- The Potential of Micro-credentials in Washington State (Olympia: State of Washington Professional Educator Standards Board, 2019), source
- In aggregate, the students served by districts in the pilot were slightly more racially diverse and less poor than state averages.
- Grunwald Associates and Digital Promise, Making Professional Learning Count.
- The major MC platforms either do not have or did not provide us with data on the characteristics of the educators engaging in MCs and their reasons for doing so.
- For example, Teaching Matters is a New York-based organization offering a comprehensive teacher leadership development approach with MCs, and most of its MC clients have been in the New York metro area. Members Impacting Students; Improving Curriculum (MISIC) is a nonprofit consortium of LEAs primarily in Iowa (and one Ohio) that has naturally engaged member districts in its MCs. Overall, a wide variety of geographic areas are currently utilizing MCs, from rural (e.g., Kentucky Valley Education Cooperative (KVEC), a consortium of Kentucky LEAs), to suburban (Kettle Moraine School District in Wisconsin), to urban (Harmony Public Schools in Texas). Some LEAs are very small (South Hamilton Community School District in Iowa), some average-size (Juab School District in Utah), and some big (Clark County School District in Nevada, via its local education association). Some serve more affluent students (Kettle Moraine School District), while others mostly serve students experiencing poverty (KVEC). While some of the LEAs we were able to study served a largely white student population, others served a more diverse, majority Black, indigenous, and people of color (BIPOC) student population.
- Lilla Toal-Mandsager and Libby Ortmann, Office of Educator Effectiveness and Leadership Development, South Carolina Department of Education, in discussion with authors, September 29, 2020.
- Micro-credentials and Teachers: What Do We Know? What Do We Still Need to Learn? (Washington, DC: Center on Great Teachers & Leaders at American Institutes for Research, 2020), source
- A review of competency-based education programs at Western Governors’ University (WGU) found that, “student reviews of WGU tend to praise its convenience and flexibility, but suggest that the design requires a high level of student initiative and persistence.” Elena Silva, Taylor White, and Tomas Toch, The Carnegie Unit, A Century-Old Standard in a Changing Education Landscape (Washington, DC: Carnegie Foundation for the Advancement of Teaching, 2015), source
- The Potential of Micro-credentials in Washington.
- Lauren Acree, Seven Lessons Learned from Implementing Micro-credentials (Raleigh, NC: Friday Institute for Educational Innovation at the NC State University College of Education, 2016), source
- Acree, Seven Lessons.
- CCSSO, “Design, Assessment, and Implementation Principles.”
- Center for Teaching Quality, “Leading Improvement, Together; Walker-Gamble Elementary & The South Carolina Collective Leadership Initiative,” 2019, source
- Christina Kuriacose and Allida Warn, A Movement Towards Personalized Professional Learning, An Exploration of Six Educator Micro-credential Programs (Boston, MA: Center for Collaborative Education, 2018), source
- Burak Yilmaz in discussion with authors, July 27, 2020.
- Discussion with authors: Yilmaz and Robert Thornton (Curriculum Director and Grant Facilitator), Harmony Public Schools, July 27, 2020 and Jim Beeler (Senior Director, College Access Partnerships), Appalachian State University, September 14, 2020; and Kuriacose and Warn, A Movement Towards Personalized Professional Learning.
- Stephen Sawchuk, “Is Teacher Recertification Broken?” Education Week, December 6, 2017, source
- Benjamin Feit, Guodong Liang, Zhaogang Qiao, and William J. Slotnik, Harmony Supporting Top Educators Program (H-STEP): Year Three Evaluation Report (Boston, MA; Community Training and Assistance Center, February 2020), source
- The authors defined “highest-need” as schools with the greatest proportions of minority, low-income, and limited English proficient students. Linda Darling-Hammond, Ruth Chung Wei, Alethea Andree, Nikole Richardson, and Stelios Orphanos, Professional Learning in the Learning Profession: A Status Report on Teacher Development in the United States and Abroad (Dallas, TX; National Staff Development Council, 2009), source
- Darling-Hammond et al., Professional Learning.
- For example, BloomBoard’s founder called time “the number one barrier to success in micro-credential implementation.” Lange, email message to authors, December 15, 2020.
- Barnett Berry and P. Ann Byrd, Micro-credentials and Education Policy in the United States (San Mateo, CA: Digital Promise and Center for Teaching Quality, 2019), source
- South Carolina Department of Education and the Center for Teaching Quality, South Carolina Micro-credential Pilot: CERRA and Charleston County Pilot (Columbia: South Carolina Department of Education, 2017).
- Christina Luke and Viki M. Young, Integrating Micro-credentials into Professional Learning: Lessons from Five Districts (San Mateo, CA: Digital Promise, 2020), source
- Cathy Stakey (Instructional/Technology Coach PreK-6), South Hamilton Elementary, in discussion with Melissa Tooley, October 26, 2020.
- Yilmaz and Thornton in discussion with authors, July 27, 2020.
- The timeframe of data collected was from February through April 2019. Christina Luke in discussion with authors, June 3, 2020.
- Darling-Hammond, et al., Professional Learning.
- Timothy D. Walker, “The Ticking Clock of Teacher Burnout,” The Atlantic, September 29, 2016,source
- Discussions with authors: Daughtrey and Byrd, September 17, 2020; O’Donnell, September 9, 2020; Brooke Molpus (Executive Director, Academic Strategy), Louisiana Department of Education Management, October 29, 2020.
- Lange, email message to authors, December 25, 2020.
- Daughtrey and Byrd in discussion with authors, September 17, 2020.
- Kelvey Oeser (Deputy Commissioner of Educator Support), Texas Education Agency, email message to authors, November 10, 2020.
- Yilmaz and Thornton in discussion with authors, July 27, 2020. They also noted that those who did not work within a PLC had to resubmit their articles of evidence more often than peers who had PLC or coaching support.
- Beers, email message to authors, July 24, 2020; Berry and Byrd, Micro-credentials and Education Policy in the United States.
- Yilmaz and Thornton in discussion with authors, July 27, 2020.
- Nutter-Coffman in discussion with authors, September 23, 2020.
- The Potential of Micro-credentials in Washington.
- Manuel and Johnson in discussion with authors, October 13, 2020.
- Micro-credentials: Driving Teacher Learning & Leadership (Carrboro, NC: Center for Teaching Quality, 2016), source
- Beyond “Job-Embedded:” Ensuring That Good Professional Development Gets Results (Santa Monica, CA: National Institute for Excellence in Teaching 2012), source
- Micro-credentials: Driving Teacher Learning.
- Brown and Carroll in discussion with authors, September 21, 2020.
- Deklotz and Ewald in discussion with authors, September 25, 2020; and Kuriacose and Warn, A Movement Towards Personalized Professional Learning.
- Machel Mills (Director, Professional Learning Systems, Teachers and Leaders Division) and Amy Wooten (Executive Director, Educator Licensure and Preparation), Tennessee Department of Education, in discussion with Melissa Tooley, October 26, 2017.
- Jon Marcus, “More Students Are ‘Stacking’ Credentials en Route to a Degree,” WIRED, June 2, 2020, source
- The Carnegie Foundation for the Advancement of Teaching (website), “What is a Carnegie Unit?” source
- Tooley and White, Rethinking Relicensure.
- U.S. Department of Education (website), “Innovative Assessment Demonstration Authority (IADA),” last modified January 17, 2020, source
- Kuriacose and Warn, A Movement Towards Personalized Professional Learning; and Deklotz and Ewald in discussion with authors, September 25, 2020.
- Krystle Bassett (Innovation and Instruction), Juab School District, in discussion with Melissa Tooley, October 23, 2020. Lange, email message to authors, November 16, 2020.
- For our purposes, a state was counted as having a formal educator MC policy or program if there was some effort at the SEA level to either: explicitly define state policy around MCs in a published resource, use MCs for a state-recognized endorsement or certificate, develop MCs using state resources, use state resources to pilot MC(s), or establish state-widecareer pathways using MCs. If state resources were expended toward MCs, we counted that as active, rather than passive, state action toward MCs. Our tally of state policies is slightly lower than that of some other organizations. For example, see the map on Digital Promise’s website created in partnership with Center for Teaching Quality and NEA, source
- Missouri Association of Elementary School Principals and Missouri Association of Secondary School Principals, “Missouri’s Introduction to an Alternative Path to Recertification Micro-credentials,” source
- Virginia: science, technology, engineering, and mathematics (STEM) endorsement areas, including computer science; Rhode Island: computer science; Oklahoma: severe-profound disabilities for special education teachers; Missouri: developing pathway for obtaining education specialist degree, career certificate for principals; Minnesota: endorsements (and certifications) for alternative career teachers and technical education teachers; Illinois: Professional Educator license endorsements in Learning Behavior Specialist 1, and Early Childhood Special Education through a partnership with American College of Education; and Arizona: computer science endorsement.
- Beers and Bartelt in discussion with authors, July 24, 2020.
- Deklotz and Ewald in discussion with authors, September 25, 2020.
- Younge and Luke, email message to authors, November 16, 2020.
- Beers and Bartelt in discussion with authors, July 24, 2020. Note that the number of hours that MISIC offers educators for each MC is less than that provided by other entities, despite the MCs being relatively on par with other entities in terms of grain size. The process of translating MCs into credit hours is not standardized. Most entities choose to provide the same credit hour equivalency for all MCs regardless of actual time estimated to complete.
- Bassett in discussion with Melissa Tooley, October 23, 2020.
- Tooley and Hood, “Schools Take a Lesson from Tech Industry;” and discussions with authors: Dreier and Samberg, August 28, 2020 and O’Donnell, September 9, 2020.
- Oeser in discussion with authors, November 3, 2020.
- Toal-Mandsager and Ortman in discussion with authors, September 29, 2020.
- Molpus in discussion with authors, October 29, 2020.
- Gary Sykes, “Micro-credentials for Educators: Research to Inform and Interrogate an Innovation: Report on a Conference,” unpublished paper prepared by Educational Testing Service for the Carnegie Corporation of New York, 2018.
- Yilmaz and Thornton in discussion with authors, July 27, 2020.
- RTI International, “Micro-credential Focus Group: Emerging Framing Ideas” (virtual presentation to the North Carolina Partnership for Micro-Credentials, November 23, 2020).
- Tooley and White, Rethinking Relicensure.
- For example, see page 7 in Kuriacose and Warn, A Movement Towards Personalized Professional Learning.
- Connecting Credentials, Building Trust in the Quality of Credentials (Ann Arbor, MI: Corporation for a Skilled Workforce and Lumina Foundation, 2017), source
- Grunwald Associates and Digital Promise, Making Professional Learning Count.
- Mills and Wooten in conversation with Melissa Tooley, October 26, 2017.
- Dian Schaffhauser, “Teachers Like Coaching for PD, but Impact Could be Greater,” The Journal, February 10, 2020, source; and K–12 Dive (website), “Survey: Teachers Want More Time for Collaboration,” source
- Depending on the MC provider, educators may be charged for each MC they choose to engage in and/or submit evidence for assessment.
- Sykes, “Micro-credentials for Educators.”
- “Change Your Brain: Neuroscientist Dr. Andrew Huberman,” episode 533 of Rich Roll podcast, source
- “Change Your Brain.”
- David Burkus, “Extrinsic vs. Intrinsic Motivation at Work,” Psychology Today, April 11, 2020, source
- For example, see Daniel H. Pink, Drive: The Surprising Truth About What Motivates Us (New York: Riverhead Books, 2009).
- Regional differences in pay result in varying attitudes: A 2018 PDK poll found that 60 percent of teachers in the Northeast, 47 percent on the West Coast and roughly 30 percent of teachers in the South and Midwest said they are fairly paid. For more information, see CNBC Make It (website), “50% of Teachers Surveyed Say They’ve Considered Quitting, Blaming Pay, Stress and Lack of Respect,” source; and Karen Hawley and Nicole Katz, “Teacher Salaries: A Critical Equity Issue,” State Education Standard 18, no. 3 (2018), source
- The Irreplaceables.
- Emma García and Elaine Weiss, U.S. Schools Struggle to Hire and Retain Teachers (Washington, DC: Economic Policy Institute, April 16, 2019), source
- For a full list of specifications, see IMS Global (website), “Open Badges v2.0 IMS Final Release,” source
- Rob Akers (Associate Commissioner), Office of Educator Licensure & Effectiveness, Kentucky Department of Education, in conversation with authors, October 2, 2020.
- Latishia Sparks (Programs and Partnerships) and Charles Rutledge (Educational Consultant), Kentucky Educational Development Corporation, in conversation with authors, November 13, 2020.
- Of the 24 MCs, 20 are mandated MCs (aligned with Danielson’s observation rubric), and the final four MCs function as a personalized “capstone” action research project. Rutledge and Sparks in discussion with authors, October 9, 2020.
- Alyssa Evans, Cassidy Francies, and Tiffany McDole, 50-State Comparison: Teacher License Reciprocity (Denver, CO: Education Commission of the States, June 24, 2020), source
- Laura Varlas, “Education Funding: Underwater and Overdue for Reform,” ASCD 16, no. 3 (2010), source
- Molpus in discussion with authors, October 29, 2020.
- Shauntice Wheeler (Title II, Part A Program Manager at State Activities and Professional Development), Georgia Department of Education, in discussion with authors, October 9, 2020.
- Yilmaz and Thornton in discussion with authors, July 27, 2020.
- Sandra Hurst (Diretor, Office of Educator Effectiveness), Arkansas Department of Education, in discussion with authors, August 13, 2020.
- Melissa Tooley and Joseph Hood, Harnessing Micro-credentials for Teacher Growth: A Model State Policy Guide (Washington, DC: New America, 2021), source
- Lauren Acree, Jim Creager, Eric Wiebe, and Mary Ann Wolf, “The Impact of Micro-credentials on Professional Learning in a Massive Open Online Course for Educators” (American Educational Research Association Annual Meeting, New York, 2018). The MOOC was separated into six distinct units, and each unit had a corresponding MC that those in the treatment group could earn. The study focused on units 2, 3, and 4, which respectively examined working memory, executive function, and motivation in the classroom.
- Jennifer S. Carroll, “A Quantitative Study of the Impact of Micro-credentials on Educator Professional Learning,” (PhD diss., University of the Cumberlands, 2019).