In last month’s Review, you read about the State’s new teacher evaluation pilot program, Excellent Educators for New Jersey (EE4NJ). Since then, the N.J. Department of Education has announced 10 districts that will participate in the pilot.
This issue looks at the teacher evaluation model that six of the 10 pilot districts selected, Charlotte Danielson’s “Framework for Teaching.” In addition, seven of the eight schools receiving federal School Improvement Grants (SIG)—schools that the State required to participate in the pilot program--also selected this model.
The Danielson framework has been in existence for more than 15 years and is currently used in more than 30 percent of New Jersey school districts. Many aspects of the Danielson approach are included in the other three models that districts could have chosen within the pilot program. It also figures prominently in NJEA’s recommended teacher evaluation framework.
This month’s installment in a series of articles on the proposed teacher evaluation program introduces Review readers to the Danielson model.
A good system of teacher evaluation must answer four questions: How good is good enough? Good enough at what? How do we know? Who should decide?
"This is so much better," proclaimed Carla, a fourth-grade teacher, following an evaluation conference with her supervisor.
“Before, I had no idea what my principal was looking for—I had to be a mind reader! So I just played it safe, taught a familiar lesson, one I knew would go well—but did the process improve my teaching? Not at all! In my old school, the principal just came in with a checklist, but we never really talked. But this time, we had a great conversation about how to help my students want to write. It really made me think. As a result, I've got a new approach: I'm going to engage some students around the things they're passionate about and have them try to convince their classmates about the value of such interests.”
Carla's statement provides an insight into how we might improve teacher evaluation to better foster conditions for both teacher and student learning. Let's consider the deficiencies of traditional systems. These include:
- Outmoded evaluative criteria, usually in the form of checklists.
- Simplistic evaluative comments, such as "needs improvement," "satisfactory," and "outstanding" without any consistency as to what those words mean. Many teachers end up being rated at the highest level on every item, with no guidance as to where they might focus their improvement efforts.
- The same procedures for both novice teachers and career professionals, and therefore, no differentiation that reflects veteran teachers' experience and expertise.
- Lack of consistency among evaluators; a teacher might be rated at the highest level by one administrator and much lower by another. This makes it much easier to attain tenure in some schools than in others, a violation of a fundamental principle of equity.
- One-way, top-down communication. Evaluation is a process that's "done to" teachers, and it often feels punitive, like a "gotcha."
Why do we evaluate teachers?
We can remedy these problematic characteristics by attending to some basic principles of assessment and teacher learning. First, it helps to be clear about why we even have teacher evaluation. Laws, of course, require it. But why are there laws? The first and most fundamental reason is because public schools are public institutions; they take public money, and the public has a right to expect high-quality teaching. But there are two more basic purposes.
To ensure teacher quality. Credibility in an evaluation system is essential. A principal or a superintendent must be able to say to the school board and the public, "Everyone who teaches here is good— and here's how I know." A teacher evaluation system that satisfies this requirement will include the following:
- A consistent definition of good teaching. To assess the quality of teaching practice, it's essential to define it. It's not sufficient to say, "I can't define good teaching, but I know it when I see it."
One of the most widely used systems that define good teaching is the Framework for Teaching, which describes not only the teaching that occurs in the classroom but also the behind-the-scenes work of planning and other professional work, such as communicating with families and participating in a professional community. For each component of good teaching, the framework includes four levels of performance—unsatisfactory, basic, proficient, and distinguished—that describe the degrees of teacher expertise in that component. To learn more about the framework, visit www.danielsongroup.org/theframeteach.htm.
- A shared understanding of this definition. Everyone in the system—teachers, mentors, coaches, and supervisors— must possess a shared understanding of this definition. Having a common language to describe practice increases the value of the conversations that ensue from classroom observations.
For example, discussing "student engagement in learning" is more effective when everyone understands what this looks like in light of four elements: activities and assignments, grouping of students, instructional materials and resources, and structure and pacing. Conversations using this more specific language invite teachers to analyze their own practice and invite observers to inquire about the decisions a teacher has made in planning and executing a lesson.
- Skilled evaluators. Those who evaluate teachers must be able to recognize classroom examples of the different components of practice, interpret that evidence against specific levels of performance, and engage teachers in productive conversations about their practice. Evaluators must be able to assess teachers accurately so teachers accept the judgments as valid and the public has confidence in the results.
As of November 2011, it will be possible for observers to be “certified” in their skill in accurately and consistently observing and assessing teacher practice. This will be available through Teachscape, and has been developed in collaboration by Teachscape, the Educational Testing Service, and me.
- Differentiated approach: Evaluations that focus on quality assurance yield judgments that are fair, reliable, and valid. They are helpful in looking at both new and experienced teachers' practice and in determining whether a teacher's skill has slipped below standard and needs strengthening.
Administrators will use the evaluations for decisions regarding employment and they must take into account that the needs of beginning and experienced teachers are different. This is crucial when deciding which teachers should attain permanent status as tenured professionals, which tenured teachers meet the standard for ongoing comprehensive evaluation, and which tenured teachers need assistance and further monitoring as they are not meeting the district’s standards for teaching.
To promote professional development. There is another--and arguably more important--purpose of teacher evaluation: to promote professional learning. Teacher evaluation typically serves this more developmental purpose through professional conversations between teachers and colleagues who observe in their classrooms and between teachers and supervisors following formal or informal observations.
A commitment to professional learning is important, not because teaching is of poor quality and must be "fixed," but rather because teaching is so hard that we can always improve it. No matter how good a lesson is, we can always make it better. Just as in other professions, every teacher has the responsibility to be involved in a career-long quest to improve practice.
Two in one
The challenge is merging these two purposes of teacher evaluation. Educators need to create procedures that yield valid and reliable results—that is, that satisfy the legitimate demands for quality assurance while promoting professional learning. In truth, the demands are somewhat different. A system to ensure quality must be valid, reliable, and defensible (these are "hard sounding" qualities) whereas a system designed to promote professional learning is likely to be collegial and collaborative and much "softer-sounding" qualities.
Until recently, educators' attempts at merging quality assurance with professional learning have taken the form of enhancing evaluators' skills using techniques like clinical supervision and cognitive coaching. These are valuable skills and worth learning, but they are insufficient. The profession is better served when the requirements for these two purposes are embedded in the design of the systems themselves.
We can get a clue as to the nature of this problem if we consider the typical observation, supervision, and evaluation process in use in most schools. The scenario proceeds as follows: The administrator goes to the classroom and watches a lesson, takes notes, goes away and writes up the notes, and then returns and tells the teacher about the lesson (what was good, what the teacher could improve). Most observations are a variation on this theme.
It's important to note that in this scenario, the administrator is doing all the work; the teacher is completely passive. (The teacher has, of course, taught the lesson, but the teacher contributes nothing to the observation itself.) So it's not surprising that teachers don't find the process valuable or supportive of their learning. The process violates everything we know about learning— that learning is done by the learner through a process of active intellectual engagement.
If we want to design teacher evaluation systems that teachers find meaningful and from which they can learn, we must use processes that not only are rigorous, valid, and reliable, but also engage teachers in those activities that promote learning—namely self-assessment, reflection on practice, and professional conversation.
We can modify the traditional observation scenario to accomplish these aims. A revised process—like the one Carla was so enthusiastic about at the beginning of this article—might look like this:
- The administrator goes to the classroom, watches a lesson, and takes notes on all aspects of the lesson: what the teacher says and does, what the students say and do, the appearance of the classroom, and so on.
- The administrator gives a copy of his or her notes to the teacher.
- The administrator analyzes the notes against the evaluative criteria and levels of performance.
- The teacher reflects on the lesson using the observer's notes and assesses the lesson against the evaluative criteria and levels of performance. The teacher will probably, as a result of this reflection, identify aspects of his or her teaching to strengthen, and that teacher will reach these conclusions without prompting from the principal. Of course, the principal can always point things out, but when the teacher reflects on a lesson before the post-observation conference, he or she will frequently be as critical as the principal would have been.
- The teacher and the administrator discuss the lesson. The teacher puts the lesson into context for the administrator, and together they decide on the teacher's strengths and areas for growth. Naturally, the administrator wasn't in the classroom the previous day and can't be familiar with all the issues that the teacher must address. So the teacher might describe a particular student's learning challenges, and the principal might suggest a different approach. But they conduct the conversation in light of their shared understanding of what constitutes good teaching.
The following areas are viewed by evaluators and teachers as being crucial to effective teacher evaluation:
- A consistent definition of good teaching. For a teacher evaluation system to be transparent and credible, everyone must understand what constitutes good practice. Unless principals and teachers participate in focused training, they probably will not have this understanding.
- Opportunities to engage in meaningful conversations about practice. As members of the Danielson Group have observed after working with teachers and administrators in hundreds of school districts. "It's all about the conversation." Noted one teacher, "You get to close the door, turn off the noise, and actually sit and talk [with your supervisor], which is really, really nice."
- A focus on what matters. Both teachers and administrators appreciate an opportunity to concentrate their collective attention on the important issues of teaching and learning. These typically occur in the post-observation (reflection) conference. As one principal pointed out, "The conversation is entirely different. My conversation before was 'You were tardy,' 'You didn't turn in your lesson plans,' all those kinds of things. Now this conversation is about good instruction."
- An atmosphere of trust. Evaluation systems that promote a culture of professional inquiry must be based on trust. Teachers must believe that evaluators are knowledgeable and that their recommendations are grounded in professional understanding. In other words, teachers need to trust that administrators know what they are talking about. Evaluators must also be consistent in their dealings with teachers, and their assessments must be predictable and stable over time. Teachers and administrators must also believe that the things they say in confidence will stay out of the public eye.
- A focus on multiple measures or evidence of student learning. A system that relies predominantly on standardized tests to define student learning involves many conceptual and technical difficulties. Multiple choice tests can assess only certain types of content, primarily knowledge of facts and procedures. They are less suited to testing more complex forms of learning, such as student’s ability to solve non-routine problems, write an essay, or design an experiment.
Standardized tests are also subject to various psychometric limitations in assessing teacher quality such as the influence of factors outside the school, missing data, student mobility, the nonrandom assignment of students to teachers, and the unavailability of state tests for a full range of subjects and levels. Even systems that measure individual student growth on standardized tests over time (“value-added”) have limited value in assessing teacher quality because they are based on the same psychometric limitations. Systems that provide the opportunity to review and discuss multiple indicators of student progress – not just standardized tests – have the greatest likelihood of improving teaching. Evidence of student learning can be found in many forms including district or teacher created assessments, and portfolios that include evidence of student work over time. For example, student writing samples from September and May supply ample evidence of a teacher’s skill in supporting student learning.
- A commitment to resources. Many new evaluation systems have failed to achieve their desired outcomes because schools and districts have not provided sufficient resources to support their plans. Schools must provide training, planning time, and release time for work on professional development plans and activities, and must support the costs associated with these needs.
The need for trained evaluators. A credible system of teacher evaluation requires higher levels of proficiency of evaluators than the old checklist, "drive-by" observation model. Evaluators need to be able to assess accurately, provide meaningful feedback, and engage teachers in productive conversations about practice.
In our experience with the Framework for Teaching, members of the Danielson Group have trained hundreds of evaluators all across the United States and in other countries as well. Our findings have been somewhat humbling; even after training, most observers require multiple opportunities to practice using the framework effectively and to calibrate their judgments with others.
Most administrator preparation programs don't teach such skills; administrators must acquire them on the job. But when they do learn them, administrators can be the instructional leaders that schools so urgently need.
A training program for evaluators —one that uses the Framework for Teaching—consists of several steps.
- Evaluators familiarize themselves with the structure of the Framework for Teaching.
- Evaluators learn how to recognize the sources of evidence for each component and element. For example, the classroom environment and instruction are demonstrated primarily in the classroom. Planning and preparation and professional responsibilities depend on artifacts, such as teachers' techniques for communicating with families (for example, newsletters or handouts for back-to-school night) or logs of professional development activities.
- Evaluators learn how to interpret the evidence against the rubrics for each component's levels of performance. For example, in assessing whether a classroom creates an environment of respect and rapport, observers would need to note whether student interactions are characterized by conflict, sarcasm, or put-downs (an unsatisfactory rating for the teacher); whether students, in general, refrain from disrespecting one another (a basic rating); whether student interactions are, in general, polite, and respectful (a proficient rating); or whether students demonstrate genuine caring for one another and monitor one another's treatment of peers (a distinguished rating).
- Evaluators learn how to calibrate their judgments against those of their colleagues. For example, one observer might interpret interactions in a classroom as representing basic performance, whereas another might see them as proficient. There are many reasons for such differences. One observer might simply have missed something important in the classroom, or the two observers might have slightly different ways of interpreting their evidence. But whatever the reason, it's important they discuss the situation so that they can, in the future, make consistent judgments.
Finding time for professional conversations
A second challenge for evaluators and teachers is finding time to conduct meaningful observations and engage in professional conversations about practice. Even in the traditional system, principals and teachers need to devote time to the evaluation process—despite the fact that it often produces few benefits. In the words of an educator with whom we've worked, "It doesn't take any longer to do this process well than to do it poorly, so why not do it well?" What better use of a school leader's time than to engage teachers in conversations about practice?
Evaluator-teacher conversations, when conducted around a common understanding of good teaching—and around evidence of that teaching— offer a rich opportunity for professional dialogue and growth. We can't create more hours in the day, but careful setting of priorities and judicious scheduling of both observations and conferences can make the best use of the time available. Moreover, unless a district's negotiated agreement forbids it, brief and informal drop-in observations yield plenty of information for reflective conversation and require far less time than formal observations do.
Abundant evidence from both informal observation and formal investigation indicates that a thoughtful approach to teacher evaluation—one that engages teachers in reflection and self-assessment—yields benefits far beyond the important goal of quality assurance. Such an approach provides the vehicle for teacher growth and development by providing opportunities for professional conversation around agreed-on standards of practice.
Charlotte Danielson is an educational consultant who has taught at all levels and has worked as an administrator, curriculum director, and staff developer. She advises state education departments and national ministries, both in the United States and overseas. The Princeton, New Jersey, resident is in demand as a policy consultant to legislatures and administrative bodies. She is the author of Enhancing Professional Practice: A Framework for Teaching. Contact Danielson at email@example.com.