Monday, August 6, 2012

Book Summary: Instructional Coaching by Jim Knight


Instructional Coaching—A Partnership Approach to Improving Instruction, by Jim Knight (Corwin, 2007)

Chapter 1 Why Coaching?
This chapter discusses what instructional coaching is and presents some research about why coaching is a far more effective method for professional development than the traditional one-shot presentation.

Chapter 2 What Does Coaching Look Like?
Knight says that there really is no typical day for an IC, that each brings its own set of activities and challenges.  In this and other chapters he shares interviews he’s had with other ICs.  These coaches all agree that their biggest fear is that “teachers will not want to work with them” (p. 20).  But, they found that even teachers who were very reticent in large-group PD sessions were much different when approached for a one-on-one conversation.  Some advice for enrolling teachers is to:  (1) start by listening and respecting teachers with whom the coach is interacting, and (2) communicate that the coach is another teacher willing to help.

Coaches are encouraged to focus on high-leverage topics so as not to waste the time of teachers.  These topics are called the “Big Four”:
  • Behavior:  Coaches can help teachers to create safe, productive classrooms.
  • Content knowledge:  Coaches can help teachers access standards and plan how to translate those standards into lessons.
  • Direct instruction:  Coaches can help teachers to be more effective instructors.
  • Formative assessment:  Coaches can help teachers use formative assessment.


Coaches need to build emotional connections with their teacher partners.  The premise of the book is that coaching is a “partnership mindset.”  Knight explains several of the principles for this mindset:  equality, choice, voice, dialogue, reflection, praxis, reciprocity.  I understood all of these except for praxis (a brand new word for me).  Apparently it means “believing that learning is most meaningful when we reflect and recreate knowledge so that we can use it in our personal or professional lives” (p. 54).

Knight describes the major forms that the coaching partnership will take: 
  • Collaboration
  • Modeling
  • Observing and providing feedback
  • Support


Chapter 3 What is the Partnership Philosophy?
This chapter expands on those core principles of the partnership mindset.

Chapter 4 Partnership Communication—Creating Learning Conversations
Six aspects of effective communication:
  • Understanding the communication process
  • Employing authentic listening
  • Understanding our audiences
  • Recognizing stories
  • Interpreting nonverbal communication and facial expressions
  • Building relationships through emotional connection


The communication process:  Speaker > Message > Listener > Interference > Perceived Message > Feedback

Authentic listening:  Misconceptions, Attentiveness, Self-Awareness, Honesty and Authenticity, Empathy and Respect

Listening strategies:  Developing inner silence, Listening for what contradicts our assumptions, Clarifying, Communicating our understanding, Practicing every day, Practicing with terrible listeners

Understanding our audience—Focus questions:
  • What are my collaborating teacher’s most pressing concerns?
  • What does my collaborating teacher know about this topic?
  • What are my collaborating teacher’s learning preferences?
  • What are my collaborating teacher’s values?


Chapter 5 Getting Teachers on Board and Finding a Starting Point
The chapter begins with a review of some of theory around the concept of “change.”  That is, the stages people go through as they are working toward change.  Next, three components of coaching are presented:  (1) enroll, (2) identify, (3) explain.  Basically there are countless ways to enroll, or begin, a partnership with a teacher or teachers.  And, for step 2 (identifying an area that the partnership can explore), there are several questions given that can be used to decide if one of the Big Four or some other topic is most pressing.  Step 3 is where the IC explains the new, to-be-tested-out teaching practice. 

Chapter 6 Modeling, Observing, and Collaboratively Exploring Data
Tips are given for how coaches should approach modeling of a lesson/practice, as well as observing in a classroom and collaboratively looking at data.  I also found very helpful the suggestions given for what to do when teachers don’t want an IC in their classrooms.  Knight approaches this problem from the viewpoint that it’s a negotiation to encourage teachers to invite ICs into their classes.  And so, he brings in Fisher and Shipiro’s (2005) Five Core Concerns for Negotiation:
  • Appreciation:  (1) Understand each other’s point of view, (2) Find merit in what each of us thinks, feels, does, (3) Communicate our understanding through words and actions.
  • Affiliation:  Build it by (1) Arrange to meet in an informal setting, (2) Sit side by side, (3) Refer to the importance of their interests, (4) Emphasize the shared nature of the task you both face, (5) Avoid dominating the conversation.
  • Autonomy:  The least effective way to utilize coaching is for the administration to tell a staff member he or she must work with a coach.
  • Status:  The IC should be presented as a “second set of hands” so as not to undercut teachers’ expertise and status as classroom leaders.
  • Fulfilling role:  The IC must not threaten teachers’ roles.  The teacher always is the leading mentor, supporter, and teacher in the classroom.


Chapter 7 Focusing on the Big Four:  Behavior, Content Knowledge, Direct Instruction, and Formative Assessment
I really appreciated the disclaimer at the beginning of this chapter that stated that if districts want their instructional coaches to be highly effective, then they need to provide them with extensive professional development in the Big Four areas.  In my own case, what real expertise do I have in these areas over and above any of my colleagues at BHS?  There are teachers at BHS who are far better at classroom management than me; I certainly don’t have the content expertise of any teacher who’s in a field other than mathematics; I am perhaps better read in instruction and assessment theory than most, but that doesn’t mean I have any more classroom experience with these things.  Instructional coaching partnerships will be a huge learning experience for me which will depend greatly on my colleagues’ patience during this learning process.  What I can bring to the partnerships is that opportunity for support and that person with whom to dialogue and reflect.  I can be a second set of hands and another pair of eyes in classrooms.  And, since I am responsible for pretty much anything data-related, I can work with teachers to examine classroom data and search out alternative instructional strategies that might lead to better results.  Jim Knight goes into some detail about the Big Four, but I’m not going to summarize it here because it has a lot of overlap with other resources we’re all familiar with:  the “notable nine” instructional strategies, classroom management strategies, formative assessment, and so on.

Chapter 8 How Coaches Can Spread Knowledge

Chapter 9 Coaches as Leaders of Change

Wednesday, August 1, 2012

Book Summary: Rethinking Homework


Rethinking Homework—Best Practices that Support Diverse Needs (Cathy Vatterott, ASCD 2009)

Chapter 1 The Cult(ure) of Homework
Vatterott is a professor of education and former middle school and high school teacher and middle school principal.  She begins by identifying homework as a long-standing tradition that began when school consisted mainly of reading, writing, and arithmetic.  Rote learning was the norm, and memorization and practice were easy for children to do at home.  But, homework has changed and now sometimes involves complex projects.  The problem is that learners are very diverse, yet most teachers continue to assign the same homework to all.  There have been research studies that give a positive effect size for homework (at least at the secondary level, see for example my book summary of Classroom Instruction That Works in which homework is one of the “notable nine”).  And there have been studies that don’t support homework.  So, who’s right?

Vatterott traces the history of American homework “policy” from the 19th century to the modern day, explaining that it has gone back and forth from “there’s too much homework” to “there’s not enough homework.”  She refers to several books by various authors (Kralovic & Buell 2000, Kohn 2006, Bennett & Kalish 2006) that give an anti-homework stance.  Vatterott summarizes their arguments to conclude that the culture of homework is based on beliefs.
  • Belief #1:  The role of the school is to extend learning beyond the classroom.
  • Belief #2:  Intellectual activity is intrinsically more valuable than nonintellectual activity.
  • Belief #3:  Homework teaches responsibility.
  • Belief #4:  Lots of homework is a sign of a rigorous curriculum.
  • Belief #5:  Good teachers give homework; good students do their homework.

Here are some more “beliefs” that influence our viewpoint on homework:
  • Moralistic views:  Children are basically lazy and irresponsible.
  • Puritan Work Ethic:  Hard work builds character.
  • Behaviorism:  Homework completion can be controlled through rewards and punishments.


But, what if some of these beliefs are wrong?  Or, if not outright wrong, what if there’s more to the story with each of them?
     #1:  “Perhaps our role in extending learning beyond the classroom is to instill in students the value of learning and the joy of learning, and to expose them to the vastness of the universe—how much there is to learn.  Perhaps our role is to help students find something in life they feel passionate about and to help them find their purpose in society” (p. 10).
    #2:  “In reality, physical, emotional, and social activities are as necessary as intellectual activity in the development of healthy, well-rounded children” (p. 11).
    #3:  There is no research that supports that homework promotes responsibility, and really what people mean isn’t responsibility, but obedience.  In fact, homework doesn’t promote responsibility or time management because it has to be coerced by an adult.  To promote responsibility or time management we have to use tasks that give students responsibility.
    #4:  “More time does not necessarily equal more learning….  Rigor is challenge—but it is not necessarily the same challenge for each student” (pp. 12 – 13).
    #5:  This is a moral judgment based on faultily equating students who complete homework with being compliant and hardworking.  If a student lacks a supportive home environment to complete homework to the same standard as his peer, does that make him bad?

Chapter 2 Homework in the Context of the New Family
The context of school may have remained fairly stable over time, but families have changed greatly.  They are more economically and culturally diverse, family composition is more varied, and parenting styles and values may be “mismatched with the values of teachers and schools.”  With all of these changes it’s sort of ridiculous for schools (i.e., teachers and school leaders) to continue assigning homework in the same old way. 

Vatterott explores several ways in which parents (which in today’s family could mean grandparent, step parent, foster parent, sister, etc.) may hold different values than teachers:  not wanting to be a teacher’s “homework cop,” different beliefs about the place of academic work in life, balancing academics with family-chosen activities, the place of paid work.  And she explores the diversity of parent involvement in homework which often has a component of “haves” vs. “have-nots.” 

Vatterott has the following tough advice for teachers:
  • Get real.  “Principals and teachers must accept that they are not totally in charge of a child’s free time and that they do not have the right to demand that parents be involved with and support homework” (p. 46).
  • Resist the temptation to judge.  “Judging, blaming, and whining solves nothing.  Teachers must accept the limitations of parental involvement and find ways to work with the support they have” (p. 47).
  • Revise expectations of parental support.  “Parents should not be expected to teach their child a new skill.  If the child has been given an assignment but has not yet acquired the skill, then the homework is inappropriate” (p. 48).
  • Suggest (do not mandate) guidelines for the parent’s role in homework.  “Parents should be encouraged to be less involved with the child’s actual homework task and more involved in communicating with the teacher—writing notes when students don’t complete work, asking for adaptations, or documenting how much time the child spent on the task” (p. 48).
  • Establish formal methods of parent-teacher communication.
  • Set parents’ minds at ease about homework.  This refers to having a policy of no retribution against a student should a parent question a teacher about homework-related concerns, and a policy that no student can be failed because of incomplete homework.
  • Endorse a set of inalienable homework rights.  (Quite frankly I’m still surprised that BHS has no homework policy when homework is such a ubiquitous and potentially harmful strategy if ineffectively used.)


Chapter 3 Homework Research and Common Sense
Vatterott examines several homework studies (some that are the same as those studied by Marzano and other meta-analysis researchers when they cite particular effect sizes).  She points out that the validity of the studies is problematic because of their design, and that any homework research should be weighed against common sense tenets.
  • Tenet #1:  Quality Teaching Matters.  This includes organization and structure of the learning process, the teacher’s homework behavior, and the teacher’s attitude about homework.  That is, the effective of homework might greatly depend upon the general learning environment (is it orderly or chaotic, focused or distracting), how much and how often homework is given, if the homework is used to inform lessons, if nonpunitive feedback is given, and even a teacher’s comments or facial expressions in reaction to homework.
  • Tenet #2:  Skills Require Practice.  Mastering a skill requires focused practice, but we must first make sure that students are practicing the skill correctly.  “We must give students adequate time to practice before we assume they have internalized the skill correctly” (p. 77).  We should use distributed practice instead of mass practice.
  • Tenet #3:  Time on Task Matters.  But time spent on learning isn’t the same thing as time needed to learn.  If all students are assigned the same homework task, some will be disadvantaged.
  • Tenet #4:  Task Is as Important as Time.  “Students make decisions about whether to attempt homework based on their assessment of the task.  Is the homework perceived to be interesting or boring, simple or tedious?” (p. 79).
  • Tenet #5:  Learning Is Individual.  “Homework needs to be personalized to fit the specific needs of individual students” (p. 80).
  • Tenet #6:  Children Differ in Readiness and Developmental Level.  Homework should be differentiated.
  • Tenet #7:  Children Differ in Learning Style.  Teachers should provide choice and flexibility in homework tasks.
  • Tenet #8:  Children Differ in Motivation, Persistence, and Organizational Skills.  Students who have a feeling of competence about learning are more likely to do homework.  This self-efficacy is strongly influenced by their past history of success or failure with homework tasks.  Students with self-concept are more likely to persist when faced with difficult tasks.  Those who have difficulty persisting might lack strategies or metacognitive skills. 
  • Tenet #9:  Frustration Is Detrimental to Motivation and Desire to Learn.  Teachers should adapt homework assignments to provide opportunities for maximum success and minimum frustration.  Another idea is to make the assignment time-based:  the student is to work as much as she can in a given time, then stop. 
  • Tenet #10:  Homework That Is Not Completed Doesn’t Help Learning


Chapter 4 Effective Homework Practices
The first half of the chapter discusses the “old paradigm” for homework which by now we know Vatterott claims doesn’t work.  For some students, it not only doesn’t work, but it’s outright damaging.  Goldberg (2007) discusses the “homework trap” in which late work or work not done leads to reduced points or zeros, which leads to lower grades, which leads to actions from parents and the school, which leads to counteractions by the students.  “The problem is cumulative and colors the experiences these children have with school, affecting their attitudes and performance in later years” (p. 92, citing Goldberg).  Stiggins (2007) reminds us that there is an “emotional dynamic” to assessment.  “Simply stated, the old paradigm short-circuits our long-term goals by allowing students to fail by not doing homework.  It creates practical and motivational obstacles that converge to form the perfect storm for student failure” (p. 94). 

The second half of the chapter deals with a “new paradigm.”  Its practices are:
  • Designing quality homework tasks
  • Differentiating homework tasks
  • Moving from grading to checking
  • Decriminalizing the grading of homework
  • Using completion strategies
  • Establishing homework support programs

Each practice is explained in quite a bit of detail.


Chapter 5 Homework Completion Strategies and Support Programs
This chapter deals with the last two practices of the new paradigm.  First, teachers will need to confront a fairly typical attitude that “all homework must be done.”  But, is that really true?  If we’re concerned with learning, shouldn’t our attitude be less about finishing work and more about demonstrating learning?  (p. 125)  Second, teachers need to change their question when they encounter students who don’t complete their homework.  It shouldn’t be “How can I make them do it?” but rather “Why aren’t they doing it?”  Possible reasons are:
  • Academic—The task is too hard or too lengthy for the student’s working speed.
  • Organizational—Getting it home, getting it done, getting it back
  • Motivational—Overload, too much failure, frustration
  • Situational—Unable to work at home, too many other activities, no materials available at home
  • Personal—Depression, anxiety, family problems, other personal issues


Next, Vatterott gives several suggestions for how to improve the rate of homework completion:
  • Limit homework to one assignment or one subject per night.
  • Take time to discuss the homework assignment and give students a few minutes to begin in class.
  • Avoid giving homework assignments at the end of the hour, when students are focused on leaving.
  • Set a maximum amount of time that the student should work on each assignment.
  • Provide peer tutors or study groups for some students.
  • Assign students homework buddies.
  • Give assignments further in advance of the due date.
  • Provide homework packets or lists of weekly or monthly assignments.
  • Establish intermittent due dates for parts of long-term projects.
  • Allow some homework to lag two or three weeks behind the introduction of a concept to check for understanding.
  • Make sure all students have the necessary materials at home to complete specific assignments.
  • Use home-based strategies (e.g., parent or student feedback checklists, Home Study Plans, Taylor’s Homework Chain, Home Schedule Card) including providing a copy of the book to store at home or  giving parents specific guidelines on how to help.
  • Be careful about using incentives.
  • Force students to practice responsibility, not by using late policies and failing grades, but by requiring all homework to be completed.  The most effective support programs kick in when a student is missing just 2 or 3 assignments, not after they’re already far behind.  Also, effective programs aren’t punitive, for example they don’t cause students to miss their lunch with friends or to miss out on recess.  At BHS we’ve already accounted for this in the redesign plan with the creation of 7th period, a 40-minute daily opportunity specifically to support students in completing the work assigned that day.  A related accommodation is for the school to develop a homework policy (e.g., each teacher would commit to not assigning more than 7 minutes of homework each day except in special and approved cases).  I say 7 minutes because if a student has six teachers during the day and each gave this amount of homework, then that would require 42 minutes of work time, already 2 minutes in excess of what 7th period provides.  The challenge for teachers is to make the 7 minutes of homework/practice/study/reflection a worthwhile exercise for students.  And, since the 7th period teacher’s effectiveness at being “homework cop” is probably not going to be any better than when parents try to be homework cop, classroom teachers will also have to pay attention to the other ideas mentioned in this book, to ensure that homework tasks are appropriate and engaging for students.

Remember, our overriding goal at BHS is to change our academic culture and this certainly includes moving to a culture where assigned tasks are completed, not avoided.
  Each teacher needs to do his or her part to progress toward this goal including adapting homework policies and practices as needed.


All in all, this was a thought-provoking book and personally challenging for me since I’ve been a proponent of giving lots of homework in math class over the years.  But, I’ve found the arguments compelling, and I think BHS teachers should engage in some thoughtful reflection and dialogue about this issue.  We may find that there’s strong reason to change how we approach homework at our school.

Book Summary: Transformative Assessment


Transformative Assessment (W. James Popham, ASCD 2008)

We’ve been using formative assessments at BHS for a few years now.  Are we using them properly?  We’ve based our system of assessing students’ progress and tracking their progress toward learning goals on Marzano’s books.  But, he’s not the only researcher out there.  What do others have to share, and are their ideas helpful to us?  Popham is widely considered to be “the expert” when it comes to assessment.  It will be interesting to learn what he has to say on the matter, plus, he writes in a snappy casual style, which is refreshing.

In the preface Popham makes a bold statement that classroom assessment “can fundamentally transform the way a teacher teaches” (p. vii).  Already I’m feeling bad because even though I’ve supposedly used formative assessments for a few years now, I don’t think my instruction has been fundamentally changed.  Thus, I don’t think I’ve really been using “formative” assessments even if that’s what we’ve been calling these periodic tasks for which we’ve entered scores in Pinnacle gradebook. 

Popham identifies four “levels” of formative assessment:
  •  Level 1:  Teachers use formative assessment to collect evidence by which they can adjust their current and future instructional activities.
  • Level 2:  Students use formative assessment evidence to adjust their own learning tactics.
  •  Level 3:  There is a complete shift in the culture of a classroom.  Classroom assessment isn’t used to compare students based on grades, but as a means to generate evidence from which teachers and students can adjust what they’re doing.
  • Level 4:  There is schoolwide adoption of one or more levels of formative assessment.

Where are we at BHS?  No doubt some teachers are more successfully incorporating the various levels, but I think we’re well short of Level 4. 

Chapter 1 Why, What, and Whether
Popham explains the history of the term “formative assessment” and follows up with his definition:  “Formative assessment is a planned process in which teachers or students use assessment-based evidence to adjust what they’re currently doing” (p. 6).

At BHS our redesign plan gives a lot of attention to this.  The building-wide lesson plan form, along with the data team process, constitute a planned process to adjust instruction based on in-class checks for understanding (assessments).  Our whole approach to lesson planning is changed.  No longer are teachers to plan out a unit or week’s worth of material, submit it to the principal, and then rigidly stick to that plan.  Instead, lesson planning is to be responsive to the needs of the students in the classroom as identified using regular checks for understanding.  The lesson planning form is to be completed and submitted (e.g., each Monday), but it is to be continuously updated throughout the week.  Plus, differentiated strategies are to be applied to students at different performance levels with respect to the learning goal(s) being studied. 

At BHS the redesign plan also calls for greater emphasis on students modifying academic behaviors based on assessment evidence.  Under our Marzano-influenced efforts teachers were to encourage students to track their own progress and create action plans, but, we didn’t seem to have much success with that intervention.  In fact, many teachers quickly abandoned having students even track their scores, let alone using class time to be responsive to their performance results.  In 2012 – 2013 this needs to change.  Teachers are to plan for opportunities to support students in taking personal (and perhaps cooperative) responsibility for their own learning.

The third crucial piece to the definition is the expectation that the formative evidence will be used to adjust what is currently being done.  For some teachers this will also be a change.  The data isn’t to be used to plan how you’d teach a topic differently next year, it’s to formulate how you’ll teach it in the next 30 minutes, or maybe more realistically, tomorrow.  For this reason, teachers may have to use completely different assessment tasks.  Timely feedback and opportunity for data analysis is essential.  A formative assessment cannot be a large test or project that will take the teacher several days to “score.”  This isn’t to say that you can’t use those tasks, but that they aren’t most appropriate for formative assessment. 

Chapter 2 Learning Progressions
“Formative assessment is all about decision making.  Those decisions, made by both teachers and students, invariably revolve around the following two-part question:  ‘Is an adjustment needed, and, if so, what should that adjustment be?’” (p. 23).  Popham says that it’s pretty much impossible to adjust everything in response to data, and so there needs to be a framework around which decisions can be made.  This framework is a learning progression (yes, the same thing we’ve created when following Marzano to make rubrics for our learning goals).  A learning progression is a sequenced set of subskills and bodies of enabling knowledge that, it is believed, students must master en route to mastering a more remote curricular aim.  Popham cautions:
  • A learning progression isn’t unerringly accurate.  It's just what a teacher thinks is a sequence of steps to complete understanding of a concept or skill.
  • A particular learning progression isn’t suitable for all students. 
  • A learning progression isn’t necessarily better if it’s more complex.
  • A learning progression tells teachers what and when to assess. 

  1.      What should be assessed?  Answer:  The subskills and enabling knowledge identified in the progression.
  2.      When to assess?  Answer:  Before proceeding to the next building block in the progression.

Marzano said all these same things, but we seemed to get caught up in worrying about gathering four scores for a learning goal instead of worrying about gathering the right evidence at the right time.  I’ve described elsewhere (see the Livebinder) how our approach to recording scores will change when we switch to TIES gradebook.  Briefly, before starting a unit or mini-unit over a LG give a pretest (this score is entered into TIES, but given 0 weight).  Use the results from this pretest to formulate your lesson plan for the unit (e.g., maybe you’ll need one or two weeks to adequately teach the LG) including making a start at differentiated strategies.  Check for understanding along the way (for what and when, see Popham’s advice).  These scores can also be recorded in the gradebook to identify learning progress (but they still carry 0 weight).  Continuously adjust lesson plans and differentiated strategies based on these checks.  Once all, or a majority of, students do well enough on a check for understanding that you predict success on a post-test, give a post-test.  In TIES, record a score that represents your best judgment of a student’s current understanding for the LG (and weight this 100%).  Later in the course if the LG comes up again (or a student shows improvement or maybe even goes backward) just change this “final” score.

There’s a cool overlap of Popham’s discussion of how to use learning progressions and formative assessments with the data team protocol we’ll be using in 2012 – 2013.  Data teams only meet once per week so teachers may need to use the protocol on their own when planning in order to remain timely.  A step in the protocol is to examine student data in order to make inferences.  Popham  suggests that the inferences we’re after are:  (1) has the student already mastered the building block?, (2) has the student partially mastered it?, (3) has the student not mastered it at all?  And, if there’s lack of mastery, to try to figure out why.  From there, plan next steps.

Popham spends the rest of the chapter explaining a procedure to develop a learning progression.  It is quite similar to the procedure that we used when following Marzano.  I’ll just list the steps:
  1. Thoroughly understand the target curricular aim.
  2. Identify all requisite precursory subskills and bodies of enabling knowledge.
  3. Determine whether students’ status with respect to each preliminarily identified building block can be measured.
  4. Arrange all building blocks in an instructionally defensible sequence.

Chapter 3 Teachers’ Instructional Adjustments
Here are four steps in Level 1 formative assessment:
  1. Identify Adjustment Occasions.  *Note:  this is not referring to those on-the-spot responses teachers make such as giving one-on-one help on a math question or asking a follow-up question to a student.  Instead, these represent the “most significant choice-points associated with students’ movement toward mastery of the target curricular aim” (p. 53).  This is about teachers looking forward into their lesson plans to identify occasions to gather evidence in order to adjust instruction.  Fortuitously the building-wide lesson plan form anticipated this recommendation and has a field for teachers to identify their planned assessment occasions.
  2. Select assessments.  There are lots of choices:  traditional, letter cards, questioning during discussion, whiteboard responses, traffic-signal, item sampling
  3. Establish adjustment triggers.  This refers to teachers deciding ahead of time what will trigger a decision to adjust instruction.  Almost all instructional adjustments boil down to either increase instruction or decrease instruction, so teachers need a trigger for both.
  4. Make instructional adjustments.

Chapter 4 Students’ Learning Tactic Adjustments
“Level 2 formative assessment consists of student-determined adjustments to their learning tactics, not teacher-dictated adjustments that students are supposed to make” (p. 72).  Teachers must play a supportive role, not a decision-making one.  But, teachers cannot only be permissive of students taking personal responsibility, they need to be strongly encouraging.  Teachers will need to teach students what a “learning tactic” is and why it’s important that students become personally responsible for their own adjustments.  This requires initial orientation and ongoing support.  One type of support is clarifying curricular expectations:  (1) the nature of the immediately upcoming curricular aim, (2) the evaluative criteria to be employed in judging students’ mastery, (3) the chief building blocks involved in mastery.  In all this, use language that the students will understand, explain assessment procedures, and share extreme responses (i.e., really strong vs. really weak student or mock responses).

The same four steps that apply in Level 1 formative assessment work here too. 
  1. The teacher tells students when the assessments are (i.e., when there will be adjustment occasions).
  2. The teacher will most likely have to prepare/direct assessments (because most students don’t have the initiative or capacity to do if for themselves).  Some student choice can be brought into play if there are optional assessments or maybe peer assessment.
  3. Students also need to establish adjustment triggers.  The teacher’s role here isn’t to tell a student what trigger to use, but to monitor periodically and make suggestions when the student’s learning tactics aren’t working.
  4. The teacher probably will have to suggest alternative learning tactics.  But, the teacher doesn’t make any decisions for the student.

Popham uses the rest of the chapter to discuss Level 3 formative assessment.

Chapter 5 Schoolwide Implementation

Chapter 6 What It Can’t Do
Much of this chapter is a rather high-level explanation of why using formative assessments in the classroom doesn’t necessarily correlate with increased achievement on standardized tests.  Popham goes through many of the arguments that most of us are familiar with (test bias in relation to SES, instructionally insensitive instruments (they’re designed to rank students, not compare quality of instruction), aptitude-linked questions, too many curricular targets, dysfunctional reporting of results (e.g., at the strand level instead of focused curricular aims).  Anyway, so after a whole book touting formative assessment, we’re left with his conclusion that we probably won’t see increases on standardized tests due to the very way these tests are designed and revised over time.  I guess our hope then is that properly utilized formative assessments will lead to more effective instruction and greater student success in classrooms, which in turn will lead to more engaged and motivated students willing to persevere and give greater effort during the MME.

Friday, July 27, 2012

Book Summary: Classroom Instruction that Works, 2nd Edition


Classroom Instruction that Works--Research-Based Strategies for Increasing Student Achievement, 2nd Edition (Ceri Dean, Elizabeth Hubbell, Howard Pitler, Bj Stone, ASCD McREL, 2012)

I have read and used the 2001 version of this book, which for many of us was our first exposure to Robert Marzano.  In that book he and his coauthors Debra Pickering and Jane Pollock identified the "notable nine"--nine instructional strategies that have been assigned effect sizes for their supposed correlation with student achievement.  For many BHS teachers the data behind these strategies validated lesson planning choices that were already being made, and for others the book may have influenced some changes in how teaching was planned, but building-wide I don't think there was any large effect from the book because we didn't attempt to implement a planned and monitored program around the nine concepts.  Even now, under the PLA/Transformation Plan, there is no intervention based on utilizing the notable nine.  However, the redesign plan through its various elements (teacher performance evaluation, data teams, formative assessment, differentiated instruction, common lesson plan format) does require teachers to be very creative in instructional design--to select strategies that best address students' needs and that create the greatest student growth toward learning goals.  For that reason teachers will need a large repertoire of strategies; the information in this book can be a good starting point.

In my opinion this 2nd edition is superior to the first as a usable resource for teachers.  In the 1st edition a lot of time is spent in discussing the meta-analyses that were done to compute the effect sizes, and then the strategies are listed in order by effect size.  But, this order isn't particularly helpful to lesson planning, and the book didn't always provide much help for actually putting the nine categories into action in a classroom.  One of the best detailed explanations in the 1st edition is about how to directly teach vocabulary--great stuff! but not even one of the nine strategies.  Also very helpful from the first book is the discussion of how to approach teaching different types of knowledge:  details, organizing ideas, skills, processes.  What's nice about the 2nd edition is that it takes this useful information that was in just one chapter of the first book and reorganizes the whole text to give clearer direction to teachers.

Introduction
The notable nine are categorized into three groups:
  • Strategies to create the environment for learning
  • Strategies to help students develop understanding
  • Strategies to help students extend and apply knowledge
The introduction also contains a section on the importance of developing good student-teacher relationships in the classroom, something that I don't recall the first book dwelling on.  Yet, we all know this is critical.  If students and teachers don't like and respect each other, then no strategies, however notable, are going to work.

Part 1 Creating the Environment for Learning
Chapter 1 Setting Objectives and Providing Feedback
The 2nd edition gives an average 0.31 effect size for setting objectives and a 0.76 effect size for providing feedback.  What this means is that when recommended techniques for these strategies are used with fidelity, students should increase their achievement by about 12% and 28% respectively.  That is, if a student would score 50% on a test without having received the strategy, she should score about 50 + 12 + 28 = 90% when receiving the two strategies.  Of course, we know it doesn't really work this way; in fact, this overestimation of the influence of effect size is a common criticism of the work of researchers such as Marzano or John Hattie.  It's not so simple as just picking a few strategies with large effect sizes and thinking that alone is going to raise students' achievement.  No doubt despite researchers best efforts to control other factors there is still overlap between the influence of instructional strategies, for example, the 28 percentile gain predicted from feedback might overlap the 12 percentile gain from objectives.  Also, these are just averages from multiple research studies--some studies in which there were negligible or even negative associations between a strategy and achievement.  The 2nd edition authors are more forthright about this, and that's why they don't dwell on the "size" of the effect size, but instead have sought to identify features within the strategies that would seem to lead to positive correlations with learning.  It is these recommendations and tips that I want to summarize here.

Recommendations for setting objectives in the classroom:
  • Set learning objectives that are specific but not restrictive
  • Communicate the learning objectives to students and parents
  • Connect the learning objectives to previous and future learning
  • Engage students in setting personal learning objectives
So, students are supposed to average about 12% better on assessments if we use objectives (learning goals) in our classrooms.  Well, I did that last year and am not convinced that my students did any better (they may have done worse than the previous year's students).  How could this happen if there is a 0.31 effect size?  Well, what if the largest portion of that effect size comes from students personalizing the objectives and that wasn't something that I handled effectively?  (It's actually kind of hard for students to personalize algebra learning goals--they're so removed from their experience.)  There's just no way for me to know for sure what's going on because the book doesn't detail the original research; it just gives average effects.  Yet, I can do my best to follow the recommendations in the hope that there will be some positive influence upon student achievement.  

Recommendations for providing feedback:
  • Provide feedback that addresses what is correct and elaborates on what students need to do next
  • Provide feedback appropriately in time to meet students' needs
  • Provide feedback that is criterion referenced
  • Engage students in the feedback process
The book gives some explanation for each of these recommendations and then concludes the chapter with additional tips for setting objectives and providing feedback.  Here are the tips:

  1. 1.   State learning objectives in simple language and in terms of knowledge rather than learning activities.
  2. 2.   Relate the learning objectives to things that are personally relevant to students.
  3. 3.   Model for students how to set their own learning objectives, and provide feedback on the learning objectives they set.
  4. 4.   Periodically check student understanding of the learning objectives.
  5. 5.   Select content sources, discussion questions, activities, assignments, and assessment methods according to how well they help students achieve learning objectives.
  6. 6.   Provide students with information about what good performance or high-quality work looks like well before an assessment.
  7. 7.   Provide students with feedback as soon after the event as possible and throughout a unit of instruction--not just at the end of a unit.
  8. 8.   After providing students with feedback about what they did correctly and what they need to do to improve performance, provide opportunities for them to continue working on the task until they succeed.
  9. 9.   Consider using technology to increase the rate of feedback, help organize it, and document it for further reflection.

Chapter 2 Reinforcing Effort and Providing Recognition
This chapter begins with a discussion of the importance of motivation and identifies several factors that influence motivation:  student beliefs, parent beliefs, cultural beliefs, teacher beliefs, student beliefs in their own competence and whether they have any control over the outcome of a task, student interest in a task and the reason why they're interested.  The research cited in the chapter indicates links between the two instructional strategies and the following variables that affect motivation:
  • Self-efficacy:  beliefs about one's competency
  • Control beliefs:  beliefs about one's ability to influence what is happening or will happen
  • Intrinsic motivation:  motivation that comes from an individual's desire for self-satisfaction or pleasure in completing the task rather than from an external source, such as a reward
  • Task value:  beliefs about the reasons for doing a task
Recommendations for reinforcing effort:
  • Teach students about the relationship between effort and achievement
  • Provide students with explicit guidance about exactly what it means to expend effort
  • Ask students to keep track of their effort and achievement
Recommendations for providing recognition:
  • Promote a mastery-goal orientation
  • Provide praise that is specific and aligned with expected performance and behaviors
  • Use concrete symbols of recognition
The first recommendation goes hand in hand with differentiated instruction, but it isn't enough to just establish multiple performance levels for a learning goal.  If students are to derive any feeling of recognition from mastering goals (in turn enhancing their motivation), then the goals have to be masterable (this isn't a word, but it should be).  So, when differentiating, we have to ensure that goals and tasks are scaffolded for students so that they experience success and are able to progress.  At BHS the data team process will classify student performances on pretests into four levels, the last being Intervention Students--students far to go and not likely to become proficient.  For these students the teacher may have to develop completely different goals and tasks and delay the targeted learning goal until students are developmentally in the ballpark.

Tips for Reinforcing Effort and Providing Recognition
  1. Ensure that your curriculum recognizes the importance of effort by allocating time over the course of the academic year to assist students in learning about effort and how to apply and track it.  This means building attention to effort into curriculum documents and lesson design and delivery.
  2. Reinforce what effort is and how knowledge about effort translates into success inside and beyond the classroom.  This helps students develop a sense of control over their learning.
  3. Keep praise simple and direct, using straightforward sentences without gushing or dramatizing.
  4. Specify the particular accomplishment being praised, pointing out any noteworthy effort, care or perseverance and calling attention to new skills or evidence of progress.
  5. Vary the phrases you use to praise students, and use nonverbal communication along with praise to convey warmth and appreciation for students' efforts and achievements.
Chapter 3 Cooperative Learning
By glossing over the research and effect sizes that were such a major part of the 2001 edition, the 2nd edition I think is missing some crucial information for us with respect to cooperative learning.  So, I'm going to include some of the 1st edition information in the summary that concerned homogeneous vs. heterogeneous grouping.  I believe this is important to us at BHS because of two initiatives starting in 2012 - 2013:  ability-grouped sections and differentiated instruction.  While one consequence of enrolling students into sections of a course based on standardized test scores is to make each section more homogeneous, which facilitates differentiated instruction, our data team protocol will still generate four classifications of students per classroom.  And, while targeting instructional activities to these students doesn't necessarily mean separating them into ability-grouped cooperative groups, in many instances that is a realistic way to accommodate differentiation.  With that in mind, here are the pertinent research-based facts:
  • Cooperative grouping (if implemented with fidelity to cooperative learning models such as Johnson's 5 elements, Kagan's structures, or Cohen's model) has positive effect sizes vs. no grouping for all ability levels
  • Cooperative grouping, if implemented poorly, has a negative association with student achievement (i.e., students will do worse when teachers subject them to poor cooperative learning experiences)
  • Low-ability grouping:  has a large negative effect size vs. heterogeneous grouping
  • Middle-ability grouping:  has a large positive effect size vs. heterogeneous grouping
  • High-ability grouping:  has a very small positive effect size vs. heterogeneous grouping
  • Group size:  Pairs:  small positive effect size; 3-4:  slightly bigger effect size; 5-7:  tiny negative effect size
This data has several inferences for us.  One, we should make effective cooperative grouping a systematic part of our instructional program and follow all recommendations for what makes grouping effective.  Two, we need to keep group size to a maximum of 4 students--this means that when differentiating we can't just split up the class into four groups, we need to make sure that groups are of appropriate size.  Three, we need to be very careful with the tasks given to our groups.  It doesn't surprise me that when high-ability groups are formed that there isn't much gain vs. heterogeneous groups because in either case the performance of the group will be largely established by the ability of the "smartest" student or students in the group.  The data about middle-ability groups is a little surprising--it seems to indicate that a group of middle-ability students will outperform a heterogeneous group that might contain one or more high-ability students.  I wonder if research has looked into why this might occur.  But, our more important concern at BHS has to be  with low-ability groups, whether they happen to be the "lowest" group in a classroom or whether they are groups formed in our "lowest" section of a class (which may or may not be the section that contains many of the special education-identified students).  What will that "lowest" cooperative group in the "lowest" section of a class be like?  And, what is the realistic potential for that group to master the content identified in our high school courses?  Teachers will need to do some serious reflection here and make some important decisions about grouping.  Maybe in some sections of a class any cooperative groups will need to be made as heterogeneously as possible considering the students in those sections.  Or, maybe goals and tasks will need to be scaffolded so that they are manageable for students.  I've already mentioned in this summary and in others that a basic tenet of differentiation is to give students what they need and that sometimes this means delaying the "required content standards" until a time when they're developmentally appropriate for a student.  

Back to the 2nd edition...
Tips for cooperative learning:
  1. Establish a classroom culture that supports cooperative learning by being clear with students about the norms and parameters within which cooperative learning will take place.
  2. Focus on the underpinnings that lead to group success by establishing and teaching the structures and processes students will follow as they work in cooperative groups.  Model what students should do as they move into and work in their cooperative groups.  Be sure they understand how to use the social skills required of them.
  3. Provide additional instruction, practice, and corrective feedback on the social skills necessary to function successfully in cooperative groups.
  4. Ensure that the use of cooperative learning aligns with the intent for learning.  When the target for learning includes mastery of skills or processes, balance the use of cooperative learning with sufficient opportunities for students to practice those skills and processes independently.
  5. To avoid misuse of cooperative learning, use cooperative learning tasks that are well structured.  A well-structured task has clearly defined goals for learning, roles, and responsibilities for each member, and it maintains individual accountability.
  6. Design cooperative learning tasks to include strategic use of other instructional strategies that help students deepen their understanding and use knowledge meaningfully.
Two final comments:  (1) remember that you are to score students' progress toward successful cooperative learning as one of the life skill goals, (2) I wish that our school would establish specific expectations for building-wide cooperative grouping structures and protocols (like we have for a reading & writing strategy) because if all students were engaging in the same structures upward of six times per day, then we'd likely have more success with teaching our students the social and work skills needed during groupwork.

Part 2 Helping Students Develop Understanding
Chapter 4 Cues, Questions, and Advance Organizers
Recommendations for Cues and Questions:
  • Focus on what is important
  • Use explicit cues
  • Ask inferential questions
  • Ask analytic questions
The first piece of advice reminds me of something I read elsewhere, but I can't remember where.  It had to do with selecting appropriate activities to engage or hook students.  At the start of a lesson a teacher did a really cool demonstration--lots of fire and explosions--and followed up with the science concept.  But, when students left the classroom that day, all they remembered was the fire and explosions, they had missed the important science because the cue was too distracting.  Maybe the lesson would have been more effective had the science been discussed first, then the neat demonstration, then a quality summary to tie the demonstration back to the concepts.

This section also reminds me of the recent book summary I did for math teachers using the book Accessible Mathematics.  Non-math teachers might want to check it out too in the Livebinder because it'll make you feel good--the premise is that math teachers should start teaching like other teachers because students are usually more engaged in those other classes.  Math teachers need to start using the strategies that other content area teachers use.  And, specifically in regard to questioning, math teachers need to get away from the basic "what is the answer?" and start using inferential and analytic questions.  It may have been in that summary where I cited a quote from a teacher that went something like "I never ask a question for which I already know the answer."  What she was getting at is that she doesn't waste her class time asking students to do factual recall, but she asks questions that get at how and why they're thinking what they're thinking.  Good advice for all content area teachers.

Recommendations for Advance Organizers:
  • Use expository advance organizers
  • Use narrative advance organizers
  • Use skimming as an advance organizer
  • Use graphic advance organizers
All of this reminds me of our commitment in 2012 - 2013 to make pre-teaching an integral part of our lesson design.  The lesson planning form lists the steps to follow for direct instruction of vocabulary (part of which is pre-teaching).  The 1st edition of the book gives an effect size of 0.32 for direct vocabulary instruction.  And, while I can't locate any specific effect sizes for other instructional strategies that involve pre-teaching (not even in John Hattie's book), common sense would indicate that if teachers prepare students ahead of time regarding what content and activities are upcoming, then students would be better prepared to succeed with them.

Chapter 5 Nonlinguistic Representations
Recommendations:
  • Use graphic organizers
  • Make physical models or manipulatives
  • Generate mental pictures
  • Create pictures, illustrations, and pictographs
  • Engage in kinesthetic activities
With respect to graphic organizers, remember that a few years ago our school made a commitment to using Thinking Maps (well, a weak and short-lived commitment due to no follow-up) so we would probably achieve the greatest benefit if we used those building wide.  I'll link the Thinking Maps website to the Livebinder as an instructional resource to remind everyone what the maps are and which type of thinking each is used for.  

Tips for Teaching Using Nonlinguistic Representations
  1. Model the use of the strategies for nonlinguistic representation through demonstrations and think-alouds.
  2. Provide students with opportunities to practice each of the strategies with familiar information before they are expected to use the strategies with new material.  This makes it possible for students to focus on the process and not worry about learning new content at the same time.
  3. Provide students with a variety of opportunities to use nonlinguistic representations as they learn new content.
  4. Model how students can use more than one nonlinguistic representation as they learn a new concept or vocabulary term.
  5. Provide students with information about and opportunities to use graphic organizers when developing summaries, taking notes, identifying similarities and differences, generating and testing hypotheses, and organizing information that may be difficult or poorly organized.
Chapter 6 Summarizing and Note Taking
The 1st edition gave an average effect size for this category of 1.00 (that's big).  The 2nd edition separates the two strategies and gives effect sizes of 0.90 for note taking and 0.32 for summarizing.  Thus, effective note taking is a more powerful strategy than summarizing.  We have building-wide strategies for both, but only the Stop & Jot (followed by a written summary) is specifically mentioned in the PLA/Transformation Plan and included in the teacher evaluation system as a scored element (note:  remember that not only are you to regularly--like every day--make use of literacy strategies in your classroom, you are to formally score and submit data to the Reading & Writing committee according to the schedule given in the Google Calendar, which is available via the Livebinder and other places).  However, you are strongly encouraged to teach and require your students to use the Cornell notes method.  I'll link some information about Cornell notes in the Livebinder as an instructional resource.  But, if you are already familiar with Cornell notes, you know that they combine note taking with summarizing, so in a sense Cornell notes is simply an alternative to the Stop & Jot + Summary method for reading comprehension.  Check out the Reading & Writing tab or the Instructional Coach tab in the Livebinder for more information.

Recommendations for Summarizing:
  • Teach students the rule-based summarizing strategy
  • Use summary frames
  • Engage students in reciprocal teaching
Each of these three strategies deserves some explanation.  

Rule-based summarizing:  "The rule-based summarizing strategy helps to demystify the process of summarizing by providing explicit, concrete steps to follow" (p. 80).  Here are the steps:
  1. Take out material that is not important to understanding.
  2. Take out words that repeat information.
  3. Replace a list of things with one word that describes them (e.g., replace "oak, elm, and maple" with "trees").
  4. Find a topic sentence or create one if it's missing.
  5. Optional step:  share the summary rough draft with a peer, then revise.
The text states that when rule-based summarizing is used school wide, students receive the greatest benefit.  At BHS we are to teach a building-wide literacy intervention (Stop & Jot + summary), and we could simply add to this a common note-taking approach (Cornell).

Summary frames:  These guide how students approach summarization based upon the structure of the information to be summarized.  Pages 83 - 88 discuss six frames (sets of questions students would address in their summary):  narrative, topic-restriction-illustration, definition, argumentation, problem-solution, conversation.  The point of these is to support students in summarizing instead of making them guess at what constitutes a good summary.

Reciprocal teaching:  Consulting my John Hattie book (he researched effect sizes for 150 different strategies), I see that reciprocal teaching was the 11th most powerful instructional strategy.  Even though it is a specific procedural thing, it's up there with the likes of major system strategies such as RTI, formative evaluation, and intervening with LD students.  It is more effective than strategies like direct instruction, peer tutoring, and giving homework.  Those three strategies are perennial favorites for a lot teachers, but how many of us utilize reciprocal teaching which supposedly is even more effective?  Reciprocal teaching is basically a cooperative learning strategy in which the group collaborates to deepen their understanding of a topic.  Pages 88 - 89 explain it very well, but in brief here it is:
  1. It's used primarily with expository text.
  2. When students first learn it, the teacher will need to model how to use the four comprehension strategies that are the heart of the process:  summarizing, questioning, clarifying, and predicting.
  3. Gradually the teacher releases control of these strategies to the students.
  4. Groups of 4; roles:  summarizer, questioner, clarifier, and predictor (note:  with smaller groups, students just take on additional roles)
  5. Step 1:  The summarizer reads a short passage and summarizes it.  Other students may add to the summary.
  6. Step 2:  The questioner asks questions in order to identify important information.  The rest of the group answers the questions to move deeper into the meaning of the text.
  7. Step 3:  The clarifier clarifies vocabulary words, pronunciations, and new or misunderstood terms.
  8. Step 4:  The predictor asks for predictions of what will happen next based on relevant information that the group already possesses.
Notice how reciprocal teaching combines cooperative learning with summarizing and note taking, inferential and evaluative questions (higher order thinking), peer discussion and feedback, and I suppose even nonlinguistic representations and identification of similarities and differences if the group's discussion goes down that route.  So, it's no surprise that it's a powerful technique since it incorporates many of the notable nine.

Recommendations for Note Taking:
  • Give students teacher-prepared notes
  • Teach students a variety of note-taking formats
  • Provide opportunities for students to revise their notes and use them for review
I'll share a strategy that the math department has committed to in 2012 - 2013.  Each teacher will use Academic Notebooks (Learning Logs, journals, whatever you want to all them) that are to be stored in the classroom and used to store the artifacts of students' class work including notes and summaries.  Class time will be provided for students to regularly interact with their own notebook (review it, write a summary, copy down some of the notes, create a practice problem to match a procedure, etc.) so they can in effect take home information from the notebook without the actual notebook ever leaving the classroom.  Math teachers have decided on this approach in the attempt to support BHS students who don't study for upcoming assessments, don't practice, and don't use their notes effectively.

Tips
  1. Post the appropriate steps for rule-based summarizing, and reference the poster as students summarize information.
  2. Come to an agreement with colleagues about the version of rule-based summarizing that will be used throughout the school.
  3. Provide students with opportunities to practice summarizing and note-taking techniques using familiar information before they are expected to use them with new material.
  4. Model the note-taking process several times before students are expected to demonstrate an understanding and appropriate use of the various formats.
  5. When students practice note taking, provide explicit corrective feedback that helps them elaborate on their understanding and improve their note-taking skills.
  6. Instruct students to leave space between each note they take to create room to add to their notes as they continue learning about a topic.
  7. Intentionally build time into your lesson plans for students to review and edit their notes.  Do not expect students to take care of this important step on their own, especially if they have had no prior experience doing so.
  8. When possible, provide time for students to share their thinking with other students.  This provides opportunities to rehearse their learning, use relevant vocabulary, and deepen their understanding.

Chapter 7 Assigning Homework and Providing Practice
While the 1st edition found a positive effect size for homework (it was next to nothing for elementary homework and greater for high school homework), the 2nd edition authors state that the association needs to be used carefully because other factors influence the effectiveness of homework:  degree of parental involvement and support, homework quality, students' learning preferences, and structure and monitoring of assignments. If a school or teacher decides to use homework, then here are some recommendations:
  • Develop and communicate a district or school homework policy
  • Design homework assignments that support academic learning and communicate their purpose
  • Provide feedback on assigned homework
In 2012 - 2013 the math department, at least in its double-dosed classes where more time is available to do practice during the school day, has established a No Homework policy.  The reasoning behind this decision is:  (1) many BHS students don't receive adequate support at home or have a fair opportunity to complete homework outside of school hours, (2) math homework is generally used to increase fluency but that can only be done with skills that students have already mastered, (3) most BHS students don't do assigned homework, (4) failure to complete assigned homework, whether because students don't know how to do it, do it incorrectly, or choose not to do it damages students' motivation and self-efficacy in the classroom.  Math teachers believe they will be further ahead in the long run by dumping the non-effective practice of using homework at BHS.  I think that other content area teachers need to reflect on their experience with homework completion, and if it's historically been a struggle, then to bag it.  Unless BHS is going to institute a homework policy accompanied by a homework completion policy (one that we stick to--we dumped ZAP/working lunch after just one year because we couldn't manage the number of students who didn't complete their work), then homework is a lost cause for us.  With classwork we seem to have much better luck in getting students' compliance to do the assignments, especially when appropriate classroom environments and teacher-student and student-student relationships are developed.  If we keep giving homework and expecting it to be done, but students don't do it and we have no workable mechanism to follow-up and arrive at compliance, then we're reinforcing exactly the wrong sort of academic culture.  We don't want students to not succeed with instructional tasks, and unfortunately homework is a task that for whatever reason many students don't complete successfully.  Let's replace homework with distributed in-class practice.

Now, having suggested that, I realize that beginning in 2012 - 2013 there is a 7th period class which is primarily a study hall for students to complete assigned work.  What work are they to complete if not homework that was assigned that day?  I think that it could be short assignments given by teachers with the specific intent that they are to be completed in 7th period.  7th period is 40 minutes long, and if every one of a student's six teachers gave an assignment, then it would be fair to make each assignment require about 6 minutes of time from students.  Examples:  a reflective question in science, create a thesis statement for an upcoming writing assignment in ELA, five practice problems (over a skill that students' have already mastered) in math, study notes taken from social studies' academic journals for an upcoming test, etc.  But, we would need to agree as a staff that a teacher isn't going to break ranks and assign a 30-minute worksheet, or 20 math problems, or a 4-week extended project.  Unless......  For instance, maybe 11th and 12th graders should have greater requirements relative to independent/outside of class work?  Maybe there is some big research paper expectation in an ELA class that necessitates extended outside of class time?  These sorts of special cases are why the school should have a policy so teachers can make instructional decisions that support overall school improvement goals.

Recommendations for practice:
  • Clearly identify and communicate the purpose of practice activities
  • Design practice sessions that are short, focused, and distributed over time
  • Provide feedback on practice sessions
If the purpose of doing practice math problems is to increase accuracy and fluency, then tell students that and create a structure for the practice that aligns with this purpose.  Research apparently indicates that students need to practice a skill at least 24 times before they reach 80% competency (p. 111, taken from Anderson, 1995).  In a math class I don't think this means to assign 24 problems once.  Instead, I think it's closer to meaning students should practice a skill on 24 separate occasions!  All teachers, not just math teachers, need to put some careful thought into lesson planning this year to distribute practice over time, something that I don't think many of us have been doing very effectively in the past.

I also want to offer some comments about how practice might relate to our formative assessment system.  Teachers are to make at least four "status checks" (checks for understanding, formative assessments, whatever you want to call them) during the instructional phase of any learning goal.  The first must be a pretest, for reasons explained elsewhere.  The second and third should be checks for understanding along the way.  Now, these checks can be scored using the 4-point scale and the scores can be entered into the TIES gradebook, but more important is to provide students appropriate and timely feedback from these checks.  If a score such as 2.5, when matched to a rubric, is sufficient to give students useful information about what they do and don't yet understand, then great, but if a lone number isn't sufficient, then the teacher needs to provide better feedback.  TIES isn't going to compute students' "final" LG scores in the same way as Pinnacle--there is no learning trend that is automatically calculated.  Instead, the teacher will record the pretest score, but with an assigned weight of 0, and can record the second and third scores (again with 0 weight), and then the fourth/final score (with 100% weight).  This final score could be an actual score earned on the fourth/summative assessment for a LG, but really it should be the teacher's best judgment of the student's final status.  In addition, if at any point in time a student demonstrates a change in status (up or down), the teacher needs only to replace that post-test score in order to modify the final score for the LG.  I mention all of this because there is no reason that the 2nd and 3rd "scores" can't be taken from assigned practice problems.  Practice is not necessarily separate from formative assessment; teachers may use whatever activities they wish as their mechanism to gather data about students' current status toward a learning goal.

Part 3 Helping Students Extend and Apply Knowledge
Chapter 8 Identifying Similarities and Differences
The 1st edition gave an effect size of 1.61 for this category.  The 2nd edition gives the effect size as 0.66.  Oops!  Maybe Marzano, et al. were a little ambitious with respect to the awesomeness of this category.  But, 0.66 is nothing to sneeze at; it equates to a 25 percentile point gain.  Just remember my caveat from the start of this summary, this strategy isn't mutually exclusive of all of the rest.  It's not like students will gain 25% on top of all the other points they've gained if you do the other eight strategies.  There's probably quite a bit of overlap between this strategy and note taking, let's say, or nonlinguistic representation.  

There are many methods you can use to have students focus on similarities and differences.  Some are graphical--there's a Thinking Map specifically for this type of thinking.  And another Thinking Map to create analogies.  Cornell notes can focus on this strategy.  Even our Stop & Jot strategy can have students go after similarities or differences--it's all in the purpose you give to students when telling them to stop and jot something.

Pages 133 - 134 give good tips, but this summary is getting monstrously long, and I'm getting tired of typing. So, you're all encouraged to read it for yourself if interested in more explanation about how to go about having students compare, classify, create a metaphor, or create an analogy.

Chapter 9 Generating and Testing Hypotheses
This strategy isn't just for science class.  Recommendations are:
  • Engage students in a variety of structured tasks for generating and testing hypotheses
  • Ask students to explain their hypotheses and their conclusions
Some structured tasks:
  • Systems analysis:  analyzing the parts of a system and how they interact
  • Problem solving:  overcoming constraints or limiting conditions that are in the way of achieving goals
  • Experimental inquiry:  generating and testing explanations of observed phenomena
  • Investigation:  identifying and resolving issues regarding past events about which there are confusions or contradictions
*Each of these tasks has step-by-step procedures.

Part 4 Putting the Instructional Strategies to Use
Chapter 10 Instructional Planning using the Nine Categories of Strategies


In conclusion, the book is a great resource for teachers who want to try different approaches this year.  Data teams may find it useful when trying to agree on instructional strategies to test out in classrooms (e.g., maybe the Electives data team might agree to try out reciprocal teaching for a few months).  Please remember that when I'm not busy with the data coordinating part of my job description I am available to support you in any of these strategies.  Even those that I'm no expert in (like not ending sentences with prepositions).  I can be a second set of hands in the classroom, can help you to do lesson plans, or can gather or create materials.  I can just observe your class or video record it if you like, afterward debriefing with you to see how a strategy that you are trying out is coming along.  Any work that you do with me is confidential and has nothing to do with your evaluation from Suzanne.  Please see the Instructional Coach tab in the Livebinder for more information about the supports available to you.