Archive for the ‘Testing’ category

Emerging Trend: Superman Snubs the Justice League, Lex Laughs to the Bank

September 18th, 2010

NBC’s Education Nation confirmed their list of panelists for the upcoming education summit – none of whom are teachers and all of whom seem to take snaps from the same ed reform playbook. All except for the lone Randi Weingarten. She will play the role of Dissenting Voice in an ed reform narrative that is being ballyhooed across the nation. (Except where it’s not.)

It was important for event organizers to give Randi a place on the panel. The basic ed reform thesis, chronicled in the upcoming “Waiting for Superman,” begins with the idea that the school system & schools are broken, and that unionized teachers are where the faulty rubber meets the road. The trouble is, if the powers-that-be were to directly cast teachers as Lex Luthor their plan might backfire.

Who’s willing to place the failure of the American Education System on little old Mrs. Newton, teaching 2nd grade to generations of tots that loved her? That won’t sell well or bring in votes.

Enter unions stage left. Randi, as president of the American Federation of Teachers, has been a vocal critic of NCLB, RTTT, & the Fire-(Teachers)-At-Will squad of trigger happy reformers. As a teacher representative, she’s become the de facto Lightning Rod in the plot line that pits unions (as antagonists) against the great teachers the ed reformers (as protagonists) would deliver if only meddling teacher advocates would step aside.

For the NBC organizers, she needs to be a panelist in order to give the Gates’ League the whipping boy (girl) it requires.

The story goes like this: the unions enable the hordes of bad teachers who are responsible for keeping students from achieving. All the while the benevolent market forces of goodness & quality do their darnedest to right this wrong through superhero feats of privatizing, hiring & firing, and incentivizing teaching to the tests.

We are asked to buy into this plot-line and then jump to reformers’ same conclusions. Effectively, we are asked to leap these tall buildings, each in a single bound of reasoning:

  1. If we weigh the cattle more often, they’ll get fatter.
  2. Non-union teachers teach better.
  3. Charter schools = silver bullet against poverty & lack of parent involvement.
  4. Merit pay will be enough improve teacher “performance”. (A recent Vanderbilt study concludes otherwise.)

These unproven assumptions need more than super breath to blow me over. I’m just not convinced that these measures will lead to more professional educators & greater access to quality learning environments for all students.

The Bottom Line Variable

But what if they are wrong?

What if the fear mongering and hyperbolized “broken” metaphors that the media outlets have bought-into & hyped are the machinations of private stakes and bottom lines, rather than deep insights into poverty, parenting & learning? (That’s not to say there are not deeply rooted problems that need transforming. But “broken”?! That seems a slap in the face to the thousands who work in our nation’s schools.)

On his site, How the University Works, Marc Bousquet brings this point to light:

I’d like to see a few more of us start to question the objectivity of The New York Times and Washington Post, both corporations with increasingly large hopes that profits from their education ventures will prop up sagging journalism revenues. The Post, which owns Kaplan and shocked readers by blatantly pushing Kaplan’s legislative agenda in print and in person is already an education corporation that owns a newspaper as a sideline.

What is curious is that even Fox & Friends has discovered what the Chamber of Commerce and the Washington Post knew a long time ago: The Obama/Duncan algorithm for improving our nations’ schools has a hidden variable — profitability.

Non-union teachers + prepackaged curricula + (test x test x test) = Corporate Bling Package

Standardizing content across the country simplifies what all teachers teach, making it easier to . . .

Increase class size and save moola on teachers (especially the union-free teachers in charter schools who get paid less & have fewer benefits), which frees up money for . . .

Buying curricula in bulk from major textbook companies (which are more profitable to produce in larger numbers) which will necessitate. . .

Buying tests designed specifically for those prepackaged curricula, which will be justified because it will help  prepare students for . . .

Super-sized multiple-choice assessments to determine if teachers are teaching, which will . . .

Earn testing companies stacks of benjamins for administrating & scoring those tests, and has the added benefit of . . .

Determining which teachers should be fired, so newer, cheaper teachers can be hired, and more curricula can be bought to raise scores.

The private sector’s opportunity to profit handsomely from this brand of standardization has stockholders salivating & lobbyists scheming. The Chamber of Commerce, at the behest of former FL governor Jeb Bush (whose younger brother, Neil, profits from NCLB & RTTT), has become a testifying standard anywhere education reform is on the legislative docket.

It all makes me wonder if ed reform is being driven by Superman, or Lex Luthor.

What if we are asking the wrong questions?

What if the propagandized central conflict, Unions vs. Good Teaching, isn’t the central conflict after all? What if it is just a sub-plot? What if the problem is much more complex than that?

What if the central argument, “Pay great teachers for student achievement and great teachers will flock to the classroom” doesn’t hold water? What if the actual teachers we want teaching and shaping our youth are not the ones attracted by promises of pay for performance?

What if wooing and keeping great teachers requires a different sort of honey altogether?

Unfortunately, no-one is asking what it takes to attract (and retain) the truly innovative educators who can provide the transformative learning experiences that transcend race, gender, and socio-economic status. It seems assumed that bonuses, based on centralized high-stakes tests, will be enough.

In a tweet-versation with RiShawn Biddle (@DropoutNation), an education journalist and ed reform advocate, I asked if the current slate of reforms was likely to narrow the curriculum and decrease educator autonomy. He replied that it would, that it was necessary.  This made me wonder what it would take to attract and keep the best and the brightest (the most ambitious and well educated among us) to the field of teaching. So I asked him.

His response?

They need more than a paycheck. They need an environment which allows them to utilize their skills in new and creative ways. In essence, they need autonomy and the flexibility to work in a professional atmosphere where they have latitude.

And therein lies our paradox. We want/need the best and the brightest to embrace teaching as a profession, but our brand of ed reform vinegar (high stakes testing, value added firing, & standardized everything) is a hook without a worm. It doesn’t attract and/or keep the very candidates we need flocking to our schools.

Superman & the Justice League

We seem to hope that by testing the kryptonite out of students Superman will arrive. However, him being faster than a speeding bullet doesn’t make him a silver bullet. We’ll need more than Superman if we aim to make meaningful, relevant, and lasting changes to our national school system.

We’ll need the entire Justice League in order to effectively address the central conundrums of transforming our schools into learning environments of equality where students are engaged, enabled, and empowered.

Our villains are many:

  • Poverty
  • Lack of parent involvement
  • Untenable dropout rates
  • Too few high achievers in the field of teaching
  • Overly specific centralized learning goals
  • Undervalued teaching profession
  • Inaccurate measures of teacher effectiveness
  • Overuse of high stakes assessments as a cure all
  • Elitism

To tackle these villains, we must recruit & engage every one of the Justice League heroes, many of whom are dedicated teachers who’ve been asked to stay quiet and do as they’re told for far too long.

The Justice League is supposed to be a collection of people banded together in mutual cooperation.

Too bad they’ve been left off of Superman’s panel.

Thanks a lot, Man of Steel. You could’ve gotten a teacher on the panel if you wanted. After all, with that cool x-ray vision thing you got going, you should be able to see through their shenanigans.

This post was originally published on Ecology of Education.

Justice League Image: OSU Department of Statistics
Lex Luthor Image: Prodigeek

To Retain New Learning, Do the Math

November 8th, 2009

Every teacher experiences the frustration. Content and skills taught throughout the year seem to abandon students during springtime standardized testing. “How can they not know this?” thinks the the teacher. “We learned this back in November.”

Recent research reveals some likely causes, and the principles for retaining new learning may not be intuitive to us as teachers. For example, multiple retrievals rather than multiple exposures promote better retention of new learning.1 In other words, the more students are required to recall new content or skills, the better their memory will be. Reviewing the material with students does not have the same effect. The students must be engaged in activity that requires them to recall the material. Even when students recall details incorrectly, if the teacher promptly provides the necessary instructive feedback, engaging students in recall of the material fosters better retention of new learning than a teacher-led review.2

But how often should teachers be engaging students in recall of newly learned material? Two findings provide answers.

First, repeated recall should occur frequently immediately following new learning. For example, a teacher who teaches students to add fractions should engage students in recall and use of that material several times over the school days immediately following instruction. Again, even if students do not recall the skill correctly, requiring recall combined with immediate instructive feedback is more effective than reviewing the skill.3

Second, once the initial period of learning and multiple retrievals is past, students still need to be engaged regularly in recall of the material. In general, students need to recall the material after a delay of 10 to 20% of the time between initial learning and final testing.4 For example, if students learn a new skill with only a month of school (about 20 school days) remaining, they should be engaged in recall of that skill every 2-4 days. This increases the likelihood that the new learning will be part of their knowledge when they begin the following school year. (Ideally, they would be recalling that skill every 7-14 days over a 10-week summer break!)

So, let’s go back to our opening scenario: a teacher teaches material in November that students need to recall for testing in May—a gap of about six months, or about 120 school days. To increase the likelihood that students will recall the material in May, they should be engaged in retrieving it every 12-24 days, once or twice a month, probably closer to every 12 days for the first few months and every 24 days for the last few months. It is critical that every retrieval be accompanied by immediate instructive feedback.

One more principle helps us design activities that engage students in retrieving new learning. The more material students are required to recall, the better. For example, if students are required to retrieve or construct an explanation of how to add fractions and actually apply the skill to add fractions, their retention will be greater than if they are merely required to apply the skill.4

According to this research, many of our classrooms may be structured for minimal memory retention. If we begin every school year reviewing material from the previous years and spend the second half of the school year introducing new material, students are less likely to retain the new learning in future school years because they were not engaged in recalling it throughout the school year. We need to be teaching more new material at the beginning of the school year and reviewing that material as the school year progresses. Perhaps this helps explain another common teacher frustration: the “They should have learned this last year” syndrome that we’ve all experienced.

Retrieval + Instructive Feedback = Retention of New Learning.

  1. Devachi, L. The Limits of Memory: How to Maximize Your Memory Trace. Presented at the 2008 North American Neuroleadership Summit, New York.
  2. Baddeley, A., Eysenck, M. W., & Anderson, M. C. Memory (New York: Psychology Press, 2009), p. 70-78.
  3. Ibid. 74.
  4. Ibid. 82.

Reform on Learning’s Terms

July 26th, 2009

At a press conference announcing the “Race to the Top” initiative, Secretary of Education Arne Duncan pledged nearly $10 billion in federal grant money to public school divisions that can deliver on four assurances:

  1. Worthy divisions will develop more rigorous standards and assessments.
  2. Worthy divisions will monitor growth in student learning and use that data to identify effective teaching practices.
  3. Worthy divisions will identify effective teachers and principals, find ways to reward them, and find ways to improve or replace ineffective educators.
  4. Worthy divisions will reorganize or close failing schools.

Looking at the assurances, I have to ask: is continuous quality improvement the same thing as innovation, or even change? Does it really cost $10 billion to assure the status quo?

First, the federal government wants to provide states with the money to develop new assessments based on common, internationally-benchmarked standards. These assessments and standards need to go beyond content or we tread water in curriculum and instruction. So long as we use a single measure like external test data to compare students, schools, systems, and states, divisions will allocate resources to teach to the test. If we’re going to stay locked in that mindset, then we’d best dramatically overhaul assessment in American education to drive changes in curricula and instructional practice.

What about paying for common performance standards and a common performance assessment to overlay state content standards? What about funding multiple assessment measures of different types?

What about funding a pilot that excuses participating divisions from yearly testing so they can teach to assessments more aligned with 21st Century Skills, like the NAEP math assessment or College and Work Readiness Assessment?

What about a pilot that excuses participating divisions from yearly testing and evaluates them instead on high school and 4-year college rates and the consequent changes they make to curriculum, assessment, instruction, scheduling, and community engagement in-house?

What about funding persistent online testing outside of set windows so students can test ahead or test until they demonstrate mastery?

How would you innovate assessment to close the gap?

Second, the “Race to the Top” grants ask divisions to close the data gap, measure student growth, and identify the teaching practices that cause growth. So how about paying for portfolio, project, and performance-based assessment pilots? Look at the College Success Portfolio from Envision Schools, or these projects from an Expeditionary Learning school as examples. Summative assessments like these and the formative measures leading up to them would both be information-rich for teachers making instructional decisions. They would also cause real change as divisions revamped professional development to support teachers in using practices like authentic engagement, entrepreneurship, and service learning. If schools permeated instruction with these practices, there would be a paradigm shift in education. Instead of being siloed in special programs or isolated in rock star teacher classrooms, these practices could be the national agenda, not an add-on to it or a field trip from it.

We already know that to ensure real learning, learning must be relevant to the student. Countless teachers take it upon themselves to design relevant instruction, but the way to make sure all teachers are supported in doing so is to make states assess for learning in ways relevant to students, their education, and careers.

The kind of information-era innovations called for by the Obama administration will not come from enabling all kids able to pass easily-scored tests or by testing kids on school work. The innovation the administration wants will come from adults who were habituated to academic risk-taking and open-ended problem-solving as children in schools where failure was seen as part of the engine of success, not as its opposite. To innovate products and services in the global marketplace, we’re going to need to support brave teachers modeling inquiry for our brilliant students and to administer messy “tests” with canny scorers. We should invest accordingly.

Secretary Duncan says he feels hope for transformational change in American education, but the four assurances of “Race to the Top” only assure that some schools and programs will improve at what they already do: preparing students to pass tests that in the near future will continue to vary in rigor and content from state to state.

This raises questions about merit pay, part of Assurance Three: “reward effective educators.” We have yet to adopt national standards, let alone national assessments; therefore, we are not ready to evaluate teachers fairly, nor should we begin differentiating their pay based on the results of different state tests with inconsistent levels of validity.

I completely support differentiating teacher pay when all teachers can earn increases by meeting benchmarks in their careers that are proven to correspond to teacher quality and student achievement, such as National Board Certification, and when school divisions provide financial support for teachers pursuing such certifications. Teachers should be able to earn pay increases based on a portfolio of professional accomplishments empirically indicative of their learned skills. This is akin to the knowledge- and skills-based pay approach. We should no more assess teachers on a single measure than we should students. There are too many inequities and dangers to catalog, in the notion of paying teachers more just for better student test results.

President Obama did recognize that it’s meaningful to move a student ahead in achievement even if the student doesn’t pass a test, but providing merit pay for student growth is a slippery slope. Imagine two students, both entering 3rd grade 2 years behind their peers in achievement. The first student has 2 ineffective teachers in a row, and then a fantastic 5th grade teacher who helps the student be on-grade-level by the end of 5th grade, still just a bit behind peers ready for 6th grade. Under the four assurances, perhaps this teacher would get merit pay for causing so much growth.

The second student, though, makes a little bit of progress with three skilled teachers in a row to finish on-grade-level at the end of fifth grade. However, he or she never grows a full grade level with any one teacher. Would those teachers each get a share of merit pay for catching the student up over three years, or none at all for failing to move the student ahead a full grade level in any single year? Are these teachers considered ineffective?

Money would be better spent in rewarding teachers for attaining a menu of meaningful professional accomplishments, rather than in paying an hourly rate increase on the basis of how many grade levels of growth equals an “advanced pass” on a state test. It would also be a real change to how the nation understands merit pay and would provide career paths for teacher-leaders that keep those teachers in the classroom.

The fourth assurance calls on superintendents to re-organize or shut down failing schools. This assurance echoes NCLB sanctions for schools that serially lag behind AYP. I am all for meaningful accountability, but I’m against using a single measure like state testing data to determine a school’s fate. I have more questions here than counter-points. If AYP goes by the wayside, what will be the measure of a school’s success? Will superintendents shake up staffing and appoint successful teachers to failing schools? What if those teachers fail, too? What’s the incentive for risk-taking? What are the incentives for letting a school fail? How much time will be granted for innovative programs to get past start-up jitters? If AYP doesn’t go by the wayside, what happens to schools that only have a 99% pass rate beyond 2014? Is the federal government awarding grants to divisions based on their willingness to shut down failing schools? What if a division wanted to charter a failing school to innovate? Can a division dodge the failing-school assurance by chartering failing schools for charter money? Will a division get grant funding for shutting down a failing school this year that wouldn’t be shut down by post-AYP/NCLB criteria?

We need more than these four assurances to reform American education. Innovation doesn’t come from assurance. In fact, assurance is anathema to innovation. If what Secretary Duncan decreed were innovative, we wouldn’t already be assured of how the money is going to be spent. If success for all were already assured, we wouldn’t need to innovate. We do need innovation and we need it from classroom teachers.

United States Chief Technology Officer Aneesh Chopra, our nation’s first CTO, recently implored our schools’ innovators to help him find them. That’s an assurance more inviting than any of Secretary Duncan’s. Help him, classroom teachers; share your ideas. Share them with your colleagues at work and online, with your principals, coordinators, directors, and superintendents. Spread your vision of learning and ask for what you need to make it happen. As your divisions compete in the “Race to the Top,” remember to start a dialogue with CTO Chopra and his office, as well. Get yourself the support you need in your classroom to change your own professional practice and ensure learning through genuinely reformative and relevant practices like authentic engagement, entrepreneurship, and service learning. Students can master any content through the skills needed for these endeavors, but no set of standards spread across separate disciplines will help them master those skills. Students need your help to facilitate the real, joyful work of learning.

Teachers: there’s energy in our country for real change, not just improvement. You are uniquely positioned at an intersection of students and learning, and networked by the technology and PLC-driven practices necessary to help each other with do-it-yourself instructional innovation. You can be the hub of students’ and teachers’ rediscovery of learning. We know what works; it’s difficult to do; we can help one another change our teaching. Advocate for your students, for yourselves, and for each other. Reform our schools on learning’s terms.

This is a test of our new commenting system.

April 25th, 2009

This is just a test.

Switch to our mobile site