Monday, October 11, 2010

The Limits of Value-Added Models of Assessment

Diane Ravitch (and others) have a lot to say about the limits of the value-added model (VAM).  For those in need of a tune-up on VAM, here is a nice synopsis from the Value Added Research Center.

One of the strengths of the VAM is that is suggests that there are number of variables that influence how "learning" takes place: schools, teacher prep programs, families, communities, teacher:student ratios.  What has to happen with these varables so that children are ready to learn and teachers are supported?

Taken in isolation, VAM has limitations.   For example, effective teachers may be miscast as ineffective, and therefore unworthy of employment, recognition and/or bonuses.*  Perhaps worse -- ineffective teachers could be identified as effective due to stand-alone standardized test scores.

And what if Oak Tree A is transplanted to Garden B?  Or how much time would Gardener B need to be effective in Garden A?  Think about switching from teaching 11th grade physics to 8th grade general science, for example.  Or switching from 5th graders to 3rd graders.  How much time, planning and coaching would you need to get to know the students, the 3rd grade teaching team, the curricula, and the families?  How long would it take for you to be "effective?"

We can also ask whether standardized tests scores are an adequate measure of learning, no matter how you adjust the numbers.

* For more on teacher bonuses, "Teacher Bonuses Don't Improve Test Scores."

Monday, September 6, 2010

John Dewey is an old-head!

A colleague recently asked "How do teachers with different years of experience work collaboratively to engage our students effectively in the classrooms?"  I've been puzzling over a few comments:
  1. Effective teachers use a variety of strategies to meet their students' needs, whether the teachers are 25 or 65.
  2. I remember that, as a student, my best K-12 experiences were when I was collaborating with classmates on projects -- whether in chemistry or history classes.  We could use a variety of approaches to solve problems or unexplained events, we had a degree of flexibility with our use of time, resources were abundant, and we were encouraged to share our findings via unique and creative presentations.
  3. Although I am committed to constructivism, I have found that my students sometimes benefit from a sprinkling of behaviorism.
  4. The biggest challenge for me, whether working with older or younger colleagues, has been understanding, if not agreeing on, the purpose of [public] education.  I think that if school communities could work that out (i.e. "What is the purpose of public education?"), teams of teachers, students and families would be in a better position to provide engaging experiences for students.  
A younger colleague recently told me that Howard Gardner's Theory of Multiple Intelligences was passe because "...he was looking really old."  What does that say about John Dewey (1859-1952)?

And a older colleague protested the use of web-based course-ware (such as this platform) because "Technology won't help the kids [learn]."  In some sense, both perspectives are a-historical.
I appreciate both the sense of immediacy and the sense of caution.  But worthwhile teaching is timeless, and effective teachers use a variety of strategies to engage students.  Always have, and always will.

Sunday, August 15, 2010

K-12 Copyright fear --- we don't want that here!

Any advice on how to help public school districts extricate themselves from the clutches of "copyright infringement fear?" Some of our work at my high school has been less effective because the district has blocked such information sites as Netflix, YouTube or blip.tv.

One challenge for us has been access to Netflix. Colleagues of mine had used the streaming feature for instructional use and critique in arts, humanities and science classes --- but the Philadelphia School District (PSD) blocked Netflix last year. The explanation was that they didn't want to infringe on copyrights.

Another challenge has been the blanketed blocking of YouTube. There are some fantastic educational videos of protein synthesis, for example, that we cannot access because PSD has blocked YouTube content. We had originally wanted students to create their own video animations and were referencing some wonderful material on the web for context. For a high school that emphasizes responsible use of computers in a 1:1 environment, it's been pretty frustrating.

In 2008-2009, our students of African American history made 30-second "commercials" about civil rights. By the time we had uploaded and indexed them on on blip.tv, and then linked them on Wikispaces (http://orange08-09.wikispaces.com/Commercials [now blip.tv is dead]), we learned that PSD blocked blip.tv when in the PSD network. Forget about in-school cross-curricular reflection and collaboration. (We use TeacherTube now.)

Why not coach students on smart use of educational technology?!?

Saturday, August 14, 2010

Effective personal learning communities (PLCs)

What are the characteristics of effective K-12 teachers' personal learning communities (PLCs), and can PLCs be digital?

I think that for PLCs to be effective, they need 3 things:  focus, responsibility, and authority.  The careful balance of these three results in teachers who are engaged, who have a sense of purpose, and who can influence the school's culture.  Most importantly, the PLCs need to cultivate individual's and/or the school's social capital.

PLCs will be more effective if they have a particular focus, whether its departmental (science or history teams), pedagogical (instructional or assessment strategies), operational (grant$ review or school culture), or interest-based (shared readings or other).

Effective PLCs need to have specific responsibilities such as completing a project, reporting back to the larger faculty and/or making policy recommendations.  Responsibility implies accountability, and the interaction between PLCs fosters accountability.  Schools need a deep leadership bench, and teachers can contribute to a school's strengths (and their own strengths) via PLCs.

A PLC's sense of authority is a tricky one.  Some teachers or administrators dispense authority to groups or individuals without proper and gradual experience with cost-benefit analysis, diplomacy, or communications etiquette.  If this is true, one solution is to have clear organizational goals and to understand how a specific PLC's aims fit into or advance the larger goals.  PLC members also need to develop 6, 12 and 18 months goals (more or less depending on the project) so that they can gradually raise the general social capital of the school overall.  The PLC's authority needs to be honored, and administrators, in particular, need to make sure they have provided enough context so that the PLCs understand the implications of their choices and recommendations.

On a side note, PLCs are more likely to be effective when administrators are participants.

Friday, July 23, 2010

Worthwhile education - Part 2

The program description from the RTTT includes four goals, one of which references competing in a "global economy" (see 4 goals below).  I commend Secretary Duncan and his OESE team for crafting an educational plan that includes an orientation to economy - we all need to eat and we all need energy:

  • "Through Race to the Top, we are asking States to advance reforms around four specific areas: 
    • Adopting standards and assessments that prepare students to succeed in college and the workplace and to compete in the global economy ;[emphasis added]
    • Building data systems that measure student growth and success, and inform teachers and principals about how they can improve instruction;
    • Recruiting, developing, rewarding, and retaining effective teachers and principals, especially where they are needed most; and
    • Turning around our lowest-achieving schools.
I have to ask if the first goal is worthwhile.  Is this really what we want for our children?

There is nothing in the program description about a "sustainable" economy, which is much more egalitarian.  In fact, I would prefer "...participate in a global democracy" rather than "...complete in the global economy."  After all, the purpose of public education is to cultivate an engaged democracy that can make critical and creative decisions about the economy --- not the other way around.

I bring it up because I think the emphasis on economy (rather than democracy) reflects 1) an interest in privatizing public education, and/or 2) a technocratic mindset where education has a utilitarian, measurable function.  The assumptions of RTTT (and  Nation at Risk before it) have permeated our social discourse to the point where we are deliberating obediency & compliance (re.: accountability) and how and where to build prisons -- rather than liberty, equality and creativity.

As Chris Lehmann says in Practical Theory, we've got to dream about and create what we want for public education.  Worthwhile education is built on those dreams.

What are your dreams?  What has to be in place for the dreams to be realized?

Wednesday, July 14, 2010

"Worthwhile education..."

With all of recent emphasis on standardized tests as a means to identify ineffective teachers, I realized that this is really a distraction form the real challenges we face. Of course there are bad teachers, but what percentage of our profession qualifies?

I think the real challenge is looking at the context of education; students come to school un-rested, under-fed and under-stimulated (with regard to measuring and reading). The onus is on families to take care of their children. This is not to suggest that we can simply blame families; it's hard being poor in America.

I think we have to look even broader. What are the conditions that are creating and maintaining a class of poor people in the first place? And who benefits? (It's like a blame game re: the Deep Horizon oil leak; everyone---including the media---is pointing fingers without asking the important question of energy sustainability).

Having teachers focus on managing ineffective teachers is a distraction. I'd rather work closely with faculty/admin/students & community to cultivate the characteristics of worthwhile public education*:
  • Well-rested, well-nourished and engaged students
    • alongside a political economy that provides meaningful & flexible employment, access to healthcare, safe neighborhoods
  • Equitable building resources (playing fields, books, science equipment, travel/experience budget)
  • 2 year-long co-teaching/internships for new teachers (at a respectable salary)
  • Teacher-led professional development
  • Democratic distributed leadership
  • curricular and instructional flexibility in alignment with content area concepts/principles and developmentally-appropriate learning
  • site-based budgeting & site-based hiring
What do you think are the characteristics of worthwhile public education?

Wednesday, July 7, 2010

What are liberal values?

Although I cannot speak for all liberals, there are several values that we often share.  For example, liberals value universal healthcare.  All Americans should be able to afford medical and dental regardless of income.  Right now, over 40 million Americans do not have healthcare.  And roughly 18,000 Americans die every year because of lack of health insurance (Institute for Medicine; Jan 14, 2004; http://www.iom.edu/CMS/3809/4660/17632.aspx).  And how many of our neighbors, whether liberal or conservative, think that getting a routine check-up should be easy and affordable? 

Another liberal value is energy conservation.  You can be certain that liberals appreciate our high standard of living.  Many Americans have warm, comfortable homes that use natural gas, oil, and/or electricity to cook food, clean clothes and run lamps.  Liberals also understand that there is a finite amount of energy available to support our way of life.  In order to sustain our fortunate wealth in the long-term, we will have to be a lot smarter about how we use energy.  At the very least, the words “reduce,” “re-use” and “recycle” have an important place in our lives---as liberals and as Americans.

The value of efficient transportation is closely linked with energy conservation.  We need local, regional, state and federal transportation planning that makes it easier to get around.   Are daily traffic jams on I-95 good for our economy?  Liberals also understand that communities should be walkable and bikeable.  Right now, there are a smattering of disconnected sidewalks near schools---and no bike lanes.  How many of our neighbors, whether conservative or liberal, would like their children to be able to walk or bike more safely to school?

Liberals value public education.  Public education exists to cultivate individual freedoms that are attuned to social responsibility.  A rich civic life is possible through direct experience with arts, athletics, humanities, math, sciences and vocations.  The possibility of a rich civic life may be compromised when you have disparate funding of public education.  In the 2006-2007 school year, Radnor, PA spent $17,105 per student while Upper Darby,PA spent $9,727 (Report Card on the School-2007; Philadelphia Inquirer: http://inquirer.philly.com/specials/2007/report_card/.  What can we do, as a society, to maintain Radnor’s excellent educational programming while providing comparable funding to less wealthy districts?

America is a rich and beautiful country because of the myriad of people who have been coming here over the last 500 years.  Although parts of our history are not pretty, we’ve had so many wonderful accomplishments because of religious and cultural exchange.  The Constitution of the United States was designed to foster this exchange in that the majority is expected to act to protect the minority.  Anytime a person or group acts to oppress another individual or group, the majority has the responsibility to act judiciously to protect the rights of the minority.   Liberals seek to hear and understand differences so that we may be better informed and thereby make better decisions in the common good.  Liberals value diversity. 

These are five values that liberals often agree on.  Sometimes, conservatives may agree with the value but not on liberal policies that support the value---and that’s okay.  It is rich and informed discussion about these values that will help America to be a tremendous place to live, work and raise families.  Interestingly, some of these secular values have their roots in Jewish, Christian, Islamic or other religious texts that emphasize compassion, caring, and civic engagement.  America’s great tradition of secular values will ensure that we will continue to grow and prosper as a vibrant, diverse, and healthy democracy.