Madison School Board member Lucy Mathiak, with a lament that, presumably, all thinking school board officials in the US share:
For years, MMSD staff have advocated for their proposals and programming choices by arguing that they are research-based data driven best practices. At times, I have wondered whether the research selected has undergone critical review. That is, do the people selecting the research stop to ask whether the research is methodologically sound with verifiable results, much less whether it was conducted on populations or under conditions that are comparable to the Madison public school district.
I’ve also wondered at an understanding of research that ignores entire bodies of data or work that falls outside of the narrow educational research paradigm. (Prime examples of the latter case include the district’s unwillingness to consider the considerable body of research on how children learn to read that is carried out by cognitive psychologists, linguists, and communicative disorder researchers. But that’s another post.)
What follows is my longwinded response, which builds up to a plea for Districts (or groups of districts) and States to establish local versions of the Consortium on Chicago School Research.
Mathiak’s particular concern is that the only source concerning underrepresented minorities mentioned by name in a report on TAG developments is by Ruby Payne, who is not a researcher, and self-publishes. Whatever the merits of this particular instance of the worry, it is a shared worry for a reason. Educational research (broadly construed as it should be) is voluminous, to say the least, and even much of the best of it is not designed, or written, to be readily accessible to non-academics. Educational leaders, whether at the school or district level, are not trained in the consumption of educational research: in fact, they are not even presented with a great deal of it during their training, even for the purpose of learning what it says. Preparing them would be quite difficult, for a couple of reasons. First, education is beset by a culture of deference to ideological commitments, which makes it quite difficult to have some kinds of discussion in a way that is really sensitive to the evidence. Consider inclusion – the policy of including children with special educational needs in the regular classroom – which is, in some quarters, a matter of faith of such strength that evidence is really irrelevant. It is similarly difficult in some districts and schools to have an evidence-sensitive discussion of racial achievement gaps. When you do have the discussion, furthermore, it is not necessarily the discussion you think you are having! (The most unnerving conversation I had with a superintendent was one in which the superintendent told me that his district uses Ronald Ferguson’s work to design their policies around the racial achievement gap, which I would think was a pretty good idea had he not just told me, as truth, a whole bunch of claims that I had, the previous day, read a Ronald Ferguson essay disproving). Training leaders to conduct such discussions in these circumstances, in which some of them have, themselves, made the particular commitments of faith, is no easy task.
[click to continue…]