Showing posts with label research. Show all posts
Showing posts with label research. Show all posts

Making Informative Decisions Based Upon the Research of Others

[Three weeks ago, I promised to write more about my thoughts concerning Reading First. I also illustrated one BIG reason why everyone should understand what is at stake here, and how the cards are dealt. While the effectiveness of Reading First remains in question, we still have something to learn from this political nightmare. Sadly enough, I know going in that this post will receive far less attention than others less deserving.]

Update: The discussion over the effectiveness of Reading First is far from dead. Stephen Krashen's recently posted editorial in USA Today, Scott's reaction on Reading Coach Online, Miguel Guhlin's challenge for the leadership gurus, and Matthew K. Tabor's briefly summarizing take are only a few current examples. While my take here is that we have something to learn from all of this, what's your take?

Just thought I'd ask.



For Gary Stager and every other school board member, superintendent, principal, teacher, policy maker, parent, and critical thinker:

Only in America will the Secretary of Education actually be named “Spellings” but that’s neither here nor there. On one count, I couldn’t agree more with the logic that Secretary Margaret Spellings (2008) has presented in her recent article.

When we don’t get reading instruction right, the consequences extend beyond our schools and into our prisons, hospital wards and unemployment lines. It’s no surprise that people who lack fundamental reading skills are more likely to drop out of high school, more likely to encounter health problems, and less likely to have a job. (¶ 4)
Hence, the responsibility to effectively teach reading throughout the curriculum lies with every educator, parent, and responsible adult. It seems that this particular shoe fits us all – teachers, parents, and responsible citizen alike.

Apart from this well-articulated idea from Spellings (2008), however, I see little reliance on logic and far too much reliance on rhetoric. Unfortunately, her inclusion of phrases like “sound science” (¶ 5) and “research-based reading instruction” (¶ 12) do nothing to convince me that Reading First really has succeeded.

Please. Help me keep up.

Does “sound science” refer to the one size fits all approach encouraged by Reading First or our government’s tendency to rely on data assembled through a clumsy, hurried, and shallow approach to data analysis? When reading instruction is “research-based”, does that mean that it’s only based on a limited number of conveniently selected studies?

Admittedly, in today’s highly scrutinized academic climate, it is increasingly important to identify the most effective practices in reading instruction. Therefore, it is only natural to turn to the work of researchers whose interests lay at the heart of reading instruction and best practices alike. It is in turning to the research that one might uncover a plethora of truths, openly exposing the many flaws with which Reading First has been plagued. In this brief post, a number of the flaws inherent in the Reading First program will be explored, as well as flaws deep-rooted in human nature and the attitudes we may have in relation to the research base.

First, Reading First would be more effective if it wasn’t so strictly prescriptive. To be clear, a “one size fits all” approach to reading instruction - or any kind of instruction, for that matter - simply doesn’t exist. As has been stated so accurately by Richard Allington (2005):
Effective teachers are much like the effective physician who offers a multi-pronged approach to reducing cholesterol… Teachers, like doctors, must make decisions based on the unique evidence they observe in their students. This makes “replicability” of effective instruction something very different from teaching from a scripted lesson plan. (p. 463)
Hence, an essential quality possessed by effective teachers is the ability to exercise good judgment. Because of this truth, teachers must be given autonomy in deciding which practices will work most effectively for the varying types of learners with whom they may work (see Garan, 2005, p. 442). Reading First, unfortunately, affords no such freedom as it mandates that scope and sequence of reading instruction be followed religiously.

Second, while Reading First may be touted as “research-based reading instruction” (Spellings, 2008, ¶ 12), it may not be as efficacious as anticipated. According to Richard Allington (2008):
No intervention has raised the achievement of 90 percent of poor readers to the 50th percentile. Moreover, no research suggests that the classroom teachers can help 90-95 percent of students acquire grade-level reading proficiencies by learning more about phonology, using a scripted curriculum, teaching systematic phonics, or following some “proven program”. (p. 25)
Therefore, simply because a program claims to be “research based” doesn’t mean it will be effective.

Timothy Shanahan (2002) has been clear in the reason why one must move forward with caution when considering the research so as to better make more informed decisions. “In our ardor to apply research findings to reading, we can make things worse rather than better. Too often, when we consider what the research says, we systematically ignore and misinterpret the meaning of research evidence” (p. 9). Accordingly, a conscious effort in interpreting research findings is crucial.

Moreover, while the National Reading Panel initially put forth some effort in examining the research base (prior to Reading First and its effects), the kind of base that must be examined would require a far more detailed – and honest – effort than was ever put forth. Said Joanne Yatvin (2002) of her experience as a member of the NRP, “Along the trail, pressured by isolation, time limits, lack of support, and the political aims of others, we lost our way – and our integrity” (p. 364). She continued, offering additional detail about some of the decisions made in haste coupled with questionable methods employed:
Members convinced themselves that, because they had worked hard under adverse conditions, the report was satisfactory. Most of the scientists also seemed to believe that the standards they had set and the methodology they had developed were accomplishments important enough to compensate for the shortcomings in their work. To justify themselves, they added a special section titled “Next Steps” that explained the small number of topics investigated and suggested areas for future investigation. Another special section called “Reflections” was also added to summarize and emphasize the panel’s accomplishments. These last-ditch efforts were to no avail. The panel’s claim to scientific objectivity and comprehensiveness was lost. (p. 367)
If panel members themselves have felt so unsure about the breadth and scope of their efforts, why should others feel so compelled to acknowledge their undertaking with reckless abandon?

Finally, as an attempt to interpret research findings is undertaken, a careful consideration of the research methods employed can aid in the process of identifying valid studies. Sadly, the “research” reported by the National Reading Panel (National Institute of Child Health and Human Development, 2000) provides a contrasting example in connection with this topic as a number of inconsistencies in the data presented and weaknesses in the methods employed have been identified in this once seemingly valid research report. Krashen (2004), for example, cites a considerable number of examples that demonstrate that methods utilized by the NRP were less than ideal. Allington (2005, p. 466) goes even further when he aggressively calls the report produced by the NRP “anti-scientific” (see also Yatvin, 2002). Again, just because a program claims to be research based, doesn’t indicate effectiveness. A careful analysis of the methods employed in the study will help in determining validity.

In conclusion, as further detailed, comprehensive attention to the research base is undertaken, more informative decisions can be made to ensure better instruction as we continue in our struggles to effectively teach children to read.

References:
  • Allington, R. L. (2008). Setting the record straight. Association for Supervision and Curriculum Development, 61(6): 22-25.
  • Allington, R. (2005). Ideology is still trumping evidence. Phi Delta Kappan. 86(6), 462–468.
  • Garan, E. (2005). Murder your darlings: A scientific response to The voice of evidence. Phi Delta Kappan, 86(1), 438-443.
  • Krashen, S. (2004). False claims about literacy development. Educational Leadership, 61(6), 18-21.
  • National Institute of Child Health and Human Development. (2000). Report of the National Reading Panel: Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction [Online]. Retrieved June 14, 2008, from http://www.nationalreadingpanel.org/Publications/publications.htm.
  • Shanahan, T. (2002). What reading research says: The promises and limitations of applying research to reading education. In S. J. Samuels & A. Farstrup (Eds.), What research has to say about reading instruction (3rd ed.) (pp. 8-24). Newark, DE: International Reading Association.
  • Spellings, M. (2008, June 7). We need more Reading First, not less. The Salt Lake Tribune. Retrieved June 23, 2008, from http://www.sltrib.com
  • Yatvin, J. (2002). Babes in the woods: The wanderings of the National Reading Panel. Phi Delta Kappan 32(5), 364–69.
Original Image Source: Flickr user thejbird

Technorati Tags:

Me, A Qualitative Researcher?

Qualitative research has an interesting history, compelling implications for present research, and an intriguing way of evolving, such that future qualitative studies will differ from past. A manner of research that is rather encompassing, I find the definition of qualitative research provided by Denzin and Lincoln (2005) to be of particular worth:

Qualitative research is a situated activity that locates the observer in the world. It consists of a set of interpretive, material practices that make the world visible. These practices transform [italics added] the world... This means that qualitative researchers study things in their natural settings, attempting to make sense of, or interpret, phenomena in terms of the meanings people bring to them. (p. 3)
In transforming the world into “a series of representations, including field notes, interviews, conversations, photographs, recordings, and memos to the self” (p. 3) the research can then better define him or herself in relation to the world, further defining the world in the process. I find this entire process to be fascinating.

Another idea that I find to be as interesting in its ramifications as it is difficult in its application is openness inherent within qualitative research. While a part of me is troubled by “the open, emergent nature of qualitative inquiry” – and hence its innate “lack of standardization” (Glesne, p. 19) – another part of me screams with joy in reaction to this implied freedom. To be able to consistently “push the envelope” offers tremendous promise for I deem the ever-changing nature of such research design to be extremely refreshing.

To be clear, I am particularly drawn toward two particular strands within the overarching concept of qualitative research: Action research and Postmodernism. I am intrigued by the possibilities that action research may hold because it “has experienced popularity again, particularly in education, as a way to improve practice” (Glesne, 2006, p. 17). As one that hopes to assume an effective role as a change agent (Rogers, 2003, p. 27) in education, I see action research – with such a focus on improvement – as a particularly promising paradigm.


Postmodernism, on the other hand, has proven to be equally compelling – particularly in how postmodernism is “marked by globalization, the spread of information technologies, and the fragmentation of nation-states” (Glesne, p. 18). My current professional position as a Technology Curriculum Specialist in the Jordan School District – and our current emphasis on global collaboration and other 21st Century skills – has led me to further inclinations to conduct research within this exciting field. Nonetheless, I don’t see postmodernism (or at least Glesne’s representation of it) as perfect. Particularly, I actually do think that there are many universal truths to be discovered – in spite of Delamont’s (2002, p. 157) claim to the contrary. Even though I can empathize with the postmodern doubt in the ability of Western science to solve all of the world’s problems, absolute truth – as I see it – can be discovered in time and through scientific and personal inquiry.

In conclusion, I look forward to learning more about qualitative research and hope to discover different ways that it can be used throughout my career.

References

Denzin, N. K., & Lincoln, Y. S. (2005). Introduction: The discipline and practice of qualitative research. In N.K. Denzin & Y. S. Lincoln (Eds.), The SAGE handbook of qualitative research (3rd ed., pp. 1-32). Thousand Oaks: Sage Publications.

Glesne, C. (2006). Becoming qualitative researchers: An introduction (3rd ed.). Boston: Pearson Education, Inc.

Rogers, E. M. (2003). Diffusion of innovations (5th ed.). New York: Free Press.

Image Source - davidking

Technorati Tags:

Bloggers Make Better Lovers Predictions

Stephen Downes has created an informative report card detailing "the predictions from the 2007 eLearn Magazine's annual round-up, and what actually happened." I have decided to take Stephen's findings one step further.


The following "grades" have come from Stephen's post and the blogs have mostly been identified (hopefully accurately) using a simple Google search: 'elliot masie blog', for example, reveals several online works created by Elliot.

Don Norman, Nielsen Norman Group, Northwestern University, and Author of Things That Make Us Smart, USA

Richard Mayer, Department of Psychology, University of California, USA
  • Grade: C-
  • Blog: None easily accessible
Elliott Masie, The MASIE Center's Learning CONSORTIUM, USA
Michael Feldstein, author of the e-Literate weblog and member of eLearn Magazine's Editorial Advisory Board, USA
Curt Bonk, Professor, Indiana University, USA
Stephen Downes, Researcher, National Research Council, Canada
Ray Schroeder, Director, Office of Technology-Enhanced Learning, University of Illinois at Springfield, USA
Karl Kapp, Assistant Director, Institute for Interactive Technologies and Professor of Instructional Technology, Bloomsburg University, USA
Saul Carliner, Assistant Professor, Graduate Program in Educational Technology, Concordia University, Canada
  • Grade: B
  • Blog: None easily accessible
Allison Rossett, Professor of Educational Technology, San Diego State University and co-author of Job Aids and Performance Support, USA
  • Grade: C
  • Blog: None easily accessible
Jay Cross, Internet Time Group., USA
Mark Oehlert, Learning Strategy Architect, Booz Allen Hamilton, USA
Margaret Driscoll, Consultant, IBM, USA
  • Grade: C
  • Blog: None easily accessible (She did publish to the Learning Circuits blog, but that hasn't been updated in years)
Richard Larson, Director, MIT Learning Interactive Networks Consortium (LINC) and Mitsui Professor, Engineering Systems, MIT, USA
  • Grade: D
  • Blog: None easily accessible
Angeliki Poulymenakou, Assistant Professor in Information Systems, and Spiros Borotis, Researcher, both at Athens University of Economics and Business, Greece
  • Grade: C
  • Blog: None easily accessible (could be language barrier)
Masaaki Kurosu, Professor, National Institute of Multimedia Education, Japan
  • Grade: D
  • Blog: None easily accessible (could be language barrier)
Ellen Wagner, Sr. Director, Worldwide eLearning Solutions, Adobe Systems, USA
  • Grade: B
  • Blog: None easily accessible
David Porush, Executive Director, SUNY Learning Environments, USA
  • Grade: C+
  • Blog: None easily accessible
Geoffrey Bock, Principal, Bock & Company, USA
Jonathon Levy, Senior Learning Strategist, Monitor Group, USA
  • Grade: C-
  • Blog: None easily accessible
Now, using the 4.0 grade scale (generally standard in the United States), I've calculated the collective averages of bloggers versus non-bloggers - and if I've recorded any of the above entries erroneously, please let me know and I'll adjust the numbers below.

Bloggers
  • N=10
  • GPA = 2.533
Non-Bloggers
  • N=10
  • GPA = 1.967
Drape's Take - These numbers may suggest that:
  • In spite of his efforts to the contrary, Stephen Downes might be biased in his grading.
  • Bloggers might be more effective in making accurate predictions about educational technologies.
  • Blogging just might make you think clearer, with a greater awareness of current events and trends.
  • I have just found several new blogs to add to the reader.
So what are your conclusions?

Technorati Tags:

Image Source - http://www.zazzle.com/

Peer Reviewed - To Be Or Not To Be

Formal research conducted by serious researchers always consists of works (journal articles or other) that have been peer reviewed. The reason peer reviewed works are considered to be of higher quality than other works is because they "have been submitted to a process of evaluation by one or more experts in the subject to determine whether it is worthy of publication" (visit here for additional definitions).

Although many peer reviewed articles can be accessed using the Internet, the easiest way to tell whether or not an article is "peer reviewed" is by reading the journal from which it came. Many peer reviewed journals state in their introductions that they are, indeed, peer reviewed. Consequently, serious researchers spend considerable amounts of time in the library. In Utah, for example, a quick trip to the libraries at either BYU, the University of Utah, or Utah State University can be well worth the time as these libraries contain entire floors of peer reviewed journals.

Nevertheless, as not all students have access to the actual journals, the Internet can also prove to be an invaluable resource. Many libraries and an increasing number of other sources now offer online access to journals. Here are a few of my favorite starting places:

Another extremely valuable tool I've used when conducting research online is Google's new Notebook tool. Coupled with the Firefox plugin, this tool allows you to quickly save URLs and text from your favorite sites (just highlight some text, and click a button). You can then save your "notebooks" for others to view (click here to see the notebook I used to prepare for TTIX).

Image Source - Myself. This is a shot of one row of journals in the periodical section of the Harold B. Lee Library. If you've never been inside of a University library, you should stop what you're doing and visit one now! The size, the feelings, and the smells are all amazing (I love the smell - rarely changes from library to library).

Technorati Tags:

Creative Commons License
Original content distributed on this site is licensed under a
Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License.