Showing posts with label reading assessments. Show all posts
Showing posts with label reading assessments. Show all posts

Friday, November 30, 2012

Gathering Data

This is part 8 in my series on trying to teach students to use annotations to read. The first entry was posted back at the beginning of September, titled “The Problem.”

So, a discussion of tracking and data is probably long overdue. Stupid, meaningless words. “We’d like to see some data on your kids.” Measuring student development in something as complex as literacy is like living perpetually in late November or early December and trying always to make a definitive statement about whether or not it’s winter. Of course, there’s an objective marker on a calendar somewhere that tells you the answer flat out, but even in the face of that kind of absolute idea, day to day experience kind of contradicts it sometimes. You’re pretty sure you’re in a state of becoming winter though. Some days more than others. Measuring literacy is kind of like that, I guess.

With that in mind, I decided to try to track some target students using a more narrative style. It gave me a chance to reflect on what was really happening for each student, day to day, but also to look explicitly at whether or not it seemed like this reading and annotation method was helping.

I focus on three categories – frequency of annotations in general, the extent to which the student's notes are reflecting central ideas in the text, and the potential for moving these notes from a simple summary level to a more explicative level. It's just a basic Word document with some columns, but it's easy enough to quickly throw some thoughts into or to print off for the odd administrator request or student conference.

In my English classes, I've been tracking a handful of students – mostly students with IEPs or who are ELLs, but a couple who self-selected by coming for individual help with reading comprehension early in the year – and I've just been finishing up scanning in a bunch of their work. Unfortunately, there's going to be a big gap in work because we started reading To Kill a Mockingbird. Maybe I'll get a chance to scan in some annotations or sticky notes from students later on. Maybe I'll sleep a little bit or finish another Game of Thrones book or something.

I've been trying to keep up with these narrative trackers on each of my target students. For the most part, I've been successful – it's not so much about taking the time to write in the 30-80 words per entry, which is pretty quick and painless. It's actually collecting the texts so that I can make copies. As I pointed out in the overall description of the method a while back, using student annotations the way we do is nice for real-time assessment as students are actually reading.

So, for instance, these annotations from early in the year might indicate that the student is able to decode the text on the most basic level, despite relatively high complexity. However, less central details – the description of the architecture, for instance – are left unmentioned. The student could use these annotations to summarize the story or talk about things like theme or characterization, but close-reading discussions like tone or author's craft would require a strategic rereading.


Thursday, October 11, 2012

Measuring Reader Confidence

This is part 4 of my project on teaching students to actually read.  The first post in this series was "The Problem," posted on 9/1/12.

So I thought that I would try to measure this process as thoroughly as possible.  Obviously I’ll want to do it by measuring students’ abilities to read increasingly difficult texts, but simply testing kids with comprehension questions and observations of their annotations would leave out one of the most important factors – their sense of their own comprehension skills.  Since the problem is really students’ inability to confront difficult texts with the skills and the confidence to work through the reading, it seemed to me that I should measure the more subjective aspect of comfort with texts.  So I asked the kids how they felt about the texts I was giving them after a brief pre-reading skim. 
            Let me be clear about this.  I usually hate these kinds of things.  I’ve never found much use for interest surveys in reading workshops and I’ve never been able to use learning style tests.  It turns out that most kids would rather talk and have hands-on experiences.  No shit.  But I’m interested in the power of confidence and I wanted to know whether or not this methodology improved students’ senses of their reading abilities along with their more objectively-measured abilities.  So I just asked them how they felt and I’ll do it again from time to time. 
            Basically, I showed them the articles and said something along the lines of “If I asked you to read this and then we were going to do something that you needed to know it, how would you feel?”  Not terribly scientific.  I even neglected to survey my smallest class, from which 3 of my target students are drawn.  But that’s the day to day of being a teacher.  We had other things going on.  Their responses were limited to the 4 possibilities listed.  You can make what you want to out of these numbers.  The Stop & Frisk articles were part of my initial preassessment for the year, tied to a writing task.  They were the first things students got from me.  The Poe came about 7 or 8 classes later, after students had been introduced to the annotation method but hadn’t really seen it in action.  I’ll post a full bit on those lessons later.
            Hopefully, I can finish this introductory unit and reward kids with some more Poe – maybe “Tell-tale Heart” – because they loved “Masque.”  When I hand it to them, I’ll ask them the same question and get their response.  Hopefully, the numbers go up. 


New York Times Stop & Frisk articles
104 students surveyed

Very uncertain – 27  (26%)
Uncertain – 43  (41%)
OK with it – 28  (27%)
Comfortable – 6  (6%)


Poe’s “Masque of the Red Death”
102 students surveyed

Very uncertain – 58  (57%)
Uncertain – 36  (35%)
Ok with it – 6  (6%)
Comfortable – 2  (2%)