The Eleven Percent Solution
January 2006
Despite an 11% acceptance rate, CS graduate student Mingyu Feng was able to get her paper "Addressing the Testing Challenge with a Web-Based E-Assessment System that Tutors as it Assesses" accepted at WWW'06, the 15th annual World Wide Web Conference to be held in Edinburgh Scotland in May 2006. Her advisor Neil Heffernan, a coauthor along with CMU researcher Kenneth Koedinger, reports that a record number of nearly 700 papers were submitted across 13 tracks, 25% more papers than in 2005. Ming's work is part of the Assistments project.
The abstract for the paper is as follows:
Secondary teachers across the country are being asked to use formative assessment data to inform their classroom instruction. At the same time, critics of No Child Left Behind are calling the bill "No Child Left Untested" emphasizing the negative side of assessment, in that every hour spent assessing students is an hour lost from instruction. Or does it have to be? What if we better integrated assessment into the classroom, and we allowed students to learn during the test? Maybe we could even provide tutoring on the steps of solving problems. Our hypothesis is that we can achieve more accurate assessment by not only using data on whether students get test items right or wrong, but by also using data on the effort required for students to learn how to solve a test item. We provide evidence for this hypothesis using data collected with our E-Assistment system by more than 600 students over the course of the 2004-2005 school year. We also show that we can track student knowledge over time using modern longitudinal data analysis techniques. In a separate paper at this same conference track, we report on the Assistment system.s architecture and scalability, while this paper is focused on how we can reliably assess student learning. Maintained by webmaster@cs.wpi.eduLast modified: August 03, 2006 09:13:51