Purpose: There is concern about a decline in mathematics achievement scores among U.S. students during the middle school years. For example, while 4th grade U.S. students rank 8th overall on an international mathematics comparison, by 10th grade U.S. student's drop significantly to 25th in the same comparison. Some researchers posit that much of this decline relates to how math is taught in the U.S. and with how students become less engaged as learners in middle school. The purpose of this project is to develop a web-based game to engage 7h grade students in a narrative-based story which will apply learning of content and skills aligned to the Common Core State Standards (CCSS) in mathematics.
Project Activities: During Phase I in 2012, the team developed a functioning prototype and conducted usability and feasibility research with fourteen 7th grade students. Researchers found that the prototype functioned as intended and that students were highly engaged while playing the game. In Phase II, the team will develop a fully-functional user interface with animated characters, interactivity across student users, narrative scripts and accompanying art assets, 36 problem sets, and student and teacher dashboards and databases. After development is complete, a pilot study will examine the usability and feasibility, fidelity of implementation, and the promise of the game to improve math learning. The study will include 120 students in 6 classrooms in three schools, with one classroom per school randomly assigned to use the game and the other half assigned to a business-as-usual control. Analyses will compare student scores on pre and post mathematics measures.
Product: Empires is a web-based game that addresses 36 pre-algebra Common Core State Standards in mathematics for 7th and 8th grades. The game follows a storyline in a recreation of an ancient empire which is at the brink of agricultural revolution and of becoming a trade economy. As students play the game, they engage in math-focused activities to drive the action, such as taxing citizens to learn ratios and proportions, allocating resources to learn percentages, and measuring the distance and time between a neighboring empire by applying the principles of the Pythagorean Theorem. As a socially networked game, students will interact with other students in the class to complete trades that lead to encounters with different math problems. The game will include two helpful, funny, advisors who will scaffold learning through mathematical discourse, arguing over the next most important thing to do. The game design architecture will work on a wide range of computers, including desktops and iPads. A teacher's guide and companion website will provide guidance to classroom activities that complement the game.
This project team is developing and testing a prototype of the Teachley Analytics Library, a platform intended to host third party-developed mathematics game apps for students in kindergarten through Grade 8. The prototype will include a dashboard to host games and generate formative assessment data to inform teacher instruction. In the Phase I pilot study, the team will examine whether the prototype functions as planned with 40 Grade 1 and 2 math teachers. The study will test if teachers are able to implement games within the classroom and utilize data to inform practice, and whether students are engaged by gameplay.
In prior research and development, the team developed the Mathalicious intervention for middle and high school students to improve mathematical thinking. Each Mathalicious lesson revolves around applying a real world example to learn math (e.g., Is college worth the cost). In this project, the team will develop and test a prototype of an adaptive platform through which students will need to demonstrate mastery prior to being able to advance to more complicated procedural, conceptual, and analytical levels. In the Phase I pilot research with three Grade 8 classrooms, the team will examine whether the prototype functions as planned, if teachers are able to implement it with students, and whether students are engaged.
In prior research and development, the team developed WuzzitTrouble, an iPhone and iPad gaming app where players solve problems using number sense mathematical strategies. This project will develop and test a prototype of an adaptive engine for this game, intended to tailor gameplay to the skill levels of individual students and to provide support (or scaffold learning) for students with weaker skills. The Phase I pilot will involve six Grade 6 classrooms and 100 students. The study will examine whether the prototype functions as planned, and if students of different skill levels are engaged and able to play the game with the support of the prototype’s adaptive engine.
Purpose: The team will fully develop and test three puzzle-based math games that adaptively assess and support student learning in middle school classrooms. A principle objective of middle school math is to prepare students for more complicated and advanced STEM topics, providing the foundation for a wide variety of college majors and careers. Students who struggle in math in grade 5 and 6 are more likely to show deficits as coursework turns to topics in algebra. However, in many classrooms, commonly used progress monitoring instruments often do not adjust in ease or difficulty based on student performance, and do not provide data teachers can use to tailor instruction to meet the needs of students.
Project Activities: During Phase I (completed in 2015), the team developed a prototype of an adaptive engine for Wuzzit Trouble, a previously developed app where players rotate a virtual wheel to solve puzzles by applying number sense mathematical strategies. The engine tailors gameplay to the skill level of individual students in real time, providing tips and support to students having difficultly or by making challenges more difficult for those who master puzzles. The research team conducted a pilot study at the end of Phase I in order to test the prototype. A little more than 200 grade 5 and 6 students and six teachers participated over two weeks. Researchers found that the prototype functioned as intended and that teachers successfully used the game before, during, and after class as a supplement to instruction. They learned that 65% of students enjoyed using the prototype and 46% indicated that the game adjusted to the right level of difficulty during gameplay. In Phase II, the team will develop two new games on topics including algebraic thinking and problem solving, will strengthen and validate the adaptive engine, and will build out the dashboard to report formative and summative assessment results. After development is complete, the researchers will carry out a larger pilot study to assess the usability and feasibility, fidelity of implementation, and promise of the three games to improve student learning over a 9-week period. Thirty-two grade 5 and 6 math classrooms from 16 schools will participate. One classroom from each school will be randomly assigned to use the games and half will continue with business-as-usual procedures. The researchers will compare pre-and-post scores for student learning on standardized measures of pre-algebra topics. They will also track teacher implementation.
Product: The final product will include a suite of three app-based puzzle games aligned to national math standards for number sense, algebraic thinking, and problem solving. The games will be designed for use in grade 5 and 6 classrooms where students develop and apply content expertise to solving challenges. The games will include an adaptive engine that assesses and adjusts content based on student level of performance, a back-end system to organize data, and a reporting dashboard to present measures of student performance, persistence, and creativity. The project team will also develop teacher resources for suggesting how to incorporate games and activities into classroom instructional practice to reinforce lesson plans and learning.