As the world is increasingly dependent upon computing and computational processes associated with data analysis, it is essential to gain a better understanding of the visualization technologies that are used to make meaning of massive scientific data. It is also essential that the infrastructure, the very means by which technologies are developed for improving the public's engagement in science itself, be better understood. Thus, this AISL Innovations in Development project will address the critical need for the public to learn how to interpret and understand highly complex and visualized scientific data. The project will design, develop and study a new technology platform, xMacroscope, as a learning tool that will allow visitors at the Science Museum of Minnesota and the Center of Science and Industry, to create, view, understand, and interact with different data sets using diverse visualization types. The xMacroscope will support rapid research prototyping of public experiences at selected exhibits, such as collecting data on a runner's speed and height and the visualized representation of such data. The xMacroscope will provide research opportunities for exhibit designers, education researchers, and learning scientists to study diverse audiences at science centers in order to understand how learning about data through the xMacroscope tool may inform definitions of data literacy. The research will advance the state of the art in visualization technology, which will have broad implications for teaching and learning of scientific data in both informal and formal learning environments. The project will lead to better understanding by science centers on how to present data to the public more effectively through visualizations that are based upon massive amounts of data. Technology results and research findings will be disseminated broadly through professional publications and presentations at science, education, and technology conferences. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project is driven by the assumption that in the digital information age, being able to create and interpret data visualizations is an important literacy for the public. The research will seek to define, measure, and advance data visualization literacy. The project will engage the public in using the xMacrocope at the Science Museum of Minnesota and at the Center of Science and Industry's (COSI) science museum and research center in Columbus, Ohio. In both museum settings the public will interact with different datasets and diverse types of visualizations. Using the xMacroscope platform, personal attributes and capabilities will be measured and personalized data visualizations will be constructed. Existing theories of learning (constructivist and constructionist) will be extended to capture the learning and use of data visualization literacy. In addition, the project team will conduct a meta-review related to different types of literacy and will produce a definition with performance measures to assess data visualization literacy - currently broadly defined in the project as the ability to read, understand, and create data visualizations. The research has potential for significant impact in the field of science and technology education and education research on visual learning. It will further our understanding of the nature of data visualization literacy learning and define opportunities for visualizing data in ways that are both personally and culturally meaningful. The project expects to advance the understanding of the role of personalization in the learning process using iterative design-based research methodologies to advance both theory and practice in informal learning settings. An iterative design process will be applied for addressing the research questions by correlating visualizations to individual actions and contributions, exploring meaning-making studies of visualization construction, and testing the xMacroscope under various conditions of crowdedness and busyness in a museum context. The evaluation plan is based upon a logic model and the evaluation will iteratively inform the direction, process, and productivity of the project.
Purpose: Purpose: This project team will fully develop and test Teachley Connect, a platform that syncs a variety of third-party math games to give elementary schools formative assessment data and intervention support. Mobile math games provide opportunities for students to access educationally-meaningful content in and out of the classroom and to supplement instruction. There are a number of examples of math apps that show promise for supporting and assessing student learning in different areas of mathematics, yet few apps in the marketplace provide meaningful data that teachers can use. Many games provide an overall score at the end of the session, but do not help teachers know what skills students are struggling with or how to provide additional support.
Project Activities: During Phase I, (completed in 2015), the team developed a prototype of Teachley Connect, which enables the secure transfer of game and learning data between third-party math games and the Teachley servers. At the end of Phase I, researchers completed a pilot study with 20 students and two teachers and demonstrated that the prototype operated as intended with important trends indicating that the system promotes student engagement and less time spent seeking help. In Phase II, the team will add additional third party math apps to the platform, strengthen the backend management system to tag user game-play data, and build out the teacher reporting dashboard to inform instruction and identify apps to address particular student and class needs. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the Teachley Connect for teachers to use formative assessment data to inform classroom practice, select apps to address individual student needs, and support student math learning. The study will include 12 (grade K to 3) classrooms and randomly assign them into one of three groups: 1) apps only, 2) Teachley-enabled apps, or 3) Teachley-enabled apps + data. Researchers will compare pre-and-post scores of student's math learning, classroom observations, and teacher surveys/interviews.
Product: Teachley Connect will be a mobile tablet-based platform that uses games to give elementary schools rich formative assessment data and intervention support. Teachley Connect will permit students to continue playing exactly where they left off on any tablet. The platform will also connect apps into a single teacher dashboard, providing teachers detailed reports on student performance across games, with insights for informing individual or whole group instruction. The platform will include teacher resources to support the alignment of game play with learning goals and to support implementation.
Purpose: The team will fully develop and test three puzzle-based math games that adaptively assess and support student learning in middle school classrooms. A principle objective of middle school math is to prepare students for more complicated and advanced STEM topics, providing the foundation for a wide variety of college majors and careers. Students who struggle in math in grade 5 and 6 are more likely to show deficits as coursework turns to topics in algebra. However, in many classrooms, commonly used progress monitoring instruments often do not adjust in ease or difficulty based on student performance, and do not provide data teachers can use to tailor instruction to meet the needs of students.
Project Activities: During Phase I (completed in 2015), the team developed a prototype of an adaptive engine for Wuzzit Trouble, a previously developed app where players rotate a virtual wheel to solve puzzles by applying number sense mathematical strategies. The engine tailors gameplay to the skill level of individual students in real time, providing tips and support to students having difficultly or by making challenges more difficult for those who master puzzles. The research team conducted a pilot study at the end of Phase I in order to test the prototype. A little more than 200 grade 5 and 6 students and six teachers participated over two weeks. Researchers found that the prototype functioned as intended and that teachers successfully used the game before, during, and after class as a supplement to instruction. They learned that 65% of students enjoyed using the prototype and 46% indicated that the game adjusted to the right level of difficulty during gameplay. In Phase II, the team will develop two new games on topics including algebraic thinking and problem solving, will strengthen and validate the adaptive engine, and will build out the dashboard to report formative and summative assessment results. After development is complete, the researchers will carry out a larger pilot study to assess the usability and feasibility, fidelity of implementation, and promise of the three games to improve student learning over a 9-week period. Thirty-two grade 5 and 6 math classrooms from 16 schools will participate. One classroom from each school will be randomly assigned to use the games and half will continue with business-as-usual procedures. The researchers will compare pre-and-post scores for student learning on standardized measures of pre-algebra topics. They will also track teacher implementation.
Product: The final product will include a suite of three app-based puzzle games aligned to national math standards for number sense, algebraic thinking, and problem solving. The games will be designed for use in grade 5 and 6 classrooms where students develop and apply content expertise to solving challenges. The games will include an adaptive engine that assesses and adjusts content based on student level of performance, a back-end system to organize data, and a reporting dashboard to present measures of student performance, persistence, and creativity. The project team will also develop teacher resources for suggesting how to incorporate games and activities into classroom instructional practice to reinforce lesson plans and learning.
Purpose: This project team will fully develop and test Cyberchase Fractions Quest, a web-based mathematics game for students in grade 3 and 4. Research shows that inadequate understanding of fractions can persist from early grades through higher education, and that success in fractions predicts future success in mathematics and other STEM subjects.
Project Activities: During Phase I (completed in 2016), the team developed a prototype of Cyberchase Fractions Quest, including an interactive number line game with four levels of challenges, and a tool to scaffold learning through hints and provide encouragement as students progress. At the end of Phase I, the research team conducted a pilot study over one week with 60 grade 4 students, half of whom were randomly assigned to use the prototype and half assigned to paper-based fractions activities. Results revealed that the prototype functioned as intended, that students were engaged during gameplay, and that from pre- to post-test, students using the prototype increased significantly in their knowledge of number line problems compared to the control group. In Phase II, the team will finalize the design, artwork, and animation, the formative and summative assessment component, and learning management system. After development is complete, the researchers will carry out a pilot study to assess the usability and feasibility, fidelity of implementation, and promise of the game to improve student learning of fractions over a 5-week period. The study will include four classrooms of grade 3 students, two of which will be randomly assigned, to use the games to supplement in-class lessons while the others will use paper-based activities. The researchers will compare pre-and-post scores for student learning of fractions. The study will also track teacher implementation.
Product: The final product is Cyberchase Fractions Quest—a math game based on the storyline of PBS children's television series, Cyberchase. In the game, students in grades 3 and 4 will apply learning fractions within three contexts: areas and regions (such as shapes), sets (groups of objects), and on a number line. The game will identify specific areas where students struggle and will introduce challenges to support individualized learning. Similar to other popular game apps, student will receive immediate feedback from one to three stars based on how well they perform on each challenge as well as in-game rewards as they progress toward mastery. The game will include teacher resources for classroom implementation, and an educator dashboard presenting results.
This project will capitalize on the power of story to teach foundational computational thinking (CT) concepts through the creation of animated and live-action videos, paired with joint media engagement activities, for preschool children and their parents. Exposure at a young age to CT is critical for preparing all students to engage with the technologies that have become central to nearly every occupation. But despite this recognized need, there are few, if any, resources that (1) introduce CT to young children; (2) define the scope of what should be taught; and (3) provide evidence-based research on effective strategies for bringing CT to a preschool audience. To meet these needs, WGBH and Education Development Center/Center for Children and Technology (EDC/CCT) will utilize an iterative research and design process to create animated and live-action videos paired with joint media engagement activities for parents and preschool children, titled "Monkeying Around". Animated videos will model for children how to direct their curiosity into a focused exploration of the problem-solving process. Live-action videos will feature real kids and their parents and will further illustrate how helpful CT can be for problem solving. With their distinctive visual humor and captivating storytelling, the videos will be designed to entice parents to watch alongside their children. This is important since parents will play an important role in guiding them in explorations that support their CT learning. To further promote joint media engagement, hands-on activities will accompany the videos. Following the creation of these resources, an experimental impact study will be conducted to capture evidence as to if and how these resources encourage the development of young children's computational thinking, and to assess parents' comfort and interest in the subject. Concurrent with this design-based research process, the project will build on the infrastructure of state systems of early education and care (which have been awarded Race to the Top grants) and local public television stations to design and develop an outreach initiative to reach parents. Additional partners--National Center for Women & Information Technology, Code in Schools, and code.org (all of whom are all dedicated to promoting CT)--will further help bring this work to a national audience.
Can parent/child engagement with digital media and hands-on activities improve children's early learning of computational thinking? To answer this question, WGBH and EDC/CCT are collaborating on a design-based research process with children and their parents to create Monkeying Around successive interactions. The overarching goal of this mixed-methods research effort is to generate evidence that supports the development of recommendations around the curricular, instructional, and contextual factors that support or impede children's acquisition of CT as a result of digital media viewing and hands-on engagement. Moving through cycles of implementation, observation, analysis, and revision over the course of three years, EDC/CCT researchers will work closely with families and WGBH's development team to determine how children learn the fundamentals of CT, how certain learning tasks can demonstrate what children understand, how to stimulate interest in hands-on activities, and the necessary scaffolds to support parental involvement in the development of children's CT. Each phase of the research will provide rich feedback to inform the next cycle of content development and will include: Phase 1: the formulation of three learning blueprints (for algorithmic thinking, sequencing, and patterns); Phase 2: the development of a cohesive set of learning tasks to provide evidence of student learning, as well as the production of a prototype of the digital media and parent/child engagement resources (algorithmic thinking); Phase 3-Part A: pilot research on the prototype, revisions, production of two additional prototypes (sequencing and patterns); Phase 3-Part B: pilot research on the three prototypes and revisions; and Phase 4: production of 27 animated and live-action videos and 18 parent/child engagement activities and a study of their impact. Through this process, the project team will build broader knowledge about how to design developmentally appropriate resources promoting CT for preschool children and will generate data on how to stimulate interest in hands-on activities and the necessary scaffolds to support parental involvement in the development of children's CT. The entire project represents an enormous opportunity for WGBH and for the informal STEM media field to learn more about how media can facilitate informal CT learning in the preschool years and ways to broaden participation by building parents' capacity to support STEM learning. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.