Virtual Reality (VR) shows promise to broaden participation in STEM by engaging learners in authentic but otherwise inaccessible learning experiences. The immersion in authentic learner environments, along with social presence and learner agency, that is enabled by VR helps form memorable learning experiences. VR is emerging as a promising tool for children with autism. While there is wide variation in the way people with autism present, one common set of needs associated with autism that can be addressed with VR is sensory processing. This project will research and model how VR can be used to minimize barriers for learners with autism, while also incorporating complementary universal designs for learning (UDL) principles to promote broad participation in STEM learning. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will build on a prototype VR simulation, Mission to Europa Prime, that transports learners to a space station for exploration on Jupiter's moon Europa, a strong candidate for future discovery of extraterrestrial life and a location no human can currently experience in person. The prototype simulation will be expanded to create a full, immersive STEM-based experience that will enable learners who often encounter cognitive, social, and emotional barriers to STEM learning in public spaces, particularly learners with autism, to fully engage and benefit from this STEM-learning experience. The simulation will include a variety of STEM-learning puzzles, addressing science, mathematics, engineering, and computational thinking through authentic and interesting problem-solving tasks. The project team's learning designers and researchers will co-design puzzles and user interfaces with students at a post-secondary institute for learners with autism and other learning differences. The full VR STEM-learning simulation will be broadly disseminated to museums and other informal education programs, and distributed to other communities.
Project research is designed to advance knowledge about VR-based informal STEM learning and the affordances of VR to support learners with autism. To broaden STEM participation for all, the project brings together research at the intersection of STEM learning, cognitive and educational neuroscience, and the human-technology frontier. The simulation will be designed to provide agency for learners to adjust a STEM-learning VR experience for their unique sensory processing, attention, and social anxiety needs. The project will use a participatory design process will ensure the VR experience is designed to reduce barriers that currently exclude learners with autism and related conditions from many informal learning opportunities, broadening participation in informal STEM learning. Design research, usability, and efficacy studies will be conducted with teens and adults at the Pacific Science Center and Boston Museum of Science, which serve audiences with autism, along with the general public. Project research is grounded in prior NSF-funded research and leverages the team's expertise in STEM learning simulations, VR development, cognitive psychology, universal design, and informal science education, as well as the vital expertise of the end-user target audience, learners with autism. In addition to being shared at conferences, the research findings will be submitted for publication to peer-reviewed journals for researchers and to appropriate publications for VR developers and disseminators, museum programs, neurodiverse communities and other potentially interested parties.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Teon EdwardsJodi Asbell-ClarkeJamie LarsenIbrahim Dahlstrom-Hakki
Sense-making with data through the process of visualization—recognizing and constructing meaning with these data—has been of interest to learning researchers for many years. Results of a variety of data visualization projects in museums and science centers suggest that visitors have a rudimentary understanding of and ability to interpret the data that appear in even simple data visualizations. This project supports the need for data visualization experiences to be appealing, accommodate short and long-term exploration, and address a range of visitors’ prior knowledge. Front-end evaluation
As the world is increasingly dependent upon computing and computational processes associated with data analysis, it is essential to gain a better understanding of the visualization technologies that are used to make meaning of massive scientific data. It is also essential that the infrastructure, the very means by which technologies are developed for improving the public's engagement in science itself, be better understood. Thus, this AISL Innovations in Development project will address the critical need for the public to learn how to interpret and understand highly complex and visualized scientific data. The project will design, develop and study a new technology platform, xMacroscope, as a learning tool that will allow visitors at the Science Museum of Minnesota and the Center of Science and Industry, to create, view, understand, and interact with different data sets using diverse visualization types. The xMacroscope will support rapid research prototyping of public experiences at selected exhibits, such as collecting data on a runner's speed and height and the visualized representation of such data. The xMacroscope will provide research opportunities for exhibit designers, education researchers, and learning scientists to study diverse audiences at science centers in order to understand how learning about data through the xMacroscope tool may inform definitions of data literacy. The research will advance the state of the art in visualization technology, which will have broad implications for teaching and learning of scientific data in both informal and formal learning environments. The project will lead to better understanding by science centers on how to present data to the public more effectively through visualizations that are based upon massive amounts of data. Technology results and research findings will be disseminated broadly through professional publications and presentations at science, education, and technology conferences. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project is driven by the assumption that in the digital information age, being able to create and interpret data visualizations is an important literacy for the public. The research will seek to define, measure, and advance data visualization literacy. The project will engage the public in using the xMacrocope at the Science Museum of Minnesota and at the Center of Science and Industry's (COSI) science museum and research center in Columbus, Ohio. In both museum settings the public will interact with different datasets and diverse types of visualizations. Using the xMacroscope platform, personal attributes and capabilities will be measured and personalized data visualizations will be constructed. Existing theories of learning (constructivist and constructionist) will be extended to capture the learning and use of data visualization literacy. In addition, the project team will conduct a meta-review related to different types of literacy and will produce a definition with performance measures to assess data visualization literacy - currently broadly defined in the project as the ability to read, understand, and create data visualizations. The research has potential for significant impact in the field of science and technology education and education research on visual learning. It will further our understanding of the nature of data visualization literacy learning and define opportunities for visualizing data in ways that are both personally and culturally meaningful. The project expects to advance the understanding of the role of personalization in the learning process using iterative design-based research methodologies to advance both theory and practice in informal learning settings. An iterative design process will be applied for addressing the research questions by correlating visualizations to individual actions and contributions, exploring meaning-making studies of visualization construction, and testing the xMacroscope under various conditions of crowdedness and busyness in a museum context. The evaluation plan is based upon a logic model and the evaluation will iteratively inform the direction, process, and productivity of the project.
Purpose: An estimated 5 to 8% of elementary school students have some form of memory or cognitive deficit that inhibits learning basic math. Researchers have identified several areas where children with math learning difficulties struggle. These include a strong sense of number facts to quickly and accurately perform operations on single digit numbers, the use of strategies to solve problems which have not yet been memorized, a sense to figure out whether or not an answer is reasonable, and self-monitoring to assess one's own efficacy and understanding. To support students with math learning difficulties in grades 1 to 4, this project team will develop a series of apps for touch-screen tablets that encourage single digit operational fluency, conceptual understanding, strategy awareness, and self-understanding.
Project Activities: During Phase I project in 2012, the research team developed a prototype of the single digit addition game, following an iterative process incorporating feedback from teachers and students having difficulty with math. Nineteen students participated in a pilot study, and the researchers found that the prototype functioned well and that users were engaged by the game. In Phase II, the team will build and refine the back end system, design and develop the teacher website, and create content for games in subtraction, multiplication, and division. Researchers will carry out a pilot test of the usability and feasibility, fidelity of implementation, and promise of the game to improve learning. Students in first to fourth grade identified by teachers as having the greatest difficulty with math will participate in the pilot study. Half of the 120 students participating in the pilot study will be randomly selected to play the game as a supplement to classroom learning whereas the other half will not have access. Students in the control group will be provided the games at the end of the study. Analyses will compare pre- and post-test math scores.
Product: The web-based game, MathFacts, will include a series of apps for touch-screen tablet computers to support math learning for 1st to 4th grade students with major or sometimes intractable learning difficulties. In the game, students will learn content through mini-lessons, engage with problems in practice and speed rounds, and then receive formative feedback on their performance. Students will use and manipulate blocks, linker tubes, number lines, and interact with engaging pedagogical agents such as parrots and sloths. Students will set goals, advance to more challenging levels, and engage in competition. The game will be self-paced and will provide individualized formative assessment scaffolding when students do not know the answer to a question. A teacher management system will support professional development and will produce reports to guide instruction. The intended outcomes from gameplay will include increased fluency, conceptual understanding, strategy awareness, self-assessment, and motivation of basic math.
Purpose: There is concern about a decline in mathematics achievement scores among U.S. students during the middle school years. For example, while 4th grade U.S. students rank 8th overall on an international mathematics comparison, by 10th grade U.S. student's drop significantly to 25th in the same comparison. Some researchers posit that much of this decline relates to how math is taught in the U.S. and with how students become less engaged as learners in middle school. The purpose of this project is to develop a web-based game to engage 7h grade students in a narrative-based story which will apply learning of content and skills aligned to the Common Core State Standards (CCSS) in mathematics.
Project Activities: During Phase I in 2012, the team developed a functioning prototype and conducted usability and feasibility research with fourteen 7th grade students. Researchers found that the prototype functioned as intended and that students were highly engaged while playing the game. In Phase II, the team will develop a fully-functional user interface with animated characters, interactivity across student users, narrative scripts and accompanying art assets, 36 problem sets, and student and teacher dashboards and databases. After development is complete, a pilot study will examine the usability and feasibility, fidelity of implementation, and the promise of the game to improve math learning. The study will include 120 students in 6 classrooms in three schools, with one classroom per school randomly assigned to use the game and the other half assigned to a business-as-usual control. Analyses will compare student scores on pre and post mathematics measures.
Product: Empires is a web-based game that addresses 36 pre-algebra Common Core State Standards in mathematics for 7th and 8th grades. The game follows a storyline in a recreation of an ancient empire which is at the brink of agricultural revolution and of becoming a trade economy. As students play the game, they engage in math-focused activities to drive the action, such as taxing citizens to learn ratios and proportions, allocating resources to learn percentages, and measuring the distance and time between a neighboring empire by applying the principles of the Pythagorean Theorem. As a socially networked game, students will interact with other students in the class to complete trades that lead to encounters with different math problems. The game will include two helpful, funny, advisors who will scaffold learning through mathematical discourse, arguing over the next most important thing to do. The game design architecture will work on a wide range of computers, including desktops and iPads. A teacher's guide and companion website will provide guidance to classroom activities that complement the game.
This project team is developing and testing a prototype of the Teachley Analytics Library, a platform intended to host third party-developed mathematics game apps for students in kindergarten through Grade 8. The prototype will include a dashboard to host games and generate formative assessment data to inform teacher instruction. In the Phase I pilot study, the team will examine whether the prototype functions as planned with 40 Grade 1 and 2 math teachers. The study will test if teachers are able to implement games within the classroom and utilize data to inform practice, and whether students are engaged by gameplay.
This project team will develop and test a prototype of LifeSim, intended to be a financial literacy game app for high school students to strengthen mathematical skills and practical life knowledge. In the game, high school students will manage hypothetical investment funds and be challenged to understand compounded interest and debt. The app will include materials for math teachers to integrate the game within instructional practice. At the end of Phase I in a pilot study with 50 students, the researchers will examine whether the prototype functions as planned and if students are engaged during gameplay.
In prior research and development, the team developed the Mathalicious intervention for middle and high school students to improve mathematical thinking. Each Mathalicious lesson revolves around applying a real world example to learn math (e.g., Is college worth the cost). In this project, the team will develop and test a prototype of an adaptive platform through which students will need to demonstrate mastery prior to being able to advance to more complicated procedural, conceptual, and analytical levels. In the Phase I pilot research with three Grade 8 classrooms, the team will examine whether the prototype functions as planned, if teachers are able to implement it with students, and whether students are engaged.
In prior research and development, the team developed WuzzitTrouble, an iPhone and iPad gaming app where players solve problems using number sense mathematical strategies. This project will develop and test a prototype of an adaptive engine for this game, intended to tailor gameplay to the skill levels of individual students and to provide support (or scaffold learning) for students with weaker skills. The Phase I pilot will involve six Grade 6 classrooms and 100 students. The study will examine whether the prototype functions as planned, and if students of different skill levels are engaged and able to play the game with the support of the prototype’s adaptive engine.
Purpose: Purpose: This project team will fully develop and test Teachley Connect, a platform that syncs a variety of third-party math games to give elementary schools formative assessment data and intervention support. Mobile math games provide opportunities for students to access educationally-meaningful content in and out of the classroom and to supplement instruction. There are a number of examples of math apps that show promise for supporting and assessing student learning in different areas of mathematics, yet few apps in the marketplace provide meaningful data that teachers can use. Many games provide an overall score at the end of the session, but do not help teachers know what skills students are struggling with or how to provide additional support.
Project Activities: During Phase I, (completed in 2015), the team developed a prototype of Teachley Connect, which enables the secure transfer of game and learning data between third-party math games and the Teachley servers. At the end of Phase I, researchers completed a pilot study with 20 students and two teachers and demonstrated that the prototype operated as intended with important trends indicating that the system promotes student engagement and less time spent seeking help. In Phase II, the team will add additional third party math apps to the platform, strengthen the backend management system to tag user game-play data, and build out the teacher reporting dashboard to inform instruction and identify apps to address particular student and class needs. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the Teachley Connect for teachers to use formative assessment data to inform classroom practice, select apps to address individual student needs, and support student math learning. The study will include 12 (grade K to 3) classrooms and randomly assign them into one of three groups: 1) apps only, 2) Teachley-enabled apps, or 3) Teachley-enabled apps + data. Researchers will compare pre-and-post scores of student's math learning, classroom observations, and teacher surveys/interviews.
Product: Teachley Connect will be a mobile tablet-based platform that uses games to give elementary schools rich formative assessment data and intervention support. Teachley Connect will permit students to continue playing exactly where they left off on any tablet. The platform will also connect apps into a single teacher dashboard, providing teachers detailed reports on student performance across games, with insights for informing individual or whole group instruction. The platform will include teacher resources to support the alignment of game play with learning goals and to support implementation.
Purpose: The team will fully develop and test three puzzle-based math games that adaptively assess and support student learning in middle school classrooms. A principle objective of middle school math is to prepare students for more complicated and advanced STEM topics, providing the foundation for a wide variety of college majors and careers. Students who struggle in math in grade 5 and 6 are more likely to show deficits as coursework turns to topics in algebra. However, in many classrooms, commonly used progress monitoring instruments often do not adjust in ease or difficulty based on student performance, and do not provide data teachers can use to tailor instruction to meet the needs of students.
Project Activities: During Phase I (completed in 2015), the team developed a prototype of an adaptive engine for Wuzzit Trouble, a previously developed app where players rotate a virtual wheel to solve puzzles by applying number sense mathematical strategies. The engine tailors gameplay to the skill level of individual students in real time, providing tips and support to students having difficultly or by making challenges more difficult for those who master puzzles. The research team conducted a pilot study at the end of Phase I in order to test the prototype. A little more than 200 grade 5 and 6 students and six teachers participated over two weeks. Researchers found that the prototype functioned as intended and that teachers successfully used the game before, during, and after class as a supplement to instruction. They learned that 65% of students enjoyed using the prototype and 46% indicated that the game adjusted to the right level of difficulty during gameplay. In Phase II, the team will develop two new games on topics including algebraic thinking and problem solving, will strengthen and validate the adaptive engine, and will build out the dashboard to report formative and summative assessment results. After development is complete, the researchers will carry out a larger pilot study to assess the usability and feasibility, fidelity of implementation, and promise of the three games to improve student learning over a 9-week period. Thirty-two grade 5 and 6 math classrooms from 16 schools will participate. One classroom from each school will be randomly assigned to use the games and half will continue with business-as-usual procedures. The researchers will compare pre-and-post scores for student learning on standardized measures of pre-algebra topics. They will also track teacher implementation.
Product: The final product will include a suite of three app-based puzzle games aligned to national math standards for number sense, algebraic thinking, and problem solving. The games will be designed for use in grade 5 and 6 classrooms where students develop and apply content expertise to solving challenges. The games will include an adaptive engine that assesses and adjusts content based on student level of performance, a back-end system to organize data, and a reporting dashboard to present measures of student performance, persistence, and creativity. The project team will also develop teacher resources for suggesting how to incorporate games and activities into classroom instructional practice to reinforce lesson plans and learning.