In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
In recent years, transmedia has come into the spotlight among those creating and using media and technology for children. We believe that transmedia has the potential to be a valuable tool for expanded learning that addresses some of the challenges facing children growing up in the digital age. Produced by the USC Annenberg Innovation Lab and the Joan Ganz Cooney Center, this paper provides a much-needed guidebook to transmedia in the lives of children age 5-11 and its applications to storytelling, play, and learning. Building off of a review of the existing popular and scholarly literature
DATE:
TEAM MEMBERS:
Becky Herr-StephensonMeryl AlperErin Reilly
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
The Accessible Oceans study will design auditory displays that support learning and understanding of ocean data in informal learning environments like museums, science centers, and aquariums. Most data presentations in these spaces use visual display techniques such as graphs, charts, and computer-generated visualizations, resulting in inequitable access for learners with vision impairment or other print-related disabilities. While music, sound effects, and environmental sounds are sometimes used, these audio methods are inadequate for conveying quantitative information. The project will use sonification (turning data into sound) to convey meaningful aspects of ocean science data to increase access to ocean data and ocean literacy. The project will advance knowledge on the design of auditory displays for all learners, with and without disabilities, as well as advance the use of technology for STEM formal and informal education. The study will include 425 participants but will reach tens of thousands through the development of education materials, public reporting, and social media. The study will partner with the Smithsonian National Museum of Natural History, Woods Hole Oceanographic Institution Ocean Discovery Center, the Georgia Aquarium, the Eugene Science Center, the Atlanta Center for the Visually Impaired, and Perkins School for the Blind.
The project will leverage existing educational ocean datasets from the NSF-funded Ocean Observatories Initiative to produce and evaluate the feasibility of using integrated auditory displays to communicate tiered learning objectives of oceanographic principles. Integrated auditory displays will each be comprised of a data sonification and a context-setting audio introduction that will help to make sure all users start with the same basic information about the phenomenon. The displays will be developed through a user-centered design process that will engage ocean science experts, visually impaired students and adults (and their teachers), and design-oriented undergraduate and graduate students. The project will support advocacy skills for inclusive design and will provide valuable training opportunities for graduate and undergraduate students in human-centered design and accessibility. The project will have foundational utility in auditory display, STEM education, human-computer interaction, and other disciplines, contributing new strategies for representing quantitative information that can be applied across STEM disciplines that use similar visual data displays. The project will generate publicly accessible resources to advance studies of inclusive approaches on motivating learners with and without disabilities to learn more about and consider careers in STEM.
This Pilots and Feasibility Studies project is supported by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Virtual Reality (VR) shows promise to broaden participation in STEM by engaging learners in authentic but otherwise inaccessible learning experiences. The immersion in authentic learner environments, along with social presence and learner agency, that is enabled by VR helps form memorable learning experiences. VR is emerging as a promising tool for children with autism. While there is wide variation in the way people with autism present, one common set of needs associated with autism that can be addressed with VR is sensory processing. This project will research and model how VR can be used to minimize barriers for learners with autism, while also incorporating complementary universal designs for learning (UDL) principles to promote broad participation in STEM learning. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will build on a prototype VR simulation, Mission to Europa Prime, that transports learners to a space station for exploration on Jupiter's moon Europa, a strong candidate for future discovery of extraterrestrial life and a location no human can currently experience in person. The prototype simulation will be expanded to create a full, immersive STEM-based experience that will enable learners who often encounter cognitive, social, and emotional barriers to STEM learning in public spaces, particularly learners with autism, to fully engage and benefit from this STEM-learning experience. The simulation will include a variety of STEM-learning puzzles, addressing science, mathematics, engineering, and computational thinking through authentic and interesting problem-solving tasks. The project team's learning designers and researchers will co-design puzzles and user interfaces with students at a post-secondary institute for learners with autism and other learning differences. The full VR STEM-learning simulation will be broadly disseminated to museums and other informal education programs, and distributed to other communities.
Project research is designed to advance knowledge about VR-based informal STEM learning and the affordances of VR to support learners with autism. To broaden STEM participation for all, the project brings together research at the intersection of STEM learning, cognitive and educational neuroscience, and the human-technology frontier. The simulation will be designed to provide agency for learners to adjust a STEM-learning VR experience for their unique sensory processing, attention, and social anxiety needs. The project will use a participatory design process will ensure the VR experience is designed to reduce barriers that currently exclude learners with autism and related conditions from many informal learning opportunities, broadening participation in informal STEM learning. Design research, usability, and efficacy studies will be conducted with teens and adults at the Pacific Science Center and Boston Museum of Science, which serve audiences with autism, along with the general public. Project research is grounded in prior NSF-funded research and leverages the team's expertise in STEM learning simulations, VR development, cognitive psychology, universal design, and informal science education, as well as the vital expertise of the end-user target audience, learners with autism. In addition to being shared at conferences, the research findings will be submitted for publication to peer-reviewed journals for researchers and to appropriate publications for VR developers and disseminators, museum programs, neurodiverse communities and other potentially interested parties.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Teon EdwardsJodi Asbell-ClarkeJamie LarsenIbrahim Dahlstrom-Hakki
Science Hunters is an outreach project which employs the computer game Minecraft to engage children with scientific learning and research through school visits, events, and extracurricular clubs. We principally target children who may experience barriers to accessing Higher Education, including low socioeconomic status, being the first in their family to attend university, and disability (including Special Educational Needs). The Minecraft platform encourages teamwork and makes science learning accessible and entertaining for children, irrespective of background. We employ a flexible approach
DATE:
TEAM MEMBERS:
Laura HobbsCarly StevensJackie HartleyCalum Hartley
The videogames industry has been flourishing. In 2010 in America alone, total consumer spending on the games industry totaled $25.1 billion (Siwek, 2010), surpassing both the music industry ($15.0 billion) and box office movies ($10.5 billion). It is also one of the fastest growing industries in the U.S. economy. From 2005 to 2010, for example, the videogames industry more than doubled while the entire U.S. GDP grew by about 16 percent. The amount of time young people spend with entertainment media in general is staggering. Youth aged 8 to 18 years old consume about 10.45 hours per day of
The concept of connected learning proposes that youth leverage individual interest and social media to drive learning with an academic focus. To illustrate, we present in-depth case studies of Ryan and Sam, two middle-school-age youth, to document an out-of-school intervention intended to direct toward intentional learning in STEM that taps interest and motivation. The investigation focused on how Ryan and Sam interacted with the designed elements of Studio STEM and whether they became more engaged to gain deeper learning about science concepts related to energy sustainability. The
EMERGE in STEM (Education for Minorities to Effectively Raise Graduation and Employment in STEM) is a NSF INCLUDES Design and Development Launch Pilot. This project addresses the broadening participation challenge of increasing participation of women, the at-risk minority population, and the deaf in the STEM workforce. The project incorporates in and out-of-school career awareness activities for grades 4-12 in a high poverty community in Guilford County, North Carolina. EMERGE in STEM brings together a constellation of existing community partners from all three sectors (public, private, government) to leverage and expand mutually reinforcing STEM career awareness and workforce development activities in new ways by using a collective impact approach.
This project builds on a local network to infuse career exposure elements into the existing mutually reinforcing STEM activities and interventions in the community. A STEM education and career exposure software, Learning Blade, will be used to reach approximately 15,000 students. A shared measurement system and assessment process will contribute to the evaluation of the effectiveness of the collective impact strategies, the implementation of mutually reinforcing activities across the partnership and the extent to which project efforts attract students to consider STEM careers.
DATE:
-
TEAM MEMBERS:
Gregory MontyMargaret KanipesMalcolm SchugSteven Jiang
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This project will advance knowledge in the design of interest triggers for science in immersive digital simulation learning games. When learners are interested in a topic, it can have a profound impact on the quality of their learning. Although much is known about how informal learning experiences can promote interest in STEM, much less research has addressed links between technology use and interest development. This Exploratory Pathways project will investigate (1) the impact of entertainment technology use by middle school learners on STEM interest development, (2) the design of interactive educational technologies created specifically to trigger interest in astronomy, and (3) informal learning resources for sustained interaction with STEM content over time. In particular, learners will have the opportunity to interactively explore the scientific consequences of considering alternative versions of Earth via "What if?" questions, such as "What if the earth had no moon?" or "What if the earth were twice its current size?". While using the simulations, learners will be invited to make observations and propose scientific explanations for what they see as different. Given recent discoveries of potentially habitable worlds throughout the Galaxy, such questions have high relevance to public discourse around space exploration, conditions necessary for life, and the long-term future of the human race. Studies will occur across three informal learning settings: museum exhibits, afterschool programs, and summer camps, and are driven by the following research questions: What technology-based triggers of interest have the strongest influence on interest? Which contextual factors are most important for supporting long-term interest development? And, what kinds of technology-based triggers are most effective for learners from audiences who are underrepresented in STEM? This research will result in an empirically tested approach for cultivating interest that will allow educators to leverage the "What if?" pedagogy in their own work, as well as downloadable materials suitable for use in both informal and formal learning settings.
Planned studies will identify features that are effective in triggering interest, with an emphasis on groups underrepresented in STEM, and elaborate on the importance of engaging learners in explanatory dialogues and in service of interest development. It is hypothesized that interacting in such novel ways can act as a trigger for interest in astronomy, physics, and potentially other areas of STEM. Design iterations will also investigate different forms of learning supports, such as guidance from facilitators, collaboration, and automated guidance available within the simulations, and identify how features vary with respect to learning contexts. Data collected will include interview and survey data to track interest development, measures of knowledge in astronomy and physics, and log files of simulation use to better understand how behaviors in the simulations align with stated interests. Results of the studies will advance the theoretical understanding of interest development and its relationship to interactive experiences, and will also have practical implications for the deployment of technology in informal settings by identifying features critical for triggering the interest of middle school learners. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
H Chad LaneJorge Perez-GallegoNeil Comins
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
Education stakeholders from advocates to developers are increasingly recognizing the potential of science games in advancing student academic motivation for and interest in science and science careers. To maximize this potential, the project will use science games (e.g. Land Science, River City, and EcoMUVE), shown to be enjoyable to students and proven to promote student learning in science at the middle school level. Through a two-phase process, games will be used as vehicles for learning about ways to change how students think about science and potentially STEM careers. The goal of the intervention is to explore which processes and design features of science games will actually help students move beyond a temporary identity of being a scientist or engineer (as portrayed while playing the game) to one where students began to see themselves in real STEM careers. Students' participation will be guided by teams of teachers, faculty members, and graduate students from Drexel University and a local school. All science students attending the local inner city middle school in Philadelphia, PA, will participate in the intervention.
Using an exploratory mixed-method design, the first two years of the project will focus on exploring, characterizing, coding, and analyzing data sets from three large games designed to help students think about possible careers in science. During year 3, the project will integrate lessons learned from the first two years into the existing middle school science curriculum to engage students in a one-year intervention using PCaRD (Play Curricular activity Reflection Discussion). During the intervention, the PI will work with experts from Drexel University and a local school to collect data on the design features of Land Science to capture identity change in the science identity of the participating students. Throughout the course of year 3, the PI will observe, video, interview, survey, and use written tasks to uncover if the Land Science game is influencing students' identity in any way (from a temporary to a long-term perspective about being a scientist or engineer). Data collected during three specified waves during the intervention will be compared to analyses of existing logged data through collaborations with researchers at Harvard University and the University of Wisconsin-Madison. These comparisons will focus on similar middle-aged science students who used the same gaming environments as the students involved in this study. However, the researcher will intentionally look for characteristics related to motivation, science knowledge, and science identity change.
This project will integrate research and education to investigate learning as a process of change in student science identity within situated environmental contexts of digital science gameplay around curricular and learning activities. This integrated approach will allow the researcher to explore how gaming is inextricably linked to the student as an individual while involved in the learning of domain specific content in science. The collaboration among major university and school partners; the expertise of the researcher in educational psychology, educational technology, and science games; and the project's advisory board makes this a real-life opportunity for the researcher to use information that naturally exists in games to advance knowledge in the field about the value of gaming to changing students' science identities. It also responds to reports by the National Research Council committee on science learning and computer games, which identifies games as having the potential to catalyze new approaches to science learning.