This paper presents synthesized research on where XR is most effective within a museum setting and what impact XR might have on the visitor experience.
Over a three-year period, the Lawrence Hall of Science will conduct research on the conversations of groups and families encountering an Augmented Reality (AR) experience in a museum environment. The research program will identify which design elements best facilitate conversations among groups of visitors, and determine if these conversations are both rich in scientific content and gender-balanced. The project will focus on four specific activities: understanding the learning associated with current AR activities, implementing design-based research to develop visitor conversation supports, designing and developing new AR programs with embedded conversation supports, and conducting iterative hypothesis-based research on how learning conversations happen in AR learning environments. The museum community will gain insights on design principles for supporting collaborative learning using AR. Project staff will disseminate results via conference workshops for museum professionals on designing AR to enhance family learning, and through publication in professional journals.
In this study we explore two different faciitation styles, collaboration and competition, in an 1-hour long, highly interactive, digital experience called Future Energy Chicago. The aim of the faciliations is to affect guests' energy literacy, that is their knowledge of, and their attitude and behavior toward energy conservation. In the collaboration condition, guests were encouraged to talk as a whole room about what they had learned about energy during the latest round of play with the goal for the whole room to get as high a score as possible. In the competition condition, guests met only
Three-dimensional digital models are increasingly prevalent in preserving tangible and intangible aspects of Indigenous material heritage. Yet, there are no comprehensive, clearly laid-out best practices that can guide researchers, Indigenous communities, and museum personnel in designing ethically sound and socially engaged 3D heritage preservation projects. The use of 3D technologies for heritage preservation and providing public access to digital 3D collections is well-established in the European context. While there have been several robust efforts on digitizing European national heritage, in the U.S. context, the focus often involves work with Indigenous heritage, instantly placing 3D projects into a post-colonial research paradigm with a complex set of ethical ramifications. This research examines emerging thoughts from the European context and connects them with best practices in digital Indigenous data management to identify practices that contribute to cultures of academic integrity that are inclusive of all stakeholder voices. This work fosters ethical cultures of STEM through the development of a comprehensive Responsible Conduct of Research guiding document that can be adapted to address culture-specific Indigenous perspectives as well as project-specific challenges in future 3D heritage preservation endeavors.
Project goals are accomplished through workshops and virtual collaborations that bring together researchers, Indigenous community members, and heritage preservation professionals with previous experience in the responsible management, protection, and sharing of Indigenous digital data and the use of 3D technology for heritage preservation. The collaboratively produced guidelines outline ethical considerations that can be used in developing: 1) partnerships with origin/descendant communities, 2) institution- and collection-specific museum policies on using 3D technology, 3) Tribal policies for culturally appropriate use of 3D technologies, and 4) training material and curriculum that integrates with other research compliance regulations pertaining to heritage preservation. The project explores the questions that have emerged through previous experiences using 3D technologies to preserve Indigenous ancestral heritage. These questions include the factors contributing to developing ethically sound 3D heritage preservation projects; the practices useful in 3D projects to foster a culture of integrity that equally engages academic and Indigenous perspectives; consideration for what constitutes Responsible Conduct of Research in using 3D technologies to preserve Indigenous cultural heritage; and addressing practice-based questions that contribute to understanding ethical challenges in digitally preserving and presenting Indigenous heritage. The project situates 3D modeling and heritage representation as part of the larger discourse on decolonizing core methodologies in museum management and anthropological collection practices. Results from this work can be adapted to training future researchers and digital heritage management professionals and creating meaningful partnerships in heritage documentation. This research cultivates cultures of academic integrity by informing heritage management policy on the critical importance of heritage ethics for the creation and management of 3D digitization projects involving Indigenous collections. This award is funded by the Directorate of Geosciences and the Directorate of Education and Human Resources.
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
The Accessible Oceans study will design auditory displays that support learning and understanding of ocean data in informal learning environments like museums, science centers, and aquariums. Most data presentations in these spaces use visual display techniques such as graphs, charts, and computer-generated visualizations, resulting in inequitable access for learners with vision impairment or other print-related disabilities. While music, sound effects, and environmental sounds are sometimes used, these audio methods are inadequate for conveying quantitative information. The project will use sonification (turning data into sound) to convey meaningful aspects of ocean science data to increase access to ocean data and ocean literacy. The project will advance knowledge on the design of auditory displays for all learners, with and without disabilities, as well as advance the use of technology for STEM formal and informal education. The study will include 425 participants but will reach tens of thousands through the development of education materials, public reporting, and social media. The study will partner with the Smithsonian National Museum of Natural History, Woods Hole Oceanographic Institution Ocean Discovery Center, the Georgia Aquarium, the Eugene Science Center, the Atlanta Center for the Visually Impaired, and Perkins School for the Blind.
The project will leverage existing educational ocean datasets from the NSF-funded Ocean Observatories Initiative to produce and evaluate the feasibility of using integrated auditory displays to communicate tiered learning objectives of oceanographic principles. Integrated auditory displays will each be comprised of a data sonification and a context-setting audio introduction that will help to make sure all users start with the same basic information about the phenomenon. The displays will be developed through a user-centered design process that will engage ocean science experts, visually impaired students and adults (and their teachers), and design-oriented undergraduate and graduate students. The project will support advocacy skills for inclusive design and will provide valuable training opportunities for graduate and undergraduate students in human-centered design and accessibility. The project will have foundational utility in auditory display, STEM education, human-computer interaction, and other disciplines, contributing new strategies for representing quantitative information that can be applied across STEM disciplines that use similar visual data displays. The project will generate publicly accessible resources to advance studies of inclusive approaches on motivating learners with and without disabilities to learn more about and consider careers in STEM.
This Pilots and Feasibility Studies project is supported by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Access to STEM information is unequal, with rural and poor communities often receiving the fewest public education science and science literacy opportunities. Rural areas also face unique STEM teaching and technology integration challenges. In fact, LatinX communities in rural areas are less likely to have access to educational resources and language supports available to LatinX communities in urban centers. This project will help address these inequities by engaging rural librarians, bilingual science communicators, polar scientists, and a technical team to create a series of five bilingual virtual reality (VR) experiences to enhance STEM understanding and appreciation. Project researchers will create a new channel for disseminating polar science, working first with rural Latinx communities in Wisconsin to create a new network between rural communities and university researchers. Involving rural librarians in the co-design of instruction process will produce new ways for rural libraries to engage their local communities and their growing Latinx populations with polar science learning experiences. Each of the five VR experiences will focus on a different area of research, using the captivating Arctic and Antarctic environments as a central theme to convey science. VR is a particularly powerful and apt approach, making it possible to visit places that most cannot experience first-hand while also learning about the wide range of significant research taking place in polar regions. After design, prototyping and testing are finished, the VR experiences will be freely available for use nationally in both rural and urban settings. Public engagement with science creates a multitude of mutual benefits that result from a better-informed society. These benefits include greater trust and more reasoned scrutiny of science along with increased interest in STEM careers, many of which have higher earning potential. The project team will partner with 51 rural libraries which are valued community outlets valuable outlets to improve science literacy and public engagement with science. The effects of this project will be seen with thousands of community members who take part in the testing of prototype VR experiences during development and scaled engagement through ongoing library programs utilizing the final VR experiences for years to come.
This project will create new informal STEM learning assessment techniques through combining prior efforts in the areas of educational data mining for stealth assessment and viewpoint similarity metrics through monitoring gaze direction. Results of the project contribute to the field of educational data mining (EDM), focusing on adopting its methods for VR learning experiences. EDM is a process of using fine grained interaction data from a digital system to support educationally relevant conclusions and has been applied extensively to intelligent tutors and more recently, educational videogames. This project will continue building on existing approaches by expanding to include the unique affordances of VR learning media, specifically gaze. The project will focus on predicting user quitting as well as assessing key learning goals within each experience and triangulate these predictive models with user observations and post-experience surveys. The eventual application of this foundational research would address the problem in assessing a learner using measures external to the experience itself (i.e., surveys) and instead provide new methods that instrument learners using only data generated by their actions within the learning context. These techniques will provide a new means for evaluating informal learning in immersive technology settings without need for explicit tagging. The findings from this project will enable a greater understanding of the relationship between a user’s experience and their learning outcomes, which may prove integral in the creation of educational interventions using VR technology.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments. This project is also supported by the Office of Polar Programs.
Implementation of a permanent exhibition, on-line content, educational materials, and public programs exploring the history and cultural impact of video games.
Through the design, fabrication, and implementation of a 24,000-sq. ft. permanent, long-term gallery—tentatively entitled Digital Worlds—The Strong National Museum of Play will explore and share the history, influence, and experience of video games as they relate to culture, storytelling, human development, and the broader evolution of play. This gallery, the centerpiece of a transformational museum expansion, will include complementary and cohesive interactive exhibit spaces that showcase the history of video games through: (1) display of rare and unique historical artifacts; (2) use of multiple media formats that allow guests to discover the history of video games and their impact on society and culture; and (3) inclusion of one-of-a-kind interactive experiences that bring the history, art, and narrative structures of video games to life.
Sense-making with data through the process of visualization—recognizing and constructing meaning with these data—has been of interest to learning researchers for many years. Results of a variety of data visualization projects in museums and science centers suggest that visitors have a rudimentary understanding of and ability to interpret the data that appear in even simple data visualizations. This project supports the need for data visualization experiences to be appealing, accommodate short and long-term exploration, and address a range of visitors’ prior knowledge. Front-end evaluation
The goal of this project is to promote informal STEM education in polar research through a novel interactive learning display that uses virtual and augmented reality technology. A new display system will be developed that combines the successful techniques of touch-enabled tabletop displays with new low-cost, head-mounted display technology to deliver an immersive 3D learning experience for the IceCube Neutrino Detection system located at the South Pole. The system will provide new means for engaging the public in learning about the IceCube Neutrino Dectection system and the challenges of Antarctic research.
The proposal relies on collaboration between three groups on the University of Wisconsin- Madison campus, including the Living Environments Laboratory (LEL), the Wisconsin IceCube Particle Astrophysics Center (WIPAC), and the Games Learning Society (GLS). Once developed, the display system will be installed at the Wisconsin Institutes for Discovery Town Center, a public space that attracts close to 50,000 people per year. This proposal was submitted as an Exploratory Pathways proposal, meaning that it represents a chance to establish the basis for future research, design, and development of innovations or approaches. Outcomes from this project will inform the PIs of how best to extend the system to add more 3D environments for other research locations in Antarctica. The system will be implemented in an extensible fashion so that a user can select from one of several Antarctic research station locations, not just IceCube, from the main menu of the system and suddenly be immersed in a 3D world that seeks to teach users about polar research at that location. Contents of the interactive learning display will be translated into Spanish, and users will be able to choose which language they want to use. Evaluations of the system will also inform designers about how these museum-type systems impact learning outcomes for the general public.
This project was submitted to the Advancing Informal STEM Learning (AISL) program, but will be funded by the Division of Polar Programs. AISL seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Many concepts in astrophysics research can be difficult for a lay individual to understand or to comprehend their importance. One such example concept is the IceCube Neutrino Observatory, which detects high-energy neutrinos at the South Pole in Antarctica. The observatory uses information from detected neutrinos originating deep in outer space to better understand astrophysical phenomena like black holes or exploding stars. Unfortunately, it is often difficult for the public to understand how these pieces fit together towards creating a more complete understanding of our universe. To promote
The project will develop and research how an emerging technology, immersive virtual reality (IVR) using head mounted displays (HMDs), can enhance ocean literacy and generate empathy towards environmental issues. Recent advances in design have resulted in HMDs that provide viscerally realistic and immersive experiences that situate participants in underwater or other remote environments. IVR can provide many people with virtual access to these environments, including persons with disabilities, people living away from coastal areas, or those who lack access for other reasons (e.g., low-income families, underserved/underrepresented communities, persons untrained in diving). The project will develop a high quality 360-degree underwater film that includes live action footage, animation, and interactive elements. The IVR experience will take the participant through an immersive underwater journey of a Pacific reef, using realistic visualizations, narrative, and a compelling story to engage participants in learning the ecology and biology of coral reefs, as well as the impacts of climate change and human disturbances on ocean ecosystems. In addition to the IVR ocean journey, the project will integrate interactive functionality of being on a reef during mass coral spawning, an annual natural phenomenon through which coral reefs replenish their populations. With hand-held controllers, participants will be able to "swim" through the water, watch the degraded reef recover and grow and will have the ability to change the rate of coral recovery and learn how increases in temperature impede coral recovery. While research has been conducted on early, desk-top versions of IVR, the potential impact of IVR on learning is still unclear. The research findings will help guide the development of IVR for use in informal STEM environments such as aquariums, zoos, science museums, and others. The IVR experience will be shared on online platforms for home viewing, at film festivals and conferences, and in informal learning environments.
The project addresses the need for research on the impacts of IVR devices as it become more affordable and more widely used at home and in other informal and formal environments. Few studies have investigated how design elements impact the user in IVR, in which the increased immersion affects the stimuli perception and cognitive processing. The research will assess the learning affordances and impacts of the IVR experience on participant ocean literacy (adapting items from an existing ocean literacy survey), environmental empathy/feelings of presence (naturalistic observations and post-experience interviews), and perceived self-efficacy (pre-post survey, post-interview interviews). In addition, the project will research how segmentation (i.e., a continuous experience vs. an experience with breaks), generative learning tasks (hands-on experiences and interactive during IVR), and gender of the narrator in an IVR experience supports learning about ocean environments. Researchers will collect data from students attending high schools with predominantly minority student enrollments. Research findings will be widely shared through peer-reviewed publications, conference presentations, and publications for educators and designers.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.