Researchers at Arizona State University (ASU), in partnership with the Smithsonian Museum on Main Street (MoMS), the Arizona Science Center, and eight tribal and rural museum sites around Arizona, will help educate and empower communities living in the Desert Southwest on water sustainability issues through the creation of WaterSIMmersion, a mixed reality (MR) educational game and accompanying museum exhibit.
DATE:
-
TEAM MEMBERS:
Claire LauerScotty CraigMina Johnson-GlenbergMichelle Hale
This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
This project will use a complex systems approach to hazard reduction across multiple scales of risk by developing a new generation of socio-technical digital twin that integrates models of physical infrastructure systems and virtual networks of communication with social games to engage community awareness and commitment to collective action.
DATE:
-
TEAM MEMBERS:
Kenichi SogaLouise ComfortStephen CollierMichael GollnerJ. Keith Gilless
Engineering is arguably one of the most critical skills in any society, from building bridges and homes, to designing cell phones and life-saving medical devices. Yet many Americans do not consider engineering to be essential or relevant to their everyday lives, and may even question its positive impact on society. While there have been gains in the number of women and underrepresented minorities in STEM professions over the past few decades, their numbers in the field remain disproportionately low. The Built World integrated multimedia and research project therefore aims to expand access to engineering content through the lens of “inclusive engineering,” which highlights how problem-solvers of all ages, genders, backgrounds, and perspectives approach and overcome challenges to innovate. The project applies this concept through the creation of Built World, a three-hour documentary series for broadcast on PBS stations nationwide, and a complementary interactive escape game streamed live on Twitch, where individuals of all ages and backgrounds can play and solve engineering challenges together. There is a need for effective remote and virtual interaction to support informal STEM learning, and live streaming game platforms present a promising approach to filling this need. Built World is poised to advance the field through: (1) content - creating high-quality inclusive engineering content across multiple platforms to reach a wide audience (Built World documentary, digital reporting and short form videos, community outreach campaign); (2) applied research - designing and studying how live-streaming, collaborative platforms can serve as safe and inclusive spaces for engineering learning; and (3) best practices - exploring how audiences engage with inclusive engineering on different platforms—a traditional documentary format (Built World) versus an interactive, collaborative space (Twitch game)—and identifying what learning outcomes might be expected on each.
A three-phase research design aims to understand what motivates users to engage with STEM content on Twitch; how to define and measure learning outcomes associated with the platform; and how to mitigate the risk of toxic environments in online communities by fostering safe spaces for a diversity of gamers. Phase 1 informs the initial design of the Twitch game and audience interaction strategies and seeks to answer: What is the best way to measure informal learning on Twitch? What is the best way to design a Twitch channel to create an inclusive space while optimizing learner engagement? Phase 2 is the core focus of the research and uses a semi-experimental design to answer questions such as: Is there evidence of learning on Twitch, and what type of learning is happening? What is the digital culture that emerges? Phase 3 assesses the pairing of the documentary series with the Twitch game to maximize informal STEM learning and is guided by questions such as: How does inclusive engineering content presented on two platforms (Twitch game and Built World series) mediate learning outcomes? How does inclusive engineering content presented on two platforms shape learners’ experiences of inclusivity and belonging? Knowledge generated through the Built World project will offer tools and best practices to other STEM media producers so that they may also leverage live streaming platforms for learning.
Access to STEM information is unequal, with rural and poor communities often receiving the fewest public education science and science literacy opportunities. Rural areas also face unique STEM teaching and technology integration challenges. In fact, LatinX communities in rural areas are less likely to have access to educational resources and language supports available to LatinX communities in urban centers. This project will help address these inequities by engaging rural librarians, bilingual science communicators, polar scientists, and a technical team to create a series of five bilingual virtual reality (VR) experiences to enhance STEM understanding and appreciation. Project researchers will create a new channel for disseminating polar science, working first with rural Latinx communities in Wisconsin to create a new network between rural communities and university researchers. Involving rural librarians in the co-design of instruction process will produce new ways for rural libraries to engage their local communities and their growing Latinx populations with polar science learning experiences. Each of the five VR experiences will focus on a different area of research, using the captivating Arctic and Antarctic environments as a central theme to convey science. VR is a particularly powerful and apt approach, making it possible to visit places that most cannot experience first-hand while also learning about the wide range of significant research taking place in polar regions. After design, prototyping and testing are finished, the VR experiences will be freely available for use nationally in both rural and urban settings. Public engagement with science creates a multitude of mutual benefits that result from a better-informed society. These benefits include greater trust and more reasoned scrutiny of science along with increased interest in STEM careers, many of which have higher earning potential. The project team will partner with 51 rural libraries which are valued community outlets valuable outlets to improve science literacy and public engagement with science. The effects of this project will be seen with thousands of community members who take part in the testing of prototype VR experiences during development and scaled engagement through ongoing library programs utilizing the final VR experiences for years to come.
This project will create new informal STEM learning assessment techniques through combining prior efforts in the areas of educational data mining for stealth assessment and viewpoint similarity metrics through monitoring gaze direction. Results of the project contribute to the field of educational data mining (EDM), focusing on adopting its methods for VR learning experiences. EDM is a process of using fine grained interaction data from a digital system to support educationally relevant conclusions and has been applied extensively to intelligent tutors and more recently, educational videogames. This project will continue building on existing approaches by expanding to include the unique affordances of VR learning media, specifically gaze. The project will focus on predicting user quitting as well as assessing key learning goals within each experience and triangulate these predictive models with user observations and post-experience surveys. The eventual application of this foundational research would address the problem in assessing a learner using measures external to the experience itself (i.e., surveys) and instead provide new methods that instrument learners using only data generated by their actions within the learning context. These techniques will provide a new means for evaluating informal learning in immersive technology settings without need for explicit tagging. The findings from this project will enable a greater understanding of the relationship between a user’s experience and their learning outcomes, which may prove integral in the creation of educational interventions using VR technology.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments. This project is also supported by the Office of Polar Programs.
While previous studies have found games and gaming to be a new and innovative communication strategy to inform the public and citizens about scientific research and engage them with it, this article addresses the under-researched question of credibility aspects in research-based gaming. The study analyses agricultural stakeholders' discussions on the credibility of scientific descriptions in The Maladaptation Game — a game based on research on climate change maladaptation in Nordic agriculture. The analysis of focus group transcripts and frame credibility finds that players attribute
‘Catan’® (1995) is a multiplayer tabletop game with global sales of over 20 million copies. Presented here is an exploration of the steps that were taken in the development of the ‘Catan: Global Warming’ expansion, from prototype to final design. During the playtesting of the game the feedback that we received from a variety of playtesters indicated that the game mechanics (rather than any accompanying story) were an effective and elegant way of developing dialogue around a specific topic, in this instance global warming. We conclude that in order to develop such a game, consideration must be
From a strategic communication perspective, for any communication to be effective, it must be audience-centered, with content and delivery channels that are relevant to its intended target. When trying to reach culturally specific communities or other groups that are not otherwise connected with science research, it is crucial to partner with community members to co-create content through media that is appealing and culturally competent. This commentary considers some examples including storytelling through ‘fotonovelas’ and radio stories, community drama and serious games.
This NOVA multiplatform media initiative consisted of a 2-hour nationally broadcast PBS documentary, Polar Extremes; a 10-part original digital series, Antarctic Extremes; an interactive game, Polar Lab; accompanying polar-themed digital shorts, radio stories, text reporting, and social media content; a collection of educational resources on PBS LearningMedia; and community screening events and virtual field trips for science classrooms. Across multiple media platforms the project’s video content had nearly 13 million views.
The research explored the potential for informal STEM learning
The goal of this project is to promote informal STEM education in polar research through a novel interactive learning display that uses virtual and augmented reality technology. A new display system will be developed that combines the successful techniques of touch-enabled tabletop displays with new low-cost, head-mounted display technology to deliver an immersive 3D learning experience for the IceCube Neutrino Detection system located at the South Pole. The system will provide new means for engaging the public in learning about the IceCube Neutrino Dectection system and the challenges of Antarctic research.
The proposal relies on collaboration between three groups on the University of Wisconsin- Madison campus, including the Living Environments Laboratory (LEL), the Wisconsin IceCube Particle Astrophysics Center (WIPAC), and the Games Learning Society (GLS). Once developed, the display system will be installed at the Wisconsin Institutes for Discovery Town Center, a public space that attracts close to 50,000 people per year. This proposal was submitted as an Exploratory Pathways proposal, meaning that it represents a chance to establish the basis for future research, design, and development of innovations or approaches. Outcomes from this project will inform the PIs of how best to extend the system to add more 3D environments for other research locations in Antarctica. The system will be implemented in an extensible fashion so that a user can select from one of several Antarctic research station locations, not just IceCube, from the main menu of the system and suddenly be immersed in a 3D world that seeks to teach users about polar research at that location. Contents of the interactive learning display will be translated into Spanish, and users will be able to choose which language they want to use. Evaluations of the system will also inform designers about how these museum-type systems impact learning outcomes for the general public.
This project was submitted to the Advancing Informal STEM Learning (AISL) program, but will be funded by the Division of Polar Programs. AISL seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.