In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This report is the summative evaluation of Moon Adventure Game. The Moon Adventure Game is a challenge-based immersive game, inspired by “escape room” experiences, which asks visitors to take on activities to help them think about what people might need to live and work on the Moon.
This guide compiles lessons learned by seven Portal to the Public Network (PoPNet) sites as well as remaining challenges and recommendations for organizations planning similar efforts in the future. PoPNet sites used the Portal to the Public Guiding Framework to build relationships with local scientists, prepare them for public engagement using Portal to the Public training materials, and feature them at public programs.
Face-to-face conversations between scientists and public audiences in an informal learning environment provide a valuable opportunity to support public engagement with scientific research. These types of experiences have significant benefits for members of the public and for scientists. For public audiences, interacting face-to-face with a scientist can expand awareness of the range of careers in science, spark new questions about scientific topics, and increase interest in learning more about the scientist’s topic (Tisdal, 2011; Ong, 2014). Scientists, too, are positively impacted by this
As part of the public impacts evaluation work conducted for the Explore Science: Earth & Space activity toolkits developed and created through the NASA-funded Space and Earth Informal STEM education (SEISE) project, this summative evaluation study of the toolkits was designed to address and answer questions regarding the number and range of audiences reached by the project, visitor engagement, relevance, science identity, and their understanding around NASA’s Science Mission Directorate (SMD) content areas (astrophysics, planetary science, heliophysics, Earth science). The results are based on
In the From Project Mercury to Planet Mars project, the Museum of Science is partnering with national leaders to create two resources, each geared to a different style of learner, that strengthen engineering education and immersive experiences in the nation’s informal education environment. The Museum of Science is collaborating with the Smithsonian National Air and Space Museum and Albert Einstein Planetarium in Washington D.C., the Clark Planetarium in Salt Lake City, Utah, the Adventure Science Center and Sudekum Planetarium in Nashville, Tennessee, and the Tech Museum of Innovation in San Jose, California. Through the development of a Planetarium show engaging audiences in the excitement of a human journey to Mars, and a large-scale engineering design challenge activity that allows participants to create design solutions to a Mars exploration challenge, the goal of From Project Mercury to Planet Mars is to increase student and public awareness of human space exploration and inspire the next generation of engineers and scientists. Planetarium show viewers are expected to demonstrate an increased appreciation and interest in future activities in engineering and science, and learn about the technical challenges of space exploration. Design challenge participants are expected to actively engage in the engineering design process and in engineering habits of mind.
The Museum of Science, Boston led the From Project Mercury to Planet Mars: Introducing Engineering and Inspiring Youth through Humanity’s Greatest Adventure project (FPMPM) as a way to produce and share high-quality informal engineering education opportunities about the topic of human space travel to Mars. The grant involved the creation of two products that address human space travel to Mars: an immersive full-dome planetarium show and a hands-on engineering design challenge. To evaluate the grant work, the Research & Evaluation Department at the Museum of Science, Boston conducted a
DATE:
TEAM MEMBERS:
Annette SawyerKatie ToddLeigh Ann MesitiAlex LussenhopKeith Allison
Exploration Place, with funding from the National Aeronautics and Space Administration (NASA), contracted RK&A to conduct a summative evaluation of Design Build Fly, an exhibition and program series that explores what happens behind-the-scenes in Wichita’s aircraft plants. The goals of the study were to identify how visitors use the exhibition, explore what meaning visitors make from Design Build Fly, and understand to what extent visitors’ meaning-making aligns with intended outcomes.
How did we approach this study? RK&A conducted timing and tracking observations of visitors to the
The Space and Earth Informal STEM Education (SEISE) project, led by the Arizona State University with partners Science Museum of Minnesota, Museum of Science, Boston, and the University of California Berkeley’s Lawrence Hall of Science and Space Sciences Laboratory, is raising the capacity of museums and informal science educators to engage the public in Heliophysics, Earth Science, Planetary Science, and Astrophysics, and their social dimensions through the National Informal STEM Education Network (NISE Net). SEISE will also partner on a network-to-network basis with other existing coalitions and professional associations dedicated to informal and lifelong STEM learning, including the Afterschool Alliance, National Girls Collaborative Project, NASA Museum Alliance, STAR_Net, and members of the Association of Children’s Museums and Association of Science-Technology Centers. The goals for this project include engaging multiple and diverse public audiences in STEM, improving the knowledge and skills of informal educators, and encouraging local partnerships.
In collaboration with the NASA Science Mission Directorate (SMD), SEISE is leveraging NASA subject matter experts (SMEs), SMD assets and data, and existing educational products and online portals to create compelling learning experiences that will be widely use to share the story, science, and adventure of NASA’s scientific explorations of planet Earth, our solar system, and the universe beyond. Collaborative goals include enabling STEM education, improving U.S. scientific literacy, advancing national educational goals, and leveraging science activities through partnerships. Efforts will focus on providing opportunities for learners explore and build skills in the core science and engineering content, skills, and processes related to Earth and space sciences. SEISE is creating hands-on activity toolkits (250-350 toolkits per year over four years), small footprint exhibitions (50 identical copies), and professional development opportunities (including online workshops).
Evaluation for the project will include front-end and formative data to inform the development of products and help with project decision gates, as well as summative data that will allow stakeholders to understand the project’s reach and outcomes.
This poster, which was presented at the Association of Science and Technology Centers Annual Conference on October 22, 2017, compares and contrasts evaluation findings across components of the Beyond Spaceship Earth project at The Children's Museum of Indianapolis. The project focuses on educating families and students about life and work aboard the International Space Station and generating interest in STEM topics and careers. Project components reviewed include an exhibit, a space object theater, and workshop-style programs focused on engineering and robotics for both families and school
In March of 2016, the Exploratorium transmitted a live webcast of a total solar eclipse from Woleai, a remote island in the southwestern Pacific. The webcast reached over 1 million viewers. Evaluation reveals effective use of digital media to engage learners in solar science and related STEM content.
Edu, Inc. conducted an external evaluation study that shows clear and consistent evidence of broad distribution of STEM content through multiple online channels, social media, pre-produced videos, and an app for mobile devices. IBM Watson did a deep analysis of tweets on eclipse topics that
The Exploratorium’s livestream of the August 2017 Total Solar Eclipse reached over 63 million people. Live programs in English and Spanish provided an informal learning experience outside the museum. Over 2.75 million people viewed on-demand videos on eclipse science. Sixty major media providers rebroadcast the livestream telescope feed.
Edu, Inc. conducted a summative evaluation of the NASA-funded project. The study reveals that the Exploratorium successfully disseminated eclipse science and STEM content through media channels and a mobile app, delivering a museum experience to online