In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This report is the summative evaluation of Moon Adventure Game. The Moon Adventure Game is a challenge-based immersive game, inspired by “escape room” experiences, which asks visitors to take on activities to help them think about what people might need to live and work on the Moon.
This project includes the development of a toolkit of new hands-on facilitated museum activities, and a mobile app with both app-based activities and do-it-yourself (DIY) activities. This evaluation report focuses on the formative evaluation of three app activities that are being added to the DIY app series.
The Exploratorium’s livestream of the August 2017 Total Solar Eclipse reached over 63 million people. Live programs in English and Spanish provided an informal learning experience outside the museum. Over 2.75 million people viewed on-demand videos on eclipse science. Sixty major media providers rebroadcast the livestream telescope feed.
Edu, Inc. conducted a summative evaluation of the NASA-funded project. The study reveals that the Exploratorium successfully disseminated eclipse science and STEM content through media channels and a mobile app, delivering a museum experience to online
In March of 2016, a total solar eclipse occurred in the southwestern pacific; and in August of 2017, a total solar eclipse occurred across a broad swath of the United States. The Exploratorium launched a 2.5 year public education program—Navigating the Path of Totality—that used these two total solar eclipses as platforms for sparking public engagement and learning about the Sun, heliophysics, and the STEM content related to both. These sequential eclipses provided an unprecedented opportunity to build and scaffold public engagement and education. Our strategy was to start the public engagement process with the 2016 eclipse, nurture that engagement with resources, activities and outreach during the 17 months between the eclipses, so that audiences (especially in the U.S., where totality was visible in multiple areas across the country) would be excited, actively interested, and prepared for deeper engagement during the 2017 eclipse. For the August 2017 eclipse, the Exploratorium produced live telescope and program feeds from Madras, OR and Casper, WY. The Exploratorium worked with NASA to leverage what was a once-in-a-lifetime experience for millions to bring heliophysics information and research to students, educators, and the public at large through a variety of learning experiences and platforms.
The core of this project was live broadcasts/webcasts of each eclipse. To accomplish these objectives, the Exploratorium produced and disseminate live feeds of telescope-only images (no commentary) of each eclipse originating them from remote locations; produce and disseminate from the field live hosted broadcasts/webcasts of each eclipse using these telescope images; design and launch websites, apps, videos, educator resources, and shareable online materials for each eclipse; design and deliver eclipse themed video installations for our Webcast studio and Observatory gallery in the months that lead up to each eclipse and a public program during each eclipse; and conduct a formative and summative evaluation of the project.
These broadcasts/webcasts and pre-produced videos provide the backbone upon which complementary educational resources and activities can be built and delivered. Programs and videos were produced in English and Spanish languages. As a freely available resource, the broadcasts/webcasts also provide the baseline content for hundreds if not thousands of educational efforts provided by other science-rich institutions, schools, community-based organizations, and venues. Platforms such as NASA TV and NASA website, broadcast and online media outlets such as ABC, NBC, CBS, CNN, MSNBC and PBS, as well as hundreds of science institutions and thousands of classrooms streamed the Exploratorium eclipse broadcasts as part of their own educational programming, reaching 63M people. These live broadcasts were relied upon educational infrastructure during total solar eclipses for institutions and individuals on the path and off the path alike.
Great Lakes Science Center (GLSC), home of the NASA Glenn Visitor Center, is dedicated to sharing NASA content to inform, engage, and inspire students, educators, and the public. To further this goal, GLSC will develop a digital experience focused on collaboration and teamwork, emphasizing the benefits of a systems approach to STEM challenges. At the recently, fully renovated NASA Glenn Visitor Center, GLSC visitors will embark on an exciting mission of discovery, working in teams to collect real data from NASA objects and experiences. Mobile devices will become scientific tools as students, teachers, and families take measurements, access interviews with NASA scientists, analyze results from Glenn Research Center (GRC) test facilities, and link to NASA resources to assemble mission-critical information. This initiative will provide experiences that demonstrate how knowledge and practice can be intertwined, a concept at the core of the Next Generation Science Standards. GLSC’s digital missions will engage students and families in STEM topics through the excitement of space exploration. In addition, this project has the potential to inform the design of future networked visitor experiences in science centers, museums and other visitor attractions.
WGBH received funding to develop and create NOVA Labs, an online environment that provides teen audiences with an online research lab, educational content, and the opportunity to engage with authentic data, tools, and processes to investigate scientific questions. This work has begun with the development of a first pilot lab, called The Sun Lab. NOVA Education created and launched this lab in early summer 2012. Examining the site in its pilot form, the Lifelong Learning Group (LLG) engaged in a formative evaluation to support refinements and improvements in the design of subsequent NOVA Lab
NOVA Labs (www.pbs.org/nova/labs) is a web-based platform designed for use by educators, students, and teens to engage learners with authentic data, processes, and tools of working scientists. The present evaluation study sought to investigate the outcomes achieved by users of the third NOVA Labs platform developed: Cloud Lab. The intended outcomes identified for student users were that they would: • Be able to successfully work with the real data provided in the Cloud Lab; • Demonstrate ability to interpret and use scientific data and tools; • Engage with real scientific data through the
Youth EXPO: Youth Exploring the Potential of Virtual Worlds was a proof-of-concept study to determine if an immersive, 3D virtual environment is an effective medium to increase high school students’ understanding of current climate change research and motivate interest in learning more about climatology-related careers. The project was conducted by the Miami Science Museum in partnership with Goddard Institute of Space Sciences and Goddard Space Flight Center, and implemented with high school students in Miami. The overall goal of the project was to develop a prototype cyber resource to promote awareness of climate change and careers in climatology, in support of NASA’s role in helping youth understand how Earth’s global climate system is changing. YouthEXPO explored the extent to which 3D virtual learning experiences can increase high school students’ conceptual understanding of complex scientific issues related to climate change. This was accomplished through the development of a series of virtual exhibits, YouthEXPO Island, and pilot testing of the exhibition with high school students as part of a broader climate change curriculum. Youth EXPO Island is a series of simulations in an immersive, 3D virtual world environment designed to increase high school students’ understanding of current climate change research and motivate interest in learning more about climatology-related careers. Modules include EarthLab, IceLab, VolcanoLab and SpaceLab, four environmental simulations where avatars can analyze the relationship between global temperature change and a variety of climate factors, learn about remote sensing and field sampling techniques, and explore related careers.
Virtual Missions and Exoplanets (vMAX) will develop and test a three-dimensional, virtual world environment that will engage middle school students and educators from high-poverty schools in NASA-related exoplanet mission simulations. The Patricia and Phillip Frost Museum of Science will serve as the lead institution, in partnership with the following institutions: U.S. Space and Rocket Center, New York Hall of Science, Chabot Space & Science Center, and Sci-Port: Louisiana¹s Science Center; Aimee Weber Studios will be responsible for virtual exhibit fabrication, and WestEd will serve as the project¹s formative and summative evaluator. The overall goal of the project is to create a NASA resource on exoplanet astronomy that will engage students, educators, and the general public in NASA¹s search for worlds beyond our own. The project aims to increase underserved students¹ engagement in STEM, knowledge of exoplanet missions, and awareness of NASA-related careers; and advance the growing body of knowledge on the use of virtual world technologies to provide opportunities for students to participate in NASA Mission-related science teaching and learning. The project will result in the development of vMAX world, a virtual world with simulations related to exoplanet astronomy designed for use as the core content of a 30-hour out-of-school learning experience for middle school students. An Educator Implementation Guide will be developed and made available online for download by secondary school teachers and science museum educators. In addition, an interactive, multiuser exhibit kiosk, utilizing the simulations created for vMAX world, will be developed and made available to interested Visitor Centers, museums and planetariums.
Mission to Mars engages 6th-8th grade students in the science, engineering and careers related to Mars exploration. The program is led by the Museum of Science and Industry, Chicago, and includes as partners Challenger Learning Centers in Woodstock, IL, Normal IL and three NASA Centers (Jet Propulsion Laboratory, Marshall Space Flight Center, and Johnson Space Center). The project aims to:
Link, via videoconference, urban and rural middle school students from low income communities in an exploration of space science
Develop and launch programs that showcase NASA Center research
Enrich middle school curricula and promote learning about NASA’s space missions with experiences that inspire youth to pursue in NASA-related STEM careers.
Programs and products produced include:
3 videoconference program scenarios that highlight research being conducted at NASA Centers
Pre- and post-event curriculum materials designed for middle school classrooms
Teacher professional development workshops
Communication support for NASA professionals
iPad apps utilized during the program
Since the program launched five years ago, Mission to Mars has served 7,676 students. MSI seeks to provide opportunities for all learners, and works to remove barriers to participation in high-quality science learning experiences. Mission to Mars allows MSI to engage more Chicago Public Schools (where 86% of students are economically disadvantaged) in real and relevant science experiences that may lead to STEM careers.
As MSI’s CP4SMP grant comes to an end, the Museum has committed to continued delivery of the program through 2 Mission to Mars Learning Labs, offered to 6-8th grade school groups visiting on field trips. Live videoconferencing with JPL and Johnson will occur during roughly half of the sessions. Our Challenger Learning Center partners will integrate Mission to Mars activities, materials and iPad apps into their own Mars-themed programs. Together these efforts extend the transformative hands-on science experiences developed under the Mission to Mars grant to a whole new audience of middle school students and teachers.
Mission: Moonbase is an interactive lunar colony simulation designed to inspire and educate participants of all ages. Prominently situated in the largest children’s science center at the Museum of Science & Industry (MOSI), Mission: Moonbase engages the general public as an exhibition. It also serves as an immersive, team-based experience for thousands of students in area school districts, Girl Scouts, Boy Scouts, etc. Through the use of high-tech gaming technologies in a facilitated, immersive environment, participants are challenged to operate lunar colony while learning and applying STEM (Science, Technology, Engineering, and Mathematics) knowledge and skills. Mission: Moonbase will continue to serve as an inspirational catalyst for students and families on the importance of STEM, NASA’s missions and career opportunities, and the value of space exploration in a fun, exciting way. Mission: Moonbase serves as an educational setting and dynamic experience for students and families with the support of educators and scientists with an eye on promoting a better future.