In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This handout was prepared for the Climate Change Showcase at the 2019 ASTC Conference in Toronto, Ontario. It highlights resources available on InformalScience.org related to the topic of climate change.
Water is an essential, basic need. It is the sustenance for living organisms. For many Native American communities, like the Ojibwe tribes of Minnesota, water is a sacred valuable life source that permeates all aspects of their culture. In these communities, water stories are often used to communicate the value and impact of water on their lives and the lives of others. These stories signal geohydrologic, sociocultural, and sociopolitical societal shifts over time. This pilot study will explore the feasibility of using Native water stories and informal learning experiences to bring water science and issues of water sustainability to youth and public audiences. A significant outcome of the pilot will be a youth-museum-educator co-created public planetarium show and program based on the water stories collected and archived. This approach is particularly novel. It provides an entry into STEM through a dynamic, multimedia context that typically does not engage youth as co-creators of the experiences. Water Values will give voice and a public platform to youth and their communities to elevate ecological issues that are relevant and timely within their own communities. It will also promote scientific discourse through field experiences, interactions with scientists and STEM professions, and community leadership development. Further, this pilot will also test a reciprocal relationship model among its partners. Analogous feasibility research to the Water Values pilot does not exist in the current NSF portfolio. Therefore, the project will not only contribute to the emerging literature base on the intersectionality of STEM, storytelling and Native cultures, but it will also contribute to broader discourse about water health, access, management, and sustainability.
The pilot study will bring together the long standing gidakiimanaaniwigamig program, with its master teachers who are experts in culturally responsive education for Native American youth, and the Bell Museum, which has decades of experience in developing informal STEM learning programs for a broad community. Thirty-five middle school aged youth, five educators, and over 200 community members will engage in the work. During the summer residential program, youth will be exposed to STEM content and important water science concepts through field-based research and a culturally relevant, placed-based curriculum focused on water and communicating water stories. These experiences will be extended during the academic year through weekend science activities that will focus on the compilation of water stories from Native communities, especially from the Ojibwe tribes of Minnesota, and creatively integrating the stories into a fully operational youth-museum co-created public planetarium program. This capstone planetarium show and program will be piloted at the Bell Museum. With regards to the research, four overarching question will guide the study: (1) How does participation in creating water journey stories increase Native students' motivation to learn and engage with STEM, (2) How does participation in creating and presenting water journey stories build change in sociopolitical awareness among Native students? (3) How do Native community members engage with water stories for sociopolitical change and greater participation in STEM? and (4) How does collaboration between gidakiimanaaniwigamig, the Bell, and the UMN impact STEM interest and participation in students and a Native community for transformative experience? Data will be collected from the youth participants, instructors and leaders, and community members. These data will be collected from content surveys, student logs, self-reported intrinsic motivation instrument, observations, and artifacts. The results will be disseminated through various mechanisms within and beyond the target communities. Formative and summative evaluations will inform that work and will be led by an external evaluation firm, Erikkson Associates.
This feasibility study is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Bhaskar UpadhyayDiana DalbottenJonee Brigham
RK&A conducted a summative evaluation of five climate change and resiliency programs at the Science Museum of Virginia (SMV). The summative evaluation was the culmination of a three-year grant from the National Oceanic and Atmospheric Administration (NOAA)—front-end and formative evaluations were completed in the two years prior. The goal of this evaluation was to test the extent to which the programs achieved the intended visitor outcomes defined in SMV’s Impact Framework.
How did we approach this study?
The summative evaluation focused on five programs—the Digital Dome theater’s
In the From Project Mercury to Planet Mars project, the Museum of Science is partnering with national leaders to create two resources, each geared to a different style of learner, that strengthen engineering education and immersive experiences in the nation’s informal education environment. The Museum of Science is collaborating with the Smithsonian National Air and Space Museum and Albert Einstein Planetarium in Washington D.C., the Clark Planetarium in Salt Lake City, Utah, the Adventure Science Center and Sudekum Planetarium in Nashville, Tennessee, and the Tech Museum of Innovation in San Jose, California. Through the development of a Planetarium show engaging audiences in the excitement of a human journey to Mars, and a large-scale engineering design challenge activity that allows participants to create design solutions to a Mars exploration challenge, the goal of From Project Mercury to Planet Mars is to increase student and public awareness of human space exploration and inspire the next generation of engineers and scientists. Planetarium show viewers are expected to demonstrate an increased appreciation and interest in future activities in engineering and science, and learn about the technical challenges of space exploration. Design challenge participants are expected to actively engage in the engineering design process and in engineering habits of mind.
The Museum of Science, Boston led the From Project Mercury to Planet Mars: Introducing Engineering and Inspiring Youth through Humanity’s Greatest Adventure project (FPMPM) as a way to produce and share high-quality informal engineering education opportunities about the topic of human space travel to Mars. The grant involved the creation of two products that address human space travel to Mars: an immersive full-dome planetarium show and a hands-on engineering design challenge. To evaluate the grant work, the Research & Evaluation Department at the Museum of Science, Boston conducted a
DATE:
TEAM MEMBERS:
Annette SawyerKatie ToddLeigh Ann MesitiAlex LussenhopKeith Allison
resourceresearchPlanetarium and Science on a Sphere
This poster, which was presented at the Association of Science and Technology Centers Annual Conference on October 22, 2017, compares and contrasts evaluation findings across components of the Beyond Spaceship Earth project at The Children's Museum of Indianapolis. The project focuses on educating families and students about life and work aboard the International Space Station and generating interest in STEM topics and careers. Project components reviewed include an exhibit, a space object theater, and workshop-style programs focused on engineering and robotics for both families and school
The Tech Museum of Innovation (The Tech) in San Jose, California proposes to partner with NOAA to integrate Science On a Sphere (SOS) into The Tech's Exploration gallery and to facilitate the development of informal and formal learning programs. Exhibits and programs at The Tech focus on the integration of emerging technologies into hands-on visitor experiences. In 2004, The Tech partnered with NOAA, the Maryland Science Center (MSC), and a consortium of national science centers to explore the potential and effectiveness of SOS as a method of engaging and informing the general public about NOAA-related sciences. Initial testing of SOS at the Maryland Science Center revealed that SOS is a visually compelling and engaging medium for conveying complex scientific information to museum visitors. Ninety-eight percent of visitors tested regarded a facilitated SOS program as a good or excellent experience with strong visitor retention suggesting the potential of SOS as a compelling visitor tool. However, when the experience was not facilitated this retention dropped dramatically. Support from NOAA will enable The Tech to test SOS and NOAA data in a number of formats to determine the most effective ways to utilize this incredible technology. The results of this evaluation will be shared with other museums using SOS to improve its reach in teaching informal audiences and promoting interest in both STEM content and NOAA research. The SOS exhibit will bring together scientists, technologists, informal education specialists, and young users to unlock the educational potential of NOAA's datasets and further NOAA's educational plan. Hands-on experiences using SOS will engage visitors in meaningful explorations of NOAA data. The Tech Museum will make SOS accessible to people of all ages, backgrounds, and educational levels. All panel text, audio, and captions will be presented in both English and Spanish to allow greater accessibility for local audiences. SOS will provide the programming platform upon which to explore the educational opportunities of this gallery as it illustrates how data collected with remote sensing technologies is helping us understand and make predictions about our dynamic environment and the future of our planet. SOS will illustrate how these data collecting technologies assist us in developing our knowledge about our planet and its solar system.
Using the relative strengths of each museum, the Science On a Sphere Partnership between the Maryland Science Center and the Science Museum of Minnesota has developed two complementary exhibit approaches to Science On a Sphere (SOS). Audiences interacting with SOS are able to observe global connections in geophysical phenomena not possible with any two dimensional representation of the Earth. The goal of the project is for museum visitors, particularly underserved audiences, to comprehend how human activities are influencing global processes now and might do so in the future. The project also tests new partnership models for working with NOAA and other science research organizations to broaden the educational impact on all groups.
The University of California, Berkeley's Lawrence Hall of Science (LHS), in partnership with the Bishop Museum in Honolulu, HI, propose to develop and evaluate curriculum-based content modules for spherical display systems. These modules will combine successful research-driven curriculum materials with the compelling nature of a spherical display to engage and inform museum visitors in the process of observing and interpreting patterns of global climate data.
The Nurture Nature Center (NNC) in Easton, PA, a joint project of the multi-state Nurture Nature Foundation and NNC, Inc., will install a Science on a Sphere and develop a new SOS module about climate and flooding. Working with the Maryland Science Center in Baltimore, the Da Vinci Science Center in Allentown, PA, and science advisers from NOAA and research universities, NNC will use existing SOS datasets, as well as new data formats, to create a docent-guided program that explains the connections between climate patterns and flooding. The Flood Forums: Education to Action program will engage audiences in deliberative forum programming to promote public understanding of the atmospheric, oceanic, and other climatic factors affecting flooding in some regional communities. Project deliverables include a program on climate change and flooding for SOS users; the same program calibrated for Magic Planet users; Forum models on issues related to climate change and flooding; project and evaluation reports; and training materials for SOS network members and other informal educators.
The American Museum of Natural History, in association with several NOAA entities, will be creating a suite of media products employing visualization of Earth-observation data as well as associated professional development programs to expand educational experiences in informal science institutions nationwide. Interactive versions of the visualizations will also be disseminated via the AMNH website. Visualization assets will be distributed to NOAA for utilization on climate.gov and Science on a Sphere. The creation of training programs and educational materials for informal education professionals will enhance the experience and efficacy of the data visualizations as tools to understand and build stewardship of Earth systems.