In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
Education Development Center (EDC) conducted the external evaluation of this second phase of NASA@ My Library. Library staff from partner libraries increased their confidence and ability to facilitate library programming related to Earth, space, and engineering.
This annual report presents an overview of Saint Louis Science Center audience data gathered through a variety of evaluation studies conducted during 2018. This report includes information on the Science Center's general public audience demographics and visitation patterns, gives an overview of visitors' comments about their Science Center experience, summarizes major trends observed in the Science Center's tool for tracking educational programs, and presents highlights from three exhibit evaluations: front-end evaluation for GameXPloration, formative evaluation for augmentations to the
The STAR Library Network Phase 2 (STAR Net) brings inquiry-based STEM learning experiences to public libraries through six traveling exhibits, training for library staff and associated programming for library patrons, and a virtual community of practice for library staff and others interested in bringing STEM programming to libraries. In 2014, the National Science Foundation (NSF) awarded a four-year grant to the Space Science Institute’s (SSI) National Center for Interactive Learning (NCIL) and its partners—the American Library Association (ALA), the Lunar and Planetary Institute (LPI), the
DATE:
TEAM MEMBERS:
Ginger FitzhughSarah ArmstrongSheila RodriguezVicky Coulon
resourceevaluationProfessional Development, Conferences, and Networks
The STAR Library Network Phase 2 (STAR Net) brings inquiry-based STEM learning experiences to public libraries through six traveling exhibits, training for library staff and associated programming for library patrons, and a virtual community of practice for library staff and others interested in bringing STEM programming to libraries. In 2014, the National Science Foundation (NSF) awarded a four-year grant to the Space Science Institute’s (SSI) National Center for Interactive Learning (NCIL) and its partners—the American Library Association (ALA), the Lunar and Planetary Institute (LPI), the
DATE:
TEAM MEMBERS:
Ginger FitzhughSarah ArmstrongSheila RodriguezVicky Coulon
The Exploratorium’s livestream of the August 2017 Total Solar Eclipse reached over 63 million people. Live programs in English and Spanish provided an informal learning experience outside the museum. Over 2.75 million people viewed on-demand videos on eclipse science. Sixty major media providers rebroadcast the livestream telescope feed.
Edu, Inc. conducted a summative evaluation of the NASA-funded project. The study reveals that the Exploratorium successfully disseminated eclipse science and STEM content through media channels and a mobile app, delivering a museum experience to online
In March of 2016, a total solar eclipse occurred in the southwestern pacific; and in August of 2017, a total solar eclipse occurred across a broad swath of the United States. The Exploratorium launched a 2.5 year public education program—Navigating the Path of Totality—that used these two total solar eclipses as platforms for sparking public engagement and learning about the Sun, heliophysics, and the STEM content related to both. These sequential eclipses provided an unprecedented opportunity to build and scaffold public engagement and education. Our strategy was to start the public engagement process with the 2016 eclipse, nurture that engagement with resources, activities and outreach during the 17 months between the eclipses, so that audiences (especially in the U.S., where totality was visible in multiple areas across the country) would be excited, actively interested, and prepared for deeper engagement during the 2017 eclipse. For the August 2017 eclipse, the Exploratorium produced live telescope and program feeds from Madras, OR and Casper, WY. The Exploratorium worked with NASA to leverage what was a once-in-a-lifetime experience for millions to bring heliophysics information and research to students, educators, and the public at large through a variety of learning experiences and platforms.
The core of this project was live broadcasts/webcasts of each eclipse. To accomplish these objectives, the Exploratorium produced and disseminate live feeds of telescope-only images (no commentary) of each eclipse originating them from remote locations; produce and disseminate from the field live hosted broadcasts/webcasts of each eclipse using these telescope images; design and launch websites, apps, videos, educator resources, and shareable online materials for each eclipse; design and deliver eclipse themed video installations for our Webcast studio and Observatory gallery in the months that lead up to each eclipse and a public program during each eclipse; and conduct a formative and summative evaluation of the project.
These broadcasts/webcasts and pre-produced videos provide the backbone upon which complementary educational resources and activities can be built and delivered. Programs and videos were produced in English and Spanish languages. As a freely available resource, the broadcasts/webcasts also provide the baseline content for hundreds if not thousands of educational efforts provided by other science-rich institutions, schools, community-based organizations, and venues. Platforms such as NASA TV and NASA website, broadcast and online media outlets such as ABC, NBC, CBS, CNN, MSNBC and PBS, as well as hundreds of science institutions and thousands of classrooms streamed the Exploratorium eclipse broadcasts as part of their own educational programming, reaching 63M people. These live broadcasts were relied upon educational infrastructure during total solar eclipses for institutions and individuals on the path and off the path alike.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This project will advance knowledge in the design of interest triggers for science in immersive digital simulation learning games. When learners are interested in a topic, it can have a profound impact on the quality of their learning. Although much is known about how informal learning experiences can promote interest in STEM, much less research has addressed links between technology use and interest development. This Exploratory Pathways project will investigate (1) the impact of entertainment technology use by middle school learners on STEM interest development, (2) the design of interactive educational technologies created specifically to trigger interest in astronomy, and (3) informal learning resources for sustained interaction with STEM content over time. In particular, learners will have the opportunity to interactively explore the scientific consequences of considering alternative versions of Earth via "What if?" questions, such as "What if the earth had no moon?" or "What if the earth were twice its current size?". While using the simulations, learners will be invited to make observations and propose scientific explanations for what they see as different. Given recent discoveries of potentially habitable worlds throughout the Galaxy, such questions have high relevance to public discourse around space exploration, conditions necessary for life, and the long-term future of the human race. Studies will occur across three informal learning settings: museum exhibits, afterschool programs, and summer camps, and are driven by the following research questions: What technology-based triggers of interest have the strongest influence on interest? Which contextual factors are most important for supporting long-term interest development? And, what kinds of technology-based triggers are most effective for learners from audiences who are underrepresented in STEM? This research will result in an empirically tested approach for cultivating interest that will allow educators to leverage the "What if?" pedagogy in their own work, as well as downloadable materials suitable for use in both informal and formal learning settings.
Planned studies will identify features that are effective in triggering interest, with an emphasis on groups underrepresented in STEM, and elaborate on the importance of engaging learners in explanatory dialogues and in service of interest development. It is hypothesized that interacting in such novel ways can act as a trigger for interest in astronomy, physics, and potentially other areas of STEM. Design iterations will also investigate different forms of learning supports, such as guidance from facilitators, collaboration, and automated guidance available within the simulations, and identify how features vary with respect to learning contexts. Data collected will include interview and survey data to track interest development, measures of knowledge in astronomy and physics, and log files of simulation use to better understand how behaviors in the simulations align with stated interests. Results of the studies will advance the theoretical understanding of interest development and its relationship to interactive experiences, and will also have practical implications for the deployment of technology in informal settings by identifying features critical for triggering the interest of middle school learners. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
H Chad LaneJorge Perez-GallegoNeil Comins
How do afterschool programs view their local public libraries? Are they working with them, and in what ways? These are the questions that the Afterschool Alliance, along with its partners at the Space Science Institute’s National Center for Interactive Learning (NCIL) and the American Library Association, wanted to answer. Overall, our goal is to build bridges between the afterschool and library fields, so that both can share knowledge and resources to better serve our youth. While our work together has primarily focused on science, technology, engineering, and math (STEM) education through
National Air and Space Museum, Washington DC
Summative Evaluation for Educational Program, 2016
The National Air and Space Museum (NASM) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a summative evaluation of Science in Pre-K, an onsite and online teacher professional development program that NASM developed for the District of Columbia Public Charter Schools’ (DCPS). The program supports preschool teachers in teaching science through exploration and problem solving. This evaluation is a continuation of a planning and evaluation project initiated in 2013. In 2013, RK&A
Summary
Girlstart’s mission is to increase girls’ interest and engagement in STEM through innovative, nationally-recognized informal STEM education programs. Girlstart examines in this report how STEM education directed toward elementary school girls influences long-term readiness and participation to math and science learning. This report compares Girlstart After School participants’ academic performance to nonparticipant performance. Specifically, it examines how Girlstart After School influences science STAAR performance and course enrollment in subsequent elementary and early middle
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. The third season of the national PBS series, SciGirls, is the first national children’s television series and website designed to engage and educate millions of children about citizen science. In each half-hour episode, a female mentor guides a group of ethnically diverse middle school girls as they learn about citizen science protocols and collect and share data for an established citizen science project. In addition to the videos, the SciGirls website presents