This document summarizes lessons learned from implementing Leap into Science: Cultivating a National Network for Informal Science and Literacy (Leap into Science) from 2017-2023.
In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
RK&A conducted prototype testing for the Game Changers exhibition with three audiences: adults, female youth 10-17 years old, and male youth 13-14 years old. The Game Changers exhibition is being developed by the Lemelson Center for the Study of Invention and Innovation at the National Museum of American History.
The Vertically Integrated Science Learning Opportunity (VISLO) program builds upon an existing three-way partnership between (i) faculty, graduate students, and undergraduate students form the University Nebraska-Lincoln (UNL), (ii) the 21st Century Community Learning Centers (CLC) in Lincoln, NE, and (iii) The University of Nebraska State Museum.
VISLO uniquely incorporates vertically-integrated peer instruction across educational levels, including: graduate, undergraduate, middle school, and elementary school. Throughout the program, participants of all identified educational levels had
The Farrell Fellows Summer Internship program consists of teen educators leading science, technology, engineering and math (STEM) activities for children at libraries and park locations across Chicago. The goal of this study was to learn more about the families who attend the sessions and to also look for evidence of learning and how that may be related to the moods and attitudes of the teen educators. Data was collected through observations of the sessions, pre- and post-session surveys of 26 teen educators, and 90 surveys of the parents of participating children. Field notes were coded using
This document is the final summative evaluation report written by EDC, the external evaluator of the STEM Guides project. The report concludes that the project was highly ambitious, with many dynamic and evolving pieces. It was deemed successful as a model of brokering connections between students aged 10-18 and STEM resources and opportunities in rural Maine communities. The STEM Guides program contributed to the increase in STEM awareness within each community, as well as connecting youth with interesting and relevant STEM experiences.
Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
Seeking to use narrative as a vehicle for getting more young people interested in STEM, the National Science Foundation supported a WETA/PBS NewsHour initiative to adapt their Student Reporting Labs (SRL) curriculum to feature a focus on STEM content in 2015. NewsHour selected Knology to run a four-year evaluation of the project from 2015 to 2019. Building on earlier research about student-led science journalism (e.g. Polman & Hope, 2014; Nicholas, 2017), this project suggests that having students develop and produce narratives about complex STEM topics may make these topics far less
The independent evaluation firm, Knight Williams, Inc., developed a two-part post-program survey to gather information about the Year 1 SciGirls CONNECT2 outreach programs conducted by 14 partner organizations. The evaluation aimed for one educator from each organization to complete Part 1 of the survey, which consisted of program reporting questions. In all, one educator from 13 partner organizations completed Part 1, for a response rate of 93%. Part 2 of the survey asked for program reflections, with a focus on perceived program goals, impacts, highlights, and challenges. Given the
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluation firm Knight Williams, Inc. administered an online survey to educators from 16 SciGirls CONNECT2 partner organizations to gather information about their anticipated use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was familiar with the original SciGirls Seven strategies – to complete the survey about the draft updated strategies after they were shared by TPT in March 2018 via an online webinar and a