This document is the final summative evaluation report written by EDC, the external evaluator of the STEM Guides project. The report concludes that the project was highly ambitious, with many dynamic and evolving pieces. It was deemed successful as a model of brokering connections between students aged 10-18 and STEM resources and opportunities in rural Maine communities. The STEM Guides program contributed to the increase in STEM awareness within each community, as well as connecting youth with interesting and relevant STEM experiences.
This long-term follow-up study utilized mixed method design to elicit information from the previous alumni cohorts over the past ten years. Extensive qualitative analysis supports quantitative findings across five intended program outcomes (content; science identity, science communication, 21st century skills and positive youth development; and networking. It also documents additional non-specifically targeted outcomes (e.g., parenting and community involvement); influence of specific program components; and visions for future alumni programming. Qualitative data derive from two sources -
Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
Intellectual Merit: Project RESET utilized a responsive teaching approach to engage youth in critical STEM literacy on the topic of climate change. Video recordings of the afterschool program, artifacts from the program, and interviews with youth were analyzed to better understand how youth supported each other’s participation in science discourse. The team outlined four themes of critical STEM literacy (CSL) and identified a “constellation” of knowledge, dispositions, and practices within each of those themes. Finally, Project RESET demonstrated the potential benefits of multi-modal analysis
With funding from a Smithsonian Institution Youth Access Grant the National Museum of Natural History offered a program pipeline that would engage underserved Washington D.C. students in programming designed to encourage academic and career STEM interest. Beginning with collaboration with community educators, the pipeline funneled students into a Teen Night Out Science Night to interest them in science workshop series offered after school and on weekend and ultimately into volunteer and internship opportunities. This report provides detailed view of methods, analyses, results, and conclusions
The Collaboration for Ongoing Visitor Experience Studies (COVES) aims to help science centers gather and share data to better understand visitors’ experiences. For the summative evaluation of COVES, the Museum of Science’s Research and Evaluation Department studied the program’s impacts on participating museums and museum professionals. Specifically, this evaluation was designed to:
Examine participants’ overall satisfaction with the collaboration and their likelihood to recommend it to others;
Understand the impact that COVES is having on Participating Institutions;
Assess whether
Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. In the fall of 2014, Techbridge Girls began offering after-school programming at five elementary and two middle schools in the Highline Public School district, located near Seattle, WA.
Education Development Center is conducting the formative and summative evaluation of the
The evaluation study supports the project Distance Learning Education Programs at the Saint Louis Zoo. To better understand what teachers want and need, and the characteristics of the settings in which their students learn, the Zoo conducted an online survey of the teachers of students with special needs in May 2014. The purpose of this evaluation was to clarify and expand the survey findings to support the design, development, and implementation of the Zoo distance learning curriculum so that it works effectively across a variety of school settings for K12 students with special needs and
In August 2012, the National Museum of Natural History (NMNH) contracted with Audience Focus (AF), a Maryland-‐based research and evaluation organization, to evaluate visitors’ experiences with the Scientist Is In program. Specifically, AF was asked to design a comprehensive study that would provide insight into the nature of visitors’ engagement with the program, and how participation in the program influenced visitors’ understanding of and curiosity about science topics, awareness of science careers, perceptions of NMNH as a research institution, and recognition of the connections between
The San Diego Natural History Museum (theNAT) contracted RK&A to conduct a summative evaluation of the exhibition Extraordinary Ideas from Ordinary People: A History of Citizen Science and to explore how well the exhibition communicates an inclusive view of science. The goals for the evaluation were to explore visitors’ behaviors in the exhibition as well as understand what meanings visitors made from the exhibition, particularly with regard to how the exhibition’s messages about citizen science are resonating in the context of visitors’ science identity.
RK&A conducted timing and tracking
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops in partnership with local science museums, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6 and 9-12 [apprentices]. During the fifth regional workshop in San Francisco, CA, the NFB operated two different programs simultaneously: one program for youth and a second program for their parents/caregivers. A third program, for the Exploratorium staff, was conducted earlier to prepare the museum staff to assist with the youth program. A separate report
Support from Safeco Insurance has enabled Pacific Science Center to open early from 8 – 10 a.m. and provide free entry for families affected by autism spectrum disorder. During the event, accommodations are made for sensory-sensitive guests, including softened general lighting and decreased noise level and visual stimulation on interactive exhibits whenever possible. In addition, Science Center staff provide facilitated experiences for guests at the Puget Sound Tide Pool, in the Willard Smith Planetarium, and on the Live Science Stage. Safeco Insurance funding also provided for staff training