This document is the final summative evaluation report written by EDC, the external evaluator of the STEM Guides project. The report concludes that the project was highly ambitious, with many dynamic and evolving pieces. It was deemed successful as a model of brokering connections between students aged 10-18 and STEM resources and opportunities in rural Maine communities. The STEM Guides program contributed to the increase in STEM awareness within each community, as well as connecting youth with interesting and relevant STEM experiences.
The National Federation of the Blind (NFB), in partnership with scholars from Utah State University and educators from the Science Museum of Minnesota (SMM), has developed the Spatial Ability and Blind Engineering Research (SABER) project to assess and improve the spatial ability of blind teens in order to broaden their participation in STEM fields. The goals of the project include:
Contribute to the knowledge base of effective practices regarding informal STEM education for the blind, particularly relating to the development of spatial reasoning abilities.
Educate families, blind
This long-term follow-up study utilized mixed method design to elicit information from the previous alumni cohorts over the past ten years. Extensive qualitative analysis supports quantitative findings across five intended program outcomes (content; science identity, science communication, 21st century skills and positive youth development; and networking. It also documents additional non-specifically targeted outcomes (e.g., parenting and community involvement); influence of specific program components; and visions for future alumni programming. Qualitative data derive from two sources -
Researchers from Ideum and XPRIZE Foundation recently completed a multi-site study of the way people use an innovative experience on health technologies. Funded by the Qualcomm Foundation, the team traveled to three US science centers to see how museum visitors interacted with and learned from the exhibit, which Ideum and XPRIZE designed and developed in 2018.
The exhibit was funded by XPRIZE after 2017’s Qualcomm Tricorder XPRIZE competition, in which teams developed ideas for new kinds of portable medical devices. Running on a custom 65” Ideum Platform multitouch table, the experience
Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
Intellectual Merit: Project RESET utilized a responsive teaching approach to engage youth in critical STEM literacy on the topic of climate change. Video recordings of the afterschool program, artifacts from the program, and interviews with youth were analyzed to better understand how youth supported each other’s participation in science discourse. The team outlined four themes of critical STEM literacy (CSL) and identified a “constellation” of knowledge, dispositions, and practices within each of those themes. Finally, Project RESET demonstrated the potential benefits of multi-modal analysis
The Lemelson Center for the Study of Invention and Innovation (Lemelson) at the National Museum of American History (NMAH) contracted RK&A to conduct a front-end evaluation of Game Changers, a new exhibition that will highlight stories of invention and innovation related to sports. The goals of the study were to identify visitors’ associations with sports and invention and explore their reactions to preliminary exhibition concepts and titles.
How did we approach this study?
RK&A conducted 40 in-depth interviews with walk-in visitors to NMAH. As much as possible, RK&A recruited
With funding from a Smithsonian Institution Youth Access Grant the National Museum of Natural History offered a program pipeline that would engage underserved Washington D.C. students in programming designed to encourage academic and career STEM interest. Beginning with collaboration with community educators, the pipeline funneled students into a Teen Night Out Science Night to interest them in science workshop series offered after school and on weekend and ultimately into volunteer and internship opportunities. This report provides detailed view of methods, analyses, results, and conclusions
The Collaboration for Ongoing Visitor Experience Studies (COVES) aims to help science centers gather and share data to better understand visitors’ experiences. For the summative evaluation of COVES, the Museum of Science’s Research and Evaluation Department studied the program’s impacts on participating museums and museum professionals. Specifically, this evaluation was designed to:
Examine participants’ overall satisfaction with the collaboration and their likelihood to recommend it to others;
Understand the impact that COVES is having on Participating Institutions;
Assess whether
The Monterey Bay Aquarium is planning to redesign existing conservation-related interactives as well as add new experiences on the Aquarium floor. In preparation for this project, the Aquarium sought to gain a better understanding of visitors’ awareness of and engagement in conservation-related actions and responses to conservation-related messaging. The Aquarium contracted with MWA Insights to conduct a front-end evaluation study to help inform the planning for these conservation stations. Specifically, the evaluation sought to understand:
Are visitors aware of issues affecting the
This is the summative evaluation for the My Sky Tonight: Early Childhood Pathways to Astronomy is a National Science Foundation funded Full-Scale Development project that was designed to support informal science education practitioner’s ability to provide astronomy learning for young children ages 3-5 years. Based on prior research and assessment of the field, the project team identified that many informal educators lack the astronomy content, interpretive strategies, and confidence they need to effectively engage audiences of families with preschool-aged children. Three mechanisms were
Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. In the fall of 2014, Techbridge Girls began offering after-school programming at five elementary and two middle schools in the Highline Public School district, located near Seattle, WA.
Education Development Center is conducting the formative and summative evaluation of the