This evaluation report provides a brief review of the National Science Foundation (NSF) planning grant, Creating an Early Childhood STEM Ecosystem, as of August 2019. The purpose of the evaluation was to provide an external, independent overview of the work completed and some of the lessons learned to date.
This report presents summative evaluation results for a National Science Foundation funded project entitled Grounding Institutional Partnerships in Structures for Broader Impacts Design (BID). The project represents a collaboration between five institutions: Institute for Learning Innovation, The STEM Research Center at Oregon State University, Scicenter, University of Washington-Bothell, and University of Wisconsin-Madison. BID aimed at creating an inter-institutional structure and toolkit to assist higher education institutions (HEIs) and informal science education organizations (ISEs) in
The Farrell Fellows Summer Internship program consists of teen educators leading science, technology, engineering and math (STEM) activities for children at libraries and park locations across Chicago. The goal of this study was to learn more about the families who attend the sessions and to also look for evidence of learning and how that may be related to the moods and attitudes of the teen educators. Data was collected through observations of the sessions, pre- and post-session surveys of 26 teen educators, and 90 surveys of the parents of participating children. Field notes were coded using
This document is the final summative evaluation report written by EDC, the external evaluator of the STEM Guides project. The report concludes that the project was highly ambitious, with many dynamic and evolving pieces. It was deemed successful as a model of brokering connections between students aged 10-18 and STEM resources and opportunities in rural Maine communities. The STEM Guides program contributed to the increase in STEM awareness within each community, as well as connecting youth with interesting and relevant STEM experiences.
This long-term follow-up study utilized mixed method design to elicit information from the previous alumni cohorts over the past ten years. Extensive qualitative analysis supports quantitative findings across five intended program outcomes (content; science identity, science communication, 21st century skills and positive youth development; and networking. It also documents additional non-specifically targeted outcomes (e.g., parenting and community involvement); influence of specific program components; and visions for future alumni programming. Qualitative data derive from two sources -
Are you interested in an innovative approach to collecting a large amount of formative data via Facebook? RMC Research Corporation conducted a formative evaluation for Oregon Public Broadcasting (OPB) to ensure the social media tag lines and clips created by OPB engage the target audiences. The primary target audience for the Hacking Your Mind (HYM) television series is the PBS primetime television viewing audience. According to the PBS Research Audience Insight 2016 Annual Report, the PBS primetime audience is older (median age of 65) and college educated (43% have a 4-year degree). To
DATE:
TEAM MEMBERS:
Jean Hiebert LarsonChandra LewisCorynn Del Core
Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
Intellectual Merit: Project RESET utilized a responsive teaching approach to engage youth in critical STEM literacy on the topic of climate change. Video recordings of the afterschool program, artifacts from the program, and interviews with youth were analyzed to better understand how youth supported each other’s participation in science discourse. The team outlined four themes of critical STEM literacy (CSL) and identified a “constellation” of knowledge, dispositions, and practices within each of those themes. Finally, Project RESET demonstrated the potential benefits of multi-modal analysis
This report summarizes the evaluation outcomes of the Collaborative Project Management (CoPM) Institute project, a two-day convening centered on bringing proven project management skills and approaches in the for-profit world to the informal science education (ISE) community to support effective collaborations and successful outcomes. The CoPM Institute was conceptualized as a pilot effort to test the effectiveness of porting of tools and frameworks for collaborative project management from the business/for-profit environment to advance the following project goals:
Build the capacity of
With funding from a Smithsonian Institution Youth Access Grant the National Museum of Natural History offered a program pipeline that would engage underserved Washington D.C. students in programming designed to encourage academic and career STEM interest. Beginning with collaboration with community educators, the pipeline funneled students into a Teen Night Out Science Night to interest them in science workshop series offered after school and on weekend and ultimately into volunteer and internship opportunities. This report provides detailed view of methods, analyses, results, and conclusions
The Collaboration for Ongoing Visitor Experience Studies (COVES) aims to help science centers gather and share data to better understand visitors’ experiences. For the summative evaluation of COVES, the Museum of Science’s Research and Evaluation Department studied the program’s impacts on participating museums and museum professionals. Specifically, this evaluation was designed to:
Examine participants’ overall satisfaction with the collaboration and their likelihood to recommend it to others;
Understand the impact that COVES is having on Participating Institutions;
Assess whether
The National Federation of the Blind (NFB), in partnership with scholars from Utah State University and educators from the Science Museum of Minnesota (SMM), has developed the Spatial Ability and Blind Engineering Research (SABER) project to assess and improve the spatial ability of blind teens in order to broaden the participation of blind students in STEM fields.
Activities began this summer (2018) with a week-long, residential engineering design program for thirty blind high school students at NFB headquarters in Baltimore. The evaluation focused on perceptions of process and measures of