This document describes the summative project evaluation of 5 annual cohorts of STE(A)M teachers, mostly from California, Florida, and New Mexico participating in out-of-school authentic research experiences collecting fossils and learning about geology, biology, and the natural history along the Panama Canal, and their experiences with museums and research collections. The STEM content of this project is based on the Great American Biotic Interchange (GABI) of animals and plants across the Isthmus of Panama over the past 5 million years. This report also describes the efficacy of sustained
Summative evaluation study for the Space Earth and Informal Science Education (SEISE) project examining professional impacts including project reach, partnerships, professional knowledge, and professionals' use of the project’s public-facing products and their implementation of practices for engaging the public
Over the course of the five-year NASA grant, the Space and Earth Informal STEM Education (SEISE) project offered a range of free professional development opportunities and resources to support informal educators’ ability to offer Earth and space programming and to partner with others
This report presents highlights from a Fall 2020 evaluation conducted with 69 STEAM teachers from across the U.S., all of whom are part of the National Air and Space Museum's Teacher Innovator Institute (TII). Due to the impact of the COVID-19 pandemic on classrooms and the museum's teacher PD program, the evaluation in Fall 2020 focused on understanding the conditions, adaptations, challenges, and success stories of this population of teachers from across the country. The findings in this report provide insight into the variations in teaching conditions (depending on geography and urbanity
The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
Ruff Family Science is a project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. The project is utilizing a research and design process to create resources that meet the needs of families
The National Building Museum (NBM) contracted RK&A, Inc. to conduct a summative evaluation of the Why Engineering? distance learning program. The goal of the evaluation was to assess program operations and explore the extent to which the program achieved its intended outcomes for students and teachers.
How did we approach this study?
RK&A used three methodologies for the study: online program observations; student assessments administered immediately after the program; and telephone interviews with teachers. Observations were primarily used to gain a holistic understanding of how the
National Air and Space Museum, Washington DC
Summative Evaluation for Educational Program, 2016
The National Air and Space Museum (NASM) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a summative evaluation of Science in Pre-K, an onsite and online teacher professional development program that NASM developed for the District of Columbia Public Charter Schools’ (DCPS). The program supports preschool teachers in teaching science through exploration and problem solving. This evaluation is a continuation of a planning and evaluation project initiated in 2013. In 2013, RK&A
This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
NatureStart Network brought together early childhood educators and environmental educators to support nature play, exploration, and inquiry for young children and their families within urban environments. Project partners included the Forest Preserves of Cook County and two established Head Start programs in the Chicago area, Mary Crane Center and El Valor. The foundation of the project was a series of three two-day professional learning sessions that took place over an eighteen month period. Through hands-on, collaborative learning and reflection activities, the participating educators
Science from the Start (SFTS) was a two-year early childhood program funded by IMLS, with matching funds from the Sciencenter. The goal of SFTS was to empower teachers, parents, and caregivers to do more science with their students and children. Although the SFTS program continues today,this final summary report describes the results of the initial two-year pilot project only.
Throughout the five year SciGirls CONNECT grant the independent evaluation firm Knight Williams assisted Twin Cities PBS (TPT) in a wide range of program evaluation activities. Given the project’s emphasis on a Train-the-Trainer model, the evaluation prioritized two goals: (i) assessing the various levels of CONNECT trainings from different vantage and time points, and (ii) capturing information on the implementation of SciGirls programs led by those who completed a training. This evaluation approach allowed the team to collect ongoing data over the course of the grant and share this
Since the summer of 2006, the Nature Museum at Grafton (TNM) has been offering three day intensive courses in Nature Writing and Nature Journaling. In 2006-07, TNM worked with PEER Associates to develop and analyze a survey which teachers complete on the last day of their course. TNM has continued to use that evaluation method, and, in December 2008 and February 2010, asked past participants to answer follow up questions about their future interest in programming options, experiences with the institutes, and their implementation of course content in their own classrooms. In late 2010, TNM