The Brooklyn Botanic Garden (BBG) and Brooklyn Academy of Science and the Environment (BASE) contracted RK&A to conduct an evaluation of their partnership’s progress and outcomes over three years. The goal of the summative evaluation is to explore students, families, and teachers’ perceptions of and relationship to BBG and the BBG-BASE partnership. The evaluation also explored attitudes and understandings of how to engage in nature exploration, scientific inquiry, and environmental stewardship in a meaningful way.
How did we approach this study?
RK&A developed questionnaires to be
Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
Seeking to use narrative as a vehicle for getting more young people interested in STEM, the National Science Foundation supported a WETA/PBS NewsHour initiative to adapt their Student Reporting Labs (SRL) curriculum to feature a focus on STEM content in 2015. NewsHour selected Knology to run a four-year evaluation of the project from 2015 to 2019. Building on earlier research about student-led science journalism (e.g. Polman & Hope, 2014; Nicholas, 2017), this project suggests that having students develop and produce narratives about complex STEM topics may make these topics far less
This annual report presents an overview of Saint Louis Science Center audience data gathered through a variety of evaluation studies conducted during 2017. This report includes information on the Science Center's general public audience demographics and visitation patterns, gives an overview of visitors' comments about their Science Center experience, summarizes major trends observed in the Science Center's tool for tracking educational programs, and presents highlights from front-end evaluation on the topic of infrastructures and summative evaluation of the GROW exhibition.
Ruff Family Science is a project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. The project is utilizing a research and design process to create resources that meet the needs of families
The National Building Museum (NBM) contracted RK&A, Inc. to conduct a summative evaluation of the Why Engineering? distance learning program. The goal of the evaluation was to assess program operations and explore the extent to which the program achieved its intended outcomes for students and teachers.
How did we approach this study?
RK&A used three methodologies for the study: online program observations; student assessments administered immediately after the program; and telephone interviews with teachers. Observations were primarily used to gain a holistic understanding of how the
This is the summative evaluation for the My Sky Tonight: Early Childhood Pathways to Astronomy is a National Science Foundation funded Full-Scale Development project that was designed to support informal science education practitioner’s ability to provide astronomy learning for young children ages 3-5 years. Based on prior research and assessment of the field, the project team identified that many informal educators lack the astronomy content, interpretive strategies, and confidence they need to effectively engage audiences of families with preschool-aged children. Three mechanisms were
The goals of the project were to build an understanding about the perception of career and technical education (CTE) as an option for middle school students in pursuing skill-based STEM-related careers, and to use that information to develop an innovative suite of digital tools designed to improve mentors’ and school counselors’ communication with middle school–aged students.
“Monkeying Around: Digital Media and Parent/Child Engagement Resources to Increase Preschool Computational Thinking” is a new project that uses animation, live-action videos, and hands-on activities to support joint engagement of children and caregivers around computational thinking concepts and practices. WGBH, a leading producer of educational STEM media, developed prototypes of videos and hands-on activities around the project’s computational thinking learning goals for young children. Education Development Center (EDC), WGBH’s research partner for the project, conducted a small formative
Since the late 2000s, interest in the development and use of shared measures in the informal science, technology, engineering, and mathematics (STEM) education (ISE) field has increased. The intent is to build the capacity of evaluators to measure common outcomes of ISE experiences. We begin this chapter with a definition of shared measures, a description of related technical qualities of these measures, and a discussion of benefits and concerns around the use of shared measures. We then review recent conversations and developments around shared measures, including examples of observational