This front-end evaluation study is part of Designing Our Tomorrow: Mobilizing the Next Generation of Engineers, a five-year project (2018–2023) led by the Oregon Museum of Science and Industry (OMSI) with the support of the National Science Foundation (NSF, DRL-1811617) and project partners: Adelante Mujeres, the Biomimicry Institute, and the Fleet Science Center. The Designing Our Tomorrow (DOT) project seeks to promote and strengthen family engagement and engineering learning via compelling exhibit-based design challenges, presented through the lens of sustainable design exemplified by
With funding from NIH SEPA, OMSI is creating a mid-sized travelling exhibition that will promote public understanding of neuroscience research and its relevance to healthy brain development in early childhood.
The purpose of this report is to support the project team by assessing the extent to which the prototype activities, content, and labels tested contributed to visitor engagement, understanding, confidence, and future use of one or more strategies outlined. It was important to the project team that the exhibition be developed in collaboration with the communities for whom it is
This document represents the story of Native Universe: Indigenous Voice in Science Museums and how it has unfolded at the project level, the three case study museum sites, and through partnerships between tribal communities and the three science museums. Modeled on the project itself, our research and evaluation team brings together Indigenous and conventional, western evaluation and research practices, through a collaborative partnership between the Lifelong Learning Group, based at COSI’s Center for Research and Evaluation (Columbus, OH) and Native Pathways (Laguna, NM). The results of
Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
Intellectual Merit: Project RESET utilized a responsive teaching approach to engage youth in critical STEM literacy on the topic of climate change. Video recordings of the afterschool program, artifacts from the program, and interviews with youth were analyzed to better understand how youth supported each other’s participation in science discourse. The team outlined four themes of critical STEM literacy (CSL) and identified a “constellation” of knowledge, dispositions, and practices within each of those themes. Finally, Project RESET demonstrated the potential benefits of multi-modal analysis
The independent evaluation firm, Knight Williams, Inc., developed a two-part post-program survey to gather information about the Year 1 SciGirls CONNECT2 outreach programs conducted by 14 partner organizations. The evaluation aimed for one educator from each organization to complete Part 1 of the survey, which consisted of program reporting questions. In all, one educator from 13 partner organizations completed Part 1, for a response rate of 93%. Part 2 of the survey asked for program reflections, with a focus on perceived program goals, impacts, highlights, and challenges. Given the
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluators at Knight Williams Inc. developed a front-end survey to gather background and baseline information about the 16 partner organizations selected to conduct outreach programs as part of SciGirls CONNECT2. The goal was for two people from each partner organization to complete the online survey about their background and prior use of the SciGirls Seven and related strategies. A total of 30 partner representatives completed the survey by the requested deadline, resulting in a response rate of 94%. The majority identified as program leaders, with smaller groups saying they
Knight Williams, Inc. completed a summative evaluation report that addresses: (i) the reach and breadth of the Latina SciGirls broadcast program and online components compared to project expectations; (ii) the impact of the Family Fiesta events that incorporated use of SciGirls videos, in-person role models, and hands-on activities as experienced by the girls, family members, and role models that participated in the events; and (iii) the partners’ Latina SciGirls programs and how they used and reflected on the value of the SciGirls resources.
Children Investigating Science with Parents and Afterschool (CHISPA) was a collaboration between the Phillip and Patricia Frost Museum of Science, UnidosUS (formerly National Council of La Raza), and the ASPIRA Association that took place from 2014-18. CHISPA sought to address the disparity in science achievement among Latino and non-Latino children through local-level partnerships between science museums in metropolitan areas with growing Latino populations and UnidosUS and ASPIRA affiliate organizations serving the same communities through afterschool programs.
Partners included the
The New Jersey Historical Commission (NJHC) initiated the Understanding Communities Study with the goal to better understand how New Jersey history and history organizations can be more inclusive for all. NJHC contracted RK&A for the first phase of the study to conduct focus groups with members of Hispanic and Latino communities in New Jersey. NJHC plans to expand the study to other communities in the future. The New Jersey Center for Hispanic Policy, Research and Development served as advisors in the project.
With support from NJHC partners, RK&A conducted three focus groups with
Ruff Family Science is a project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. The project is utilizing a research and design process to create resources that meet the needs of families