The following summative report describes overarching evaluation findings from the evaluation of Leap into Science, including future considerations for the Leap into Science program team (program team). The report aims to summarize takeaways from 2018-2023 and report on overall insights pertaining to the core evaluation questions of interest.
In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This report is the summative evaluation of Moon Adventure Game. The Moon Adventure Game is a challenge-based immersive game, inspired by “escape room” experiences, which asks visitors to take on activities to help them think about what people might need to live and work on the Moon.
In spring 2019, WestEd conducted a pilot study using five playlists to understand the feasibility of implementing the playlists in afterschool programs and to discuss the potential impact of the playlists on student science learning. The research questions were: 1) How are the playlists implemented in after-school programs? 2) What is the potential impact of playlists on student science knowledge and skills? Student science knowledge was measured using the ScienceQuest test, and attitudes towards science were measured by the Emerging STEM Learning Activation Survey. Data were analyzed using a
This paper reports on a new media-based tool designed to develop new knowledge about joint parent-child participation in science talk and practices using a second screen app synced with a television program, called Splash! Ask-Me: Ocean Adventures (Splash!).[1] With funding from the National Science Foundation, Splash! is an app designed to work in conjunction with a marine science-focused television program, Splash and Bubbles, for children 2-8 years old that premiered nationally on PBS Kids in fall of 2016.
The free app includes a variety of "conversation catalysts" tied to the television
PLUM LANDING a digital media PBS Kids series that is designed to motivate six- to nine-year-old children to investigate the natural world. Content developers from WGBH Boston and researchers from the Education Development Center (EDC) used an iterative research and design process to create the Plum Landing Explore Outdoors Toolkit. The Toolkit includes digital media resources (animated stories, live-action videos, an online badging system, a digital game, and an app for families), hands-on science activities, and support materials for parents, caregivers, educators, and program directors to
Ruff Family Science is an exploratory project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. More specifically, the project is undertaking a research and design process to create prototype
The Association of Science-Technology Centers (ASTC) aims to help member institutions inform and educate the public about science through a global lens. The World Biotech Tour (WBT) was a three-year initiative designed to not only promote a greater understanding of biotechnology through public outreach and programming led by science centers and museums, but also as an opportunity for ASTC to collect useful data on the resources required and challenges encountered at different science museums around the world when implementing a long-term, multi-country program. The WBT involved students
As the maker movement is increasingly adopted into K-12 schools, students are developing new competences in exploration and fabrication technologies. This study assesses learning with these technologies in K-12 makerspaces and FabLabs.
Our study describes the iterative process of developing an assessment instrument for this new technological literacy, the Exploration and Fabrication Technologies Instrument, and presents findings from implementations at five schools in three countries. Our index is generalizable and psychometrically sound, and permits comparison between student confidence
DATE:
TEAM MEMBERS:
Paulo BliksteinZaza KabayadondoAndrew P. MartinDeborah A. Fields
Concord Evaluation Group (CEG) conducted an outreach partner evaluation for Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
In partnership with the Center for Research on Lifelong STEM Learning, we completed year one of a multi-year study on the impact of the Curiosity Machine model on students. There is a specific focus on linking dosage to impact. The constructs that were explored were:
* STEM identities (e.g., how students think of themselves in science)
* “Possible selves” (see STEM as a component of their own career or future learning pathways, e.g., course taking in STEM areas)
* Self-efficacy (e.g., beliefs in their abilities in STEM subject areas, self-perception of confidence in STEM)
* Interest in