The Wild Center has been running climate programs for over a decade and has embraced a culture of evaluation in its work to reflect on and improve the programs over time. This evaluation built on findings from prior evaluations to further explore the programs’ impact on rural youth and teachers, but also sought to understand broader contributions to the ecosystem of organizations doing climate resilience work across New York state and around the country.
This document summarizes lessons learned from implementing Leap into Science: Cultivating a National Network for Informal Science and Literacy (Leap into Science) from 2017-2023.
In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
The project team published a research synopsis article with Futurum Science Careers in Feb 2023 called “How Can Place Attachment Improve Scientific Literacy?”
The Discovery Center at Murfree Spring, in partnership with six science centers and museums, will promote and invest in science education in rural communities with limited museum access. This coalition will work with two cohorts of rural school communities (12 total) and focus on engaging, learning from, and supporting rural school districts, teachers, families, and communities through relationship building, asset mapping, and the collaborative integration and implementation of museum resources. Additional activities include the production of publications, virtual presentations, and a virtual tool kit. The project will illustrate the ways in which museums can collaborate to support STEM and literacy at the K-2 level, enhance teacher self-efficacy, attitudes and beliefs, and engage family and community, strengthening services for Americans who live in the most rural areas.
ECHO, Leahy Center for Lake Champlain will increase its capacity to serve rural schools through programming opportunities under its STEM in Motion 2.0 program. In partnership with rural schools, they will conduct two year-long teacher institutes blending in-person and virtual professional development. They plan to develop a total of 270 in-person and virtual classroom STEM programs and produce 18 classroom curriculum kits and standard-activity aligned guides. As a result of STEM in Motion 2.0’s activities, the museum anticipate that 54 teachers will have additional capacity to deliver high-quality STEM learning experiences to K–5th grade students in underserved, rural communities.
The L.C. Bates Museum will deliver STEAM programming to neighboring rural, mostly low-income second grade children and their families through the Observing Ornithology science project. Over a two-year period, the museum will work with 40 teachers in 12 schools to support student learning tied to Next Generation core science performance measures. The project activities will use museum collections and other resources to present a series of three ornithology programs designed to motivate curiosity and engage children in observation activities that support a new approach to thinking, analyzing and solving. The museum will loan a new pop-up display to each of the 12 school libraries and will present four family and four children's museum bird days at the museum for participating students and their families during each year of the project. An external evaluator will measure the project's success in achieving defined performance measures that include strengthening the children's knowledge, understanding, and attitude toward the regional environment.
The Harvard Museums of Science and Culture will improve the ability of middle school teachers to use museum-based digital resources to support classroom instruction aligned with state and national science standards. Working with advisory teachers from five collaborating school districts, the museum will co-create classroom activities, based on digital resources from its collections, along with associated teacher professional development programs at three sites across urban and rural Massachusetts. The project will provide schools with access to classroom-ready resources that successfully support student learning. Teachers will learn how to use these materials, integrate them into their teaching, and enhance their skills to teach science content and practice. External evaluators will assess the project's effectiveness by measuring teacher implementation of the digital resources in the classroom, requests for information and assistance, and changes in teachers' confidence and comfort levels.
Hanohano o Oahu: The Geology and Moolelo of Kona to Ewa project will provide learning opportunities for 500 fourth grade students and their teachers from ten public schools located in central and leeward Oahu, Hawaii. A geology unit will be developed that includes a 90-minute class presentation, hands-on classroom activities, a Discovery Box to extend learning opportunities, and a full-day (5-hour) field trip experience. The multi-stop bus tour will be centered on the moku (district) of Kona and Ewa and highlight significant Oahu cultural sites, their moolelo (stories, history) and geology. A culture-based student activity booklet, hands-on activities, and other education materials will also be developed for the unit. The project will target rural communities with underserved families, large Hawaiian homestead neighborhoods, and little access to museum services. Participation in the programming will provide students and teachers with a better understanding of the connection between scientific information and Hawaiian knowledge.
Parents and adult caregivers play a significant role in young children's understanding of (and participation in) science, technology, engineering, and mathematics (STEM). Research suggests that early engagement with STEM can have a profound impact on children's use of STEM process skills such as exploration, observation, and problem-solving, as well as future academic success. An immediate yet ongoing challenge facing informal STEM learning providers is to understand how limited resources can be used to support effective STEM learning opportunities and experiences for all children and families. Through a collaboration between researchers, Head Start, two science centers (one rural, one urban), and educators, this project aims to foster STEM access and engagement with specific attention to young children and their caregivers. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This Pilot and Feasibility study will apply an experimental, mixed-methods design to examine parent/caregiver and child (ages 4-5) interactions before, during, and after informal STEM experiences to identify which factors influence children's transfer of learning STEM process skills across multiple informal contexts. Research results will lay the foundation for a future longitudinal study. The project team will ask: (1) What types of parent/caregiver-child engagement at the science center are most predictive of children's application of STEM process skills in subsequent problem-solving tasks and school readiness? (2) How do variations in parent/caregiver-child conversational strategies during the science center visit influence children's memory and learning? and (3) How can informal educators best support Head Start family engagement and children's emerging STEM knowledge? This study will collect data on 240, 4-5-year-old children, with their caregivers, in two different science centers that serve a largely rural and largely urban population. Data sources will include video/audio of caregiver-child interactions at the science centers and at home, as well as children's recall, engagement with a problem-solving task, and school readiness scores. Coding and analysis of the tasks during and after the science center visit will detail mechanisms underlying children's memory, learning, and application of STEM process skills that transfer to the problem-solving task. The project will be implemented by a research-practice partnership, leveraging the expertise of project partners and communities to ensure the use of culturally responsive research practices. This research has the potential to strategically impact how science centers and Head Start grantees work together on Family Engagement programming to achieve equitable STEM learning opportunities, broadening participation for low-income young children and their families.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.