This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
Overview
In 2021, we worked with the Smithsonian Institution’s American Women’s History Initiative (AWHI) to design and implement a baseline study that would measure the long-term impacts of the Because of Her Story (BOHS) internship program on participants. The program is a cross-Smithsonian initiative that matches interns with museum projects meant to amplify women's stories to tell a more complete American history, reach a diverse audience, and empower and inspire people from all walks of life.
Together, we articulated clear and measurable mid- and long-term outcomes for internship
Funded by the Institute of Museum and Library Services, the Access from the Ground Up project at the Palo Alto Junior Museum & Zoo (JMZ) seeks to better serve children with disabilities through a combination of partnerships with community, staff professional development and training, and the development of accessible STEM-focused exhibits and resources at the new JMZ facility, which opened in November 2021. This summative evaluation report seeks to answer the following evaluation questions:
To what extent does the Access from the Ground Up project build or strengthen relationships with
The Detroit Zoo will partner with community-based organizations serving youth in metropolitan Detroit to implement a program to develop and present remote STEM programming for students in this area, targeting low- to moderate-income students of color. Staff from the zoo and three afterschool programs (American Institutional Management Services, Arab Community Center for Economic and Social Services, and Boys and Girls Clubs of Southeast Michigan) will participate in professional development workshops on virtual, inquiry-based, humane STEM education. They will then utilize skills developed in the workshops to develop and lead virtual education programming for a total of 24 groups of 20 middle school youth.
The Louisiana Children’s Museum is developing a comprehensive set of resources entitled “Water Dialogues–Living with Water,” designed around its new exhibits and landscape resources, to strengthen the community’s understanding of the challenges associated with water management. They are creating a new field trip series and water-based science curriculum, “Water Pathways” as well as an outreach program, “Steward’s Ship,” to bring the program’s environmental messages to schools and camps. The museum will also conduct a professional development training series on science education for local educators implementing the state’s new science standards, in addition to a series of literacy workshops where children ages four to eight will write “how-to” books and “water journals.” To further spread the associated environmental and sustainability messages, they will organize an annual “Water Fest” program for the community.
The University of Montana spectrUM Discovery Area will implement “Making Across Montana” —a project to engage K–12 students and teachers in rural and tribal communities with making and tinkering. In collaboration with K–12 education partners in the rural Bitterroot Valley and on the Flathead Indian Reservation, the museum will develop a mobile making and tinkering exhibition and education program. The exhibition will be able to travel to K–12 schools statewide. The project team will develop a K–12 teacher professional development workshop, along with accompanying curriculum resources and supplies. The traveling program and related materials will build schools’ capacity to incorporate making and tinkering—and informal STEM experiences more broadly—into their teaching.
The Springfield Science Museum will increase participation in informal science learning by making its educational programs and learning spaces more accessible and inclusive. Museum staff will undergo Disability Inclusion and Universal Design training to redesign and enhance a core multi-use learning space and principle STEM program that can remove physical, cognitive, and social barriers to learning. External evaluators will measure access needs and learning outcomes before and after project upgrades in order to track progress and develop a scalable model of inclusive practice for all the museum’s science programming. The result will be an improved educational experience for visitors of all ages, abilities, and backgrounds.
The Cleveland Museum of Natural History will implement “SLAM Dunk,” a multidisciplinary initiative centered around Dunkleosteus terrelli, the largest predator and one of the fiercest creatures alive in the Devonian “Age of Fishes,” and for which the museum hold the best-preserved fossils. Each East Cleveland City Schools Kindergarten, 1st grade, and 2nd grade class will visit the museum for extended programming twice each school year. Museum educators will visit classrooms three times each school year. Museum staff will work with East Cleveland teachers on professional development offerings to increase teachers’ comfort level working with science content. Each school will receive an Educator Resource Center membership along with books and STEM materials. The museum will organize a family day at the museum each spring and provide scholarships for rising 3rd grade students to attend the museum’s week-long summer camps.
Growth in the US Latinx population has outpaced the Latinx growth in science, technology, engineering, and math (STEM) degrees and occupation, further widening the ethnic gap in STEM. Mathematics has often identified as a bottleneck keeping many youth, especially minoritized youth, from pursuing STEM studies. Unequal opportunities to develop powerful math assets explain differences in math skills and understanding often experienced by minoritized youth. Implementing culturally responsive practices (CRP) in afterschool programs has the potential to promote math skills and motivation for youth from minoritized groups. However, extensive research is needed to understand which culturally responsive informal pedagogical practices (CIPPs) are most impactful and why. This project aims to identify and document such practices, shed light on the challenges faced by afterschool staff in implementing them, and develop training resources for afterschool staff to address these challenges. This project is funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The fundamental research questions addressed by the project focus on (1) which CIPPs matter most in the context of a STEM university-community partnership engaging Latinx youth, and (2) in what context(s) and under what conditions do these CIPPs relate to positive outcomes for both youth participants and college mentor/facilitator. A third aim is to build capacity of afterschool staff for implementing CIPPs in informal STEM afterschool programs. The first two aims are addressed through a mixed-methods research study which includes quantitative surveys and qualitative in-depth interviews with five cohorts of adolescent participants, parents, and undergraduate mentors. Each year, surveys will be collected from adolescents and mentors at four time points during the year; the in-depth interviews will be collected from adolescents, parents, and mentors in the spring. In total, 840 adolescents and 210 mentors will be surveyed; and 87 adolescents, 87 parents, and 87 mentors will be interviewed. The third aim will be addressed by leveraging the research findings and the collective knowledge developed by practitioners and researchers to create a public archive containing documentation of CIPPs for informal STEM afterschool programs and training modules for afterschool staff. The team will disseminate these resources extensively with informal afterschool practitioners in California and beyond. Ultimately, this project will lead to improved outcomes for minoritized youth in informal STEM afterschool programs across the nation, and increased representation of minoritized youth in STEM pursuits.
DATE:
-
TEAM MEMBERS:
Alessandra PantanoSandra SimpkinsCynthia Sanchez Tapia
ECHO, Leahy Center for Lake Champlain will increase its capacity to serve rural schools through programming opportunities under its STEM in Motion 2.0 program. In partnership with rural schools, they will conduct two year-long teacher institutes blending in-person and virtual professional development. They plan to develop a total of 270 in-person and virtual classroom STEM programs and produce 18 classroom curriculum kits and standard-activity aligned guides. As a result of STEM in Motion 2.0’s activities, the museum anticipate that 54 teachers will have additional capacity to deliver high-quality STEM learning experiences to K–5th grade students in underserved, rural communities.