This document summarizes lessons learned from implementing Leap into Science: Cultivating a National Network for Informal Science and Literacy (Leap into Science) from 2017-2023.
The following summative report describes overarching evaluation findings from the evaluation of Leap into Science, including future considerations for the Leap into Science program team (program team). The report aims to summarize takeaways from 2018-2023 and report on overall insights pertaining to the core evaluation questions of interest.
We examined an approach to reaching audiences who may not ordinarily engage with science. Termed Guerilla Science, this approach blends elements of access, by removing barriers to participation by embedding science into unexpected places, with those of inclusion, by designing activities that speak to the learning identities of participants.
The Children’s Museum will collaborate with six Hartford Public Library branches, three Hartford Family Centers, and the Connecticut Children’s Medical Center to provide hands-on Science, Technology, Engineering, Arts, and Mathematics (STEAM) - based programs to over 1,000 local 3 to 14-year old children and their care givers. Program design and development will include planning for field trips to the museum. All participants will be given age-specific, supplemental STEAM materials to continue their learning activities at home, and families can attend more than one week of library programs, or more than three Saturdays of family center programs. The goal will be to help urban Hartford youths find new pathways toward responsible citizenry and fiscal stability.
The Aldrich Contemporary Art Museum will amplify its partnership with Hart Magnet School, a Title 1 elementary school in urban Stamford, Connecticut, by increasing exposure and access to the arts for first-fifth graders, their families, and educators. A new program model, leveraging the museum's artist exhibitions, will focus on technology and an inquiry-based approach to science. Students, educators, and families will be encouraged to see and think in new ways through on-site STEAM tours at the museum, artist-led workshops at Hart, teacher professional development, and afterschool family activities. Outside evaluators will work with the project team to develop goals and associated metrics to measure how the model of museum-school partnership can enhance student achievement, engage families more deeply in their child's school experience and community, and contribute to teacher professional development. The evaluator will also train museum staff on best practices for program assessment.
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:
EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.
This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.
In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
A long history of research suggests that early informal STEM learning experiences such as block play, puzzles, visiting zoos and science museums can build a strong foundation for STEM learning and which leads to later STEM success. Yet, children from low-income and historically underserved communities have less access to these opportunities due to scarce resources and barriers to access such as transportation and cost. To address these challenges, this project will endeavor to infuse public urban spaces such as local parks, bus-stops, and grocery stores with playful and engaging informal STEM learning opportunities in low-income Latinx neighborhoods as a strategy for understanding how public spaces, when co-designed with community partners and informed by the science of learning, can foster rich, informal STEM learning experiences for young children in neighborhood places where families naturally spend time. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Using techniques of Community-Based, Participatory Design Research, researchers will collaborate closely with community families and partners in Santa Ana, California to achieve three aims: 1) Co-design a series of outdoor Playful Learning Landscape (PLL) exhibit installations with community partners that reflect the goals, values, and cultural capital of the Latino community. 2) Explore how caregivers and their children experience PLL exhibit installations and examine the development and changes in: a) caregiver-child STEM conversation and interactions, and b) caregiver attitudes about the importance of informal STEM learning and their beliefs about their role in facilitating STEM learning. 3) Leverage existing data from county partners to examine the potential effects of having multiple PLL installations within a specific neighborhood on promoting STEM learning and development across an array of cognitive and socio-emotional outcomes in early-childhood. This project will advance current knowledge on informal STEM learning by demonstrating new ways to understand the cultural assets that Latinx families bring to learning contexts, showing how the unique assets and needs of a local community can be incorporated into public infrastructure, and documenting the STEM-related learning experiences and interactions that occur in these settings. Due to a partnership with the Orange County Children and Families Commission, which collects data on child learning and development on every child in the county, researchers will examine the longitudinal impacts of a cluster of playful STEM-learning exhibit installations in a single neighborhood on children's developmental outcomes compared to matched neighborhoods without access to these installations. By leveraging everyday routines to promote playful STEM learning and caregiver-child STEM-related interactions, this project will: 1) empower caregivers to build a STEM learning foundation for children during early childhood; and 2) serve as a model for how cities can be re-designed to enhance ubiquitous STEM learning across public spaces, with the cultural capital of local families and children at the center of urban design and revitalization.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Andres BustamanteKathy Hirsh-PasekJune Ahn
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
Ruff Family Science is a project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. The project is utilizing a research and design process to create resources that meet the needs of families
Informal STEM education institutions seek to engage broader cross sections of their communities to address inequities in STEM participation and remain relevant in a multicultural society. In this chapter, we advance the role that evaluation can play in helping the field adopt more inclusive practices and achieve greater equity than at present through evaluation that addresses sociopolitical contexts and reflects the perspectives and values of non-dominant communities. To do this for specific projects, we argue that evaluation should privilege the voices and lived experiences of non-dominant