The following summative report describes overarching evaluation findings from the evaluation of Leap into Science, including future considerations for the Leap into Science program team (program team). The report aims to summarize takeaways from 2018-2023 and report on overall insights pertaining to the core evaluation questions of interest.
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
The Children’s Museum will collaborate with six Hartford Public Library branches, three Hartford Family Centers, and the Connecticut Children’s Medical Center to provide hands-on Science, Technology, Engineering, Arts, and Mathematics (STEAM) - based programs to over 1,000 local 3 to 14-year old children and their care givers. Program design and development will include planning for field trips to the museum. All participants will be given age-specific, supplemental STEAM materials to continue their learning activities at home, and families can attend more than one week of library programs, or more than three Saturdays of family center programs. The goal will be to help urban Hartford youths find new pathways toward responsible citizenry and fiscal stability.
Sciencenter will use a co-development process to strengthen rural engagement with hands-on and inquiry-based STEM for families and children. The museum will initiate the project in partnership with Moravia Central School District and Groton Public Library. The project team will also collaborate with advisors who have expertise in reaching rural audiences. Project activities will increase the museum's understanding of rural communities' needs around STEM. The museum will work with additional rural partners to develop activities and programs that meet identified needs. An external evaluator will track project progress and measure results. This evaluator will also train the museum's staff on data collection and recording methods. Data analysis throughout the project will support changes in programs and activities as needed.
Miami Children's Museum will redesign its Construction Zone Gallery into a STEM-learning space providing children, primarily ages eight and under, with a stimulating and interactive experience. The exhibition will incorporate 13 distinctive exhibition components, allowing full engagement in a variety of STEM-based learning activities. The museum will conduct focus group activities with field interpreters, specialists and educators working in STEM fields to guide and refine content development of the script and exhibition layout, followed by testing of the themes, programming activities, exhibition props and tools, software concepts, and learning outcomes. The project team will develop accompanying programming for children to be presented at the museum and at area public libraries. All components of the exhibition will support Florida's Early Learning Standards, and will meet the evolving educational needs of its youngest learners.
This report shares the results of a year-long study of the impact of IMLS grants (1998-2003) though programs that served youth aged 9-19. Nearly 400 museum and library programs were surveyed about their goals, strategies, content, audience, and structure, as well as about their impact, effectiveness, and outcomes.
Children and their families are practicing STEAM (Science, Technology, Engineering, Arts, and Math) skills through a library program. Hand-crank generators and LED bulbs are set out on each of the tables, along with two types of dough—conductive play dough and insulating modeling clay.
DATE:
TEAM MEMBERS:
Brooks MitchellClaire RatcliffeKeliann LaConte
The Farrell Fellows Summer Internship program consists of teen educators leading science, technology, engineering and math (STEM) activities for children at libraries and park locations across Chicago. The goal of this study was to learn more about the families who attend the sessions and to also look for evidence of learning and how that may be related to the moods and attitudes of the teen educators. Data was collected through observations of the sessions, pre- and post-session surveys of 26 teen educators, and 90 surveys of the parents of participating children. Field notes were coded using
This project will focus on addressing the challenges faced by rural youth with a particular emphasis on those youth who are English Language Learners. The project will provide informal education via libraries and librarians which can provide unique opportunities for rural youth and communities. Building on several years of research and experimentation, this project will augment the formal education sector, as well. The settings for the project are 12 rural school districts in largely Latinx communities. The project partners are the Space Science Institute, the American Library Association (ALA), the Institute for Learning Innovation and the Twin Cities Public Television. Expertise from the Latinx community will play a significant part in the project. The project will engage learners from diverse backgrounds, ages, and interests in science through a coordinated and tested strategy incorporating three Learning Pathways (i.e., Science Learning Spaces, Programs, and Science Kits) in a public library environment. The results should yield a model for Nationwide application.
The main goals are: 1) to establish learning pathways to engage rural communities through exhibit host libraries and (2) to increase art-rich STEM learning opportunities for rural communities through libraries and their support systems. Building on an established training model, the project will introduce library staff to the STEAM content of the exhibits and guide them in developing their own STEAM Learning Pathways. SciGirls digital media, hands-on activities, family resources, and a training network will expand the depth and reach of the project. The project draws on existing professional infrastructure to increase library staff capacity through ALA and the Institute's established community of practice. The researchers will study the efficacy of each pathway, alone and in tandem, on participant's interest development and persistence. The research will use a mixed-methods design-based approach that involves questionnaires, interviews and case studies.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Libraries can provide unique opportunities for rural youth and communities. Phase III of the STAR Library Network will be a collaboration with 12 rural school districts in largely Latinx communities to address the challenges faced by rural youth, particularly English Language Learners. The project will use a coordinated and tested strategy to establish three learning pathways in public libraries: science learning spaces with exhibits, library programs, and science kits. These resources will provide learners with art-rich STEM learning opportunities.
Partners
Project partners include the Space Science Institute, the American Library Association (ALA), the Institute for Learning Innovation, and Twin Cities Public Television. The project will rely significantly on expertise from the Latinx community.
Project Plan
Building on an established librarian training model, the project will introduce library staff to the STEAM content and guide them in developing their own STEAM Learning Pathways. The project will draw on existing professional infrastructure from the ALA and the Institute for Learning Innovation’s established community of practice. SciGirls digital media, hands-on activities, family resources, and a training network will expand the depth and reach of the project.
The Research
The research team will study the efficacy of each pathway, alone and in tandem, on participant’s interest development and persistence. The research will use a mixed-methods design-based approach that involves questionnaires, interviews, and case studies. The results should yield a model for nationwide application and contribute insights for the formal education sector.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The PEAR Institute: Partnerships in Education and Resilience at McLean Hospital and Harvard Medical School conducted a year-long study of the Tulsa Regional STEM Alliance (TRSA). Funded by the Overdeck Family Foundation, STEM Next Opportunity Fund, and the Charles and Lynn Schusterman Family Foundation, this study is the first of its kind among 68 national and international STEM Ecosystems.
DATE:
TEAM MEMBERS:
Kristin Lewis-WarnerPatricia AllenGil Noam