The following summative report describes overarching evaluation findings from the evaluation of Leap into Science, including future considerations for the Leap into Science program team (program team). The report aims to summarize takeaways from 2018-2023 and report on overall insights pertaining to the core evaluation questions of interest.
Imagination Station, Toledo’s Science Center, will implement Toledo Tinkers: Through a Child’s Eyes — a new initiative to address barriers to STEM education and promote a lifelong love of those subjects. An outreach curriculum and a mobile tinkering lab will help children ages 11–13 and their families establish personal connections with making and tinkering. Pilot programs will include the Maker Club — a 12-session out-of-school program for students from Boys and Girls Clubs of Toledo and other community-based organizations — as well as Tinkering Takeovers, which is a drop-in tinkering program for families at branch libraries. A community exhibition will showcase the diversity of the Toledo community and its rich history of making and tinkering, using the work of participating children.
The Children’s Museum will collaborate with six Hartford Public Library branches, three Hartford Family Centers, and the Connecticut Children’s Medical Center to provide hands-on Science, Technology, Engineering, Arts, and Mathematics (STEAM) - based programs to over 1,000 local 3 to 14-year old children and their care givers. Program design and development will include planning for field trips to the museum. All participants will be given age-specific, supplemental STEAM materials to continue their learning activities at home, and families can attend more than one week of library programs, or more than three Saturdays of family center programs. The goal will be to help urban Hartford youths find new pathways toward responsible citizenry and fiscal stability.
The Whaling Museum & Education Center will expand its educational programming to benefit underserved and high-risk students in grades 2 to 5, as well as their teachers and families. The museum will develop, implement, market, and evaluate core components of its programming to reach nearly 3,000 students and 50 teachers. Museum educators will present hands-on activities in nearby schools, using real and replica artifacts and other learning materials. They will also deliver workshops for teachers at the museum to help them incorporate primary resources from the museum's collection into their curricula. A family day event will showcase what students learned from the in-class visit through displays of art projects and science posters. Other project activities will include free afterschool library programs exploring STEAM and history topics and an increase in the number of scholarships to the museum's summer camp program.
Sciencenter will use a co-development process to strengthen rural engagement with hands-on and inquiry-based STEM for families and children. The museum will initiate the project in partnership with Moravia Central School District and Groton Public Library. The project team will also collaborate with advisors who have expertise in reaching rural audiences. Project activities will increase the museum's understanding of rural communities' needs around STEM. The museum will work with additional rural partners to develop activities and programs that meet identified needs. An external evaluator will track project progress and measure results. This evaluator will also train the museum's staff on data collection and recording methods. Data analysis throughout the project will support changes in programs and activities as needed.
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Despite the rich scientific evidence of adaptations and their evolutionary basis, there are concerning public misconceptions about evolution, processes of natural selection, and adaptations in the biodiverse world. Such misconceptions begin early. Younger elementary school children are often resistant to the idea that one “kind” of animal could descend from a completely different kind of animal, and they see features as having always existed. Other misconceptions lead to an inaccurate belief that changes in individual organisms acquired in a lifetime are passed directly on to offspring or that entire populations transform as a whole. These cognitive biases and "intuitive” misunderstandings can persist into adulthood. This Innovations in Development project will counter that narrative through an informal science project focusing on the blue whale one of nature’s most spectacular stories of adaptation. It is a species that lives life at extremes: a long-distance migrator, a deep diver, an extravagant eater, the largest animal to ever exist. With its awe-inspiring size and rich mosaic of anatomical, physiological, and behavioral specializations, it serves as a bridge to an enriched understanding of universal concepts in elementary biology and can begin to dispel the deeply rooted misconceptions. The project deliverables include a giant screen film documenting the field work of research scientists studying the blue whales in the Indian Ocean and Gulf of Mexico; multi-platform educational modules and programs that will build on the blue whale content from the film for use in science center programs and rural libraries; and professional development webinars that will offer content utilization and presentation skills for ISE facilitators. Project partners include California Science Center, STAR Library Education Network, HHMI Tangled Bank Studios and SK Films.
The external evaluation studies will gather data from 20 participating rural libraries and 6 science museums. A formative evaluation of the film will be conducted in a giant screen theater setting with 75 families. After viewing a fine-cut version of the film they will complete age-appropriate post-viewing surveys on the film’s engagement, storytelling, content appeal and clarity, and learning value in communicating key science concepts. An external summative evaluation will include three studies. Study 1 will assess the implementation of the project at the 26 organizations, addressing the question: To what extent is the project implemented as envisioned in the libraries and science center settings? Baseline information will be collected, and later partners will complete post-grant surveys to report on their actual implementation of the project elements. In addition, the study will examine outcomes relating to professional development. Study 2 will be an evaluation of the film as experienced by 400 youth and parents in science centers and examining the question: To what extent does experiencing the film engage youth and parents and affect their interest, curiosity, and knowledge of blue whales, adaptations, and the scientific process? Study 3 will examine: To what extent and how does experiencing an educational module (virtual field trips, hands on activities, augmented reality) affect youth and parents’ interest, curiosity, and knowledge of adaptations and scientific process?
Children and their families are practicing STEAM (Science, Technology, Engineering, Arts, and Math) skills through a library program. Hand-crank generators and LED bulbs are set out on each of the tables, along with two types of dough—conductive play dough and insulating modeling clay.
DATE:
TEAM MEMBERS:
Brooks MitchellClaire RatcliffeKeliann LaConte
This project will teach foundational computational thinking (CT) concepts to preschoolers by creating a series of mobile apps to guide families through sequenced sets of videos and hands-on activities. To support families at home it would also develop a new library model to build librarians' computational thinking content knowledge and self-efficacy so they can support parents' efforts with their children. Computational thinking is a an increasingly critical skill for learning and success in the workforce. It includes the ability to identify problems, brainstorm and generate solutions and processes that can be communicated and followed by computers or humans. There are few projects that introduce computational thinking to young children. Very little research has been done on the ways that parents can facilitate children's engagement in CT skills. And developing a model that trains and supports librarians to become virtual coaches of parents as they engage with their children in CT, will leverage and build the expertise of librarians. The project's target audience includes parents and children living in rural areas where access to CT learning may be very limited. Project partners include the EDC, a major research organization, the American Library Association, and BUILD, a national association that promotes collaborations across library, kindergarten readiness, and public media programming.
The formative research study asks: 1) What supports do parents of preschoolers in rural communities need in order to effectively engage in CT with their children at home? and 2) How can libraries in rural communities support joint CT exploration in family homes? The summative research study asks: 3) how can an intervention that combines media resources, mobile technology, and library supports foster sustained joint parent/child engagement and positive attitudes around CT? Researchers will develop a parent survey, adapting several scales from previously developed instruments that ask parents to report on children's use of CT-related vocabulary and CT-related attitudes and dispositions. Survey scales will assess librarians' attitudes towards CT, as well as their self-efficacy in supporting parents in CT in a virtual environment. During the formative study, EDC will pilot-test survey scales with 30 parents and 6 librarians in rural MS and KY. Analyses will be primarily qualitative and will be geared toward producing rapid feedback for the development team. Quantitative analyses will be used on parent app use, using both time query and back-end data, exploring factors associated with time spent using apps. The summative study will evaluate how the new media resources and mobile technology, in combination with the library virtual implementation model, support families' joint engagement with CT, and positive attitudes around CT. The researchers will recruit 125 low-income families with 4- to 5-year-old children in rural MS and KY to participate in the study. They will randomly assign families within each library to the full intervention condition, including media resources, mobile technology, and library support delivered through the virtual implementation model, or the media and mobile-technology-only condition. This design will allow researchers to understand more fully the additional benefit of library support for rural families' sustained engagement, and conversely, see the comparative impact of a media- and mobile-technology only intervention, given that some families might not be able to access virtual or physical library support.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project is co-funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
There is a national need to expand opportunities to learn coding and computational thinking in informal science, technology, engineering, and mathematics (STEM) education. These skills are increasingly needed in STEM disciplines. As young people learn to code, they engage in computational thinking concepts and practices which are problem solving strategies that include repeated process (iterative) design skills. This project promotes innovation by designing and developing activities for tinkering spaces (a space filled with materials for hands-on exploration of STEM) combined with coding in informal learning organizations such as museums, and community centers. The project supports both tinkering and making as methods to meaningfully incorporate computational thinking in STEM learning experiences. The tinkering approach to learning is characterized by hands-on, trial and error engagement. Making is similar to tinkering with additional attention to learning with peer groups. The long-term goal of the project is to enable informal educators to engage in STEM programming with youth and families from underrepresented groups. The project brings together interdisciplinary teams from the Department of Information Science at the University of Colorado Boulder (CU Boulder), the Tinkering Studio at the Exploratorium, and the Lifelong Kindergarten research group at the Massachusetts Institution of Technology. In collaboration with local partner sites, the project team will design and disseminate a collection of six computational tinkering activity areas that engage learners in creative explorations using a combination of physical objects and computational code. The team will develop visual coding "microworlds" for each of the activity areas, specialized sets of coding blocks designed to provide scaffolding. Additionally, the project team will design and develop facilitation guides to document these activities and facilitation strategies, as well as workshops to better support facilitators in making and tinkering spaces.
The project enhances knowledge building through investigations of what instructional supports informal educators need to develop effective facilitation practices that engage underrepresented youth and families in STEM computational learning experiences. Study participants will include informal educators in museum, library, and community-based settings with varying backgrounds and experiences facilitating computing activities. The project team will also engage youth and families from underrepresented groups through collaborative efforts with community-based partners. Research questions include: 1) What challenges and barriers do informal learning educator, face to engage their learners in design-based activities with computing? 2) What supports informal learning educators to take on key facilitation practices that support children and families in computational tinkering activities? 3) In jointly engaging in these computational tinkering activities, how do the activities and informal learning educators? facilitation of these activities impact children's and families' development of computational tinkering and identities as creators and learners with computing? To answer these research questions the project will use qualitative ethnographic methods to study the developing interactions between learners and facilitators at three local sites. Comparative case studies of facilitators across the local partner sites will also be used to examine what supports facilitators to take on key facilitation practices. Data sources will include participant observation of facilitators and families, documentation in the form of photos, videos, and audio recordings, project artifacts, bi-monthly short surveys with reflective prompts, and interviews with facilitators and families.
This award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The Space Science Institute’s (SSI) National Center for Interactive Learning (NCIL), in partnership with the American Society for Civil Engineers (ASCE) and the University of Virginia (UVA), was awarded a grant from the National Science Foundation (NSF) to develop and implement a 3-year program, Project BUILD (Building Using an Interactive Learning Design). Project BUILD aims to bring together public library staff from six libraries (three rural and three urban) and professional engineers from ASCE to engage youth in grades 2-5 and their families in age-appropriate, technology-rich