The following summative report describes overarching evaluation findings from the evaluation of Leap into Science, including future considerations for the Leap into Science program team (program team). The report aims to summarize takeaways from 2018-2023 and report on overall insights pertaining to the core evaluation questions of interest.
This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
The Discovery Center at Murfree Spring, in partnership with six science centers and museums, will promote and invest in science education in rural communities with limited museum access. This coalition will work with two cohorts of rural school communities (12 total) and focus on engaging, learning from, and supporting rural school districts, teachers, families, and communities through relationship building, asset mapping, and the collaborative integration and implementation of museum resources. Additional activities include the production of publications, virtual presentations, and a virtual tool kit. The project will illustrate the ways in which museums can collaborate to support STEM and literacy at the K-2 level, enhance teacher self-efficacy, attitudes and beliefs, and engage family and community, strengthening services for Americans who live in the most rural areas.
The Louisiana Children’s Museum is developing a comprehensive set of resources entitled “Water Dialogues–Living with Water,” designed around its new exhibits and landscape resources, to strengthen the community’s understanding of the challenges associated with water management. They are creating a new field trip series and water-based science curriculum, “Water Pathways” as well as an outreach program, “Steward’s Ship,” to bring the program’s environmental messages to schools and camps. The museum will also conduct a professional development training series on science education for local educators implementing the state’s new science standards, in addition to a series of literacy workshops where children ages four to eight will write “how-to” books and “water journals.” To further spread the associated environmental and sustainability messages, they will organize an annual “Water Fest” program for the community.
The Jackson Hole Children’s Museum will expand its K–5th grade STEAM programs, which serve more than 1,300 students in Teton County School District #1. The STEAM programs provide inquiry-based, hands-on programming to all K–5 District students in accordance with the Wyoming State Science Standards. An additional 500 students are reached through homeschool groups, summer school, childcare and therapy organizations, and nearby Idaho schools. Each two-hour program opens with interactive, student-centered, scientific method lab stations. Students are then challenged to use newly acquired vocabulary and knowledge to complete a hands-on building project. The program is designed to contribute to increasing science and engineering literacy in the community and to support the development of students’ 21st century skills.
The Pensacola MESS Hall will create and deliver “Science Sprouts”—a four-session classroom program for kindergarten students, including related professional development for teachers. The program will focus on 10 underserved elementary schools in the community, providing students and teachers access to quality math, engineering, and science experiences. Trained museum educators will engage children in hands-on exploration while engaging teachers in effective methods to enhance classroom learning. The lessons will include a story followed by small group activities that reinforce key concepts. To increase the teachers’ comfort in program delivery and application to other curricular units, the activities will utilize common materials and connect to children’s literature.
This Masters project consists of two elements: 1) an integrated after-school program to improve student English language reading and academic outcomes for third graders' vocabulary development by incorporating music, artistic creativity and linguistics; 2) a pilot sample curriculum that demonstrates the approach for building student comprehension through musical theater and Science, Technology, Engineering, and Mathematics (STEM) content experiences. Called "Water Buddy", this is an after-school program uses singing, dancing, writing, and play to build reading and vocabulary skills. The goal
Future educational robots are emerging as social companions supporting learning. By socially interacting with such a robot, learners can potentially reason and talk about the things they are learning and receive help in seeing the relevance of STEM in their daily lives. However, little is known about how to design educational robots to work with youth at home over a long period of time. This project will develop an informal science learning program, called STEMMates, in collaboration with a local community center, for youth with little interest in science. The program will partner learners with an in-home learning companion robot, designed to read books with youth and provide science activities for them at the community center, where youth will engage in exciting and personally relevant science learning. As the learner reads books, the robot will make comments about what is happening in the book to help connect the reading to the science activities at the community center. The overarching goals of STEMMates are to: (a) positively support youth's individual interest in science and future science learning, (b) connect in-home learning experiences with out-of-school community-based learning, (c) bridge the gap between formal and informal engagement and learning in science, and (d) encourage the participation of youth who are underrepresented and who have low interest in STEM learning. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to and evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments.
Researchers will work with youth and staff at the community center, alongside experts in informal science learning, to design the program and then test how learners respond to reading with the robot and participating in the science activities and whether this program has a lasting impact on their science interest. Social interactions with a robot may help distribute cognitive load during learning activities to help youth reason about STEM and also supplement learning by improving feelings of value and belongingness in order to facilitate lasting interest development. Following a mixed-methods research approach using qualitative and quantitative data-collection techniques, the research team will investigate the following research questions: (1) What social and interest-development supports and activities can be utilized as socially situated interest scaffolds in an informal and in-home, augmented reading and science activity program to promote individual interest and learning in science for low interest learners? How can a social robot best facilitate this program? (2) How do learners perceive and interact with the robot in authentic, in-home, long-term situations, and how does this interaction change over time? (3) Does working with a robot designed with socially situated interest scaffolds increase individual interest in science when compared to a pre-intervention baseline, and do these effects impact future (long-term) interest and engagement in formal science learning? To answer these research questions, researchers will implement the science learning program during an 11-week summer deployment and utilize an AB single-case research design. Interview-based qualitative data and self-report surveys to examine the learner?s perception of the robot and their evolving interest in science and quantitative data on science learning using pre-/post-measure comparisons will be collected. Log data of time-on-task, reading rate, book selection and reading goal attainment will also be collected by the robot. The outcomes of this project will lay the groundwork for future investigations of the design of social robots for a diversity of learner populations and their use in different informal learning settings.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will develop a national infrastructure of state and regional partnerships to scale up The Franklin Institute's proven model of Leap into Science, an outreach program that builds the capacity of children (ages 3-10) and families from underserved communities to participate in science where they live. Leap into Science combines children's science-themed books with hands-on science activities to promote life-long interest and knowledge of science, and does so through partnerships with informal educators at libraries, museums, and other out-of-school time providers. Already field-tested and implemented in 12 cities, Leap into Science will be expanded to 90 new rural and urban communities in 15 states, and it is estimated that this expansion will reach more than 500,000 children and adults as well as 2,700 informal educators over four years. The inclusion of marginalized rural communities will provide new opportunities to evaluate and adapt the program to the unique assets and needs of rural families and communities.
The project will include evaluation and learning research activities. Evaluation will focus on: 1) the formative issues that may arise and modifications that may enhance implementation; and 2) the overall effectiveness and impact of the Leap into Science program as it is scaled across more sites and partners. Learning research will be used to investigate questions organized around how family science interest emerges and develops among 36 participating families across six sites (3 rural, 3 urban). Qualitative methods, including data synthesis and cross-case analysis using constant comparison, will be used to develop multiple case studies that provide insights into the processes and outcomes of interest development as families engage with Leap into Science and a conceptual framework that guides future research. This project involves a partnership between The Franklin Institute (Philadelphia, PA), the National Girls Collaborative Project (Seattle, WA), Education Development Center (Waltham, MA), and the Institute for Learning Innovation (Corvallis, OR).
In prior research and development, the project team developed a StoryWorld, a computer-based intervention for English Learners (ELs) that presents children oral and written narratives in English while also providing the information in their first language. With this Phase I funding, the team will develop and test a prototype of a web-based dashboard that provides EL teachers real-time reports on children's progress in areas including for vocabulary, comprehension, fluency, and proficiency. At the end of Phase I, in a pilot study in three first grade classrooms, the researchers will examine whether the prototype functions as planned, is easy to use, and provides information teachers can understand and use to inform their language and literacy instruction?
Maker Corps is a program delivered by the Maker Education Initiative (Maker Ed) to increase organizational capacity to develop and deliver maker programing. Since its inception in 2013, the program has grown to support over 100 organizations by providing professional development, connections to a community of other maker educators and individualized support. Over time the program elements have changed in response to feedback from participants, collaboration with evaluators and shifts in focus for Maker Ed’s goals. In the spirit of maker education – tinkering, observing, responding, iterating –