This project will teach foundational computational thinking (CT) concepts to preschoolers by creating a mobile app to guide families through sequenced sets of videos and hands-on activities, building on the popular PBS KIDS series Work It Out Wombats!
DATE:
-
TEAM MEMBERS:
Marisa WolskyJanna KookJessica Andrews
resourceevaluationProfessional Development, Conferences, and Networks
This document is the final evaluation report for the Teen Science Cafes for Advancing STEM in Rural Places project.
A Teen Science Café is a free, regularly occurring event during the school year in which a local scientist, engineer, or STEM expert discusses their field experiences with the teen attendees. Ideally, a Teen Leader cohort, under the mentorship of an Adult Leader, organizes and implements each Café.
The Teen Science Café Network is a community of practice linking the various youth-serving organizations, institutions, community settings, and individuals that host Teen Science
The Discovery Center at Murfree Spring, in partnership with six science centers and museums, will promote and invest in science education in rural communities with limited museum access. This coalition will work with two cohorts of rural school communities (12 total) and focus on engaging, learning from, and supporting rural school districts, teachers, families, and communities through relationship building, asset mapping, and the collaborative integration and implementation of museum resources. Additional activities include the production of publications, virtual presentations, and a virtual tool kit. The project will illustrate the ways in which museums can collaborate to support STEM and literacy at the K-2 level, enhance teacher self-efficacy, attitudes and beliefs, and engage family and community, strengthening services for Americans who live in the most rural areas.
The University of Montana spectrUM Discovery Area will implement “Making Across Montana” —a project to engage K–12 students and teachers in rural and tribal communities with making and tinkering. In collaboration with K–12 education partners in the rural Bitterroot Valley and on the Flathead Indian Reservation, the museum will develop a mobile making and tinkering exhibition and education program. The exhibition will be able to travel to K–12 schools statewide. The project team will develop a K–12 teacher professional development workshop, along with accompanying curriculum resources and supplies. The traveling program and related materials will build schools’ capacity to incorporate making and tinkering—and informal STEM experiences more broadly—into their teaching.
This project is designed to support collaboration between informal STEM learning (ISL) researchers, designers, and educators with sound researchers and acoustic ecologists to jointly explore the role of auditory experiences—soundscapes—on learning. In informal STEM learning spaces, where conversation advances STEM learning and is a vital part of the experience of exploring STEM phenomena with family and friends, attention to the impacts of soundscapes can have an important bearing on learning. Understanding how soundscapes may facilitate, spark, distract from, or even overwhelm thinking and conversation will provide ISL educators and designers evidence to inform their practice. The project is structured to reflect the complexity of ISL audiences and experiences; thus, partners include the North Park Village Nature Center located in in a diverse immigrant neighborhood in Chicago; Wild Indigo, a Great Lakes Audubon program primarily serving African American visitors in Midwest cities; an after-school/summer camp provider, STEAMing Ahead New Mexico, serving families in the rural southwest corner of New Mexico, and four sites in Ohio, MetroParks, Columbus Zoo and Aquarium, Franklin Park Conservatory and Botanical Gardens, and the Center of Science and Industry.
Investigators will conduct large-scale exploratory research to answer an understudied research question: How do environmental sounds impact STEM learning in informal learning spaces? Researchers and practitioners will characterize and describe the soundscapes throughout the different outdoor and indoor exhibit/learning spaces. Researchers will observe 800 visitors, tracking attraction, attention, dwell time, and shared learning. In addition to observations, researchers will join another 150 visitors for think-aloud interviews, where researchers will walk alongside visitors and capture pertinent notes while visitors describe their experience in real time. Correlational and cluster analyses using machine learning algorithms will be used to identify patterns across different sounds, soundscapes, responses, and reflections of research participants. In particular, the analyses will identify characteristics of sounds that correlate with increased attention and shared learning. Throughout the project, a team of evaluators will monitor progress and support continuous improvement, including guidance for developing culturally responsive research metrics co-defined with project partners. Evaluators will also document the extent to which the project impacts capacity building, and influences planning and design considerations for project partners. This exploratory study is the initial in a larger research agenda, laying the groundwork for future experimental study designs that test causal claims about the relationships between specific soundscapes and visitor learning. Results of this study will be disseminated widely to informal learning researchers and practitioners through workshops, presentations, journal articles, facilitated conversations, and a short film that aligns with the focus and findings of the research.
DATE:
-
TEAM MEMBERS:
Martha MersonJustin MeyerDaniel Shanahan
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
ECHO, Leahy Center for Lake Champlain will increase its capacity to serve rural schools through programming opportunities under its STEM in Motion 2.0 program. In partnership with rural schools, they will conduct two year-long teacher institutes blending in-person and virtual professional development. They plan to develop a total of 270 in-person and virtual classroom STEM programs and produce 18 classroom curriculum kits and standard-activity aligned guides. As a result of STEM in Motion 2.0’s activities, the museum anticipate that 54 teachers will have additional capacity to deliver high-quality STEM learning experiences to K–5th grade students in underserved, rural communities.
Sciencenter will use a co-development process to strengthen rural engagement with hands-on and inquiry-based STEM for families and children. The museum will initiate the project in partnership with Moravia Central School District and Groton Public Library. The project team will also collaborate with advisors who have expertise in reaching rural audiences. Project activities will increase the museum's understanding of rural communities' needs around STEM. The museum will work with additional rural partners to develop activities and programs that meet identified needs. An external evaluator will track project progress and measure results. This evaluator will also train the museum's staff on data collection and recording methods. Data analysis throughout the project will support changes in programs and activities as needed.
This project addresses a longstanding problem in informal science education: how to increase the likelihood of consequential science, technology, engineering, and mathematics (STEM) learning from short duration experiences such as field trips. Although informal learning experiences can greatly contribute to interest in and knowledge of science, there is a shared concern among educators and researchers that students may have difficulty recalling and using scientific information and practices emphasized during these experiences, even though doing so would further their science learning. Nonetheless, science learning is rarely, if ever, a "one-shot deal." Children acquire knowledge about science cumulatively across different contexts and activities. Therefore, it is important that informal science learning institutions identify effective practices that support the consolidation of learning and memory from exhibit experiences to foster portable, usable knowledge across contexts, such as from informal science learning institutions, to classrooms, and homes. To this end, this Research in Service to Practice project seeks to harness the power and potential of visual representations (e.g., graphs, drawings, charts, maps, etc.) for enhancing learning and encouraging effective reflection during and after science learning experiences. The project promises to increase learning for the 9,000+ 5th and 6th grade students from across the rurality and growing diversity of the state of Maine who annually participate in LabVenture, a 2.5-hour exploration of the Gulf of Maine ecosystem at Gulf of Maine Research Institute. The research will provide new and actionable informal science learning practices that promote engagement with visual representations and reflection, and science understandings that can be applied broadly by informal science institutions. This project is funded by the Advancing Informal STEM Learning (AISL) and the Discovery Research PreK-12 (DRK-12) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the DRK-12 program goal of enhancing the learning and teaching of STEM by preK-12 students and teachers.
The project is grounded in the idea that visual representations, including drawings, can both enhance science learning and encourage reflection on doing science that can support extension of that learning beyond a singular informal science experience. The project uses design-based research to address the following research questions: (1) Does reflection during an informal science learning experience promote students’ retention and subsequent use of science information and practices that are part of the experience? (2) Does interpreting and constructing visual representations, such as drawings, improve students’ understanding and retention of information, and if so, how and when? and (3) Does combining visual representations and narrative reflections confer benefits on students’ science learning and engagement in science practices both during the informal learning experience, and later in their classrooms and at home? These questions will be pursued in collaboration with practitioners (both informal educators and classroom teachers) and a diverse team of graduate and undergraduate student researchers. Approximately 600 student groups (roughly 3000 individual students) will be observed during the LabVenture experience, with further data collection involving a portion of these students at school and at home. The project will yield resources and video demonstrations of field-tested, empirically based practices that promote engagement with visual representations and reflection, and science understandings that can travel within students' learning ecosystem. In support of broadening participation, the undergraduate/graduate student researchers will gain wide understanding and experience connecting research to practice and communicating science to academic and nonacademic audiences.
Although approximately one-quarter of U.S. students reside in rural communities, rural youth are fifty percent less likely to receive and engage in out-of-school STEM experiences than their urban counterparts. In addition, there has been significantly more investment in understanding and improving informal experiences in urban settings than in rural settings. As a result, there is less known about the characteristics of learning ecosystems and programs that support STEM learning for youth in informal contexts within rural communities. This Research in Service to Practice project aims to address this challenge by exploring the feasibility of a culturally relevant and sustaining STEM program designed specifically for rural youth and their families. Parents and caregivers play a critical role in fostering youths’ interests and persistence in STEM through their own engagement and by connecting them to STEM opportunities and STEM-related fields and career pathways. Through a partnership between the High Desert Museum in Oregon, the Institute for Learning Innovation, Maine Mathematics and Science Alliance, JKS Consulting, and three informal science education institutions, a year-long series of STEM-based workshops and experiences for youth and their families will be co-designed by members of the rural community, informal STEM educators, and STEM professionals and implemented within the rural communities of the participating informal science education institutions—Caddo Mounds State Historic Site Weeping Mary (TX), High Desert Museum (OR), Oregon Coast Aquarium, and The Wild Center (NY). Each series will reflect the cultural knowledge, connections, and resources specific to each rural community. In addition, the informal STEM educators and STEM professionals will receive training on facilitating the culturally sustaining workshops and experiences. Researchers at the Institution for Learning Innovation and the Maine Mathematics and Science Alliance together with the evaluator at JKS Consulting will employ a collaborative design-based research approach to identify and study the STEM learning practices and supports that occur within the program to promote youths’ interests and persistence in STEM. The findings will offer evidence-based insights to the field on how to better engage, reflect, and provide opportunities for diverse rural communities. Ultimately, this research has the potential to advance the current understanding thereby, strengthening rural STEM learning ecosystems and broadening STEM participation among youth in rural communities.
Over a four-year project duration, a collaborative design-based research approach will be employed to address the following research questions: (1) How does culturally sustaining informal STEM programming for families in rural communities contribute to increases in youth STEM persistence? (1a) How might this vary in relation to family and community factors? (2) How does culturally sustaining informal family STEM programming increase community connectivity between STEM-related resources and institutions across informal and formal learning contexts in rural communities leading to a more robust and inclusive STEM learning ecosystem? (2a) To what extent do participating families, informal STEM educators, STEM professionals, and community partners each play a role in increasing this connectivity? The research sample will include 300 families with youth ages 8-11, informal science educators, and STEM professionals across all four sites. Surveys, interviews and observations will be the primary data sources. Analysis of Variance and simple descriptive statistical analysis will be used to analyze the quantitative data. The qualitative data will be analyzed using thematic coding through NVivo. In addition, to complement the research data, JKS Consulting will conduct the formative and summative evaluations of the project to hone effective practices for training informal science learning practitioners in developing and implementing place-based, inquiry-based family learning in rural communities and effective and sustainable practices for engaging rural families in place-based STEM. Findings from the research will be made available and widely distributed in publications, conference presentations, and a multi-part Research to Practice Toolkit designed for parents and caregivers, informal science educators, STEM professionals, and the informal education field at large.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program.
This project will scale up fully virtual or face-to-face STEM professional development to afterschool educators in both urban and rural settings. Given that many afterschool educators have little or no background in STEM education, there is demand for professional development that is effective, inexpensive, and accessible. This project will build national capacity in STEM education by developing the STEM skills of over 1,500 educators across multiple states and will ultimately impact over 31,000 under-represented youth in these areas. The project will also deliver robust materials through a free open-source mechanism, for use by educators anywhere and anytime. The project will broaden participation in STEM by engaging community educators in the rural parts of the nation, a critically under-represented group in STEM. It will also reach educators from low-income urban communities across three states and seven cities, targeted through strategic networks and partnerships, including organizations such as the YMCA, 4-H, and the National Afterschool Association.
This collaborative project is scaling the ACRES model (Afterschool Coaching for Reflective Educators in STEM). The model humanizes the virtual experience, making it social and engaging, and allows educators to learn, share, and practice essential STEM facilitation skills with a focus on making STEM relevant and introducing STEM careers to youth. In addition to enhancing the professional STEM skills of rural and urban educators, the project will create a national cohort of coaches with deep expertise in (i) converting in-person activities for youth into a highly engaging, choice-rich online format, (ii) engaging isolated informal educators in supportive professional learning communities, and (iii) coaching foundational research-based STEM facilitation skills that ensure these activities are pedagogically sound. A key part of this broad implementation project involves studying how to integrate an effective professional development program into afterschool organizations, including the ways afterschool programs adapt the materials to be culturally responsive to their local communities. The researchers will also study factors contributing to the longer-term sustainability of the program. The research will use surveys, interviews, direct observations, and case studies of participants to provide the field with valuable insights into scaling a program in the afterschool world.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for extending access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Parents and adult caregivers play a significant role in young children's understanding of (and participation in) science, technology, engineering, and mathematics (STEM). Research suggests that early engagement with STEM can have a profound impact on children's use of STEM process skills such as exploration, observation, and problem-solving, as well as future academic success. An immediate yet ongoing challenge facing informal STEM learning providers is to understand how limited resources can be used to support effective STEM learning opportunities and experiences for all children and families. Through a collaboration between researchers, Head Start, two science centers (one rural, one urban), and educators, this project aims to foster STEM access and engagement with specific attention to young children and their caregivers. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This Pilot and Feasibility study will apply an experimental, mixed-methods design to examine parent/caregiver and child (ages 4-5) interactions before, during, and after informal STEM experiences to identify which factors influence children's transfer of learning STEM process skills across multiple informal contexts. Research results will lay the foundation for a future longitudinal study. The project team will ask: (1) What types of parent/caregiver-child engagement at the science center are most predictive of children's application of STEM process skills in subsequent problem-solving tasks and school readiness? (2) How do variations in parent/caregiver-child conversational strategies during the science center visit influence children's memory and learning? and (3) How can informal educators best support Head Start family engagement and children's emerging STEM knowledge? This study will collect data on 240, 4-5-year-old children, with their caregivers, in two different science centers that serve a largely rural and largely urban population. Data sources will include video/audio of caregiver-child interactions at the science centers and at home, as well as children's recall, engagement with a problem-solving task, and school readiness scores. Coding and analysis of the tasks during and after the science center visit will detail mechanisms underlying children's memory, learning, and application of STEM process skills that transfer to the problem-solving task. The project will be implemented by a research-practice partnership, leveraging the expertise of project partners and communities to ensure the use of culturally responsive research practices. This research has the potential to strategically impact how science centers and Head Start grantees work together on Family Engagement programming to achieve equitable STEM learning opportunities, broadening participation for low-income young children and their families.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.