In July 2020, Dr. Brigid Barron and her team at Stanford University’s Graduate School of Education and the Joan Ganz Cooney Center convened a virtual workshop to mobilize a community of investigators to explore innovative methods for studying family and community learning during the pandemic. Participants included NSF RAPID-COVID grantees from Stanford University, University of Washington, and the University of Michigan.
This report summarizes the strategies and insights generated at this workshop so that they may be shared among a wider network of researchers, practitioners, funders, and
This award is funded in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
This project will create the specification for a learner-controlled system to represent youth learning in Out-of-School-Time (OST) settings, to improve access to future Science, Technology, Engineering, and Mathematics (STEM) learning opportunities. For learners to pursue a STEM education, and STEM careers, they must be able to move through "gatekeeping" mechanisms that filter and sort students based on factors such as prior coursework and grades, teacher recommendations, and language proficiency assessments. Even though abundant evidence shows that such measures fail to capture all important aspects of STEM learning, they are traditionally relied upon in secondary and post-secondary STEM education contexts as indicators of preparation for future STEM learning. These systemic processes exclude certain minoritized groups, including Black, Indigenous, and other people of color (BIPOC), low income, immigrant and refugee youth, and youth learning English, from high-quality secondary and post-secondary STEM learning experiences because existing measures do not validate their prior knowledge and experiences. Yet, minoritized youth often engage in OST STEM learning opportunities, where their readiness for future learning opportunities is nurtured and valued. One challenge is to reliably document this readiness in a usable format so youth can access new STEM learning opportunities, especially in post-secondary contexts. This project builds strategically upon earlier work focusing on the democratization of STEM learning through vehicles such as digital micro-credentials or badges, and upon digital portfolios. Missing from these earlier efforts was integration of these platforms with an infrastructure that connected youth learners to OST STEM learning organizations and to future STEM learning opportunities. This Innovations in Development project brings together minoritized youth and their families, OST providers, and admissions officials from higher education institutions to explore the needed design features for OST "transcripts," and user stories that describe how software systems can support their creation and sharing. Grounded in the concept of mastery-based learning, where learning is demonstrated via action, learners will control what is included in the transcript so that they create their own narratives about their learning experiences. Recognizing that documentation is not the key focus of most STEM OST organizations, this project will provide direct support for identifying and codifying learning goals or outcomes that learners and their families find relevant and important within different STEM activities. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The project will take a Design-Based Implementation Research (DBIR) approach and proceed by convening representatives from three main stakeholder groups (youth and their families, OST providers, and admissions staff) to engage in a series of discovery and design activities. Project partners, including the Mastery Transcript Consortium (MA), STEAMville (IL), STUDIO (WA), and Wolverine Pathways (MI), will work together with the PIs to design templates learners can use to characterize STEM learning from each provider, aligned with different STEM learning foci (e.g., computer science, computational thinking, cross-cutting concepts, science and engineering practices, and mathematics). Data collected from these sessions will be used to address the following research questions: (1) How and why do youth and families from minoritized communities understand and choose to participate in STEM OST learning opportunities?, (2) How do youth understand and interact with STEM OST learning opportunities?, (3) How do OST providers characterize the STEM learning goals in the activities they provide?, and (4) How do college admissions personnel view the role of informal STEM learning as part of a holistic admissions process? This work has the potential to further the understanding of how OST learning can be documented and shared as a part of the larger ecosystem of STEM learning trajectories. By deeply engaging the perspectives and voices of minoritized youth and families, this project seeks to develop a valid and trustworthy instrument that recognizes and serves their STEM learning, thus broadening the participation of minoritized youth in STEM education and careers. This work will also benefit OST providers, by translating the documentation of youth STEM learning into forms that may help communicate the efficacy of their programs in ways that further their missions, including communicating evidence of effectiveness to both future participants and funders.
Early childhood is a critical time for developing foundational knowledge, skills, and interest in science, technology, engineering, and mathematics (STEM). For that reason, the Public Broadcasting Service (PBS) places a great priority on developing early childhood STEM content, especially through its television shows that are watched by over 60% of young children in the United States. Research suggests that adding in-the-moment interaction to television watching promotes learning and engagement. Toward this end, researchers from the University of California, Irvine and PBS KIDS have prototyped interactive versions of science shows that children view on internet-connected devices while they communicate with the main character powered by an AI conversational agent. Pilot studies show that when children watch these new interactive videos with the main character pausing periodically to ask probing questions about the learning goals of the episode and following up with appropriate responses, they are more engaged and learn more about science, with heightened benefits for children who speak languages other than English at home. Based on these early results, in this Innovations in Development project the research team will develop, test and produce publicly available conversational episodes for two PBS KIDS television shows, one focused on science and the other on computational thinking.
The project will iteratively study and develop six conversational videos with novel forms of support for children, including extended back-and-forth conversation that builds upon a child's responses, visual scaffolding that facilitates verbal communication, and bilingual language processing so that children can answer in English or Spanish. The conversational videos will be evaluated in both lab-based and home settings. The lab-based study will involve 600 children ages 3-7 in a predominantly low-income Latino community in Southern California, in which researchers compare children’s learning and engagement when watching the conversational videos with three other formats: (1) watching the non-interactive broadcast version of the video; (2) watching the video with pseudo-interaction, in which the main character asks questions and gives a generic response after a fixed amount of time but can’t understand what the child says; or (3) watching the broadcast version of the video with a human co-viewer who pauses the video and asks questions. The home-based study will involve 80 families assigned to watch either the non-interactive or interactive videos as many times as they want over a month at home. In both the lab-based and home studies, pre- and post-tests will be used to examine the impact of video watching on science and language learning, and log data will be used to assess children’s verbalization and engagement while watching. Following the home study, the six videos will be further refined and made available for free to the public through the PBS KIDS apps and website, which are visited by more than 13 million users a month. Beyond providing engaging science learning opportunities to children throughout the country, this study will yield important insights into the design, usability, feasibility, and effectiveness of incorporating conversational agents into children’s STEM-oriented video content, with implications for extending this innovation to other educational media such as e-books, games, apps, and toys.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Mark WarschauerSilvia LovatoAndres BustamanteAbby JenkinsYing Xu
Cyberchase: Mobile Adventures in STEM is designed to advance the STEM learning of children ages 6-8 and engage low-income families in informal STEM interactions. Based on a successful NSF-funded pilot, the project combines the appeal of the PBS KIDS series Cyberchase and the potential of mobile texting to deliver informal learning. WNET and Education Development Center will produce: three Cyberchase videos that blend math and environmental content; a bilingual family engagement campaign in 15 communities across the U.S. that combines this media with weekly text-based engagement; and research into use and impact of the model among low-income Latinx families. Mobile Adventures addresses the need to better engage underserved families in informal science practices that are foundational for future STEM learning. While the materials target low-income communities broadly, research will focus on low-income Latinx families with children ages 6-8, an age group overlooked in previous research on educational uses of texting. A needs assessment and formative testing will ensure that the project design meets the needs and interests of diverse Latinx and other families.
The goal of Mobile Adventures is to build knowledge about how innovative, culturally responsive tools can help Latinx and low-income families engage in fun STEM learning at home. A three-tiered research study will address the question: how and to what extent does a mobile text-and-media approach to delivering informal STEM learning materials foster joint media engagement between children and parents, building new repertoires for learning together? The study will combine analysis of observation in homes and community settings, backend data, and pre/post surveys. Research will deepen understanding of effective family engagement models that make media a central component, the potential of text messaging as a stimulus to parent/child STEM learning, and maximal design of media and community engagement to serve low-income Latinx families. Findings will be disseminated through national conferences and journals. The Cyberchase videos, distributed free on broadcast and digital platforms, will build the STEM literacy of millions of diverse children, while the family engagement campaign will involve a projected 3,750 families in 15 locations. Evaluation will assess how well the project has met its goals.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
Families play a vital role in supporting children’s informal science learning. Yet multiple studies have shown that Latinx families, particularly in neighborhoods with a high poverty rate, face many barriers to accessing informal science experiences and environments. Telenovelas, a type of television serial drama watched by Spanish-speaking audiences around the world, may provide an entryway to reaching these families. Prior research has shown that telenovelas can be an effective means of changing adults’ behavior, with potential cascading impacts on children. Education Development Center, Literacy Partners, and Univision will use a culturally responsive approach to broaden participation of Latinx families in informal science learning using La Fuerza de Creer, a popular Spanish-language telenovela that reaches 7 million U.S. viewers. The five-episode telenovela series will model positive informal science interactions between caregivers and their children and provide positive role models of Latinx scientists. The project team will then use the telenovela as the foundation for a five-session workshop series for caregivers to further explore how to engage in these informal science learning opportunities with their children. The La Fuerza-STEM project will build on families’ strengths and interests and tap their power—la fuerza—to engage children in exploring science. This research will examine the relationship between the telenovela/workshops and caregivers’ practices and attitudes towards science. La Fuerza-STEM seeks to expand informal science learning using a culturally grounded strategy to engage an under-served population that is historically under-represented in STEM.
The project will use an iterative research and design process that is guided by the input of both parent and scientific advisory boards. Front-end formative research with approximately 30 Latinx caregivers from under-resourced communities will explore their informal science practices. These experiences will then inform script development for the telenovela. A pre-post comparison group study with 200 caregivers will investigate how caregivers’ attitudes toward science might change as a result of viewing the telenovela. The project will then build a 5-session workshop series around the telenovela and these research findings. Finally, 300 caregivers will participate in a randomized controlled trial to examine the efficacy of the La Fuerza-STEM workshops on changing caregivers’ informal science attitudes and practices. Throughout, the project will address the overarching research question, How can a culturally relevant telenovela be used to improve Latinx caregivers’ science self-efficacy, career awareness, and informal science practices? Project findings and products will be publicly disseminated through publications, conference presentations, and local partner organizations, with an eye toward open access and data sharing. The project will generate knowledge about the effectiveness of embedding informal science content in a culturally-grounded medium—the telenovela—in improving caregivers’ confidence and competence to engage in informal science learning experiences with their children. With an anticipated audience of 7 million, the potential impact of the telenovela on caregivers’ informal science attitudes and practices is enormous. By implementing workshops with local organizations, the project aims to be self-sustaining, building the capacity of community partners to provide families with services targeting informal science knowledge and skills long after the grant has ended.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Joy KennedyJessica YoungAlexia RaynalAnthony Tassi
The U.S. urgently needs the perspective and knowledge of females who are Latinx and African American in STEM fields. Providing early STEM interest pathways for these populations that are historically underrepresented in STEM fields is critical to creating gender equity in the STEM workforce. There are profound inequities in STEM fields for women of color that impact their interest and persistence in these fields. This Research in Service to Practice project will build important knowledge about early pathways for reducing these inequities by developing early interest in STEM. Gender stereotypes around who can do STEM are one of the sociocultural barriers that contributes to girls’ loss of interest in STEM. These stereotypes emerge early and steer young women away from STEM studies and pursuits. Exposing girls to role models is an effective strategy for challenging stereotypes of who belongs and succeeds in STEM. This project will explore how an afterschool program that combines narrative and storytelling approaches, STEM role models, and family supports, sparks elementary-age girls’ interest in STEM and fosters their STEM identity. The project targets K-5 students and families from underrepresented groups (e.g., Latinx and African American) living in poverty. The project will evaluate an inquiry-based, afterschool program that serves both elementary school girls and boys and explores if adding storytelling components to the out-of-school time (OST) learning will better support girls’ interest in STEM. The storytelling features include: 1) shared reading of books featuring females in STEM; 2) students’ own narratives that reminisce about their STEM experiences; and 3) video interviews of female parents and community members with STEM careers. A secondary aim of this project is to build capacity of schools and afterschool providers to deliver and sustain afterschool STEM enrichment experiences. Museum-based informal STEM experts will co-teach with afterschool providers to deliver the Children’s Museum Houston (CMH) curriculum called Afterschool Science, Technology, Engineering, Arts and Math (A’STEAM). Although A’STEAM has been implemented in over 100 sites and shows promise, to scale-up this and other promising afterschool programs, the team will evaluate how professional development resources and the co-facilitation approach can build afterschool educators' capacity to deliver the most promising approaches.
Researchers at the Children’s Learning Institute (CLI) at UTHealth will partner with Museum-based informal STEM educators at CMH, YES Prep, a high performing charter school serving >95% of underrepresented groups, and other afterschool providers serving mostly underrepresented groups experiencing poverty. Storytelling components that highlight females in STEM will be added to an existing afterschool program (A'STEAM Basic). This derivative program is called A’STEAM Stories. Both instantiations of the afterschool programs (Basic and Stories) include an afterschool educator component (ongoing professional development and coaching), a family component (e.g., home extension activities, in-person, and virtual family learning events), and two age-based groups (K-G2 and G3-G5). Further, the A’STEAM Stories professional development for educators includes training that challenges STEM gender stereotypes and explains how to make science interesting to girls. The 4-year project has four phases. In Phase 1, researchers, CMH, and afterschool educators will adapt the curriculum for scalability and the planned storytelling variation. During Phase 2, the research team will conduct an experimental study to evaluate program impacts on increasing STEM interest and identity and reducing STEM gender stereotypes. To this end, the project’s team will recruit 36 sites and 1200 children across Kindergarten through Grade 5. This experimental phase is designed to produce causal evidence and meet the highest standards for rigorous research. The researchers will randomly assign sites to one of three groups: control, A’STEAM Basic, or A’STEAM Stories. During Phase 3, researchers will follow-up with participating sites to understand if the inclusion of afterschool educators as co-facilitators of the program allowed for sustainability after Museum informal science educator support is withdrawn. In Phase 4, the team will disseminate the afterschool curriculum and conduct two training-of-trainers for local and national afterschool educators. This study uses quantitative and qualitative approaches. Data sources include educator and family surveys, focus groups, and interviews as well as observations of afterschool program instructional quality and analysis of parent-child discourse during a STEM task. Constructs assessed with children include STEM interest, STEM identity, and STEM gender stereotype endorsement as well as standardized measures of vocabulary, science, and math. Findings will increase understanding of how to optimize OST STEM experiences for elementary-age girls and how to strengthen STEM interest for all participants. Further, this project will advance our knowledge of the extent to which scaffolded, co-teaching approaches build capacity of afterschool providers to sustain inquiry-based STEM programs.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Although approximately one-quarter of U.S. students reside in rural communities, rural youth are fifty percent less likely to receive and engage in out-of-school STEM experiences than their urban counterparts. In addition, there has been significantly more investment in understanding and improving informal experiences in urban settings than in rural settings. As a result, there is less known about the characteristics of learning ecosystems and programs that support STEM learning for youth in informal contexts within rural communities. This Research in Service to Practice project aims to address this challenge by exploring the feasibility of a culturally relevant and sustaining STEM program designed specifically for rural youth and their families. Parents and caregivers play a critical role in fostering youths’ interests and persistence in STEM through their own engagement and by connecting them to STEM opportunities and STEM-related fields and career pathways. Through a partnership between the High Desert Museum in Oregon, the Institute for Learning Innovation, Maine Mathematics and Science Alliance, JKS Consulting, and three informal science education institutions, a year-long series of STEM-based workshops and experiences for youth and their families will be co-designed by members of the rural community, informal STEM educators, and STEM professionals and implemented within the rural communities of the participating informal science education institutions—Caddo Mounds State Historic Site Weeping Mary (TX), High Desert Museum (OR), Oregon Coast Aquarium, and The Wild Center (NY). Each series will reflect the cultural knowledge, connections, and resources specific to each rural community. In addition, the informal STEM educators and STEM professionals will receive training on facilitating the culturally sustaining workshops and experiences. Researchers at the Institution for Learning Innovation and the Maine Mathematics and Science Alliance together with the evaluator at JKS Consulting will employ a collaborative design-based research approach to identify and study the STEM learning practices and supports that occur within the program to promote youths’ interests and persistence in STEM. The findings will offer evidence-based insights to the field on how to better engage, reflect, and provide opportunities for diverse rural communities. Ultimately, this research has the potential to advance the current understanding thereby, strengthening rural STEM learning ecosystems and broadening STEM participation among youth in rural communities.
Over a four-year project duration, a collaborative design-based research approach will be employed to address the following research questions: (1) How does culturally sustaining informal STEM programming for families in rural communities contribute to increases in youth STEM persistence? (1a) How might this vary in relation to family and community factors? (2) How does culturally sustaining informal family STEM programming increase community connectivity between STEM-related resources and institutions across informal and formal learning contexts in rural communities leading to a more robust and inclusive STEM learning ecosystem? (2a) To what extent do participating families, informal STEM educators, STEM professionals, and community partners each play a role in increasing this connectivity? The research sample will include 300 families with youth ages 8-11, informal science educators, and STEM professionals across all four sites. Surveys, interviews and observations will be the primary data sources. Analysis of Variance and simple descriptive statistical analysis will be used to analyze the quantitative data. The qualitative data will be analyzed using thematic coding through NVivo. In addition, to complement the research data, JKS Consulting will conduct the formative and summative evaluations of the project to hone effective practices for training informal science learning practitioners in developing and implementing place-based, inquiry-based family learning in rural communities and effective and sustainable practices for engaging rural families in place-based STEM. Findings from the research will be made available and widely distributed in publications, conference presentations, and a multi-part Research to Practice Toolkit designed for parents and caregivers, informal science educators, STEM professionals, and the informal education field at large.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program.
For many youth, gaining access to quality STEM (science, technology, engineering mathematics) experiences is a challenge. Inequity and underrepresentation of youth of color in STEM persist. The makerspace movement holds great promise in broadening participation in STEM among youth from underrepresented communities. Makerspaces are defined as collaborative workspaces inside a library, school, or other community location designed for creating, learning, exploring, and sharing with high- to low-tech tools. Despite the availability of making programs focused on STEM activities targeted towards youth of color, the field has few models for designing these programs in ways that build upon youths’ cultural assets and desires for making. Working collaboratively with youth, families, and maker educators in Lansing, Michigan, and Greensboro, North Carolina, this project aims to deepen the field’s understanding about the rich and deep ingenuity in STEM-based making that youth from underrepresented communities can engage. These insights will be leveraged towards advancing community-based maker programming across four community-based makerspaces. The project will also build capacity among STEM-oriented maker educators, researchers, and youth. This model is important because the voices and perspectives of families and communities have been largely absent from the formative knowledge and theory-building processes of the field of makerspace education.
This project will build new knowledge about how and why youth and families make at home, in communities, and in STEM-based maker programs. Collaborators for the project include the University of Michigan, the University of North Carolina at Greensboro, and four STEM- and youth-oriented making spaces in Lansing, Michigan, and Greensboro, North Carolina. This project will take place in two phases, exploring two main research questions: 1) What are the learning results of making at home and in the community? And 2) How do youth organize community resources for sustained STEM making, and what facilitates or hinders such organization? Phase one investigates the community resources (people, tools, materials, knowledge, data, and spaces) youth leverage towards making and how they do so across time. The project will study how youth connect these resources to STEM-rich making and what youth and families learn in the process. In phase two, design-based research will be used to apply phase one insights to the design of community-based STEM-rich maker programs in four maker clubs in Michigan and North Carolina. This work will develop an understanding of youths’ family and community-based STEM-based making practices, including the community resources (people, tools, materials, knowledge, data, and spaces) that youth leverage.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.
This is a survey we developed in 2018 for our exploratory research study of listeners and their parents/guardians of the children's science podcast, Brains On!. The survey includes questions about who listens, when and where children listen, children's listening behaviors, motivations for listening, activities after listening, household information, and demographic questions.
Cities need to know how their cultural institutions related to each other; yet these institutions themselves struggle to understand what their niche can and should be in a city (Kloosterman, 2014). However the public often implicitly ‘knows’ the role of a particular cultural institution within an urban ecology; increasingly this knowledge is made manifest on a variety of digital apps and social media platforms (Budge, 2020; Moreno-Mendoza et al., 2020). Cultural institutions can learn from visitors and other institutions by utilizing digital apps to view area content offerings and attendance
Kid-focused STEM podcasts have grown in popularity over the years, but the ISE field lacks knowledge of the impact and value of this medium as a means for engaging children and families in science learning and discovery. This research summary shares the results of an exploratory study of the popular children's science podcast, Brains On!, in an effort to being to fill this knowledge gap.
The research was guided by three overarching research questions:
Who is the audience for Brains On! and what are their motivations for listening to children’s science podcasts?
How are Brains On