In July 2020, Dr. Brigid Barron and her team at Stanford University’s Graduate School of Education and the Joan Ganz Cooney Center convened a virtual workshop to mobilize a community of investigators to explore innovative methods for studying family and community learning during the pandemic. Participants included NSF RAPID-COVID grantees from Stanford University, University of Washington, and the University of Michigan.
This report summarizes the strategies and insights generated at this workshop so that they may be shared among a wider network of researchers, practitioners, funders, and
Despite the fact that most science learning takes place outside of school, little is known about how engagement in informal science learning (ISL) experiences affects learners’ knowledge, skill development, interest, or identities over long periods of time. Although substantial ISL research has documented short-term outcomes such as the learning that takes place during a science center visit, research suggests that the genuine benefits of informal experiences are long-term transformations in learners as they pursue a “cascade” of experiences subsequent to the initial educational event
This short (approximately 2-3 hours), self-paced non-credit learning module is designed for those new to conducting research in communities impacted by energy development. You will learn about the concept of “research fatigue” and become more prepared for fieldwork by learning what to expect when you visit energy-impacted communities.
Access is free for students, researchers and those living in or serving communities impacted by energy development.
Participants who complete the online course can a digital badge called Understanding Research Fatigue. Earners of this certification will
DATE:
TEAM MEMBERS:
Suzi TaylorJulia Hobson HaggertyKristin SmithRuchie Pathak
For both parents and educators, monitoring and adjusting their behaviors to ensure that children develop appropriate prosocial and learning behaviors is a complex balance between nurturance and limit setting. When these interactions are strained, negative or coercive cycles may emerge that delay appropriate development and exacerbate existing impairment. To disrupt the development of coercive cycles, adults must have the ability to accurately assess the quality of their interactions with children and integrate this information into personal change. Approaches to measuring these types of interactions will inform what we know about the mechanisms of child social, emotional, and learning development in STEM learning settings, and enable the creation of adaptive interventions for those moments when support is most needed. This project envisions a closed-loop intervention framework to promote a supportive and interactive environment around children. Smart wearables will sense interaction and responses between the children and their parents or educators, using embedded machine learning technology to recognize supportive behaviors. The perceived behaviors will be sent to a cloud server where adaptive interaction strategies will be identified from either online psychological consultation or artificial intelligence. These interaction strategies will then be provided to the parents and educators in the form of guidance cues to promote a supportive STEM learning environment around the children.
This planning project aims to understand the barriers and critical problems in the implementation of smart technology and psychological strategies to support adult-child interactions in STEM learning settings. The work will proceed by convening key stakeholders (parent organizations, formal educational institutions, and informal educational institutions) in a series of iterative discussions to produce a set of adult-child behavioral targets that are essential to children’s development of social, emotional, and learning skills. Further discussions will then identify mechanisms to enhance these behaviors, and reduce competing, less effective approaches. Qualitative thematic analysis of the discussions will be used to capture these behaviors and mechanisms. Then technologies will be developed to measure, provide feedback on, and improve these behaviors. These devices will be piloted with adult-child dyads. Audiovisual data collected by the devices will be human coded as well as processed by algorithms to vet the technological capacity of the devices to detect and respond to targeted behaviors. A series of debriefing interviews and surveys with adult-child dyads will be used to determine the feasibility, acceptability, and utility of the devices. The collected preliminary data will support the forming of critical technological and social science research questions that co-inform one another: questions about the social engagement between adults and children will drive the technical research, and what can be discovered via the technological research will open up new questions that can be posed about social engagement between children and adults. Adult-child interactions are key social factors that integrate to produce student social, emotional, and academic outcomes. Within our informal educational communities, our formal educational communities, and our familial communities it is essential to find the best mechanisms for measuring, providing feedback, and improving these interactions. This work thus seeks to advance a new approach to, and evidence-based understanding of, the development of STEM learning. This Smart and Connected Communities project is also supported by the Advancing Informal STEM Learning program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Early childhood is a critical time for developing foundational knowledge, skills, and interest in science, technology, engineering, and mathematics (STEM). For that reason, the Public Broadcasting Service (PBS) places a great priority on developing early childhood STEM content, especially through its television shows that are watched by over 60% of young children in the United States. Research suggests that adding in-the-moment interaction to television watching promotes learning and engagement. Toward this end, researchers from the University of California, Irvine and PBS KIDS have prototyped interactive versions of science shows that children view on internet-connected devices while they communicate with the main character powered by an AI conversational agent. Pilot studies show that when children watch these new interactive videos with the main character pausing periodically to ask probing questions about the learning goals of the episode and following up with appropriate responses, they are more engaged and learn more about science, with heightened benefits for children who speak languages other than English at home. Based on these early results, in this Innovations in Development project the research team will develop, test and produce publicly available conversational episodes for two PBS KIDS television shows, one focused on science and the other on computational thinking.
The project will iteratively study and develop six conversational videos with novel forms of support for children, including extended back-and-forth conversation that builds upon a child's responses, visual scaffolding that facilitates verbal communication, and bilingual language processing so that children can answer in English or Spanish. The conversational videos will be evaluated in both lab-based and home settings. The lab-based study will involve 600 children ages 3-7 in a predominantly low-income Latino community in Southern California, in which researchers compare children’s learning and engagement when watching the conversational videos with three other formats: (1) watching the non-interactive broadcast version of the video; (2) watching the video with pseudo-interaction, in which the main character asks questions and gives a generic response after a fixed amount of time but can’t understand what the child says; or (3) watching the broadcast version of the video with a human co-viewer who pauses the video and asks questions. The home-based study will involve 80 families assigned to watch either the non-interactive or interactive videos as many times as they want over a month at home. In both the lab-based and home studies, pre- and post-tests will be used to examine the impact of video watching on science and language learning, and log data will be used to assess children’s verbalization and engagement while watching. Following the home study, the six videos will be further refined and made available for free to the public through the PBS KIDS apps and website, which are visited by more than 13 million users a month. Beyond providing engaging science learning opportunities to children throughout the country, this study will yield important insights into the design, usability, feasibility, and effectiveness of incorporating conversational agents into children’s STEM-oriented video content, with implications for extending this innovation to other educational media such as e-books, games, apps, and toys.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Mark WarschauerSilvia LovatoAndres BustamanteAbby JenkinsYing Xu
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
The Accessible Oceans study will design auditory displays that support learning and understanding of ocean data in informal learning environments like museums, science centers, and aquariums. Most data presentations in these spaces use visual display techniques such as graphs, charts, and computer-generated visualizations, resulting in inequitable access for learners with vision impairment or other print-related disabilities. While music, sound effects, and environmental sounds are sometimes used, these audio methods are inadequate for conveying quantitative information. The project will use sonification (turning data into sound) to convey meaningful aspects of ocean science data to increase access to ocean data and ocean literacy. The project will advance knowledge on the design of auditory displays for all learners, with and without disabilities, as well as advance the use of technology for STEM formal and informal education. The study will include 425 participants but will reach tens of thousands through the development of education materials, public reporting, and social media. The study will partner with the Smithsonian National Museum of Natural History, Woods Hole Oceanographic Institution Ocean Discovery Center, the Georgia Aquarium, the Eugene Science Center, the Atlanta Center for the Visually Impaired, and Perkins School for the Blind.
The project will leverage existing educational ocean datasets from the NSF-funded Ocean Observatories Initiative to produce and evaluate the feasibility of using integrated auditory displays to communicate tiered learning objectives of oceanographic principles. Integrated auditory displays will each be comprised of a data sonification and a context-setting audio introduction that will help to make sure all users start with the same basic information about the phenomenon. The displays will be developed through a user-centered design process that will engage ocean science experts, visually impaired students and adults (and their teachers), and design-oriented undergraduate and graduate students. The project will support advocacy skills for inclusive design and will provide valuable training opportunities for graduate and undergraduate students in human-centered design and accessibility. The project will have foundational utility in auditory display, STEM education, human-computer interaction, and other disciplines, contributing new strategies for representing quantitative information that can be applied across STEM disciplines that use similar visual data displays. The project will generate publicly accessible resources to advance studies of inclusive approaches on motivating learners with and without disabilities to learn more about and consider careers in STEM.
This Pilots and Feasibility Studies project is supported by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Cyberchase: Mobile Adventures in STEM is designed to advance the STEM learning of children ages 6-8 and engage low-income families in informal STEM interactions. Based on a successful NSF-funded pilot, the project combines the appeal of the PBS KIDS series Cyberchase and the potential of mobile texting to deliver informal learning. WNET and Education Development Center will produce: three Cyberchase videos that blend math and environmental content; a bilingual family engagement campaign in 15 communities across the U.S. that combines this media with weekly text-based engagement; and research into use and impact of the model among low-income Latinx families. Mobile Adventures addresses the need to better engage underserved families in informal science practices that are foundational for future STEM learning. While the materials target low-income communities broadly, research will focus on low-income Latinx families with children ages 6-8, an age group overlooked in previous research on educational uses of texting. A needs assessment and formative testing will ensure that the project design meets the needs and interests of diverse Latinx and other families.
The goal of Mobile Adventures is to build knowledge about how innovative, culturally responsive tools can help Latinx and low-income families engage in fun STEM learning at home. A three-tiered research study will address the question: how and to what extent does a mobile text-and-media approach to delivering informal STEM learning materials foster joint media engagement between children and parents, building new repertoires for learning together? The study will combine analysis of observation in homes and community settings, backend data, and pre/post surveys. Research will deepen understanding of effective family engagement models that make media a central component, the potential of text messaging as a stimulus to parent/child STEM learning, and maximal design of media and community engagement to serve low-income Latinx families. Findings will be disseminated through national conferences and journals. The Cyberchase videos, distributed free on broadcast and digital platforms, will build the STEM literacy of millions of diverse children, while the family engagement campaign will involve a projected 3,750 families in 15 locations. Evaluation will assess how well the project has met its goals.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
Families play a vital role in supporting children’s informal science learning. Yet multiple studies have shown that Latinx families, particularly in neighborhoods with a high poverty rate, face many barriers to accessing informal science experiences and environments. Telenovelas, a type of television serial drama watched by Spanish-speaking audiences around the world, may provide an entryway to reaching these families. Prior research has shown that telenovelas can be an effective means of changing adults’ behavior, with potential cascading impacts on children. Education Development Center, Literacy Partners, and Univision will use a culturally responsive approach to broaden participation of Latinx families in informal science learning using La Fuerza de Creer, a popular Spanish-language telenovela that reaches 7 million U.S. viewers. The five-episode telenovela series will model positive informal science interactions between caregivers and their children and provide positive role models of Latinx scientists. The project team will then use the telenovela as the foundation for a five-session workshop series for caregivers to further explore how to engage in these informal science learning opportunities with their children. The La Fuerza-STEM project will build on families’ strengths and interests and tap their power—la fuerza—to engage children in exploring science. This research will examine the relationship between the telenovela/workshops and caregivers’ practices and attitudes towards science. La Fuerza-STEM seeks to expand informal science learning using a culturally grounded strategy to engage an under-served population that is historically under-represented in STEM.
The project will use an iterative research and design process that is guided by the input of both parent and scientific advisory boards. Front-end formative research with approximately 30 Latinx caregivers from under-resourced communities will explore their informal science practices. These experiences will then inform script development for the telenovela. A pre-post comparison group study with 200 caregivers will investigate how caregivers’ attitudes toward science might change as a result of viewing the telenovela. The project will then build a 5-session workshop series around the telenovela and these research findings. Finally, 300 caregivers will participate in a randomized controlled trial to examine the efficacy of the La Fuerza-STEM workshops on changing caregivers’ informal science attitudes and practices. Throughout, the project will address the overarching research question, How can a culturally relevant telenovela be used to improve Latinx caregivers’ science self-efficacy, career awareness, and informal science practices? Project findings and products will be publicly disseminated through publications, conference presentations, and local partner organizations, with an eye toward open access and data sharing. The project will generate knowledge about the effectiveness of embedding informal science content in a culturally-grounded medium—the telenovela—in improving caregivers’ confidence and competence to engage in informal science learning experiences with their children. With an anticipated audience of 7 million, the potential impact of the telenovela on caregivers’ informal science attitudes and practices is enormous. By implementing workshops with local organizations, the project aims to be self-sustaining, building the capacity of community partners to provide families with services targeting informal science knowledge and skills long after the grant has ended.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Joy KennedyJessica YoungAlexia RaynalAnthony Tassi
This project will scale up fully virtual or face-to-face STEM professional development to afterschool educators in both urban and rural settings. Given that many afterschool educators have little or no background in STEM education, there is demand for professional development that is effective, inexpensive, and accessible. This project will build national capacity in STEM education by developing the STEM skills of over 1,500 educators across multiple states and will ultimately impact over 31,000 under-represented youth in these areas. The project will also deliver robust materials through a free open-source mechanism, for use by educators anywhere and anytime. The project will broaden participation in STEM by engaging community educators in the rural parts of the nation, a critically under-represented group in STEM. It will also reach educators from low-income urban communities across three states and seven cities, targeted through strategic networks and partnerships, including organizations such as the YMCA, 4-H, and the National Afterschool Association.
This collaborative project is scaling the ACRES model (Afterschool Coaching for Reflective Educators in STEM). The model humanizes the virtual experience, making it social and engaging, and allows educators to learn, share, and practice essential STEM facilitation skills with a focus on making STEM relevant and introducing STEM careers to youth. In addition to enhancing the professional STEM skills of rural and urban educators, the project will create a national cohort of coaches with deep expertise in (i) converting in-person activities for youth into a highly engaging, choice-rich online format, (ii) engaging isolated informal educators in supportive professional learning communities, and (iii) coaching foundational research-based STEM facilitation skills that ensure these activities are pedagogically sound. A key part of this broad implementation project involves studying how to integrate an effective professional development program into afterschool organizations, including the ways afterschool programs adapt the materials to be culturally responsive to their local communities. The researchers will also study factors contributing to the longer-term sustainability of the program. The research will use surveys, interviews, direct observations, and case studies of participants to provide the field with valuable insights into scaling a program in the afterschool world.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for extending access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Black girls display high interest, confidence and ability in STEM but face multiple barriers including racial, ethnic and gender stereotypes, low exposure to STEM role models, low awareness of diverse STEM fields and financial obstacles to STEM education. It is critical to infuse STEM education with specific and intentional culturally responsive and anti-racist strategies to attract and retain Black girls in STEM. Through this combination of media, role modeling and outreach, Black SciGirls will help increase access to STEM education for Black girls, preparing them for future workforce participation. This project will study the impacts on elementary/middle school Black girls’ exposure to early career Black female STEM professionals as role models. Deliverables include 1) professional development for STEM educators and Black STEM professional women to prepare them to lead STEM programs for girls 2) a PBS series of role model videos of early-career Black STEM professionals and 3) a research study that examines how/if in person and media-based STEM role models increase Black girls’ interest and confidence in STEM, motivation to pursue future STEM studies, and STEM identity. While women make up 47% of the U.S. workforce, they are underrepresented in STEM and only 1.6% are Black women.
The research study will examine how educators’ use of role models addresses a critical barrier for Black girls, seeing women in STEM who look like them. The research study questions are: How and in what ways do Black STEM women role models influence Black girls’ interest in STEM? How and to what extent do role models report changes in their confidence and ability to engage girls in STEM as a result of training in best practices in role modelling? and, How and to what extent are parents engaged in supporting girls’ involvement in STEM, as a result of the participation of role models? The research team will visit participating local SciGirls programs to collect qualitative data, including observations of program activities, interviews, and focus groups. To ensure reliable outcomes and utilize robust theoretical underpinnings, the research will combine pre/post survey data and an in-depth cross-case studies employing qualitative and quantitative data collection. This mixed-methods approach will enable gathering data that comprehensively offers insight into Black girls’ STEM experiences and those of the Black STEM professional women role models and parents who support them. Qualitative data that centers girls’, role models’, and parents’ perspectives will contribute to this identity-centered study. A culturally responsive evaluation will determine the extent to which the project builds educators’ ability to integrate equitable and anti-racist practices to build Black girls’ interest and confidence in STEM studies.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Rita KarlAngel Miles NashRonda BullockAdrienne StephensonLataisia Jones
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Increasing greater diversity, equity, and inclusion in science not only presents a social justice goal, but is also vital to the financial and social success of the nation. The stereotype of the older white male scientist has obscured the contributions of women and people of color. This project seeks to remedy these perceptions which are barriers to entry into STEM fields. The project will create a large-scale hub for STEM themed video content on YouTube and other social media platforms, featuring 100+ original STEM videos produced by PBS partners. This hub and accompanying research seeks to identify the characteristics of online STEM content that attract (or fail to attract) underrepresented groups, specifically Black and Hispanic communities as well as women of all races. The objectives of this project are to 1) provide a unified online science-themed hub, PBS Terra, on YouTube and other platforms for hosting, sharing, and distributing digital STEM series from diverse producers from across the PBS system; 2) conduct surveys and focus groups to examine and understand the needs and expectations of women, Black and Hispanic communities and their consumption of STEM video content online and 3) test hypotheses about the communicative strategies of STEM videos that feature Black and Hispanic female scientists. Project collaborators include PBS, researchers at the University of Utah and the University of Georgia, and consultants and advisors with expertise in broadening participation and inclusion in STEM.
Little is known about how or why adult Americans seek science content on YouTube, especially the motivations of adults from underrepresented minorities and females. The key research questions in this project are: 1) Why do Black and Hispanic audiences and women of all races seek science video content online? 2) How does showing Black and Hispanic female scientists in science video content on YouTube impact viewers’ identification with and sense of belonging in STEM? 3) How does the use of humor by Black and Hispanic scientists in YouTube science content affect viewers’ perceptions of the communicator and their engagement with STEM content? 4) How does the appearance and manner of dress of Black and Hispanic scientists in YouTube science content affect viewers’ perceptions in the aforementioned areas? A nationally representative baseline survey will be conducted. A probability sample of 2000 respondents will be obtained including oversampling of Black and Hispanic audiences. To complement findings from the survey, focus groups will be conducted in eight different regions of the country to learn why these targeted audiences do or do not seek science content on YouTube and what motivates them to share the content with their social media network. In addition, an experiment embedded in an online survey will test the hypothesis that greater on-screen representation of women and scientists of color will broaden existing perceptions about scientists. The experiment will consist of a 3 (scientist’s race: Black/Hispanic/White) × 2 (science issue: controversial/non-controversial) × 2 (style: casual/professional) between-subjects design. Survey participants will be randomly assigned to the experimental conditions. These factors (science issue and host appearance) can be altered by content producers to better reach and engage the targeted audiences. The project not only investigates theoretical questions at the intersection of STEM stereotypes and race, but findings related to these experimental conditions will offer practical insight into strategies that can be used by science communication practitioners.
DATE:
-
TEAM MEMBERS:
Adam DylewskiSara YeoMichael Cacciatore
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.