Informal STEM education institutions seek to engage broader cross sections of their communities to address inequities in STEM participation and remain relevant in a multicultural society. In this chapter, we advance the role that evaluation can play in helping the field adopt more inclusive practices and achieve greater equity than at present through evaluation that addresses sociopolitical contexts and reflects the perspectives and values of non-dominant communities. To do this for specific projects, we argue that evaluation should privilege the voices and lived experiences of non-dominant
Latina SciGirls addresses specific barriers that prevent many young Latinas from participating fully in STEM, including:
Lack of STEM identity (girls’ ability to envision themselves as STEM professionals)
Limited exposure to STEM role models who look like them
Lack of knowledge and/or misunderstanding of STEM fields
The Child Trends News Service (CTNS) was created to report on new research about child development, and broaden the public’s access to information that can inform their parenting decisions. CTNS features this new research and research-based parenting practices in video news reports in both English and Spanish. While CTNS reporting is relevant to all parents, it also focuses on issues of specific interest to Latino parents regarding their children—the fastest-growing group of children in the United States.
CTNS is a collaboration between the Child Trends Hispanic Institute, a Child Trends
This poster was presented at the 2019 NSF AISL Principal Investigators Meeting.
The project's goals were to:
Use a series of 6 museum-facilitated family workshops at pre-kindergarten (pre-k) centers to promote informal STEM learning.
Examine 3 conditions in which families and their children most benefit from “doing science and math” together.
Focus on populations that are typically underrepresented in STEM fields – families experiencing poverty and families who speak English and/or Spanish at home
DATE:
TEAM MEMBERS:
Tricia ZuckerCheryl McCallumMichael AsselJanelle MontroyArmando OrdunaGisela Trevino
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The Designing Our Tomorrow project will develop a framework for creating exhibit-based engineering design challenges and expand an existing model of facilitation for use in engineering exhibits. The project seeks to broaden participation in engineering and build capacity within the informal science education (ISE) field while raising public awareness of the importance of sustainable engineering design practices. The project focuses on girls aged 9-14 and their families and is co-developed with culturally responsive strategies to ensure the inclusion and influence of families from Latino communities. The project will conduct research resulting in theory-based measures of engineering proficiencies within an exhibit context and an exhibit facilitation model for the topic area of engineering. Based on the research, the project will develop an engineering design challenge framework for developing design challenges within an exhibit context. As the context for research, the project will develop a bilingual English/Spanish 2,000-square foot traveling exhibition designed to engage youth and families in engineering design challenges that advance their engineering proficiencies from beginner to more informed, supported by professional development modules and a host-site training workshop introducing strategies for facilitating family engineering experiences within a traveling exhibition. The project is a collaboration of Oregon Museum of Science and Industry with the Biomimicry Institute, Adelante Mujeres, and the Fleet Science Center.
Designing Our Tomorrow builds on a theory-based engineering teaching framework and several previous NSF-funded informal education projects to engage families in compelling design challenges presented through the lens of sustainable design exemplified by biomimicry. Through culturally-responsive co-development and research strategies to include members of Latino communities and provide challenges that highlight the altruistic, creative, personally relevant, and collaborative aspects of engineering, the Designing Our Tomorrow exhibition showcases engineering as an appealing career option for women and helps families support each other's engineering proficiencies. To better understand and promote engineering learning in an ISE setting, the project will conduct two research studies to inform and iteratively develop effective strategies. In the first study, measurement development will build on prior research and practice to design credible and reliable measures of engineering proficiency, awareness, and collaboration, as well as protocols for use in exhibit development and the study of facilitation at engineering exhibits, and future research. The second study will explore the effects of facilitation on the experience outcomes.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. In this Innovations and Development project, Child Trends, in collaboration with Ivanhoe Broadcast News, will expand the reach of the Child Trends News Service, and rigorously evaluate its impact on viewers. The News Service aims to build the public's knowledge of, and appreciation for, social science research and to encourage adoption of research-informed parenting practices associated with positive child development--particularly among Latino parents. First produced in 2017 through a NSF proof of concept grant, the Child Trends News Service covers actionable, child-focused, social science research. By featuring this research on local TV news, the project expands access to evidence-based parenting recommendations. As of February 2018, 89 stations had subscribed to the News Service, including eight stations in the top 25 Latino-serving TV markets that reach 38% of all Hispanic TV Households in those 25 markets. This project is a response to the challenges faced by U.S. children, of whom more than one in five live in poverty. The focus on Latino parents is in response Latinos' increasing share of all children, and that Latino children are disproportionately poor, in comparison to their peers. The project will examine the impact of the News Service on parents who view the news reports in their homes, as well as Latino parents viewing the News Service as part of their participation in the Abriendo Puertas (Opening Doors) community-based parenting program. This research will contribute to the knowledge base of what we know about how people access and use science, technology, engineering and math (STEM) information across settings.
The overarching aim of this project is to leverage commercial television news to reach populations who have historically been underrepresented in STEM education and careers. The goals of the project are to:
1. Build and manage an interdisciplinary collaborative, including news media professionals, researchers, practitioners in organizations serving at-risk families, and experts in STEM communications and Latino studies.
2. Leverage mass media news outlets to deliver social science research on children to at-risk populations, with a focus on reaching Latino parents.
3. Advance the field of informal STEM learning by exploring how the public interacts with actionable research on child development to inform their knowledge, attitudes and behaviors.
4. Expand the reach and application of the news products through strategic outreach to other stakeholders in the child development field including programs serving under-served families.
To accomplish these goals, the project will further strengthen an Advisory Panel to inform content development, study design, interpretation of findings, dissemination of study results, and the transition of the project after the NSF grant period. The project will continue to provide eight (both in English and Spanish) stories each month to TV stations and strategically grow the reach in top Latino markets. The editorial process will be informed by surveys of Latino parents to identify topics of interest. Through a random-assignment impact study with local TV news audiences from diverse racial/ethnic groups, the project will evaluate the impact of the News Service. The project will use formative research methods to refine messaging and examine the potential for repurposing the videos through a parenting program for Latino parents.
The Child Trends News Service seeks broader impacts in three areas: increasing the public's scientific literacy and engagement with science and technology; increasing partnerships between academia, industry, and others; and improving the well-being of individuals in society.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will develop and test intergenerational science media resources for parents that are participating in adult education programs and their young children. The materials will build on the research-based and successful children's television program, Fetch with Ruff Ruffman. The target audience includes parents enrolled in adult education programs who lack a high school diploma or are in English as a Second Language classes. These resources will support parents' engagement in science activities with their children both in the adult education settings as well as at home. Adult and family educators will receive professional development resources and training to support their integration of the parent/child activities. Project partners include the National Center for Families Learning, Kentucky Educational Television, and Alabama Public Television,
The goals of the Ruff Family Science project are to: (1) investigate adult education settings that feature an intergenerational learning model, in order to learn about the unique characteristics of adults and families who are enrolled in these programs; (2) examine the institutional circumstances and educator practices that support joint parent/child engagement in science; (3) iteratively develop new prototype resources meet the priorities and needs of families and educators involved in intergenerational education settings; and (4) develop the knowledge needed to create a fuller set of materials in the future that will motivate and support diverse, low-income parents to investigate science with their children. The research strategy is comprised of three main components: Phase 1: Needs Assessment: Determine key motivations and behaviors common to adult education students who are also parents; surface obstacles and assets inherent in these parents' current practices; and examine the needs and available resources for supplementing parents' current engagement in family science learning. Phase 2: Prototype Development: Iteratively develop two prototype Activity Sets, along with related educator supports and training materials, designed to promote joint parent-child engagement with English and Spanish-speaking families around physical science concepts. Phase 3: Prototype Field Test: Test how the two refined prototype Activity Sets work in different educational settings (adult education, parent education, and parent and child together time). Explore factors that support or impede effective implementation. Sources of data for the study include observations of adult and parent education classes using an expert interview protocol, focus groups, adult and family educator interviews, and parent surveys.
WNET, working with Education Development Center, will lead a small scale Innovations in Development effort to develop, research, and evaluate a new model to engage underserved families in STEM learning. The new endeavor, Cyberchase: Mobile Adventures in STEM, will build on the proven impact of the public media mathematics series Cyberchase and the growing potential of mobile technology and texting to reach underserved parents. WNET will produce two new Cyberchase episodes for 6-9 year olds, focused on using math to learn about the environment. Drawing on these videos and an existing Cyberchase game, the team will produce a bilingual family engagement campaign that will combine an in-person workshop followed by a 6-8 week "text to parent" campaign, in which parents receive weekly text messages suggesting family STEM activities related to the media content. The engagement model will be piloted in three cities with large low-income/Latino populations, along with one texting campaign offered without the workshop. This project will build knowledge about how to deploy well-designed public media assets and text messaging to promote fun, effective STEM learning interactions in low-income families. While past research on educational STEM media has tended to focus on children, especially preschool age, this project will focus primarily on text messaging for parents, and on learners age 6-9, and the wider scope of parent/child STEM interactions possible at that age.
The primary goal of the project will be to develop, test and refine a family engagement model that includes a face-to-face workshop, rich narrative Cyberchase content, and text-message prompts for parents to engage in short, playful STEM activities with children. The project team will explore which features of the mobile text-and-media program have most value for low-income and Latino families and prompt STEM learning interactions, including a comparison of workshop-based and text-only variants. The project will have three phases: needs assessment and preliminary design; an early-stage test in New York and development and testing of media; and three late-stage tests in contrasting locations, two including workshops and one "text-only," and analysis of findings. Ultimately, the project will share knowledge with the field about the opportunities and challenges of using mobile texting and public media to reach underserved families effectively. This knowledge will also inform a future proposal for production and outcomes research, which, based on the study results, may include a scaled-up version in ten locations and a ten-city Randomized Control Test. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The overall goal of this project is to develop and evaluate a community model of informal genomic education that is culturally and educationally appropriate for low-literacy Latino adults born in Mexico and Central America (MCA). The community engagement strategy and materials created will be designed to lead to three learning outcomes: increased interest and engagement with genomics, change in science, technology, engineering, and mathematics (STEM) attitudes and self-identity, and increased understanding about gene function and the human genome. The model created in this project will have the potential to inform other educational efforts, nationally. Semi-structured in-depth interviews will be conducted in Spanish with 60 MCA Latinos to delineate beliefs and knowledge about genetic and genomic concepts and transmission of traits. Interview transcripts will be systematically analyzed to identify explanations about trait transmission, and familiarity with genetic and genomic concepts. Variation in responses across geographic and cultural regions will be noted. Knowledge from this analysis will be used to develop a meaningful community-based learning program about genomics. Lay community educators will facilitate informal learning with MCA adults about genetics and genomics, including gene-environment interactions. This project will use information about environmental exposures (e.g., residential pesticides) as a vehicle to pique participants' interest and illustrate genetic and genomic content. It will compare outcomes for 100 participants who receive practical strategies only to reduce negative and increase positive environmental exposures, respectively, to 100 participants who also receive genetic and genomic content. The strategy and materials will be disseminated through journal articles and presentations at meetings that focus on informal STEM education. The process and content will be rigorously evaluated throughout the project. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
A frequently missing element in environmental education programs is a concerted effort by communities, organizations, government, and academic stakeholders to build meaningful partnerships and cultivate informal science learning opportunities via public participation in environmental research. This collaborative approach not only makes scientific information more readily available, it also engages community members in the processes of scientific inquiry, synthesis, data interpretation, and the translation of results into action. This project will build a co-created citizen science program coupled with a peer education model and an extensive communication of results to increase environmental STEM literacy. The project targets historically underrepresented populations that are likely to be disproportionately impacted by climate, water scarcity, and food security. Based upon past needs assessments in the targeted communities, gardens irrigated by harvested rainwater will become hubs for environmental STEM education and research. For this project, gardens irrigated by harvested rainwater will serve as hubs for environmental literacy education efforts. Researchers from the University of Arizona and Sonora Environmental Research Institute will work alongside community environmental health workers, who will then train families residing in environmentally compromised areas (urban and rural) on how to monitor their soil, plant, and harvested water quality. The project aims to: (1) co-produce environmental monitoring, exposure, and risk data in a form that will be directly relevant to the participants' lives, (2) increase the community's involvement in environmental decision-making, and (3) improve environmental STEM literacy and learning in underserved rural and urban communities. The project will investigate and gather extensive quantitative and quantitative data to understand how: (1) participation in a co-created citizen science project enhances a participant's overall environmental STEM literacy; (2) a peer-education model coupled with a co-created citizen science program affects participation of historically underrepresented groups in citizen science; and (3) the environmental monitoring approach influences the participant's environmental health learning outcomes and understanding of the scientific method. In parallel, this project will evaluate the role of local-based knowledge mediators and different mechanisms to communicate results. These findings will advance the fields of informal science education, environmental science, and risk communication. Concomitantly, the project will facilitate the co-generation of a robust dataset that will not only inform guidelines and recommendations for harvested rainwater use, it will build capacity in underserved communities and inform the safe and sustainable production of food sources. This research effort is especially critical for populations in arid and semiarid environments, which account for ~40% of the global land area and are inhabited by one-third of the world's population. This program will be available in English and Spanish and can truly democratize environmental STEM research and policy. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
Chemistry is an important and widely relevant field of science. However, when compared with other STEM content areas, chemistry is under-represented in U.S. science museums and other informal educational environments. This project will build, and build knowledge about, innovative approaches to delivering informal science learning activities in chemistry. The project will not only increase public interest and understanding of chemistry but also increase public perception of chemistry's relevance and increase the public's self-efficacy with respect to chemistry. This project outcomes will include a guide for practitioners along with activity materials that will be packaged into a kit, distributed, and replicated for use by informal science educators, chemists, and chemistry students at 250 sites across the U.S. The project team will reach out to organizations that serve diverse audiences and diverse geographic locations, including organizations in rural and inner-city areas. The kits will provide guidance on engaging girls, people with various abilities, Spanish speakers, and other diverse audiences, and include materials in Spanish. Written guides, training videos, and training slides will be included to support training in science communication in general, as well as chemistry in particular. This project is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
This project will take an innovative approach to develop informal educational activities and materials about chemistry. Rather than starting with content goals, the project will start with a theoretical framework drawn from research about affecting attitudes about science related to interest, relevance, and self-efficacy. A design-based research approach (DBR) will be used to apply that framework to the development of hands-on educational activities about chemistry, while also testing and modifying the framework itself. (DBR blends empirical educational research with the theory-driven design of learning environments.) Existing or new educational activities that appear to embody key characteristics defined in the framework will be tested with public audiences for their impact on visitors. Researchers and educators will determine how different characteristics of the educational activities defined in the framework affect the outcomes. The activities will be modified and tested iteratively until the investigators achieve close alignment between framework and impacts.. The project team will continue the design-based research approach both to examine groups of activities in which synergies can have impacts beyond single interactions as well as to examine varied ways of training facilitators who can also significantly affect outcomes. In this way, the project will generate knowledge about how kits of hands-on informal learning activities can stimulate attitudes of interest, relevance, and self-efficacy with respect to the neglected field of chemistry. The project teams will broadly disseminate project outcomes within the educational research, science and informal Science, Technology, Engineering and Mathematics (STEM) education communities. While this project will focus on chemistry, the strategies it will develop and test through a design-based research process will provide valuable insight into effective approaches for informal STEM education more broadly.
The achievement gap begins well before children enter kindergarten. Research has shown that children who start school having missed critical early learning opportunities are already at risk for academic failure. This project seeks to narrow this gap by finding new avenues for bringing early science experiences to preschool children (ages 3-5), particularly those living in communities with few resources. Bringing together media specialists, learning researchers, and two proven home visiting organizations to collaboratively develop and investigate a new model that engages families in science exploration through joint media engagement and home visiting programs. The project will leverage the popularity and success of the NSF-funded PEEP and the Big Wide World/El Mundo Divertido de PEEP to engage both parents and preschool children with science.
To address the key goal of engaging families in science exploration through joint media engagement and home visiting programs, the team will use a Design Based Implementation Research (DBIR) approach to address the research questions by iteratively studying the intervention model (the materials and implementation process) and assessing the impact of the intervention model on parents/caregivers. The intervention model will include the PEEP Family Engagement Toolkit that will support 20 weeks of family science investigations using new digital and hands-on science learning resources. It will also include new professional development resources for home educators as well as and the implementation process and strategies for developing and implementing the Toolkit with families.
The proposed research focuses first on refining and improving program design and implementation, and second, on investigating whether the intervention improves the capacity of parent/caregivers to support young children's learning in science. Ultimately this research will accomplish two important aims: it will inform the design of the PEEP family engagement intervention model, and, more broadly, it will build practical and theoretical understanding of: 1) effective family engagement models in science learning; 2) the types of supports that families and home educators need to implement these models; and 3) how to implement these models across different home visiting programs. Given the reach of the home visiting programs and the increasing interest in supporting early science learning the potential for broad impact is significant. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.