This white paper examined the process of evaluating a new Growth Mindset youth program developed for youth in Grades 3-5 in the Northwest suburb communities in Dundee Township, IL.
DATE:
TEAM MEMBERS:
Luci HanstedtDrew Glassford Mike LoPrestiMallory NamoffRobert Tai
The NSF-funded project titled An Informal Learning Model of Genetic and Genomic Education for Adult Bilingual Learners, was led by Joanne Sandberg, PhD. The project included three phases:
Phase I: Investigation of knowledge and beliefs about transmission of traits, genetic and genomic concepts, gene-environment interactions, and environmental exposures in Latinx adults born in Mexico or Central America and who have limited literacy.
Phase II: Development of two educational interventions in Spanish that address:
Information about environmental exposures that can be detrimental to
Stark inequities evident in the low representation of Black women in Science, Technology, Engineering, Mathematics, and Medicine (STEMM) careers persist despite considerable investment in the diversification of the education-to-workplace STEMM pipeline. College participation rates of Black women measure 4-5% of all degrees in biological and physical sciences, 2-3% of degrees in computer science and math, and roughly 1% in engineering. Ultimately, Black women make up only 2.5% of the workforce in STEMM-related fields, indicating that they chronically experience stalled professional advancement. Because there are so few longitudinal studies in either formal or informal settings, educators and researchers lack critical insights into why BA/BS credentialed Black women drop out of STEMM careers at high rates upon entering the workforce. This Research in Service to Practice project will conduct a longitudinal examination of key professional outcomes and life trajectories among adult Black women who enrolled Women in Natural Sciences (WINS), a 40-year-old out-of-school time (OST) high school STEM enrichment program. Prior research on WINS documents that alumnae outperform national averages on all metrics related to STEMM advancement up through college graduation. This study will test the hypothesis that such success continues for these cohorts as they pursue life goals and navigate the workforce. Findings from this study will promote the progress of science, pivotal to NSF’s mission as the project builds knowledge about supportive and frustrating factors for Black women in STEMM careers. Strategic impact lies in the novel participant-centered research methods that amplify Black women’s voices and increase both accuracy and equity in informal STEM learning research.
This research probes the experiences of Black women at a critical phase of their workforce participation when BS/BA credentialed WINS alumnae establish their careers (ages 26-46). The team will conduct a longitudinal comparative case study of outcomes and life trajectories among 20 years of WINS cohorts (1995-2015). Research questions include (1) What do the life-journey narratives of WINS alumnae in adulthood reveal about influential factors in the socio-cultural ecological systems of Black women in STEMM? (2) What are the long-term outcomes among WINS women regarding education, STEMM and other careers, socio-economic status, and STEMM self-efficacy and interest? How do these vary? (3) What salient program elements in WINS are highlighted in alumnae narratives as relevant to Black women’s experiences in adulthood? How do these associations vary? (4) How do selected outcomes (stated in RQ2) and life story narratives among non-enrolled applicants compare to program alumnae? and (5) How do salient components in the WINS program associate with socio-cultural factors in regard to Black women’s careers and other life goals? Participants include 100 Black WINS alumnae as an intervention group and a matched comparison group of 100 Black women who successfully applied to the WINS program but did not or could not enroll. Measurable life outcomes and life trajectory narratives with maps of experiences from both groups will be studied via a convergent mixed methods design inclusive of quantitative and qualitative analyses. Comparisons of outcomes and trajectories will be made between the study groups. Further, associations between alumnae’s long-term outcomes and how they correlate their WINS experiences with other socio-cultural factors in their lives will be identified. It is anticipated that findings will challenge extant knowledge and pinpoint the most effective characteristics of and appropriate measures for studying lasting impacts of OST STEMM programs for Black women and girls. The project is positioned to contribute substantially to national efforts to increase participation of Black women in STEMM.
DATE:
-
TEAM MEMBERS:
Ayana Allen-HandyJacqueline GenovesiLoni Tabb
Milwaukee has established itself as a leader in water management and technology, hosting a widely recognized cluster of industrial, governmental, nonprofit, and academic activity focused on freshwater. At the same time, Milwaukee faces a wide range of challenges with freshwater, some unique to the region and others common to cities throughout the country. These challenges include vulnerability to flooding and combined sewer overflows after heavy rainfall, biological and pharmaceutical contamination in surface water, lead in drinking water infrastructure, and inequity in access to beaches and other recreational water amenities. Like other cities, Milwaukee grapples with the challenges global climate change imposes on urban water systems, including changing patterns of precipitation and drought.
These problems are further complicated by Milwaukee's acute racial and economic residential segregation. With a population of approximately 595,000, embedded within a metropolitan area of over 1.5 million, Milwaukee remains one of the country's most segregated cities. There is increasing urgency to engage the public--and especially those who are most vulnerable to environmental impacts--more deeply in the stewardship of urban water and in the task of creating sustainable urban futures. The primary goal of this four-year project is to foster community-engaged learning and environmental stewardship by developing a framework that integrates art with Science, Technology, Engineering, and Mathematics (STEM) experiences along with geography, water management, and social science. Synergies between STEM learning and the arts suggest that collaborations among artists, scientists, and communities can open ways to bring informal learning about the science of sustainability to communities.
WaterMarks provides an artist generated conceptual framework developed by Mary Miss / City as Living Laboratory (CALL) to help people better understand their relationship to the water systems and infrastructure that support their lives. Project activities include artist/scientist/community member-led Walks, which are designed to engage intergenerational participants both from the neighborhoods and from across the city, in considering the conditions, characteristics, histories, and ecosystems of neighborhoods. Walks are expanded upon in Workshops with residents, local scientists/experts, and other stakeholders, and include exploring current water-related environmental challenges and proposing solutions. The Workshops draw on diverse perspectives, including lived experience, scientific knowledge, and policy expertise. Art projects created by local artists amplify community engagement with the topics, including programming for teens and young adults. Free Wi-Fi will be integrated into various Marker sites around the city providing access to online, self-guided learning opportunities exploring the water systems and issues facing surrounding neighborhoods. Current programming focuses primarily on Milwaukee's predominantly African American near North Side and the predominantly Latinx/Hispanic near South Side. Many neighborhoods in these sections are vulnerable to such problems as frequent flooding, lead contamination in drinking water, inequities in safety and maintenance of green space, and less access to Lake Michigan, the city's primary natural resource and recreational amenity.
The WaterMarks project advances informal STEM learning in at least two ways. First, while the WaterMarks project is designed to fit Milwaukee, the project includes the development of an Adaptable Model Guide. The Guide is designed so that other cities can modify and employ its inclusive structure, programming, and process of collaboration among artists, scientists, partner organizations, and residents to promote citywide civic engagement in urban sustainability through the combination of informal STEM learning and public art. The Guide will be developed by a Community-University Working Group (CULab) hosted by UW-Milwaukee's Center for Community-Based Learning, Leadership, and Research and made up of diverse community and campus-wide stakeholders. In addition to overseeing the Guide’s creation, CULab will conceptualize onboarding and mentorship strategies for new participants as well as a framework for the program’s expansion and sustainability.
Second, through evaluation and research, the project will build a theoretical model for the relationships among science learning, engagement with the arts, and the distinctive contexts of different neighborhoods within an urban social-ecological system. The evaluation team, COSI’s Center for Research and Evaluation, and led by Co-PI Donnelly Hayde, aims to conduct formative, summative, and process evaluation of the Watermarks project, with the additional goal of producing evaluative research findings that can contribute to the broader field of informal learning. Evaluation foci include: How does the implementation of WaterMarks support positive outcomes for the project’s communities and the development of an adaptable model for city-scale informal science learning about urban environments? 2. To what extent do the type and degree of outcome-related change experienced by participating community residents vary across and/or between project sites? What factors, if any, appear to be linked to these changes? 3. To what extent and in what ways do the activities of the WaterMarks projects appear to have in situ effects related to the experience of place at project sites?
The project’s research team led by PI Ryan Holifield and Co-PI Woonsup Choi, will investigate how visual artistic activities introduced by the programming team as part of the Walks (and potentially other engagement activities) interact with personal, sociocultural, and physical contexts to produce distinctive experiences and outcomes of informal science learning about urban water systems. The aim of the research will be to synthesize the results from the different WaterMarks sites into an analysis generalizable beyond specific neighborhoods and applicable to other cities. The project's research questions include: 1. How does participation in Walks focused on visual artistic activities affect outcomes and experiences of informal STEM learning about urban water systems? 2. How do outcomes and experiences of informal STEM learning vary across different urban water topics, participants from different demographic groups, and contrasting sociocultural and biophysical contexts?
This Innovations in Development project is led by the University of Wisconsin-Milwaukee (UWM), in collaboration with City as Living Laboratory (CALL) and the COSI Center for Research and Evaluation.
The call for more science, technology, engineering, and mathematics (STEM) education taking place in informal settings has the potential to shape future generations, drive new innovations and expand opportunities. Yet, its power remains to be fully realized in many communities of color. However, research has shown that using creative embodied activities to explore science phenomena is a promising approach to supporting understanding and engagement, particularly for youth who have experienced marginalization. Prior pilot work by the principal investigator found that authentic inquiries into science through embodied learning approaches can provide rich opportunities for sense-making through kinesthetic experience, embodied imagining, and the representation of physics concepts for Black and Latinx teens when learning approaches focused on dance and dance-making. This Research in Service to Practice project builds on prior work to better understand the unique opportunities for learning, engagement, and identity development for these youth when physics is explored in the context of the Embodied Physics Learning Lab Model. The model is conceptualized as a set of components that (1) allow youth to experience and utilize their intersectional identities; (2) impact engagement with physics ideas, concepts and phenomena; and (3) lead to the development of physics knowledge and other skills. The project aims to contribute to more expansive definitions of physics and physics learning in informal spaces. While the study focuses primarily on Black and Latinx youth, the methods and discoveries have the potential to impact the teaching of physics for a much broader audience including middle- and high-school children, adults who may have been turned off to physics at an earlier age, and undergraduate physical science majors who are struggling with difficult concepts. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The research is grounded in sociocultural perspectives on learning and identity, embodied interaction and enactive cognition, and responsive design. The design is also informed by the notion of “ArtScience” which highlights commonalities between the thinking and making practices used by artists and by scientists and builds on the theoretical philosophy that all things can be understood through art or through science but integrating the two lenses allows for more complete understandings. Research will investigate the relationship between embodied learning approaches, design principles, and structures of the Embodied Physics Learning Lab model using the lenses of physics, dance, and integrated ArtScience to better understand the model. The project employs design-based research to address two overarching research questions: (1) What unique opportunities for learning, engagement, and identity development for Black and Latinx youth occur when physics is explored in the context of the Embodied Physics Learning Lab Model? and (2) How do variations in site demographics and site implementation influence the impact and scalability of the Learning Lab model? Further, the inquiry will consider (a) how youth experience and utilize their intersectional various identities in the context of the activities, structures, and essential elements of the embodied physics learning lab; (b) how youth's level of physics engagement changes depending on which embodied learning approaches and essential element structures are used; (c) the physics knowledge and other skills youth attain through the set of activities; and (d) how, if at all, the embodied learning approaches engage youth in thinking about their own agency as STEM doers. An interdisciplinary team of researchers, choreographers, and youth along with community organizations will co-design and implement project activities across four sites. Approximately 200 high school youth will be engaged; 24 will have the role of Teen Thought Partner. Through three iterative design cycles of implementation, the project will refine the model to investigate which elements most affect successful implementation and to identify the conditions necessary for scale-up. Data will be collected in the form of video, field notes, pre- and post- interviews, pre- and post- surveys, and artifacts created by the youth. Analyses will include a combination of interaction analysis, descriptive data analysis, and movement analysis. In addition to the research findings and explication of the affordances and constraints of the model, the project will also create a curricular resource, including narrative text and video demonstrations of physics concepts led by the teen thought partners, video case training modules, and assessment tools.
DATE:
-
TEAM MEMBERS:
Folashade Cromwell SolomonDionne Champion
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Increasing greater diversity, equity, and inclusion in science not only presents a social justice goal, but is also vital to the financial and social success of the nation. The stereotype of the older white male scientist has obscured the contributions of women and people of color. This project seeks to remedy these perceptions which are barriers to entry into STEM fields. The project will create a large-scale hub for STEM themed video content on YouTube and other social media platforms, featuring 100+ original STEM videos produced by PBS partners. This hub and accompanying research seeks to identify the characteristics of online STEM content that attract (or fail to attract) underrepresented groups, specifically Black and Hispanic communities as well as women of all races. The objectives of this project are to 1) provide a unified online science-themed hub, PBS Terra, on YouTube and other platforms for hosting, sharing, and distributing digital STEM series from diverse producers from across the PBS system; 2) conduct surveys and focus groups to examine and understand the needs and expectations of women, Black and Hispanic communities and their consumption of STEM video content online and 3) test hypotheses about the communicative strategies of STEM videos that feature Black and Hispanic female scientists. Project collaborators include PBS, researchers at the University of Utah and the University of Georgia, and consultants and advisors with expertise in broadening participation and inclusion in STEM.
Little is known about how or why adult Americans seek science content on YouTube, especially the motivations of adults from underrepresented minorities and females. The key research questions in this project are: 1) Why do Black and Hispanic audiences and women of all races seek science video content online? 2) How does showing Black and Hispanic female scientists in science video content on YouTube impact viewers’ identification with and sense of belonging in STEM? 3) How does the use of humor by Black and Hispanic scientists in YouTube science content affect viewers’ perceptions of the communicator and their engagement with STEM content? 4) How does the appearance and manner of dress of Black and Hispanic scientists in YouTube science content affect viewers’ perceptions in the aforementioned areas? A nationally representative baseline survey will be conducted. A probability sample of 2000 respondents will be obtained including oversampling of Black and Hispanic audiences. To complement findings from the survey, focus groups will be conducted in eight different regions of the country to learn why these targeted audiences do or do not seek science content on YouTube and what motivates them to share the content with their social media network. In addition, an experiment embedded in an online survey will test the hypothesis that greater on-screen representation of women and scientists of color will broaden existing perceptions about scientists. The experiment will consist of a 3 (scientist’s race: Black/Hispanic/White) × 2 (science issue: controversial/non-controversial) × 2 (style: casual/professional) between-subjects design. Survey participants will be randomly assigned to the experimental conditions. These factors (science issue and host appearance) can be altered by content producers to better reach and engage the targeted audiences. The project not only investigates theoretical questions at the intersection of STEM stereotypes and race, but findings related to these experimental conditions will offer practical insight into strategies that can be used by science communication practitioners.
DATE:
-
TEAM MEMBERS:
Adam DylewskiSara YeoMichael Cacciatore
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project would expand the informal STEM learning field's understanding of how to use digital science media to increase STEM educational experiences and opportunities for English language learners. Across the U.S. there are significant STEM opportunity and achievement gaps for English learners with varying levels of English proficiency. This is at a time when the U.S. is facing a shortage of STEM professionals in the workforce including the life and physical science fields. This project aims to close these gaps and improve English learners' STEM learning outcomes using digital media. Within community colleges, there are multiple site-based programs to provide content to help English learners to learn English and to improve their math and literacy skills. Involving the state community college networks is a critical strategy for gathering important feedback for the pedagogical approach as well as for recruiting English learner research participants. The team will initially study an existing YouTube chemistry series produced by Complexly then produce and test new videos in Spanish using culturally relevant instructional strategies. The target audience is 18-34-year-old English learners. Project partners are Complexly, a producer of digital STEM media and EDC, a research organization with experience in studying informal STEM learning.
The project has the potential to advance knowledge about the use of culturally relevant media to improve STEM opportunities and success for English language learners. Using a Design-Based Implementation Research framework the research questions include: 1) what are the effective production and instructional strategies for creating digital media to teach science to English learners whose native language is Spanish? 2) what science content knowledge do English learners gain when the project's approach is applied to a widely available set of YouTube videos? and 3) how might the findings from the research be applied to future efforts targeting English learners? The project has the potential to significantly broaden participation in science and engineering. Phase 1 of the research will be an exploration of how to apply strategic pedagogical approaches to digital media content development. Interviews will be conducted with educators in 3 focal states with high numbers of English language learners (NY, CA, TX) to reflect on pedagogical foundations for teaching science to English learners. A survey of 30 English learners will provide feedback on the perceived strengths and weaknesses of a selection of existing YouTube chemistry videos. Phase 2 will create/test prototypes of 6 adapted chemistry videos. Forty students (ages 18-34) will be recruited and participate in cognitive interviews with researchers after viewing these videos. Based on this input additional videos will be produced with revised instructional strategies for further testing. Additional rounds of production and testing will be conducted to develop an English learners mini chemistry series. Phase 3 will be a pilot study to gauge the science learning of 75 English learners who will view an 11-episode chemistry miniseries. It will also identify gaps in expected learning to determine whether any further adjustments are necessary to the instructional approach.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Kelsey SavageCeridwen RileyStan MullerHeather LavigneCaroline ParkerKatrina Bledsoe
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project aims to understand ways to empower Latinx families (adult caregivers) to feel confident in their ability to support their middle school-aged girls in science and engineering activities. The project involves seven weeks of family programming around rockets or urban farming, as well as separate conversation groups for adult family members and girls. The project is relevant for several reasons: females and Latinx individuals are both underrepresented in science, technology, engineering, and math (STEM) coursework and careers; girls tend to lose interest in STEM by middle school age; and adult family members may have an impact on their children's attitudes and interests. The project partners with school districts and nonprofit organizations in Arizona and California.
This multidisciplinary project's priority is broadening participation, with a focus on increasing Latina girls' science and engineering interests through Family Project-Based Learning Activities, Conversation Groups, and a cultivated Community of Learners. It is based on the frameworks of Social Cognitive Career Theory and Community Cultural Wealth. The project aims to empower families (adult caregivers) to feel confident in their ability to support their daughters in science and engineering activities, which is often low especially among Latinx parents. The project will develop and evaluate two out-of-school enrichment methods for aiding families in encouraging and supporting their daughters in science: Family Problem-Based Learning Activities, which focus on rockets and urban farming, and Conversation Groups, which provide information and discussion for separate groups of parents and girls. A series of pilot studies will be conducted with 80 families to iteratively evaluate and improve the materials and procedure prior to the main study with 180 families, featuring a factorial design with a control group.
The materials developed and research findings may inform similar projects, especially those for students from culturally and linguistically diverse backgrounds and projects seeking to enhance the role of families in learning. The hypothesis guiding the project is that the greatest gains will be produced with the synergistic combination of enrichment methods. Another component that can potentially have broad impact is working to create environments where Community Cultural Wealth is recognized and enhanced through interactions of different families, creating Communities of Learners. This can inform projects that recognize the importance of community and/or that seek to use culture as an asset. The proposed study will engage three geographically distributed universities and several community partners. It will also provide university students and community leaders opportunities for work on instructional design, implementation, and research. The team will disseminate their findings and methods through multiple avenues to reach researchers, parents, leaders, curators, and educators in informal and K-12 settings.
This Research in Service to Practice award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Katherine Short-MeyersonPeter RilleroPeter MeyersonMargarita Jimenez-SilvaChristopher Edwards
Background. STEM identity has emerged as an important research topic and a predictor of how youth engage with STEM inside and outside of school. Although there is a growing body of literature in this area, less work has been done specific to engineering, especially in out-of-school learning contexts.
Methods. To address this need, we conducted a qualitative investigation of five adolescent youth participating in a four-month afterschool engineering program. The study focused on how participants negotiated engineering-related identities through ongoing interactions with activities, peers
The Oregon Museum of Science and Industry (OMSI), in collaboration with neuroscientists at the Oregon Health & Science University (OHSU), museum professionals, and community partners, proposes to create a 1,000 to 1,500-square-foot traveling exhibition, accompanying website, and complementary programming to promote public understanding of neuroscience research and its relevance to healthy brain development in early childhood. The exhibition and programs will focus on current research on the developing brain, up to age 5, and will reach a national audience of adult caregivers of young children and their families, with a special emphasis on Latino families. The project will be developed bi-culturally and bilingually (English/Spanish) in order to better engage underrepresented Latino audiences. The exhibition and programs will be designed and tested with family audiences.
The exhibition project, Interactive Family Learning in Support of Early Brain Development, has four goals that primarily target adult caregivers of children up to age 5:
Foster engagement with and interest in neurodevelopment during early childhood
Enhance awareness of how neuroscience research leads to knowledge about healthy development in early childhood
Inform and empower adult caregivers to enrich their children’s early learning experiences
Reach diverse family audiences, especially Latino caregivers and their families
A collaborative, multidisciplinary team of neuroscience researchers, experts in early childhood education, museum educators, and OMSI personnel with expertise in informal science education and bilingual exhibit development will work together to ensure that current science is accurately interpreted and effectively presented to reach the target audiences. The project will foster better public understanding of early brain development and awareness and confidence in caregivers in using play to enrich their children’s experiences and support healthy brain development. Visitors will explore neuroscience and early childhood development through a variety of forms—multi-sensory, hands-on interactive exhibits, graphic panels, real objects, facilitated experiences, and an accompanying website.
Following the five-year development process, the exhibition will begin an eight-year national tour, during which it will reach more than one million people.