In this collaborative project, a university research lab and children's science museum work together to design, implement, study, and revise a week-long data science camp for middle school age students, data science learning assessment items and a facilitator training curriculum.
Arecibo C3 will serve as a collaborative hub for STEM discovery and exploration by building upon existing programs and opportunities established at the Arecibo site by previous NSF programs, while also creating new STEM education, research, and outreach programs and initiatives. The goals for the Center are to (1) promote STEM education, learning, and teaching; (2) support fundamental and applied STEM and STEM education research; (3) broaden participation in STEM; and (4) build and strengthen collaborations and partnerships.
DATE:
-
TEAM MEMBERS:
Jose Agosto RiveraJoseph Carroll-MirandaJaime Abreu RamosAmilcar VelezJason WilliamsCristina Fernandez-MarcoWanda Diaz MercedAnuchka RamosPatricia Ordonez
This project aims to advance racial equity in outdoor and environmental science education (OESE) by co-developing, implementing, and studying a replicable model for organizational capacity building and transformation.
DATE:
-
TEAM MEMBERS:
Jedda ForemanCraig StrangValeria Romero
The New York Hall of Science (NYSCI), will recruit and support two postdoctoral fellows, who will spend 24 months conducting research in residence with NYSCI's diverse staff, audiences, and local community. This fellowship program is designed to support the postdoctoral researchers as they develop and pursue independent lines of research on equitable and inclusive informal STEM learning experiences.
While there is a growing commitment in ISL to broadening participation in STEM, genuine diversity cannot be attained if current efforts continue to revolve around a dominant paradigm. This research synthesis project will review, summarize, and interpret existing research and knowledge on non-Western STEM knowledge, worldviews, and ways of knowing.
Stark inequities evident in the low representation of Black women in Science, Technology, Engineering, Mathematics, and Medicine (STEMM) careers persist despite considerable investment in the diversification of the education-to-workplace STEMM pipeline. College participation rates of Black women measure 4-5% of all degrees in biological and physical sciences, 2-3% of degrees in computer science and math, and roughly 1% in engineering. Ultimately, Black women make up only 2.5% of the workforce in STEMM-related fields, indicating that they chronically experience stalled professional advancement. Because there are so few longitudinal studies in either formal or informal settings, educators and researchers lack critical insights into why BA/BS credentialed Black women drop out of STEMM careers at high rates upon entering the workforce. This Research in Service to Practice project will conduct a longitudinal examination of key professional outcomes and life trajectories among adult Black women who enrolled Women in Natural Sciences (WINS), a 40-year-old out-of-school time (OST) high school STEM enrichment program. Prior research on WINS documents that alumnae outperform national averages on all metrics related to STEMM advancement up through college graduation. This study will test the hypothesis that such success continues for these cohorts as they pursue life goals and navigate the workforce. Findings from this study will promote the progress of science, pivotal to NSF’s mission as the project builds knowledge about supportive and frustrating factors for Black women in STEMM careers. Strategic impact lies in the novel participant-centered research methods that amplify Black women’s voices and increase both accuracy and equity in informal STEM learning research.
This research probes the experiences of Black women at a critical phase of their workforce participation when BS/BA credentialed WINS alumnae establish their careers (ages 26-46). The team will conduct a longitudinal comparative case study of outcomes and life trajectories among 20 years of WINS cohorts (1995-2015). Research questions include (1) What do the life-journey narratives of WINS alumnae in adulthood reveal about influential factors in the socio-cultural ecological systems of Black women in STEMM? (2) What are the long-term outcomes among WINS women regarding education, STEMM and other careers, socio-economic status, and STEMM self-efficacy and interest? How do these vary? (3) What salient program elements in WINS are highlighted in alumnae narratives as relevant to Black women’s experiences in adulthood? How do these associations vary? (4) How do selected outcomes (stated in RQ2) and life story narratives among non-enrolled applicants compare to program alumnae? and (5) How do salient components in the WINS program associate with socio-cultural factors in regard to Black women’s careers and other life goals? Participants include 100 Black WINS alumnae as an intervention group and a matched comparison group of 100 Black women who successfully applied to the WINS program but did not or could not enroll. Measurable life outcomes and life trajectory narratives with maps of experiences from both groups will be studied via a convergent mixed methods design inclusive of quantitative and qualitative analyses. Comparisons of outcomes and trajectories will be made between the study groups. Further, associations between alumnae’s long-term outcomes and how they correlate their WINS experiences with other socio-cultural factors in their lives will be identified. It is anticipated that findings will challenge extant knowledge and pinpoint the most effective characteristics of and appropriate measures for studying lasting impacts of OST STEMM programs for Black women and girls. The project is positioned to contribute substantially to national efforts to increase participation of Black women in STEMM.
DATE:
-
TEAM MEMBERS:
Ayana Allen-HandyJacqueline GenovesiLoni Tabb
Science identity has been shown to be a necessary precondition to academic success and persistence in science trajectories. Further, science identities are formed, in large part, due to the kinds of access, real or perceived, that (racialized) learners have to science spaces. For Black and Latinx youth, in particular, mainstream ideas of science as a discipline and as a culture in the US recognize and support certain learners and marginalize others. Without developing identities as learners who can do science, or can become future scientists, these young people are not likely to pursue careers in any scientific field. There are demonstrable links between positive science identities and the material and social resources provided by particular places. Thus, whether young people can see themselves as scientists, or even feel that they have access to science practices, also depends on where they are learning it. The overarching goal of this project is to broaden participation of Black and Latinx youth in science by deepening our understanding of both science identities and how science learning spaces may be better designed to support the development of positive science identities of these learners. By deepening the field’s knowledge of how science learning spaces shape science identities, science educators can design more equitable learning spaces that leverage the spatial aspects of program location, culturally relevant curriculum, and participants’ lived experiences. A more expansive understanding of positive science identities allows educators to recognize these in Black and Latinx learners, and direct their continued science engagements accordingly, as positive identities lead to greater persistence in science. This project is a collaboration between researchers at New York University and those at a New York City informal science organization, BioBus. It is funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This participatory design research project will compare three different formats, in different settings, of afterschool science programming for middle schoolers: one located in a lab space on the campus of a nearby university, one located in the public middle school building of participating students, and one aboard a mobile science lab. For purposes of this study, the construct of “setting” refers to the dimensions of geographic location, built physical environment, and material resources. Setting is not static, but instead social and relational: it is dynamically (co)constructed and experienced in activity by individuals and in interaction by groups of individuals. Therefore, the three BioBus programming types allow for productive comparison not only because of their different geographic locations, built environments, and material resources (e.g., scientific tools), but also the existing relationships learners may have with these places, as well as the instructional designs and pedagogical practices that BioBus teaching scientists use in each. This project uses a design-based research approach to answer the following research questions: (1) How do the settings of science learning shape science identity development? What are different positive science identities that may emerge from these relationships? And (2) What are ways to leverage different spatial aspects of informal science programming and instruction to support positive science identities? The study uses ethnographic and micro-analytic methods to develop better understandings of the relationships between setting and science identity development, uncover a broad range of types of positive science identities taken up by our Black and Latinx students, and inform informal science education to design for and leverage spatial aspects of programming and instruction. Findings will contribute to a systematic knowledge base bringing together spatial aspects of informal science education and science identity and identity development, and provide new tools for informal science educators, including design principles for incorporating spatial factors into program and lesson planning.
DATE:
-
TEAM MEMBERS:
Jasmine MaLatasha WrightRoya Heydari
This project is designed to support collaboration between informal STEM learning (ISL) researchers, designers, and educators with sound researchers and acoustic ecologists to jointly explore the role of auditory experiences—soundscapes—on learning. In informal STEM learning spaces, where conversation advances STEM learning and is a vital part of the experience of exploring STEM phenomena with family and friends, attention to the impacts of soundscapes can have an important bearing on learning. Understanding how soundscapes may facilitate, spark, distract from, or even overwhelm thinking and conversation will provide ISL educators and designers evidence to inform their practice. The project is structured to reflect the complexity of ISL audiences and experiences; thus, partners include the North Park Village Nature Center located in in a diverse immigrant neighborhood in Chicago; Wild Indigo, a Great Lakes Audubon program primarily serving African American visitors in Midwest cities; an after-school/summer camp provider, STEAMing Ahead New Mexico, serving families in the rural southwest corner of New Mexico, and four sites in Ohio, MetroParks, Columbus Zoo and Aquarium, Franklin Park Conservatory and Botanical Gardens, and the Center of Science and Industry.
Investigators will conduct large-scale exploratory research to answer an understudied research question: How do environmental sounds impact STEM learning in informal learning spaces? Researchers and practitioners will characterize and describe the soundscapes throughout the different outdoor and indoor exhibit/learning spaces. Researchers will observe 800 visitors, tracking attraction, attention, dwell time, and shared learning. In addition to observations, researchers will join another 150 visitors for think-aloud interviews, where researchers will walk alongside visitors and capture pertinent notes while visitors describe their experience in real time. Correlational and cluster analyses using machine learning algorithms will be used to identify patterns across different sounds, soundscapes, responses, and reflections of research participants. In particular, the analyses will identify characteristics of sounds that correlate with increased attention and shared learning. Throughout the project, a team of evaluators will monitor progress and support continuous improvement, including guidance for developing culturally responsive research metrics co-defined with project partners. Evaluators will also document the extent to which the project impacts capacity building, and influences planning and design considerations for project partners. This exploratory study is the initial in a larger research agenda, laying the groundwork for future experimental study designs that test causal claims about the relationships between specific soundscapes and visitor learning. Results of this study will be disseminated widely to informal learning researchers and practitioners through workshops, presentations, journal articles, facilitated conversations, and a short film that aligns with the focus and findings of the research.
DATE:
-
TEAM MEMBERS:
Martha MersonJustin MeyerDaniel Shanahan
resourceprojectProfessional Development, Conferences, and Networks
Diversity, equity, access, inclusion, and belonging-related change is often difficult to achieve in organizations. In the context of Informal STEM Learning (ISL), this results in inequitable opportunities for both ISL professionals and learners to engage in STEM environments and experiences. For people to thrive in these settings, creative and innovative approaches that address historical and current realities of intersectional marginalization and inequitable norms within informal STEM institutions are necessary to disrupt conventions, institutional barriers, and patterns of inequities. TERC and the Detroit Zoological Society will develop and implement an ISL Equity Resource Center (the Center). The Center will advance equity within the ISL field by cultivating a multi-sector, diverse learning community that designs and conducts evidence-based research and practice, including but not limited to equity-focused leadership, decision-making, theory, methods, project topic selection and design, and budget management.
The Center will cultivate lasting change in the ISL and broader STEM learning ecosystem via (a) sharing more inclusive, culturally relevant, and responsive ISE research and practice; (b) identifying scalable, equity-focused research findings useful in ISL programming; and (c) promoting greater public awareness of the importance of broadening participation in STEM. The Center's primary stakeholders are ISL professionals, including researchers, practitioners, and evaluators. The Center will maintain and expand a digital infrastructure to support innovation and sharing across the ISL field. Through its combined efforts, the Center will raise the visibility and impact of ISL equity-focused research and practice and its contributions to the overall STEM endeavor. The Center will also organize and host the biennial AISL Awardee Meeting. The Center is funded by the Advancing Informal STEM Learning program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Stephen AlkinsDiane MillerLisette Torres-GeraldPati Ruiz
resourceprojectProfessional Development, Conferences, and Networks
Developing solutions to large-scale collective problems -- such as resilience to environmental challenges -- requires scientifically literate communities. However, the predominant conception of scientific literacy has focused on individuals, and there is not consensus as to what community level scientific literacy is or how to measure it. Thus, a 2016 National Academies of Sciences, Engineering, and Medicine report, “Science Literacy: Concepts, Contexts, and Consequences,” stated that community level scientific literacy is undertheorized and understudied. More specifically, the committee recommended that research is needed to understand both the i) contexts (e.g., a community’s physical and social setting) and ii) features of community organization (e.g., relationships within the community) that support community level science literacy and influence successful group action. This CAREER award responds to this nationally identified need by iteratively refining a model to conceptualize and measure community level scientific literacy. The model and metrics developed in this project may be applied to a wide range of topics (e.g., vaccination, pandemic response, genetically-modified foods, pollution control, and land-use decisions) to improve a community’s capacity to make scientifically-sound collective decisions. This CAREER award is funded by the Advancing Informal STEM Learning (AISL) and the EHR CORE Research (ECR) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the ECR program goal to advance relevant research knowledge pertaining to STEM learning and learning environments.
The proposed research will conceptualize, operationalize, and measure community level scientific literacy. This project will use a comparative multiple case study research design. Three coastal communities, faced with the need to make scientifically-informed land-use decisions, will be studied sequentially. A convergent mixed methods design will be employed, in which qualitative and quantitative data collection and analyses are performed concurrently. To describe the i) context of each community case, this project will use qualitative research methods, including document analysis, observation, focus groups, and interviews. To measure the ii) features of community organization for each community case, social network analysis will be used. The results from this research will be disseminated throughout and at the culmination of the project through professional publications and conference presentations as well as with community stakeholders and the general public. The integrated education activities include a professional learning certificate for informal science education professionals and STEM graduate students. This certificate emphasizes high-quality community-engaged scholarship, placing students with partners such as museums, farmer’s markets, and libraries, to offer informal learning programs in their communities. This professional learning program will be tested as a model to provide training for STEM graduate students who would like to communicate their research to the public through outreach and extension activities.
Early childhood is a critical time for developing foundational knowledge, skills, and interest in science, technology, engineering, and mathematics (STEM). For that reason, the Public Broadcasting Service (PBS) places a great priority on developing early childhood STEM content, especially through its television shows that are watched by over 60% of young children in the United States. Research suggests that adding in-the-moment interaction to television watching promotes learning and engagement. Toward this end, researchers from the University of California, Irvine and PBS KIDS have prototyped interactive versions of science shows that children view on internet-connected devices while they communicate with the main character powered by an AI conversational agent. Pilot studies show that when children watch these new interactive videos with the main character pausing periodically to ask probing questions about the learning goals of the episode and following up with appropriate responses, they are more engaged and learn more about science, with heightened benefits for children who speak languages other than English at home. Based on these early results, in this Innovations in Development project the research team will develop, test and produce publicly available conversational episodes for two PBS KIDS television shows, one focused on science and the other on computational thinking.
The project will iteratively study and develop six conversational videos with novel forms of support for children, including extended back-and-forth conversation that builds upon a child's responses, visual scaffolding that facilitates verbal communication, and bilingual language processing so that children can answer in English or Spanish. The conversational videos will be evaluated in both lab-based and home settings. The lab-based study will involve 600 children ages 3-7 in a predominantly low-income Latino community in Southern California, in which researchers compare children’s learning and engagement when watching the conversational videos with three other formats: (1) watching the non-interactive broadcast version of the video; (2) watching the video with pseudo-interaction, in which the main character asks questions and gives a generic response after a fixed amount of time but can’t understand what the child says; or (3) watching the broadcast version of the video with a human co-viewer who pauses the video and asks questions. The home-based study will involve 80 families assigned to watch either the non-interactive or interactive videos as many times as they want over a month at home. In both the lab-based and home studies, pre- and post-tests will be used to examine the impact of video watching on science and language learning, and log data will be used to assess children’s verbalization and engagement while watching. Following the home study, the six videos will be further refined and made available for free to the public through the PBS KIDS apps and website, which are visited by more than 13 million users a month. Beyond providing engaging science learning opportunities to children throughout the country, this study will yield important insights into the design, usability, feasibility, and effectiveness of incorporating conversational agents into children’s STEM-oriented video content, with implications for extending this innovation to other educational media such as e-books, games, apps, and toys.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Mark WarschauerSilvia LovatoAndres BustamanteAbby JenkinsYing Xu
Access to STEM information is unequal, with rural and poor communities often receiving the fewest public education science and science literacy opportunities. Rural areas also face unique STEM teaching and technology integration challenges. In fact, LatinX communities in rural areas are less likely to have access to educational resources and language supports available to LatinX communities in urban centers. This project will help address these inequities by engaging rural librarians, bilingual science communicators, polar scientists, and a technical team to create a series of five bilingual virtual reality (VR) experiences to enhance STEM understanding and appreciation. Project researchers will create a new channel for disseminating polar science, working first with rural Latinx communities in Wisconsin to create a new network between rural communities and university researchers. Involving rural librarians in the co-design of instruction process will produce new ways for rural libraries to engage their local communities and their growing Latinx populations with polar science learning experiences. Each of the five VR experiences will focus on a different area of research, using the captivating Arctic and Antarctic environments as a central theme to convey science. VR is a particularly powerful and apt approach, making it possible to visit places that most cannot experience first-hand while also learning about the wide range of significant research taking place in polar regions. After design, prototyping and testing are finished, the VR experiences will be freely available for use nationally in both rural and urban settings. Public engagement with science creates a multitude of mutual benefits that result from a better-informed society. These benefits include greater trust and more reasoned scrutiny of science along with increased interest in STEM careers, many of which have higher earning potential. The project team will partner with 51 rural libraries which are valued community outlets valuable outlets to improve science literacy and public engagement with science. The effects of this project will be seen with thousands of community members who take part in the testing of prototype VR experiences during development and scaled engagement through ongoing library programs utilizing the final VR experiences for years to come.
This project will create new informal STEM learning assessment techniques through combining prior efforts in the areas of educational data mining for stealth assessment and viewpoint similarity metrics through monitoring gaze direction. Results of the project contribute to the field of educational data mining (EDM), focusing on adopting its methods for VR learning experiences. EDM is a process of using fine grained interaction data from a digital system to support educationally relevant conclusions and has been applied extensively to intelligent tutors and more recently, educational videogames. This project will continue building on existing approaches by expanding to include the unique affordances of VR learning media, specifically gaze. The project will focus on predicting user quitting as well as assessing key learning goals within each experience and triangulate these predictive models with user observations and post-experience surveys. The eventual application of this foundational research would address the problem in assessing a learner using measures external to the experience itself (i.e., surveys) and instead provide new methods that instrument learners using only data generated by their actions within the learning context. These techniques will provide a new means for evaluating informal learning in immersive technology settings without need for explicit tagging. The findings from this project will enable a greater understanding of the relationship between a user’s experience and their learning outcomes, which may prove integral in the creation of educational interventions using VR technology.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments. This project is also supported by the Office of Polar Programs.