Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
What do you think?
How do you connect with youth audiences?
What assumptions do you have about how identity relates to exhibit engagement?
How do factors that shape your identity impact your life? Has this shifted over time?
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Dinosaurs of Antarctica is a giant screen film and outreach project that documents the work of NSF-funded researchers on expeditions to Shackleton Glacier during the 2017-2018 field season. This immersive film and companion television special will bring the past to life and engage the public, and particularly students in middle grades (6-9), with polar science through appealing, entertaining media experiences and informal learning programs. The film serves as a companion for the synonymous Antarctic Dinosaurs museum exhibition
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.
Reframing engineering activities to emphasize the needs of others has the potential to strengthen engineering practices like problem scoping, while also providing more inclusive and socially relevant entry points into engineering problems. In a three-year design-based research project, we developed novel strategies for adding narratives to engineering activities to deepen girls’ engagement in engineering practices by evoking empathy for the users of their designs. In this article, we describe a set of hands-on engineering activities developed through iterative development and testing with 190
Awareness of a STEM discipline is a complex construct to operationalize; a learner’s awareness of a discipline is sometimes viewed through the lens of personal identity, use of relevant discourse, or knowledge of career pathways. This research proposes defining engineering awareness through a learner’s associations with engineering practices - fundamental processes involved in engineering such as identifying criteria and constraints, testing designs, diagnosing issues and assessing goal completion. In this study, a learner’s engineering awareness was determined by examining 1) their ability to
This document provides a brief story about how the Designing our Tomorrow team explored some of their questions about exhibit features by using the C-PIECE Framework: Framework of Collaborative Practices at Interactive Engineering Challenge Exhibits.
This exploratory line of inquiry looked at relationships between exhibit features and visitor groups’ Informed engineering design practices. This brief includes an Introduction, Methods and Findings, Summary, and Implications.
This exploratory line of inquiry was conducted to inform the development of the Designing our Tomorrow exhibit and
This paper provides detailed descriptions of the goals, theoretical perspectives, context, and methods used in A study of collaborative practices at interactive engineering challenge exhibits (the C-PIECE Study), the first of two studies in the Designing Our Tomorrow (DOT) research program. The C-PIECE Study supported foundational and exploratory lines of inquiry related to engineering practices used by families engaging with design challenge exhibits. This paper describes the study background and methods as an anchor to four other products that detail these four specific lines of inquiry and
The purpose of this research was to explore associations between engineering practices included in the C-PIECE framework. In this work, we took particular interest in practices under the Defining a Problem proficiency. Practices under Defining a Problem have great potential to influence the entire exhibit interaction and early observations indicated that visitor groups did not engage frequently in these practices at the informed level, therefore they were seen as an opportunity ripe for study. Through observations, interviews, and video analysis, the DOT research team investigated the
Very little is known about the experiences of people with learning disabilities in informal learning environments such as science centers and museums. This project will describe the ways in which engagement and intrinsic motivation for learning are and are not supported for visitors with learning disabilities, and build capacity for informal STEM education practitioners to apply this learning for the benefit of those with learning disabilities as well as any visitor who needs more support in the context of self-directed learning. Broadening participation science, technology, engineering and math (STEM) is a core goal of the National Science Foundation and its Advancing Informal STEM Learning (AISL) program. This project pursues this goal with a focus on young people with learning disabilities. As the largest group of individuals with disabilities in the United States, people with learning disabilities make up an estimated 20% of the U.S. population. Science professions offer many life- and work-related opportunities for individuals with learning disabilities, and the flexible experiences of informal learning spaces offer important opportunities to promote participation, engagement in and motivation for science. This work represents the next generation of accessible design to broaden participation in, and impacts of, informal STEM learning opportunities. This project will generate guidelines and resources to support inclusive design for this group of visitors. Resources will include a Toolkit of Visual Assets that can be shared digitally and in print with youth with learning disabilities, informal STEM practitioners, and the learning disability research and practice community.
The project will develop empirical knowledge to support informal STEM practitioners to better facilitate the inclusion of youth with learning disabilities. Using the lens of Self-Determination Theory as an explanatory framework, this research will be pursued in three phases. Self-Determination Theory describes the psychological needs that must be met, such as autonomy and feelings of efficacy, to create an environment that supports individuals' engagement in self-motivated behaviors. Phase 1 will be an exploratory study describing the engagement and motivation of adolescents (ages 10-17) with learning disabilities when experiencing varied STEM exhibits. This first phase will adapt validated scales, employ an existing observation protocol, and conduct stimulated recall interviews with youth. Phase 2 will explore, develop and investigate design strategies to improve the intrinsic motivation of youth with learning disabilities at educational STEM exhibits. This second phase will involve a set of experimental studies in which design strategies related to intrinsic motivation are manipulated to inform principles of inclusive design for visitors with learning disabilities. As in the previous phase, Phase 2 will adapt validated scales and employ an existing observation protocol. Phase 3 will focus on design charrettes in which researchers and practitioners work with high school students with learning disabilities in a co-design process. The charrettes will generate guidelines and case examples of exhibit components using Universal Design for Learning to balance varying design priorities and effectively, inclusively design exhibits for this population. This third phase will rely on qualitative coding of co-design charette artifacts, field notes and researcher reflections; member checking will play an important role in the coding process. Dissemination efforts for this project will target youth with learning disabilities, informal STEM education practitioners, and the broader field of learning disability researchers and practitioners. In addition to the exhibit design guidelines and Toolkit described above, the project will publish peer reviewed articles and develop manuscripts aimed at educational research and practice.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Science centres have been identified as an important resource in encouraging teenagers to choose higher education in science and technology. This is of interest to society, since there seems to be a problem in getting sufficient numbers to do so. And accomplishing this is sometimes described as a fatal question for a nation’s future prosperity and development. Still, there is an international trend where teenagers fail to visit science centres.
Through research, little is known about what is interesting or useful to the public, as well as how to reach those who are ‘unengaged’. Considering