This paper examines STEM-based informal learning environments for underrepresented students and reports on the aspects of these programs that are beneficial to students. This qualitative study provides a nuanced look into informal learning environments and determines what is unique about these experiences and makes them beneficial for students. We provide results of a qualitative research study conducted with the Mathematics, Engineering, Science Achievement (MESA) program, an informal learning environment that has proven to be effective in recruiting, retaining and encouraging
DATE:
TEAM MEMBERS:
Cameron DensonChandra Austin StallworthChristine HaileyDaniel Householder
Researchers examined whether engineering activities and lessons can help students apply science and math content in real-world contexts and gain insights into the professional activities and goals of engineers.
This is a Science Learning+ planning project that will develop a plan for how to conduct a longitudinal study using existing data sources that can link participation in science-focused programming in out-of-school settings with long-range outcomes. The data for this project will ultimately come from "mining" existing data sets routinely collected by out-of-school programs in both the US and UK. 4H is the initial out-of-school provider that will participate in the project, but the project will ideally expand to include other youth-based programs, such as Girls Inc. and YMCA. During the planning grant period, the project will develop a plan for a longitudinal research study by examining informal science-related factors and outcomes including: (a) range of educational outcomes, (b) diversity and structure of learning activities, (c) links to formal education experiences and achievement measures, and (d) structure of existing informal science program data collection infrastructure. The planning period will not involve actual mining of existing data sets, but will explore the logistics regarding data collection across different informal science program, including potential metadata sets and instruments that will: (a) identify and examine data collection challenges, (b) explore the implementation of a common data management system, (c) identify informal science programs that are potential candidates for this study, (d) compare and contrast data available from the different programs and groups, and (e) optimize database management.
This Science Learning+ project will develop research-and-practice activities to explore how an integrated art, STEM, and society (what we refer to as STEAM) approach can expand science engagement and learning of youth aged 15-19, from low-income and non-dominant cultural communities. The project will review current knowledge, practice, and trends related to underrepresented youth, STEAM, and science engagement. The review will be used to develop: (1) A cross-setting research framework for investigating the relationship between informal STEAM learning experiences and young people's developing engagement with science. (2) Design principles for out-of-school STEAM programs that have proven effective in cultivating youth engagement with science and making relevant cross-setting connections. (3) Practitioner-friendly program evaluation tools that integrate findings from current research and practice related to cross-setting science learning of young adults especially non-dominant youth as it relates to STEAM learning experiences.
This CRPA award addresses the issue of multidisciplinary science and the public's awareness of the ideas. The PIs believe that the prevalence of multidisciplinary science is high and growing fast. Thus, the public and particularly the younger generations need to understand these concepts and to begin thinking in those terms. Thus, they will derive hands-on modules for three age groups that are age appropriate. The project team includes 7 NSF funded researchers who do multidiscipline-based research in biology, mathematics and engineering. These modules will be tested at the Boy and Girls Club of Dane County prior to being exhibited at the Madison Children's Museum and the Aldo Leopold Nature Center. Further, the local PBS TV station (WPT) will air some of the demonstrations giving the project more visibility and impact. Each set of modules designed for the three age groups shall be evaluated separately using age specific goals and objectives. The project is a collaboration between 7 scientists and engineers, the Boys and Girls Club of Dane County, the Aldo Leopold Nature Center, the Madison Children's Museum, and the Wisconsin Institutes of Discovery of the University of Wisconsin.
The C2C award addresses the lack of validated instruments to measure teamwork and collaboration in middle and high school students in out of school time (OST) settings by implementing a rigorous four-phase process to develop new assessments. Phase 1 focuses on defining the construct of teamwork and collaboration skills so it aligns with the research literature and is relevant to outcomes in a variety of STEM OST programs. Construct maps are developed during Phase 2 to guide item development. The instruments are piloted in Phase 3 through think-aloud interviews and survey administration with a diverse set of youth and programs. Through an iterative process, items are revised or removed based on their psychometric properties. The final phase is a national field test with a cross-section of STEM OST programs. C2C's intellectual merit is its potential to advance understanding of how to measure teamwork and collaboration skills in STEM OST programs. There is a national call for more measures to evaluate 21st century skills. C2C's creation of instruments to measure teamwork and collaboration skills in STEM OST programs helps to address this gap. The work of C2C addresses broader impacts and benefit society by creating tools to understand the role STEM OST programs play in readying our nation's youth for the STEM workforce. C2C will create instruments validated specifically for this diverse population, allowing programs to understand the role they play in important societal STEM workforce readiness outcomes. C2C also benefits the informal science education field by conceptualizing the construct of teamwork and collaboration within STEM OST programs and developing validated instruments to understand the impact of these programs on youth.
Most students who pursue math have chosen to do so by high school. Elementary and middle school experiences are thus vitally important in attracting students to STEM. Research consistently points to after-school as a golden opportunity to increase students' exposure to high-quality math learning opportunities and to develop the key influencers of math participation and persistence: interest and identity. However, more research on how and under what conditions after-school programs can foster these factors is needed. The role of identity in math education has been particularly neglected. The proposed research project addresses this gap by studying the implementation and outcomes of After-School Math PLUS (ASM+), an after-school math program designed to address all aspects of math identity and thus have a positive effect on this key influencer of math participation and achievement. "Improving Math Identity" is a Research-in-Service to Practice project funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. The team will study the impact of ASM+ through a rigorous randomized controlled trial of 30 elementary-level after-school sites in South Carolina serving predominately low-income and minority students (15 treatment using ASM+; 15 control using Mixing in Math). Sites selected into the study must serve fourth and fifth graders and must operate five days a week. Through an implementation study, data will be collected in order to assess the program and understand the experiences of group leaders and students in the ASM+ program and at comparison sites. Data sources include surveys, interviews, observations, and administrative data collected from the treatment and control sites. The study will investigate how and to what extent ASM+ develops fourth and fifth grade students' math identity and increases math engagement and interest. It will explore whether increasing identity, engagement, and interest leads to greater skill development and academic achievement. This research is being conducted by IMPAQ International LLC, a social science and public policy research and evaluation firm in collaboration with Educational Equity at FHI 360, a global development and education organization. The research addresses the need to enhance students' math identity at an early age and, as a result, change students' educational and career aspirations. The ultimate goal is to broaden participation in STEM by underrepresented groups. Results will inform the development of interventions designed to motivate and retain students in STEM, particularly in informal settings. Knowledge gained from this research will be broadly disseminated to practitioners, researchers, program developers, and policy makers.
DATE:
-
TEAM MEMBERS:
Cheri FancsaliMerle FroschlBarbara Sprung
Research shows that participation and interest in science starts to drop as youth enter high school. This is also the point when science becomes more complex and there is increased need for content knowledge, mathematics capability, and computer or computational knowledge. Evidence suggests that youth who participate in original scientific research are more likely to enter and maintain a career in science as compared to students who do not have these experiences. We know young people get excited by space science. This project (STEM-ID) is informed by previous work in which high school students were introduced to scientific research and contributed to the search for pulsars. Students were able to develop the required science and math knowledge and computer skills that enabled them to successfully participate. STEM-ID builds on this previous work with two primary goals: the replication of the local program into a distributed program model and an investigation of the degree to which authentic research experiences build strong science identities and research self-efficacies. More specifically the project will support (a) significant geographic expansion to institutions situated in communities with diverse populations allowing substantial inclusion of under-served groups, (b) an online learning and discovery environment that will support the participation of youth throughout the country via online activities, and (c) opportunities for deeper participation in research and advancement within the research community. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and understanding of, the design and development of STEM learning in informal environments. STEM-ID will serve 2000 high school youth and 200 high school teachers in afterschool clubs with support from 30 undergraduate and graduate students and 10 college/university faculty. Exploratory educational research will determine the broad mechanisms by which online activities and in-person and online peer-mentor teacher-scientist interactions influence science identity, self-efficacy, motivation, and career intentions, as well as a focused understanding of the mechanisms that influence patterns of participation. Youth will be monitored longitudinally through the first two years of college to provide an understanding of the long-term effects of out-of-class science enrichment programs on STEM career decisions. These studies will build an understanding of the best practices for enhancing STEM persistence in college through engagement in authentic STEM programs before youth get to college. In addition to the benefits of the education research, this program may lead participants to discover dozens of new pulsars. These pulsars will be used for fundamental advances such as for testing of general relativity, constraining neutron star masses, or detecting gravitational waves. The resulting survey will also be sensitive to transient signals such as sporadic pulsars and extragalactic bursts. This project provides a potential model for youth from geographical disparate places to participate in authentic research experiences. For providers, it will offer a model for program delivery with lower costs. Findings will support greater understanding of the mechanisms for participation in STEM. This work is being led by West Virginia University and the National Radio Astronomy Observatory. Participating sites include California Institute of Technology, Cornell University, El Paso Community College, Howard University, Montana State University, Penn State University, Texas Tech University, University of Vermont, University of Washington, and Vanderbilt University.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This research project leverages ongoing longitudinal research to investigate whether, and if so how, youth from ages 10 to 15 in a diverse, under-resourced urban community become interested and engaged in STEM. The project addresses a global issue; fewer youth choose to major in scientific fields or take science coursework at high school or university levels. These declining numbers result in fewer STEM professionals and fewer scientifically literate citizens who are able to function successfully in an increasingly scientific and technological society. These declines are observed for youth as a whole, but are most pronounced for girls and particular non-white ethnic minorities. Data collected from youth in this community of study, including non-white ethnic minorities, mirrors this decline. NSF funding will support a five-year systematic and systemic process in which project researchers work collaboratively with existing informal and formal educational partners (e.g., museums, libraries, afterschool providers, schools) to develop sets of customized, connected, and coordinated learning interventions, in and out of school, for youth with different backgrounds, needs, and interests, all with the goal of averting or dampening this decline of STEM interest and participation during early adolescence. In addition to new research and community STEM networks, this project will result in a Community Toolkit that includes research instruments and documentation of network-building strategies for use by other researchers and practitioners nationally and internationally. This mixed methods exploratory study has two distinct but interrelated populations - youth and educators from across informal and formal institutions. To develop a clearer understanding of the factors that influence youths' STEM interest development over time, particularly among three youth STEM Interest Profiles identified in a secondary analysis (1-Dislike Math, 2-Like all STEM, 3-Dislike all STEM), the design combines surveys with in-depth interviews and observations. To study educators and institutions, researchers will combine interviews, focus groups, and observations to better understand factors that influence community-wide, data-driven approaches to supporting youth interest development. Research will be conducted in three phases with the goal of community-level change in youth STEM interest and participation. In Phase 1 (Years 1 & 2) four educational partners will develop interventions for a 6th and 7th grade youth cohort that will be iteratively refined through a design-based approach. Educational partners and researchers will meet to review and discuss interest and participation data and use these data to select content, as well as plan activities and strategies within their programs (using a simplified form of conjecture mapping). By Phase 2 (Years 3 & 4) four additional partners will be included, more closely modeling the complex system of the community. With support from researchers support and existing partners, new educational partners will similarly review and discuss data, using these to select content, as well as plan activities consistent with program goals and strategies. Additional interventions will be implemented by the new partners and further assessed and refined with a new 6th and 7th grade cohort, along with the existing interventions of the first four partners. In Phase 3 (Year 5) data will be collected on pre-post community-level changes in STEM interest and participation and the perceived effectiveness of this approach for youth. These data will inform future studies.
More and more young people are learning about science, technology, engineering, and mathematics (STEM) in a wide variety of afterschool, summer, and informal programs. At the same time, there has been increasing awareness of the value of such programs in sparking, sustaining, and extending interest in and understanding of STEM. To help policy makers, funders and education leaders in both school and out-of-school settings make informed decisions about how to best leverage the educational and learning resources in their community, this report identifies features of productive STEM programs in