This award is funded in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
This project will create the specification for a learner-controlled system to represent youth learning in Out-of-School-Time (OST) settings, to improve access to future Science, Technology, Engineering, and Mathematics (STEM) learning opportunities. For learners to pursue a STEM education, and STEM careers, they must be able to move through "gatekeeping" mechanisms that filter and sort students based on factors such as prior coursework and grades, teacher recommendations, and language proficiency assessments. Even though abundant evidence shows that such measures fail to capture all important aspects of STEM learning, they are traditionally relied upon in secondary and post-secondary STEM education contexts as indicators of preparation for future STEM learning. These systemic processes exclude certain minoritized groups, including Black, Indigenous, and other people of color (BIPOC), low income, immigrant and refugee youth, and youth learning English, from high-quality secondary and post-secondary STEM learning experiences because existing measures do not validate their prior knowledge and experiences. Yet, minoritized youth often engage in OST STEM learning opportunities, where their readiness for future learning opportunities is nurtured and valued. One challenge is to reliably document this readiness in a usable format so youth can access new STEM learning opportunities, especially in post-secondary contexts. This project builds strategically upon earlier work focusing on the democratization of STEM learning through vehicles such as digital micro-credentials or badges, and upon digital portfolios. Missing from these earlier efforts was integration of these platforms with an infrastructure that connected youth learners to OST STEM learning organizations and to future STEM learning opportunities. This Innovations in Development project brings together minoritized youth and their families, OST providers, and admissions officials from higher education institutions to explore the needed design features for OST "transcripts," and user stories that describe how software systems can support their creation and sharing. Grounded in the concept of mastery-based learning, where learning is demonstrated via action, learners will control what is included in the transcript so that they create their own narratives about their learning experiences. Recognizing that documentation is not the key focus of most STEM OST organizations, this project will provide direct support for identifying and codifying learning goals or outcomes that learners and their families find relevant and important within different STEM activities. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The project will take a Design-Based Implementation Research (DBIR) approach and proceed by convening representatives from three main stakeholder groups (youth and their families, OST providers, and admissions staff) to engage in a series of discovery and design activities. Project partners, including the Mastery Transcript Consortium (MA), STEAMville (IL), STUDIO (WA), and Wolverine Pathways (MI), will work together with the PIs to design templates learners can use to characterize STEM learning from each provider, aligned with different STEM learning foci (e.g., computer science, computational thinking, cross-cutting concepts, science and engineering practices, and mathematics). Data collected from these sessions will be used to address the following research questions: (1) How and why do youth and families from minoritized communities understand and choose to participate in STEM OST learning opportunities?, (2) How do youth understand and interact with STEM OST learning opportunities?, (3) How do OST providers characterize the STEM learning goals in the activities they provide?, and (4) How do college admissions personnel view the role of informal STEM learning as part of a holistic admissions process? This work has the potential to further the understanding of how OST learning can be documented and shared as a part of the larger ecosystem of STEM learning trajectories. By deeply engaging the perspectives and voices of minoritized youth and families, this project seeks to develop a valid and trustworthy instrument that recognizes and serves their STEM learning, thus broadening the participation of minoritized youth in STEM education and careers. This work will also benefit OST providers, by translating the documentation of youth STEM learning into forms that may help communicate the efficacy of their programs in ways that further their missions, including communicating evidence of effectiveness to both future participants and funders.
The independent evaluation firm, Knight Williams, Inc., developed a two-part post-program survey to gather information about the Year 1 SciGirls CONNECT2 outreach programs conducted by 14 partner organizations. The evaluation aimed for one educator from each organization to complete Part 1 of the survey, which consisted of program reporting questions. In all, one educator from 13 partner organizations completed Part 1, for a response rate of 93%. Part 2 of the survey asked for program reflections, with a focus on perceived program goals, impacts, highlights, and challenges. Given the
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluators at Knight Williams Inc. developed a front-end survey to gather background and baseline information about the 16 partner organizations selected to conduct outreach programs as part of SciGirls CONNECT2. The goal was for two people from each partner organization to complete the online survey about their background and prior use of the SciGirls Seven and related strategies. A total of 30 partner representatives completed the survey by the requested deadline, resulting in a response rate of 94%. The majority identified as program leaders, with smaller groups saying they
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project will conduct a feasibility study of an informal youth STEM learning program. High school students from under served communities in New York City will use existing historical, cultural and environmental data to investigate selected UNESCO World Heritage sites. Participants will apply the skills and knowledge they have developed from their analysis of the UNESCO sites and apply them to their local communities. Participants will identify, map, and analyze their own community heritage sites, using relevant citizen science, environmental and cultural data. Throughout the program, the project will involve participants in maker-related activities. Participants will design devices to collect data, explore variables through model making, and communicate findings through models and artistic forms with the to spur both individual and community action for selected heritage sites.
The project will be implemented as a 9-month weekly after school program in Long Island City, New York. Most students from the school will be from low-income families and are youth of color. The research the question for the study is "How does access to STEM increase for historically underrepresented youth populations when culturally relevant curriculum connects citizen science and making practices?" During the first phase of the program, participants will engage with core STEM concepts and making/design processes through an engaging curriculum that explores damaged UNESCO World Heritage Sites. During the second phase, youth will identify, map, and plan enhancements for their own community heritage sites or environmental landmarks. A condensed version of the program will be piloted in the summer with youth from across the city. The Educational Development Corporation will conduct a process and summative evaluation of the project. Process evaluation, which will provide ongoing feedback to the project team, will include document review, observation of program implementation, and interviews with project partners. Summative evaluation will continue these methods, supplemented by pre- and post-participation participant surveys and focus-groups. Validated survey instruments, such as the Growth Mindset Scale, and the Common Instrument Suite (PEAR Institute) will be used. Resources from research and program practices will be disseminated through publications and conference presentations to the education research community, global learning and design fields, and practitioners from after school and other informal learning environments. Participants will share project results with their communities.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This project responds to the Faculty Early Career Development Program (CAREER) solicitation (NSF 17-537) and is sponsored by the Advancing Informal STEM Learning program at the National Science Foundation. CAREER: Talking Science: Early STEM Identity Formation Through Everyday Science Talk (Talking Science) addresses the critical issue of the development of children's identification with science, technology, engineering and mathematics (STEM) fields and the limited knowledge about the development of STEM identity through conversations, particularly among very young children from underserved and underrepresented populations. Talking Science is based on the premise that individuals who develop STEM interests and identify with STEM at a young age tend to participate in STEM fields more so than individuals who develop these later in life. This study investigates how STEM-related conversations outside of school with friends and family during formative years (i.e., 7 - 12 years old) shape youths’ STEM identity later in life and their engagement in STEM. The goals of Talking Science are (1) To develop an understanding of the features and context of conversations held between children and their caregivers/teachers that support STEM identity development in both majority and Hispanic/Latine populations; and (2) To translate the research outcomes into informal STEM learning practices that positively contribute to young people's perceptions of STEM fields in their future.
To achieve its goals, this work addresses the following research questions: (1) What is the content, context, and structure of STEM-related conversations with friends and family that youth ages 7 - 12 participate in?; (2) How do the features of conversation (i.e., content, context, structure) relate to the development of youth's STEM interests, sense of recognition as STEM people, and self-identification with STEM?; (3) How do the cultural values and science talk experiences of Hispanic/Latine youth shape conversation features related to youth's STEM interests, sense of recognition as STEM people, and self-identification with STEM?; and (4) Does professional development for practitioners that focuses on encouraging youth to engage in STEM-related conversations with friends and family positively contribute to youth's STEM interest, sense of recognition, and self-identification with STEM? To address these questions, the study adopts a qualitative research approach that applies phenomenological strategies in research design, data collection, and analysis to allow for exploration of the meaning of lived experiences in social and cultural contexts. Participants include elementary-age youths (ages 7 - 12) and caregivers from socially, culturally, linguistically, and economically diverse backgrounds. To inform the development of interview protocols in terms of the kinds of childhood talk that leave a long-term impact on students, including the kinds of talk experiences remembered by students who choose or persist towards a STEM career in college, the project also recruits college students pursuing STEM degrees as participants. Data gathering and interpretation strategies include surveys and interviews. The outcomes of this research will constitute a theoretical framework and models that guide the development of both professionals and programmatic activities at informal learning institutions, particularly around scaffolding participation in STEM through family science talk.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The STEM Interest and Engagement (STEM IE) Study was a four-year project funded by the National Science Foundation under the auspices of its Advancing Informal STEM Learning (AISL) program that was designed to better understand what types of practices, supports, and opportunities afforded to early adolescent youth: (1) Are especially effective in helping youth experience in-the-moment engagement while participating in ISL activities, and (2) Serve to support growth in STEM interest and aspirations. The study was conducted in a total of nine, STEM-oriented, summer learning programs serving
DATE:
TEAM MEMBERS:
Neil NaftzgerJennifer SchmidtLee ShumowPatrick BeymerJoshua Rosenberg
Ideas from social justice can help us understand how equity issues are woven through out-of-school science learning practices. In this paper, I outline how social justice theories, in combination with the concepts of infrastructure access, literacies and community acceptance, can be used to think about equity in out-of-school science learning. I apply these ideas to out-of-school science learning via television, science clubs and maker spaces, looking at research as well as illustrative examples to see how equity challenges are being addressed in practice. I argue that out-of-school science
Utah Valley University (UVU) with partners Weber State University (WSU) and American Indian Services (AIS) are implementing UTAH PREP (PREParation for STEM Careers) to address the need for early preparation in mathematics to strengthen and invigorate the secondary-to-postsecondary-to-career STEM pipeline. As the preliminary groundwork for UTAH PREP, each partner currently hosts a PREP program (UVU PREP, WSU PREP, and AIS PREP) that identifies low-income, under-represented minority, first-generation, and female students entering seventh grade who have interest and aptitude in math and science, and involves them in a seven-week, three-year summer intensive program integrating STEM courses and activities. The course content blends skill-building academics with engaging experiences that promote a clear understanding of how mathematical concepts and procedures are applied in various fields of science and engineering. Courses are enhanced through special projects, field trips, college campus visits, and the annual Sci-Tech EXPO. The purpose of the program is to motivate and prepare participants from diverse backgrounds to complete a rigorous program of mathematics in high school so that they can successfully pursue STEM studies and careers, which are vital to advancing the regional and national welfare.
UTAH PREP is based on the TexPREP program that originated at the University of Texas at San Antonio and which was named as one of the Bright Spots in Hispanic Education by the White House Initiative on Educational Excellence for Hispanics in 2015. TexPREP was adapted by UVU for use in Utah for non-minority serving institutions and in regions with lower minority populations, but with great academic and college participation disparity. With NSF funding for a two-year pilot program, the project partners are building UTAH PREP through a networked improvement community, collective impact approach that, if demonstrably successful, has the ability to scale to a national level. This pilot program's objectives include: 1) creating a UTAH PREP collaboration with commitments to a common set of objectives and common set of plans to achieve them; 2) strengthening existing PREP programs and initiating UTAH PREP at two or three other institutions of higher education in Utah, each building a sustainable local support network; 3) developing a shared measurement system to assess the impact of UTAH PREP programs, adaptations, and mutually reinforcing activities on students, including those from groups that are underrepresented in STEM disciplines; and 4) initiating a backbone organization that will support future scaling of the program's impact.
DATE:
-
TEAM MEMBERS:
Daniel HornsAndrew StoneVioleta Vasilevska
This Science Learning+ project will develop research-and-practice activities to explore how an integrated art, STEM, and society (what we refer to as STEAM) approach can expand science engagement and learning of youth aged 15-19, from low-income and non-dominant cultural communities. The project will review current knowledge, practice, and trends related to underrepresented youth, STEAM, and science engagement. The review will be used to develop: (1) A cross-setting research framework for investigating the relationship between informal STEAM learning experiences and young people's developing engagement with science. (2) Design principles for out-of-school STEAM programs that have proven effective in cultivating youth engagement with science and making relevant cross-setting connections. (3) Practitioner-friendly program evaluation tools that integrate findings from current research and practice related to cross-setting science learning of young adults especially non-dominant youth as it relates to STEAM learning experiences.
During middle school, many young people disengage from and consequently do not achieve in school-based STEM subjects. This phenomenon is more pronounced among young people in low-income communities than elsewhere. Many summer, out-of-school STEM programs are designed to offer young people opportunities to engage in hands-on, inquiry-based learning that promote interest and engagement in STEM. Research on the effect of these types of programs is limited, however. This research project seeks to fill this gap by identifying and studying practices that promote interest and engagement in STEM-related topics. The central goal of the summer STEM Interest and Engagement Study is to identify instructional practices associated with cultivating and sustaining young people's interest and engagement in out-of-school STEM summer learning programs for middle school youth. The project is based on a model of change developed from existing theory and empirical research on the cultivation of youths' interest and engagement in STEM. The project is a descriptive study that will apply multiple data collection and analytic methods, including the Experience Sampling Method (ESM), to determine instructional practices and the resulting interest, engagement, and perceptions of youth as they participate in STEM activities. In addition, survey data provided by program participants will allow the researchers to account for individual differences in preexisting interest and background factors, such as gender and ethnicity, and to measure changes in dispositions toward STEM. By better understanding these connections, practitioners can better understand how the design of their programs may influence the outcome of the participants' experience, including their education and career decisions.
DATE:
-
TEAM MEMBERS:
Deborah MoroneyNeil NaftzgerLee ShumowJennifer Schmidt