This white paper examined the process of evaluating a new Growth Mindset youth program developed for youth in Grades 3-5 in the Northwest suburb communities in Dundee Township, IL.
DATE:
TEAM MEMBERS:
Luci HanstedtDrew Glassford Mike LoPrestiMallory NamoffRobert Tai
This award is funded in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
This project will create the specification for a learner-controlled system to represent youth learning in Out-of-School-Time (OST) settings, to improve access to future Science, Technology, Engineering, and Mathematics (STEM) learning opportunities. For learners to pursue a STEM education, and STEM careers, they must be able to move through "gatekeeping" mechanisms that filter and sort students based on factors such as prior coursework and grades, teacher recommendations, and language proficiency assessments. Even though abundant evidence shows that such measures fail to capture all important aspects of STEM learning, they are traditionally relied upon in secondary and post-secondary STEM education contexts as indicators of preparation for future STEM learning. These systemic processes exclude certain minoritized groups, including Black, Indigenous, and other people of color (BIPOC), low income, immigrant and refugee youth, and youth learning English, from high-quality secondary and post-secondary STEM learning experiences because existing measures do not validate their prior knowledge and experiences. Yet, minoritized youth often engage in OST STEM learning opportunities, where their readiness for future learning opportunities is nurtured and valued. One challenge is to reliably document this readiness in a usable format so youth can access new STEM learning opportunities, especially in post-secondary contexts. This project builds strategically upon earlier work focusing on the democratization of STEM learning through vehicles such as digital micro-credentials or badges, and upon digital portfolios. Missing from these earlier efforts was integration of these platforms with an infrastructure that connected youth learners to OST STEM learning organizations and to future STEM learning opportunities. This Innovations in Development project brings together minoritized youth and their families, OST providers, and admissions officials from higher education institutions to explore the needed design features for OST "transcripts," and user stories that describe how software systems can support their creation and sharing. Grounded in the concept of mastery-based learning, where learning is demonstrated via action, learners will control what is included in the transcript so that they create their own narratives about their learning experiences. Recognizing that documentation is not the key focus of most STEM OST organizations, this project will provide direct support for identifying and codifying learning goals or outcomes that learners and their families find relevant and important within different STEM activities. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The project will take a Design-Based Implementation Research (DBIR) approach and proceed by convening representatives from three main stakeholder groups (youth and their families, OST providers, and admissions staff) to engage in a series of discovery and design activities. Project partners, including the Mastery Transcript Consortium (MA), STEAMville (IL), STUDIO (WA), and Wolverine Pathways (MI), will work together with the PIs to design templates learners can use to characterize STEM learning from each provider, aligned with different STEM learning foci (e.g., computer science, computational thinking, cross-cutting concepts, science and engineering practices, and mathematics). Data collected from these sessions will be used to address the following research questions: (1) How and why do youth and families from minoritized communities understand and choose to participate in STEM OST learning opportunities?, (2) How do youth understand and interact with STEM OST learning opportunities?, (3) How do OST providers characterize the STEM learning goals in the activities they provide?, and (4) How do college admissions personnel view the role of informal STEM learning as part of a holistic admissions process? This work has the potential to further the understanding of how OST learning can be documented and shared as a part of the larger ecosystem of STEM learning trajectories. By deeply engaging the perspectives and voices of minoritized youth and families, this project seeks to develop a valid and trustworthy instrument that recognizes and serves their STEM learning, thus broadening the participation of minoritized youth in STEM education and careers. This work will also benefit OST providers, by translating the documentation of youth STEM learning into forms that may help communicate the efficacy of their programs in ways that further their missions, including communicating evidence of effectiveness to both future participants and funders.
This award takes an innovative approach to an ongoing, pervasive, and persistent societal issue: women are still drastically underrepresented in computing careers. This project targets middle school-aged girls because it is a time when many of them lose interest and confidence in pursuing technical education and computing careers. This project will design, develop, and deploy a one-week experience focused on middle school girls that targets this issue with a novel combination of teaching techniques and technology. The project will use wearable computing devices to support girls' social interactions as they learn computing and solve technical challenges together. The goals of the project are to raise interest, perceived competence, and involvement in the computational ability of girls. Additionally, the project aims to increase a sense of computational community for girls that makes pursuing computational skills more relevant to their identities and lives, and that helps continued participation in computing. The project will deploy a one-week experience four times per year with a socioeconomically diverse range of campers. The project will also develop a 'program in a box' kit that can be broadly used by others wishing to deliver a similar experience for girls.
The planned research will determine if a one-week experience that uses social wearable construction in the context of live-action role play can use the mediating process of computational community formation to positively impact middle school girls' engagement with and interest in computation. Computational community is defined as girls engaging together in the process of learning computation, trading resources and knowledge, and supporting growth. Research participants will include 100 6th to 9th-grade girls. At least 75% of the participants will be either low income, first-generation college-bound, or underrepresented in higher education. Students will be recruited through the longstanding partnerships with title one schools in the Salinas Valley, the Educational Partnership Center, and in the Pajaro Valley Unified School district, where 82% of the students are Hispanic/Latinx, 42% are English Learners, and 73% are eligible for free or reduced lunch. The research questions are: 1) Does the proposed experience increase girls' self-reported competence, self-efficacy, and interest in computational skills and careers? and 2) Will the proposed experience lead to activity-based evidence of learning and integration of computational skills at the group social level? The project will use a mixed-methods, design-based research approach which is an iterative design process to rapidly collect and analyze data, and regularly discuss the implications for practice with the design team. Data will be collected using observations, interviews, focus groups, surveys, and staff logs. Quantitative data will be analyzed using frequencies, means, and measures of dispersion will be applied to survey data from both time points. Pearson correlation coefficients will be used to describe the bivariate relationship between continuous factors. ANOVAs will assess whether there are significant differences in continuous measures across groups. Qualitative data will be analyzed using a constant comparison method.
This Innovations in Development award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Computing and computational thinking are integral to the practice of modern science, technology, engineering, and math (STEM); therefore, computational skills are essential for students' preparation to participate in computationally intensive STEM fields and the emerging workforce. In the U.S., Latinx and Spanish speaking students are underrepresented in computing and STEM fields, therefore, expanding opportunities for students to learn computing is an urgent need. The Georgia Institute of Technology and the University of Puerto Rico will collaborate on research and development that will provide Latinx and Spanish speaking students in the continental U.S. and Puerto Rico, opportunities to learn computer science and its application in solving problems in STEM fields. The project will use a creative approach to teaching computer science by engaging Latinx and Spanish speaking students in learning how to code and reprogram in a music platform, EarSketch. The culturally relevant educational practices of the curriculum, as a model for informal STEM learning, will enable students to code and reprogram music, including sounds relevant to their own cultures, community narratives, and cultural storytelling. Research results will inform education programs seeking to design culturally authentic activities for diverse populations as a means to broaden participation in integrated STEM and Computing. This Broad Implementation project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments, including multiple pathways for broadening access to and engagement in STEM learning, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
As part of the technical innovation of the project, the EarSketch platform will be redesigned for cultural and linguistic authenticity that will include incorporating traditional and contemporary Latin sound beats and musical samples into the software so that students can remix music and learn coding using sounds relevant to their cultures; and developing a Spanish version of the platform, with a toggle to easily switch between English and Spanish. Investigators will also develop an informal STEM curriculum using best practices from Culturally Relevant Education and Cultural Sustaining Pedagogy that provides authentic, culturally and linguistically rich opportunities for student engagement by establishing direct and constant connections to their cultures, communities and lived experiences. The curriculum design and implementation team will work collaboratively with members of Latinx diverse cultural groups to ensure semantic and content equivalency across diverse students and sites. Validating the intervention across students and sites is one of the goals of the project. The model curriculum for informal learning will be implemented as a semester long afterschool program in six schools per year in Atlanta and Puerto Rico, and as a one-week summer camp twice in the summer. The curricular materials will be broadly disseminated, and training will be provided to informal learning practitioners as part of the project. The research will explore differences in musical and computational engagement; the interconnection between music and the computational aspects of EarSketch; and the degree to which the program promotes cultural engagement among culturally and linguistically heterogenous groups of Latinx students in Atlanta, and more culturally and linguistically homogenous Latinx students in Puerto Rico. Investigators will use a mixed method design to collect data from surveys, interviews, focus groups, and computational/musical artifacts created by students. The study will employ multiple case study methodology to analyze and compare the implementation of the critical components of the program in Puerto Rico and Atlanta, and to explore differences in students' musical and computational thinking practices in the two regions. Results from the research will determine the impact of the curriculum on computer science skills and associated computational practices; and contribute to the understanding of the role of cultural engagement on educational outcomes such as sense of belonging, persistence, computational thinking, programming content knowledge and computer science identity. Results will inform education programs designing culturally authentic and engaging programming for diverse populations of Latinx youths.
DATE:
-
TEAM MEMBERS:
Diley HernandezJason FreemanDouglas EdwardsRafael Arce-NazarioJoseph Carroll-Miranda
The independent evaluators at Knight Williams Inc. developed a front-end survey to gather background and baseline information about the 16 partner organizations selected to conduct outreach programs as part of SciGirls CONNECT2. The goal was for two people from each partner organization to complete the online survey about their background and prior use of the SciGirls Seven and related strategies. A total of 30 partner representatives completed the survey by the requested deadline, resulting in a response rate of 94%. The majority identified as program leaders, with smaller groups saying they
The purpose of the proposed project, Community of Bilingual English-Spanish Speakers Exploring Issues in Science and Health (CBESS), is to increase linguistic diversity in science, technology, engineering, and math (STEM)-healthcare fields, including biomedical, behavioral, and clinical research careers. With support of the large group of Spanish-English bilingual (SEB), STEM-healthcare professionals that was formed during this proposal preparation, CBESS will contribute to the pipeline between K–12 and higher education/career.
CBESS will recruit Spanish-English bilingual (SEB) high-school students at the end of tenth grade and implement several language-supported STEM-healthcare interventions during the eleventh and twelfth grade (17 months): family-engaged career exploration; Next Generation Science Standards (NGSS)-aligned, inquiry-based, youth-led summer research residential program; community outreach/dissemination, internships, and mentoring.
Applying methods that are known to be effective with the target population, CBESS will also train undergraduate, near-peer instructor-mentors—STEM-healthcare Leadership Trainees (LT)—in inquiry-based instruction and strategies for positioning K–12 bilingual students as “insiders” in STEM-healthcare, as well as in the responsible conduct of research and mentoring skills, followed by practical application with SR.
CBESS will develop and expand the nascent SEB STEM-healthcare community of practice (CoP) that was created during CBESS proposal preparation. Committed academic, clinical, research, and community partners will contribute to research and evaluation efforts, and support the pipeline between K–12 and higher education/career through Community Based Participatory Research (CBPR), framing priority community health issues to be addressed by each cohort of SR from among issues identified by the SR during the application process. Finally, the CoP will target long-term institutional sustainability for linguistically diverse students in STEM-healthcare education and careers.
This project responds to the Faculty Early Career Development Program (CAREER) solicitation (NSF 17-537) and is sponsored by the Advancing Informal STEM Learning program at the National Science Foundation. CAREER: Talking Science: Early STEM Identity Formation Through Everyday Science Talk (Talking Science) addresses the critical issue of the development of children's identification with science, technology, engineering and mathematics (STEM) fields and the limited knowledge about the development of STEM identity through conversations, particularly among very young children from underserved and underrepresented populations. Talking Science is based on the premise that individuals who develop STEM interests and identify with STEM at a young age tend to participate in STEM fields more so than individuals who develop these later in life. This study investigates how STEM-related conversations outside of school with friends and family during formative years (i.e., 7 - 12 years old) shape youths’ STEM identity later in life and their engagement in STEM. The goals of Talking Science are (1) To develop an understanding of the features and context of conversations held between children and their caregivers/teachers that support STEM identity development in both majority and Hispanic/Latine populations; and (2) To translate the research outcomes into informal STEM learning practices that positively contribute to young people's perceptions of STEM fields in their future.
To achieve its goals, this work addresses the following research questions: (1) What is the content, context, and structure of STEM-related conversations with friends and family that youth ages 7 - 12 participate in?; (2) How do the features of conversation (i.e., content, context, structure) relate to the development of youth's STEM interests, sense of recognition as STEM people, and self-identification with STEM?; (3) How do the cultural values and science talk experiences of Hispanic/Latine youth shape conversation features related to youth's STEM interests, sense of recognition as STEM people, and self-identification with STEM?; and (4) Does professional development for practitioners that focuses on encouraging youth to engage in STEM-related conversations with friends and family positively contribute to youth's STEM interest, sense of recognition, and self-identification with STEM? To address these questions, the study adopts a qualitative research approach that applies phenomenological strategies in research design, data collection, and analysis to allow for exploration of the meaning of lived experiences in social and cultural contexts. Participants include elementary-age youths (ages 7 - 12) and caregivers from socially, culturally, linguistically, and economically diverse backgrounds. To inform the development of interview protocols in terms of the kinds of childhood talk that leave a long-term impact on students, including the kinds of talk experiences remembered by students who choose or persist towards a STEM career in college, the project also recruits college students pursuing STEM degrees as participants. Data gathering and interpretation strategies include surveys and interviews. The outcomes of this research will constitute a theoretical framework and models that guide the development of both professionals and programmatic activities at informal learning institutions, particularly around scaffolding participation in STEM through family science talk.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Ideas from social justice can help us understand how equity issues are woven through out-of-school science learning practices. In this paper, I outline how social justice theories, in combination with the concepts of infrastructure access, literacies and community acceptance, can be used to think about equity in out-of-school science learning. I apply these ideas to out-of-school science learning via television, science clubs and maker spaces, looking at research as well as illustrative examples to see how equity challenges are being addressed in practice. I argue that out-of-school science
The lack of equitable access to science learning for marginalized groups is now a significant concern in the science education community (Bell et al. 2009). In our commitment to addressing these concerns, we (the HERP Project staff) have spent four years exploring different ways to increase diverse student participation in our informal science programs called herpetology research experiences (HREs). We wanted the demographics of participants to mirror the racial, ethnic, cultural, linguistic, and socioeconomic demographics of the areas where our HREs are held. To achieve this, project staff
The University of Alaska Fairbanks will partner with the National Optical and Astronomy Observatory, the University of Alaska Museum of the North, and the University of Washington-Bothell to bring biomaterials, optics, photonics, and nanotechnology content, art infused experiences, and career awareness to art-interested girls. This full scale development project, Project STEAM, will explore the intersections between biology, physics, and art using advanced technologies at the nano to macro scale levels. Middle school girls from predominately underrepresented Alaskan Native, Native American (Tohono O'odham, Pascula Yaqui) and Hispanic groups, their families, teachers, and Girl Scout Troop Leaders in two site locations- Anchorage, Alaska and Tucson, Arizona will participate in the project. Centered on the theme "Colors of Nature," Project STEAM will engage girls in science activities designed to enhance STEM learning and visual-spatial skills. Using advanced technologies, approximately 240 girls enrolled in the Summer Academy over the project duration will work with women scientist mentors, teachers, and Girl Scout Troop Leaders to create artistic representations of natural objects observed at the nano and macro scale levels. Forty girls will participate in the Summer Academy in year one (20 girls per site- Alaska and Arizona). In consequent years, approximately180 girls will participate in the Academy (30 girls per site). Another 1,500 girls are expected to be reached through their Girl Scout Troop Leaders (n=15) who will be trained to deliver a modified version of the program using specialized curriculum kits. In addition, over 6,000 girls and their families are expected to attend Project STEAM Science Cafe events held at local informal science education institutions at each site during the academic year. In conjunction with the programmatic activities, a research investigation will be conducted to study the impact of the program on girls' science identity. Participant discourse, pre and post assessments, and observed engagement with the scientific and artistic ideas and tools presented will be examined and analyzed. A mixed methods approach will also be employed for the formative and summative evaluations, which will be conducted by The Goldstream Group. Ultimately, the project endeavors to increase STEM learning and interest through art, build capacity through professional development, advance the research base on girls' science identity and inspire and interest girls in STEM careers.
Deals with the success of the Rural Girls in Science Program at the University of Washington in Seattle, Washington State, which uses science to address local issues through long-term research projects. Source of funding for the program; Components of the research projects; Factors which contributed to the success of the program.
DATE:
TEAM MEMBERS:
Angela GinorioJanice FournierKatie Frevert