Well-designed out-of-school time experiences can provide youth with rich opportunities to learn. However, to design effective out-of-school time experiences, it is critical to have a research basis that clarifies the features of programs that support increased youth engagement that then leads to better outcomes for youth. This project explores the features of programming that integrates sports, mathematics and science concepts, and growth mindset for 4th through 8th grade aged Latinx and African American youth. To accomplish this, the investigators refine curricular resources for out-of-school time programs and develop a model for professional learning experiences for informal educators and facilitators to support their implementation of integrated sports and STEM programming. To identify critical features of the programming, the researchers explore the ways that the program activities are implemented in two different contexts as well as the impact of the programming on youth participants' mindset, understanding of science and mathematics concepts, STEM interests, and self-perceived science and mathematics abilities. Additionally, researchers will explore the ways that the sports-themed programming supports (or could better support) girls' engagement.
The project builds on the University of Arizona researchers' existing partnerships with Major League Baseball (MLB) and Boys/Girls Club programs and an existing school-based MLB program for schools to (a) expand and refine Science of Baseball activities to enhance engagement among girls and incorporate growth mindset experiences that focus on the value of effort, determination, and learning from mistakes in both athletics and STEM; (b) study the enactment and outcomes of the program with 4th-8th grade aged youth in the two distinct informal learning settings; and (c) develop and refine a model for professional learning that includes in-person and on-line components for training informal STEM learning facilitators. The work will focus on two study contexts: afterschool programs of Boys and Girls Clubs in AZ, CA, and MO and summer programs of MLB in CA and MO. Participants will include 300 youth and up to 28 informal STEM learning facilitators split across the two contexts. Design-Based Implementation Research (DBIR) will be used to a) iteratively refine the activities and professional development model, and b) study the enactment and outcomes of the program. Research questions focus on outcomes for youth participants (i.e., impact on growth mindset, STEM dispositions, and understanding of science/math concepts), and the elements of effective professional development for informal STEM educators. Outcomes of the project include empirical evidence of what works and what doesn't work in the design, implementation, and professional development for STEM learning programs that integrate sports and growth mindset principles. In addition, outcomes of the project will advance knowledge of how different out-of-school program structures with similar sports-focused STEM programming can similarly (or differentially) support youth learning.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Computing and computational thinking are integral to the practice of modern science, technology, engineering, and math (STEM); therefore, computational skills are essential for students' preparation to participate in computationally intensive STEM fields and the emerging workforce. In the U.S., Latinx and Spanish speaking students are underrepresented in computing and STEM fields, therefore, expanding opportunities for students to learn computing is an urgent need. The Georgia Institute of Technology and the University of Puerto Rico will collaborate on research and development that will provide Latinx and Spanish speaking students in the continental U.S. and Puerto Rico, opportunities to learn computer science and its application in solving problems in STEM fields. The project will use a creative approach to teaching computer science by engaging Latinx and Spanish speaking students in learning how to code and reprogram in a music platform, EarSketch. The culturally relevant educational practices of the curriculum, as a model for informal STEM learning, will enable students to code and reprogram music, including sounds relevant to their own cultures, community narratives, and cultural storytelling. Research results will inform education programs seeking to design culturally authentic activities for diverse populations as a means to broaden participation in integrated STEM and Computing. This Broad Implementation project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments, including multiple pathways for broadening access to and engagement in STEM learning, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
As part of the technical innovation of the project, the EarSketch platform will be redesigned for cultural and linguistic authenticity that will include incorporating traditional and contemporary Latin sound beats and musical samples into the software so that students can remix music and learn coding using sounds relevant to their cultures; and developing a Spanish version of the platform, with a toggle to easily switch between English and Spanish. Investigators will also develop an informal STEM curriculum using best practices from Culturally Relevant Education and Cultural Sustaining Pedagogy that provides authentic, culturally and linguistically rich opportunities for student engagement by establishing direct and constant connections to their cultures, communities and lived experiences. The curriculum design and implementation team will work collaboratively with members of Latinx diverse cultural groups to ensure semantic and content equivalency across diverse students and sites. Validating the intervention across students and sites is one of the goals of the project. The model curriculum for informal learning will be implemented as a semester long afterschool program in six schools per year in Atlanta and Puerto Rico, and as a one-week summer camp twice in the summer. The curricular materials will be broadly disseminated, and training will be provided to informal learning practitioners as part of the project. The research will explore differences in musical and computational engagement; the interconnection between music and the computational aspects of EarSketch; and the degree to which the program promotes cultural engagement among culturally and linguistically heterogenous groups of Latinx students in Atlanta, and more culturally and linguistically homogenous Latinx students in Puerto Rico. Investigators will use a mixed method design to collect data from surveys, interviews, focus groups, and computational/musical artifacts created by students. The study will employ multiple case study methodology to analyze and compare the implementation of the critical components of the program in Puerto Rico and Atlanta, and to explore differences in students' musical and computational thinking practices in the two regions. Results from the research will determine the impact of the curriculum on computer science skills and associated computational practices; and contribute to the understanding of the role of cultural engagement on educational outcomes such as sense of belonging, persistence, computational thinking, programming content knowledge and computer science identity. Results will inform education programs designing culturally authentic and engaging programming for diverse populations of Latinx youths.
DATE:
-
TEAM MEMBERS:
Diley HernandezJason FreemanDouglas EdwardsRafael Arce-NazarioJoseph Carroll-Miranda
Mentoring is a widely accepted strategy for supporting positive socioemotional and cognitive development across a variety of sectors including education, workforce development, and the justice system. An estimated 2.5 million volunteer mentors support youth development in the United States each year. However, there is broad concern that practice has outpaced empirical testing, with significant gaps in the research literature on important modifiers of mentoring relationships and their impacts. This is especially true for mentoring youth ages 10-14 in STEM. Studying highly successful programs may be one way to better understand the role of mentoring and moderators of mentoring effectiveness. The Science Club, a community-based STEM mentoring program for middle-grade youth in the Chicago area, will provide multiple sites for a research study to examine three important issues for advancing theory and practice for STEM mentoring. These issues include (1) understanding STEM mentoring for youth in the middle grades, (2) identifying outcomes and motivations for scientist mentors to more fully participate in mentoring programs, and (3) examining a model of middle-school-focused STEM mentoring collaboration.
Through a series of three studies, the team will investigate which elements of the mentoring relationships are associated with the demonstrated STEM identity gains in youth participants. The work will also contribute much-needed data on the impact of STEM mentoring relationships on the mentors themselves. Study 1 is designed as a retrospective study of program alumni, both youth and mentors, about the nature and extent of each their STEM identity shifts during their time in Science Club. A purposeful sample of 160+ youth and 100+ mentor alumni will participate. Study 2 is a prospective study of three consecutive cohorts of active Science Club participants, built on data and findings from Study 1. In Study 2, the team will design and implement a new Identity-Focused Mentoring Observation Instrument specifically aimed at exploring the nature and quality of mentoring relationships and their role in science identity development longitudinally. Three independent cohorts of 40 youth and 20 mentors each will participate. Study 3 is retrospective, examining how participating individuals and organizations perceive and are impacted by mentoring. The three studies employ a mixed methods approach utilizing surveys, observations, individual interviews, and document review.
This proposal will fill critical gaps in the mentoring literature regarding the formative middle school years through novel, empirical research. Building on the current literature and practice, outcomes of the work will inform practice and enhance knowledge-building in the field on both mentoring relationships and the collective impact of university-school-OST partnerships.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The role of afterschool programs in the science, technology, engineering, and mathematics (STEM) learning ecosystem has grown over the past two decades, which has led to increasing efforts to support and improve program quality. These efforts include developing STEM programs and curricula, creating standards for facilitating informal STEM learning experiences, building networks of support, and developing tools for assessment and evaluation. However, such efforts may have limited impact in terms of ongoing quality improvement. STEM curricula vary in disciplinary focus, quality and may not apply to local contexts and needs. Many afterschool programs resort to using simple STEM kits or online activities rather than rigorous curricula with support for educators. The project will study how the California Department of Education's (CDE) efforts to change organizational culture to support continuous quality improvement (CQI) have affected the offerings and quality of afterschool STEM in the state's more than 4,500 publicly funded afterschool sites. The EPISTEMIC project will contribute new research findings on how CQI can increase access to higher quality STEM learning opportunities for underserved youth. Even more important, the project will provide new insights on how organizational culture affects participation in and implementation of afterschool CQI.
The team will use an organizational theory framework and a mixed methods approach to conduct three research activities: (1) Describe the organizational context through interviews, participant observations, and artifact analysis to map and describe the overall support system as a context for understanding organizational culture change; (2) Describe change over time in organizational culture, CQI processes, and STEM program offerings and quality through surveys/interviews of afterschool youth, staff, directors, and grantee representatives; and (3) Generate explanations about the relationships between organizational culture, CQI, and STEM quality in different contexts through in depth case studies. Bringing organizational culture, CQI, and STEM offerings and quality into shared focus is the most important intellectual contribution of this work. Organizational theory's sensemaking concept will guide analyses to describe, exemplify, and generate theoretical explanations for patterns in organizational culture, CQI, and STEM program changes, with attention to relevant contextual factors.
Continuous quality improvement provides tools for afterschool STEM staff to identify needs and ways to improve. The EPISTEMIC study will contribute recommendations on the systemic, organizational, and cultural aspects of improvement strategies relevant to policymakers, funders, support providers, and afterschool organizations in California, as well as other state or nongovernmental support systems around the country. The study will also produce CQI guidelines for reflecting on and incorporating changes to organizational culture as part of CQI for afterschool staff and site directors. These will be helpful for practitioners around the country. The study's focus on three organizational contexts -- school district, national afterschool, and local afterschool -- will extend the relevance of the findings and recommendations, which will be disseminated through forums, workshops, and articles in practice and policy-oriented publications. The study will also benefit the research community by providing a framework and methods for studying organizational culture and CQI. The findings on the relationships between organizational culture, CQI, and STEM offerings and outcomes will provide a foundation for further research on how these relate to STEM learning outcomes for youth. EPISTEMIC is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Patrik LundhAndrea BeesleyTimothy PodkulCarrie Allen