The Joseph Moore Museum at Earlham College will revise its interpreter training and educational programs to reflect current best practices in participatory STEM education. This project will include strengthening their programs to better prepare undergraduate educators, as well as updating the delivery of their top three requested programs to ensure learner-centered experiences. The project will include the development of a training program modeled on a combination of principles set out by the National Association of Interpretation and the Reflections on Practice program. Undergraduate educators will undergo systematic training in the fundamentals of educational theory and practice and benefit from a program of sustained evaluation and mentorship.
The Hollister Herbarium at Tennessee Tech University will implement “Rooting Students in their Botanical History” — an educational module targeted for 11th and 12th grade biology students. The module will address “plant blindness,” a phenomenon defined as the failure to notice or appreciate plants. The herbarium will collaborate with three Tennessee high school biology teachers, a videographer, and a graduate research assistant to increase knowledge, awareness, and appreciation of plants over the three-year project. Students also will get to know herbarium specimens as an essential resource for information about the natural world.
This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
The Arizona-Sonora Desert Museum will partner with the Flowing Wells Unified School District on “We Bee Scientists,” a program to engage students in grades K–6 in real-world science by learning about bees—the most important group of pollinators. They plan to create a curriculum and related activities aligned with the Arizona science standards. The program is an expansion of the Tucson Bee Collaborative, which empowers community scientists from “K to grey” to contribute to ecosystem health and understanding through the study of native bees. The museum also will partner with Pima Community College and the University of Arizona on the program, which will involve volunteers and high school, college, and university students in documenting the abundance and diversity of native bees.
DATE:
-
TEAM MEMBERS:
Debra Colodner
resourceprojectProfessional Development, Conferences, and Networks
Growth in the US Latinx population has outpaced the Latinx growth in science, technology, engineering, and math (STEM) degrees and occupation, further widening the ethnic gap in STEM. Mathematics has often identified as a bottleneck keeping many youth, especially minoritized youth, from pursuing STEM studies. Unequal opportunities to develop powerful math assets explain differences in math skills and understanding often experienced by minoritized youth. Implementing culturally responsive practices (CRP) in afterschool programs has the potential to promote math skills and motivation for youth from minoritized groups. However, extensive research is needed to understand which culturally responsive informal pedagogical practices (CIPPs) are most impactful and why. This project aims to identify and document such practices, shed light on the challenges faced by afterschool staff in implementing them, and develop training resources for afterschool staff to address these challenges. This project is funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The fundamental research questions addressed by the project focus on (1) which CIPPs matter most in the context of a STEM university-community partnership engaging Latinx youth, and (2) in what context(s) and under what conditions do these CIPPs relate to positive outcomes for both youth participants and college mentor/facilitator. A third aim is to build capacity of afterschool staff for implementing CIPPs in informal STEM afterschool programs. The first two aims are addressed through a mixed-methods research study which includes quantitative surveys and qualitative in-depth interviews with five cohorts of adolescent participants, parents, and undergraduate mentors. Each year, surveys will be collected from adolescents and mentors at four time points during the year; the in-depth interviews will be collected from adolescents, parents, and mentors in the spring. In total, 840 adolescents and 210 mentors will be surveyed; and 87 adolescents, 87 parents, and 87 mentors will be interviewed. The third aim will be addressed by leveraging the research findings and the collective knowledge developed by practitioners and researchers to create a public archive containing documentation of CIPPs for informal STEM afterschool programs and training modules for afterschool staff. The team will disseminate these resources extensively with informal afterschool practitioners in California and beyond. Ultimately, this project will lead to improved outcomes for minoritized youth in informal STEM afterschool programs across the nation, and increased representation of minoritized youth in STEM pursuits.
DATE:
-
TEAM MEMBERS:
Alessandra PantanoSandra SimpkinsCynthia Sanchez Tapia
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
The Northwest Passage Project explored the changing Arctic through an innovative expedition aboard the Swedish Icebreaker Oden to conduct groundbreaking ocean science research, while it actively engaged 22 undergraduate and graduate students from the project’s five Minority Serving Institution (MSI) partners and 2 early career Inuit researchers in the research at sea. Over 35 hours of training in Arctic research techniques, polar science, and science communication was provided to these participants, who were engaged in the Northwest Passage expedition and worked with the onboard science team
This Innovations in Development project explores radical healing as an approach to create after-school STEM programming that welcomes, values and supports African American youth to form positive STEM identities. Radical healing is a strength-based, asset centered approach that incorporates culture, identity, civic action, and collective healing to build the capacity of young people to apply academic knowledge for the good of their communities. The project uses a newly developed graphic novel as a model of what it looks like to engage in the radical healing process and use STEM technology for social justice. This graphic novel, When Spiderwebs Unite, tells the true story of an African American community who used STEM technology to advocate for clean air and water for their community. Youth are supported to consider their own experiences and emotions in their sociopolitical contexts, realize they are not alone, and collaborate with their community members to take critical action towards social change through STEM. The STEM Club activities include mentoring by African American undergraduate students, story writing, conducting justice-oriented environmental sciences investigations, and applying the results of their investigations to propose and implement community action plans. These activities aim to build youth’s capacity to resist oppression and leverage the power of STEM technology for their benefit and that of their communities.
Clemson University, in partnership with the Urban League of the Upstate, engages 100 predominantly African American middle school students and 32 African American undergraduate students in healing justice work, across two youth-serving, community-based organizations at three sites. These young people assume a leadership role in developing this project’s graphic novel and curriculum for a yearlong, after-school STEM Club, both constructed upon the essential components of radical healing. This project uses a qual→quant parallel research design to investigate how the development and use of a graphic novel could be used as a healing justice tool, and how various components of radical healing (critical consciousness, cultural authenticity, self knowledge, radical hope, emotional and social support, and strength and resilience) affect African American youths’ STEM identity development. Researchers scrutinize interviews, field observations, and project documents to address their investigation and utilize statistical analyses of survey data to inform and triangulate the qualitative data findings. Thus, qualitative and quantitative data are used to challenge dominant narratives regarding African American youth’s STEM achievements and trajectories. The project advances discovery and understanding of radical healing as an approach to explicitly value African Americans’ cultures, identities, histories, and voices within informal STEM programming.
DATE:
-
TEAM MEMBERS:
Renee LyonsRhondda ThomasCorliss Outley
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
The Da Vinci Science Center will expand its Women in Science and Engineering Network by partnering with community organizations, colleges, and universities to enhance the STEM learning and support ecosystem for women and girls in the Lehigh Valley and surrounding communities in eastern Pennsylvania. The museum will assess the needs of K-12 girls, undergraduate women, and women in STEM employment, and map opportunities for cross-sector collaborations to support them. The project team will identify marketing and recruitment messages that encourage STEM-interested girls and women to participate in programs and follow developmental pathways within a STEM learning ecosystem. Based on identified needs and messages, the museum will pilot and evaluate new STEM programs for girls and women, and train educators and mentors to sustain this work.
In this chapter, I offer the National Black Male College Achievement Study (NBMCAS) as an example of how to explore and better understand the enablers of minority student achievement in STEM. Methods employed in the national study are described in the next section, followed by the presentation of an anti-deficit achievement framework for research on students of color at various junctures of the STEM pipeline, from K–12 schools through doctoral degree attainment and transitions into science research and long-term industry careers. Though informed by and conceptually similar to the framework