As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will collaboratively design, test and study effective and efficient ways to develop embedded assessments (EAs) of citizen science (CS) volunteer scientific inquiry skills in order to better understand the impact of these CS experiences on volunteer scientific inquiry abilities. EAs are assessment activities that are integrated into the learning experience and allow learners to demonstrate their competencies in an unobtrusive way. The acquisition of scientific inquiry skills is an essential, even defining, characteristic of citizen science experiences that has a direct influence on data quality. Methods for assessing the direct impact of CS on volunteers' scientific inquiry skills are limited. The project will result in EA measures designed for use by diverse CS projects, strategies that CS projects can use to develop EA assessment tools, and research findings that document opportunities, supports and barriers of this innovative method across a range of CS contexts. Findings and initial resources will be shared with the broad array of stakeholders in CS through conferences, workshops, peer-reviewed publication, community websites and other relevant venues. The results of this work also have the potential to generalize to other informal science learning experiences that engage the public in science The project will address two research questions: (1) What processes are useful for developing broadly applicable EA methods or measures? and (2) What can we learn about gains in volunteers' scientific inquiry skills when citizen science organizations use EA? These will be addressed through design-based research focused on two streamlining strategies. For the reframing data validation strategy, six leaders from five established citizen science projects will conduct secondary analyses of their existing databases to uncover the skill gains of CS volunteers that are currently unexplored in their data. For the common measure strategy, ten CS projects will collaborate to create and test common EA measures of select identification-based skills. Data will be gathered through meeting notes, participant interviews and action plans, and volunteer skill gains to capture process and products of each strategy. Data will be analyzed using grounded theory, multiple process techniques, multilevel models, and repeated-measures analysis of variance. The design-based-research framework will significantly expand project impacts by jump-starting evaluation of the participating CS projects and by producing initial resources for two distinct EA strategies that have the potential to dramatically alter practice and impact citizen science efforts to ultimately enable more people to learn by contributing to the science endeavor. The project will directly equip the 15 participating citizen-science projects with authentic performance tools to assess the quality of their programing, which will expand their understanding of CS volunteer skills and help them better recruit and support their varied audiences (including rural, low-income and tribal communities).
One way to encourage youth to pursue training in the STEM fields and enter the STEM workforce is to foster interest and engagement in STEM during adolescence. Informal STEM Learning Sites (ISLS) provide opportunities for building interest and engagement in the STEM fields through a multitude of avenues, including the programming that they provide for youth, particularly teens. Frequently, ISLS provide opportunities to participate in volunteer programs, internships or work, which allow teens both to learn relevant STEM knowledge as well as to share that knowledge with others through opportunities to serve as youth educators. While youth educator programs provide rich contexts for teens to engage as both learners and teachers in these informal STEM environments, research to date has not yet identified the relationship between serving as youth educators and STEM engagement. Thus, the goal of this project is to document the impact of youth educators on visitor learning in ISLS and to identify best practices for implementing youth educator programs. The project studies STEM interests and engagement in the youth participants and the visitors that they interact with at six different ISLS in the US and UK. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
This project examines youth educator experiences related to STEM identity, educational aspirations, and motivation. The project also identifies outcomes that the youth educators have on visitors to ISLS in terms of knowledge, interest, and engagement in STEM. The specific aims are: 1) Outcomes for Teens - To measure the longitudinal impact of participation in an extended youth educator experience in an ISLS; 2) Outcomes for Visitors - To compare visitor engagement with and learning from exhibits in ISLS when they interact with a youth educator, relative to outcomes of interacting with an adult educator or no educator; and 3) Outcomes Across Demographics and STEM Sites - To examine differences in visitor engagement based on participant characteristics such as socio-economic status (SES), age, gender, and ethnicity and to compare outcomes of youth educator experiences across different types of ISLS. This research, which draws on expectancy value theory and social cognitive theory, will follow youth participants longitudinally over the course of 5 years and use latent variable analyses to understand the impact on the youth educators as well as the visitors with whom they interact. Importantly, the results of this research will be used to develop best practices for implementing youth educator programs in ISLS and the results will be disseminated to both academic and practice-based communities.
This project has clear and measurable broader impacts in a variety of ways. First, the project provides guidance to improve programming for youth in ISLS, including both the sites involved directly in the research and to the larger community of ISLS through evaluation, development, and dissemination of best practices. Additionally, this project provides rigorous, research-based evidence to identify and describe the outcomes of youth educator programs. This study directly benefits the participants of the research, both the visiting public and the youth educators, through opportunities to engage with science. The findings speak to issues of access and inclusivity in ISLS, providing insight into how to design environments that are welcoming and accessible for diverse groups of learners. Finally, this project provides evidence for best practices for ISLS in developing programs for youth that will lead to interest in and pursuit of STEM careers by members of underrepresented groups.
DATE:
-
TEAM MEMBERS:
Adam Hartstone-RoseMatthew IrvinKelly Lynn MulveyElizabeth ClemensLauren ShenfeldAdam RutlandMark WinterbottomFrances BalkwillPeter McOwanKatie ChambersStephanie TylerLisa Stallard
This project by California State University San Marcos and their collaborators will expand and continue to innovate on a pilot Mobile Making program with the goal of developing a sustainable, regional model for serving underserved, middle-school aged youth in twelve after-school programs in the San Diego region. Evaluation of the current Mobile Making program has documented positive impacts on participants' interest, self-efficacy, and perception of the relevance of Making/STEM in everyday life, and led to a model for engaging underserved youth in Making. The work will focus on implementing the program model sustainably at greater capacity by increasing the number of undergraduate activity leaders, after-school sites, and level of community engagement. The expanded Mobile Making program is expected to engage ~1800 middle school youth at 12 local school sites, with activities facilitated by ~1020 undergraduate CSU-SM STEM majors. The sites are in ethnically diverse and economically disadvantaged neighborhoods, with as many as 90% of students at some sites qualifying for free or reduced price lunch. The undergraduate facilitators are drawn from CSU-SM's diverse student body, which includes 44% underrepresented minorities. Outcomes are expected to include increases in the youth participants' interest, self-efficacy, and perception of the relevance of Making/STEM in everyday life. Positive impacts on the undergraduate facilitators will include broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. The program is designed to achieve sustainability through innovative means such as involving undergraduate facilitators via Community Service Learning (rather than paid positions), and increased community engagement via development and support of a community of practice including local after-school providers, teachers, Makers, and University members. Evaluation of the program outcomes and lessons learned are expected to result in a comprehensive model for a sustainable, university-based after-school Making program with regional impact in underserved communities. Dissemination to other regions will be leveraged via CSU-SM's membership in the California State University (CSU) system, yielding a potential statewide impact. The support of the CSU Chancellor's Office and input from a CSU implementation group will ensure the applicability of the model to other regional university settings, identify common structural barriers and solutions, and increase the probability of secondary implementations. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program supports new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This project will meet this goal through rigorous research and the broad implementation of an environmental science literacy professional development and learning program for informal educators and youth engaged in outdoor science programs (OSP). With growing support from the literature and the Next Generation Science Standards (NGSS), much attention has been placed on creating and leveraging interdisciplinary science learning opportunities beyond science classrooms. As such, an estimated 300 residential OSPs currently exist in the United States. Unfortunately, the informal educators often charged with facilitating these deep and impactful science learning experiences often lack robust formal training in evidenced-based, age-appropriate environmental science content knowledge and pedagogy specific for the youth in their programs. This issue is often more pronounced in under-resourced and under-served programs and communities. This project will directly address these pervasive challenges in the field by not only providing much needed science focused professional development and resources to informal educators but also by specifically targeting and training informal leaders and educators serving youth in predominately rural areas, low-income communities, and underrepresented communities.
Approximately 200 OSP leaders at 100 OSPs around the country will participate in a week-long, intensive training in the professional development model at one of five regional residential leadership institutes. OSP leaders will then redeliver the training to the approximately 1,500 OSP educators/field instructors in their home institutions. The OSP educators/field instructors will then use what they learn through the professional development to facilitate the environmental science learning program (i.e., curriculum, field experiences, resources, pedagogy) to over 1 million youth (grades 3-8) enrolled in their residential outdoor science programs. In addition, a rigorous implementation study, efficacy study and evaluation will be conducted. The implementation study will investigate: (a) Which of the professional learning model practices were implemented and (b) What successes and challenges the programs faced implementing the model. The mixed methods efficacy study will explore: (a) if outdoor science programs contribute to the development of science learning activation and environmental literacy? and (b) what are the features of these experiences that are correlated with increases in science learning activation and environmental literacy. Approximately 25-35 youth will be randomly selected from each of 50 randomly selected sites to participate in the efficacy study. The data and findings from the research and evaluation produced by this project will contribute to a relatively sparse knowledge and research base specific to youth efficacy and implementation processes and practices across nearly 1/3 of the estimated 300 existing residential outdoor science programs in the United States.
The Wayne State University Math Corps is a mathematics enrichment and mentoring program that operates during summers and on Saturdays. The curriculum and the teach pedagogies in this informal learning program have documented success of supporting youths' mathematics learning as well as raising achievement levels in school. Through rigorous research and evaluation, this project seeks to analyze and understand the nature, extent, and reasons for Math Corps' success with youth learning in Detroit as well as the processes of program replication in three sites: Cleveland, OH; Utica, NY; and Philadelphia, PA. As such, this project will deepen understandings of program replication and of addressing the needs of youth in economically-challenged communities in order to promote mathematics learning.
The project's research studies will assess the multiple factors that make Math Corps successful with youth in Detroit and document the implementation of the program to the three replication sites. Research methods include discourse analyses, surveys, interviews, and pre/post-tests. The project will also conduct a retrospective evaluation of Math Corps based on quantitative datasets regarding both near-term and long-term youth outcomes.
This projects is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Steve KahnStephen ChrisomalisTodd KubicaCarol Philips-BeyFrancisca Richter
The achievement gap begins well before children enter kindergarten. Research has shown that children who start school having missed critical early learning opportunities are already at risk for academic failure. This project seeks to narrow this gap by finding new avenues for bringing early science experiences to preschool children (ages 3-5), particularly those living in communities with few resources. Bringing together media specialists, learning researchers, and two proven home visiting organizations to collaboratively develop and investigate a new model that engages families in science exploration through joint media engagement and home visiting programs. The project will leverage the popularity and success of the NSF-funded PEEP and the Big Wide World/El Mundo Divertido de PEEP to engage both parents and preschool children with science.
To address the key goal of engaging families in science exploration through joint media engagement and home visiting programs, the team will use a Design Based Implementation Research (DBIR) approach to address the research questions by iteratively studying the intervention model (the materials and implementation process) and assessing the impact of the intervention model on parents/caregivers. The intervention model will include the PEEP Family Engagement Toolkit that will support 20 weeks of family science investigations using new digital and hands-on science learning resources. It will also include new professional development resources for home educators as well as and the implementation process and strategies for developing and implementing the Toolkit with families.
The proposed research focuses first on refining and improving program design and implementation, and second, on investigating whether the intervention improves the capacity of parent/caregivers to support young children's learning in science. Ultimately this research will accomplish two important aims: it will inform the design of the PEEP family engagement intervention model, and, more broadly, it will build practical and theoretical understanding of: 1) effective family engagement models in science learning; 2) the types of supports that families and home educators need to implement these models; and 3) how to implement these models across different home visiting programs. Given the reach of the home visiting programs and the increasing interest in supporting early science learning the potential for broad impact is significant. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Young people learn about science, technology, engineering, and math (STEM) in a variety of ways and from many sources, including school, the media, personal experiences, and friends and family. Yet STEM participation and identification by youth are not equal across social, economic, and cultural communities. This project will study a long-term, out-of-school program for high school-age youth, who are from groups under-represented in STEM academics and careers: girls, youth from low-income households, and youth of color. Located in the urban context of the Science Museum of Minnesota, the Kitty Andersen Youth Science Center (KAYSC) engages youth in applying culturally rich STEM content to work toward social justice and community building. Specifically, this project will examine how the learning practices of the KAYSC model support youth in identifying with, engaging in, and participating in STEM. Through studying the KAYSC's STEM Justice model, which centers youth as learners, teachers, and leaders who address critical community issues through STEM, this project will develop resources that informal science educators in a variety of contexts and programs can use to promote positive social change, equity, inclusion, and applied STEM learning.
The Science Museum of Minnesota will use design-based implementation research to study this model. This research will draw on and further the emerging theoretical framework of science capital. Science capital attempts to capture multiple aspects of science learning and application, including science knowledge, social and cultural resources, and science-related behaviors and practices. Empirically developing the theory of science capital has the potential to build concrete understanding of how to address inequalities in science participation. Four teams will work independently and collaboratively to do so: an adult research team, a high school youth research team, a practitioner team, and a co-design team composed of representatives from the other three teams. Research teams will collect data in the form of observations, semi-structured interviews, practitioner activity reports, artifacts, and the experience sampling method. Initial cycles of design will occur at the Science Museum of Minnesota as researchers and practitioners document, analyze, and iteratively design learning practices within the STEM Justice model. In the second half of the grant, the team will work with an external out-of-school time youth leadership site to implement the redesigned model. Participatory research and design methods involving both youth and adults can advance understanding of what makes out-of-school time STEM learning meaningful, relevant, and successful for marginalized youth and their communities. Grounded in culturally and socially relevant, community-based resources and programming, this project will study how leveraging STEM out-of-school time learning connected to social justice can broaden access to STEM as well as develop workforce, and leadership, and STEM skills by under-represented youth. The project also builds staff capacity for promoting equity and access in informal learning settings.
This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
People of color who live in low income, urban communities experience lower levels of educational attainment than whites and continue to be underrepresented in science at all educational and professional levels. It is widely accepted that this underrepresentation in science is related, not only to processes of historical exclusion and racism, but to how science is commonly taught and that investigating authentic, relevant science questions can improve engagement and learning of underrepresented students. Approaching science in these ways, however, requires new teaching practices, including ways of relating cross-culturally. In addition to inequity in science and broader educational outcomes, people of color from low income, urban communities experience high rates of certain health problems that can be directly or indirectly linked to mosquitoes. Recognizing that undertaking public health research and preventative outreach efforts in these communities is challenging, there is a critical need for an innovative approach that leverages local youth resources for epidemiological inquiry and education. Such an approach would motivate the pursuit of science among historically-excluded youth while, additionally, involving pre-service, in-service, and informal educators in joint participatory inquiry structured around opportunities to learn and practice authentic, ambitious science teaching and learning.
Our long-term goal is to interrupt the reproduction of educational and health disparities in a low-income, urban context and to support historically-excluded youth in their trajectories toward science. This will be accomplished through the overall objective of this project to promote authentic science, ambitious teaching, and an orientation to science pursuits among elementary students participating in a university-school-community partnership promise program, through inquiry focused on mosquitoes and human health. The following specific aims will be pursued in support of the objective:
1. Historically-excluded youth will develop authentic science knowledge, skills, and dispositions, as well as curiosity, interest, and positive identification with science, and motivation for continued science study by participating in a scientific community and engaging in the activities and discourses of the discipline. Teams of students and educators will engage in community-based participatory research aimed at assessing and responding to health and well-being issues that are linked to mosquitoes in urban, low-income communities. In addition, the study of mosquitoes will engage student curiosity and interest, enhance their positive identification with science, and motivate their continued study.
2. Informal and formal science educators will demonstrate competence in authentic and ambitious science teaching and model an affirming orientation toward cultural diversity in science. Pre-service, in-service, and informal educators will participate in courses and summer institutes where they will be exposed to ambitious teaching practices and gain proficiency, through reflective processes such as video study, in adapting traditional science curricula to authentic science goals that meet the needs of historically excluded youth.
3. Residents in the community will display more accurate understandings and transformed practices with respect to mosquitoes in the urban ecosystem in service of enhanced health and well-being. Residents will learn from an array of youth-produced, culturally responsive educational materials that will be part of an ongoing outreach and prevention campaign to raise community awareness of the interplay between humans and mosquitoes.
These outcomes are expected to have an important positive impact because they have potential for improving both immediate and long-term educational and health outcomes of youth and other residents in a low-income, urban community.
DATE:
-
TEAM MEMBERS:
Katherine Richardson BrunaLyric Colleen Bartholomay
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This research project leverages ongoing longitudinal research to investigate whether, and if so how, youth from ages 10 to 15 in a diverse, under-resourced urban community become interested and engaged in STEM. The project addresses a global issue; fewer youth choose to major in scientific fields or take science coursework at high school or university levels. These declining numbers result in fewer STEM professionals and fewer scientifically literate citizens who are able to function successfully in an increasingly scientific and technological society. These declines are observed for youth as a whole, but are most pronounced for girls and particular non-white ethnic minorities. Data collected from youth in this community of study, including non-white ethnic minorities, mirrors this decline. NSF funding will support a five-year systematic and systemic process in which project researchers work collaboratively with existing informal and formal educational partners (e.g., museums, libraries, afterschool providers, schools) to develop sets of customized, connected, and coordinated learning interventions, in and out of school, for youth with different backgrounds, needs, and interests, all with the goal of averting or dampening this decline of STEM interest and participation during early adolescence. In addition to new research and community STEM networks, this project will result in a Community Toolkit that includes research instruments and documentation of network-building strategies for use by other researchers and practitioners nationally and internationally. This mixed methods exploratory study has two distinct but interrelated populations - youth and educators from across informal and formal institutions. To develop a clearer understanding of the factors that influence youths' STEM interest development over time, particularly among three youth STEM Interest Profiles identified in a secondary analysis (1-Dislike Math, 2-Like all STEM, 3-Dislike all STEM), the design combines surveys with in-depth interviews and observations. To study educators and institutions, researchers will combine interviews, focus groups, and observations to better understand factors that influence community-wide, data-driven approaches to supporting youth interest development. Research will be conducted in three phases with the goal of community-level change in youth STEM interest and participation. In Phase 1 (Years 1 & 2) four educational partners will develop interventions for a 6th and 7th grade youth cohort that will be iteratively refined through a design-based approach. Educational partners and researchers will meet to review and discuss interest and participation data and use these data to select content, as well as plan activities and strategies within their programs (using a simplified form of conjecture mapping). By Phase 2 (Years 3 & 4) four additional partners will be included, more closely modeling the complex system of the community. With support from researchers support and existing partners, new educational partners will similarly review and discuss data, using these to select content, as well as plan activities consistent with program goals and strategies. Additional interventions will be implemented by the new partners and further assessed and refined with a new 6th and 7th grade cohort, along with the existing interventions of the first four partners. In Phase 3 (Year 5) data will be collected on pre-post community-level changes in STEM interest and participation and the perceived effectiveness of this approach for youth. These data will inform future studies.
This project engages members of racially and economically diverse communities in identifying and carrying out environmental projects that are meaningful to their lives, and adapts technology known as NatureNet to assist them. NatureNet, which encompasses a cell phone app, a multi-user, touch-based tabletop display and a web-based community, was developed with prior NSF support. Core participants involved in programs of the Anacostia Watershed Society in Washington, D.C., and Maryland, and the Reedy Creek Nature Preserve in Charlotte, NC, will work with naturalists, educators, and technology specialists to ask scientific questions and form hypotheses related to urban waterway restoration and preservation of native species. They will then collect and analyze data using NatureNet, requesting changes to the technology to customize it as needed for their projects. Casual visitors to the nature centers will be able to interact with the environmental projects via the tabletop, and those who live farther away will be able to participate more peripherally via the online community. The research project, led by researchers from the University of Maryland, College Park, with collaborators from the University of North Carolina, Charlotte, and the University of Colorado, Boulder, will provide answers to two questions: 1) How do community-driven informal environmental learning projects impact participants, including their motivation to actively participate in science issues via technology and their disposition toward nature preserves and scientific inquiry? and 2) What are the key factors (e.g., demographic composition of participants, geographical location) that influence the development of community-driven environmental projects? Researchers will gather extensive qualitative and quantitative data to understand how community projects are selected and carried out, how participants approach technology use and adaptation, and how informal learning and engagement on STEM-related issues can be fostered over a period of several months and through iterative project cycles. Data will be collected through motivation questionnaires; focus groups; interviews; tabletop, mobile, and website interaction logs; field notes from participatory design and reflection sessions; and project journals kept by nature preserve staff. Through extensive research, iterative design, and evaluation efforts, researchers will develop an innovative model for community-driven environmental projects that will deepen informal science education by demonstrating how members of diverse communities connect environmental knowledge and scientific inquiry skills to the practices, values, and goals of their communities, and how technology can be used to facilitate such connections.
DATE:
-
TEAM MEMBERS:
Tom YehMary Lou MaherJennifer PreeceTamara CleggCarol Boston