The pilot test of a capacity building program integrating strategic discourse & community change theory identified a new path for advancing community STEM literacies. The results of experiment established partnerships with locally based non-profits working to address environmental justice and social disparities in areas threatened by climate change identified five recommendations to reset the role of ISLC’s as more relevant to the communities: 1) Allocate Time to Build Relationships; 2) Develop a Shared Definition of Resilience; 3) Situate Community Aspirations as Context for STEM Learning; 4)
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this pilot and feasibility study is to increase participation in informal STEM learning in rural Idaho through Stories of Fire, a program based on personal narratives of wildland fire. Idaho is a rural state, with an average population of just 19 people per square mile, the fourth lowest population density in the United States. The state is experiencing increasingly severe wildfire, and effective responses to such environmental change require a better understanding of the underlying science. Contextualizing science learning, making connections between everyday lives and a sense of place can engage learners and bring about a better understanding of wildfire. This project will bring together a science communicator, a narratologist, a fire ecologist, and a specialist on emotions and public lands. They will work collaboratively with informal educators based in rural areas of Idaho underrepresented in STEM fields. Rural areas are rich in knowledge based on years of cumulative observations, cultural beliefs, and practices shared through community networks. This project builds on these rural assets while addressing the challenges rural populations face. The project addresses broadening participation in STEM through narrative practices that encourage more diverse ways of knowing, being, and representing science.
This research study will explore: 1) what mechanisms of narrative (storytelling) most effectively integrate individuals? personal experiences and accurate STEM content in fire science communication, and 2) what audience-centered approaches best facilitate narrative approaches to informal STEM learning. This project engages four levels of participants over four phases of research and programming: 1) The research team will interview and analyze the narratives of 40 Frontliners (e.g., wildland firefighters and evacuees) from the inland Northwest region with first-hand experience with wildfire. 2) They will conduct a narrative workshop to train 20 informal STEM Educators from across the state on audience-centered approaches that facilitate participant storytelling about fire. 3) Educators will pilot their own narrative-based informal science learning programs with program participants in their rural home communities across the state, 4) A professional podcaster will create two podcasts modeled on our research findings for public audiences reached through media.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Teresa CohnLeda KobziarJennifer LadinoErin James
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This two-year Pilots and Feasibility project seeks to build knowledge and strategic impact in the informal STEM learning field by studying how and why science-education-art collaborations yield impactful informal STEM learning experiences. By design and implementing interactive and participatory experiences for adult audiences, this project will build knowledge about how to help communities learn about environmental science and apply scientific knowledge to environmental decision-making in their lives.
The project's two overarching research questions are: (1) What are the essential elements of collaboration among scientists, educators, and artists that support learning about adaptation in a changing environment? (2) In what ways do designed, participatory, informal science learning experiences support participant learning? This pilot project will: a) develop methods for facilitating and assessing collaboration among scientists, educators, and artists; b) pilot and refine approaches for engaging scientists, educators, and artists with community members for high quality participatory experiences focus on learning about adaptation to environmental change in informal learning settings; c) pilot and refine methods to measure the outcomes for community participants on knowledge about environmental change and its application to problems in their everyday lives. This project is innovative in bridging a diverse body of scholarship in order to study the process of collaboration and the specific ways interdisciplinary collaborations foster learning. Because informal STEM learning settings often combine the work of multiple disciplines, examining the process and outcomes of collaborative, participatory STEM learning has the potential to deliver widely applicable guidance for achieving more impactful educational outcomes.
The proposed project will broaden participation by engaging adult members of environmentally vulnerable communities in participatory STEM activities and will improving individual and community well-being by delivering tools for future decision-making. The collaborative project will build valuable partnerships and capacity between disparate sectors of society, allowing co-learning and co-production of knowledge. Results will be published in scholarly journals as well as shared with community participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Amy LesenSameer HonwadAma RoganCalvin Mackie
The University of South Carolina will develop and research an educational program in the Southeastern United States designed to recognize and foreground the scientific contributions of the descendants of West Africans and West Indians. Though these contributions have been vital to many scientific enterprises, including land stewardship and aquaponics, they have remained largely underappreciated in educational programs. To address this issue, this project will develop an informal science education program for youth from Gullah/Geechee communities whose ancestors were formerly enslaved West African and West Indian peoples. Across centuries, Gullah/Geechee people have developed historical and contemporary scientific, engineering, and technological practices that enabled the mastery of fishing and the cultivation of numerous crops across barrier islands and coastal cities from North Carolina to Florida. Guided by Gullah/Geechee scholars and community members, pre-service and in-service teachers will co-design culturally sustaining summer programs, which provide Gullah/Geechee youth with opportunities to engage in culturally-embedded scientific and engineering practices as they learn about numerous STEM (science, technology, engineering, and mathematics) career pathways related to these practices. The University of South Carolina will host these summer programs in partnership with the historic Penn Center, an African American historical and cultural institution, and in partnership with the Belle W. Baruch Institute for Marine and Coastal Sciences, a research organization dedicated to improving the management of marine and coastal resources. Researchers will study how the in-service and pre-service teachers enact pedagogies that sustain Gullah/Geechee cultural practices. They will also study how the Gullah/Geechee youth share their understandings of culturally-embedded scientific content through creating iMovies and through giving community presentations hosted by the Penn Center, Baruch Institute, and other community partners. This project will advance knowledge on broadening participation in STEM (science, technology, engineering, and mathematics) career pathways in informal settings through culturally sustaining pedagogies. This project will also advance partnerships through illuminating how different institutions and stakeholders?such as community leaders, cultural centers, university educator programs, and scientific research organizations can work together to support culturally-embedded learning across informal settings.
The University of South Carolina will conduct a mixed-method study grounded in principles of design-based research and community-based participatory research. Pre-service and in-service teachers from underrepresented groups will participate in an immersive two-year professional development experience during which they co-design and teach culturally sustaining summer programs with Gullah/Geechee scholars and leaders. In these programs, fifth- and sixth-grade Gullah/Geechee youth will engage in project-based learning by applying historical and contemporary scientific practices grounded in Gullah/Geechee cultures. Guided by cultural mentors, youth will engage in STEM practices similar to those of STEM professionals in the community. Researchers will study how the educators understand and apply culturally sustaining pedagogies by using constant comparative analytic methods to analyze transcripts from observations and interviews, as well as the educators' work materials (e.g., lesson plans). They will also study how the youth convey their understandings of culturally-embedded scientific content and practices by using constant comparative and multimodal analysis to analyze transcripts from interviews and observations, as well as youth-generated artifacts such as the iMovie. Additionally, pre- and post-tests will enable the research team to determine changes to the youths' understandings of scientific content and perceptions regarding participation in STEM enterprises and careers. Deliverables, such as youth-generated products, will be shared with local media and with relevant cultural centers, while empirical results will be widely disseminated through local and national conferences. This project is funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts, and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers. This project is also co-funded by the Advanced Informal STEM Learning (AISL) program. As part of its overall strategy to enhance learning in informal environments, the AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This Pilot and Feasibility project will investigate: a) the kinds of learning outcomes that occur in an informal STEM project utilizing a Critical Environmental Justice-informed Participatory Action Research framework, co-created between researchers and homeless communities, and b) the challenges and opportunities that arise in evaluating such collaborative projects. To address these questions, a team of university and community researchers will work with two self-organized homeless communities, in Portland, OR and Baltimore, MD, to systematically examine air quality at their sites and further develop a multimedia environmental justice toolkit. The toolkit is aimed at equipping homeless communities with STEM-based information and approaches to learn about and address various environmental hazards. Homeless people are disproportionately vulnerable to the impacts of air and soil pollution, rodents, extreme weather, floods, fires, and other hazards. This collaboration will study STEM learning outcomes related to the broader historical socio-political context in which people are living. The project also anticipates finding ways to adapt evaluation processes to better suit the needs of marginalized groups participating in informal STEM projects.
Guided by this integrated framework, the team will undertake participant observation, interviews, focus groups, and document analysis to assess learning. It also anticipates gaining insights into how evaluation processes may be adapted to better suit the needs of marginalized groups participating in informal STEM learning. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Chris HawnMelanie MaloneErin GoodlingDillon MahmoudiAnthony Levenda
The primary objective of this study is to document how people learn the science of the COVID-19 pandemic in real time, how they activate this scientific knowledge towards informed decision making, and how these processes change over time. This study is intended to produce additional insights on how such learning is shaped by equity concerns and contextual factors. For example, researchers will document how the ways in which people learn the science of COVID-19 are mediated by the sources of information they have access to and leverage, as well as what supports them in doing so. The research will further document how people leverage their understandings of COVID-19, alongside other forms of knowledge and concerns in their decision-making. This study may serve a crucial role in aiding the public understanding of where structural points of informational failure might occur. It may also reveal where and how the public engages or resists community action strategies to mitigate spread and suffering through when, how and why they gather, share, and make sense of scientific data. This RAPID was submitted in response to the NSF Dear Colleague letter related to the COVID-19 pandemic. This award is made by the AISL and ECR programs in the Division of Research on Learning, using funds from the Coronavirus Aid, Relief, and Economic Security (CARES) Act.
This research will draw upon a conceptual framework of consequential learning and a methodological framework of narrative inquiry. Sixty participants in Lansing, Michigan and Seattle, Washington will participate over the course of one year in cyclical interviews, focus group conversations and experience sampling approaches. Documents and resources named and used by the participants in their learning will be collected and analyzed. Attention will be paid to science learning in the following areas as the primary focus: a) the science of SARS-CoV-2 and the relationship between virus and disease, b) viral transmission, and c) origination, replication and spread. A key focus will also be how people use scientific data and evidence-based explanations when developing understandings and making decisions with respect to the pandemic. This research is urgent and timely because the COVID-19 pandemic is projected to occur in multiple waves over approximately 18 months. Insights may produce basic understanding about rapid science learning, policy strategies, school-based practices and resources for use within current and future waves. Socioscientific crises differentially impact people, with effects felt more significantly by vulnerable people. Thus, this study will address the urgent call for investigation into factors and experiences of low-income individuals and families who are trying to educate themselves on continually changing data during an international health crisis.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Science outreach represents a strategy that helps to connect scientists with non-specialized audiences in culturally relevant ways, with the overarching goal of bridging science and society. The concept of science outreach dates back to the beginning of modern science research, but in more recent times, science outreach is increasingly seen as a necessary component of the scientific enterprise, particularly in the context of promoting access, equity, and inclusivity. Yet, challenges exist with regard to scaling and sustaining science outreach efforts. As the field of science outreach moves towards professionalization, it is important to understand how science outreach programs and activities are currently viewed among members of the scientific community. The goal of this project is uncover how science outreach is valued among scientific researchers, learn what motivates scientists to participate in science outreach related initiatives, and examine how gender and race influences participation. The results of this project have the potential to raise awareness about the importance of science outreach and ultimately support increased, effective, and sustainable public engagement with science.
The aims of this project will be accomplished through the creation, dissemination, and analysis of a nationwide survey instrument which will be developed with collaborative input from representative members of the growing national science outreach community. The survey instrument will be tailored to query three distinct groups of respondents that exist within the scientific community: 1) Respondents who do not conduct science outreach; 2) Respondents who participate in science outreach with varying frequency; 3) Respondents who practice science outreach as their profession. A large-scale survey will be conducted and the responses will be analyzed and shared with the broad scientific community through peer-reviewed publication, alongside complementary write-ups and future recommendations, which will be shared on free and publicly accessible web platforms.
Mentoring is a widely accepted strategy for supporting positive socioemotional and cognitive development across a variety of sectors including education, workforce development, and the justice system. An estimated 2.5 million volunteer mentors support youth development in the United States each year. However, there is broad concern that practice has outpaced empirical testing, with significant gaps in the research literature on important modifiers of mentoring relationships and their impacts. This is especially true for mentoring youth ages 10-14 in STEM. Studying highly successful programs may be one way to better understand the role of mentoring and moderators of mentoring effectiveness. The Science Club, a community-based STEM mentoring program for middle-grade youth in the Chicago area, will provide multiple sites for a research study to examine three important issues for advancing theory and practice for STEM mentoring. These issues include (1) understanding STEM mentoring for youth in the middle grades, (2) identifying outcomes and motivations for scientist mentors to more fully participate in mentoring programs, and (3) examining a model of middle-school-focused STEM mentoring collaboration.
Through a series of three studies, the team will investigate which elements of the mentoring relationships are associated with the demonstrated STEM identity gains in youth participants. The work will also contribute much-needed data on the impact of STEM mentoring relationships on the mentors themselves. Study 1 is designed as a retrospective study of program alumni, both youth and mentors, about the nature and extent of each their STEM identity shifts during their time in Science Club. A purposeful sample of 160+ youth and 100+ mentor alumni will participate. Study 2 is a prospective study of three consecutive cohorts of active Science Club participants, built on data and findings from Study 1. In Study 2, the team will design and implement a new Identity-Focused Mentoring Observation Instrument specifically aimed at exploring the nature and quality of mentoring relationships and their role in science identity development longitudinally. Three independent cohorts of 40 youth and 20 mentors each will participate. Study 3 is retrospective, examining how participating individuals and organizations perceive and are impacted by mentoring. The three studies employ a mixed methods approach utilizing surveys, observations, individual interviews, and document review.
This proposal will fill critical gaps in the mentoring literature regarding the formative middle school years through novel, empirical research. Building on the current literature and practice, outcomes of the work will inform practice and enhance knowledge-building in the field on both mentoring relationships and the collective impact of university-school-OST partnerships.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Fostering greater inclusion in science creates benefits for both science and society. In this Innovations and Development project, the University of Utah will investigate how to sustain and scale the STEM Ambassador Program (STEMAP), begun in 2016 with AISL funding. STEMAP developed an innovative process to train scientists to engage members of the public, who cannot or do not gain access to science via conventional science education venues (such as museums, schools, zoos), by implementing activities in non-traditional settings. The 65 scientists trained by the initial STEMAP effort effectively engaged in over 45 settings including an affordable housing development, a youth residential treatment center, a state prison, a cooking class, a daycare facility, and several senior centers. The number of scientists applying to the program quickly exceeded STEMAP's capacity. Other institutions expressed interest in replicating the training. This project will explore strategies for scaling and sustaining public engagement training to support more scientists who can engage more people in more venues. Outcomes will serve to inform the broader implementation of STEMAP and the efforts of other public engagement programs, many of which face similar scaling and sustainability challenges.
Scaling and sustaining public engagement of science (PES) programs is a central challenge for many in the informal science learning community. This project will explore strategies to scale and sustain the STEM Ambassador Program. Research questions include: (1) How do different program formats increase or restrict program capacity and engagement outcomes? (2) What benefits accrue to scientists and their institutions by participating in public engagement in science activities that might serve as motivators to continue these activities? (3) Are funding and organizational models developed in business and other professional settings applicable to sustaining these programs? To address scalability, this project will explore the effectiveness of three dissemination formats: (1) the creation of a mentorship program for in-person trainees, (2) a train-the-trainer approach, and (3) online training with in-person mentorship. The project team will create an evaluation toolkit with participant surveys, rubrics for observers, and "on-the-spot" assessment tools developed under AISL Award 1811022 to assess the effectiveness of engagement activities delivered by trainees in each of the three formats. To address sustainability, the project team will document the values of public engagement training to both the participating scientists and their institutions via surveys and interviews. Consultants from the business sectors will create a PES Campus Council to explore possible financial, organizational, and leadership plans that will help sustain engagement efforts. Outcomes will be published in peer-reviewed journals and compiled into a dissemination framework to inform actions to scale and sustain STEMAP and other public engagement of science programs to engage more hard-to-reach audiences. Inverness Research will serve as the project's external evaluator.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This collaborative project will facilitate rural community education on climate impacts. The Carnegie Natural History Museum and the University of Pittsburgh will work together to form a network of interested community members in Mercer County and Powdermill Nature Reserve in western Pennsylvania to explore the impacts of climate and how its effect could be mitigated or accommodated. The project is has three related ideas: (1) museums hold valuable resources for understanding environmental change, (2) museums are not serving rural audiences well, and (3) complex socio-scientific environmental topics are deeply connected to social decision making in rural communities. This project will bring an inclusive approach to the discussion of socio-scientific issues in rural Western PA, through building relationships between local public audiences, STEM professionals, and informal learning specialists, creating opportunities for co-development of resources and building organizational capacity. The overarching goals of the project are to explore how museums can better serve rural stakeholders and increase the capacity for science-based conversations about human-caused climate impacts.
This project involves a cross-disciplinary team with Carnegie Museum of Natural History providing expertise in interpretation and ecological science, the University of Pittsburgh Center for Learning in Out of School Environments (UPCLOSE) providing expertise in learning research, and rural Hubs centered at Powdermill Nature Reserve (PNR) and the Mercer County Conservation District providing expertise in environmental education, conservation, and engagement with rural communities. The Hubs will coordinate professional development workshops, collaborative design sessions, and community gatherings to bring local stakeholders together to examine and adapt existing resources, including environmental science data and climate education tools, to local issues. These activities will be structured through a Research Practice Partnership. Each will have its own unique mix of geography, demographics, resources, and challenges.
The Research questions are: 1. How can the project effectively support the creation of socially safe spaces for rural Western PA communities to have science-based discussions around climate impacts? 2. How does work with rural partners influence the development of the museum's Center for Climate Studies and its mission to offer programs designed to support public engagement?
3. In what ways have museums been able to support learning about climate topics in rural communities? Data will be gathered from interviews and case studies. There will be two longitudinal studies of local network change and museum change. A survey will also be done to assess the impact of the project on the public. Protocols will be developed in collaboration with the Hubs.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Lauren GiarrataniNicole HellerKevin Crowley
This pilot study will examine the effectiveness of an innovative applied social change, community and technology based program on marginalized youths' access, interest, efficacy and motivation to learn and engage in digital technology applications. Using stratified near-peer and peer-to-peer mentoring approaches, the pilot builds on extant literature that indicates that peer-supported hands-on mentoring and experiences can alleviate some barriers to youth engagement in digital technologies, particularly among underrepresented groups. In this project, undergraduate students will mentor and work collaboratively with high school youth primarily of Hispanic descent and community-based organizations to develop creative technology-based solutions to address social issues and challenges within their local communities, culminating in events called Impactathons. These community-hosted local and state-wide events set this pilot project apart from similar work in the field. The Impactathons not only provide a space for intellectual discourse and problem-solving among the undergraduate-youth-community partners but the Impactathons will also codify expertise from scientists, social scientists, technologists, community leaders, and other stakeholders to develop technology-based solutions with real world application. If successful, a distal outcome will be increased youth interest in digital technologies and related fields. In the short term, favorable findings will provide preliminary evidence of success and lay the foundation for a more extensive study in the future.
This pilot project is a collaboration between the Everett Program, a student-led program for Technology and Social Change at the University of California Santa Cruz - a Hispanic Serving Institution - and the Digital NEST, a non-profit, high-tech youth career development and collaboration space for young people ages 14-24. Through this partnership and other recruitment efforts, an estimated 70-90 individuals will participate in the Impactathon pilot program over two years. Nearly two-thirds of the participants are expected to be undergraduate students. They will receive extensive training in near-peer and peer-to-peer mentoring and serve as mentors for and co-innovation developers with the high school youth participants. The undergraduates and youth will partner with local community organizations to identify a local social challenge that can be addressed through a technology-based solution. The emergent challenges will vary and could span the spectrum of STEM and applied social science topics of interest. Working in informal contexts (i.e., afterschool. weekend), the undergraduate-youth-community partner teams will work collaboratively to develop practical technology-based solutions to real world challenges. The teams will convene three times per year, locally and statewide, at student and community led Impactathons to share their work and glean insights from other teams to refine their innovations. In parallel, the research team will examine the effectiveness of the Impactathon model in increasing the undergraduate and youths' interest, motivation, excitement, engagement and learning of digital technologies. In addition to the research, the formative and summative evaluations should provide valuable insights on the effectiveness of the model and its potential for expansion and replication.
The project is co-funded by the Advancing Informal STEM Learning (AISL) Program and STEM +C. The AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. STEM + C focuses on research and development of interdisciplinary and transdisciplinary approaches to the integration of computing within STEM teaching and learning for preK-12 students in both formal and informal settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will develop and test a model for audience assessment that STEM professionals can use during their public engagement efforts. These on-the-spot assessments will allow scientists to monitor audience understanding and use this to make immediate improvements to their activity. This project fills a critical gap in the field of public science communication as expressed by outreach scientists and by the professional and academic organizations that train them. Project partners include The Astronomical Society of the Pacific, Oregon State University, Pacific Science Center, and the National Radio Astronomy Observatory. Research questions include: (1) How and under what conditions can scientists, regardless of discipline, learn to build assessment into outreach activities? (2) To what degree are scientists willing and able to change their outreach activities to include assessment to ascertain audience attentiveness or understanding? (3) To what degree will scientists be able to adjust their outreach and engagement efforts based on audience feedback, and what support do they need to do so? (4) With constraints on their time and resources, how can the model help scientists conduct audience assessment on their own? (5) Are audience members finding events more enjoyable and fruitful that use assessment techniques? Several iterative rounds of R&D will be used in the spiral design-based approach. A group of Design Testers will start each of the iterative cycles for the initial development and testing techniques, associated training, and support. Later phases will use Field Testers using a rubric for usability, validity, and reliability of various strategies. The summative evaluation of the project will begin early and add data over the life of the project. A mixed methods approach will be used including surveys of scientists once each year after they have participated in the Prototype training. Descriptive and inferential statistics will be used to document the extent to which the project has achieved its intended outcomes. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.