Final External Evaluation Report for Informal STEM Learning at Biological Field Stations, an NSF AISL Exploratory Pathways project, which studied the pedagogical and andragogical characteristics of informal educational outreach activities at field stations. This report summarizes the project team’s major research activities and the contextual factors that supported that work.
Appendix includes interview protocol.
The U.S. Fish and Wildlife Service estimates that over 41 million people connect to nature through birding. Learning about birds in their natural environments offers opportunities for informal engagement in STEM by a broad range of individuals and groups. Birders often engage in scientific data gathering and analyses, geolocation and remote sensing, and phenology. They also become aware of ecological changes in bird habitats and migratory patterns due to rising temperatures and climate-related events like sea level rise, droughts, fires, and extreme weather. As such, the birding community is an ideal network to better understand and communicate the impacts of climatological changes on bird populations to the public. With this Innovations in Development project, the National Audubon Society will develop a new avian-focused, conservation and climate science community science curriculum for its Nature Centers, and test the effectiveness of the curriculum in educating the public about avian-focused conservation and climatological changes through guided nature experiences. Birding can serve as a pivotal entrée for young people into STEM fields and careers. Through its programs and partnerships, Audubon will leverage its national network to ensure that through this project a more diverse group of voices, particularly young adults and young adults of color, become involved in asking critical questions and developing solutions to address important environmental issues of the future. If successful, the broader impacts of this project on capacity building and public engagement could be far-reaching and long-lasting.
Over the three-year project duration, Audubon will bring educators from its nationwide network of thirty-four Nature Centers (including urban, suburban, and rural sites), together with over 510 young adults (ages 18-25) from its network of college campus chapters. An evidence-based curriculum and community science activities will be created and tested, relying heavily on a team of experts in ornithology, climate science research, STEM curriculum design, diversity, and informal science education. College students will advise on the design of content and activities to effectively interest and engage young adults. These students will be recruited from the new Audubon Campus Chapters Program, which includes 111 college and university campuses, among them, 19 Historically Black Colleges and Universities (HBCUs) and other Minority Serving Institutions (MSIs). The target population will be surveyed to also understand their current and likely participation in guided nature experiences and knowledge base in climate science. Current best practices in guided nature experiences will be gathered from across the Audubon network. The implementation efforts will result in a national STEM model, with train-the-trainer guides and workshops for informal science educators and public engagement opportunities focused on improving the state and condition of avian habitats and communities through climate science research. An external evaluation will be conducted and will include data collection methods such as retrospective pre and post surveys, semi-structured interviews, focus groups, and an embedded assessment to determine impact. The findings will be used to iteratively refine the evidence-based curriculum and measure STEM learning outcomes for the guided nature experience participants. The evaluation will address four areas: (1) fidelity of program implementation to promote accountability; (2) formative evaluation to understand needs and interests of young adults (ages 18-25), and subsequently inform program design; (3) outcomes for Center educators, to inform iterative improvement; and (4) outcomes for program participants, to contribute to the growing knowledge base on effective practices for STEM learning in informal settings.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Loren SmithMark ScallionHeather Starck
Field stations across the United States provide learning opportunities to the general public through their outreach programming. With approximately 78% and 98% of the US population living within 60 and 120 miles of a field station, respectively, stations have the potential to be key providers of informal STEM education. We surveyed a sample of US biological field stations and asked them to describe their outreach programming and goals. Our findings indicate that field stations prioritize outreach by dedicating personnel and fiscal resources, but such initiatives are highly variable in
For the United States to maintain its leading role on the world economic stage, it is essential to strengthen the American workforce in science, technology, engineering, and mathematics (STEM). Our current prosperity and our future success hinge on recruiting, training, and employing the creative and industrious STEM professionals who drive the innovation economy. Strengthening the American STEM workforce depends, in part, on broadening participation to students from demographics that have traditionally been underrepresented in STEM. This NSF INCLUDES Launch Pilot project will foster recruitment, training, and employment for indigenous STEM students, where the term "indigenous" comprises the terms Native American, American Indian, Alaskan Native, and Hawaiian Native. Specifically, this project will support the design and development of a first-of-its-kind network focused on environmental stewardship of indigenous lands. The network will comprise both tribal and government partners and will be organized by three faculty at the University of Colorado-Denver. Student recruitment, training, and employment will be organized around the unifying principle of land stewardship. The focus on land stewardship has been selected not only because it demands the expertise of STEM professionals, but also because land stewardship is among the top motivations for indigenous students considering STEM careers. Accordingly, this work is important on several fronts: It addresses the recognized need for STEM professionals; it broadens participation to students from underrepresented groups; and it provides a test bed for collective action by a first-of-its-kind network of tribal, government, and university partners.
The proposed network will work together to design, deploy, and debug a unique educational program giving students an opportunity to train for employment as tribal liaisons in the environmental field. In particular, this program will address the need for culturally-sensitive, scientifically-trained individuals who can serve as tribal liaisons between tribal and non-tribal organizations, which will allow them to prevent, minimize, or manage environmental incidents through their understanding of STEM principles and organizational dynamics. All students in this educational program will earn a regular four-year STEM degree, but a key feature of the program is that they will also participate in training and internships designed to provide background with nontechnical matters such as cultural awareness, environmental regulations, and organizational dynamics. Additionally, this educational program is designed to support recruitment of indigenous students by (1) providing a clear vision of a high-impact, culturally-relevant professional career and by (2) providing a cultural connection with obtaining a college degree. Taken together, the network aims to increase enrollment, retention, graduation, and alumni activity by indigenous students. Best practices and strategies for collective impact will be used to document achievement of the network in increasing the enrollment, retention, graduation, and alumni activity of indigenous students in higher education and in STEM careers. Continuous feedback will be collected to assess partner engagement and durability, and student satisfaction, performance, and progress. The network is expected to be sustainable because it addresses a demonstrated need; it is expected to be scalable because scientifically aware, culturally-sensitive individuals who can serve as tribal liaisons are needed not only regionally, but nationally.
DATE:
-
TEAM MEMBERS:
Timberley RoaneDavid MaysRafael Moreno-SanchezBrenda AllenGrace RedShirt Tyon
This NSF INCLUDES Design and Development Launch Pilot, "Expanding Diversity in Energy and Environmental Sustainability (EDEES)", will develop a network of institutions in the United States mid-Atlantic region to recruit, train, and prepare a significant number of underrepresented, underserved, and underprivileged members of the American society in the areas of alternative energy generation and environmental sustainability. Researchers from Delaware State University (DSU) will lead the effort in collaboration with scientists and educators from the University of Delaware, Delaware Technical Community College, University of Maryland, and Stony Brook University. The program comprises a strong educational component in different aspects of green energy generation and environmental sciences including the development of a baccalaureate degree in Green Energy Engineering and the further growth of the recently established Renewable Energy Education Center at our University. The program comprises an active involvement of students from local K-12 institutions, including Delaware State University Early College High School. The character of the University as a Historically Black College (HBCU) and the relatively high minority population of the region will facilitate the completion of the goal to serve minority students. The program will also involve the local community and the private sector by promoting the idea of a green City of Dover, Delaware, in the years to come.
The goal of EDEES-INCLUDES pilot comprises the enrollment of at least twenty underrepresented minority students in majors related to green energy and environmental sustainability. It also entails the establishment of a baccalaureate degree in Green Energy Engineering at DSU. The program is expected to strengthen the pathway from two-year energy-related associate degree programs to four-year degrees by ensuring at least five students/year transfer to DSU in energy-related programs. The pilot is also expected to increase the number of high school graduates from underrepresented groups who choose to attend college in STEM majors. Based on previous experience and existing collaborations, the partner institutions expect to grow as an integrated research-educational network where students will be able to obtain expertise in the competitive field of green energy. The pilot program comprises a deep integration of education and research currently undergoing in the involved institutions. In collaboration with its partner institutions, DSU plans to consistently and systematically involve students from the K-12 system to nurture the future recruitment efforts of the network. A career in Green Energy Engineering is using and expanding up existing infrastructure and collaborations. The program will involve the local community through events, workshops and open discussions on energy related fields using social networks and other internet technology in order to promote energy literacy.
DATE:
-
TEAM MEMBERS:
Aristides MarcanoMohammed KhanGulnihal OzbayGabriel Gwanmesia
resourceprojectProfessional Development, Conferences, and Networks
This NSF INCUDES Design and Development Launch Pilot will increase the recruitment, retention, and matriculation of racial and ethnic minorities in STEM Ph.D. programs contributing to hazards and disaster research. Increasing STEM focused minorities on hazards mitigation, and disaster research areas will benefit society and contribute to the achievements of specific, desired societal outcomes following disasters. The Minority SURGE Capacity in Disasters (SURGE) launch pilot will provide the empirical research to identify substantial ways to increase the underrepresentation of minorities in STEM disciplines interested in hazards mitigation and disaster research. Increasing the involvement of qualified minorities will help solve the broader vulnerability concerns in these communities and help advance the body of knowledge through the diversity of thought and creative problem solving in scholarship and practice. Utilizing workshops and a multifaceted mentorship program SURGE creates a new model that addresses the diversity concerns in both STEM and disaster fields, and make American communities more resilient following natural disasters. This project will be of interest to policymakers, educators and the general public.
The Minority SURGE Capacity in Disasters (SURGE) NSF INCLUDES Design and Development Launch Pilot will enhance the social capital of racial and ethnic minority communities by increasing their networks, connections, and access to disaster management decision-making among members of their community from STEM fields. The four-fold goals of SURGE are to: (1) increase the number of minority graduate researchers in STEM fields with a disaster focus; (2) develop and guide well-trained, qualified disaster scholars from STEM fields; (3) provide academic and professional mentorship for next generation minority STEM scholars in hazards mitigation and disaster research; and (4) develop professional and research opportunities that involve outreach and problem solving for vulnerable communities in the U.S. The SURGE project is organized as a lead-organization network through the University of Nebraska at Omaha and includes community partners. As a pilot project, SURGE participation is limited to graduate students from research-intensive universities across the country. Each student will attend workshops and training programs developed by the project leads. SURGE investigators will conduct project evaluation and assessment of their workshops, training, and mentorship projects. Results from evaluations and assessments will be presented at STEM and disaster-related conferences and published in peer-reviewed academic journals.
DATE:
-
TEAM MEMBERS:
DeeDee BennettLori PeekTerri NortonHans Louis-Charles
The Sustainability Teams Empower and Amplify Membership in STEM (S-TEAMS), an NSF INCLUDES Design and Development Launch Pilot project, will tackle the problem of persistent underrepresentation by low-income, minority, and women students in STEM disciplines and careers through transdisciplinary teamwork. As science is increasingly done in teams, collaborations bring diversity to research. Diverse interactions can support critical thinking, problem-solving, and is a priority among STEM disciplines. By exploring a set of individual contributors that can be effect change through collective impact, this project will explore alternative approaches to broadly enhance diversity in STEM, such as sense of community and perceived program benefit. The S-TEAMS project relies on the use of sustainability as the organizing frame for the deployment of learning communities (teams) that engage deeply with active learning. Studies on the issue of underrepresentation often cite a feeling of isolation and lack of academically supportive networks with other students like themselves as major reasons for a disinclination to pursue education and careers in STEM, even as the numbers of underrepresented groups are increasing in colleges and universities across the country. The growth of sustainability science provides an excellent opportunity to include students from underrepresented groups in supportive teams working together on problems that require expertise in multiple disciplines. Participating students will develop professional skills and strengthen STEM- and sustainability-specific skills through real-world experience in problem solving and team science. Ultimately this project is expected to help increase the number of qualified professionals in the field of sustainability and the number of minorities in the STEM professions.
While there is certainly a clear need to improve engagement and retention of underrepresented groups across the entire spectrum of STEM education - from K-12 through graduate education, and on through career choices - the explicit focus here is on the undergraduate piece of this critical issue. This approach to teamwork makes STEM socialization integral to the active learning process. Five-member transdisciplinary teams, from disciplines such as biology, chemistry, computer and information sciences, geography, geology, mathematics, physics, and sustainability science, will work together for ten weeks in summer 2018 on real-world projects with corporations, government organizations, and nongovernment organizations. Sustainability teams with low participation by underrepresented groups will be compared to those with high representation to gather insights regarding individual and collective engagement, productivity, and ongoing interest in STEM. Such insights will be used to scale up the effort through partnership with New Jersey Higher Education Partnership for Sustainability (NJHEPS).
DATE:
-
TEAM MEMBERS:
Amy TuiningaAshwani VasishthPankaj Lai
Worldwide, four million people participate in geocaching--a game of discovering hidden treasures with GPS-enabled devices (including smart phones). Geocachers span all ages and tend to be interested in technology and the outdoors. To share information about the Montana Climate Assessment (MCA), an NSF-funded scientific report, Montana State University created a custom trackable geocaching coin featuring the MCA Website and logo. We then recruited volunteers to hide one coin in each of Montana’s 56 counties. Volunteer geocachers enthusiastically adopted all 56 counties, wrote blogs and social media posts about the coins, and engaged local Scout troops and schools. Other geocachers then found and circulated the coins while learning about Montana’s climate. One coin has traveled nearly 4,000 miles; several have visited other states and Canada. 95% of the volunteers said the project made them feel more connected to university research, and they told an average of seven other people about the project. Nearly all of the participants were unfamiliar with the Montana Climate Assessment prior to participating. The geocaching educational outreach project included several partnerships, including with Geocaching Headquarters in Seattle (a.k.a. “Groundspeak”); Cache Advance, Inc., an environmentally friendly outdoor gear company; and Gallatin Valley Geocachers. An advisory board of geocachers helped launch the project.
DATE:
TEAM MEMBERS:
Suzi TaylorRay CallawayM.J. NehasilCathy Whitlock
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal Science Learning program funds innovative research, approaches and resources for use in a variety of settings. This Exploratory Pathways project brings together scientists and science curriculum experts with field station leaders to study informal science learning at biological field stations. The objective is to understand and evaluate the unique qualities of field stations as centers of informal and enduring science learning for the non-science community. There are over 400 field stations and represent a science communication mechanism that if available to most US citizens. This project is a collaboration between Texas A&M University and Colorado State University.
Field stations typically engage in informal science learning. While there are great examples of informal learning through outreach activities at field stations, little is known about what is happening in the aggregate at these establishments. This project documents the outreach work of field stations and explores the connections between how the outreach activities engage learners, incorporate science topics, and address science learning. By creating an Outreach Ontology, a multidimensional framework around the outreach activities, this work provides a valuable resource and reference to informal science researchers who seek to understand what informal learning projects are undertaken at field stations, and how these activities fit into the broader context of informal science learning. This project will help field stations collaborate on improving informal STEM learning activities by bringing them together to discuss their efforts and by developing a publicly available, searchable database detailing their activities. A particular benefit to advancing informal STEM learning by investigating field stations is the broad range of people and communities that are involved with and affected by field station outreach activities.
The Yellowstone Altai-Sayan Project (YASP) brings together student and professional researchers with Indigenous communities in domestic (intermountain western U.S.) and international (northwest Mongolian) settings. Supported by a National Science Foundation grant, MSU and tribal college student participants performed research projects in their home communities (including Crow, Northern Cheyenne, Fort Peck Assiniboine & Sioux, and Fort Berthold Mandan, Hidatsa and Sahnish) during spring semester 2016. In the spirit of reciprocity, these projects were then offered in comparative research contexts during summer 2016, working with Indigenous researchers and herder (semi-nomadic) communities in the Darhad Valley of northwestern Mongolia, where our partner organization, BioRegions International, has worked since 1998. In both places, Indigenous Research Methodologies and a complementary approach called Holistic Management guided how and what research was performed, and were in turn enriched by Mongolian research methodologies. Ongoing conversations with community members inspire the research questions, methods of data collection, as well as how and what is disseminated, and to whom. The Project represents an ongoing relationship with and between Indigenous communities in two comparable bioregions*: the Big Sky of the Greater Yellowstone Ecosystem, and the Eternal Blue Sky of Northern Mongolia.
*A ‘bioregion’ encompasses landscapes, natural processes and human elements as equal parts of the whole (see http://bioregions.org/).
DATE:
-
TEAM MEMBERS:
Kristin RuppelClifford MontagneLisa Lone Fight
Finding inclusive approaches to broaden the participation of underrepresented communities in the sciences is the focus of this project. The team will create pathways for Native American students from the development of new partnerships between tribal communities and STEM institutions that promote the participation and inclusion of Native American scientists in the geosciences. Each partner brings a successful program, based on good practices from the research literature in improving outcomes for underrepresented students and scientists. Together, the researchers will create scientific collaborations that support a pipeline for Native American students from middle school through to graduate school and beyond. In addition, the project will work on building welcoming workplace climates for indigenous researchers within ?traditional Western? organizations. The approach will integrate indigenous and Western knowledge in research collaborations to create more creative, innovative, and culturally relevant science research programs.
This project, Integrating Indigenous and Western Knowledge to Transform Learning and Discovery in the Geosciences, uses the principles of collective impact to create new partnerships between tribal communities and STEM institutions that promote the participation and inclusion of Native American scientists in the geosciences. The project collaborators will more strongly integrate indigenous and Western knowledge into collectively-developed research projects. The project partners the Rising Voices: Collaborative Science for Climate Solutions (Rising Voices) and member tribal colleges and communities with Haskell Indian Nations University, the National Center for Atmospheric Research (NCAR), the University of Arizona?s Biosphere 2, and National Center for Atmospheric Research?s Significant Opportunities in Atmospheric Research and Science (SOARS) internship and Global Learning and Observation to Benefit the Environment (GLOBE) citizen science programs. Together, they will build research partnerships between Native American and traditional Western scientists, provide professional development for NCAR and Biosphere 2 scientists on how to engage appropriately with tribal communities, and provide pathways for NA students from middle school through college, to grad school and beyond. The project will connect community-based citizen science programs for middle- and high school youth with undergraduate programs at Haskell Indian Nations University and University of Arizona, and with summer research internship experiences for undergraduates and graduate students that address topics of interest across tribal communities, tribal college faculty, traditional science institutions, and community-based citizen science. This project also enhances the research capacity of all partners, and brings together diverse perspectives, which have been shown to lead to greater innovation, creativity, and higher impact research. The project has the potential to provide a tried and tested model for building similar partnerships at other institutions, including content and methods for professional development for mainstream scientists, ways to create more welcoming spaces for Native American students and scientists, promising practices for improving how research in the geosciences carried out, and an increase in the representation of Native American students and scientists in that vital research enterprise.
Changes in household-level actions in the U.S. have the potential to reduce rates of greenhouse gas (GHG) emissions and climate change by reducing consumption of food, energy and water (FEW). This project will identify potential interventions for reducing household FEW consumption, test options in participating households in two communities, and collect data to develop new environmental impact models. It will also identify household consumption behavior and cost-effective interventions to reduce FEW resource use. Research insights can be applied to increase the well-being of individuals at the household level, improve FEW resource security, reduce climate-related risks, and increase economic competitiveness of the U.S. The project will recruit, train, and graduate more than 20 students and early-career scientists from underrepresented groups. Students will be eligible to participate in exchanges to conduct interdisciplinary research with collaborators in the Netherlands, a highly industrialized nation that uses 20% less energy and water per person than the U.S.
This study uses an interdisciplinary approach to investigate methods for reducing household FEW consumption and associated direct and indirect environmental impacts, including GHG emissions and water resources depletion. The approach includes: 1) interactive role-playing activities and qualitative interviews with homeowners; 2) a survey of households to examine existing attitudes and behaviors related to FEW consumption, as well as possible approaches and barriers to reduce consumption; and 3) experimental research in residential households in two case-study communities, selected to be representative of U.S. suburban households and appropriate for comparative experiments. These studies will iteratively examine approaches for reducing household FEW consumption, test possible intervention strategies, and provide data for developing systems models to quantify impacts of household FEW resource flows and emissions. A FEW consumption-based life cycle assessment (LCA) model will be developed to provide accurate information for household decision making and design of intervention strategies. The LCA model will include the first known farm-to-fork representation of household food consumption impacts, spatially explicit inventories of food waste and water withdrawals, and a model of multi-level price responsiveness in the electricity sector. By translating FEW consumption impacts, results will identify "hot spots" and cost-effective household interventions for reducing ecological footprints. Applying a set of climate and technology scenarios in the LCA model will provide additional insights on potential benefits of technology adoption for informing policymaking. The environmental impact models, household consumption tracking tool, and role-playing software developed in this research will be general purpose and publicly available at the end of the project to inform future education, research and outreach activities.
DATE:
-
TEAM MEMBERS:
David WatkinsBuyung AgusdinataChelsea SchellyRachael ShwomJenni-Louise Evans