Final External Evaluation Report for Informal STEM Learning at Biological Field Stations, an NSF AISL Exploratory Pathways project, which studied the pedagogical and andragogical characteristics of informal educational outreach activities at field stations. This report summarizes the project team’s major research activities and the contextual factors that supported that work.
Appendix includes interview protocol.
The U.S. Fish and Wildlife Service estimates that over 41 million people connect to nature through birding. Learning about birds in their natural environments offers opportunities for informal engagement in STEM by a broad range of individuals and groups. Birders often engage in scientific data gathering and analyses, geolocation and remote sensing, and phenology. They also become aware of ecological changes in bird habitats and migratory patterns due to rising temperatures and climate-related events like sea level rise, droughts, fires, and extreme weather. As such, the birding community is an ideal network to better understand and communicate the impacts of climatological changes on bird populations to the public. With this Innovations in Development project, the National Audubon Society will develop a new avian-focused, conservation and climate science community science curriculum for its Nature Centers, and test the effectiveness of the curriculum in educating the public about avian-focused conservation and climatological changes through guided nature experiences. Birding can serve as a pivotal entrée for young people into STEM fields and careers. Through its programs and partnerships, Audubon will leverage its national network to ensure that through this project a more diverse group of voices, particularly young adults and young adults of color, become involved in asking critical questions and developing solutions to address important environmental issues of the future. If successful, the broader impacts of this project on capacity building and public engagement could be far-reaching and long-lasting.
Over the three-year project duration, Audubon will bring educators from its nationwide network of thirty-four Nature Centers (including urban, suburban, and rural sites), together with over 510 young adults (ages 18-25) from its network of college campus chapters. An evidence-based curriculum and community science activities will be created and tested, relying heavily on a team of experts in ornithology, climate science research, STEM curriculum design, diversity, and informal science education. College students will advise on the design of content and activities to effectively interest and engage young adults. These students will be recruited from the new Audubon Campus Chapters Program, which includes 111 college and university campuses, among them, 19 Historically Black Colleges and Universities (HBCUs) and other Minority Serving Institutions (MSIs). The target population will be surveyed to also understand their current and likely participation in guided nature experiences and knowledge base in climate science. Current best practices in guided nature experiences will be gathered from across the Audubon network. The implementation efforts will result in a national STEM model, with train-the-trainer guides and workshops for informal science educators and public engagement opportunities focused on improving the state and condition of avian habitats and communities through climate science research. An external evaluation will be conducted and will include data collection methods such as retrospective pre and post surveys, semi-structured interviews, focus groups, and an embedded assessment to determine impact. The findings will be used to iteratively refine the evidence-based curriculum and measure STEM learning outcomes for the guided nature experience participants. The evaluation will address four areas: (1) fidelity of program implementation to promote accountability; (2) formative evaluation to understand needs and interests of young adults (ages 18-25), and subsequently inform program design; (3) outcomes for Center educators, to inform iterative improvement; and (4) outcomes for program participants, to contribute to the growing knowledge base on effective practices for STEM learning in informal settings.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Loren SmithMark ScallionHeather Starck
Human-induced global change has triggered the sixth major extinction event on earth with profound consequences for humans and other species. A scientifically literate public is necessary to find and implement approaches to prevent or slow species loss. Creating science-inspired art can increase public understanding of the current anthropogenic biodiversity crisis and help people connect emotionally to difficult concepts. In spite of the pressure to avoid advocacy and emotion, there is a rich history of scientists who make art, as well as art–science collaborations resulting in provocative work
DATE:
TEAM MEMBERS:
Jennifer HarrowerJennifer ParkerMartha Merson
resourceprojectProfessional Development and Workshops
For the United States to maintain its leading role on the world economic stage, it is essential to strengthen the American workforce in science, technology, engineering, and mathematics (STEM). Our current prosperity and our future success hinge on recruiting, training, and employing the creative and industrious STEM professionals who drive the innovation economy. Strengthening the American STEM workforce depends, in part, on broadening participation to students from demographics that have traditionally been underrepresented in STEM. This NSF INCLUDES Launch Pilot project will foster recruitment, training, and employment for indigenous STEM students, where the term "indigenous" comprises the terms Native American, American Indian, Alaskan Native, and Hawaiian Native. Specifically, this project will support the design and development of a first-of-its-kind network focused on environmental stewardship of indigenous lands. The network will comprise both tribal and government partners and will be organized by three faculty at the University of Colorado-Denver. Student recruitment, training, and employment will be organized around the unifying principle of land stewardship. The focus on land stewardship has been selected not only because it demands the expertise of STEM professionals, but also because land stewardship is among the top motivations for indigenous students considering STEM careers. Accordingly, this work is important on several fronts: It addresses the recognized need for STEM professionals; it broadens participation to students from underrepresented groups; and it provides a test bed for collective action by a first-of-its-kind network of tribal, government, and university partners.
The proposed network will work together to design, deploy, and debug a unique educational program giving students an opportunity to train for employment as tribal liaisons in the environmental field. In particular, this program will address the need for culturally-sensitive, scientifically-trained individuals who can serve as tribal liaisons between tribal and non-tribal organizations, which will allow them to prevent, minimize, or manage environmental incidents through their understanding of STEM principles and organizational dynamics. All students in this educational program will earn a regular four-year STEM degree, but a key feature of the program is that they will also participate in training and internships designed to provide background with nontechnical matters such as cultural awareness, environmental regulations, and organizational dynamics. Additionally, this educational program is designed to support recruitment of indigenous students by (1) providing a clear vision of a high-impact, culturally-relevant professional career and by (2) providing a cultural connection with obtaining a college degree. Taken together, the network aims to increase enrollment, retention, graduation, and alumni activity by indigenous students. Best practices and strategies for collective impact will be used to document achievement of the network in increasing the enrollment, retention, graduation, and alumni activity of indigenous students in higher education and in STEM careers. Continuous feedback will be collected to assess partner engagement and durability, and student satisfaction, performance, and progress. The network is expected to be sustainable because it addresses a demonstrated need; it is expected to be scalable because scientifically aware, culturally-sensitive individuals who can serve as tribal liaisons are needed not only regionally, but nationally.
DATE:
-
TEAM MEMBERS:
Timberley RoaneDavid MaysRafael Moreno-SanchezBrenda AllenGrace RedShirt Tyon
This NSF INCLUDES Design and Development Launch Pilot, "Expanding Diversity in Energy and Environmental Sustainability (EDEES)", will develop a network of institutions in the United States mid-Atlantic region to recruit, train, and prepare a significant number of underrepresented, underserved, and underprivileged members of the American society in the areas of alternative energy generation and environmental sustainability. Researchers from Delaware State University (DSU) will lead the effort in collaboration with scientists and educators from the University of Delaware, Delaware Technical Community College, University of Maryland, and Stony Brook University. The program comprises a strong educational component in different aspects of green energy generation and environmental sciences including the development of a baccalaureate degree in Green Energy Engineering and the further growth of the recently established Renewable Energy Education Center at our University. The program comprises an active involvement of students from local K-12 institutions, including Delaware State University Early College High School. The character of the University as a Historically Black College (HBCU) and the relatively high minority population of the region will facilitate the completion of the goal to serve minority students. The program will also involve the local community and the private sector by promoting the idea of a green City of Dover, Delaware, in the years to come.
The goal of EDEES-INCLUDES pilot comprises the enrollment of at least twenty underrepresented minority students in majors related to green energy and environmental sustainability. It also entails the establishment of a baccalaureate degree in Green Energy Engineering at DSU. The program is expected to strengthen the pathway from two-year energy-related associate degree programs to four-year degrees by ensuring at least five students/year transfer to DSU in energy-related programs. The pilot is also expected to increase the number of high school graduates from underrepresented groups who choose to attend college in STEM majors. Based on previous experience and existing collaborations, the partner institutions expect to grow as an integrated research-educational network where students will be able to obtain expertise in the competitive field of green energy. The pilot program comprises a deep integration of education and research currently undergoing in the involved institutions. In collaboration with its partner institutions, DSU plans to consistently and systematically involve students from the K-12 system to nurture the future recruitment efforts of the network. A career in Green Energy Engineering is using and expanding up existing infrastructure and collaborations. The program will involve the local community through events, workshops and open discussions on energy related fields using social networks and other internet technology in order to promote energy literacy.
DATE:
-
TEAM MEMBERS:
Aristides MarcanoMohammed KhanGulnihal OzbayGabriel Gwanmesia
resourceprojectProfessional Development, Conferences, and Networks
This NSF INCUDES Design and Development Launch Pilot will increase the recruitment, retention, and matriculation of racial and ethnic minorities in STEM Ph.D. programs contributing to hazards and disaster research. Increasing STEM focused minorities on hazards mitigation, and disaster research areas will benefit society and contribute to the achievements of specific, desired societal outcomes following disasters. The Minority SURGE Capacity in Disasters (SURGE) launch pilot will provide the empirical research to identify substantial ways to increase the underrepresentation of minorities in STEM disciplines interested in hazards mitigation and disaster research. Increasing the involvement of qualified minorities will help solve the broader vulnerability concerns in these communities and help advance the body of knowledge through the diversity of thought and creative problem solving in scholarship and practice. Utilizing workshops and a multifaceted mentorship program SURGE creates a new model that addresses the diversity concerns in both STEM and disaster fields, and make American communities more resilient following natural disasters. This project will be of interest to policymakers, educators and the general public.
The Minority SURGE Capacity in Disasters (SURGE) NSF INCLUDES Design and Development Launch Pilot will enhance the social capital of racial and ethnic minority communities by increasing their networks, connections, and access to disaster management decision-making among members of their community from STEM fields. The four-fold goals of SURGE are to: (1) increase the number of minority graduate researchers in STEM fields with a disaster focus; (2) develop and guide well-trained, qualified disaster scholars from STEM fields; (3) provide academic and professional mentorship for next generation minority STEM scholars in hazards mitigation and disaster research; and (4) develop professional and research opportunities that involve outreach and problem solving for vulnerable communities in the U.S. The SURGE project is organized as a lead-organization network through the University of Nebraska at Omaha and includes community partners. As a pilot project, SURGE participation is limited to graduate students from research-intensive universities across the country. Each student will attend workshops and training programs developed by the project leads. SURGE investigators will conduct project evaluation and assessment of their workshops, training, and mentorship projects. Results from evaluations and assessments will be presented at STEM and disaster-related conferences and published in peer-reviewed academic journals.
DATE:
-
TEAM MEMBERS:
DeeDee BennettLori PeekTerri NortonHans Louis-Charles
The Sustainability Teams Empower and Amplify Membership in STEM (S-TEAMS), an NSF INCLUDES Design and Development Launch Pilot project, will tackle the problem of persistent underrepresentation by low-income, minority, and women students in STEM disciplines and careers through transdisciplinary teamwork. As science is increasingly done in teams, collaborations bring diversity to research. Diverse interactions can support critical thinking, problem-solving, and is a priority among STEM disciplines. By exploring a set of individual contributors that can be effect change through collective impact, this project will explore alternative approaches to broadly enhance diversity in STEM, such as sense of community and perceived program benefit. The S-TEAMS project relies on the use of sustainability as the organizing frame for the deployment of learning communities (teams) that engage deeply with active learning. Studies on the issue of underrepresentation often cite a feeling of isolation and lack of academically supportive networks with other students like themselves as major reasons for a disinclination to pursue education and careers in STEM, even as the numbers of underrepresented groups are increasing in colleges and universities across the country. The growth of sustainability science provides an excellent opportunity to include students from underrepresented groups in supportive teams working together on problems that require expertise in multiple disciplines. Participating students will develop professional skills and strengthen STEM- and sustainability-specific skills through real-world experience in problem solving and team science. Ultimately this project is expected to help increase the number of qualified professionals in the field of sustainability and the number of minorities in the STEM professions.
While there is certainly a clear need to improve engagement and retention of underrepresented groups across the entire spectrum of STEM education - from K-12 through graduate education, and on through career choices - the explicit focus here is on the undergraduate piece of this critical issue. This approach to teamwork makes STEM socialization integral to the active learning process. Five-member transdisciplinary teams, from disciplines such as biology, chemistry, computer and information sciences, geography, geology, mathematics, physics, and sustainability science, will work together for ten weeks in summer 2018 on real-world projects with corporations, government organizations, and nongovernment organizations. Sustainability teams with low participation by underrepresented groups will be compared to those with high representation to gather insights regarding individual and collective engagement, productivity, and ongoing interest in STEM. Such insights will be used to scale up the effort through partnership with New Jersey Higher Education Partnership for Sustainability (NJHEPS).
DATE:
-
TEAM MEMBERS:
Amy TuiningaAshwani VasishthPankaj Lai
The Yellowstone Altai-Sayan Project (YASP) brings together student and professional researchers with Indigenous communities in domestic (intermountain western U.S.) and international (northwest Mongolian) settings. Supported by a National Science Foundation grant, MSU and tribal college student participants performed research projects in their home communities (including Crow, Northern Cheyenne, Fort Peck Assiniboine & Sioux, and Fort Berthold Mandan, Hidatsa and Sahnish) during spring semester 2016. In the spirit of reciprocity, these projects were then offered in comparative research contexts during summer 2016, working with Indigenous researchers and herder (semi-nomadic) communities in the Darhad Valley of northwestern Mongolia, where our partner organization, BioRegions International, has worked since 1998. In both places, Indigenous Research Methodologies and a complementary approach called Holistic Management guided how and what research was performed, and were in turn enriched by Mongolian research methodologies. Ongoing conversations with community members inspire the research questions, methods of data collection, as well as how and what is disseminated, and to whom. The Project represents an ongoing relationship with and between Indigenous communities in two comparable bioregions*: the Big Sky of the Greater Yellowstone Ecosystem, and the Eternal Blue Sky of Northern Mongolia.
*A ‘bioregion’ encompasses landscapes, natural processes and human elements as equal parts of the whole (see http://bioregions.org/).
DATE:
-
TEAM MEMBERS:
Kristin RuppelClifford MontagneLisa Lone Fight
Changes in household-level actions in the U.S. have the potential to reduce rates of greenhouse gas (GHG) emissions and climate change by reducing consumption of food, energy and water (FEW). This project will identify potential interventions for reducing household FEW consumption, test options in participating households in two communities, and collect data to develop new environmental impact models. It will also identify household consumption behavior and cost-effective interventions to reduce FEW resource use. Research insights can be applied to increase the well-being of individuals at the household level, improve FEW resource security, reduce climate-related risks, and increase economic competitiveness of the U.S. The project will recruit, train, and graduate more than 20 students and early-career scientists from underrepresented groups. Students will be eligible to participate in exchanges to conduct interdisciplinary research with collaborators in the Netherlands, a highly industrialized nation that uses 20% less energy and water per person than the U.S.
This study uses an interdisciplinary approach to investigate methods for reducing household FEW consumption and associated direct and indirect environmental impacts, including GHG emissions and water resources depletion. The approach includes: 1) interactive role-playing activities and qualitative interviews with homeowners; 2) a survey of households to examine existing attitudes and behaviors related to FEW consumption, as well as possible approaches and barriers to reduce consumption; and 3) experimental research in residential households in two case-study communities, selected to be representative of U.S. suburban households and appropriate for comparative experiments. These studies will iteratively examine approaches for reducing household FEW consumption, test possible intervention strategies, and provide data for developing systems models to quantify impacts of household FEW resource flows and emissions. A FEW consumption-based life cycle assessment (LCA) model will be developed to provide accurate information for household decision making and design of intervention strategies. The LCA model will include the first known farm-to-fork representation of household food consumption impacts, spatially explicit inventories of food waste and water withdrawals, and a model of multi-level price responsiveness in the electricity sector. By translating FEW consumption impacts, results will identify "hot spots" and cost-effective household interventions for reducing ecological footprints. Applying a set of climate and technology scenarios in the LCA model will provide additional insights on potential benefits of technology adoption for informing policymaking. The environmental impact models, household consumption tracking tool, and role-playing software developed in this research will be general purpose and publicly available at the end of the project to inform future education, research and outreach activities.
DATE:
-
TEAM MEMBERS:
David WatkinsBuyung AgusdinataChelsea SchellyRachael ShwomJenni-Louise Evans
Whereas the evolution of snow cover across forested mountain watersheds is difficult to predict or model accurately, the presence or absence of snow cover is easily observable and these observations contribute to improved snow models. We engaged citizen scientists to collect observations of the timing of distributed snow disappearance over three snow seasons across the Pacific Northwest, U.S.A. . The primary goal of the project was to build a more spatially robust dataset documenting the influence of forest cover on the timing of snow disappearance, and public outreach was a secondary goal
DATE:
TEAM MEMBERS:
Susan Dickerson-LangeKarla EitelLeslie DorseyTimothy LinkJessica Lundquist
Artists have used the environment as a subject forever and there is a long history of artists whose works affect peoples’ awareness of and perceptions of their natural environments. But only relatively recently have other artists become part of the modern environmental movement and of efforts to educate college students and the population at large about environmental issues. Environmental studies programs need to take advantage of this increased interest on the part of artists, and global warming provides a perfect vehicle.
A public event series, “Ecohumanities for Cities in Crisis,” will bring humanities scholars and the public together in Miami, FL to discuss the tension between humans and nature over hundreds of years. Miami is on the verge of an environmental crisis from a warming planet and rising seas. As the region grapples with policy and science issues, humanities scholars have a unique role to play. The project will frame humanistic discussion about urban environments, risk, and resilience. The centerpiece is a public forum in March 2016 which includes a plenary of scholars from diverse humanities disciplines, a walking tour, and a panel on diversity and justice in environmental advocacy. There will be five subsequent public programs through the Fall 2016, an on online archive of all events, professional development activities for high school teachers, a graduate public environmental history course, and a curated museum exhibit.