Kera Collective conducted two rounds of program evaluation to understand the experience and impact of Coastal Maine Botanical Garden’s (CMBG) Advanced Studies in Professional Horticulture programs, which vary in format from standalone lectures to multi-session certificate courses.
The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
The Paine Art Center and Gardens will address challenges facing arts education in the region, in particular the low retention rate of new visual and performing arts teachers in the first five years of entering the field. Previous community-based planning sessions determined that arts integration is a compelling and relevant strategy to address the needs of new teachers and arts education. The project will support the development and implementation of the ArtsCore Laboratory, a new dedicated classroom at the Paine, which facilitates teacher collaboration, experimentation, and art activities for students. The laboratory will be designed and equipped to foster interdisciplinary activities and learning styles, with an emphasis on connecting STEM education with arts education. A new educator-in-residence program, the ArtsCore Experience, will offer a professional development program for teachers. The initiatives are a collaboration between the museum and the University of Wisconsin Oshkosh, the Oshkosh Area School District, and more than seven additional school districts.
This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
This is a poster created for the 2019 annual meeting of the American Geophysical Union. Below is the accepted abstract of the poster:
The Long Term Ecological Research (LTER) network spans 28 sites across North America and beyond. Here we share work from two LTER sites in the northeastern US—the Harvard Forest, MA and the Hubbard Brook Experimental Forest, NH—where boundary organizations have been developing a framework for embedding effective public engagement and knowledge co-production into these long-term studies. Here we share this framework and how it has been developed and applied in
The U.S. Fish and Wildlife Service estimates that over 41 million people connect to nature through birding. Learning about birds in their natural environments offers opportunities for informal engagement in STEM by a broad range of individuals and groups. Birders often engage in scientific data gathering and analyses, geolocation and remote sensing, and phenology. They also become aware of ecological changes in bird habitats and migratory patterns due to rising temperatures and climate-related events like sea level rise, droughts, fires, and extreme weather. As such, the birding community is an ideal network to better understand and communicate the impacts of climatological changes on bird populations to the public. With this Innovations in Development project, the National Audubon Society will develop a new avian-focused, conservation and climate science community science curriculum for its Nature Centers, and test the effectiveness of the curriculum in educating the public about avian-focused conservation and climatological changes through guided nature experiences. Birding can serve as a pivotal entrée for young people into STEM fields and careers. Through its programs and partnerships, Audubon will leverage its national network to ensure that through this project a more diverse group of voices, particularly young adults and young adults of color, become involved in asking critical questions and developing solutions to address important environmental issues of the future. If successful, the broader impacts of this project on capacity building and public engagement could be far-reaching and long-lasting.
Over the three-year project duration, Audubon will bring educators from its nationwide network of thirty-four Nature Centers (including urban, suburban, and rural sites), together with over 510 young adults (ages 18-25) from its network of college campus chapters. An evidence-based curriculum and community science activities will be created and tested, relying heavily on a team of experts in ornithology, climate science research, STEM curriculum design, diversity, and informal science education. College students will advise on the design of content and activities to effectively interest and engage young adults. These students will be recruited from the new Audubon Campus Chapters Program, which includes 111 college and university campuses, among them, 19 Historically Black Colleges and Universities (HBCUs) and other Minority Serving Institutions (MSIs). The target population will be surveyed to also understand their current and likely participation in guided nature experiences and knowledge base in climate science. Current best practices in guided nature experiences will be gathered from across the Audubon network. The implementation efforts will result in a national STEM model, with train-the-trainer guides and workshops for informal science educators and public engagement opportunities focused on improving the state and condition of avian habitats and communities through climate science research. An external evaluation will be conducted and will include data collection methods such as retrospective pre and post surveys, semi-structured interviews, focus groups, and an embedded assessment to determine impact. The findings will be used to iteratively refine the evidence-based curriculum and measure STEM learning outcomes for the guided nature experience participants. The evaluation will address four areas: (1) fidelity of program implementation to promote accountability; (2) formative evaluation to understand needs and interests of young adults (ages 18-25), and subsequently inform program design; (3) outcomes for Center educators, to inform iterative improvement; and (4) outcomes for program participants, to contribute to the growing knowledge base on effective practices for STEM learning in informal settings.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Loren SmithMark ScallionHeather Starck
resourceprojectProfessional Development, Conferences, and Networks
Implicit bias and inequities limit the quality, effectiveness, and widespread acceptance of the outdoor and environmental science education field. The field continues to struggle to find resonance with the most tenacious concerns and challenges of communities of color, especially with regards to environmental issues that disproportionately impact the health and economies of these communities. In a time of calls to action to dismantle systemic racism and bias, there is a renewed interest in solution driven approaches to address matters of equity, inclusion, and cultural relevance in education and within organizational change frameworks. This Innovations in Development project will develop and test a model to build individual and organizational capacities to create and sustain equitable, inclusive, culturally relevant workplaces and learning environments, and support professionals of color currently in positions in outdoor science programs and may be at risk of leaving the field. With capacity building support for systems change, the model will help organizations to lead with equity as they plan for the future. The need for this work could not be timelier. If successful, the knowledge gleaned from the Working Toward Equitable Organizations model could inform future efforts to transform the field through institutional changes that result in a more diverse STEM workforce at all levels of leadership and inclusive programs and practices that support STEM learning and engagement in outdoor and environmental science education programs.
Over the three-year project duration, the project will be centered on two strands: (1) Support for Organizational Systems and (2) Professionals of Color Engagement. For the first strand, two cohorts of outdoor science program leaders will engage in intensive reflection, professional learning, and development. They will consider all aspects of their work through an equity lens, develop action plans, and make necessary adjustments to curricula, guiding documents, and practices. For the second strand, a cohort model will be used to create professional learning and engagement communities for professionals of color in outdoor science programs as they navigate the challenges associated with being in the minority in a predominately white-dominated field. In addition, a rigorous research study will be conducted to examine how the professional learning model contributes to changes in organizations to create more inclusive and equitable career paths for professionals of color and will describe under what conditions outdoor science programs are able to make institutional change. A culturally responsive evaluation will inform the design and development of the model and assess its effectiveness. Together, the evaluation and research will identify promising aspects of the work and directions for future scaling. The project will develop and document a scalable model for program leaders and professionals of color that builds the capacity of organizations to promote equity, inclusion, and cultural relevance. It is poised to impact twenty organizations nationwide, 60 professionals of color and ultimately, 200,000 students annually.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Craig StrangValeria RomeroJedda Foreman
Most researchers are keenly interested in disseminating their work beyond traditional publication routes. With an eye to increasing broader impacts, scientists can benefit from partnerships with informal educators who interact daily with the public and see their role as translating science to increase the public’s intellectual and emotional connections with the natural world. Typically, researchers give a one-time lunch hour talk, generally a modified version of a presentation aimed at scientific peers. Talks during which scientists show slides and interpreters mainly listen are a missed
Digital Observation Technology Skills (DOTS) is a framework for integrating modern, mobile technology into outdoor, experiential science education. DOTS addresses longstanding tensions between modern technology and classical outdoor education by carefully selecting appropriate digital technology for educational purposes and by situating these tools in classical experiential pedagogy.
DATE:
TEAM MEMBERS:
R. Justin HoughamMarc NutterCaitlin Graham
In this article, The North American Association for Environmental Education (NAAEE) shares the programs and publications it developed to advance E-STEM—the integration of environmental education into STEM.