Kera Collective conducted two rounds of program evaluation to understand the experience and impact of Coastal Maine Botanical Garden’s (CMBG) Advanced Studies in Professional Horticulture programs, which vary in format from standalone lectures to multi-session certificate courses.
This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
The U.S. Fish and Wildlife Service estimates that over 41 million people connect to nature through birding. Learning about birds in their natural environments offers opportunities for informal engagement in STEM by a broad range of individuals and groups. Birders often engage in scientific data gathering and analyses, geolocation and remote sensing, and phenology. They also become aware of ecological changes in bird habitats and migratory patterns due to rising temperatures and climate-related events like sea level rise, droughts, fires, and extreme weather. As such, the birding community is an ideal network to better understand and communicate the impacts of climatological changes on bird populations to the public. With this Innovations in Development project, the National Audubon Society will develop a new avian-focused, conservation and climate science community science curriculum for its Nature Centers, and test the effectiveness of the curriculum in educating the public about avian-focused conservation and climatological changes through guided nature experiences. Birding can serve as a pivotal entrée for young people into STEM fields and careers. Through its programs and partnerships, Audubon will leverage its national network to ensure that through this project a more diverse group of voices, particularly young adults and young adults of color, become involved in asking critical questions and developing solutions to address important environmental issues of the future. If successful, the broader impacts of this project on capacity building and public engagement could be far-reaching and long-lasting.
Over the three-year project duration, Audubon will bring educators from its nationwide network of thirty-four Nature Centers (including urban, suburban, and rural sites), together with over 510 young adults (ages 18-25) from its network of college campus chapters. An evidence-based curriculum and community science activities will be created and tested, relying heavily on a team of experts in ornithology, climate science research, STEM curriculum design, diversity, and informal science education. College students will advise on the design of content and activities to effectively interest and engage young adults. These students will be recruited from the new Audubon Campus Chapters Program, which includes 111 college and university campuses, among them, 19 Historically Black Colleges and Universities (HBCUs) and other Minority Serving Institutions (MSIs). The target population will be surveyed to also understand their current and likely participation in guided nature experiences and knowledge base in climate science. Current best practices in guided nature experiences will be gathered from across the Audubon network. The implementation efforts will result in a national STEM model, with train-the-trainer guides and workshops for informal science educators and public engagement opportunities focused on improving the state and condition of avian habitats and communities through climate science research. An external evaluation will be conducted and will include data collection methods such as retrospective pre and post surveys, semi-structured interviews, focus groups, and an embedded assessment to determine impact. The findings will be used to iteratively refine the evidence-based curriculum and measure STEM learning outcomes for the guided nature experience participants. The evaluation will address four areas: (1) fidelity of program implementation to promote accountability; (2) formative evaluation to understand needs and interests of young adults (ages 18-25), and subsequently inform program design; (3) outcomes for Center educators, to inform iterative improvement; and (4) outcomes for program participants, to contribute to the growing knowledge base on effective practices for STEM learning in informal settings.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Loren SmithMark ScallionHeather Starck
Digital Observation Technology Skills (DOTS) is a framework for integrating modern, mobile technology into outdoor, experiential science education. DOTS addresses longstanding tensions between modern technology and classical outdoor education by carefully selecting appropriate digital technology for educational purposes and by situating these tools in classical experiential pedagogy.
DATE:
TEAM MEMBERS:
R. Justin HoughamMarc NutterCaitlin Graham
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will embed public engagement with science (PES) into the cultures and practices of two Long-Term Ecological Research (LTER) sites: the Hubbard Brook Experimental Forest in New Hampshire and the Harvard Forest in Massachusetts. The goals are 1) to build knowledge about the mutual learning between scientists and adult stakeholders in face-to-face engagement setting and 2) to develop evidence-based practices in the content of place-based ecosystem research. This is a collaborative project of 3 universities (Michigan State University, Harvard, and CUNY) and the two LTERs. Two primary research questions guide this work. First, how willing are participating scientists to take part in PES? What are their attitudes and beliefs about whether engagement can be effective and whether they have the necessary skills? Second, how willing are participating scientists to build relationships with stakeholders using normed tactics? Both qualitative and quantitative methods will be used to collect evidence including semi-structured interviews and surveys. A general set of hypothesis include that there will be positive changes in LTER scientists willingness to participate in PES, attitudes, and efficacy beliefs.
DATE:
-
TEAM MEMBERS:
John BesleySarah GarlickPeter GroffmanPamela TemplerKathleen Lambert
In recent years, there has been much concern over the decline of biologists who actually identify themselves to be naturalists, which negatively impacts the field of conservation and the study of biology as a whole. This could result in a decrease in individuals who participate in naturalist-like activities, such as informal environmental education and environmental volunteerism. The purpose of my study was to determine what discourse identities were held by naturalist development program participants, how these discourse identities related to their volunteer motives in environmental settings
This poster presented at the 2014 AISL PI Meeting describes an outdoor informal science learning project that trains volunteer naturalists to lead environmental programs for middle school students.
The New England Wild Flower Society, in collaboration with the Yale Peabody Museum, Montshire Museum of Science, and the Chewonki Foundation, is implementing the Go-Botany project, a multi-faceted, web-based botany user interface. "Go-Botany: Integrated Tools to Advance Botanical Learning," improves botanical education by opening plant study to a larger and more diverse segment of the population including novices, citizen scientists, and informal science educators. The project is designed to integrate a variety of web tools and mobile communication devices to facilitate learning about botany and plant conservation with a focus on native and naturalized plants in New England. Project deliverables include an online database of New England plants; online keys to over 4,000 species of New England flora; a customizable user interface; My Plants personal webpages; an outdoor exhibit that incorporates mobile resources; training programs for informal science educators and educational programs for the public. Projected impacts include increased attraction to and engagement in botanical learning for public audiences and improved teaching abilities by informal science education professionals through the application of user friendly, digital resources on mobile communication devices. Go-Botany significantly impacts the field of informal science education by changing the way that informal learners learn about plants by removing barriers through the use of free online materials, mentoring, and user created resources. This project is projected to reach over 46,000 youth, adults, and informal educators in workshops and via the Go-Botany website.
DATE:
-
TEAM MEMBERS:
Elizabeth FarnsworthGregory LowenbergArthur HainesWilliam Brumback
The Meadowlands Environmental Center, reaching 60,000 members of the public annually, will develop test and implement the "Marsh Access" program." This project will identify and test appropriate assistive technologies and programmatic approaches engaging 5,000 adults from specific disability groups in outdoor field-based experiences in order to better support their engagement, to foster their interest in science and to improve their scientific literacy. One hundred professionals will participate in conferences and professional development around the implementation of these programmatic approaches and will create plans to implement similar programming in outdoor settings across the nation. Utilizing an accessible outdoor garden and trail in the marshes of the New Jersey Meadowlands, Ramapo College in partnership with the New Jersey Meadowlands Commission, Recording for the Blind and Dyslexic, Spectrum for Living and the Adler Aphasia Center will identify and prototype kiosks and educational programming. Evaluation and program development will focus on identifying specific tools and approaches for engaging people with visual, hearing, mobility, mental/cognitive and age related disabilities. Data will be collected through observations, surveys and focus groups during a field testing process with groups of individuals from partner agencies over the three years of the program. Deliverables include two programmatic modules focusing on the science, natural history and ecology of the meadowlands, two multi media kiosks at points along the outdoor trail, a set of assistive technologies for use by public audiences in both facilitated and non facilitated experiences, and a set of program materials available to the public outlining the process and findings of the program.
As teachers respond to the demands of educational reform and strive to meet increasing pressures of educational benchmarks and standards, there is less and less time to utilize innovative teaching techniques. Education reform expectations, coupled with increasing class size and shrinking budgets has significantly impacted the way that science education is delivered in schools. 4-H Wildlife Stewards, a Master Science Educator's Program was developed in response to these emerging concerns in science education. The program is based on the premise that trained volunteer Master Science Educators
DATE:
TEAM MEMBERS:
Mary ArnoldMichael DaltonMaggie LivesayRobin Galloway