This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
This Smart and Connected Community (SCC) project will partner with two rural communities to develop STEMports, an innovative Science, Technology, Engineering and Mathematics (STEM) learning game for workforce development. The game's activities will take players on localized Augmented Reality (AR) missions to both engage in STEM learning challenges and discover emerging STEM careers in their community, specifically highlighting innovations in the fields of sustainable agriculture and aquaculture, forest products, and renewable energy. Community Advisory Teams (CATs) and co-design teams, including youth, representatives from the targeted emerging STEM economies, and decision-makers will partner with project staff to co-design STEMports that reflect the interests, cultural contexts, and envisioned STEM industries of the future for each community.
The project will: (a) design and pilot an AR game for community STEM workforce development; (b) develop and adapt a community engagement process that optimizes community networking for co-designing the gaming application and online community; and (c) advance a scalable process for wider applications of STEMports. This project is a collaboration between the Maine Mathematics and Science Alliance and the Field Day Lab at the University of Wisconsin-Madison to both build and research the co-designing of a SCC based within an AR environment. The project will contribute knowledge to the informal STEM learning, community development, and education technology fields in four major ways:
Deepening the understanding of how innovative technological tools support rural community STEM knowledge building as well as STEM identity and workforce interest.
Identifying design principles for co-designing the STEMports community related to the technological design process.
Developing social network approaches and analytics to better understand the social dimensions and community connections fostered by the STEMport community.
Understanding how participants' online and offline interactions with individuals and experiences builds networks and knowledge within a SCC.
With the scaling of use by an ever-growing community of players, STEMports will provide a new AR-based genre of public participation in STEM and collective decision making. The research findings will add to the emerging literature on community-wide education, innovative education technologies, informal STEM learning (especially place-based learning and STEM ecosystems), and participatory design research.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Ecology Plus (Ecology+) is an NSF INCLUDES Launch Pilot project with a goal of increasing the participation of underrepresented minorities in a broad range of career pathways where ecology plays a role. This project recognizes that both innovative scientific research and wider societal participation are needed for effective and equitable solutions to environmental issues that directly impact societal well-being and national security. Both research and policy are enhanced by full participation of all sectors of society. Despite the existence of multiple programs over many years, barriers to the participation of underrepresented minorities in ecology persist. One overarching systemic issue remains critical: that insufficient connections among programs result in breaks along critical transition points in career pathways. Project activities will lay the groundwork by developing a regional approach to alliance-building that can be extended across the nation.
Ecology+ will use a collective impact framework -- characterized by a common agenda, shared measurement, mutually reinforcing activities, continuous communication, and backbone support -- to optimize career guidance and support for undergraduate students, graduate students and early career technical and professional scientists. Starting in the Washington-Baltimore region, key objectives of the project are to develop infrastructure for effective communications among partners with the capacity to expand nationally; map potential career pathways with associated sets of necessary competencies, opportunities and mentors, and; empower alliance participants to overcome institutional barriers and patterns of unconscious bias. Ecology+ will: a) establish an online mentoring platform; b) offer a career fair with motivational talks and guidance on individual career development plans; c) offer a series of relevant skills workshops; d) arrange research or internship experiences, and; e) facilitate awareness and networking opportunities with employers from agencies, business and nonprofit sectors. The value of Ecology+ lies in its comprehensive, integrated approach that will bring new partners and their resources into a transformative and systemic response to the key barriers affecting underrepresented minorities in science.
Over the seven years prior to this award, the principal investigator from George Mason University and a national team of scientists, professional societies, science communication researchers, and broadcast meteorologists have been engaged in an effort to include in TV and other weather broadcasts information about current research on the interactions of climate and weather. A Climate Matters network has been established that involves 350 weathercasters at 218 stations, in 119 media markets, nationwide. A particular focus of the initiative has been to help the public become more familiar with the science behind how their local weather and its trends are related to the dynamics of the climate. Many communities nationwide are engaged in deliberations about how to understand, plan for, and adapt to the potential impacts of changes in their weather on important factors pertaining to their economy and well-being, such as natural resources, natural disasters, agriculture, industry, and health. The goal of this continuing project is to expand the quantity and nature of the coverage of such information into the news segments of local news media. By stimulating local reporting on climate impacts and their relationships to personal and community-wide decision-making, this project will potentially help millions of Americans better understand and respond to critical factors that are affecting their lives. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project involves five inter-related, complementary activities: (1) Knowledge building through formative research and process evaluation, specifically in-depth interviews and random sample surveys of journalists in each of the participating journalism professional societies; (2) Recruiting 400 news directors, producers, reporters and additional weathercasters into the Climate Matters network; (3) Providing climate reporting training and professional development to members of the network; (4) Producing and distributing Climate Matters reporting packages to all members of the network on a near-weekly basis; and (5) Evaluating the impacts of the climate reporting on public understanding of science.
DATE:
-
TEAM MEMBERS:
Edward MaibachSusan HassolBernadette PlackyRichard CraigTeresa Myers
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will embed public engagement with science (PES) into the cultures and practices of two Long-Term Ecological Research (LTER) sites: the Hubbard Brook Experimental Forest in New Hampshire and the Harvard Forest in Massachusetts. The goals are 1) to build knowledge about the mutual learning between scientists and adult stakeholders in face-to-face engagement setting and 2) to develop evidence-based practices in the content of place-based ecosystem research. This is a collaborative project of 3 universities (Michigan State University, Harvard, and CUNY) and the two LTERs. Two primary research questions guide this work. First, how willing are participating scientists to take part in PES? What are their attitudes and beliefs about whether engagement can be effective and whether they have the necessary skills? Second, how willing are participating scientists to build relationships with stakeholders using normed tactics? Both qualitative and quantitative methods will be used to collect evidence including semi-structured interviews and surveys. A general set of hypothesis include that there will be positive changes in LTER scientists willingness to participate in PES, attitudes, and efficacy beliefs.
DATE:
-
TEAM MEMBERS:
John BesleySarah GarlickPeter GroffmanPamela TemplerKathleen Lambert
resourceprojectProfessional Development, Conferences, and Networks
The Institute of Arctic and Alpine Research (INSTAAR) at the University of Colorado, Boulder, in collaboration with EcoArts Connections and the National Center for Atmospheric Research (NCAR), is conducting an initial planning workshop and related activities which will be the first of three stepwise convenings over the next two or three years to gather experts from the fields of natural and social sciences, arts, energy/water conservation, and related disciplines. The initiative will work to establish an operational strategy for knowledge sharing across collaborating entities, networks, and associations. The major goal is to strengthen collaboration of professionals nationally to better conceive, conduct, and evaluate projects for the public that work at the intersection of science, arts, and sustainability (environmental, social and economic). Many communities around the country have been seeking to address increasingly pressing problems about their ability to sustain the vitality, health and resilience of their regions and the lives of their residents. Bringing inter-disciplinary knowledge and skills to bear on these issues is considered to be critical. Between 24 - 32 professionals will be involved. The workshop will be conducted simultaneously in Boulder, CO and at Princeton University, with communication between the two sites. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. Intended outcomes from this first workshop include: 1) identification and preliminary mapping of successful evidence-based best practices in science-arts-sustainability collaborations 2) a strategic vision for interdisciplinary collaboration across networks; and 3) an initial framework for the dissemination of findings that can reach across disciplines. Outputs include 1) preparation of a pre-workshop briefing booklet based in part on interviews of professionals in the various disciplines; 2) a post-workshop white paper; 3) a network of experts from the participating disciplinary fields; and 4) an agenda for the second (larger) convening. The trans-disciplinary strategy promises to more efficiently and effectively bring STEM disciplines to a wider public in collaboration with the arts through sustainability topics that are place-based, targeted to, and meaningful for specific audiences.