This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by engaging in hands-on field experience, laboratory/project-based entrepreneurship tasks and mentorship experiences. This ITEST project aims to research the STEM career interests of late elementary and middle-school students and, based on the results of that research, build an informal education program to involve families and community partners to enhance their science knowledge, attitudes, experiences, and resources. There is an emphasis on underrepresented and low income students and their families.
The project will research and test a new model to promote the development of positive attitudes toward STEM and to increase interest in STEM careers. Phase 1 of the project will include exploratory research examining science capital and habitus for a representative sample of youth at three age ranges: 8-9, 9-10 and 11-12 years. The project will measure the access that youth have to adults who engage in STEM careers and STEM leisure activities. In phase II the project will test a model with a control group and a treatment group to enhance science capital and habitus for youth.
This is the protocol for a research project to assess the wants and needs of adults in underserved STEM learning communities -- in our case, the Richmond, VA African American community -- towards the goal of using a community-university partnership to staging STS science cafes that respond to these wants and needs.
This assessment is based on the three vertices of a triangle composed of cognition, observation, and interpretation, all of which converge on the nature of science, the relevance of science to everyday life, and decision-making behaviors.
We chose one measure from Conley, Pintrich, Vekiri, & Harrison (2004). This measure encompasses four dimensions about scientific knowledge -- source, certainty, development and justification -- so we thought it might reveal interesting dimensions of stasis and change in attitudes toward science from formal school environments to informal adult learning
Citizen science is a form of Public Participation in Scientific Research (PPSR) in which the participants are engaged in the scientific process to support research that results in scientifically valid data. Opportunities for participation in real and authentic scientific research have never been larger or broader than they are today. The growing popularity and refinement of PPSR efforts (such as birding and species counting studies orchestrated by the Cornell Lab of Ornithology) have created both an opportunity for science engagement and a need for more research to better implement such projects in order to maximize both benefits to and contributions from the public.
Towards this end, Shirk et al. have posted a design framework for PPSR projects that delineates distinct levels of citizen scientist participation; from the least to the highest level of participation, these categories are contract, contribute, collaborate, co-create, and colleagues. The distinctions among these levels are important to practitioners seeking to design effective citizen science programs as each increase in citizen science participation in the scientific process is hypothesized to have both benefits and obstacles. The literature on citizen science models of PPSR calls for more research on the role that this degree of participation plays in the quality of that participation and related learning outcomes (e.g., Shirk et al., 2012; Bonney et al., 2009). With an unprecedented interest in thoughtfully incorporating citizen science into health-based studies, citizen science practitioners and health researchers first need a better understanding of the role of culture in how different communities approach and perceive participation in health-related studies, the true impact of intended educational efforts from participation, and the role participation in general has on the scientific process and the science outcome.
Project goal to address critical barrier in the field: Establish best practices for use of citizen science in the content area of human health-based research, and better inform the design of future projects in PPSR, both in the Denver Museum of Nature & Science’s Genetics of Taste Lab (Lab), and importantly, in various research and educational settings across the field.
Aims
Understand who currently engages in citizen science projects in order to design strategies to overcome the barriers to participation that occur at each level of the PPSR framework, particularly among audiences underrepresented in STEM.
Significantly advance the current knowledge regarding how citizen scientists engage in, and learn from, and participate in the different levels of the PPSR framework.
Determine the impact that each stage of citizen science participation has on the scientific process.
Worldwide, four million people participate in geocaching--a game of discovering hidden treasures with GPS-enabled devices (including smart phones). Geocachers span all ages and tend to be interested in technology and the outdoors. To share information about the Montana Climate Assessment (MCA), an NSF-funded scientific report, Montana State University created a custom trackable geocaching coin featuring the MCA Website and logo. We then recruited volunteers to hide one coin in each of Montana’s 56 counties. Volunteer geocachers enthusiastically adopted all 56 counties, wrote blogs and social media posts about the coins, and engaged local Scout troops and schools. Other geocachers then found and circulated the coins while learning about Montana’s climate. One coin has traveled nearly 4,000 miles; several have visited other states and Canada. 95% of the volunteers said the project made them feel more connected to university research, and they told an average of seven other people about the project. Nearly all of the participants were unfamiliar with the Montana Climate Assessment prior to participating. The geocaching educational outreach project included several partnerships, including with Geocaching Headquarters in Seattle (a.k.a. “Groundspeak”); Cache Advance, Inc., an environmentally friendly outdoor gear company; and Gallatin Valley Geocachers. An advisory board of geocachers helped launch the project.
DATE:
TEAM MEMBERS:
Suzi TaylorRay CallawayM.J. NehasilCathy Whitlock
Northern ecosystems are rapidly changing; so too are the learning and information needs of Arctic and sub-Arctic communities who depend on these ecosystems for wild harvested foods. Public Participation in Scientific Research (PPSR) presents a possible method to increase flow of scientific and local knowledge, enhance STEM-based problem solving skills, and co-create new knowledge about phenology at local and regional or larger scales. However, there remain some key challenges that the field of PPSR research must address to achieve this goal. The proposed research will make substantial contributions to two of these issues by: 1) advancing theory on the interactions between PPSR and resilience in social-ecological systems, and 2) advancing our understanding of strategies to increase the engagement of youth and adults historically underrepresented in STEM, including Alaska Native and indigenous youth and their families who play an essential role in the sustainability of environmental monitoring in the high latitudes and rural locations throughout the globe. In particular, our project results will assist practitioners in choosing and investing in design elements of PPSR projects to better navigate the trade-offs between large-scale scientific outcomes and local cultural relevance. The data collected across the citizen science network will also advance scientific knowledge on the effects of phenological changes on berry availability to people and other animals.
The Arctic Harvest research goals are to 1) critically examine the relationship between PPSR learning outcomes in informal science environments and attributes of social-ecological resilience and 2) assess the impact of two program design elements (level of support and interaction with mentors and scientists, and an innovative story-based delivery method) on the engagement of underserved audiences. In partnership with afterschool clubs in urban and rural Alaska, we will assess the impact of participation in Winterberry, a new PPSR project that investigates the effect of changes in the timing of the seasons on subsistence berry resources. We propose to investigate individual and community-level learning outcomes expected to influence the ability for communities to adapt to climate change impacts, including attributes of engagement, higher-order thinking skills, and their influence on the level of civic action and interest in berry resource stewardship by the youth groups. Using both quantitative and qualitative approaches, we compare these outcomes with the same citizen science program delivered through two alternate methods: 1) a highly supported delivery method with increased in-person interaction with program mentors and scientists, and 2) an innovative method that weaves in storytelling based on elder experiences, youth observations, and citizen science data at all stages of the program learning cycle. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project also has support from the Office of Polar Programs.
DATE:
-
TEAM MEMBERS:
Katie SpellmanElena SparrowChrista MulderDeb Jones
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will embed public engagement with science (PES) into the cultures and practices of two Long-Term Ecological Research (LTER) sites: the Hubbard Brook Experimental Forest in New Hampshire and the Harvard Forest in Massachusetts. The goals are 1) to build knowledge about the mutual learning between scientists and adult stakeholders in face-to-face engagement setting and 2) to develop evidence-based practices in the content of place-based ecosystem research. This is a collaborative project of 3 universities (Michigan State University, Harvard, and CUNY) and the two LTERs. Two primary research questions guide this work. First, how willing are participating scientists to take part in PES? What are their attitudes and beliefs about whether engagement can be effective and whether they have the necessary skills? Second, how willing are participating scientists to build relationships with stakeholders using normed tactics? Both qualitative and quantitative methods will be used to collect evidence including semi-structured interviews and surveys. A general set of hypothesis include that there will be positive changes in LTER scientists willingness to participate in PES, attitudes, and efficacy beliefs.
DATE:
-
TEAM MEMBERS:
John BesleySarah GarlickPeter GroffmanPamela TemplerKathleen Lambert
The Water for Life project has been an effective, and in some cases an essential vehicle for addressing issues around water quality and retention in island settings where water security is an on-going challenge. The focus on local partnerships was a highly valued attribute of the WfL project, and the informal science and conservation education resources produced and disseminated by the project have had a significant impact on these populations
A majority of Americans rely on general outlets for science news but more say specialty sources get the facts right about science. This report presents findings from a survey conducted among a nationally representative sample of 4000+ adults from May 30-June 12, 2017. The survey asked about a range of issues from how the public encounters science news and assesses what and who to trust to other ways that people engage with science information in everyday life, including participation in citizen science research projects, hobbies, and consumption of entertainment programming built around
The Art of Science Learning, Phase 2 was an NSF-funded research and development project to investigate the value of incorporating arts-based learning techniques in STEM-related group innovation processes. The project team created a new, arts-infused innovation curriculum in consultation with leading national practitioners in the arts, creativity, and innovation, then deployed that curriculum in “innovation incubators” in San Diego, Chicago, and Worcester (Mass.) in partnership with informal STEM institutions in those cities. At each incubator, diverse members of the public (from high school
DATE:
TEAM MEMBERS:
Peter LinettSteve ShewfeltNicole BaltazarNnenna OkekeDreolin FleisherEric LaPlantMadeline SmithChloe Chittick PattonSarah LeeHarvey Seifter
The Extreme Plants Traveling Sideshow is a theatre piece performed at the Natural History Museum of Utah in relation to the special exhibition, The Power of Poison. While NHMU has a history of Museum Theatre performances, this was the first to be performed since its move to the Rio Tinto Center.
The goal of this evaluation was to understand the visitor experience with museum theater and museum theatre’s value in communicating science content, as well as to inform future productions at NHMU. With this in mind, we sought answer the following questions:
1. Did guests feel the performance