This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
This is the Advisors' Report for 2017 for the iSWOOP (Interpreters and Scientists Working on Our Parks) project. It discusses broad issues across project sites, provides park by park overviews, and highlights results of the research.
The University of Guam (UOG) NSF INCLUDES Launch Pilot project, GROWING STEM, addresses the grand challenge of increasing Native Pacific Islander representation in the nation's STEM enterprise, particularly in environmental sciences. The project addresses culturally-relevant and place-based research as the framework to attract, engage, and retain Native Pacific Islander students in STEM disciplines. The full science, technology, engineering and mathematics (STEM) pathway will be addressed from K-12 to graduate studies with partnerships that include the Guam Department of Education, Humatak Community Foundation, Pacific Post-Secondary Education Council, the Guam Science and Discovery Society, the Society for the Advancement of Chicanos/Hispanics and Native Americans in Science (SACNAS) and the University of Alaska-Fairbaanks. As the project progresses, the project anticipates further partnerships with the current NSF INCLUDES Launch Pilot project at the University of the Virgin Islands.
Pilot activities include summer internships for high school students, undergraduate and graduate research opportunities through UOG's Plant Nursery and the Humatak Community Foundation Heritage House. STEM professional development activities will be offered through conference participation and student research presentations in venues such as the Guam Science and Discovery Society's Guam Island-wide Science Fair and SACNAS. Faculty will be recruited to develop a mentoring protocol for the project participants. Community outreach and extension services will expand public understanding in environmental sciences from the GROW STEM project. Project metrics will include monitoring the diversity of partners, increases in community engagement, Native Pacific Islander participation in STEM activities, the number of students who desire to attain terminal STEM degrees and the number of community members reached by pilot STEM extension and outreach activities. Dissemination of the GROWING STEM pilot project results will occur through the NSF INCLUDES National Network, partner annual conferences, and local, regional and national STEM conferences.
DATE:
-
TEAM MEMBERS:
John PetersonCheryl SanguezaElse DemeulenaereAustin Shelton
Worldwide, four million people participate in geocaching--a game of discovering hidden treasures with GPS-enabled devices (including smart phones). Geocachers span all ages and tend to be interested in technology and the outdoors. To share information about the Montana Climate Assessment (MCA), an NSF-funded scientific report, Montana State University created a custom trackable geocaching coin featuring the MCA Website and logo. We then recruited volunteers to hide one coin in each of Montana’s 56 counties. Volunteer geocachers enthusiastically adopted all 56 counties, wrote blogs and social media posts about the coins, and engaged local Scout troops and schools. Other geocachers then found and circulated the coins while learning about Montana’s climate. One coin has traveled nearly 4,000 miles; several have visited other states and Canada. 95% of the volunteers said the project made them feel more connected to university research, and they told an average of seven other people about the project. Nearly all of the participants were unfamiliar with the Montana Climate Assessment prior to participating. The geocaching educational outreach project included several partnerships, including with Geocaching Headquarters in Seattle (a.k.a. “Groundspeak”); Cache Advance, Inc., an environmentally friendly outdoor gear company; and Gallatin Valley Geocachers. An advisory board of geocachers helped launch the project.
DATE:
TEAM MEMBERS:
Suzi TaylorRay CallawayM.J. NehasilCathy Whitlock
resourceresearchMuseum and Science Center Programs
The National Autonomous University of Mexico (UNAM) is one of the world's single largest employers of science communicators, with over 350,000 students and 40,000 staff. Its science communication activities include five museums (Universum, Museo de la Luz, the Geology Museum, Museo de la Medicina Mexicana and Musem of Geophysics), botanical gardens, as well as a wide range of cultural and outreach activities. It has several programmes for training professional science communicators. The science communication staff are spread across the campuses in Mexico City and four other cities, including
DATE:
TEAM MEMBERS:
Ana Claudia NepoteElaine Reynoso-Haynes
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will embed public engagement with science (PES) into the cultures and practices of two Long-Term Ecological Research (LTER) sites: the Hubbard Brook Experimental Forest in New Hampshire and the Harvard Forest in Massachusetts. The goals are 1) to build knowledge about the mutual learning between scientists and adult stakeholders in face-to-face engagement setting and 2) to develop evidence-based practices in the content of place-based ecosystem research. This is a collaborative project of 3 universities (Michigan State University, Harvard, and CUNY) and the two LTERs. Two primary research questions guide this work. First, how willing are participating scientists to take part in PES? What are their attitudes and beliefs about whether engagement can be effective and whether they have the necessary skills? Second, how willing are participating scientists to build relationships with stakeholders using normed tactics? Both qualitative and quantitative methods will be used to collect evidence including semi-structured interviews and surveys. A general set of hypothesis include that there will be positive changes in LTER scientists willingness to participate in PES, attitudes, and efficacy beliefs.
DATE:
-
TEAM MEMBERS:
John BesleySarah GarlickPeter GroffmanPamela TemplerKathleen Lambert
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal Science Learning program funds innovative research, approaches and resources for use in a variety of settings. This Exploratory Pathways project brings together scientists and science curriculum experts with field station leaders to study informal science learning at biological field stations. The objective is to understand and evaluate the unique qualities of field stations as centers of informal and enduring science learning for the non-science community. There are over 400 field stations and represent a science communication mechanism that if available to most US citizens. This project is a collaboration between Texas A&M University and Colorado State University.
Field stations typically engage in informal science learning. While there are great examples of informal learning through outreach activities at field stations, little is known about what is happening in the aggregate at these establishments. This project documents the outreach work of field stations and explores the connections between how the outreach activities engage learners, incorporate science topics, and address science learning. By creating an Outreach Ontology, a multidimensional framework around the outreach activities, this work provides a valuable resource and reference to informal science researchers who seek to understand what informal learning projects are undertaken at field stations, and how these activities fit into the broader context of informal science learning. This project will help field stations collaborate on improving informal STEM learning activities by bringing them together to discuss their efforts and by developing a publicly available, searchable database detailing their activities. A particular benefit to advancing informal STEM learning by investigating field stations is the broad range of people and communities that are involved with and affected by field station outreach activities.
The project will advance efforts by the American Association for the Advancement of Science and the Institute for Learning Innovation to bring together young adults from communities historically underrepresented in science, technology, engineering, and mathematics (STEM) to collaboratively conduct scientifically driven challenges embedded in a mobile learning tool based upon the AAAS Active Explorer platform. The project will be conducted at the Washington National Mall, San Francisco National Golden Gate Park, and the Boston Harbor Islands National Recreation Area, and will study how a mobile technology used in these settings can facilitate learner engagement in science content; how it can affect young adults' engagement in science-learning processes; and whether interest in learning science and technology has been furthered. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments, including pathways for broadening access to STEM learning experiences and advancing research STEM learning. Research questions will investigate science learning inequalities by addressing how place-based augmented reality games can connect young adults to scientific practices, including observing science phenomena, analyzing data, and communicating findings; how young adults develop science skills related to their science self-efficacy through participation in augmented reality science exploration; and how mobile technologies and gaming can serve as mediators that enable young adults to improve their science identity. In addition to engaging young adults in science activities at the National Parks and increasing their science skills, the project will provide valuable information to National Park staff and scientists to assist them in designing effective tools, resources and experiences to better engage young adults. Research teams will collect data in the form of digital ethnography, focus groups, activity reports, artifacts, and surveys. The project will document learning and engagement through mobile technology in three urban national parks that will involve 60 young adults at each location, and will create innovative measurement tools to monitor how informal settings can leverage the intersections of the arts and sciences to support student engagement and learning.
Public Participation in Scientific Research (PPSR), often referred to as crowdsourcing or citizen science, engages participants in authentic research, which both advances science discovery as well as increases the potential for participants' understanding and use of science in their lives and careers. This four year research project examines youth participation in PPSR projects that are facilitated by Natural History Museums (NHMs). NHMs, like PPSR, have a dual focus on scientific research and science, technology, engineering, and mathematics (STEM) education. The NHMs in this project have established in-person and online PPSR programs and have close ties with local urban community-based organizations. Together, these traits make NHMs appropriate informal learning settings to study how young people participate in PPSR and what they learn. This study focuses on three types of PPSR experiences: short-term outdoor events like bioblitzes, long-term outdoor environmental monitoring projects, and online PPSR projects such as crowdsourcing the ID of field observations. The findings of this study will be shared through PPSR networks as well as throughout the field in informal STEM learning in order to strength youth programming in STEM, such that youth are empowered to engage in STEM research and activities in their communities. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
The study employs observations, surveys, interviews, and learning analytics to explore three overarching questions about youth learning: 1) What is the nature of the learning environments and what activities do youth engage in when participating in NHM-led PPSR? 2) To what extent do youth develop three science learning outcomes, through participation in NHM-led citizen science programs? The three are: a) An understanding of the science content, b) identification of roles for themselves in the practice of science, and c) a sense of agency for taking actions using science? 3) What program features and settings in NHM-led PPSR foster these three science learning outcomes among youth? Based on studies occurring at multiple NHMs in the US and the UK, the broader impact of this study includes providing research-based recommendations for NHM practitioners that will help make PPSR projects and learning science more accessible and productive for youth. This project is collaboration between education researchers at University of California, Davis and Open University (UK), and Oxford University (UK) and citizen science practitioners, educators, and environmental scientists at three NHMs in the US and UK: NHM London, California Academy of Sciences, and NHM Los Angeles.
The Yellowstone Altai-Sayan Project (YASP) brings together student and professional researchers with Indigenous communities in domestic (intermountain western U.S.) and international (northwest Mongolian) settings. Supported by a National Science Foundation grant, MSU and tribal college student participants performed research projects in their home communities (including Crow, Northern Cheyenne, Fort Peck Assiniboine & Sioux, and Fort Berthold Mandan, Hidatsa and Sahnish) during spring semester 2016. In the spirit of reciprocity, these projects were then offered in comparative research contexts during summer 2016, working with Indigenous researchers and herder (semi-nomadic) communities in the Darhad Valley of northwestern Mongolia, where our partner organization, BioRegions International, has worked since 1998. In both places, Indigenous Research Methodologies and a complementary approach called Holistic Management guided how and what research was performed, and were in turn enriched by Mongolian research methodologies. Ongoing conversations with community members inspire the research questions, methods of data collection, as well as how and what is disseminated, and to whom. The Project represents an ongoing relationship with and between Indigenous communities in two comparable bioregions*: the Big Sky of the Greater Yellowstone Ecosystem, and the Eternal Blue Sky of Northern Mongolia.
*A ‘bioregion’ encompasses landscapes, natural processes and human elements as equal parts of the whole (see http://bioregions.org/).
DATE:
-
TEAM MEMBERS:
Kristin RuppelClifford MontagneLisa Lone Fight
NNOCCI is a collaborative effort led by the New England Aquarium with the Association for Zoos and Aquariums, the FrameWorks Institute, the Woods Hole Oceanographic Institution, the National Aquarium in Baltimore, Monterey Bay Aquarium, the New Knowledge Organization in partnership with Penn State University and the Ohio's Center for Science and Industry. With support from the National Science Foundation Climate Change Education Partnership program, NNOCCI's goal is to establish a national network of professionals who are skilled in communicating climate science to the American public.
The Advancing Informal STEM Learning (AISL) program funds innovative projects in a variety of informal settings. The iSWOOP project aims to equip National Park Service interpretive rangers with visualizations and interactive approaches for communicating science in natural learning spaces. An advantage to locating STEM learning in national parks is that they serve as America’s outdoor laboratories, hosting thousands of research studies annually. Dynamic changes in the landscape, wildlife, and interspecies interactions offer countless avenues for inquiry. The project will build collaborations between park-based scientists, whose work frequently happens out of the public eye, and interpreters, who interact with millions of visitors annually. Based on pilot studies done at Carlsbad Caverns National Park, the researchers have extended this work to four more national park units, each with its own natural resources and research. Partners in this endeavor include Winston-Salem State University, Institute for Learning Innovation, and TERC. This project's goal is to establish a model for how national parks can be resources for science education and learning.
iSWOOP works by providing interpretive rangers with professional development. iSWOOP coordinates 1) opportunities for interpreters and scientists to work together in a classroom setting and in the field; 2) creates compelling visualizations, which can function as a jumping off point for conversations about the methods and relevance of park-based research; 3) ongoing opportunities for interpretive rangers to reflect on interactions with visitors and to experiment with questions that spark visitors’ curiosity in the moment and interest long-term.
The main goal of this proposed effort is to translate park-based research endeavors and results from the scientists to the park visitors in ways that make the process enjoyable, informative, and thought-provoking. Evaluation elements will be included every step in this process in order to not only determine if learning has occurred but also how effectively the science has been translated.