This pilot and feasibility project will explore whether participation in informal science initiatives like citizen science, which is a form of Public Participation in Scientific Research, can foster or enhance participant attachment to the natural places participants investigate via these programs. The project also examines if participant attachment to place influences the development or application of critical thinking skills among adult learners. Critical thinking skills and the factors that enhance critical thinking skills are important areas of inquiry within the informal STEM learning community. Existing scholarship suggests that three components may be linked: (1) feelings of connection to specific places, (2) intentional exploration and investigation of those places (in this case via citizen science), and (3) understanding of complex socio-ecological systems, which is predicated on critical thinking skills ability. However, the degree to which these aspects are related to each other, the scale at which they occur (local to global), and the specific dimensions of place connection or informal science experiences implicated is not known. Working with the Coastal Observation and Seabird Survey Team (COASST) citizen science program, this project advances collaboration among experts from disparate fields to examine if and how citizen science contributes to increases in connection to place and higher-order critical thinking skills among participants and the potential links between those hypothesized outcomes. The ultimate goal of the project is to inform design of Public Participation in Scientific Research programming that optimizes participant learning, interest, and retention; produces societal outcomes like critical thinking in support of science literacy; and creates high quality data of the scale and grain needed to address questions and issues across the basic-applied science continuum.
This research focuses on the degree to which Public Participation in Scientific Research, specifically citizen science, may foster the presence or intensity of place attachment felt by participants for the sites and settings investigated through these programs and to what extent place attachment may be linked to higher order critical thinking skills among adult learners. A three-pronged mixed-methods research strategy will include: (1) a re-analysis of existing survey and interview data for markers of three-dimensional (personal, social, natural) place attachment as well as critical thinking skills and dispositions; (2) an assessment survey to test for the presence and intensity of place attachment and critical thinking skills; and (3) in-depth interviews to better understand the qualitative nature and development of place attachment and critical thinking skills in a citizen science context. The survey and interview sample will be drawn from participants in the COASST citizen science program and will be stratified into four groups as a function of time engaged in the program, including new, novice, and long-term participants. An independent external advisory board and a committee of visitors comprised of experts in informal science, education, and sense of place will critique and help guide this work. Results are expected to reveal important factors that impact the learning and behavioral outcomes of informal STEM initiatives by probing questions about the essential experiences, exposures, and COASST program components that facilitate deeper critical thinking skills and place attachment. Synthesizing theoretical frameworks from the fields of geography, science education, and educational psychology while testing a unique methodological approach to best measure critical thinking skills and place attachment in an informal citizen science setting will enhance knowledge-building among research and practitioner communities.
In a globalized and increasingly technologically complex world, the ability of citizens to interrogate and interpret scientific evidence, views, and values is critical. That is, scientific literacy is essential for the maintenance of robust and healthy economic, social, and environmental systems in the twenty-first century. Informal science learning fills an important gap in national educational efforts to cultivate a scientifically literate populace as research suggests that formal science training is not always capable of fostering the type of higher order critical thinking skills that undergird such scientific competency. This project aims to strengthen infrastructure and build capacity among informal science practitioners by clarifying whether specific aspects and forms of Public Participation in Scientific Research, especially those relating to people-place connections, are implicated in the development and/or application of critical thinking skills in STEM settings. This effort may expand opportunities to strengthen informal science learning program outcomes, including the cultivation of numerous 21st century skills like information literacy and social skills like conflict management. Through a greater understanding of the individual components that shape informal learning experiences and outcomes, this project also has the potential to support the broadening of participation in STEM fields by providing the groundwork for further research on whether or not underrepresented or traditionally marginalized groups of people experience and/or relate differently to both the "places" most common in citizen science and the practice of informal science programming itself.
Peer production projects involve people in many tasks, from editing articles to analyzing datasets. To facilitate mastery of these practices, projects offer a number of learning resources, ranging from project-defined FAQsto individually-oriented search tools and communal discussion boards. However, it is not clear which project resources best support participant learning, overall and at different stages of engagement. We draw on Sørensen's framework of forms of presence to distinguish three types of engagement with learning resources: authoritative, agent-centered and communal. We assigned
DATE:
TEAM MEMBERS:
Corey Brian JacksonCarsten OsterlundKevin CrowstonMahboobeh HarandiLaura Trouille
Informal learning institutions (ILIs) create opportunities to increase public understanding of science and promote increased inclusion of groups underrepresented in Science, Technology, Engineering, and Math (STEM) careers but are not equally distributed across the United States. We explore geographic gaps in the ILI landscape and identify three groups of underserved counties based on the interaction between population density and poverty percentage. Among ILIs, National Park Service lands, biological field stations, and marine laboratories occur in areas with the fewest sites for informal
Final External Evaluation Report for Informal STEM Learning at Biological Field Stations, an NSF AISL Exploratory Pathways project, which studied the pedagogical and andragogical characteristics of informal educational outreach activities at field stations. This report summarizes the project team’s major research activities and the contextual factors that supported that work.
Appendix includes interview protocol.
Learning to See, Seeing to Learn is a National Science Foundation-funded project to develop www.macroinvertebrates.org, a digital observation tool and set of informational resources that can supplement volunteer biomonitoring trainings and improve aquatic macroinvertebrates identification. Project researchers are interested in how trainers and volunteers use the tool, as well as how training that incorporates the tool impacts volunteers’ confidence in and accuracy around aquatic macroinvertebrates identification. In November 2018, project partner, Stroud Water Research Center, conducted a
Embedded assessment (EA) is particularly well-suited for evaluating citizen science volunteers’ proficiency of science inquiry skills; however they remain uncommon in informal education. Using design-based research, we are examining processes to streamline EA development by building on existing data validation procedures within five citizen science projects. Here, we focus on the critical first step of supporting citizen science project leaders in identifying appropriate skills that are important, relevant, accessible, and potentially hiding in plain sight in their existing data. Our research
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Exploratorium in San Francisco, in collaboration with social science researchers at Arizona State University and Rutgers University, will conduct a two-year Pilots and Feasibility Studies project that will test a new model for integrating museum exhibits with public participation in scientific research, called Exhibit-Based PPSR (E-PPSR). The team will create a mini-exhibition about social psychology that (a) engages science museum visitors in investigating and reflecting on social factors that promote cooperation or not, (b) builds public awareness of the science of social psychology and (c) generates valid data for academic research in this area.
The Exploratorium will build on its long history of creating participatory exhibits that engage visiting groups in social science learning and in self-reflective metacognition. This expands beyond the typical lab-in-the-museum in which individual visitors interact with researchers' laptops or simple props. The model takes the exhibit experiences further, injecting the dimension of public participation in social psychology research. By voluntarily and anonymously contributing demographic and response data, large numbers of people from mixed-age groups will help social scientists gain new insights into cooperation among a broader sample of humanity than are usually studied in university labs. The E-PPSR lab is always available, rather than open only when a researcher is present. The model also incorporates research on learning and assesses the effect of E-PPSR on social science learning experiences. Do museum visitors build greater conceptual understanding of the social science by contributing to real research and seeing their own responses within the larger dataset? Do they attend more deeply to debriefing activities when they have contributed their own data? The three main deliverables include: 1) a prototype Exhibit-based PPSR laboratory at the Exploratorium comprised of one exhibit for gaining informed consent, three 'Data-Catcher' exhibits modified to record anonymous responses when visitors opt-in to contributing to social psychological research, and one debriefing exhibit. A back-end database will send data to the academic researchers; 2) evaluation studies that test the E-PPSR model. The studies will assess the success of debriefing approaches, the effectiveness of recruitment and the impact of E-PPSR on learning. The team will publish a journal article describing the E-PPSR model and academic research findings. The team will also organize a conference session with others in the museum field who manage in-house academic research laboratories; and 3) a report by the academic partners describing the impact of the project on their research program.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for STEM learning in a variety of settings. Many military veterans who seek to transition to higher education or workforce pathways find it challenging to translate the skills they acquired during service to civilian STEM settings and the modern day workforce. Yet many returning veterans have significant experience with STEM fields, including mapping and geospatial technologies, because of their unique functions and service assignments. Such geospatial skills are useful for location-aware industries, citizen science and public services. At the same time, military and veteran families have been largely overlooked as an important public audience for focused informal STEM learning. Informal learning events called "mapathons" which enlists participants to mapping exercises and create geospatial data on open platforms that address authentic needs in their communities and the broader society at large. When seeking to further their education upon returning from service, veterans' typical options have included some form of formal higher education. Mapathons may be a feasible bridging activity that (a) recognizes veterans' unique, valuable, and in-demand STEM skills and (b) supports lifelong learning.
This pilot research seeks to understand how informal learning experiences such as mapathons are viable pathways for veterans to transition to the civilian workforce. The conceptual approach pays attention to the realities of the life course of military and veteran families, especially building upon theories of change related to transitions to include a spatial component. The foundation of the project's intellectual merit is its explicit inclusion and sensitivity to place, scale, and spatial behavior, building directly from findings of prior NSF-funded projects and the evidence base for informal learning pathways. The research will contribute to knowledge about workforce development by addressing the questions: (1) To what extent do veterans recognize that their extant skills acquired, in military settings, are translatable to civilian STEM settings?; (2) How can informal learning experiences help a diverse veteran population increase awareness of the translatability of geospatial workforce competencies, build confidence in technology skills, and motivate interest to pursue formal studies in STEM fields in general?; and (3) What pathways do which veterans favor when they could pursue formal STEM higher education learning among an array of choices online or at regional sites, and why? The study will engage 320 participants at 8 sites across Texas; employ in-depth surveys and interviews; and use spatial analysis to elicit insights about the research questions.
Military and veteran families include a significant number of people from group typically underrepresented in STEM fields. Supporting more veterans to transition successfully to higher education pathways or careers in STEM is a vital service to the nation. This study on informal to formal pathways for veterans will include an innovative understanding of the importance of place in meaning-making and in the reality of choices they consider during the transitions of their life course.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Patricia SolisMelanie HartDennis Patterson
Northern ecosystems are rapidly changing; so too are the learning and information needs of Arctic and sub-Arctic communities who depend on these ecosystems for wild harvested foods. Public Participation in Scientific Research (PPSR) presents a possible method to increase flow of scientific and local knowledge, enhance STEM-based problem solving skills, and co-create new knowledge about phenology at local and regional or larger scales. However, there remain some key challenges that the field of PPSR research must address to achieve this goal. The proposed research will make substantial contributions to two of these issues by: 1) advancing theory on the interactions between PPSR and resilience in social-ecological systems, and 2) advancing our understanding of strategies to increase the engagement of youth and adults historically underrepresented in STEM, including Alaska Native and indigenous youth and their families who play an essential role in the sustainability of environmental monitoring in the high latitudes and rural locations throughout the globe. In particular, our project results will assist practitioners in choosing and investing in design elements of PPSR projects to better navigate the trade-offs between large-scale scientific outcomes and local cultural relevance. The data collected across the citizen science network will also advance scientific knowledge on the effects of phenological changes on berry availability to people and other animals.
The Arctic Harvest research goals are to 1) critically examine the relationship between PPSR learning outcomes in informal science environments and attributes of social-ecological resilience and 2) assess the impact of two program design elements (level of support and interaction with mentors and scientists, and an innovative story-based delivery method) on the engagement of underserved audiences. In partnership with afterschool clubs in urban and rural Alaska, we will assess the impact of participation in Winterberry, a new PPSR project that investigates the effect of changes in the timing of the seasons on subsistence berry resources. We propose to investigate individual and community-level learning outcomes expected to influence the ability for communities to adapt to climate change impacts, including attributes of engagement, higher-order thinking skills, and their influence on the level of civic action and interest in berry resource stewardship by the youth groups. Using both quantitative and qualitative approaches, we compare these outcomes with the same citizen science program delivered through two alternate methods: 1) a highly supported delivery method with increased in-person interaction with program mentors and scientists, and 2) an innovative method that weaves in storytelling based on elder experiences, youth observations, and citizen science data at all stages of the program learning cycle. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project also has support from the Office of Polar Programs.
DATE:
-
TEAM MEMBERS:
Katie SpellmanElena SparrowChrista MulderDeb Jones
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings.The project plans to develop evidence-based principles to guide citizen science project owners in the coordinated management of project participants within the SciStarter landscape. SciStarter is a repository of over 1,500 citizen science (CS) projects. Through prior research, SciStarter 2.0 tools were developed which can be used to study and coordinate recruitment and retention strategies across projects. Coordinated management has the potential to deepen volunteer learning and growth and benefit project goals because it can address across-project skew (CS volunteers involved in multiple projects), evolving motivations, seasonal gaps, untapped synergies across projects, and other unanticipated factors that cannot be addressed via management within project silos. The project will increase the capacity of citizen science projects to achieve their myriad scientific, learning and conservation goals through enhanced coordination of volunteer management, facilitated by evidence-based guidance from the SciStarter's User's Manual for Project Owners. The findings of the research will guide project design and implementation towards synergies that increase the capacity of projects to generate scientific, learning, and conservation outcomes. Research about citizen scientists has focused on within-project assessments and comparisons of projects, but few have examined dynamics of recruitment, retention, and movement of individuals across projects. SciStarter is designed for embedded tracking of participation dynamics in a landscape of projects. The project will expand embedded assessment to measure scientific, learning, and conservation outcomes and their links to participation dynamics within and across projects. Through social network analysis, the project will describe patterns of bridges, ties, and distances among projects based on the cross-over of participants. The project will also propose qualitative research to understand project managers' perceptions of SciStarter and the costs and benefits of coordinated management of citizen scientists. The research is designed to provide insights into participation dynamics that will lead to subsequent knowledge building across citizen science projects, and determine whether new evidence about advantages and disadvantages of coordinated management will persuade project owners to rely less on the silo approach to volunteer management.
Public Participation in Scientific Research (PPSR), often referred to as crowdsourcing or citizen science, engages participants in authentic research, which both advances science discovery as well as increases the potential for participants' understanding and use of science in their lives and careers. This four year research project examines youth participation in PPSR projects that are facilitated by Natural History Museums (NHMs). NHMs, like PPSR, have a dual focus on scientific research and science, technology, engineering, and mathematics (STEM) education. The NHMs in this project have established in-person and online PPSR programs and have close ties with local urban community-based organizations. Together, these traits make NHMs appropriate informal learning settings to study how young people participate in PPSR and what they learn. This study focuses on three types of PPSR experiences: short-term outdoor events like bioblitzes, long-term outdoor environmental monitoring projects, and online PPSR projects such as crowdsourcing the ID of field observations. The findings of this study will be shared through PPSR networks as well as throughout the field in informal STEM learning in order to strength youth programming in STEM, such that youth are empowered to engage in STEM research and activities in their communities. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
The study employs observations, surveys, interviews, and learning analytics to explore three overarching questions about youth learning: 1) What is the nature of the learning environments and what activities do youth engage in when participating in NHM-led PPSR? 2) To what extent do youth develop three science learning outcomes, through participation in NHM-led citizen science programs? The three are: a) An understanding of the science content, b) identification of roles for themselves in the practice of science, and c) a sense of agency for taking actions using science? 3) What program features and settings in NHM-led PPSR foster these three science learning outcomes among youth? Based on studies occurring at multiple NHMs in the US and the UK, the broader impact of this study includes providing research-based recommendations for NHM practitioners that will help make PPSR projects and learning science more accessible and productive for youth. This project is collaboration between education researchers at University of California, Davis and Open University (UK), and Oxford University (UK) and citizen science practitioners, educators, and environmental scientists at three NHMs in the US and UK: NHM London, California Academy of Sciences, and NHM Los Angeles.
The widespread accessibility of live streaming video now makes it possible for viewers around the world to watch live events together, including unprecedented, 24/7 views of wildlife. In addition, online technologies such as live chatting and forums have opened new possibilities for people to collaborate from locations around the world. The innovation that the projects provide is bringing these opportunities together, enabling real-time research and discussion as participants observe and annotate live streaming footage; sharing questions and insights through live Q&A sessions; and explore data with interactive visualization tools. Scientists will support the community's research interests, in contrast with traditional models of citizen science in which communities support the work of scientists. This project will enable people from diverse backgrounds and perspectives to co-create scientific investigations, including participants who might not otherwise have access to nature. The evaluation research for this project will advance the understanding of practices that enable interconnected communities of people to participate in more phases of scientific discovery, and how participation affects their learning outcomes. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of science, technology, engineering, and mathematics (STEM) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. As such, this project will advance a new genre of Public Participation in STEM Research (PPSR). It will also advance scientific exploration using live wildlife cams and establish a database for long-term research to understand how bird behavior and reproductive success are affected by environmental change. This project aims to deepen public involvement in science, building on knowledge and relevance for STEM learning by creating an online learning environment that expands on traditional crowdsourcing models of PPSR in which participants collect data to answer questions driven by scientists. In this project, participants are involved in co-created research investigations, including asking questions, deciding what data are needed, generating data, looking for patterns, making interpretations, reviewing results, and sharing findings. The goals are to 1) create a system that involves the public more deeply in scientific research; 2) develop participants' science skills and interests; 3) increase participants' understanding of birds and the environment; 4) generate new scientific knowledge about wildlife; and 5) advance the understanding of effective project design for co-created PPSR projects at a national scale. Through iterative design and evaluation, the project will advance the understanding of the conditions that foster online collaboration and establish design principles for supporting science and discovery in online learning environments. Through scaling and quasi-experimental studies, the evaluation research will advance the understanding of how learning outcomes may be similar or different for participants engaging in different ways, whether they observe the cams and read about the investigation, process data as contributors, provide some input as collaborators, or join in most or all of the scientific process as co-creators. Despite the popularity of live wildlife cams, with millions of people watching hundreds of cams around the world, little research has been conducted on the use of live cams for collaborative work in formal or informal science education. The infrastructure and open-source framework created for this project will expand the capacity for online communities of people from diverse career backgrounds and perspectives to collaborative on solving personally meaningful questions and contribute to new knowledge. Using this project as a prototype, cam operators from around the world could build networks of cams, enabling future studies with broader scope for comparative biological studies and discoveries. Additionally, it will serve as a model for use in classrooms or for online communities exploring other scientific fields using live-streaming content in collaborative research. By involving scientists and participants from across society as collaborators and co-creators, this project can help increase public engagement with science, technology, and environmental stewardship while advancing the understanding of the natural world and informing public decision-making.