This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
The Kaulele Kapa Exhibit was created to explore the effectiveness of a Hawaiian culture-based framework and approach in increasing learner engagement and depth of knowledge in STEM among Native Hawaiian/Pacific Islander (NHPI) learners. The exhibit utilized hands-on and interactive activities, coupled with scientific and cultural information, to create relevant learning experiences for these communities. To determine the effectiveness, exhibit attendees were invited to complete a survey that asked about how the exhibit influenced their interest and understanding of STEM and Hawaiian culture
We examined an approach to reaching audiences who may not ordinarily engage with science. Termed Guerilla Science, this approach blends elements of access, by removing barriers to participation by embedding science into unexpected places, with those of inclusion, by designing activities that speak to the learning identities of participants.
This paper is the culmination of several meaning-making activities between an external researcher, PES practitioners, and social scientist researchers who considered the unique contributions that can be made through RPPs on PES (that is, research-practice partnerships on public engagement with science). Based on the experiences from three RPP projects, the group noted that the PES context may be particularly suited to RPPs, and identified the importance of working as thinking-partners who support reciprocal decision-making. Recommendations are made in support of using these approaches to
But many young people face signifcant economic, cultural, historical, and/or social obstacles that distance them from STEM as a meaningful or viable option— these range from under-resourced schools, race- and gender-based discrimination, to the dominant cultural norms of STEM professions or the historical uses of STEM to oppress or disadvantage socio-economically marginalized communities (Philip and Azevedo 2017). As a result, participation in STEM-organized hobby groups, academic programs, and professions remains low among many racial, ethnic, and gender groups (Dawson 2017). One solution to
This AISL Pilots and Feasibility project will study the data science learning that takes place as members of the public explore and analyze open civic data related to their everyday lives. Government services, such as education, transportation, and non-emergency municipal requests, are becoming increasingly digital. Generally, program workshops and events may be able to support participants in using such data to answer their own questions, such as: "How do City agencies respond to noise in my neighborhood?" and "How do waste and recycling services in my neighborhood compare with others?" This project seeks to understanding how such programs are designed and facilitated to support diverse communities in accessing and meaningfully analyzing data will promote innovation and knowledge building in informal data science education. The team will begin by summarizing best practices in data science education from a variety of fields. Next they will explore the design and impacts of two programs in New York City, a leader in publicly available Open Data initiatives. This phase will explore activities and facilitation approaches, participants' objectives and data literacy skills practice, and begin to identify potential barriers to entry and levels of participation. Finally, the team will build capacity for other similar organizations to explore and understand their impacts on community members' engagement with civic data. This pilot study will establish preliminary evidence of the effectiveness of these programs, and in turn, inform future research into the identifying and amplifying best practices to support public engagement with data.
This research team will begin by synthesizing data science learning best practices based on varied literatures and surveys with academic and practitioner experts.
Synthesis results will be applied as a lens to gather preliminary evidence regarding the impacts of two programs on participants' data science practices and understanding of the nature of data in the context of civics. The programs include one offered by the Mayor's Office of Data Analytics (MODA), which is the NYC agency with overall responsibility for the City's Open Data programs, and BetaNYC, a leading nonprofit organization working to improve lives through civic design, technology, and engagement with government open data. The research design triangulates ethnographic observations and artifacts, pre and post adapted surveys, and interviews with participants and facilitators. Researchers will identify programmatic metrics and adapts existing measures to assess various outcomes related to public engagement with data, including: question formulation, data set selection and manipulation, the use of data to make inferences, and understanding variability, sampling and context. These metrics will be shared through an initial assessment framework for data science learning in the context of community engagement with civic open data. Researchers will also begin to identify barriers to broader participation through literature synthesis, interviews with participants and facilitators, and conversations with other organizations in our networks, such as NYC Community Boards. Findings will determine the suitability of the programs under study and inform future research to identify and amplify best practices in supporting public engagement with data.
This project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
According to the Gateway Belief Model, scientists and science educators should stress the scientific consensus when engaging with the lay population across a wide variety of mediums, including debates. The purpose of this study, then, was to determine if engaging in such debates does more harm than good in terms of persuading individuals towards accepting the scientific consensus of controversial issues. Participants (N = 208) read a manipulated debate segment altered by the issue discussed as well as the position/title of the skeptic debater. Results indicate that it is possible to influence
The Science Fairs Under the 'Scope Study's key findings are summarized here on the topics of:
Models And Elements Of Middle School Science Fairs
Science And Engineering Practices
Cost Of Science Fairs
Parent Involvement In Science Fairs
Science Interest And Identity.
We collected data from middle school science fairs held in schools across the country to understand:
What are the basic models and elements of middle school science fairs;
If and how science fairs increase students’ interest in science, technology, engineering or math (STEM) and/or STEM careers
If and how participation in select models of middle school science fairs enhance students’ mastery of the science and engineering practices; and
What costs and resources are required to implement an effective middle school science fair?
In this paper we share an emerging analytical approach to designing and studying STEAM programs that focuses on how programs integrate the respective epistemic practices—the ways in which knowledge is constructed—of science and art. We share the rationale for moving beyond surface features of STEAM programs (e.g., putting textiles and electronics on the same table) to the disciplinary-specific ways in which participants are engaged in creative inquiry and production. We share a brief example from a public STEAM event to demonstrate the ways in which this approach can foster reflection and
The goal of our research is to identify strengths and weaknesses of high school level science fair and improvements that might enhance learning outcomes based on empirical assessment of student experiences. We use the web-based data collection program REDCap to implement anonymous and voluntary surveys about science fair experiences with two independent groups -- high school students who recently competed in the Dallas Regional Science and Engineering Fair and post high school students (undergraduates, 1st year medical students, and 1st year biomedical graduate students) on STEM education