This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
The Kaulele Kapa Exhibit was created to explore the effectiveness of a Hawaiian culture-based framework and approach in increasing learner engagement and depth of knowledge in STEM among Native Hawaiian/Pacific Islander (NHPI) learners. The exhibit utilized hands-on and interactive activities, coupled with scientific and cultural information, to create relevant learning experiences for these communities. To determine the effectiveness, exhibit attendees were invited to complete a survey that asked about how the exhibit influenced their interest and understanding of STEM and Hawaiian culture
We examined an approach to reaching audiences who may not ordinarily engage with science. Termed Guerilla Science, this approach blends elements of access, by removing barriers to participation by embedding science into unexpected places, with those of inclusion, by designing activities that speak to the learning identities of participants.
When NSTA first adopted guidelines for science competitions in 1999, two of the important questions addressed were whether competitions should be voluntary or required, and whether the emphasis should be on the learning experience or the competition. Our recent research concerning students’ high school science fair experiences has important implications for both of these questions.
Several years ago, we began a systematic and ongoing study of high school science fairs using anonymous voluntary surveys that included a combination of quantitative and qualitative (open-ended text) questions
Science fairs have a remarkable hold on the public’s attention. President Obama, in his 2011 State of the Union address, said, “We need to teach our kids that it’s not just the winner of the Super Bowl who deserves to be celebrated, but the winner of the science fair.” The 2018 film Science Fair won that year’s Sundance Film Festival favorite award. The 2018 book The Class chronicled a year in a classroom where science fairs are at the center of science education. And a recent GEICO “Science Fair of the Future” television commercial had more than 11 million views on YouTube in its first month
Science fairs offer potential opportunities for students to learn first-hand about the practices of science. Over the past six years we have been carrying out voluntary and anonymous surveys with regional and national groups of high school and post high school students to learn about their high school science fair experiences regarding help received, obstacles encountered, and opinions about the value and impact of science fair. Understanding what students think about science fairs will help educators make science fairs more effective learning opportunities. In this paper, we focus on the
The goal of our ongoing research is to identify strengths and weaknesses of high school level science fair and improvements that can help science educators make science fair a more effective, inclusive and equitable learning experience. In this paper, we confirm and extend our previous findings in several important ways. We added new questions to our anonymous and voluntary surveys to learn the extent to which students had an interest in science or engineering careers and if science fair participation increased their interest in science or engineering. And we surveyed a national rather than
This paper is the culmination of several meaning-making activities between an external researcher, PES practitioners, and social scientist researchers who considered the unique contributions that can be made through RPPs on PES (that is, research-practice partnerships on public engagement with science). Based on the experiences from three RPP projects, the group noted that the PES context may be particularly suited to RPPs, and identified the importance of working as thinking-partners who support reciprocal decision-making. Recommendations are made in support of using these approaches to
But many young people face signifcant economic, cultural, historical, and/or social obstacles that distance them from STEM as a meaningful or viable option— these range from under-resourced schools, race- and gender-based discrimination, to the dominant cultural norms of STEM professions or the historical uses of STEM to oppress or disadvantage socio-economically marginalized communities (Philip and Azevedo 2017). As a result, participation in STEM-organized hobby groups, academic programs, and professions remains low among many racial, ethnic, and gender groups (Dawson 2017). One solution to
This AISL Pilots and Feasibility project will study the data science learning that takes place as members of the public explore and analyze open civic data related to their everyday lives. Government services, such as education, transportation, and non-emergency municipal requests, are becoming increasingly digital. Generally, program workshops and events may be able to support participants in using such data to answer their own questions, such as: "How do City agencies respond to noise in my neighborhood?" and "How do waste and recycling services in my neighborhood compare with others?" This project seeks to understanding how such programs are designed and facilitated to support diverse communities in accessing and meaningfully analyzing data will promote innovation and knowledge building in informal data science education. The team will begin by summarizing best practices in data science education from a variety of fields. Next they will explore the design and impacts of two programs in New York City, a leader in publicly available Open Data initiatives. This phase will explore activities and facilitation approaches, participants' objectives and data literacy skills practice, and begin to identify potential barriers to entry and levels of participation. Finally, the team will build capacity for other similar organizations to explore and understand their impacts on community members' engagement with civic data. This pilot study will establish preliminary evidence of the effectiveness of these programs, and in turn, inform future research into the identifying and amplifying best practices to support public engagement with data.
This research team will begin by synthesizing data science learning best practices based on varied literatures and surveys with academic and practitioner experts.
Synthesis results will be applied as a lens to gather preliminary evidence regarding the impacts of two programs on participants' data science practices and understanding of the nature of data in the context of civics. The programs include one offered by the Mayor's Office of Data Analytics (MODA), which is the NYC agency with overall responsibility for the City's Open Data programs, and BetaNYC, a leading nonprofit organization working to improve lives through civic design, technology, and engagement with government open data. The research design triangulates ethnographic observations and artifacts, pre and post adapted surveys, and interviews with participants and facilitators. Researchers will identify programmatic metrics and adapts existing measures to assess various outcomes related to public engagement with data, including: question formulation, data set selection and manipulation, the use of data to make inferences, and understanding variability, sampling and context. These metrics will be shared through an initial assessment framework for data science learning in the context of community engagement with civic open data. Researchers will also begin to identify barriers to broader participation through literature synthesis, interviews with participants and facilitators, and conversations with other organizations in our networks, such as NYC Community Boards. Findings will determine the suitability of the programs under study and inform future research to identify and amplify best practices in supporting public engagement with data.
This project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
According to the Gateway Belief Model, scientists and science educators should stress the scientific consensus when engaging with the lay population across a wide variety of mediums, including debates. The purpose of this study, then, was to determine if engaging in such debates does more harm than good in terms of persuading individuals towards accepting the scientific consensus of controversial issues. Participants (N = 208) read a manipulated debate segment altered by the issue discussed as well as the position/title of the skeptic debater. Results indicate that it is possible to influence