This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
This is an overview of research to measure STEM Engagement and Advocacy of Older Adults (50+). This work explored findings from Design Challenges hosted for older adult learners and also resulted in survey instruments to be used for this population. It also outlines constructs that were developed to inform the research.
DATE:
TEAM MEMBERS:
Sarah Olsen
resourceevaluationMuseum and Science Center Exhibits
The Kaulele Kapa Exhibit was created to explore the effectiveness of a Hawaiian culture-based framework and approach in increasing learner engagement and depth of knowledge in STEM among Native Hawaiian/Pacific Islander (NHPI) learners. The exhibit utilized hands-on and interactive activities, coupled with scientific and cultural information, to create relevant learning experiences for these communities. To determine the effectiveness, exhibit attendees were invited to complete a survey that asked about how the exhibit influenced their interest and understanding of STEM and Hawaiian culture
In this study we test a “Guerilla Science” approach that blends elements of access, by removing barriers to participation, with those of inclusion, by designing participant-centered activities, for reaching an art-interested adult audience at the FIGMENT art festival in New York City.
We examined an approach to reaching audiences who may not ordinarily engage with science. Termed Guerilla Science, this approach blends elements of access, by removing barriers to participation by embedding science into unexpected places, with those of inclusion, by designing activities that speak to the learning identities of participants.
This document is the final evaluation report for the Teen Science Cafes for Advancing STEM in Rural Places project.
A Teen Science Café is a free, regularly occurring event during the school year in which a local scientist, engineer, or STEM expert discusses their field experiences with the teen attendees. Ideally, a Teen Leader cohort, under the mentorship of an Adult Leader, organizes and implements each Café.
The Teen Science Café Network is a community of practice linking the various youth-serving organizations, institutions, community settings, and individuals that host Teen Science
This paper is the culmination of several meaning-making activities between an external researcher, PES practitioners, and social scientist researchers who considered the unique contributions that can be made through RPPs on PES (that is, research-practice partnerships on public engagement with science). Based on the experiences from three RPP projects, the group noted that the PES context may be particularly suited to RPPs, and identified the importance of working as thinking-partners who support reciprocal decision-making. Recommendations are made in support of using these approaches to
This poster was presented at the 2021 NSF AISL Awardee Meeting.
The Rural Activation and Innovation Network (RAIN) project aims to engage, support and better understand rural communities in:
Changing perceptions of the importance of STEM Learning
Leveraging of local STEM resources and expertise with Rural Innovation Councils (RICs)
Strategic Planning embedding asset maps, gap analysis, budget, media, and communication.
This poster was presented at the 2021 NSF AISL Awardee Meeting. The Guerilla Science project conducted two studies: one at the Oregon Eclipse Festival, a large multi-day residential music and arts festival, and one during the Figment festival, a cultural and family-oriented free festival on Governor’sIsland (NewYorkCity). We used a multi-method research design: trained data collectors conducted intercept interviews of various length; short written feedback forms were made available post events; and we conducted structured observations of events.We compared Guerilla Science audiences with
But many young people face signifcant economic, cultural, historical, and/or social obstacles that distance them from STEM as a meaningful or viable option— these range from under-resourced schools, race- and gender-based discrimination, to the dominant cultural norms of STEM professions or the historical uses of STEM to oppress or disadvantage socio-economically marginalized communities (Philip and Azevedo 2017). As a result, participation in STEM-organized hobby groups, academic programs, and professions remains low among many racial, ethnic, and gender groups (Dawson 2017). One solution to
This AISL Pilots and Feasibility project will study the data science learning that takes place as members of the public explore and analyze open civic data related to their everyday lives. Government services, such as education, transportation, and non-emergency municipal requests, are becoming increasingly digital. Generally, program workshops and events may be able to support participants in using such data to answer their own questions, such as: "How do City agencies respond to noise in my neighborhood?" and "How do waste and recycling services in my neighborhood compare with others?" This project seeks to understanding how such programs are designed and facilitated to support diverse communities in accessing and meaningfully analyzing data will promote innovation and knowledge building in informal data science education. The team will begin by summarizing best practices in data science education from a variety of fields. Next they will explore the design and impacts of two programs in New York City, a leader in publicly available Open Data initiatives. This phase will explore activities and facilitation approaches, participants' objectives and data literacy skills practice, and begin to identify potential barriers to entry and levels of participation. Finally, the team will build capacity for other similar organizations to explore and understand their impacts on community members' engagement with civic data. This pilot study will establish preliminary evidence of the effectiveness of these programs, and in turn, inform future research into the identifying and amplifying best practices to support public engagement with data.
This research team will begin by synthesizing data science learning best practices based on varied literatures and surveys with academic and practitioner experts.
Synthesis results will be applied as a lens to gather preliminary evidence regarding the impacts of two programs on participants' data science practices and understanding of the nature of data in the context of civics. The programs include one offered by the Mayor's Office of Data Analytics (MODA), which is the NYC agency with overall responsibility for the City's Open Data programs, and BetaNYC, a leading nonprofit organization working to improve lives through civic design, technology, and engagement with government open data. The research design triangulates ethnographic observations and artifacts, pre and post adapted surveys, and interviews with participants and facilitators. Researchers will identify programmatic metrics and adapts existing measures to assess various outcomes related to public engagement with data, including: question formulation, data set selection and manipulation, the use of data to make inferences, and understanding variability, sampling and context. These metrics will be shared through an initial assessment framework for data science learning in the context of community engagement with civic open data. Researchers will also begin to identify barriers to broader participation through literature synthesis, interviews with participants and facilitators, and conversations with other organizations in our networks, such as NYC Community Boards. Findings will determine the suitability of the programs under study and inform future research to identify and amplify best practices in supporting public engagement with data.
This project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.