This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
This is an overview of research to measure STEM Engagement and Advocacy of Older Adults (50+). This work explored findings from Design Challenges hosted for older adult learners and also resulted in survey instruments to be used for this population. It also outlines constructs that were developed to inform the research.
We examined an approach to reaching audiences who may not ordinarily engage with science. Termed Guerilla Science, this approach blends elements of access, by removing barriers to participation by embedding science into unexpected places, with those of inclusion, by designing activities that speak to the learning identities of participants.
This document is the final evaluation report for the Teen Science Cafes for Advancing STEM in Rural Places project.
A Teen Science Café is a free, regularly occurring event during the school year in which a local scientist, engineer, or STEM expert discusses their field experiences with the teen attendees. Ideally, a Teen Leader cohort, under the mentorship of an Adult Leader, organizes and implements each Café.
The Teen Science Café Network is a community of practice linking the various youth-serving organizations, institutions, community settings, and individuals that host Teen Science
This evaluation brief summarizes the kinds of formative feedback and resources that Rockman et al evaluators provided to inform content and marketing of two science cafés, and support the construction, refinement, and dissemination of a questionnaire about café participants understanding of Science Technology and Society (STS). REA staff members served as educational assessment consultants who worked with the project team to (a) qualitatively assess the validity of and refine the constructs for the science café assessment tool; and (b) construct and refine the summative assessment
This is the protocol for a research project to assess the wants and needs of adults in underserved STEM learning communities -- in our case, the Richmond, VA African American community -- towards the goal of using a community-university partnership to staging STS science cafes that respond to these wants and needs.
This assessment is based on the three vertices of a triangle composed of cognition, observation, and interpretation, all of which converge on the nature of science, the relevance of science to everyday life, and decision-making behaviors.
We chose one measure from Conley, Pintrich, Vekiri, & Harrison (2004). This measure encompasses four dimensions about scientific knowledge -- source, certainty, development and justification -- so we thought it might reveal interesting dimensions of stasis and change in attitudes toward science from formal school environments to informal adult learning
In partnership with the Digital NEST, students engage in near to peer learning with a technical tool for the benefit of a nonprofit that tackles issues the youth are passionate about. Youth build first from an 'internal’ Impactathon, to planning and developing an additional Impactathon for a local partner and then traveling to another partner elsewhere in the state. Participants range from 14 to 24 from UC Santa Cruz students to middle schoolers from Watsonville and Salinas.
This poster was presented at the 2019 AISL Principal Investigators Meeting.
This pilot study will examine the effectiveness of an innovative applied social change, community and technology based program on marginalized youths' access, interest, efficacy and motivation to learn and engage in digital technology applications. Using stratified near-peer and peer-to-peer mentoring approaches, the pilot builds on extant literature that indicates that peer-supported hands-on mentoring and experiences can alleviate some barriers to youth engagement in digital technologies, particularly among underrepresented groups. In this project, undergraduate students will mentor and work collaboratively with high school youth primarily of Hispanic descent and community-based organizations to develop creative technology-based solutions to address social issues and challenges within their local communities, culminating in events called Impactathons. These community-hosted local and state-wide events set this pilot project apart from similar work in the field. The Impactathons not only provide a space for intellectual discourse and problem-solving among the undergraduate-youth-community partners but the Impactathons will also codify expertise from scientists, social scientists, technologists, community leaders, and other stakeholders to develop technology-based solutions with real world application. If successful, a distal outcome will be increased youth interest in digital technologies and related fields. In the short term, favorable findings will provide preliminary evidence of success and lay the foundation for a more extensive study in the future.
This pilot project is a collaboration between the Everett Program, a student-led program for Technology and Social Change at the University of California Santa Cruz - a Hispanic Serving Institution - and the Digital NEST, a non-profit, high-tech youth career development and collaboration space for young people ages 14-24. Through this partnership and other recruitment efforts, an estimated 70-90 individuals will participate in the Impactathon pilot program over two years. Nearly two-thirds of the participants are expected to be undergraduate students. They will receive extensive training in near-peer and peer-to-peer mentoring and serve as mentors for and co-innovation developers with the high school youth participants. The undergraduates and youth will partner with local community organizations to identify a local social challenge that can be addressed through a technology-based solution. The emergent challenges will vary and could span the spectrum of STEM and applied social science topics of interest. Working in informal contexts (i.e., afterschool. weekend), the undergraduate-youth-community partner teams will work collaboratively to develop practical technology-based solutions to real world challenges. The teams will convene three times per year, locally and statewide, at student and community led Impactathons to share their work and glean insights from other teams to refine their innovations. In parallel, the research team will examine the effectiveness of the Impactathon model in increasing the undergraduate and youths' interest, motivation, excitement, engagement and learning of digital technologies. In addition to the research, the formative and summative evaluations should provide valuable insights on the effectiveness of the model and its potential for expansion and replication.
The project is co-funded by the Advancing Informal STEM Learning (AISL) Program and STEM +C. The AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. STEM + C focuses on research and development of interdisciplinary and transdisciplinary approaches to the integration of computing within STEM teaching and learning for preK-12 students in both formal and informal settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Summative evaluation of the Marcellus Matters: EASE project. Marcellus Matters: Engaging Adults in Science and Energy (EASE) was a program of Penn State University’s Marcellus Center for Outreach and Research (MCOR), in collaboration with other experts across the university. The first year of program activities took place in 2012, and the project continued through September 2016. EASE was a multidisciplinary initiative that provided adults in rural Pennsylvania with opportunities to increase their knowledge of science and energy systems and engage in scientific inquiry and investigation