This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
We examined an approach to reaching audiences who may not ordinarily engage with science. Termed Guerilla Science, this approach blends elements of access, by removing barriers to participation by embedding science into unexpected places, with those of inclusion, by designing activities that speak to the learning identities of participants.
The National Academy of Sciences’ LabX program came into existence in 2017 with a directive to develop programming meant to engage with a young-adult (18-37 years old) target audience who are active decision-makers and whose actions impact current and future policies. While conducting preliminary research, the LabX staff and advisory board discovered that available research on young adults’ relationship with science was sadly lacking in detail, beyond obvious conclusions about high levels of interest in technology and social experiences.
To fill these knowledge gaps, gain a deeper
This evaluation brief summarizes the kinds of formative feedback and resources that Rockman et al evaluators provided to inform content and marketing of two science cafés, and support the construction, refinement, and dissemination of a questionnaire about café participants understanding of Science Technology and Society (STS). REA staff members served as educational assessment consultants who worked with the project team to (a) qualitatively assess the validity of and refine the constructs for the science café assessment tool; and (b) construct and refine the summative assessment
This is the protocol for a research project to assess the wants and needs of adults in underserved STEM learning communities -- in our case, the Richmond, VA African American community -- towards the goal of using a community-university partnership to staging STS science cafes that respond to these wants and needs.
This assessment is based on the three vertices of a triangle composed of cognition, observation, and interpretation, all of which converge on the nature of science, the relevance of science to everyday life, and decision-making behaviors.
We chose one measure from Conley, Pintrich, Vekiri, & Harrison (2004). This measure encompasses four dimensions about scientific knowledge -- source, certainty, development and justification -- so we thought it might reveal interesting dimensions of stasis and change in attitudes toward science from formal school environments to informal adult learning
In partnership with the Digital NEST, students engage in near to peer learning with a technical tool for the benefit of a nonprofit that tackles issues the youth are passionate about. Youth build first from an 'internal’ Impactathon, to planning and developing an additional Impactathon for a local partner and then traveling to another partner elsewhere in the state. Participants range from 14 to 24 from UC Santa Cruz students to middle schoolers from Watsonville and Salinas.
This poster was presented at the 2019 AISL Principal Investigators Meeting.
This pilot study will examine the effectiveness of an innovative applied social change, community and technology based program on marginalized youths' access, interest, efficacy and motivation to learn and engage in digital technology applications. Using stratified near-peer and peer-to-peer mentoring approaches, the pilot builds on extant literature that indicates that peer-supported hands-on mentoring and experiences can alleviate some barriers to youth engagement in digital technologies, particularly among underrepresented groups. In this project, undergraduate students will mentor and work collaboratively with high school youth primarily of Hispanic descent and community-based organizations to develop creative technology-based solutions to address social issues and challenges within their local communities, culminating in events called Impactathons. These community-hosted local and state-wide events set this pilot project apart from similar work in the field. The Impactathons not only provide a space for intellectual discourse and problem-solving among the undergraduate-youth-community partners but the Impactathons will also codify expertise from scientists, social scientists, technologists, community leaders, and other stakeholders to develop technology-based solutions with real world application. If successful, a distal outcome will be increased youth interest in digital technologies and related fields. In the short term, favorable findings will provide preliminary evidence of success and lay the foundation for a more extensive study in the future.
This pilot project is a collaboration between the Everett Program, a student-led program for Technology and Social Change at the University of California Santa Cruz - a Hispanic Serving Institution - and the Digital NEST, a non-profit, high-tech youth career development and collaboration space for young people ages 14-24. Through this partnership and other recruitment efforts, an estimated 70-90 individuals will participate in the Impactathon pilot program over two years. Nearly two-thirds of the participants are expected to be undergraduate students. They will receive extensive training in near-peer and peer-to-peer mentoring and serve as mentors for and co-innovation developers with the high school youth participants. The undergraduates and youth will partner with local community organizations to identify a local social challenge that can be addressed through a technology-based solution. The emergent challenges will vary and could span the spectrum of STEM and applied social science topics of interest. Working in informal contexts (i.e., afterschool. weekend), the undergraduate-youth-community partner teams will work collaboratively to develop practical technology-based solutions to real world challenges. The teams will convene three times per year, locally and statewide, at student and community led Impactathons to share their work and glean insights from other teams to refine their innovations. In parallel, the research team will examine the effectiveness of the Impactathon model in increasing the undergraduate and youths' interest, motivation, excitement, engagement and learning of digital technologies. In addition to the research, the formative and summative evaluations should provide valuable insights on the effectiveness of the model and its potential for expansion and replication.
The project is co-funded by the Advancing Informal STEM Learning (AISL) Program and STEM +C. The AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. STEM + C focuses on research and development of interdisciplinary and transdisciplinary approaches to the integration of computing within STEM teaching and learning for preK-12 students in both formal and informal settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Adult education beyond K-12 and postsecondary levels is very important as this citizenry group is often the policy and decision makers in local communities, as well as for state and federal issues that impact the Nation. Moreover, they are responsible for advising their progeny on a myriad of choices. This project will plan, execute, and promote four annual public lecture events, working with a professional educational evaluation expert to develop an appropriate assessment tool for adult learners in the structured informal learning environment of a science café. These planned events will be used to test and refine an assessment tool for making this work widely available to the community of informal science practitioners and researchers. Further, this project is a pilot for epitomizing the use of science cafés to address the learning needs of unique citizens of Richmond, Virginia. The project is committed to including under-represented citizens including Veterans with disabilities. The evaluation and research efforts will validate the education mechanisms so science cafés can be more effective in the future. As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings.
This project is a collaboration that includes Virginia Commonwealth University (VCU), Rockman et al (an evaluation firm), Science Pub RVA (Science Pub RVA is a long-running and award-nominated Richmond, VA science café), Carver Community Partnership, East District Family Resource Center, VCU Partnership for People with Disabilities, VCU Department of Rehabilitation Counseling, VCU Medical Center, and a variety of other VCU departments. The investigators will conduct a series of science cafés to determine motivation, interests, and best practices for educating the diverse citizens of Richmond, Virginia. The objective of the research is to rigorously analyze the characteristics of participants and cohesively determine the best practices for the effective learning for each person. Further, rigorous evaluation will determine validity of the best and most effective learning practices enabling the project to derive an adaptable model. The investigators' hypothesis is that the participant's knowledge base is derived from the traditional learning which occurred in the K-12 classroom. Thus, in this work, the investigators hope to add to the participant's knowledge base with STS (Science, Technology, and Society) content and enhance the depth and breadth of knowledge and knowledge acquisition. The research scope will embrace an assessment that is based on the three vertices of a triangle composed of cognition, observation, and interpretation, all of which converge on the nature of science, the relevance of science to everyday life, and decision-making behaviors.
Previous studies on public engagement with science have identified various difficulties in the encounters between experts and lay people. However, there is a scarcity of research investigating expert-youth interaction. In this paper we focus on the interactive framings of an informal PES event. Based on a case study involving a climate change panel discussion and a simultaneous online chat, both aimed at young people, we discuss the multiplicity of framing. Further, we look for “misbehaviours” which challenge the rationality and norms of the event. Our findings indicate that the frame of
The National Science Festival Network project, also operating as the Science Festival Alliance, is designed to create a sustainable national network of science festivals that engages all facets of the general public in science learning. Science Festivals, clearly distinct from "science fairs", are community-wide activities engaging professional scientists and informal and K-12 educators targeting underrepresented segments of local communities historically underserved by formal or informal STEM educational activities. The initiative builds on previous work in other parts of the world (e.g. Europe, Australasia) and on recent efforts in the U.S. to create science festivals. The target audiences are families, children and youth ages 5-18, adults, professional scientists and educators in K-12 and informal science institutions, and underserved and underrepresented communities. Project partners include the MIT Museum in Cambridge, UC San Diego, UC San Francisco, and the Franklin Institute in Philadelphia. The deliverables include annual science festivals in these four cities supported by year-round related activities for K-12 and informal audiences, a partnership network, a web portal, and two national conferences. Ten science festivals will be convened in total over the 3 years of the project, each reaching 15,000 to 60,000 participants per year. STEM content includes earth and space science, oceanography, biological/biomedical science, bioinformatics, and computer, behavioral, aeronautical, nanotechnology, environmental, and nuclear science. An independent evaluator will systematically assess audience participation and perceptions, level/types of science interest stimulated in target groups, growth of partnering support at individual sites, and increasing interactions between ISE and formal K-12 education. A variety of qualitative and quantitative assessments will be designed and utilized. The project has the potential to transform public communication and understanding of science and increase the numbers of youth interested in pursuing science.
DATE:
-
TEAM MEMBERS:
Loren ThompsonJeremy BabendureBen Wiehe