Summative evaluation of the Marcellus Matters: EASE project. Marcellus Matters: Engaging Adults in Science and Energy (EASE) was a program of Penn State University’s Marcellus Center for Outreach and Research (MCOR), in collaboration with other experts across the university. The first year of program activities took place in 2012, and the project continued through September 2016. EASE was a multidisciplinary initiative that provided adults in rural Pennsylvania with opportunities to increase their knowledge of science and energy systems and engage in scientific inquiry and investigation
RMC Research designed evaluation activities to provide formative and summative feedback to the Hubbard Brook Research Foundation (HBRF) on their NSF Pathways project, Forest Science Dialogues (FSD). FSD consists of a plan to engage with scientists at the Hubbard Brook Ecosystem Study and with the surrounding community using the Hubbard Brook Roundtable dialogue process in order to facilitate mutual learning. The purpose of this engagement was to increase public knowledge, understanding, and awareness of ecosystem science in the Northern Forest in order to enrich local dialogue surrounding
Designing Our World (DOW) was a four-year NSF-funded initiative in which the Oregon Museum of Science and Industry (OMSI) sought to promote girls’ pursuit of engineering careers through community-based programming, exhibition development, and identity research. The overarching aim of DOW was to engage girls ages 9–14 with experiences that illuminate the social, personally relevant, and altruistic nature of engineering. In addition to programming for girls, the project also included workshops for parents/caregivers, professional development for staff from community partners; and an exhibition
MobiLLab is a mobile science education program designed to awaken young people’s interest in science and technology (S&T). Perceived novelty, or unfamiliarity, has been shown to affect pupils’ educational outcomes at similar out-of-school learning places (OSLePs) such as museums and science centers. A study involved 215 mobiLLab pupils who responded to three surveys: a pre-preparation, at-visit, and post-visit survey. Results provide evidence for four dimensions of pupils’ at-visit novelty: curiosity, exploratory behavior, oriented feeling, and cognitive load. Findings also show that classroom
In March of 2016, the Exploratorium transmitted a live webcast of a total solar eclipse from Woleai, a remote island in the southwestern Pacific. The webcast reached over 1 million viewers. Evaluation reveals effective use of digital media to engage learners in solar science and related STEM content.
Edu, Inc. conducted an external evaluation study that shows clear and consistent evidence of broad distribution of STEM content through multiple online channels, social media, pre-produced videos, and an app for mobile devices. IBM Watson did a deep analysis of tweets on eclipse topics that
“The Roads Taken” virtual conference was part of a three-phase research project designed to explore the very long-term impact of STEM youth programs (such as the iconic YouthALIVE program). In this first phase, a virtual conference was held to engage youth program practitioners in the development and testing of a Program Profile prototype, a structured document that helps institutions to characterize their own youth programs in useful ways.
Following the webinars and the completion of the Program Profile by each organization, participants were asked to complete a brief survey (included as
This report details the formative evaluation study conducted through collaboration with the National Science Teachers Association (NSTA) and the Association of Science-Technology Centers (ASTC) to inform the iterative development and piloting of the Connected Science Learning: Connecting In-School and Out-of-School STEM Learning journal. The journal was the result of an Early Concept Grant for Exploratory Research (EAGER) project funded by the National Science Foundation (NSF) to develop, disseminate and evaluate a new resource for connecting STEM education practitioners across settings and to
As part of the development work of Latina SciGirls, the independent evaluation firm Knight Williams Inc. conducted a front-end evaluation focused on gathering input from the project’s primary public audiences (Latina girls and their parents/guardians) and professional audiences (the project’s advisers and partners). A total of 86 participants representing these diverse audience perspectives were asked to review an episode of the SciGirls program Hábitat en Caos/Habitat Havoc and two role model scientist profile videos featuring Karin Block and Victoria Velez. Scheduled early in Year 1 of the
As part of the development work of Latina SciGirls, the independent evaluation firm Knight Williams Inc. conducted a front-end evaluation focused on gathering input from the project’s primary public audiences (Latina girls and their parents/guardians) and professional audiences (the project’s advisers and partners).
Appendix includes logic model.
The National Museum of the American Indian, NY (NMAI-NY) contracted RK&A to conduct a two-phase formative evaluation of the museum’s upcoming Native New York exhibition. The study’s objectives for walk-in visitors and teachers were to understand their baseline knowledge, what piques their interest, potential barriers (confusion or misunderstanding), strategies to help make personal connections, and how/if they understand exhibition outcomes (such as appreciate who Native Americans are today and understand that Native peoples have powerfully shaped and defined New York’s geography, economy, and
To explore the role and impact of The Innovation Lab at Youth Radio, Rockman et al, an independent research and evaluation organization, conducted an external evaluation of the project. With funding from the National Science Foundation’s Advancing Informal STEM Learning (AISL) program, the Innovation Lab sought to develop and research a scalable, evidence-informed theory of action to engage underrepresented youth in Science, Technology, Engineering, and Mathematics (STEM) learning through the collaborative creation and dissemination of original journalistic media, technology, and curriculum
From October 2015 to July 2016, Smart Start Evaluation & Research conducted a formative evaluation of a full-length film festival cut of the film The Anthropologist in order to provide feedback that improves decision-making capacity for the film’s final edit, production design, and distribution strategies in line with the project’s goals (see p. 5).
SmartStart conducted focus group interviews with participants to 1) measure their initial impressions of the film and its content, and 2) provide feedback on content, edits, target audience, website, and ideas for distribution. SmartStart then