This document provides information about the quantitative and qualitative data collected and analyzed for this project with hopes that it informs future research and evaluation efforts for STEM education in rural contexts.
NSF generously funded the Science Museum of Minnesota's exploration of whether or not the "theatrical gaming" technique could improve visitors' understanding of complex topics requiring conceptual shifts--topics like evolution. COVID disrupted our formal evaluation plans, but this report offers finding and guidance/best practices for other informal education institutions interested in developing this type of experience. Individual sections discuss our particular, three-phased project, theatrical gaming as a technique, storytelling, gaming, technology, and evaluation.
This evaluation report provides a brief review of the National Science Foundation (NSF) planning grant, Creating an Early Childhood STEM Ecosystem, as of August 2019. The purpose of the evaluation was to provide an external, independent overview of the work completed and some of the lessons learned to date.
This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
This is a survey we developed in 2018 for our exploratory research study of listeners and their parents/guardians of the children's science podcast, Brains On!. The survey includes questions about who listens, when and where children listen, children's listening behaviors, motivations for listening, activities after listening, household information, and demographic questions.
This document describes the summative project evaluation of 5 annual cohorts of STE(A)M teachers, mostly from California, Florida, and New Mexico participating in out-of-school authentic research experiences collecting fossils and learning about geology, biology, and the natural history along the Panama Canal, and their experiences with museums and research collections. The STEM content of this project is based on the Great American Biotic Interchange (GABI) of animals and plants across the Isthmus of Panama over the past 5 million years. This report also describes the efficacy of sustained
The Brains On! exploratory research study was guided by three overarching research questions:
Who is the audience for Brains On! and what are their motivations for listening to children’s science podcasts?
How are Brains On! listeners using the podcast and engaging with its content?
What kinds of impacts does Brains On! have on its audiences?
These questions were answered through a three-phase mixed-methods research design. Each phase informed the next, providing additional insights into answering the research questions. Phase 1 was a review of a sample of secondary data in the
Through Project BUILD, a STAR Library Network (STAR Net) program funded by the National Science Foundation, the American Society of Civil Engineers (ASCE) and the Space Science Institute’s National Center for Interactive Learning (NCIL) offered the virtual Dream, Build, Create program which consisted of (1) the award-winning documentary Dream Big: Engineering Our World and (2) five live-streamed panels of diverse engineers (Dream Teams) who shared their stories of what it means to be an engineer.
The external evaluation, conducted by Education Development Center (EDC), aimed to examine how
The Practitioners and Researchers Investigating Sensorimotor Movement (PRISM) Toolkit provides a suite of observation tools for identifying and categorizing gestures, movement, and speech for interactive museum exhibits (espeically those that involve full-body interactions). The tools can be used live in some settings when appropriate, but also can be used on video recordings of exhibit interactions.
Informal learning institutions, such as museums, science centers, and community-based organizations, play a critical role in providing opportunities for students to engage in science, technology, engineering, and mathematics (STEM) activities during out-of-school time hours. In recent years, thousands of studies, evaluations, and conference proceedings have been published measuring the impact that these programs have had on their participants. However, because studies of informal science education (ISE) programs vary considerably in how they are designed and in the quality of their designs, it
This paper discusses findings from the use of the Wise Guys and Gals (WGG) Observation of WGG Youth Protocol in a blended learning environment. The protocol was used to assess youth engagement when completing blended engineering design challenges at two Boys and Girls Clubs. WGG is a project funded through a grant from the National Science Foundation and which brings blended learning design challenges to middle school aged learners in informal STEM (science, technology, engineering, and mathematics) settings. This paper explores the feasibility of using the observation protocol to collect data
This document is the final summative evaluation report written by EDC, the external evaluator of the STEM Guides project. The report concludes that the project was highly ambitious, with many dynamic and evolving pieces. It was deemed successful as a model of brokering connections between students aged 10-18 and STEM resources and opportunities in rural Maine communities. The STEM Guides program contributed to the increase in STEM awareness within each community, as well as connecting youth with interesting and relevant STEM experiences.