This study collected data from seven planetarium email lists (one per planetarium regional organization in the United States), as well as online survey panel data from residents in each area, to describe and compare those who do and do not visit planetariums.
Through desk-based research and expert interviews, this study set out to investigate how funders and policy makers could drive coordination and improvements in the evaluation of youth engagement with STEM. The study explored the current landscape of evaluating youth engagement with STEM, gaps and challenges and key learnings from the evaluation practice in other sectors and key initiatives. Between February and March 2022, 18 project and programme evaluation reports and papers were reviewed, approximately 40 academic papers were analysed and synthesised, and 14 experts were interviewed.
This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
The COVID-19 pandemic tested many fundamental connections between science and society. A growing field working to strengthen those connections exists within the informal STEM learning (ISL) community which provides diverse learning and engagement environments outside the formal classroom. One of the largest funders of ISL initiatives is the National Science Foundation (NSF) which runs the Advanced Informal STEM Learning (AISL) program in the United States. The AISL program supports initiatives through six categories that include pilots and feasibility studies, research in service to practice
Background: Capturing measures of students’ attitudes toward science has long been a focus within the field of science education. The resulting interest has led to the development of many instruments over the years. There is considerable disagreement about how attitudes should be measured, and especially whether students’ attitudes toward science can or should be measured unidimensionally, or whether separate attitude dimensions or subscales should be considered. When it is agreed upon that the attitudes toward science construct should be measured along separate subscales, there is no
The Aldrich Contemporary Art Museum will amplify its partnership with Hart Magnet School, a Title 1 elementary school in urban Stamford, Connecticut, by increasing exposure and access to the arts for first-fifth graders, their families, and educators. A new program model, leveraging the museum's artist exhibitions, will focus on technology and an inquiry-based approach to science. Students, educators, and families will be encouraged to see and think in new ways through on-site STEAM tours at the museum, artist-led workshops at Hart, teacher professional development, and afterschool family activities. Outside evaluators will work with the project team to develop goals and associated metrics to measure how the model of museum-school partnership can enhance student achievement, engage families more deeply in their child's school experience and community, and contribute to teacher professional development. The evaluator will also train museum staff on best practices for program assessment.
The Bay Area Discovery Museum will address the need for STEM education by delivering engineering outreach programming to schools and libraries throughout the San Francisco Bay Area. The museum's mobile engineering lab, Try It Truck, will introduce the engineering design process to students and teachers in grades K-5 with hands-on activities (both on and off the truck) where they can collaborate, experiment, and design solutions to engineering challenges. The Try It Truck will serve 21,600 children, parents, and educators throughout the Bay Area, with at least 50 percent of all participants coming from underserved communities and Title I schools. The museum will work with an external evaluator to design survey instruments for both formative and summative evaluation, analyze summative evaluation data, and produce a report. Museum staff will share project results with colleagues at national and statewide conferences.
The Children's Museum of the Upstate will expand its STEAM outreach programming to benefit both teachers and students in the Greenville County Schools. The museum will serve 2,000 students through STEAM programs held on-site at their elementary schools, with a focus on curriculum areas where standardized test scores indicate that students are struggling. A new program for preschoolers will be piloted in the school district's six child development centers. The pre-school classes will visit the museum for a field trip that includes free exploration time and a tailored storytime lesson. The museum will also present four teacher workshops reaching 400 educators to assist them in teaching STEAM topics. An independent evaluator will conduct an evaluation of the outreach programming and develop assessment tools to help determine how the curriculum can support student achievement and result in improved standardized test scores.
The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
Presentation slides and narration for the NARST 2022 Annual Conference. In this presentation we summarize findings from our interviewed with undergraduate STEM majors who identify as Latine, homing in on the ways in which they characterize "STEM" and "STEM people" and their descriptions of K-12 experiences that contributed to their characterizations of these concepts.
From 2019 to 2021, Knology undertook a project called Addressing Societal Challenges through STEM, which investigated how informal learning institutions are advancing the use of STEM knowledge and scientific reasoning to enable individuals, families, and communities to understand what they can do, and apply their learning to solving critical societal challenges.
The literature reviewed (237 studies and articles) documented an emerging infrastructure to support the capacity of ISL institutions to address social issues. This infrastructure includes a body of empirical and peer-reviewed