This evaluation report highlights findings from the evaluation of the Center for the Advancement of Informal Science Education’s first five years of funding. CAISE, funded through a cooperative agreement with NSF, in its first five years, was a partnership between The Association of Science-Technology Centers, the Institute for Learning Innovation, University of Pittsburgh Center for Learning in Out-of-School Environments, the Visitor Studies Association and other collaborators, who stewarded the development of an Informal Science Education (ISE) resource center to support ongoing improvement
This evaluation report provides a brief review of the National Science Foundation (NSF) planning grant, Creating an Early Childhood STEM Ecosystem, as of August 2019. The purpose of the evaluation was to provide an external, independent overview of the work completed and some of the lessons learned to date.
As several recent National Academies of Sciences reports have highlighted, greater science communication research is needed on 1) communicating chemistry, and 2) building research-practice partnerships to advance communication across science issues. Here we report our insights in both areas, gathered from a multi-year collaboration to advance our understanding of how to communicate about chemistry with the public. Researchers and practitioners from science museums across the U.S. partnered with academic social scientists in science communication to develop and conduct multi-strand data
Chemistry is a vital and highly relevant field of science that is under-represented in science centers and museums. Amidst concerns that the public is ambivalent about the chemistry field, the Explore Science: Let's Do Chemistry project sought to understand how to design hands-on activities that could increase the feelings of interest, relevance, and self-efficacy around chemistry. Using design-based research, the team tested and refined a variety of activities while simultaneously creating a framework for future use about content and format strategies that increase interest, relevance, and
ChemAttitudes: Using Design-Based Research to Develop and Disseminate Strategies and Materials to Support Chemistry Interest, Relevance, and Self-Efficacy (ChemAttitudes, NSF DRL-1612482) is a collaborative project between the Museum of Science, Boston (MOS), the National Informal STEM Education Network (NISE Net), and the American Chemical Society (ACS) among others. As a part of this project, researchers and educators from MOS and the Science Museum of Minnesota (SMM) used design-based research to create chemistry hands-on activities meant to positively impact visitors’ attitudes towards
This poster was presented at the 2021 NSF AISL Awardee Meeting.
The Rural Activation and Innovation Network (RAIN) project aims to engage, support and better understand rural communities in:
Changing perceptions of the importance of STEM Learning
Leveraging of local STEM resources and expertise with Rural Innovation Councils (RICs)
Strategic Planning embedding asset maps, gap analysis, budget, media, and communication.
This report presents summative evaluation results for a National Science Foundation funded project entitled Grounding Institutional Partnerships in Structures for Broader Impacts Design (BID). The project represents a collaboration between five institutions: Institute for Learning Innovation, The STEM Research Center at Oregon State University, Scicenter, University of Washington-Bothell, and University of Wisconsin-Madison. BID aimed at creating an inter-institutional structure and toolkit to assist higher education institutions (HEIs) and informal science education organizations (ISEs) in
This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.
BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.
A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.
This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This guide compiles lessons learned by seven Portal to the Public Network (PoPNet) sites as well as remaining challenges and recommendations for organizations planning similar efforts in the future. PoPNet sites used the Portal to the Public Guiding Framework to build relationships with local scientists, prepare them for public engagement using Portal to the Public training materials, and feature them at public programs.