The Pacific Science Center will develop new evaluation tools to assess the impact of Tinker Tank, a visitor-directed, hands-on design space in which participants are challenged to use their creativity, problem solving, and experience to understand the processes of design, engineering, and science. The project will allow the museum to determine which tools, adapted from both informal learning settings (such as timing and tracking studies, observations, surveys, and focus groups) and formal settings (such as design journals, digital portfolios, and badging),are most suitable for providing meaningful data about the learning and engagement occurring in its makerspace. By adjusting and refining the evaluation tools and methods, the museum will be able to measure learning in its makerspace, determine the extent to which it is achieving the goals and objectives of its Tinker Tank, and guide planning for expansion of making activities into different areas of its exhibition floor.
The Bay Area Discovery Museum will address the need for STEM education by delivering engineering outreach programming to schools and libraries throughout the San Francisco Bay Area. The museum's mobile engineering lab, Try It Truck, will introduce the engineering design process to students and teachers in grades K-5 with hands-on activities (both on and off the truck) where they can collaborate, experiment, and design solutions to engineering challenges. The Try It Truck will serve 21,600 children, parents, and educators throughout the Bay Area, with at least 50 percent of all participants coming from underserved communities and Title I schools. The museum will work with an external evaluator to design survey instruments for both formative and summative evaluation, analyze summative evaluation data, and produce a report. Museum staff will share project results with colleagues at national and statewide conferences.
The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
This book chapter, which describes emotional accessibility in digital learning experiences and its relation to Universal Design, was included in the book "Inclusive Digital Interactives: Best Practices + Research" published by the Smithsonian. This chapter includes a description of the Productive Struggle project, data highlights, and information on how attending to emotions can broaden our concepts of accessibility.
The Wayne State University Math Corps is a mathematics enrichment and mentoring program that operates during summers and on Saturdays. The curriculum and the pedagogies in this informal learning program have documented success of supporting youths' mathematics learning as well as raising achievement levels in school. Through rigorous research and evaluation, this project seeked to analyze and understand the nature, extent, and reasons for Math Corps' success with youth learning in Detroit as well as the processes of program replication in three sites: Cleveland, OH; Utica, NY; and Philadelphia
Future City, operating since 1992, is “a national, project-based learning experience where students in sixth, seventh, and eighth grade imagine, design, and build cities of the future. Students work as a team with an educator and engineer mentor to plan cities using SimCityTM software, research and write solutions to an engineering problem, build tabletop scale models with recycled materials, and present their ideas before judges at regional competitions in January. Regional winners represent their region at the National Finals in Washington, DC in February.
Future City’s cross-curricular
As science communication programs grow worldwide, effective evaluation and assessment metrics lag. While there is no consensus on evaluation protocols specifically for science communication training, there is agreement on elements of effective training: listening, empathy, and knowing your audience — core tenets of improvisation. We designed an evaluation protocol, tested over three years, based on validated and newly developed scales for an improvisation-based communication training at the Alan Alda Center for Communicating Science. Initial results suggest that ‘knowing your audience’ should
DATE:
TEAM MEMBERS:
Christine O’ConnellMerryn McKinnonJordan Labouff
Reframing engineering activities to emphasize the needs of others has the potential to strengthen engineering practices like problem scoping, while also providing more inclusive and socially relevant entry points into engineering problems. In a three-year design-based research project, we developed novel strategies for adding narratives to engineering activities to deepen girls’ engagement in engineering practices by evoking empathy for the users of their designs. In this article, we describe a set of hands-on engineering activities developed through iterative development and testing with 190
With funding from the NASA Science Activation program, the Space Science Institute (SSI) launched NASA@ My Library in 2016. The vision of NASA@ My Library was to help public libraries and state library agencies increase NASA and STEM learning opportunities for library patrons throughout the U.S., including those in geographic areas and populations currently underserved in STEM education. SSI worked closely with its partners, including the American Library Association (ALA), Cornerstones of Science (CoS), the Lunar and Planetary Institute (LPI), and the Pacific Science Center’s Portal to the
IMPACT NC is a collaboration between the North Carolina science centers and museums and NC State University (NCSU) to build and foster a Community of Practice (CoP) for collective evaluation among the 54 partner organizations across the state of North Carolina. Funded by IMLS Museum Leadership Grant (MG-70-19-0019-19).
The goals of IMPACT NC are:
Identification of a set of shared goals for informal science education across the state.
Development of metrics to assess these goals.
Enhanced capacity of the Community of Practice of science museums to conduct evaluation centered on these collective evaluation goals and metrics.
Improved cohesion among science museums and other partners in NC (e.g. university collaborators, non-profit organizations) as they collectively work toward shared goals.
Development of a system for reporting program outcomes using shared metrics that is integrated into annual reporting or grant proposal processes across NC, thereby informing decision making.
In November 2020, President-elect Joe Biden identified four priority areas for the incoming administration: COVID-19; climate change, economic recovery, and racial equity. These crucial areas of national interest will be the focus of media attention, policy debates, funding initiatives, and community discussions over the next four years. Will museums be part of these important conversations and initiatives? Are there opportunities for museums to affirm or to reposition their roles within the difficult public deliberations ahead? Addressing Societal Challenges through STEM (ASCs) is a research
NASA@ My Library is made possible through the support of the National Aeronautics and Space Administration (NASA) Science Mission Directorate as part of its Science Activation program. The project is led by the National Center for Interactive Learning (NCIL) at the Space Science Institute (SSI) in partnership with the American Library Association (ALA) Public Programs Office, Lunar and Planetary Institute (LPI), and Education Development Center (EDC). From 2016-2020, 78 public libraries (75 partner libraries and 3 pilot libraries), 18 State Library Agencies, 6 Portal to the Public Network sites, and 30 NASA-funded scientists participated in the project. More than 225,000 library patrons were reached through their efforts.
In 2021-2022, public libraries, universities, and state library agencies will participate in the project to increase and enhance STEAM learning opportunities in their communities, with an emphasis on reaching audiences underrepresented in STEM education and professions.