IMPACT NC is a collaboration between the North Carolina science centers and museums and NC State University (NCSU) to build and foster a Community of Practice (CoP) for collective evaluation among the 54 partner organizations across the state of North Carolina. Funded by IMLS Museum Leadership Grant (MG-70-19-0019-19).
The goals of IMPACT NC are:
Identification of a set of shared goals for informal science education across the state.
Development of metrics to assess these goals.
Enhanced capacity of the Community of Practice of science museums to conduct evaluation centered on these collective evaluation goals and metrics.
Improved cohesion among science museums and other partners in NC (e.g. university collaborators, non-profit organizations) as they collectively work toward shared goals.
Development of a system for reporting program outcomes using shared metrics that is integrated into annual reporting or grant proposal processes across NC, thereby informing decision making.
The Science Museum of Minnesota will create a 450-square-foot version of its award-winning "RACE: Are We So Different?" exhibition for distribution to rural areas and communities in Minnesota, and adjacent regions in Iowa, eastern North and South Dakota, and northern Wisconsin. The museum will produce four replicas of the exhibition for museums and partner organizations, and collaborate with community groups to develop supporting programming specific to identified community needs. Programs will include facilitated reflective dialogues for groups of adults and students; a leadership institute with representatives from each host community; an educator guide for secondary school teachers; and a variety of workshops and arts presentations to extend conversations about race and racism. Like the original RACE exhibition, these condensed exhibitions will encourage visitors to explore the science, history, and everyday effects of race and racism through a combination of artifacts, historic and contemporary photography, multimedia components, and interactive activities.
The Expanding the Reach: Creating Capacity for Understanding RACE project developed site-specific programming to complement the installation of three small footprint exhibitions of RACE: Are We So Different? in three communities in Minnesota. The goal of the project was to prompt community conversations around topics of race, racism, equity, and the nation’s history, as well as local histories concerning race. Our evaluation questions were: 1) What impact did having the RACE exhibit and associated program have on prompting conversation about race and racism, (a) within institutions and (b)
Diversity, equity, accessibility, and inclusion (DEAI) have become central concerns for museums. Across the field, leaders are asking—with increasing urgency—how museums can diversify their visitors, staff, and boards; create welcoming and inclusive environments and workplaces; and ensure that museum offerings reflect a broad range of interests, experiences, and needs.
Museums have approached DEAI efforts in different ways and at different levels, from developing special exhibits and events for specific audiences to offering staff diversity training to board development. Despite more than
Identifying causal relationships is an important aspect of research and evaluation in visitor studies, such as making claims about the learning outcomes of a program or exhibit. Experimental and quasi-experimental approaches are powerful tools for addressing these causal questions. However, these designs are arguably underutilized in visitor studies. In this article, we offer examples of the use of experimental and quasi-experimental designs in science museums to aide investigators interested in expanding their methods toolkit and increasing their ability to make strong causal claims about
The Collaboration for Ongoing Visitor Experience Studies (COVES) aims to help science centers gather and share data to better understand visitors’ experiences. For the summative evaluation of COVES, the Museum of Science’s Research and Evaluation Department studied the program’s impacts on participating museums and museum professionals. Specifically, this evaluation was designed to:
Examine participants’ overall satisfaction with the collaboration and their likelihood to recommend it to others;
Understand the impact that COVES is having on Participating Institutions;
Assess whether
Recent research suggests that emerging adulthood—the stage between adolescence and maturity marked by a lengthy process of identity development—constitutes a window of opportunity for museums to influence adults’ lifelong science learning trajectories. The current study sought to explore the impact of a single museum visit on emerging adults’ science self-efficacy, beliefs about their own abilities to learn or do science. A repeated measures design assessed the science self-efficacy of 244 emerging adults before, immediately after and three months after a science museum visit. Results from
Since the late 2000s, interest in the development and use of shared measures in the informal science, technology, engineering, and mathematics (STEM) education (ISE) field has increased. The intent is to build the capacity of evaluators to measure common outcomes of ISE experiences. We begin this chapter with a definition of shared measures, a description of related technical qualities of these measures, and a discussion of benefits and concerns around the use of shared measures. We then review recent conversations and developments around shared measures, including examples of observational
With funding from the Institute of Museum and Library Services’ (IMLS) Museums for America program, the Cincinnati Zoo & Botanical Garden (Zoo) undertook a process of improving the interpretive experience of its Wings of the World exhibit, which concluded in summer 2018. The updated exhibition sought to enhance families’ connections to nature and inspire them to become better bird neighbors, in direct alignment with the Zoo’s strategic planning.
In collaboration with the Zoo, the Lifelong Learning Group (LLG) conducted formative and summative evaluation in spring and summer 2018. The
The Museum of Science will launch the "Collaboration for Ongoing Visitor Experience Studies" (COVES) project to construct an infrastructure for collaboration, which will unite science centers across the country in the systematic collection, analysis, and reporting of visitor experience data. The COVES program will develop common instruments for studying visitors in science museums and provide staff training on how to use these instruments and how to make sense of findings. The collaborative effort will enable participating science centers to become data-driven organizations focused on their audiences and will allow museums to learn from one another.
The Collaboration for Ongoing Visitor Experience Studies (COVES) is designed to unite science centers across the country to systematically collect, analyze, and report on visitor experience data. We envision a collaborative museum community seeking to better understand and improve the visitor experience. We believe that studying the visitor experience in science centers—who visits a particular museum, why they visit, what they experience during their visit, and how they react to different aspects of their experience—can help organizations learn about their visitors, make evidence-based
Federal support for museums through the Institute for Museum and Library Services (IMLS) is based on the premise that museums are valuable community organizations providing rich opportunities for learning and civic engagement. Yet, until recently, there has been a paucity of systematic and evidence-based research on the public impact of museums. Therefore, since 2005, the IMLS Office of Museum Services has funded research projects under the auspices of the National Leadership Grant program. These grants support projects that ‘raise the bar’ in museum research and practice. Funded projects have
DATE:
TEAM MEMBERS:
John H FalkKerry BronnenkantCynthia VernonJoseph Heimlich