This essay examines the question of how museum professionals select research methods for summative exhibit evaluation. It explores the ways in which this question historically has been answered in the United States, and it argues that selecting appropriate research methods depends upon understanding the interrelationship between research theories, methods, and designs. It also characterizes this interconnection in relation to different kinds of evaluative questions. The main purpose of the paper is to help museum professionals select an approach to summative evaluation appropriate to specific
Museums and galleries collect more visitor data today than ever before. But how much of it gives us real insight into visitors motivations, behaviour, experiences and responses? And how much of it simply ticks a box on a funding form? Commissioned by some of the UK’s leading institutions, including Tate, The British Museum, V&A and the Imperial War Museum North, Morris Hargreaves McIntyre has tackled this insight deficit head on. In doing so, we have helped these organisations to move beyond the data routinely collected to get to the knowledge they actually need.
DATE:
TEAM MEMBERS:
Morris Hargreaves McIntyre
resourceprojectProfessional Development, Conferences, and Networks
The Coalition for Science After School (CSAS) was established in 2004 in response to the growing need for more STEM (science, technology, engineering, and mathematics) learning opportunities in out-of-school time. CSAS sought to build this field by uniting STEM education goals with out-of-school time opportunities and a focus on youth development. Over a decade of work, CSAS Steering Committee members, staff and partners advocated for STEM in out-of-school-time settings, convened leaders, and created resources to support this work. CSAS leadership decided to conclude CSAS operations in 2014, as the STEM in out-of-school time movement had experienced tremendous growth of programming and attention to science-related out-of-school time opportunities on a national level. In its ten-year strategic plan, CSAS took as its vision the full integration of the STEM education and out-of-school time communities to ensure that quality out-of-school time STEM opportunities became prevalent and available to learners nationwide. Key CSAS activities included: (1) Setting and advancing a collective agenda by working with members to identify gaps in the field, organizing others to create solutions that meet the needs, identifying policy needs in the field and supporting advocates to advance them; (2) Developing and linking committed communities by providing opportunities for focused networking and learning through conferences, webinars, and other outreach activities; and (3) Identifying, collecting, capturing, and sharing information and available research and resources in the field. The leadership of the Coalition for Science After School is deeply grateful to the funders, partners, supporters, and constituents that worked together to advance STEM in out-of-school time during the last decade, and that make up today's rich and varied STEM in out-of-school time landscape. We have much to be proud of, but as a movement there is much more work to be done. As this work continues to expand and deepen, it is appropriate for the Coalition for Science After School to step down as the many other organizations that have emerged over the last decade take on leadership for the critical work that remains to be done. A timeline and summary of CSAS activities, products, and accomplishments is available for download on this page. All resources noted in the narrative are also available for download below.
Evaluation of the impact of science centers and museums is a growing field of study, because of trends such as increasing competition and financial pressure, demands for greater public accountability and transparency, and government policies that require public institutions to demonstrate their achievements in a variety of areas. As part of this growing focus on impact evaluation, the Association of Science-Technology Centers and a number of individual science centers have jointly funded an international study of the impact of science centers on their local communities. Phase 1 of this study
This research study reports on the evaluation of the outcome and impact of learning as a result of the implementation of Education Programme Delivery Plans in 69 museums in the nine regional museum hubs in England during September, October and November 2005. This is the second study of the impact of learning achieved through museum school services which have been funded through the Renaissance in the Regions programme, which provides central government funding to museums in the English regions. The first study 'What did you learn at the museum today?' was carried out in 2003. The findings of
DATE:
TEAM MEMBERS:
Eilean Hooper-GreenhillJocelyn DoddLisanne GibsonMartin PhillipsCeri JonesEmma Sullivan
To begin, this paper describes the climate in science education in the United States, and describes and defines formative assessment. Next, Black & Wiliam’s review and two other important empirical studies will be summarized. Then, a framework characterizing different forms of formative assessment is presented. Non-empirical studies are organized according to this continuum. Finally, the paper describes limitations in the implementation of formative assessment in K-8 science, and summarizes assessment practices that show promise for improving student learning. The important contribution of the
Viewers believe they are learning from giant screen films. But are they really learning, and what are they learning? This article reviews how evaluators look for learning impact and what evaluators have discovered aboutl learning from giant screen films and their adjunct materials.
This study, requested by Smithsonian Secretary Lawrence Small, was conducted between April 2004 and May 2005, over all four seasons, and used the following methods: 1) open-ended interviews with 55 visit groups; 2) formal observations of a sample of 100 visitors, for which the observer estimated the age and gender of visitors and noted their paths, all stops over 3 seconds in length, what displays they looked at, and which hands-on devices they used; 3) a peer review panel comprised of seven ex- hibition specialists (curators, designers,writers, educators, and exhibition developers) who work
This paper discusses a study that tracked the behavior of 350 visitors to the Lester E. Fisher Great Ape House at Lincoln Park Zoo over a 12-month period. Findings relate to visit durations, including children vs. adults as well as visitors' responses to interpretive graphics. This data adds to the growing literature on visitor behavior in zoological parks and have helped to guide several aspects of exhibit design for Lincoln Park Zoo's new ape facility.
This paper discusses how museums can encourage chaperones to facilitate deeper experiences for students during field trips. The authors describe how the California Science Center's ThinkSCIENCE! Pathways field trip program addresses this issue. Pathways asks chaperones to become facilitators by using "chaperone sheets," sets of materials containing gallery-specific questions, activities, and points of interest to help chaperones engage students in discussion. This article cites findings from a rigorous formative evaluation of these chaperone sheets and the program in general.
This paper reports a formative evaluation of an interactive exhibit in the Museum of Science, Boston, that encouraged visitors to create a model using everyday materials. The materials provided for visitors to create their models changed during the period of the evaluation, and visitors were observed and interviewed as they engaged with the various prototypes. Evaluation results show that the type of modeling material presented influenced the visitors' model making process and individual learning and behaviors as well as the interactions visitors had with each other.
This paper explores the question “What proportion of the local population can museums expect to attract?”, using data on museum visitation collected by means of a population-based sample survey repeated each six months from July 1991 to February 2004 in Sydney, Australia. The links between reported museum visiting and self-described personality attributes are also explored. The findings suggest that there is a limit to the audience for museums and that this limit appears to be driven by people's preferences for conceptual cognitive activity.