This paper describes the Visitor Evaluation Program developed jointly by the Centre de Recherche Evaluation Social des Technologies (CREST) in Montreal (Bernard Schiele) and the CNRS in Paris (Jacqueline Eidelman). The purpose of the program is to ensure the successful installation of the future Galerie de l'Evolution at the Museum National d'Histoire Naturelle in Paris. The evaluation program is based on the application of principles and methods used in contemporary evaluation processes. This paper provides a brief description of the Galerie de l'Evolution project, the major stages of the
Engineering Adventures (EA) is a free, hands-on, project-based engineering curriculum designed for out-of-school time (OST) programs serving children in grades 3 to 5. The EA curriculum was developed by Engineering is Elementary® (EiE), a project of the National Center for Technological Literacy® at the Museum of Science, Boston. Each Engineering Adventures (EA) curriculum unit features a hands-on "engineering design challenge" based on real-world events that gives children the opportunity to apply and reinforce the science and engineering practices put forth in the Next Generation Science Standards. Every EA unit focuses on a different field of engineering and features 10-12 hours of activities with flexible scheduling options. EA units area available as FREE DOWNLOADS on the project website.
Roto, an exhibition design and production firm, contracted Randi Korn & Associates, Inc. (RK&A) to conduct a front-end evaluation of Speed, an exhibition being developed for The Science Museum of Virginia (SMV) in Richmond, Virginia. RK&A explored visitors’ thoughts, perceptions, and understandings of exhibition concepts related to speed, defined as change over time. How did we approach this study? RK&A worked closely with Roto to identify the goals and objectives for the Speed exhibition. Findings from the front-end evaluation were designed to help Roto and SMV find common ground between
This paper provides an overview of the Audience Research Consortium of Toronto, comprised of the Art Gallery of Ontario, the Metropolitan Toronto Zoo, the Ontario Science Center and the Royal Ontario Museum. These groups have a shared vision of attracting a larger and more diverse audience-one that includes nontraditional and multicultural groups. This paper outlines how this group developed, acquired funding, hired a consulting group, and created a proposal and research plan. Preliminary findings are also briefly summarized.
DATE:
TEAM MEMBERS:
Art Gallery of OntarioRoyal Ontario MuseumOntario Science CentreMetropolitan Toronto ZooWoods Gordon Management Consultants
Project LIFTOFF works with local, regional, and national partners to engineer statewide systems for Informal Science Education that inspire: YOUTH to pursue STEM education and careers through increased opportunities for quality, hands-on STEM learning. AFTERSCHOOL STAFF to facilitate STEM learning experiences that contribute to the overall STEM education and aspirations of youth in their programs. PROGRAM ADMINISTRATORS to encourage and support staff in the integration of STEM enrichment into the daily programming. STATE LEADERS to sustain and expand afterschool learning opportunities so that all students have access to engaging STEM experiences outside of the regular school day. Project LIFTOFF is dedicated to the development of the following essential elements of statewide systems for informal science education:
Access to appropriate STEM Curriculum for youth of all ages, abilities, and socio-cultural backgrounds that meets the needs and interests of individual community programs
Systematic STEM Professional Development that matches individual skills in positive youth development with abilities to facilitate discovery and science learning
A diverse Cadres of Trainers who will deliver the professional development, technical assistance and curriculum dissemination in their local communities
Authentic Evaluation of informal science efforts that determine the impacts on youth aspirations and the capacity of youth programs to provide quality STEM experiences
Local STEM education leadership to identify the ways in which collaborative education efforts can advance the development of 21st Century Skills and the preparedness for STEM workforce and higher education
Partnerships in support of youth development and informal science education that convene local, regional, and statewide organizations and stakeholders
To advance national initiatives and states' sySTEM engineering efforts, LIFTOFF coordinates an annual convening, the Midwest Afterschool Science Academy, that brings together national informal science experts, system leaders and youth development professionals to elevate the levels of science after school. The 5th MASA will be in the spring of 2014 in Kansas City, MO
DATE:
TEAM MEMBERS:
Missouri AfterSchool NetworkJeff Buehler
Climate change science is becoming a more frequent and integral part of the middle school curriculum. This project, NASA Data in My Field Trip, proposes to leverage a regional network of Informal Science Institutions (ISIs) committed to climate change education, the Global Climate Change Consortium (GC3). This project will support climate change education in the formal curriculum by creating opportunities for inquiry-based exploration of NASA data and products in class and as part of already established field trip experiences to ISIs. The ISIs of the recently formed GC3 include a broad range of science-based institutions including Carnegie Museum of Natural History (CMNH), Carnegie Science Center (CSC), Phipps Conservatory and Botanical Gardens, National Aviary, and the Pittsburgh Zoo and PPG Aquarium. Partners, Pittsburgh Public Schools and Wilkinsburg School District have respectively 70 and 99% minority populations. NASA Data in My Field Trip will build innovative connections among NASA data and products, ISI resources and experiences, curriculum standards, and educators in formal and informal environments. It has three components: (1) joint professional development for formal and informal educators, (2) in-class pre-field trip data explorations, and (3) the integration of NASA resources into ISI field trip experiences. In the first phase of NASA Data in My Field Trip, CMNH and CSC will pilot NASA resources as central components of middle school climate change field trips as well as in pre-visit experiences. In the second phase, three other GC3 ISIs will tailor the pilot products to their climate change field trips. In both phases, formal and informal educators will participate in joint professional development. Alignment with the school districts' curriculum and formative evaluation is critical at all steps of this project and will guide and inform the implementation of the project through both phases. The success of the project will be measured in terms of (1) educators’ attitudes toward and ability to use NASA resources, (2) the effectiveness of in-class and field trip experiences for students, (3) the development of a community of practice among informal and formal educators, and (4) the adoption of NASA data and products into informal and formal programming outside of the project’s specified reach. Primary strengths of this project are that it brings NASA resources to underserved schools and includes ISIs that have a commitment to climate change education but have not previously connected with NASA or its resources. Techniques developed in this project will be tailored to a diversity of ISIs and can therefore serve as a replicable model for NASA products throughout the ISI field.
DATE:
TEAM MEMBERS:
Kerry HandronEllen McCallieJohn RadzilowiczPittsburgh Public SchoolsWilkinsburg School DistrictPittsburgh Zoo and PPG AquariumNational AviaryPhipps Conservatory and Botanical Gardens
The MyDome project will bring 3D virtual worlds for group interaction into planetaria and portable domes. Advances in computing have evolved the planetarium dome experience from a star field and pointer presentation to a high-resolution movie covering the entire hemispherical screen. The project will further transform the dome theater experience into an interactive immersive adventure. MyDome will develop scenarios in which the audience can explore along three lines of inquiry: (1) the past with archeological reconstructions, (2) the present in a living forest, and (3) the future in a space station or colony on Mars. These scenarios will push the limits of technology in rendering believable environments of differing complexity and will also provide research data on human-centered computing as it applies to inquiry and group interactions while exploring virtual environments. The project proposes to engage a large portion of the population, with a special emphasis on the underserved and under-engaged but very tech-savvy teenage learner. Research questions addressed are: 1. What are the most engaging and educational environments to explore in full-dome? 2. What on-screen tools and presentation techniques will facilitate interactions? 3. What are the limitations for this experience using a single computer, single projector mirror projection system as found in the portable Discovery Dome? 4. Which audiences are best served by exploration of virtual hemispherical environments? 5. How large can the audience be and still be effective for the individual learner? What techniques can be used to provide more people with a level of control of the experience and does the group interaction enhance or diminish the engagement of different individuals? 6. What kind of engagement can be developed in producing scientific and climate awareness? Does experiencing past civilizations lead to more interest in other cultures? Does supported learning in the virtual forest lead to greater connection to and understanding of the real forest? Does the virtual model space experience excite students and citizens about space exploration or increase the understanding of the Earth's biosphere? The broader impacts of the project are (1) benefits to society from increasing public awareness and understanding of human relationships with the environment in past civilizations, today?s forests and climate change, and potential future civilizations in space and on Mars; (2) increasing the appeal of informal science museums to the tech-savvy teenage audience, and (3) significant gains in awareness of young people in school courses and careers in science and engineering. The partners represent a geographically diverse audience and underserved populations that include rural (University of New Hampshire), minority students (Houston Museum of Natural Science) and economically-distressed neighborhoods (Carnegie Museum of Natural History). Robust evaluation will inform each program as it is produced and refined, and will provide the needed data on the potential for learning in the interactive dome environment and on the optimal audience size for each different type of inquiry.
DATE:
-
TEAM MEMBERS:
Annette SchlossKerry HandronCarolyn Sumners
The following comprise the CONCLUSIONS of SRA's evaluation: POLAR-PALOOZA toured the United States at a time when the topic of climate change and global warming appeared relatively low on a list of Americans' concerns (Pew Research Center for the People and the Press, 2006), with the economy, war, and health care taking precedence. Nevertheless, POLAR-PALOOZA was a powerful format for engaging the public and teachers with science, while also being a rewarding and worthwhile experience for the traveling scientists. PPZA was an ambitious and complex undertaking designed to bring what is
This report presents the findings of a summative evaluation of The Search for Life conducted by Randi Korn & Associates, Inc. (RK&A), for The New York Hall of Science (NY Hall) in Queens, New York. The Search for Life was developed by NY Hall staff and funded by the National Science Foundation, NASA and NASA Astrobiology Institute, New York City Department of Cultural Affairs with funds from the Office of the Mayor, Institute for Library Services, Anonymous and Wyeth. Data collection took place in October 2005.
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.New York Hall of Science
MIT Education Arcade, in partnership with the Smithsonian Institution, designed and developed Vanished, an eight-week environmental science game as a new genre called the curated game, a hybrid of museum-going, social networking, and online gaming. Middle school aged participants engaged in Earth systems science to study a range of environmental issues associated with mass extinction. Though the game was structured around a fictional scenario--communication with visitors from the future--it posited a future affected by current environmental issues and conditions, and encouraged participants to apply systems thinking as a means to understand how these current conditions led to environmental disruptions. As part of the game play participants studied, applied, and integrated knowledge and skills from multiple sources, including Earth science, ecology, astronomy, and archaeology, and forensic anthropology. An Advisory Board and contributing scientists were be involved. The project team is currently analyzing data collected from the game to test the hypothesis that the game play would allow youth, ages 11-14, to increase their understanding of the scientific process and increase their motivation to learn more science. This summative evaluation is being conducted by TERC Inc. A Curated Game Handbook will be produced to disseminate project results as a model for new applications of game-based learning. Open source software created as part of the game has been made available, and should enable future developers in informal science education to build directly upon these foundational efforts.
DATE:
-
TEAM MEMBERS:
Eric KlopferConrad LabandeiraScot OsterweilStephanie Norby
Cosmic Serpent - Bridging Native and Western Science Learning in Informal Settings is a four-year collaboration between the Indigenous Education Institute and the University of California-Berkeley targeting informal science education professionals. This project is designed to explore the commonalities between western science and native science in the context of informal science education. The intended impacts are to provide informal science education professionals with the skills and tools to gain an understanding of the commonalities between native and western worldviews; create regional networks that bridge native and museum communities; develop science education programs in which learners cross cultural borders between western science and indigenous peoples; and meet the needs of diverse audiences using culturally-responsive approaches to science learning. Participants are introduced to topics in physical, earth, space, and life science, using an interdisciplinary approach. Deliverables include professional development workshops, peer mentoring, museum programs for public audiences, a project website, and media products for use in programs and exhibits. Additionally, regional partnerships between museums and native communities, a legacy document, and a culminating conference jointly hosted by the National Museum of the American Indian and the Association of Science and Technology Centers will promote future sustainability. Strategic impact is realized through participants' increased understanding of native and western science paradigms, museum programs that reflect commonalities in the two approaches, partnerships between museums and native communities, and increased institutional capacity to engage native audiences in science. This project directly impacts 270 informal educators at 96 science centers and tribal/cultural museums nationally while the resulting programs will reach an estimated 200,000 museum visitors.
This project will be conducted by a team of investigators from North Carolina State University. The principal investigator proposes to examine the characteristics, motivations, in and out-of-school experiences, informal science activities, and career trajectories of 1000 science hobbyists and "master hobbyists." Master hobbyists are individuals who have developed science expertise and spend considerable free time engaging in science as a leisure activity. Master science hobbyists are found across most areas of science (e.g. birdwatchers, amateur astronomers). This research will determine who these individuals are, their career pathways, how they engage in science activities and what motivates, sustains, and defines their science interests. One of the particular goals of this research is to develop new understandings of how science hobby interests develop for women and underserved minorities. In the proposed research investigators will use the results of interviews and surveys to identify contextual factors that influence the motivational processes that, in turn, influenced choices of careers and contribute to ongoing choices in hobby and citizen science activities. Of interest in this study is how citizen scientists who are also serious hobbyists differ from master science hobbyists. Research on citizen scientists has shown that this group is highly motivated by collective motives (such as a desire to help others and further science), whereas this may not be the case with the master science hobbyist. Two groups will be sampled: a) birdwatchers and b) amateur astronomers. This sampling model will allow investigators to contrast their findings by: 1) those who have selected a science career versus those that did not select a science career, 2) those who participate in citizen science activities and those that do not, and 3) those who are birdwatchers (greater mathematical components) and those who are amateur astronomers (lesser mathematical components). Additional coding and analyses will examine any differences in the evolution of bird watching and astronomy hobbies. The results of this research will be examined in light of existing motivational and sociocultural models of career selection. This research will document differences in the perceived motivational elements that influenced master science hobbyists/citizen scientists to choose a science career or not. The results can inform federal, state, and local policies for supporting youth and adults engaged in free choice learning. Results of this research will inform the design of intervention/recruitment programs and ISE outreach initiatives. Potential audiences include ISE institutions (e.g. museums and science centers), organizations with links to STEM (e.g. scouts, boys/girls clubs) and pre- and college initiatives that seek to influence career choices and life-long science interests. The proposed cross-disciplinary approach will promote new understandings of complex issues related to motivation, retention, career selection, leisure activities, engagement with formal and informal educational environments, gender and ethnicity, communities of practice and changes in interests over time. Members of the advisory board have expertise in assessment and measurement and will work closely with the project team to conduct a detailed examination of methodologies and analyses at all phases of the project.