In this paper, the Franklin Institute's Ann Mintz discusses the managerial challenges associated with evaluation projects. Mintz explains how evaluators teeter on a continuum serving as both as artists and educators throughout the evaluation process. She cites evidence from an ongoing project at the Franklin Institute called the The Franklin Institute Computer Network that serves seven categories of museum visitors.
Project LIFTOFF works with local, regional, and national partners to engineer statewide systems for Informal Science Education that inspire: YOUTH to pursue STEM education and careers through increased opportunities for quality, hands-on STEM learning. AFTERSCHOOL STAFF to facilitate STEM learning experiences that contribute to the overall STEM education and aspirations of youth in their programs. PROGRAM ADMINISTRATORS to encourage and support staff in the integration of STEM enrichment into the daily programming. STATE LEADERS to sustain and expand afterschool learning opportunities so that all students have access to engaging STEM experiences outside of the regular school day. Project LIFTOFF is dedicated to the development of the following essential elements of statewide systems for informal science education:
Access to appropriate STEM Curriculum for youth of all ages, abilities, and socio-cultural backgrounds that meets the needs and interests of individual community programs
Systematic STEM Professional Development that matches individual skills in positive youth development with abilities to facilitate discovery and science learning
A diverse Cadres of Trainers who will deliver the professional development, technical assistance and curriculum dissemination in their local communities
Authentic Evaluation of informal science efforts that determine the impacts on youth aspirations and the capacity of youth programs to provide quality STEM experiences
Local STEM education leadership to identify the ways in which collaborative education efforts can advance the development of 21st Century Skills and the preparedness for STEM workforce and higher education
Partnerships in support of youth development and informal science education that convene local, regional, and statewide organizations and stakeholders
To advance national initiatives and states' sySTEM engineering efforts, LIFTOFF coordinates an annual convening, the Midwest Afterschool Science Academy, that brings together national informal science experts, system leaders and youth development professionals to elevate the levels of science after school. The 5th MASA will be in the spring of 2014 in Kansas City, MO
DATE:
TEAM MEMBERS:
Missouri AfterSchool NetworkJeff Buehler
The Exploding Optic Incredible was an experiment in expanding the boundaries of art and music with science and technology. Ostensibly a multi-media rock concert as a fund raiser for Marshall Barnes' drug free creativity efforts, it took Andy Warhol's Exploding Plastic Inevitable concept of the 1960s into unchartered territory driven by Marshall's inspiration through discussions with Omni magazine's Dick Teresi and Pamela Weintraub and Gene Youngblood's book, Expanded Cinema. Marshall incorporated 1970s era slide and film projection light show effects, with dance lights, massive strobes, spotlights, and big screen video projection that showed customized and original video special effects while bands performed, and music videos in-between accompanied by lighting effects. The first multi-media rock concert of the 1990s, the January 18, 1990 event at the Newport Music Hall was also a test for the public's reaction to over stimulation through sight and sound, the results leading to exploration and ultimate creation of psychoactive entertainment technology later that year and the formation of new technological architectures for entertainment and learning that have yet to be presented but exist in design form.
This project was an early example of STEAM (Science, Technology, Engineering, Art, Math) and was produced for the 2004 BLD Studios art exhibition, Time Machines, in Columbus, OH. This project included a chair and a desk made of drawers, on top of which was a audio/video work station where visitors sat and interacted with the technology by using the headphones and listening to one tape deck for instructions and then listening to music on the other while watching the TV screen with special HyperSpeks(tm). There was also a panel of photos above the TV designed to simulate time travel. The instructions explained the purpose of the exhibit and how to use the TV to tune into various channels to pick-up a variety of video static on empty UHF frequencies. The music was designed to put the visitor into a certain frame of mind. It was futuristic sounding and created using DEMI sampling, a proprietary sampling technique also created by Marshall Barnes. The intent was to set the mood. Training Session was supposed to simulate training prospective transdimensional travelers in the cognitive exercises required to deal with the psychological rigors of time/parallel universe travel. The HyperSpeks(tm) allowed the visitors to search for various shapes in the TV static on a number of selcted channels which would resemble such cosmological constructs as black holes and wormholes. The static was live and not prerecorded and so the interaction on all levels was live and in real time. Visitors were to write their observations down on paper which was provided via a note pad and pen at the exhibit. In this way, a record of their experiences existed for subsequent visitors to review. The visitors were also told to view the photo panel, which consisted of pictures taken in 1977, but not developed until 2004. As a result, the pictures were somewhat faded and all tinted pink, however, when the visitors viewed them with the HyperSpeks(tm) they appeared not only normal color, but almost as if the scenes they depicted were views outside a window. Thus, the visitor was able to travel optically back in time and see the images the way they looked when they were originally photographed.
This summative evaluation of the exhibition Robots & Us was designed to investigate how visitor audiences used and experienced this exhibition in relation to the project’s objectives and challenges. Visitors’ expectations and perceptions in relation to the project’s content goals prompted the summative evaluation to focus on specific challenges including: attitudes and perceptions about technology, connections between robots and people, appeal to a broad audience, and reactions to specific exhibits.
DATE:
TEAM MEMBERS:
Jeff HaywardJolene HartScience Museum of Minnesota
Historically, most efforts to improve public knowledge of science and technology have focused on improvements in K-12 schooling, although post-secondary education and informal education have also been mentioned as important factors. Currently, little empirical data exist to determine how or when to best leverage science and technology education energies and resources. This article examines a range of factors potentially contributing to adult knowledge of science and technology. Results from a telephone survey of 1,018 adult residents in greater Los Angeles, California (United States) showed
Goodman Research Group, Inc. (GRG) conducted a summative evaluation of the second season of NOVA scienceNOW, the PBS series that explores cutting-edge scientific and technological innovation in real time. (GRG also served as the external evaluator for NOVA scienceNOW during Season One). In addition to the television series, WGBH-TV developed a companion website, a series of high school classroom activities, and a Science Cafe outreach initiative, designed to discuss, in non-academic environments, the latest developments in science. The Season Two evaluation included: 1) a viewer study
Goodman Research Group, Inc. (GRG) conducted a summative evaluation of the first season of NOVA scienceNOW, the PBS series that explores cutting-edge scientific and technological innovation in real time. The evaluation included two primary components: 1) an evaluation of the television series, and 2) an evaluation of the outreach, which consisted of a companion website and a series of Science Cafes hosted around the country. GRG's evaluation was designed to assess the project's effectiveness in meeting its overall goal of engaging a variety of audiences more deeply with scientific research in
Too Small to See is a 5,000 square-foot interactive traveling museum exhibition designed to provide hands-on nanotechnology science education to youth age 8 to 13 and adults. It debuted at Disney's Epcot and will reach over three million people during a five-year US tour. This evaluation examines the exhibition’s outcomes and impact on increasing visitors’ awareness of, interest in, engagement with, and understanding of nanoscale science, engineering, and technology. An overarching goal is to document the project’s contribution to the portfolio of federally funded Science Technology
DATE:
TEAM MEMBERS:
Douglas SpencerTina PhillipsTori AngelottiShane MurphyFred ConnerCornell University
resourceevaluationPlanetarium and Science on a Sphere
Visitor Baseline Study of Science on a Sphere at the Denver Museum of Nature & Science. This resource includes the Research Assistant Protocol, Observation Protocol, and Visitor Questionnaire.
Visitor Baseline study for Science on a Sphere at the Denver Museum of Nature & Science. Resource includes Research Assistant Protocol and Visitor Questionnaire.
DATE:
TEAM MEMBERS:
Andrea GironDenver Museum of Nature & Science
PERG conducted the formative and summative evaluations of Windows on Earth, a project led by the Center for Earth and Space Science Education (CESSE) at TERC. The project included numerous partners and contributors who focused on the development of the Windows on Earth software, exhibit and website, as well as four museums who participated in the development and evaluation process: Boston's Museum of Science, (MOS), the Smithsonian Air and Space Museum, (A&S), the St. Louis Science Center (SLSC), and the Montshire Museum of Science (MM) in Vermont. The project also coordinated some programming
DATE:
TEAM MEMBERS:
Judah LeblangJoan KarpTERC IncJodi Sandler