This evaluator reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It reflects on the nature of learning and challenges assumptions of outcomes from engaging in informal learning experiences.
This funder reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It describes the importance of evaluation to funders, and provides some prompts and questions for thinking about evaluation with relation to funding.
This leadership reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It provides an organizational leadership perspective on evaluation.
This practitioner reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It discusses improving practice through reflection.
Currently, many museums present histories of science and technology, but very few are integrating scientific activity--observation, measurement, experimentation-with the time- and place-specific narratives that characterize history-learning experiences. For the Prairie Science project, Conner Prairie is combining proven science center-style activities, developed by the Science Museum of Minnesota, with family-engagement strategies developed through extensive research and testing with audiences in historical settings. The goal of this integration is to create guest experiences that are rich in both STEM and historical content and encourage family learning. One key deliverable of this project is the Create.Connect gallery, which is currently installed at Conner Prairie. Create.Connect allows the project team to evaluate and research hands-on activities, facilitation strategies and historic settings to understand how these elements combine to encourage family conversations and learning around historical narratives and STEM content. For example, in one exhibit area families can experiment with creating their own efficient wind turbine designs while learning about the innovations of the Flint & Walling windmill manufacturing company from Indiana. The activity is facilitated by a historic interpreter portraying a windmill salesman from 1900. The interpreter not only guides the family though the process of scientific inquiry, but shares his historic perspective on wind power as well. Two other exhibit areas invite hands-on exploration of electrical circuits and forces in motion as they connect to stories from Indiana history. Evaluation and research findings from the Create.Connect exhibit will be used to develop a model that can guide other history institutions that want to incorporate STEM content and thinking into their exhibits and interpretation. By partnering with the Science Museum of Minnesota, we will combine the experience of science center professionals and history museum professionals to find the best practices for incorporating science activities into historic settings. To ensure that this dissemination model is informed from many perspectives, Conner Prairie has invited the participation of four history museums: The Museum of America and the Sea, Mystic, Connecticut; the California State Railroad Museum, Sacramento, California; the Wabash County Historical Society, Wabash, Indiana; and the Oliver H. Kelley Farm, Elk River, Minnesota. Each of the four participants will install history-STEM exhibit components which will be connected to location-specific historic narratives. Drawing on the staff experience and talents of participant museums, this project will develop realistic solutions to an array of anticipated barriers. These issues and the resulting approaches will become part of a stronger, more adaptable dissemination model that will support history museums in creating STEM-based guest experiences.
The STAR Library Education Network: a hands-on learning program for libraries and their communities, (STAR_Net for short) is led by the National Center for Interactive Learning (NCIL) at the Space Science Institute (PI: Paul Dusenbery). STAR stands for Science-Technology, Activities and Resources. Team members include NCIL staff, the American Library Association (ALA), Lunar and Planetary Institute (LPI), and the National Girls Collaborative Project (NGCP). STAR_Net is developing two comprehensive, informal education programs: Discover Earth and Discover Tech. The project also includes a comprehensive evaluation plan and a research component that explores how public libraries can serve as a STEM learning center in rural, underserved communities. STAR_Net is supported through a grant from the National Science Foundation. The STAR_Net project includes two traveling library exhibits: Discover Earth: A Century of Change and Discover Tech: Engineers Make a World of Difference. The Discover Earth exhibition features interactive, multimedia displays that allow exhibit visitors to interact with digital information in a dynamic way, encouraging new perspectives on our planet. Discover Tech introduces the many extraordinary ways that engineers solve problems to help people and societies around the world. Similar to a science center experience, visitors and families will be able to explore and tinker with their own engineering solutions. A number of STEM activities and resources will be developed by project staff and by other organizations to help librarians and community partners offer a wide variety of programs for their patrons. Besides the traveling exhibits and programs, STAR_Net also includes library staff training (online and in-person) and a Community of Practice (CoP) for librarians (including non-host librarians) to interact and partner with STEM professionals and organizations. NCI's Kate Haley Goldman and staff from Evaluation and Research Associates are conducting the project's evaluation.
The Nature Research Center is a project through which the North Carolina Museum of Natural Sciences provides NASA with a permanent presence through the creation of NASA-themed exhibits in its new wing (the Nature Research Center), hosting special events, educator workshops and special programming, all of which serve the general population and seek to improve understanding of and engagement with science. The lead institution is the North Carolina Museum of Natural Sciences. Goals, expected and actual outcomes are as follows: Exhibits in the new wing were expected to reach 200,000 individuals in its inaugural year; in only 8 months, the Museum has welcomed over 1 million visitors. Astronomy Days’ goal was to reach 20,000 people per year and is on target for meeting this goal. Educator Workshops’ goal was to reach 32 educators per workshop and is on target for meeting this goal. The Museum’s visitor base has demonstrated an insatiable desire for NASA-themed programs. Attendance at Astronomy Days remains impressive and special space events (such as the transit of Venus, or live downlinks with the International Space Station) attract larger-than-expected audiences. The Museum appreciates NASA’s support and is eager to continue providing NASA with an ongoing presence in Raleigh, NC.
The Dynamic Earth: You Have To See it To Believe It is a public exhibition and suite of programming designed to educate and excite K-8 students, teachers, and families about weather and climate science, plate tectonics, erosion, and stream formation. The Dynamic Earth program draws attention to the importance of large-scale earth processes and the human impacts on these processes, utilizing real artifacts, hands-on models, and NASA earth imagery and data. The program includes the exhibition, student workshops, family workshops, annual professional development opportunities for classroom teachers, innovative theater shows, lectures for adults by visiting scientists, and interpretive activities. The Montshire Museum of Science has partnered with Chabot Space and Science Center (CA) and the US Army Corps of Engineers Cold Regions Research and Engineering Laboratory (NH) on various components. The project has broadened our internal capacity for providing quality earth science programming by greatly expanding our program titles and allowing us to create hands-on materials for use by our educators and to loan to schools in our Partnership Initiative. Programming developed during the grant period continues to reach thousands of students and teachers each year, both on-site and as part of our rural outreach efforts.
NASA STEM Educational Project for the Goddard Greenbelt and Wallops Visitor Center and the Independent Verification and Validation (IV&V) Facility Education Resource Center is a project designed to provide high value STEM education activities. The Goddard Office of Education is fortunate to have three facilities (Greenbelt, WFF and IV&V) that coordinate to produce high impact, sustainable results using NASA’s unique capabilities for their education customers which include visitors, K-16 students, educators and science centers, museums and planetariums. The Greenbelt project elements will take our current Visitor Center in the direction of the Science Education and Exploration Center (SEEC). This project includes utilizing the GeoDome portable planetarium with underserved populations, expanding STEM engagement programs held at the Visitor Center and growing the network of museum partners that implement programs through an experiential workshop held in September 2012. This project also includes support for a summer experience for students and educators for the SEEC held July 2012. The WFF elements of the project include developing educational exhibits and information on NASA’s WFF missions and launches. A presentation on the LADEE orbital moon mission is being developed for the Science on a Sphere. Content is being developed for a kiosk with hands-on exhibits for students that inspire them in STEM fields and based on NASA’s Suborbital and Orbital missions at Wallops Flight Facility. The IV&V elements leverage past NASA and Visitor Center investments, content, and programs. Using the IR camera enables sharing science and engineering information about missions such as the James Webb Space Telescope to a broader audience. IV&V is using the Space Weather kit to train educators and students on space weather forecasting. Having IV&V as a partner allows us to target rural underserved populations with our programs.
The goal of this project is to advance STEM education in Hawaii by creating a series of educational products, based on NASA Earth Systems Science, for students (grades 3-5) and general public. Bishop Museum (Honolulu HI) is the lead institution. NASA Goddard Space Flight Center is the primary NASA center involved in the project. Partners include Hawaii Department of Education and a volunteer advisory board. The evaluation team includes Doris Ash Associates (UC Santa Cruz) and Wendy Meluch of Visitor Studies Inc. Key to this project: the NASA STEM Cohort, a team of six current classroom teachers whom the Museum will hire. The cohort will not only develop curricula on NASA earth science systems but also provide guidance to Bishop Museum on creating museum educational programming that best meets the needs of teachers and students. The overall goal of Celestial Islands is to advance STEM education in Hawaii through the use of NASA Earth Science Systems content. Products include: 1) combined digital planetarium/Science on a Sphere® program; 2) traveling version of that program, using a digital planetarium and Magic Planet; 3) curricula; 4) new exhibit at Bishop Museum on NASA ESS; 5) 24 teacher workshops to distribute curricula; 6) 12 community science events. The project's target audience is teachers and students in grades 3-5. Secondary audiences include families and other members of the general public. A total of 545,000 people will be served, including at least 44,000 students.
The Maryland Science Center (MSC) Astrobiology project includes an interactive exhibit and Davis Planetarium program for school and public museum visitors, exploring the search for life in our Solar System, the search for exoplanets and an understanding of extreme forms of Earthly life. Four day-long Educator Workshops have taken place during the project with a total of 179 teachers participating.
Baltimore’s MSC is the lead institution, with the project led by PI Van Reiner, MSC President and CEO and Co-PI Jim O’Leary, MSC Senior Scientist, and science advisors consisting of astronomers, biologists, a geologist and educators representing NASA Goddard Space Flight Center, Space Telescope Science Institute, Carnegie Institute of Washington, Johns Hopkins University and the University of Maryland and Maryland School for the Blind.
The project provides visitors with a sense of the Milky Way Galaxy’s size and composition, the galaxy’s number of stars and potential planets, and the number of other galaxies in the Universe. The exhibit explores Earthly extremophiles, what their survival signifies for life elsewhere in the Solar System, and examines possibilities for life on Mars and moons of the Solar System, explores techniques used to detect exoplanets and NASA’s missions searching for exoplanets and Earth-like worlds. The project looks to provide a sense of the vast number of potential planets that exist, the hardiness of Earthly life, the possibilities for life on nearby planets and moons, and the techniques used to search for exoplanets.
The exhibit and Planetarium program premiered November 2, 2012, and both remain as long-term Science Center offerings. Since opening, MSC has hosted nearly a million visitors, and with the Life Beyond Earth exhibit located in a highly trafficked area near the Davis Planetarium and Science On a Sphere, the great majority of visitors have experienced the exhibit. The We Are Aliens program in the Davis Planetarium has been seen by more than 26,000 visitors since opening.
National Parks are full of interesting and unusual STEM features which often intrigue visitors whose questions are answered by park personnel. In addition to the natural features, there are often researchers in the parks gathering data and conducting experiments. Park personnel are not apprised of these studies yet are often questioned about them. This collaborative project's goals are to derive a mechanism to educate the park personnel so they can respond to the visitor's inquiries. Collaborators include the National Park Service (NPS), TERC, Winston-Salem State University, and the park personnel at Carlsbad Caverns National Park. The plan is to work through the park interpreters who are employees of NPS and often are the voice for explaining the park's natural features. For this project, the interpreters and researchers will collaborate on the explanations of the science and TERC will work with the interpreters on interacting or educating the public visitors on the research. This is a pilot study to determine how best to bridge the scientists and their research to the park visitors. Evaluation on all elements in this study will be done by Char Associates and the Institute for Mathematics and Science Education at New Mexico State University. The results of this study are to determine the issues in explaining the research to the park interpreters and thence to the park visitors. If successful, it is anticipated that a model will be developed in collaboration with the NPS for use in other National Parks.