This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
Arkansas State University (ASU) Museum will offer engaging STEM (Science, Technology, Engineering, and Math) learning experiences for children, at-risk youth, and teachers through three years of membership in the Arkansas Discovery Network, a coalition of seven Arkansas museums that develops and shares children's exhibits. Membership in the network will entitle ASU to nine high-quality, hands-on, STEM-based exhibits that promote "learning by doing" and the needed training in their STEM programming for educators. ASU Museum staff will build substantially upon these exhibits by developing many new and engaging tours, gallery activities, and programs that ensure STEM content registers in learners. This project will enable the museum to offer exceptional experiences with the potential to change attitudes about the value of learning in the targeted audiences in Northeast Arkansas.
These resources are designed to identify opportunities to improve training for educators and researchers during implementation of the Living Laboratory model. The Data Collection Guidelines provide general instructions and tips for conducting evaluation through observations of (and/or interviews with) visitors. Two versions of each instrument (Researcher-Caregiver Conversations Instrument and Research Toy Interactions Instrument) are included: one can be modified and printed for data collection; the second is an annotated version, which includes more detailed instructions for each item in the
The Ross Sea Project was a Broader Impact projects for an NSF sponsored research mission to the Ross Sea in Antarctica. The project, which began in the summer of 2010 and ended in May 2011, consisted of several components: (1) A multidisciplinary teacher-education team that included educators, scientists, Web 2.0 technology experts and storytellers, and a photographer/writer blogging team; (2) Twenty-five middle-school and high-school earth science teachers, mostly from New Jersey but also New York and California; (3) Weeklong summer teacher institute at Liberty Science Center (LSC) where teachers and scientists met, and teachers learned about questions to be investigated and technologies to be used during the mission, and how to do the science to be conducted in Antarctica; (4) COSEE NOW interactive community website where teachers, LSC staff and other COSEE NOW members shared lesson plans or activities and discussed issues related to implementing the mission-based science in their classrooms; (5) Technological support and consultations for teachers, plus online practice sessions on the use of Web 2.0 technologies (webinars, blogs, digital storytelling, etc.); (6)Daily shipboard blog from the Ross Sea created by Chris Linder and Hugh Powell (a professional photographer/writer team) and posted on the COSEE NOW website to keep teachers and students up-to-date in real-time on science experiments, discoveries and frustrations, as well as shipboard life; (7) Live webinar calls from the Ross Sea, facilitated by Rutgers and LSC staff, where students posed questions and interacted directly with shipboard researchers and staff; and (8) A follow-up gathering of teachers and scientists near the end of the school year to debrief on the mission and preliminary findings. What resulted from this project was not only the professional development of teachers, which extended into the classroom and to students, but also the development of a relationship that teachers and students felt they had with the scientists and the science. Via personal and virtual interactions, teachers and students connected to scientists personally, while engaged in the science process in the classroom and in the field.
This paper presents a summary of each of 10 evaluations conducted of NASA educational programs. The paper begins with a table outlining the titles of the evaluations and who conducted them, the date of the report, the evaluation questions, the evaluation design or methods and brief comments on the quality of each report. After the table each report is considered in more depth through an overview of what the evaluation included as well as a critique of the evaluation questions, methods and findings. The paper concludes with an overall commentary on the set of evaluations.
This is a Broad Implementation proposal. Our goal is to create a vibrant, sustained community of practice around the established Café Scientifique New Mexico model for engaging high school teens in science, technology, engineering and math; scale-up will be accomplished via a national network of committed partners. The adult Cafe Scientifique model for engaging citizens in science has proven very effective and has been implemented widely. The interaction in a social setting with a scientist-presenter around a hot science topic is the key to the model’s success. With ISE funding, the model has been adapted by Science Education Solutions for the high school teen audience. Cafe Scientifique New Mexico, now starting its fifth year, has had documented success in providing teens with increased STEM literacy and a more realistic picture of scientists as real people leading interesting lives. Teens come to better understand the nature of science and are more likely to see the relevance of science to their lives. Scientists express strong satisfaction with the nature of our coaching and the resulting quality of their science communication. The program has been continually evaluated and improved, and is now ready for broad implementation. Intellectual Merit: Teenagers are the adult citizens and workforce of tomorrow. Teens are reaching a critical life juncture and are making choices that affect their future life style, life-long learning behaviors, and careers. Yet they are increasingly dropping out of the STEM pipeline in school. Even teens interested in STEM often know little about science and engineering careers and the nature of scientific research. Teen Cafés can play an important role in addressing these challenges. We have two major objectives: 1. Implement the Café Scientifique model of Teen Cafés in a national network of sites committed to adopting and adapting the program and validating its impacts with diverse audiences; and 2. Create a vibrant and sustainable community of practice comprised of ISE and STEM professionals interested in engaging teens in STEM through Teen Cafés. We have formed a core network of six initial partners: Southern Illinois University Edwardsville, Center for STEM Research, Education, and Outreach; The Florida Teen SciCafé Partnership; North Carolina Museum of Natural Sciences, Raleigh; Science Discovery, University of Colorado; The Pacific Science Center in Seattle; and The Missouri AfterSchool Network (MASN) – Project LIFTOF. We will add two more core partners in Year 3. The core partners will join the Teen Cafe Network in a staged fashion in years 1 - 3. Each will reach sustainability over a three-year funding period. Each node has a local area network of partners consisting of organizations that will host local Cafes; scientific organizations with potential presenters; schools and other organizations for recruiting teens; and entities capable of contributing to financial sustainability. The network will provide a structure for a dynamic, growing, and sustainable community of practice to implement the Teen Café model, in which high school teens will gain skills in scientific discourse, thought, and exploration. STEM professionals will gain improved skills for communicating with public audiences and a new perspective on their research from a broader societal perspective. ISE professionals will gain capacity to adapt, implement, test, and further disseminate the Teen Café model and increased capability for preparing STEM experts to communicate effectively with teen audiences, along with tools, resources, and expertise to help them do so. Science Education Solutions will manage the project and provide the resources to support the community of practice, while continuing Cafe Scientifique New Mexico as a ninth network node. We will stimulate intensive ongoing communication of lessons learned across the network as partners start up their Cafe programs; external observers will be able to watch the program unfold. Broader Impacts: We will build capacity for serving teens and effective communication of science in the broad ISE and STEM communities by encouraging and nurturing others wishing to start a Cafe program and join the network. We have partnered with 10 large science and science education organizations, each with its own extensive network, which will allow us to further propagate the Teen Cafe Network. They are: National Ecological Observatory Network (NEON). Nanoscale Informal Science Education Network (NISE Net), The American Institute of Physics (AIP), Science Cafés.org (to include NOVA), Science Festival Alliance, Consortium of Universities for the Advancement of Hydrologic Science (CUAHSI), Informalscience.org, Project Liftoff: Elevating Science Afterschool, ITEST Learning Resource Center, and The Center for Multiscale Modeling of Atmospheric Processes (CMMAP). Each partner will also target underserved and diverse teen audiences for their programs.
Science museums play a role in creating visitor experiences that relate to contemporary issues in science, and in linking audiences to the scientific enterprise and the community of scientists. In the Portal to the Public approach, science researchers are trained by museum educators with experience in inquiry-based learning, and are then given opportunities to translate their current research for museum audiences. Portal to the Public offers one solution to museums seeking to sustain a commitment to delivering experiences that reflect the dynamic pace of research, and the need to connect local
The First Synthesis Meeting was held in January 2008, at the front end of the Portal to the Public grant period. For this meeting, forty-three experts, stakeholders and members of the project team came together at Pacific Science Center for two days of dialog and reflection. Participants brought diverse knowledge and experience, and represented public, research scientist and informal science education perspectives. The First Synthesis Meeting's goal was to facilitate in-depth conversation to identify current initiatives, best practices, and future directions regarding activities in the field
The Global Soundscapes! Big Data, Big Screens, Open Ears Project uses the new science of soundscape ecology to design a variety of informal science learning experiences that engage participants through acoustic discovery Soundscape ecology is an interdisciplinary science that studies how humans relate to place through sound and how humans influence the environment through the alteration of natural sound composition. The project includes: (1) an interface to the NSF-funded Global Sustainable Soundscapes Network, which includes 12 universities around the world; (2) sound-based learning experiences targeting middle-school students (grades 5-8), visually impaired and urban students, and the general public; and (3) professional development for informal science educators. Project educational components include: the first interactive, sound-based digital theater experience; hands-on Your Ecosystem Listening Labs (YELLS), a 1-2 day program for school classes and out-of school groups; a soundscape database that will assist researchers in developing a soundscape Big Database; and iListen, a virtual online portal for learning and discovery about soundscape. The project team includes Purdue-based researchers involved in soundscape and other ecological research; Foxfire Interactive, an award-winning educational media company; science museum partners with digital theaters; the National Audubon Society and its national network of field stations; the Perkins School for the Blind; and Multimedia Research (as the external evaluator).
Boston's Museum of Science (MOS), with Harvard as its university research partner, is extending, disseminating, and further evaluating their NSF-funded (DRL-0714706) Living Laboratory model of informal cognitive science education. In this model, early-childhood researchers have both conducted research in the MOS Discovery Center for young children and interacted with visitors during the museum's operating hours about what their research is finding about child development and cognition. Several methods of interacting with adult visitors were designed and evaluated, including the use of "research toys" as exhibits and interpretation materials. Summative evaluation of the original work indicated positive outcomes on all targeted audiences - adults with young children, museum educators, and researchers. The project is now broadening the implementation of the model by establishing three additional museum Hub Sites, each with university partners - Maryland Science Center (with Johns Hopkins), Madison Children's Museum (with University of Wisconsin, Madison), and Oregon Museum of Science and Industry (with Lewis & Clark College). The audiences continue to include researchers (including graduate and undergraduate students); museum educators; and adults with children visiting the museums. Deliverables consist of: (1) establishment of the Living Lab model at the Hub sites and continued improvement of the MOS site, (2) a virtual Hub portal for the four sites and others around the country, (3) tool-kit resources for both museums and scientists, and (4) professional symposia at all sites. Intended outcomes are: (1) improve museum educators' and museum visiting adults' understanding of cognitive/developmental psychology and research and its application to raising their children, (2) improve researchers' ability to communicate with the public and to conduct their research at the museums, and (3) increase interest in, knowledge about, and application of this model throughout the museum community and grow a network of such collaborations.
The "Playful Invention and Exploration (PIE) Institute" is a three-year project to increase the capacity of museum educators and exhibitors to design and implement technology-integrated inquiry activities for the public. The collaborators include the Exploratorium, MIT Media Lab, Science Museum of Minnesota, Fort Worth Museum of Science and History, Explora Science Center and the Children's Museum of Albuquerque. The deliverables include a portfolio of technology-rich activities, professional development institutes, online educator resources and a handbook of pedagogical design principles for museum educators. This project builds upon prior NSF supported work that developed the PIE Network, which among other things developed the "cricket," an inexpensive computer that makes informal learning inquiry activities more compelling. This project has the potential to impact both the theory and practice of informal science education in museums. It will implement new theories and tools that represent a new approach to engaging and supporting visitors' learning experiences using play and experimentation that mirrors the processes of laboratory investigation. It also provides an innovative model of collaboration that develops and implements a major complex project by bringing together science centers with unique and complementary expertise.
DATE:
-
TEAM MEMBERS:
Mike PetrichCollen BlairKaren WilkinsonKristen MurrayKeith BraafladtRobert LindseySamuel Dean
resourceprojectProfessional Development, Conferences, and Networks
"Saving Species" will engage large and diverse public audiences in inquiry-based learning and environmental stewardship through a system of exhibits at zoos and other informal science education institutions throughout the U.S. The exhibit system will include more than 70 touch screen interactives and related technological infrastructure being created by Project Dragonfly at Miami University (Ohio). Project partners include the Cincinnati Zoo & Botanical Garden, Brookfield Zoo, Cleveland Metroparks Zoo, Columbus Zoo & Aquarium, Denver Zoo, Liberty Science Center, Louisville Zoological Garden, New York State Zoo, Oregon Zoo, Pittsburgh Zoo, Riverbanks Zoo, Santa Barbara Zoo, Shedd Aquarium, Toledo Zoo, The Wilds, Woodland Park Zoo, and Zoo Atlanta. Touch screen exhibit components will be designed for specific programs at partner zoos. The partner institutions in this consortium are establishing exhibits nationwide linked to one of three Saving Species campaigns: 1) the Great Ape Campaign allows families to conduct research on captive ape populations and to help save wild apes by joining the work of experienced field researchers; 2) the Wild Cat Campaign focuses on endangered cat species and allows families to join in conservation efforts along with professionals; 3) the Sustaining Life Campaign builds on widespread interest and growing exhibitry in environmental stewardship, renewable energy, and climate change. The consortium includes a shared library of public inquiry and public-action tools (e.g., cell phone recycling), as well as remote monitoring capabilities that provide real-time measures of station success, facilitating the development of variations of exhibit interactives across the country. More than 500 staff from informal science institutions are participating in "Saving Species" professional development through workshops and graduate courses in major cities and conservation sites worldwide. The formal educational opportunities include two new Master\'s degree programs co-delivered by Miami University and informal science institutions: (1) the Advanced Inquiry Program, and (2) the Global Field Program. Strategic partners include the Association of Zoos & Aquariums, public television, Conservation International, and the Society of Conservation Biology. Project evaluation by the Institute for Learning Innovation includes specific assessment protocols that are identifying patterns of engagement by gender, ethnicity, and socio-economic class so that disparities can be addressed across these demographics. A planning study and front-end evaluation will inform the future development of personalized, post-visit engagement opportunities on social networking platforms. "Saving Species" will achieve broad impact nationally, reaching millions of visitors to the participating institutions annually during the funding period and beyond, fostering the relationship between science inquiry and public action, and building multi-institutional partnerships committed to sustaining life on our planet.