This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. EvalFest is a community of practice designed to test innovative evaluation methods across 24 Science Festivals to measure their impact.
The University of Alaska Fairbanks will partner with the National Optical and Astronomy Observatory, the University of Alaska Museum of the North, and the University of Washington-Bothell to bring biomaterials, optics, photonics, and nanotechnology content, art infused experiences, and career awareness to art-interested girls. This full scale development project, Project STEAM, will explore the intersections between biology, physics, and art using advanced technologies at the nano to macro scale levels. Middle school girls from predominately underrepresented Alaskan Native, Native American (Tohono O'odham, Pascula Yaqui) and Hispanic groups, their families, teachers, and Girl Scout Troop Leaders in two site locations- Anchorage, Alaska and Tucson, Arizona will participate in the project. Centered on the theme "Colors of Nature," Project STEAM will engage girls in science activities designed to enhance STEM learning and visual-spatial skills. Using advanced technologies, approximately 240 girls enrolled in the Summer Academy over the project duration will work with women scientist mentors, teachers, and Girl Scout Troop Leaders to create artistic representations of natural objects observed at the nano and macro scale levels. Forty girls will participate in the Summer Academy in year one (20 girls per site- Alaska and Arizona). In consequent years, approximately180 girls will participate in the Academy (30 girls per site). Another 1,500 girls are expected to be reached through their Girl Scout Troop Leaders (n=15) who will be trained to deliver a modified version of the program using specialized curriculum kits. In addition, over 6,000 girls and their families are expected to attend Project STEAM Science Cafe events held at local informal science education institutions at each site during the academic year. In conjunction with the programmatic activities, a research investigation will be conducted to study the impact of the program on girls' science identity. Participant discourse, pre and post assessments, and observed engagement with the scientific and artistic ideas and tools presented will be examined and analyzed. A mixed methods approach will also be employed for the formative and summative evaluations, which will be conducted by The Goldstream Group. Ultimately, the project endeavors to increase STEM learning and interest through art, build capacity through professional development, advance the research base on girls' science identity and inspire and interest girls in STEM careers.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.
The purpose of the 3-year formative and summative evaluation was to gauge public perceptions of the utility and quality of NASA-funded workshops and programs offered by the North Carolina Museum of Natural Sciences. This final summative report includes 3-year project findings from 11 NASA Educator Workshops and three Astronomy Days events.
DATE:
TEAM MEMBERS:
North Carolina State Museum of Natural ScienceMary Styers
COSI offers special event programming on a monthly basis designed to enhance the guest experience: primarily Science Day and Fun Day special events. Science Days are events that highlight science topics, especially those dealing with our specific areas of focus, and celebrations surrounding events with a science theme, such as Space and Stars Day. On the other hand, Fun Days are events that are appealing to guests and are simple to implement, such as appearances by local sports teams, celebrities, performance groups, etc. COSI would like to better understand the impact special events have in
This report presents findings from Goodman Research Group's evaluation of the following: (1) The NOVA scienceNOW series, including viewer feedback on Season Three and the knowledge gained from viewing the six new episodes, (2) The NOVA scienceNOW website, and (3) Focus groups conducted at the Science Café conference in June 2008. Includes survey.
The National Science Foundation funded Roadside Heritage (RH) to produce three major deliverables during this project: (1) STEM-rich audio stories for the traveling public that highlight the science associated with Highway 395; (2) Traveling festival kits that highlight major STEM features of the Eastern Sierra landscape; and (3) The RH website, a STEM-rich site highlighting the natural and cultural landscape associate with Highway 395. During the project’s final year, WestEd conducted summative evaluation activities targeting each of these deliverables. Appendix contains survey.
DATE:
TEAM MEMBERS:
Jerome HippsSharon HerpinDonna Winston
EvalFest (Evaluation Use, Value, and Learning through Festivals of Science and Technology) will test innovative evaluation methods in science festivals that are being held across the country and assess in what ways and how effectively they are used. Morehead Planetarium and Science Center (at the University of North Carolina-Chapel Hill) and the University of California, San Francisco, in collaboration with over twenty science festivals, will (1) investigate whether a multisite evaluation approach is an effective model for creating common metrics for informal STEM education, (2) develop common methods to measure the effects of Festivals, (3) create a query-able database of 50,000 Festival attendees to share with the informal STEM learning field, and (4) document whether these efforts also result in new knowledge related to informal STEM education. The project will develop the Enterprise Feedback Management (EFM) system and query-able database for the festival community. EFMs are systems, including processes and software, that enable groups (such as the festival network) to collect, organize, analyze and share data. The EFM system will be designed to integrate data across sites and to allow users to extract data of interest. The project will refine evaluation tools currently used within the Science Festival Alliance that assess self-reported festival learning, and the effects of festival attendance, motivation, and future science participation. It will collect economic impact data and longitudinal festival attendee data. The project will also develop some new evaluation tools such as secret shopper observational protocols. Data from festival attendees will be collected onsite at participating festivals.
This paper discusses the results of a long-term memory study in which fifty visitors to Expo 67 (25 participants from British Columbia and 25 from Quebec) shared their recollections of their personal experience forty years after the event. The impetus for this study stems from a desire to understand the long-term impact of visitors' experience in informal, leisure-time contexts, and, particularly in large-scale exhibitions. This paper presents and discusses outcomes that elucidate the nature of personal memories of Expo 67 and in relation to the collective memory of cultural events/productions
This paper presents a summary of each of 10 evaluations conducted of NASA educational programs. The paper begins with a table outlining the titles of the evaluations and who conducted them, the date of the report, the evaluation questions, the evaluation design or methods and brief comments on the quality of each report. After the table each report is considered in more depth through an overview of what the evaluation included as well as a critique of the evaluation questions, methods and findings. The paper concludes with an overall commentary on the set of evaluations.
Indianapolis / City as Living Laboratory (I/CaLL) is a city-wide civic collaboration engaging in cross-sector research that builds on prior research in informal science learning in public settings. It extends research in place-based and service learning traditions, and uses the city itself as an informal science learning (ISL) environment for Science and Engineering for Environmental Sustainability learning outcomes. This project is creating place-based science learning experiences as part of public spaces in Indianapolis and establishes the next generation of urban science museums that increase opportunities for learning. The project will develop a self-sustaining program for art/science collaborations as they inaugurate city-sanctioned changeable installations at I/CaLL sites. Data from the project will be used to inform ISL professionals at museums throughout the community and around the country. Thousands of volunteers and their families will help create I/CaLL spaces, engage with communities, and serve as research participants connecting with science learning through site development. The unprecedented scale of this project provides a full measure of informal science service learning at a city scale, offering data that can change how science learning is measured, how people from all walks of life develop science literacy as part of their social public experience, and embodying the concept of the city as a living science learning lab. Broader impacts include the development of the city as an informal science learning environment that will become a new standard for thinking about what cities as cultural units can become as we build a resilient Science and Engineering culture for Environmental Sustainability.