This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
Many scientists want to connect with the public, but their efforts to do so are not always easy or effective. Visionary programs and institutions are leading the way identifying the support needed to enable scientists’ connections with the public. However, the current appetite by -- and demand for -- scientists to do this exceeds the capacity of those who facilitate quality communication and engagement efforts. More can be done to ensure that those who support scientists are networked, sharing best practices, and supported by a reliable infrastructure.
This workshop series, convened by the Kavli, Rita Allen, Packard and Moore Foundations, was intended to view the entire system of people who support scientists’ engagement and communication efforts in order to explore how this system can be most effective and sustainable. The discussions examined where this system is thriving, the limits people within the system face and what can be done to ensure their efforts are commensurate with the demand for quality communication and engagement support.
Conducted over four closely scheduled workshops in late 2017 and early 2018, the convenings brought together leaders in different parts of the field who bridge scientists and the public and led to the emergence of a number of key priority areas. While the initial intention was to also hold a plenary event to provide a more holistic view of scientists’ support system in order to collectively discern directions to advance the field, we feel a more efficient way forward right now is to focus our efforts and resources on building community and advancing these priority areas.
Our invitation-only workshops brought together scientists, academic leaders, engagement professionals, researchers, communication trainers, and foundation leaders. For each workshop, we also commissioned a “landscape overview”, to better understand the high-level state of each community. Workshops included:
Workshop I: Communication and engagement training programs - Dec. 4-5, 2017 at SUNY Global Center/Alan Alda Center for Communicating Science in New York
Workshop II: Associations, societies and other professional organizations - Feb. 28 - March 1, 2018 at the Howard Hughes Medical Institute in Chevy Chase, MD
Workshop III: Academic institutions - March 27-28, 2018 at UC San Diego
Workshop IV: Science engagement facilitators (museums, science festivals, connectors) - May 2-3, 2018 at Monterey Bay Aquarium
TBD - Workshop V: Plenary event
The goal of the workshops was to explore how to ensure scientists’ communication and engagement support is effective and sustained. In doing so, we hoped to 1) deepen our understanding of how scientists are currently supported in these areas, 2) map the broader support system to expose the opportunities and obstacles that play a role in achieving this goal, and 3) identify strategic and practical next steps that move us closer to this goal. This initiative also aimed to forge and strengthen networks across communities and institutions – and in so doing, take a view of the entire system to explore how everyone can better ensure their efforts are impactful, mutually supportive, and connected to a greater whole.
Included in the links below are summaries from each workshop.
The University of Alaska Fairbanks will partner with the National Optical and Astronomy Observatory, the University of Alaska Museum of the North, and the University of Washington-Bothell to bring biomaterials, optics, photonics, and nanotechnology content, art infused experiences, and career awareness to art-interested girls. This full scale development project, Project STEAM, will explore the intersections between biology, physics, and art using advanced technologies at the nano to macro scale levels. Middle school girls from predominately underrepresented Alaskan Native, Native American (Tohono O'odham, Pascula Yaqui) and Hispanic groups, their families, teachers, and Girl Scout Troop Leaders in two site locations- Anchorage, Alaska and Tucson, Arizona will participate in the project. Centered on the theme "Colors of Nature," Project STEAM will engage girls in science activities designed to enhance STEM learning and visual-spatial skills. Using advanced technologies, approximately 240 girls enrolled in the Summer Academy over the project duration will work with women scientist mentors, teachers, and Girl Scout Troop Leaders to create artistic representations of natural objects observed at the nano and macro scale levels. Forty girls will participate in the Summer Academy in year one (20 girls per site- Alaska and Arizona). In consequent years, approximately180 girls will participate in the Academy (30 girls per site). Another 1,500 girls are expected to be reached through their Girl Scout Troop Leaders (n=15) who will be trained to deliver a modified version of the program using specialized curriculum kits. In addition, over 6,000 girls and their families are expected to attend Project STEAM Science Cafe events held at local informal science education institutions at each site during the academic year. In conjunction with the programmatic activities, a research investigation will be conducted to study the impact of the program on girls' science identity. Participant discourse, pre and post assessments, and observed engagement with the scientific and artistic ideas and tools presented will be examined and analyzed. A mixed methods approach will also be employed for the formative and summative evaluations, which will be conducted by The Goldstream Group. Ultimately, the project endeavors to increase STEM learning and interest through art, build capacity through professional development, advance the research base on girls' science identity and inspire and interest girls in STEM careers.
The purpose of the 3-year formative and summative evaluation was to gauge public perceptions of the utility and quality of NASA-funded workshops and programs offered by the North Carolina Museum of Natural Sciences. This final summative report includes 3-year project findings from 11 NASA Educator Workshops and three Astronomy Days events.
DATE:
TEAM MEMBERS:
North Carolina State Museum of Natural ScienceMary Styers
This paper presents a summary of each of 10 evaluations conducted of NASA educational programs. The paper begins with a table outlining the titles of the evaluations and who conducted them, the date of the report, the evaluation questions, the evaluation design or methods and brief comments on the quality of each report. After the table each report is considered in more depth through an overview of what the evaluation included as well as a critique of the evaluation questions, methods and findings. The paper concludes with an overall commentary on the set of evaluations.
A NSF EArly-concept Grant for Exploratory Research (EAGER) was awarded to Principal Investigator John Fraser, PhD, AIA, in collaboration with co-Principal Investigators, Mary Miss and William Solecki, PhD, for City as Living Laboratory for Sustainability in Urban Design (CaLL). The CaLL project explored how public art installations can promote public discussion about sustainability. The project examined the emerging role of artists and visual thinkers as people with the skills to encourage conversation between scientists and the public. The grant supported an experimental installation
The Institute for Learning Innovation, in collaboration with Mary Miss Studio and the Institute for Urban Design, is conducting an exploratory research and development project on sustainable practices related to the built infrastructure of New York City. The work will (1) pilot test and study new interpretive strategies for urban "place-based" public learning experiences that focus pedestrians' attention on a city's ecology and existing built sustainability infrastructure; (2) engage urban design professionals and STEM researchers to explore how these new strategies have the potential to transform how urban design fields inform, dialog and interact with the public about sustainable urban design and planning; and (3) assess the effectiveness of these public interpretation programs on STEM learning beyond traditional Informal Science Learning Environments (ISEs) such as science museums. Project participants also include faculty from the City College of NY Graduate Program in Urban Design, STEM faculty from Columbia University, and staff of the Provisions Library in Washington, D.C. The project is an early phase of the "City as Living Laboratory" initiative that can leverage the Rockefeller Foundation-funded Urban Design Week program in New York City scheduled to occur September 15 - 20, 2011. This request to NSF adds an additional track to the process to specifically focus on STEM learning and urban sustainability. From the promotional materials: "The Institute for Urban Design is currently preparing for the first annual Urban Design Week, a public festival created to engage New Yorkers in the fascinating and complex issues of the public realm and celebrate the city's exceptional urbanity. Through a rich roster of charettes, summits, installations, film screenings, exhibitions, and tours, Urban Design Week will draw in citizens from every borough and walk of life and highlight the idea that cities are made by collective effort, and that each of us can be a part of that great endeavor." The project goal is to generate new models for public engagement with science in the city environment and to explore how urban designers and planners, as they design for sustainability, can more effectively collaborate with STEM researchers and with the public. The project has both research and programmatic deliverables. Research activities include: Public Audiences: observational study of pedestrians in the installation environment; intercept surveys of the public about their experiences with the streetscape installations. Professional Audiences: pre-installation surveys on the role of public space science interpretation for altering public discourse about urban planning and sustainable cities; focus group assessment of professionals' experiences with observing public interactions with the installations; online delayed- post experience survey on learning outcomes in terms of knowledge, attitude, motivation and anticipated impacts on professional practices; analysis of blog postings and public media surrounding the installation; survey of attendees at an ISE forum on the project, its goals, outcomes and potential for future developments. Programmatic deliverables include: a workshop that engages urban design students in the development of experimental streetscape installations; a pilot installation on streets in the City College of NY (consistent with approvals already received by NYC Dept. of Transportation); a City as Living Laboratory art-science workshop for Urban Design Week professionals to highlight possible benefits of inter-disciplinary collaboration; a panel discussion around new forms of citizen engagement through a "city as a science learning environment"; a forum specifically for ISE professionals to explore the research findings and potential for use as a strategy to increase science learning in city places.
This Pathways Project connects rural, underserved youth and families in Eastern Washington and Northern Idaho to STEM concepts important in sustainable building design. The project is a collaboration of the Palouse Discovery Science Center (Pullman, WA), Washington State University and University of Idaho, working in partnership with rural community organizations and businesses. The deliverables include: 1) interactive exhibit prototype activities, 2) a team cooperative learning problem-solving challenge, and (3) take-home materials to encourage participants to use what they have learned to investigate ways to make their homes more energy-efficient and sustainable. The project introduces youth and families to the traditionally difficult physics concept of thermal energy, particularly as it relates to sustainable building design. Participants explore how building materials and their properties can be used to control all three types of heat transfer: conduction, convection, and radiation. The interactive exhibit prototypes are coupled with an Energy Efficient Engineering Challenge in which participants, working in cooperative learning teams, use information learned from the exhibit prototype activities to retrofit a model house, improving its energy efficiency. The project components are piloted at the Palouse Discovery Science Center, and then travel to three underserved rural/tribal communities in Northern Idaho and Eastern Washington. Front-end and formative evaluation studies will demonstrate whether this model advances participant understanding of and interest in STEM topics and careers. The project will yield information about ways that other ISE practitioners can effectively incorporate cooperative learning strategies in informal settings to improve the transferability of knowledge gained from exhibits to real-world problem-solving challenges, especially for rural and underserved audiences. This project will also provide the ISE field with: 1) a model for increasing the capacity of small, rural science centers to form collaborative regional networks that draw on previously unused resources in their communities and provide more effective outreach to the underrepresented populations they serve, and 2) a model for coupling cooperative learning with outreach exhibits, providing richer experiences of active engagement.
The Institute for Learning Innovation, in collaboration with Mary Miss Studio and the Institute for Urban Design, is conducting an exploratory research and development project on sustainable practices related to the built infrastructure of New York City. The work will (1) pilot test and study new interpretive strategies for urban "place-based" public learning experiences that focus pedestrians' attention on a city's ecology and existing built sustainability infrastructure; (2) engage urban design professionals and STEM researchers to explore how these new strategies have the potential to transform how urban design fields inform, dialog and interact with the public about sustainable urban design and planning; and (3) assess the effectiveness of these public interpretation programs on STEM learning beyond traditional Informal Science Learning Environments (ISEs) such as science museums. Project participants also include faculty from the City College of NY Graduate Program in Urban Design, STEM faculty from Columbia University, and staff of the Provisions Library in Washington, D.C. The project is an early phase of the "City as Living Laboratory" initiative that can leverage the Rockefeller Foundation-funded Urban Design Week program in New York City scheduled to occur September 15 - 20, 2011. This request to NSF adds an additional track to the process to specifically focus on STEM learning and urban sustainability. From the promotional materials: "The Institute for Urban Design is currently preparing for the first annual Urban Design Week, a public festival created to engage New Yorkers in the fascinating and complex issues of the public realm and celebrate the city's exceptional urbanity. Through a rich roster of charettes, summits, installations, film screenings, exhibitions, and tours, Urban Design Week will draw in citizens from every borough and walk of life and highlight the idea that cities are made by collective effort, and that each of us can be a part of that great endeavor." The project goal is to generate new models for public engagement with science in the city environment and to explore how urban designers and planners, as they design for sustainability, can more effectively collaborate with STEM researchers and with the public. The project has both research and programmatic deliverables. Research activities include: Public Audiences: observational study of pedestrians in the installation environment; intercept surveys of the public about their experiences with the streetscape installations. Professional Audiences: pre-installation surveys on the role of public space science interpretation for altering public discourse about urban planning and sustainable cities; focus group assessment of professionals\' experiences with observing public interactions with the installations; online delayed- post experience survey on learning outcomes in terms of knowledge, attitude, motivation and anticipated impacts on professional practices; analysis of blog postings and public media surrounding the installation; survey of attendees at an ISE forum on the project, its goals, outcomes and potential for future developments. Programmatic deliverables include: a workshop that engages urban design students in the development of experimental streetscape installations; a pilot installation on streets in the City College of NY (consistent with approvals already received by NYC Dept. of Transportation); a City as Living Laboratory art-science workshop for Urban Design Week professionals to highlight possible benefits of inter-disciplinary collaboration; a panel discussion around new forms of citizen engagement through a "city as a science learning environment"; a forum specifically for ISE professionals to explore the research findings and potential for use as a strategy to increase science learning in city places.
To address a lack of informal science education opportunities and to increase community capacity to support STEM education for their children, Washington State University's Yakima Valley/Tri Cities MESA program, the Pacific Science Center, and KDNA Educational Radio have developed a set of informal science initiatives that offer complementary learning opportunities for rural Latino families. The goal of this four-year program is to create a sustainable informal science infrastructure in southeastern Washington State to serve families, increase parental awareness, support and involvement in science education and ultimately increase the numbers of rural Latino youth pursuing STEM-related under graduate studies. This program is presented in English and Spanish languages in all of its interconnected deliverables: Two mobile exhibits, beginning with one focused on agricultural and environmental science developed by The Pacific Science (PCS) Center; Curriculum and training in agriculture, life sciences and facilitating learning; Curriculum and training for community members to provide support to parents in encouraging the academic aspirations of their children developed by PSC and MESA; 420 Youth and parents from the MESA program trained to interpret exhibits and run workshops, community festivals, family science workshops and Saturday programs throughout the community; Four annual community festivals, quarterly Family Saturday events, and Family Science Workshops reaching 20,000 people over the four-year project; Take home activities, science assemblies, a website and CDs with music and science programming for community events; A large media initiative including monthly one hour call-in radio programs featuring science experts, teachers, professionals, students and parents, 60-second messages promoting science concepts and resources and a publicity campaign in print, radio and TV to promote community festivals. These venues reach 12,500-25,000 people each; A program manual that includes training, curriculum and collaborative strategies used by the project team. Overall Accesso la Ciencia connects parents and children through fun community activities to Pasco School District's current LASER science education reform effort. This project complements the school districts effort by providing a strong community support initiative in informal science education. Each activity done in the community combines topics of interest to rural Latinos (agriculture for instance) to concepts being taught in the schools, while also providing tools and support to parents that increases their awareness of opportunities for their children in STEM education.
DATE:
-
TEAM MEMBERS:
James PrattD. Janae' LandisDonald LynchMichael Trevisan