The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
In The Nature of Community: SCIENCES, we share the lessons learned from an innovative partnership designed to leverage the strengths of two nonprofit organizations—a large cultural institution and a smaller, deeply-rooted community-based organization, both of which offer informal science education expertise.
You’ll read first-hand reflections of how staff members, community leaders and members, children, and adults experienced this partnership: the expectations, surprises, challenges, successes, and lessons learned. We hope the description of this partnership inspires other organizations to
Consideration of the needs of individuals with a wide range of disabilities is not always considered in the early design stages of an informal STEM learning (ISL) activity or program. The primary access approach for people with disabilities becomes the provision of accommodations once the ISL product or environment is created. In contrast, the Universal Design approach considers users with a wide range of characteristics throughout the design process and works to create products and environments that are accessible, usable, and inclusive. This project, called AccessISL, led by the University of Washington's DO-IT (Disabilities, Opportunities, Internetworking and Technology) Center and Museology Program, includes an academic museology program and local ISL sites, representing museums, zoos, aquariums, makerspaces, science centers, and other sites of informal STEM learning. Insights will be gained through the engagement of people with disabilities, museology graduate students and faculty, and ISL practitioners. The AccessISL project model, composed of a set of approaches and interventions, builds on existing research and theory in the fields of education science, change management, effective ISL practices, and inclusive design processes. The project will collect evidence of policies and practices (or lack thereof) that improve the inclusiveness of ISL with respect to a wide range of disabilities and considers approaches for the design and development of new strategies; explores what stakeholders need to make change happen; uncovers challenges to the adoption of inclusive practices in public ISL settings and explores ways to overcome them; and proposes relevant content that might be included in museology curriculum. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project addresses the following two objectives:
For ISL personnel and museology faculty: to increase knowledge, skills, and actions to make ISL programs, facilities, courses, and resources more welcoming and accessible to participants with disabilities and embed relevant practices within their work.
For postsecondary STEM students with disabilities and museology students: to increase knowledge and skills in advocating for ISL offerings that are welcoming and accessible to everyone, including those with a wide variety of disabilities, and to encourage individuals with disabilities to pursue careers in ISL.
The project employs a student-centered approach and a set of practices that embrace the social model of disability, social justice education, disability as a diversity issue, intersectionality, and Universal Design. A leadership team of interns--each member a STEM student with a disability or a museology graduate student--along with project staff will engage with the University of Washington's Museology Program to identify and implement strategies for making ISL activities and courses more welcoming and accessible to individuals with disabilities. An online community of practice will be developed from project partners and others nationwide. A one-day capacity building institute will be held to include presentations, student/personnel panels for sharing project and related experiences, and group discussions to explore issues and further identify systemic changes to make ISL programs more welcoming and accessible to individuals with disabilities. As prototypes of the AccessISL Model are developed, evaluation activities will primarily be formative (looking for strengths and weaknesses) and remedial (identifying/implementing changes that could be made to improve the model). The model will continue to be fine-tuned through formative evaluation. Evaluation of the model components will focus on the experience of a range of stakeholders in the project. Specifically, quantitative data collected will include levels and quality of engagement, accessibility recommendations and products developed, and delivery of ISL services. Qualitative data will be collected through observations, surveys, focus groups, interviews, and case studies.
AccessISL project products will include proceedings of an end-of-project capacity building institute, promising practices, case studies, a video, and other online resources to help ISL practitioners and museology faculty that will result in making future ISL opportunities more inclusive of people with disabilities. AccessISL will advance knowledge and ensure long-term impact using multiple strategies:
broadening the STEM participation of people with disabilities as well as women, racial/ethnic minorities, and other underrepresented groups through the application of universal design
strengthening associations and creating synergy and durable relationships among stakeholders,
encouraging teaching about disability, accessibility, and universal design in museology courses,
empowering students with disabilities and current and future ISL practitioners to advocate for accessible ISL and develops an infrastructure to promote accessible ISL programs nationwide, and
contributing to the body of promising practices with products that will (a) enhance understanding of issues related to the inclusion of people with disabilities in ISL programs and (b) promote inclusive practices.
Outcomes will benefit society by making STEM opportunities available to more people and enhancing STEM fields with the talents and perspectives of people with disabilities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Today’s conservation challenges are complex. Solving these challenges often requires scientific collaborations that extend beyond the scope, expertise, and capacity of any single agency, organization, or institution. Conservation efforts can benefit from interdisciplinary collaboration, scientific and technological innovations, and the leveraging of capacity and resources among partners. Here we explore a series of case studies demonstrating how collaborative scientific partnerships are furthering the mission of the US Fish and Wildlife Service (USFWS), including: (1) contaminants of emerging
DATE:
TEAM MEMBERS:
Shauna MarquardtMandy AnnisRyan DrumStephanie HummelDavid MosbyTamara Smith
This research in service to practice project will examine the impact of a 12-year statewide science field trip program called LabVenture. This hands-on program in discovery and inquiry brings middle school students and teachers across the State of Maine to the Gulf of Maine Research Institute (GMRI) in Portland, Maine to become fully immersed in explorations into the complexities of local marine science ecosystems. These intensive field trip experiences are led by informal educators and facilitated entirely within informal contexts at GMRI. Approximately 70% of all fifth and sixth grade students in Maine participate in the program each year and more than 120,000 students have attended since the program's inception in 2005. Unfortunately, little is known to date on how the program has influenced practice and learning ecosystems within formal, informal, and community contexts. As such, this research in service to practice project will employ an innovative research approach to understand and advance knowledge on the short and long-term impacts of the program within different contexts. If proven effective, the LabVenture program will elucidate the potential benefits of a large-scale field trip program implemented systemically across a community over time and serve as a reputable model for statewide adoption of similar programs seeking innovative strategies to connect formal and informal science learning to achieve notable positive shifts in their local, statewide, or regional STEM learning ecosystems.
Over the four-year project duration, the project will reach all 16 counties in the State of Maine. The research design includes a multi-step, multi-method approach to gain insight on the primary research questions. The initial research will focus on extant data and retrospective data sources codified over the 12-year history of the program. The research will then be expanded to garner prospective data on current participating students, teachers, and informal educators. Finally, a community study will be conducted to understand the potential broader impacts of the program. Each phase of the research will consider the following overarching research questions are: (1) How do formal and informal practitioners perceive the value and purposes of the field trip program and field trip experiences more broadly (field trip ontology)? (2) To what degree do short-term field trip experiences in informal contexts effect cognitive and affective outcomes for students? (3) How are community characteristics (e.g., population, distance from GMRI, proximity to the coast) related to ongoing engagement with the field trip program? (4) What are aspects of the ongoing field trip program that might embed it as an integral element of community culture (e.g., community awareness of a shared social experience)? (5) To what degree does a field trip experience that is shared by schools across a state lead to a traceable change that can be measured for those who participated and across the broader community? and (6) In what ways, if at all, can a field trip experience that occurs in informal contexts have an influence on the larger learning ecosystem (e.g., the Maine education system)? Each phase of the research will be led by a team of researchers with the requisite expertise in the methodologies and contexts required to carry out that particular aspect of the research (i.e., retrospective study, prospective study, community study). In addition, evaluation and practitioner panels of experts will provide expertise and guidance on the research, evaluation, and project implementation. The project will culminate with a practitioner convening, to share project findings more broadly with formal and informal practitioners, and promote transfer from research to practice. Additional dissemination strategies include conferences, network meetings, and peer-reviewed publications.
The potential insights this research could garner on intersectionality between formal and informal STEM learning are substantial. As a consequence, this project is co-funded by the Advancing Informal STEM Learning (AISL) and Discovery Research K-12 (DRK-12) Programs. The Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. Likewise, the Discovery Research-K12 Program seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Increased integration and synergy between formal and informal learning environments is proposed to provide multiple benefits to science learners. In an effort to better bridge these two learning contexts, we developed an educational model that employs the charismatic nature of arachnids to engage the public of all ages in science learning; learning that aligns with the Next Generation Science Standards (NGSS Disciplinary Core Ideas associated with Biodiversity and Evolution). We created, implemented, and evaluated a family-focused, interactive science event—Eight-Legged Encounters (ELE)—which
The evaluation study supports the project Distance Learning Education Programs at the Saint Louis Zoo. To better understand what teachers want and need, and the characteristics of the settings in which their students learn, the Zoo conducted an online survey of the teachers of students with special needs in May 2014. The purpose of this evaluation was to clarify and expand the survey findings to support the design, development, and implementation of the Zoo distance learning curriculum so that it works effectively across a variety of school settings for K12 students with special needs and
The Ocean Science project integrates the Ocean Literacy Essential Principles and Fundamental Concepts into a Western Washington region-wide, coordinated program of formal and informal education consisting of: 1. Teacher professional development in the ocean sciences to integrate the Ocean Literacy Essential Principles and Fundamental Concepts into inquiry-based marine science education and instruction; 2. Evaluation and re-alignment of existing Sound Science ecosystems curricula into Ocean Science, incorporating NOAA data and promoting the Ocean Literacy Essential Principles and Fundamental Concepts; 3. Classroom programs, beach field investigations, and on-site programs at the Seattle Aquarium of the Olympic Coast national Marine Sanctuary's Olympic Coast Discovery Center for grades 4-5 students, their parents and teachers; 4. Parent training in ocean science content, the Ocean Literacy Essential Principles and Fundamental Concepts, and inquiry-based methods for supporting their children's science education; 5. Informal education for the general public via an interactive learning station linked to the Window on Washington Waters exhibit and designed to innovatively use NOAA data and information (videos, computer simulations and other creative media) to increase and evaluate ocean literacy in adults and children. Window on Washington Waters displays the outer coast marine environments and sea life of the Olympic Coast National Marine Sanctuary.
Connecting Tennessee to the World Ocean is a three-year capacity building project of the Tennessee Aquarium and its partners, the Hamilton County Department of Education, Calvin Donaldson Environmental Science Academy, and NOAA's National Weather Service. Expanded capacity, in turn, allows the institution to reach a broader audience with a message connecting Tennessee's waterways to the world ocean. Primary project outcomes are increased ocean literacy and expanded ocean stewardship ethics in targeted Aquarium audiences. A series of specific activities focused on ocean literacy and global change make this possible, including expanding Aquarium classroom capacity by 60% to serve more students, expanded videoconferencing opportunities in partnership with NWS, free admission and programming for underrepresented students from across the region, expanded educational opportunities on the Aquarium s website, updated interpretive panels focusing on global change, installation of a NOAA WeatherBug station, a civic engagement series, and professional development for Aquarium educators.
The Maritime Aquarium at Norwalk is located at the mouth of the Norwalk River where it flows into Long Island Sound. Its mission is to inspire people to appreciate and protect the Sound and the global environment. Over the past decade, a large percentage of the region’s 23 million people living within 50 miles of the Sound were directly affected by severe weather events, providing a timely opportunity to educate students, teachers and the public about community resilience. In a new three-year program, the Maritime Aquarium will deliver education related to environmental hazards, resilience, and the underlying science to schools from ten towns along or near Connecticut’s coast, including eight in the Natural Hazards Mitigation Plan Draft 2016-2021 for Southwestern Connecticut. In these towns as in many coastal regions, the most significant environmental threats are related to the nexus of land and water. To reflect that nexus, education will occur both in the classroom and on the water, aboard the Aquarium’s hybrid-electric research vessel, Spirit of the Sound. An exhibit featuring NOAA educational assets related to threats and resilience will also build environmental literacy as it engages Aquarium visitors. The project will be supported by an advisory board of local educators, planning and emergency management officials, representatives from Connecticut Sea Grant, the Connecticut Institute for Resilience and Climate Adaptation and the Western Connecticut Council of Governments.
NatureStart Network brought together early childhood educators and environmental educators to support nature play, exploration, and inquiry for young children and their families within urban environments. Project partners included the Forest Preserves of Cook County and two established Head Start programs in the Chicago area, Mary Crane Center and El Valor. The foundation of the project was a series of three two-day professional learning sessions that took place over an eighteen month period. Through hands-on, collaborative learning and reflection activities, the participating educators