The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
This report looks across multiple phases of work to discuss the PLUM Rx project’s contribution to broader knowledge about supporting children’s active, outdoor science exploration in informal, urban settings. The PLUM LANDING Explore Outdoors Toolkit that resulted from this work is designed for use by outdoor prescription programs and a broad range of informal education programs serving urban children and families. This report describes (1) the rationale for the design principles that guided Toolkit development, (2) the Toolkit components developed in accordance with the design principles; and
Supported by the National Science Foundation, the Global Soundscapes! Big Data, Big Screens, Open Ears project employs a variety of informal learning experiences to present the physics of sound and the new science of soundscape ecology. The interdisciplinary science of soundscape ecology analyzes sounds over time in different ecosystems around the world. The major components of the Global Soundscapes project are an educator-led interactive giant-screen theater show, group activities, and websites. All components are designed with both sighted and visually impaired students in mind. Multimedia
Schools often have limited resources to devote to science education, which can impact student interest in and preparedness for careers in STEM. Seattle Children’s Research Institute created the Science Adventure Lab, a mobile laboratory program, to support and enrich science education at low-resource schools and stimulate interest in science and pursuing a career in STEM. The mobile laboratory provides students with the unique opportunity to fully immerse themselves in authentic, hands-on science learning with scientists. This limits the burden on school resources and reduces disruptions to
DATE:
TEAM MEMBERS:
William H RodenRebecca HowsmonRebecca A CarterMark RuffoAmanda L Jones
Many urban New Yorkers believe that the Hudson River is so polluted that nothing could possibly live there. In reality, the estuary is thriving, and The River Project (TRP), a marine science field station in lower Manhattan, exists to showcase its vast biodiversity through place-based education. In 2014, TRP began collaborating on a city-wide initiative with New York Harbor Foundation and eight other partner organizations to integrate restoration science into Title I middle school curricula through the Curriculum and Community Enterprise for Restoration Science (CCERS). Teachers in the
DATE:
TEAM MEMBERS:
Elisa CarefMelissa RexAnnie LederbergGaylen Moore
resourceresearchWebsites, Mobile Apps, and Online Media
This brief discusses the PLUM LANDING Explore Outdoors Toolkit, a new set of free, public media resources designed to help informal educators and parents infuse science learning into outdoor recreation. Developed by trusted media producer WGBH in partnership with researchers at Education Development Center (EDC), the Toolkit aims to get children (ages 6–9) from low-income, urban communities outside so they can explore the environment around them while debunking the myth that nature is something that only exists beyond city limits.
DATE:
TEAM MEMBERS:
Marion GoldsteinElizabeth PiersonJamie KynnLisa Famularo
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This Change Makers project will establish Food Justice Ambassador corps across three cities in Massachusetts where youth will install, manage and learn the science and technology underlying hydroponics. The project takes a near-peer mentoring approach that empowers high school youth to take the lead in improving ethnic minority and low-income residents' access to healthy produce and to help educate middle school youth regarding the value of fresh produce in one's diet by learning the science of hydroponics. Youth will create story maps to visualize food accessibility in their communities. High school youth will work with their communities to establish hydroponic farms in middle school after-school settings. The food that is grown will be provided to the community through farmers' markets. Youth will share their work with a larger community of urban farmers at the Massachusetts Urban Farming Conference. This project seeks to understand the contribution on youth development by the model's three components: (1) STEM learning embedded in a social justice framework, (2) near-peer mentoring, and (3) youth purpose and career development. This will enable researchers to better understand how the project enables youth to learn STEM skills; apply them to a real life problem; learn the relevance of STEM skills for addressing personal, career aspiration, and social justice issues; develop a sense of purpose and aspirations related to STEM fields; and mentor other youth through the same process. The project will use a mixed-method, multi-site longitudinal study utilizing quantitative surveys, structural equation modeling, and qualitative interviews to study the intersections of the components of the project. As such, the study will address three key questions: 1) How do youth and mentors perceive and experience their roles as participants in the pedagogy? 2) What is the impact of the intervention on youth' sense of purpose, identity, career adaptability, work volition, critical consciousness, school engagement, STEM interests, and STEM intentionality? 3) What is the contribution of relational/mentoring and psychosocial/career adaptability aspects of the youths' contexts on their capacity to benefit from this program and to develop and sustain purpose and engagement in school and STEM? Most urban youth (and adults) have little knowledge of where their food comes from and have limited opportunities to learn how to grow produce as well as develop related skills that can lead to a career in a STEM field. This is particularly disconcerting as 55% of African Americans live inside central cities (90% in metropolitan areas) and over half of all Latino/as live in central cities (United States Census Bureau, 2011). This project entails the recruitment of low-income youth from populations underrepresented in science into a program where social justice concerns (food justice, food security) are illuminated, analyzed, and acted upon through the development of STEM knowledge and skills. Specifically, this project recognizes the potential for urban youth to become deeply knowledgeable citizens who can mobilize their STEM knowledge and skills to resolve social injustices such as food deserts. If successful, this project will provide a model that should be transferable to similar contexts to help broaden participation in STEM.
DATE:
-
TEAM MEMBERS:
George BarnettBelle LiangDavid Blustein
Lineage is a comprehensive educational media and outreach initiative that will engage individuals and families in learning about deep time and evolution, helping audiences come to newfound understandings of the connections between the past, present, and future of life on Earth. The project is a partnership between Twin Cities PBS (TPT) and the Smithsonian Institution's National Museum of Natural History and is linked to the opening of that museum's new Deep Time Fossil Hall in June 2019. The project includes a two-hour film for national broadcast on PBS, and a 20-minute short version for exhibition in science centers. The documentaries will show how scientists, using paleontology, genetics, earth science and other disciplines, can reconstruct in detail the origins of living animals like birds and elephants, revealing their ancient past as well as evidence of ecological change that can inform our understanding of Earth today. Extensive educational outreach will include the creation of "Bone Hunter," an innovative VR (Virtual Reality) game designed for family co-play that engages multiple players in the process of paleontology as they piece together a fossil in a digital lab. Bone Hunter and other collaborative educational activities will be deployed at Family Fossil Festivals that will attract multi-generational learners. One such Festival will take place at the Smithsonian Institution in Washington, D.C., while others will be based at geographically diverse institutions that serve underserved rural as well as urban communities. Lineage is a collaboration between national media producers, noted learning institutions and researchers, including Twin Cities Public Television, the Smithsonian Institution / National Museum of Natural History, Schell Games, the Institute for Learning Innovation (ILI), and Rockman et al. One of the project's primary innovations is its exploration of new learning designs for families that use cutting-edge technologies (e.g. the Bone Hunter virtual reality game) and collaborative multi-generational learning experiences that advance science knowledge and inquiry-based learning. An external research study conducted by ILI will investigate how intergenerational co-play with physical artifacts compared to virtual artifacts influences STEM (Science Technology Engineering Mathematics) learning and engagement. The findings will lead to critical strategic impacts for the field, building knowledge about ongoing innovation in the free choice learning space. The project's external evaluation will be conducted by Rockman et al and evaluative findings, as well as the educational materials derived from the project, will be widely disseminated through partnerships with professional and educator groups. Clips from the Lineage film and related learning resources will be hosted on PBS LearningMedia, so educators can incorporate these resources into their classrooms, and students and lifelong learners can explore and discover on their own. The project outcomes will have broad impact on public audiences, deepening and advancing knowledge and understanding about important scientific concepts, and promoting continued, family-based collaborative learning experiences to expand and deepen STEM knowledge. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning.
A frequently missing element in environmental education programs is a concerted effort by communities, organizations, government, and academic stakeholders to build meaningful partnerships and cultivate informal science learning opportunities via public participation in environmental research. This collaborative approach not only makes scientific information more readily available, it also engages community members in the processes of scientific inquiry, synthesis, data interpretation, and the translation of results into action. This project will build a co-created citizen science program coupled with a peer education model and an extensive communication of results to increase environmental STEM literacy. The project targets historically underrepresented populations that are likely to be disproportionately impacted by climate, water scarcity, and food security. Based upon past needs assessments in the targeted communities, gardens irrigated by harvested rainwater will become hubs for environmental STEM education and research. For this project, gardens irrigated by harvested rainwater will serve as hubs for environmental literacy education efforts. Researchers from the University of Arizona and Sonora Environmental Research Institute will work alongside community environmental health workers, who will then train families residing in environmentally compromised areas (urban and rural) on how to monitor their soil, plant, and harvested water quality. The project aims to: (1) co-produce environmental monitoring, exposure, and risk data in a form that will be directly relevant to the participants' lives, (2) increase the community's involvement in environmental decision-making, and (3) improve environmental STEM literacy and learning in underserved rural and urban communities. The project will investigate and gather extensive quantitative and quantitative data to understand how: (1) participation in a co-created citizen science project enhances a participant's overall environmental STEM literacy; (2) a peer-education model coupled with a co-created citizen science program affects participation of historically underrepresented groups in citizen science; and (3) the environmental monitoring approach influences the participant's environmental health learning outcomes and understanding of the scientific method. In parallel, this project will evaluate the role of local-based knowledge mediators and different mechanisms to communicate results. These findings will advance the fields of informal science education, environmental science, and risk communication. Concomitantly, the project will facilitate the co-generation of a robust dataset that will not only inform guidelines and recommendations for harvested rainwater use, it will build capacity in underserved communities and inform the safe and sustainable production of food sources. This research effort is especially critical for populations in arid and semiarid environments, which account for ~40% of the global land area and are inhabited by one-third of the world's population. This program will be available in English and Spanish and can truly democratize environmental STEM research and policy. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
This project will research factors influencing the implementation of programs designed to increase diverse participation in informal science. The goal is to provide the informal science education field with information and tools that will help them design effective programs that more effectively engage a broad range of diverse audiences. The project has two major components. First, the project will research the implementation of a citizen science project, Celebrate Urban Birds (CUB), in major U.S. cities. Citizen science projects involve public volunteers in gathering scientifically valid data as part of ongoing research. Second, building on results of the research, the project will launch a website and learning community (called a Community of Practice or CoP) supporting informal science educators that are involved in designing and implementing informal science programs with an emphasis on engaging diverse participants. The project will be lead by the Cornell Lab of Ornithology (CLO), a leader in designing and researching citizen science projects, in collaboration with the Association of Science-Technology Centers (ASTC) and five science center members of ASTC, where the CUB program will be implemented and researched. The objective of the research is to better understand contextual factors and how they impact implementation even when accepted practices are followed. Such research is key not only to revealing accepted practices but also to understanding how projects are implemented in the face of concrete operational, cultural, economic, and demographic variables. The research will use a comparative case study approach, which is designed for studies requiring holistic, in-depth investigation. The development of the website and the CoP will be guided by a Network Improvement Strategy, a research-based approach to designing educational CoPs. The development of the CoP will involve the project stakeholders including the informal science organization practitioners, community organization representatives, CUB staff, ASTC staff, advisors and consultants. This strategy will allow the project team and pilot sites to leverage their diverse experiences and skill sets to improve practice; provide space for researchers and practitioners to work together as partners; and develop a nuanced set of strategies that can be implemented across a variety of organizational contexts.
The Chicago Zoological Society (CZS) in collaboration with Eden Place Nature Center, the Fuller Park Community Corporation, and the University of Illinois at Chicago (UIC) will implement the SCIENCES Program, Supporting a Community's Informal Education Needs: Confidence and Empowerment in STEM. The primary goals of this Full Scale Development project are to broaden access to and participation in environmental science, strengthen partnerships between CZS, Eden Place, and UIC, and gain insights into the 'ecosystemic' learning model which promotes scientific literacy and agency in the community. The project targets a low-resource community with a minority audience while the secondary audience is informal science learning organizations and researchers who will advance research in informal learning. The theoretical framework for the project design draws on conservation psychology, informal science learning, civic ecology education, and urban science education to create an ecosystematic, geographically centered approach. The deliverables include research, curriculum, and engaging hands-on programs for youth, families, adults, and teachers, reaching both in-school and out-of-school audiences, in addition to the SCIENCES Implementation Network. Three potential curriculum themes to be explored are water conservation and protection, pollinators for healthy ecosystems, and community resilience to climate change. The SCIENCES project offers a comprehensive suite of engaging programs for community audiences. For example, the year-long Zoo Adventure Passport (ZAP) program for families includes hands-on experiments and field trips, while project-based learning experiences enable teens to create wetlands, design interpretive signage, and develop associated public programming. School-based programs include professional development for teachers on the Great Lakes ecosystem and invasive species. Existing programs that have been previously evaluated and demonstrated to show learning impacts will be adapted and modified to meet the goals of the ecosystemic learning model by providing multiple learning opportunities. New learning resources will also be created to support the content themes and provide continuity. The result will be a comprehensive approach that ensures deep community engagement by individuals, families, and organizations, with cohesiveness provided by the overarching content themes which broaden access to STEM learning resources and leverages partnerships. The project includes both a research and evaluation plan. The primary research question to be addressed is: How does a large informal science learning institution work with a community-based organization to support environmental scientific literacy and agency at all levels of the community? A sociocultural framework will be used for this mixed-methods case study research. Study participants include community leaders, youth, parents, teachers, and staff from Eden Place. The case study sample will include 20 focal individuals drawn from the participant groups and approximately 300 survey participants. Case study data will be triangulated with evaluation data and analyzed using a grounded theory approach. By examining changes from the baseline following the implementation of the community programs, the findings may provide insight on agency and science literacy among community members. The comprehensive, mixed-methods evaluation plan employs a quasi-experimental design and incorporates front-end, formative, and summative evaluation components. The evaluation questions address the quality of the processes and products, access to environmental science learning opportunities, environmental science literacy, sustainability, and barriers to implementation. An extensive dissemination plan is proposed with a dual emphasis on meeting stakeholders' needs at multiple levels. The evaluation and research teams will emphasize publication in peer reviewed journals and presentations at conferences for informal science education professionals. Findings will be shared with the Fuller Park community stakeholders using creative methods such as one-page research briefs written in layperson's language, videos, and recorded interviews with participants. The local project Advisory Board will also be actively involved in the dissemination of findings to community constituents. The SCIENCES National Amplification Network will be created and work collaboratively with the American Association of Zoos and Aquariums and the Metropolitan Green Spaces Alliance to disseminate the model. Collectively, the activities and deliverables outlined in this proposal will advance the discovery of sustainable models of community-based learning while the research will advance the understanding of informal learning support for science literacy and agency.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This project will develop and study a cyber-enhanced informal learning environment to improve observational practices and classification skills among citizen scientists. The project will focus on the taxonomic identification skills needed by volunteers to provide high-quality data for water quality monitoring of local streams, lakes, estuaries, wetlands, and ground water resources. To make the task of identifying freshwater insects easier and more engaging, the project will develop an innovative educational resource, the Macroinvertebrate Identification Training Environment, that will use zoomable high-resolution images, interactive media, and annotations of diagnostic features to improve perceptual skills. The goal is to increase the confidence and accuracy of volunteers engaged in identification tasks, while also increasing the reliability and quality of the data they are generating for purposes of scientific research and conservation efforts. This interdisciplinary design research and development project will use networked gigapixel image technology to create a visual environment where users can move seamlessly from full panoramic views of macroinvertebrates to extreme close-ups, with embedded text, images, graphics, audio, and video at various locations and zoom levels. This system will be developed in concert with a cognitive apprenticeship training model designed through a series of design studies. The design studies will be conducted over a two-year period and will include examination of the distinguishing features of various biomonitoring programs, reviews of existing training materials and strategies, expert performance analysis of professional entomologists, and development of user interface features. Project developers will collaborate with five regional volunteer biomonitoring organizations to engage a diverse set of volunteers in the design process, including rural populations, older adults, urban youth, and the trainers who support them. The project work will consist of four integrated strands of activity: design-based learning research, creation of an entomological teaching collection, cyberplatform development, and the external evaluation of the training system. The resulting Macroinvertebrate Identification Training Environment will be evaluated in terms of its impacts on volunteer accuracy, confidence, and engagement in taxonomic classification activities related to macroinvertebrates. The impacts of the learning system on trainers and volunteer biomonitoring organizations will also be examined.