The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
This poster presents the overall approach of the project and was presented at the NSF AISL PI meeting in February 2019 by the PI.
This pilot research seeks to understand how informal learning experiences called mapathons are viable pathways for veterans to transition to the civilian workforce. The conceptual approach pays attention to the realities of the life course of military and veteran families, especially building upon theories of change related to transitions that include a spatial component.
DATE:
TEAM MEMBERS:
Patricia SolisDennis PattersonMelanie Hart
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for STEM learning in a variety of settings. Many military veterans who seek to transition to higher education or workforce pathways find it challenging to translate the skills they acquired during service to civilian STEM settings and the modern day workforce. Yet many returning veterans have significant experience with STEM fields, including mapping and geospatial technologies, because of their unique functions and service assignments. Such geospatial skills are useful for location-aware industries, citizen science and public services. At the same time, military and veteran families have been largely overlooked as an important public audience for focused informal STEM learning. Informal learning events called "mapathons" which enlists participants to mapping exercises and create geospatial data on open platforms that address authentic needs in their communities and the broader society at large. When seeking to further their education upon returning from service, veterans' typical options have included some form of formal higher education. Mapathons may be a feasible bridging activity that (a) recognizes veterans' unique, valuable, and in-demand STEM skills and (b) supports lifelong learning.
This pilot research seeks to understand how informal learning experiences such as mapathons are viable pathways for veterans to transition to the civilian workforce. The conceptual approach pays attention to the realities of the life course of military and veteran families, especially building upon theories of change related to transitions to include a spatial component. The foundation of the project's intellectual merit is its explicit inclusion and sensitivity to place, scale, and spatial behavior, building directly from findings of prior NSF-funded projects and the evidence base for informal learning pathways. The research will contribute to knowledge about workforce development by addressing the questions: (1) To what extent do veterans recognize that their extant skills acquired, in military settings, are translatable to civilian STEM settings?; (2) How can informal learning experiences help a diverse veteran population increase awareness of the translatability of geospatial workforce competencies, build confidence in technology skills, and motivate interest to pursue formal studies in STEM fields in general?; and (3) What pathways do which veterans favor when they could pursue formal STEM higher education learning among an array of choices online or at regional sites, and why? The study will engage 320 participants at 8 sites across Texas; employ in-depth surveys and interviews; and use spatial analysis to elicit insights about the research questions.
Military and veteran families include a significant number of people from group typically underrepresented in STEM fields. Supporting more veterans to transition successfully to higher education pathways or careers in STEM is a vital service to the nation. This study on informal to formal pathways for veterans will include an innovative understanding of the importance of place in meaning-making and in the reality of choices they consider during the transitions of their life course.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Patricia SolisMelanie HartDennis Patterson
A mixed-methods series of surveys were used to explore public literacy related to environmental science and sustainability in Indianapolis. Surveys also explored predictive variables including environmental identity, nature affinity, use of nature places as learning opportunities, and motivations for visiting nature spaces. An online, citywide consumer survey was distributed alongside a parallel identical survey of employees at a major science-based corporation to assess variation in knowledge, attitudes, and learning behaviors. This science-based corporation provides substantial support to
DATE:
TEAM MEMBERS:
John FraserSu-Jen RobertsNezam Ardalan
Summative evaluation of one of four pieces of the Marcellus Matters: EASE project. This study examined the effectiveness of a series of environmental planning workshops geared toward local community members in counties across Pennsylvania.
Digital Observation Technology Skills (DOTS) is a framework for integrating modern, mobile technology into outdoor, experiential science education. DOTS addresses longstanding tensions between modern technology and classical outdoor education by carefully selecting appropriate digital technology for educational purposes and by situating these tools in classical experiential pedagogy.
DATE:
TEAM MEMBERS:
R. Justin HoughamMarc NutterCaitlin Graham
Community education with regard to science comes in many forms and is usually designed to address issues within that community. In this proposal, land use is the focus. This is a general topic and applicable in nearly all locations within communities and in the State. In this case, the topic is used to educate adults and high school students providing each with unique identities. Using satellite-enabled tools, the topology of an area can be mapped in detail and assessed for use thus enabling science education for both adults and high school students. The studies will involve intergenerational learning which is an area needing additional study. Also, the proposers are going to broaden the scope so that it impacts several different areas in the State of Connecticut. This is important because in doing so it will include the diversity of cultures within the State and the education results will reflect this diversity. As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This proposed effort aims to promote lifelong STEM learning through a focus on conservation, geospatial technology and community engagement. The goals are to: (1) develop particular STEM knowledge and skills, and foster STEM identity authoring/learning in two disparate groups of lifelong learners, and (2) gain a deeper understanding of the ways that this learning occurs through research and evaluation. The project will develop an educational program that focuses on conservation science and recent advances in web-enabled geospatial technologies (geographic information systems, remote sensing, and global positioning systems) that, for the first time, make these technologies accessible and attainable for the public. The focus will be on urban and rural areas with underrepresented populations of STEM learners. Two groups of lifelong learners will be targeted: adult volunteers involved with community land conservation issues, and high school-aged adolescents enabling the project to investigate the processes and impacts of intergenerational learning.
DATE:
-
TEAM MEMBERS:
John VolinDavid MossDavid CampbellChester ArnoldCary Chadwick
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. In this project, the primary goal of Geo-literacy Education in Micronesia is to demonstrate the potential for effective intergenerational, informal learning and development of geo-literacy through an Informal STEM Learning Team (ISLT) model for Pacific island communities. This will be accomplished by means of a suite of six informal learning modules that blend local/Indigenous approaches, Western STEM knowledge systems, and active learning. This project will be implemented across 12 select communities in the Republic of Palau, the Federated States of Micronesia - which consists of the four States of Chuuk, Kosrae, Pohnpei, and Yap - and the Republic of the Marshall Islands. Jointly, these entities are referred to as the Freely Associated States (FAS). Geo-literacy refers to combining both local knowledge and Western STEM into a synthesized understanding of the world as a set of interconnected, dynamic physical, biological, and social systems, and using this integrated knowledge to make informed decisions. Applications include natural resource management, conservation, and disaster risk reduction. The project will: (1) demonstrate that the recruitment and development of an ISLT model is an effective method of engaging communities in geo-literacy activities; (2) increase geo-literacy knowledge and advocacy skills of ISLT participants; (3) produce and disseminate geo-literacy educational materials and resources (e.g., place-based teaching guides, geospatial data systems, educational apps, 2-D and 3-D models, and digital maps); and (4) provide evidence that FAS residents use these geo-literacy educational materials and resources to positively influence decision-making.
DATE:
-
TEAM MEMBERS:
Corrin BarrosKoh Ming WeiDanko TabrosiEmerson Odango
Pipeline for Remote Sensing Education and Application (PRSEA), will increase awareness, knowledge and understanding of remote sensing technologies and associated disciplines, and their relevance to NASA, through a combination of activities that build a “pipeline” to STEM and remote sensing careers, for a continuum of audiences from third grade through adulthood. This program will be led by Pacific Science Center. The first objective is to engage 50 teens from groups underrepresented in STEM fields in a four-year career ladder program; participants will increase knowledge and understanding of remote sensing as well as educational pathways that lead to careers in remote sensing fields at NASA and other relevant organizations. The second objective is to serve 2,000 children in grades 3-5, in a remote sensing-based out-of school time outreach program that will increase the participant’s content knowledge of remote sensing concepts and applications and awareness and interest in remote sensing disciplines. PRSEA’s third objective is to engage 180 youth, grades 6-8, in remote sensing-themed summer intensive programs through which youth will increase knowledge of remote sensing concepts and applications and increase awareness and interest in educational and career pathways associated with remote sensing and NASA’s role in this field. The final objective is to engage 10,000 visitors of all ages with a remote sensing-themed Discovery Cart on Pacific Science Center’s exhibit floor. By engaging in cart activities, we anticipate visitors will increase their level of awareness and interest in the topic of remote sensing and NASA’s role in contributing to this field.
The Chicago Zoological Society (CZS) in collaboration with Eden Place Nature Center, the Fuller Park Community Corporation, and the University of Illinois at Chicago (UIC) will implement the SCIENCES Program, Supporting a Community's Informal Education Needs: Confidence and Empowerment in STEM. The primary goals of this Full Scale Development project are to broaden access to and participation in environmental science, strengthen partnerships between CZS, Eden Place, and UIC, and gain insights into the 'ecosystemic' learning model which promotes scientific literacy and agency in the community. The project targets a low-resource community with a minority audience while the secondary audience is informal science learning organizations and researchers who will advance research in informal learning. The theoretical framework for the project design draws on conservation psychology, informal science learning, civic ecology education, and urban science education to create an ecosystematic, geographically centered approach. The deliverables include research, curriculum, and engaging hands-on programs for youth, families, adults, and teachers, reaching both in-school and out-of-school audiences, in addition to the SCIENCES Implementation Network. Three potential curriculum themes to be explored are water conservation and protection, pollinators for healthy ecosystems, and community resilience to climate change. The SCIENCES project offers a comprehensive suite of engaging programs for community audiences. For example, the year-long Zoo Adventure Passport (ZAP) program for families includes hands-on experiments and field trips, while project-based learning experiences enable teens to create wetlands, design interpretive signage, and develop associated public programming. School-based programs include professional development for teachers on the Great Lakes ecosystem and invasive species. Existing programs that have been previously evaluated and demonstrated to show learning impacts will be adapted and modified to meet the goals of the ecosystemic learning model by providing multiple learning opportunities. New learning resources will also be created to support the content themes and provide continuity. The result will be a comprehensive approach that ensures deep community engagement by individuals, families, and organizations, with cohesiveness provided by the overarching content themes which broaden access to STEM learning resources and leverages partnerships. The project includes both a research and evaluation plan. The primary research question to be addressed is: How does a large informal science learning institution work with a community-based organization to support environmental scientific literacy and agency at all levels of the community? A sociocultural framework will be used for this mixed-methods case study research. Study participants include community leaders, youth, parents, teachers, and staff from Eden Place. The case study sample will include 20 focal individuals drawn from the participant groups and approximately 300 survey participants. Case study data will be triangulated with evaluation data and analyzed using a grounded theory approach. By examining changes from the baseline following the implementation of the community programs, the findings may provide insight on agency and science literacy among community members. The comprehensive, mixed-methods evaluation plan employs a quasi-experimental design and incorporates front-end, formative, and summative evaluation components. The evaluation questions address the quality of the processes and products, access to environmental science learning opportunities, environmental science literacy, sustainability, and barriers to implementation. An extensive dissemination plan is proposed with a dual emphasis on meeting stakeholders' needs at multiple levels. The evaluation and research teams will emphasize publication in peer reviewed journals and presentations at conferences for informal science education professionals. Findings will be shared with the Fuller Park community stakeholders using creative methods such as one-page research briefs written in layperson's language, videos, and recorded interviews with participants. The local project Advisory Board will also be actively involved in the dissemination of findings to community constituents. The SCIENCES National Amplification Network will be created and work collaboratively with the American Association of Zoos and Aquariums and the Metropolitan Green Spaces Alliance to disseminate the model. Collectively, the activities and deliverables outlined in this proposal will advance the discovery of sustainable models of community-based learning while the research will advance the understanding of informal learning support for science literacy and agency.