Hanohano o Oahu: The Geology and Moolelo of Kona to Ewa project will provide learning opportunities for 500 fourth grade students and their teachers from ten public schools located in central and leeward Oahu, Hawaii. A geology unit will be developed that includes a 90-minute class presentation, hands-on classroom activities, a Discovery Box to extend learning opportunities, and a full-day (5-hour) field trip experience. The multi-stop bus tour will be centered on the moku (district) of Kona and Ewa and highlight significant Oahu cultural sites, their moolelo (stories, history) and geology. A culture-based student activity booklet, hands-on activities, and other education materials will also be developed for the unit. The project will target rural communities with underserved families, large Hawaiian homestead neighborhoods, and little access to museum services. Participation in the programming will provide students and teachers with a better understanding of the connection between scientific information and Hawaiian knowledge.
The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
The Monterey Bay Aquarium is planning to redesign existing conservation-related interactives as well as add new experiences on the Aquarium floor. In preparation for this project, the Aquarium sought to gain a better understanding of visitors’ awareness of and engagement in conservation-related actions and responses to conservation-related messaging. The Aquarium contracted with MWA Insights to conduct a front-end evaluation study to help inform the planning for these conservation stations. Specifically, the evaluation sought to understand:
Are visitors aware of issues affecting the
This poster presents the overall approach of the project and was presented at the NSF AISL PI meeting in February 2019 by the PI.
This pilot research seeks to understand how informal learning experiences called mapathons are viable pathways for veterans to transition to the civilian workforce. The conceptual approach pays attention to the realities of the life course of military and veteran families, especially building upon theories of change related to transitions that include a spatial component.
DATE:
TEAM MEMBERS:
Patricia SolisDennis PattersonMelanie Hart
With the acceleration and increasing complexity of macro-scale problems such as climate change, the need for scientists to ensure that their work is understood has become urgent. As citizens and recipients of public funds for research, scientists have an obligation to communicate their findings in ways many people can understand. However, developing translations that are broadly accessible without being “dumbed down” can be challenging. Fortunately, tenets of visual literacy, combined with narrative methods, can help to convey scientific knowledge with fidelity, while sustaining viewers’
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase student motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by designing, implementing, and testing an afterschool internship program that will engage older youth in work-based learning experiences in in STEM fields. The new model program will link the resources and learning approaches of the Global Learning and Observations to Benefit the Environment (GLOBE) program to career academies where youth from populations underrepresented in STEM fields will gain direct experiences in data collection and analysis through student-led investigations in the geosciences and environmental studies. Two key outcomes of this project will be: (a) Development of a replicable model of an afterschool STEM internship program for informal STEM learning environments and schools across the nation, and (b) Development of a set of measurement tools and approaches that can assess and promote understanding regarding how youth think and feel about science and their possible future roles in science careers. Participating youth will master scientific practices and become immersed in science culture through opportunities to develop research projects, interact with scientists, and collaborate with fellow student-researchers. In the process, they will develop collaboration and communication skills, and gain an increased sense of identity and agency in science fields. They will also learn new strategies to attain their career goals.
In developing and testing the new model of an afterschool program focusing on STEM careers, the project will draw on both existing and emerging knowledge from three areas of inquiry: informal STEM learning, youth development, and work-based learning. The project will bring together theory related to work-based learning and apprenticeship to knowledge about informal STEM learning and youth development, addressing the needs of older youth as they transition to adulthood. The program will also explore the use of measurement tools that address workforce-related student learning goals in addition to social-emotional learning and STEM learning goals, adapting existing tools and developing new tools as needed. The result will be a replicable model for an afterschool, career-focused internship that facilitates STEM learning and identity, employing youth development principles, such as experiential learning, peer collaboration, adult mentoring, and meaningful contributions to the world beyond school. The project will use a mixed-methods approach to investigate four research questions: (1) What aspects of the program are most important for promoting the development of scientific practices, socio-emotional learning, and career skills? (2) How can afterschool informal science learning be designed to address the perceptions and needs of diverse groups, especially those from populations underrepresented in STEM? (3) How do youth make gains in developing facility with STEM practices, key social-emotional outcomes needed in work and civic life, and career development knowledge? And (4) How do we accurately measure development of scientific practices, socio-emotional learning and career skills? The project will develop pretest and posttest self-report measures to gauge program influence on social-emotional outcomes and career-related outcomes, and performance-based assessments and rubrics will be used to assess culminating science projects. Other factors contributing to the success of the new model will be examined through analysis of coach instructional logs, surveys, and questions, as well as participant observations, interviews, and focus groups. Project participants will be youth of ages 14-18 recruited from ten inner-city schools having large populations of students from groups underrepresented in STEM fields. Participants will meet in teams of approximately 14 interns for a total of 2.5 hours per week for 32 weeks. Each team will also meet an additional 4-6 times for weekend or overnight outings associated with their study sites.
DATE:
-
TEAM MEMBERS:
Manuel AlonsoCathy RingstaffSvetlana Darche
This research in service to practice project will examine the impact of a 12-year statewide science field trip program called LabVenture. This hands-on program in discovery and inquiry brings middle school students and teachers across the State of Maine to the Gulf of Maine Research Institute (GMRI) in Portland, Maine to become fully immersed in explorations into the complexities of local marine science ecosystems. These intensive field trip experiences are led by informal educators and facilitated entirely within informal contexts at GMRI. Approximately 70% of all fifth and sixth grade students in Maine participate in the program each year and more than 120,000 students have attended since the program's inception in 2005. Unfortunately, little is known to date on how the program has influenced practice and learning ecosystems within formal, informal, and community contexts. As such, this research in service to practice project will employ an innovative research approach to understand and advance knowledge on the short and long-term impacts of the program within different contexts. If proven effective, the LabVenture program will elucidate the potential benefits of a large-scale field trip program implemented systemically across a community over time and serve as a reputable model for statewide adoption of similar programs seeking innovative strategies to connect formal and informal science learning to achieve notable positive shifts in their local, statewide, or regional STEM learning ecosystems.
Over the four-year project duration, the project will reach all 16 counties in the State of Maine. The research design includes a multi-step, multi-method approach to gain insight on the primary research questions. The initial research will focus on extant data and retrospective data sources codified over the 12-year history of the program. The research will then be expanded to garner prospective data on current participating students, teachers, and informal educators. Finally, a community study will be conducted to understand the potential broader impacts of the program. Each phase of the research will consider the following overarching research questions are: (1) How do formal and informal practitioners perceive the value and purposes of the field trip program and field trip experiences more broadly (field trip ontology)? (2) To what degree do short-term field trip experiences in informal contexts effect cognitive and affective outcomes for students? (3) How are community characteristics (e.g., population, distance from GMRI, proximity to the coast) related to ongoing engagement with the field trip program? (4) What are aspects of the ongoing field trip program that might embed it as an integral element of community culture (e.g., community awareness of a shared social experience)? (5) To what degree does a field trip experience that is shared by schools across a state lead to a traceable change that can be measured for those who participated and across the broader community? and (6) In what ways, if at all, can a field trip experience that occurs in informal contexts have an influence on the larger learning ecosystem (e.g., the Maine education system)? Each phase of the research will be led by a team of researchers with the requisite expertise in the methodologies and contexts required to carry out that particular aspect of the research (i.e., retrospective study, prospective study, community study). In addition, evaluation and practitioner panels of experts will provide expertise and guidance on the research, evaluation, and project implementation. The project will culminate with a practitioner convening, to share project findings more broadly with formal and informal practitioners, and promote transfer from research to practice. Additional dissemination strategies include conferences, network meetings, and peer-reviewed publications.
The potential insights this research could garner on intersectionality between formal and informal STEM learning are substantial. As a consequence, this project is co-funded by the Advancing Informal STEM Learning (AISL) and Discovery Research K-12 (DRK-12) Programs. The Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. Likewise, the Discovery Research-K12 Program seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This project develops and examines place-based learning using mobile augmented reality experiences for rural families where museums and science centers are scarce yet where natural resources are rich with outdoor trails, parks, and forestlands. The collaborative research team, with members from rural libraries, outdoor learning centers, learning scientists at Penn State University, and rural communities in Pennsylvania, will develop augmented reality and mobile learning resources for families and children aged from 4 to 12. The goal is to help people see what is not visible in real-time in order to learn about life and earth sciences based on local watersheds, trees, and seasonal cycles that are familiar and relevant to rural communities. To accomplish this goal, the project team will create scientifically meaningful experiences for rural families and children in their out-of-school time through three iterations of research and design. Although there is evidence that augmented reality can support learning, little empirical research has been conducted to determine what makes one type of augmented learning experience more effective than others in outdoor learning spaces. This project will produce research findings on the utility of augmented reality for science learning with families and youths outdoors. This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants
Through a four-year design-based research study, researchers will investigate three research questions. (1) How can outdoor learning experiences be enhanced with augmented reality and digital resources in ways that make science more visible and interesting?; (2) How do different forms of augmentations on trails and in gardens support science learning? 3) What social roles do children and parents play in supporting each other's science learning and connections to rural communities? Data collection includes video-recordings of children and families in the outdoors, learning analytics of people's behavior, and interviews with rural families. The project's research design will allow for the development of theory, which supports rural families learning science within and about their communities. At the end of the project, the team will offer generalizable design principles for technologically-enhanced informal learning for outdoor displays, gardens, and trails.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This Research in Service to Practice project will study how visual immersion and interactivity in augmented reality (AR) affects visitors' engagement and understanding of science. The research involves creating different versions of an AR exhibit to communicate paleontology research from the La Brea Tar Pits to the general public. Different versions of the exhibit will be compared to learn how design choices for immersion and interactivity impact visitors' engagement and understanding of science. The result of this study should be a model to follow for similar public exhibits, as well as design principles that generalize to AR experiences for a broader range of informal learning environments. This project will also demonstrate and report on specific AR mechanisms that help visitors understand the scientific process and increase knowledge about paleontology research.
The study includes a user-centered design and evaluation process with both formative and comparative studies. This project investigates two high-level design factors for mobile AR: visual immersion and interactivity. These impact the learning experience and the development so extensively that multiple versions are seldom compared. These factors also have unique considerations for informal settings, such as how to balance immersion against situational awareness (e.g., 3D viewers reduce field of view). One goal of this project is to systematically compare qualitatively different AR designs that convey equivalent science content and study these tradeoffs empirically. The second goal is to leverage these findings to publicly release an AR experience that promotes engagement, increases understanding of science, and reduces scientific misconceptions. This research will also contribute to understanding usability and logistical issues for different AR designs for public, outdoor, informal settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Emily LindseyBenjamin NyeGale SinatraWilliam Swartout
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for STEM learning in a variety of settings. Many military veterans who seek to transition to higher education or workforce pathways find it challenging to translate the skills they acquired during service to civilian STEM settings and the modern day workforce. Yet many returning veterans have significant experience with STEM fields, including mapping and geospatial technologies, because of their unique functions and service assignments. Such geospatial skills are useful for location-aware industries, citizen science and public services. At the same time, military and veteran families have been largely overlooked as an important public audience for focused informal STEM learning. Informal learning events called "mapathons" which enlists participants to mapping exercises and create geospatial data on open platforms that address authentic needs in their communities and the broader society at large. When seeking to further their education upon returning from service, veterans' typical options have included some form of formal higher education. Mapathons may be a feasible bridging activity that (a) recognizes veterans' unique, valuable, and in-demand STEM skills and (b) supports lifelong learning.
This pilot research seeks to understand how informal learning experiences such as mapathons are viable pathways for veterans to transition to the civilian workforce. The conceptual approach pays attention to the realities of the life course of military and veteran families, especially building upon theories of change related to transitions to include a spatial component. The foundation of the project's intellectual merit is its explicit inclusion and sensitivity to place, scale, and spatial behavior, building directly from findings of prior NSF-funded projects and the evidence base for informal learning pathways. The research will contribute to knowledge about workforce development by addressing the questions: (1) To what extent do veterans recognize that their extant skills acquired, in military settings, are translatable to civilian STEM settings?; (2) How can informal learning experiences help a diverse veteran population increase awareness of the translatability of geospatial workforce competencies, build confidence in technology skills, and motivate interest to pursue formal studies in STEM fields in general?; and (3) What pathways do which veterans favor when they could pursue formal STEM higher education learning among an array of choices online or at regional sites, and why? The study will engage 320 participants at 8 sites across Texas; employ in-depth surveys and interviews; and use spatial analysis to elicit insights about the research questions.
Military and veteran families include a significant number of people from group typically underrepresented in STEM fields. Supporting more veterans to transition successfully to higher education pathways or careers in STEM is a vital service to the nation. This study on informal to formal pathways for veterans will include an innovative understanding of the importance of place in meaning-making and in the reality of choices they consider during the transitions of their life course.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Patricia SolisMelanie HartDennis Patterson
This document contains the following Appendices that provide information for the I/CaLL Community Science Learning study.
Appendix A: StreamLines Events
Appendix B: StreamLines Events Survey Instrument
Appendix C: Art + Science Brainstorm Coding Themes
Appendix D: Art + Science Brainstorm Flyer