This document presents the final evaluation report for the NSF-funded AISL project: "Multimodal Visitor Analytics: Investigating Naturalistic Engagement with Interactive Tabletop Science Exhibits."
This assessment serves as the summative assessment of the IMLS-funded project at KU Biodiversity Institute and Natural History Museum: Natural History Mystery: Immersing families in a problem-solving game using museum collections. The assessment employs a mixed methods approach, in which both quantitative and qualitative data are collected. More specifically, quantitative data are generated from surveys that are administered to participants at the beginning and end of the game and analyzed by using descriptive statistics (i.e., mean, standard deviation, and histogram) and paired sample t-test
In 2019, the Advancing Informal STEM Learning program at the National Science Foundation funded the Advancing Ocean Science Literacy through Immersive Virtual Reality project, a pilot/feasibility and collaborative research project between The Hydrous and the Virtual Human Interaction Lab (VHIL) at Stanford University designed to investigate how immersive virtual reality using head mounted displays can enhance ocean literacy and generate empathy towards environmental issues, particularly among high school girls from different socio-economic backgrounds. The Hydrous was responsible for designing
The Lineage project was a collaboration between Twin Cities Public Television and the Smithsonian’s National Museum of Natural History. The project included creation of a feature-length video program, a Virtual Reality game, and a set of hands-on activities designed for use by multigenerational audiences—all of which were incorporated as part of a series of seven Fossil Festival events at museums and other sites around the United States. This report presents findings from a set of external evaluation studies that examined impacts on families who participated in Fossil Festival events as well
This Smart and Connected Community (SCC) project will partner with two rural communities to develop STEMports, an innovative Science, Technology, Engineering and Mathematics (STEM) learning game for workforce development. The game's activities will take players on localized Augmented Reality (AR) missions to both engage in STEM learning challenges and discover emerging STEM careers in their community, specifically highlighting innovations in the fields of sustainable agriculture and aquaculture, forest products, and renewable energy. Community Advisory Teams (CATs) and co-design teams, including youth, representatives from the targeted emerging STEM economies, and decision-makers will partner with project staff to co-design STEMports that reflect the interests, cultural contexts, and envisioned STEM industries of the future for each community.
The project will: (a) design and pilot an AR game for community STEM workforce development; (b) develop and adapt a community engagement process that optimizes community networking for co-designing the gaming application and online community; and (c) advance a scalable process for wider applications of STEMports. This project is a collaboration between the Maine Mathematics and Science Alliance and the Field Day Lab at the University of Wisconsin-Madison to both build and research the co-designing of a SCC based within an AR environment. The project will contribute knowledge to the informal STEM learning, community development, and education technology fields in four major ways:
Deepening the understanding of how innovative technological tools support rural community STEM knowledge building as well as STEM identity and workforce interest.
Identifying design principles for co-designing the STEMports community related to the technological design process.
Developing social network approaches and analytics to better understand the social dimensions and community connections fostered by the STEMport community.
Understanding how participants' online and offline interactions with individuals and experiences builds networks and knowledge within a SCC.
With the scaling of use by an ever-growing community of players, STEMports will provide a new AR-based genre of public participation in STEM and collective decision making. The research findings will add to the emerging literature on community-wide education, innovative education technologies, informal STEM learning (especially place-based learning and STEM ecosystems), and participatory design research.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The project will develop and research how an emerging technology, immersive virtual reality (IVR) using head mounted displays (HMDs), can enhance ocean literacy and generate empathy towards environmental issues. Recent advances in design have resulted in HMDs that provide viscerally realistic and immersive experiences that situate participants in underwater or other remote environments. IVR can provide many people with virtual access to these environments, including persons with disabilities, people living away from coastal areas, or those who lack access for other reasons (e.g., low-income families, underserved/underrepresented communities, persons untrained in diving). The project will develop a high quality 360-degree underwater film that includes live action footage, animation, and interactive elements. The IVR experience will take the participant through an immersive underwater journey of a Pacific reef, using realistic visualizations, narrative, and a compelling story to engage participants in learning the ecology and biology of coral reefs, as well as the impacts of climate change and human disturbances on ocean ecosystems. In addition to the IVR ocean journey, the project will integrate interactive functionality of being on a reef during mass coral spawning, an annual natural phenomenon through which coral reefs replenish their populations. With hand-held controllers, participants will be able to "swim" through the water, watch the degraded reef recover and grow and will have the ability to change the rate of coral recovery and learn how increases in temperature impede coral recovery. While research has been conducted on early, desk-top versions of IVR, the potential impact of IVR on learning is still unclear. The research findings will help guide the development of IVR for use in informal STEM environments such as aquariums, zoos, science museums, and others. The IVR experience will be shared on online platforms for home viewing, at film festivals and conferences, and in informal learning environments.
The project addresses the need for research on the impacts of IVR devices as it become more affordable and more widely used at home and in other informal and formal environments. Few studies have investigated how design elements impact the user in IVR, in which the increased immersion affects the stimuli perception and cognitive processing. The research will assess the learning affordances and impacts of the IVR experience on participant ocean literacy (adapting items from an existing ocean literacy survey), environmental empathy/feelings of presence (naturalistic observations and post-experience interviews), and perceived self-efficacy (pre-post survey, post-interview interviews). In addition, the project will research how segmentation (i.e., a continuous experience vs. an experience with breaks), generative learning tasks (hands-on experiences and interactive during IVR), and gender of the narrator in an IVR experience supports learning about ocean environments. Researchers will collect data from students attending high schools with predominantly minority student enrollments. Research findings will be widely shared through peer-reviewed publications, conference presentations, and publications for educators and designers.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The Computational Thinking in Ecosystems (CT-E) project is funded by the STEM+Computing Partnership (STEM+C) program, which seeks to advance new approaches to, and evidence-based understanding of, the integration of computing in STEM teaching and learning. The project is a collaboration between the New York Hall of Science (NYSCI), Columbia University's Center for International Earth Science Information Network, and Design I/O. It will address the need for improved data, modeling and computational literacy in young people through development and testing of a portable, computer-based simulation of interactions that occur within ecosystems and between coupled natural and human systems; computational thinking skills are required to advance farther in the simulation. On a tablet computer at NYSCI, each participant will receive a set of virtual "cards" that require them to enter a computer command, routine or algorithm to control the behavior of animals within a simulated ecosystem. As participants explore the animals' simulated habitat, they will learn increasingly more complex strategies needed for the animal's survival, will use similar computational ideas and skills that ecologists use to model complex, dynamic ecological systems, and will respond to the effects of the ecosystem changes that they and other participants elicit through interaction with the simulated environment. Research on this approach to understanding interactions among species within biological systems through integration of computing has potential to advance knowledge. Researchers will study how simulations that are similar to popular collectable card game formats can improve computational thinking and better prepare STEM learners to take an interest in, and advance knowledge in, the field of environmental science as their academic and career aspirations evolve. The project will also design and develop a practical approach to programing complex models, and develop skills in communities of young people to exercise agency in learning about modeling and acting within complex systems; deepening learning in young people about how to work toward sustainable solutions, solve complex engineering problems and be better prepared to address the challenges of a complex, global society.
Computational Thinking in the Ecosystems (CT-E) will use a design-based study to prototype and test this novel, tablet-based collectable card game-like intervention to develop innovative practices in middle school science. Through this approach, some of the most significant challenges to teaching practice in the Next Generation Science Standards will be addressed, through infusing computational thinking into life science learning. CT-E will develop a tablet-based simulation representing six dynamic, interconnected ecosystems in which students control the behaviors of creatures to intervene in habitats to accomplish goals and respond to changes in the health of their habitat and the ecosystems of which they are a part. Behaviors of creatures in the simulation are controlled through the virtual collectable "cards", with each representing a computational process (such as sequences, loops, variables, conditionals and events). Gameplay involves individual players choosing a creature and habitat, formulating strategies and programming that creature with tactics in that habitat (such as finding food, digging in the ground, diverting water, or removing or planting vegetation) to navigate that habitat and survive. Habitats chosen by the participant are part of particular kinds of biomes (such as desert, rain forest, marshlands and plains) that have their own characteristic flora, fauna, and climate. Because the environments represent complex dynamic interconnected environmental models, participants are challenged to explore how these models work, and test hypotheses about how the environment will respond to their creature's interventions; but also to the creatures of other players, since multiple participants can collaborate or compete similar to commercially available collectable card games (e.g., Magic and Yu-Go-Oh!). NYSCI will conduct participatory design based research to determine impacts on structured and unstructured learning settings and whether it overcomes barriers to learning complex environmental science.
This report summarizes evaluative findings from Computational Thinking in Ecosystems project, and the resulting product, i.e., a functional draft of a game called “The Pack.” Evaluative efforts included gathering feedback from key stakeholders—including members of the design based research (DBR) team members at the New York Hall of Science (NYSCI) along with advisors and project partners— about the game and the DBR process, as well as an independent assessment of the game via feedback from educators and a round of play-testing with youth.
Supported by the National Science Foundation, the Global Soundscapes! Big Data, Big Screens, Open Ears project employs a variety of informal learning experiences to present the physics of sound and the new science of soundscape ecology. The interdisciplinary science of soundscape ecology analyzes sounds over time in different ecosystems around the world. The major components of the Global Soundscapes project are an educator-led interactive giant-screen theater show, group activities, and websites. All components are designed with both sighted and visually impaired students in mind. Multimedia
Glaciers around the world are undergoing dramatic changes. Many people, however, have a limited understanding of the scope of these changes because they are geographically distant and difficult to visualize. Although both digital learning tools and online scientific data repositories have greatly expanded over the last decade, there is currently no interface that brings the two together in a way that allows the public to explore these rapidly changing glacial environments. Therefore, to both improve public understanding and provide greater access to already existing resources, the project team will develop the Virtual Ice Explorer to encourage informal learning about glacial environments. This web application will feature an immersive virtual environment and display a suite of environmental data for an array of Earth's glacial systems. An interactive globe will allow users to select from a collection of sites ranging from polar regions to tropical latitudes. Each featured site will offer users an opportunity to interact with (1) a 3D rendering of the landscape; (2) a local map of the site; (3) historical and contemporary photographs of the site; (4) background information text describing the location, past research, and climate impacts; and (5) available environmental data. One of the most original features of the application will be its realistic, immersive 3D rendering of glacial landscapes by combining very high-resolution digital elevation models and satellite imagery with the application's built-in capabilities for immersive virtual environments. Although immersive environments often require expensive equipment, we are maximizing accessibility by developing the Virtual Ice Explorer to run in a web browser and function across various devices. Thus, the application will be available to anyone with internet access, and they can explore at their own pace.
As part of the successful development of Virtual Ice Explorer, the project team will create a platform for digital elevation models to be visualized and explored in 3D by users within the web application; curate digital elevation models, maps, images, text, and environmental data for inclusion in the web application for up to 11 geographically diverse glaciers/glacial landscapes; iteratively user-test the web application with project partners; and design the architecture of the system to readily scale to a larger collection of glaciers/glacial landscapes. To extend dissemination of the final products, the team has partnered with the U.S. Geologic Survey to showcase four benchmark glaciers in their long-term Glaciers and Climate project. In addition to improving understanding of glacier systems in informal learning environments, the project team will explore applications for spatial learning, employment of 3D environments for educational interventions, and use of Virtual Ice Explorer in formal learning environments. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project also has support from the Office of Polar Programs.
DATE:
-
TEAM MEMBERS:
Jason CervenecJesse FoxJulien Nicolas
In this project, education researchers, environmental scientists, and educators will develop a computer tool to let STEM educators and curriculum developers build local environmental science models. The system will use data about land use to automatically construct map-based simulations of any area in the United States. Users will be able to choose from a range of environmental and economic issues to include in these models. The system will create simulations that ask students to change to patterns of land use -- for example, increasing land zoned for housing, or open land, or industrial development -- to try to meet environmental and social goals. As a result, students will be able to learn about the interaction of environmental and economic issues relevant to their own city, town, neighborhood, or region. These map-based simulations will be incorporated into an existing science, technology, engineering, and mathematics (STEM) education tool, Land Science, in which learners work in a fictional planning office to study how zoning affects economic and environmental issues in a community. Research has shown that Land Science is mode effective when learners are exploring issues in an area near their home, and the current study will investigate how and why local simulations improve environmental science learning. This project is funded by the Advancing Informal STEM Learning (AISL) program which supports work to enhance learning in informal environments by funding innovative research, approaches, and resources for use in a variety of settings.
In this project, the research team will build, test, and deploy a toolkit that will allow informal STEM educators and developers of informal STEM programming to easily adapt an existing environmental science learning environment, which consists of a place-based virtual internship in urban planning and ecology, to their local contexts, learning objectives, and learner populations. Land Science is a virtual internship in which young people explore the environmental and socio-economic impacts of land-use decisions. To do so, they play the role of interns at an urban planning firm developing a new land-use proposal for the city of Lowell, Massachusetts: they read reports, virtually visit sites, determine stakeholder priorities, and use a geographic information system (GIS) model to evaluate the socio-economic and environmental impacts of land-use choices. No one plan can satisfy all stakeholders, so learners must compromise to create an effective plan and justify their decisions. Land Science has been shown to improve civic engagement, interest in eco-social issues, and understanding of scientific models, but it is most effective when the location of the virtual internship is in or near the learners' home town. To improve the accessibility and impact of this effective learning intervention, the interdisciplinary research team, which includes learning scientists, land-use experts, and informal STEM educators, will develop a Local Environmental Modeling toolkit, which will allow educators to change the location of the simulation and the stakeholder groups, zoning codes, and environmental and socio-economic indicators included in the land-use model. The system will ensure that the model produced is functional, realistic, and appropriately complex. The localized versions of Land Science produced by informal STEM educators will be used in a range of contexts and locations, allowing the research team to study the effects of an online, place-based learning intervention on environmental science learning, STEM interest and motivation, and civic engagement.
DATE:
-
TEAM MEMBERS:
David ShafferKristen ScopinichHolly GibbsJeffrey Linderoth
Lineage is a comprehensive educational media and outreach initiative that will engage individuals and families in learning about deep time and evolution, helping audiences come to newfound understandings of the connections between the past, present, and future of life on Earth. The project is a partnership between Twin Cities PBS (TPT) and the Smithsonian Institution's National Museum of Natural History and is linked to the opening of that museum's new Deep Time Fossil Hall in June 2019. The project includes a two-hour film for national broadcast on PBS, and a 20-minute short version for exhibition in science centers. The documentaries will show how scientists, using paleontology, genetics, earth science and other disciplines, can reconstruct in detail the origins of living animals like birds and elephants, revealing their ancient past as well as evidence of ecological change that can inform our understanding of Earth today. Extensive educational outreach will include the creation of "Bone Hunter," an innovative VR (Virtual Reality) game designed for family co-play that engages multiple players in the process of paleontology as they piece together a fossil in a digital lab. Bone Hunter and other collaborative educational activities will be deployed at Family Fossil Festivals that will attract multi-generational learners. One such Festival will take place at the Smithsonian Institution in Washington, D.C., while others will be based at geographically diverse institutions that serve underserved rural as well as urban communities. Lineage is a collaboration between national media producers, noted learning institutions and researchers, including Twin Cities Public Television, the Smithsonian Institution / National Museum of Natural History, Schell Games, the Institute for Learning Innovation (ILI), and Rockman et al. One of the project's primary innovations is its exploration of new learning designs for families that use cutting-edge technologies (e.g. the Bone Hunter virtual reality game) and collaborative multi-generational learning experiences that advance science knowledge and inquiry-based learning. An external research study conducted by ILI will investigate how intergenerational co-play with physical artifacts compared to virtual artifacts influences STEM (Science Technology Engineering Mathematics) learning and engagement. The findings will lead to critical strategic impacts for the field, building knowledge about ongoing innovation in the free choice learning space. The project's external evaluation will be conducted by Rockman et al and evaluative findings, as well as the educational materials derived from the project, will be widely disseminated through partnerships with professional and educator groups. Clips from the Lineage film and related learning resources will be hosted on PBS LearningMedia, so educators can incorporate these resources into their classrooms, and students and lifelong learners can explore and discover on their own. The project outcomes will have broad impact on public audiences, deepening and advancing knowledge and understanding about important scientific concepts, and promoting continued, family-based collaborative learning experiences to expand and deepen STEM knowledge. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning.