This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
The Michigan Science Center will purchase a portable planetarium that will bring planetarium shows to more than 2,000 children through its Traveling Science Program. The museum plans to take the programs to 10 schools and 8 libraries in Metro Detroit and 6 libraries in northern Michigan. They will deliver the portable planetarium shows in coordination with the museum’s long-standing “Scopes in the City” program, which allows people to use telescopes to see the night sky. The program also will expose students to Michigan’s growing aerospace industry and help increase their interest in earth and space science.
Through the T523: Formative Evaluation for Educational Product Development course, our team conducted a semester-long formative evaluation for the Museum of Science, Boston (MoS) Gaia Exhibit. The Gaia Exhibit (Gaia) is a new, temporary art installation located in the MoS’s Blue Wing exhibition hall. Gaia that strives to inspire appreciation for the earth and climate change awareness. The exhibit displays imagery of the Earth’s surface on a twenty feet diameter, three-dimensional globe. Additional exhibit elements include projected questions on the floor to prompt reflection and exhibit-
The Arboretum at Flagstaff will complete an interactive outdoor exhibition to provide relevant and science-based climate change information to its northern Arizona audience, as well as visitors from throughout the state. Project activities include the addition of three kiosks to the climate change exhibition; developing standards-based curriculum guides for educators to assist them with both onsite and classroom instruction for students in grades 6-8; and the development of new webpage interfaces designed to make data files and curriculum guides readily available. The climate change center will engage students and general audiences in the STEM components of real-time climate change research, interpretation, and mitigation.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Dinosaurs of Antarctica is a giant screen film and outreach project that documents the work of NSF-funded researchers on expeditions to Shackleton Glacier during the 2017-2018 field season. This immersive film and companion television special will bring the past to life and engage the public, and particularly students in middle grades (6-9), with polar science through appealing, entertaining media experiences and informal learning programs. The film serves as a companion for the synonymous Antarctic Dinosaurs museum exhibition
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
The Accessible Oceans study will design auditory displays that support learning and understanding of ocean data in informal learning environments like museums, science centers, and aquariums. Most data presentations in these spaces use visual display techniques such as graphs, charts, and computer-generated visualizations, resulting in inequitable access for learners with vision impairment or other print-related disabilities. While music, sound effects, and environmental sounds are sometimes used, these audio methods are inadequate for conveying quantitative information. The project will use sonification (turning data into sound) to convey meaningful aspects of ocean science data to increase access to ocean data and ocean literacy. The project will advance knowledge on the design of auditory displays for all learners, with and without disabilities, as well as advance the use of technology for STEM formal and informal education. The study will include 425 participants but will reach tens of thousands through the development of education materials, public reporting, and social media. The study will partner with the Smithsonian National Museum of Natural History, Woods Hole Oceanographic Institution Ocean Discovery Center, the Georgia Aquarium, the Eugene Science Center, the Atlanta Center for the Visually Impaired, and Perkins School for the Blind.
The project will leverage existing educational ocean datasets from the NSF-funded Ocean Observatories Initiative to produce and evaluate the feasibility of using integrated auditory displays to communicate tiered learning objectives of oceanographic principles. Integrated auditory displays will each be comprised of a data sonification and a context-setting audio introduction that will help to make sure all users start with the same basic information about the phenomenon. The displays will be developed through a user-centered design process that will engage ocean science experts, visually impaired students and adults (and their teachers), and design-oriented undergraduate and graduate students. The project will support advocacy skills for inclusive design and will provide valuable training opportunities for graduate and undergraduate students in human-centered design and accessibility. The project will have foundational utility in auditory display, STEM education, human-computer interaction, and other disciplines, contributing new strategies for representing quantitative information that can be applied across STEM disciplines that use similar visual data displays. The project will generate publicly accessible resources to advance studies of inclusive approaches on motivating learners with and without disabilities to learn more about and consider careers in STEM.
This Pilots and Feasibility Studies project is supported by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Math is everywhere in the world, but youth may see math as disconnected from their everyday experiences and wonder how math is relevant to their lives. There is evidence that informal math done by children is highly effective, involving efficiency, flexibility, and socializing. Yet, more is needed to understand how educators can support math engagement outside of school, and the role these out-of-school experiences can play relative to the classroom and lifelong STEM learning. This Innovations and Development Project seeks to conduct research on a location-based mobile app for informal mathematics learning. This research takes place at 9 informal learning sites and involves iteratively designing an app in which learners can view and contribute to an interactive map of math walk “stops” at these sites. Learners will be able to select locations and watch short videos or view pictures with text that describe how mathematical principles are present in their surroundings. For example, learners could use the app to discover how a painting by a local Latino artist uses ratio and scale, or how a ramp in downtown was designed with a specific slope to accommodate wheelchairs. Research studies will examine the affordances of augmented reality (AR) overlays where learners can hold up the camera of their mobile device, and see mathematical representations (e.g., lines, squares) layered over real-world objects in their camera feed. Research studies will also examine the impact of having learners create their own math walk stops at local informal learning sites, uploading pictures, descriptions, and linking audio they narrate, where they make observations about how math appears in their surroundings and pose interesting questions about STEM ideas and connections they wonder about.
This project draws on research on informal math learning, problem-posing, and culturally-sustaining pedagogies to conduct cycles of participatory design-based research on technology-supported math walks. The research questions are: How does posing mathematical scenarios in community-imbedded math walks impact learners’ attitudes about mathematics? How can experiencing AR overlays on real world objects highlight mathematical principles and allow learners to see math in the world around them? How can learners and informal educators be engaged as disseminators of content they create and as reviewers of mathematical content created by others? To answer these questions, five studies will be conducted where learners create math walk stops: without technology (Study 1), with a prototype version of the app (Study 2), and with or without AR overlays (Study 3). Studies will also compare children's experiences receiving math walk stops vs. creating their own stops (Study 4) and explore learners reviewing math walk stops made by their peers (Study 5). Using a community ethnography approach with qualitative and quantitative process data of how youth engage with the app and with each other, the project will determine how the development of math interest can be facilitated, how learner-driven problem generation can be scaffolded, and under what circumstances app-based math walks are most effective. The results will contribute to research on the development of interest, problem-posing, informal mathematics learning, and digital supports for STEM learning such as AR. This project will promote innovation and have strategic impact through a digital infrastructure that could be scaled up to support STEM walks anywhere in the world, while also building a local STEM learning ecosystem among informal learning sites focused on informal mathematics. This project is a partnership between Southern Methodist University, a nonprofit, talkSTEM that facilitates the creation of community math walks, and 9 informal learning providers. The project will directly serve approximately 500 grades 4-8 learners and 30-60 informal educators. The project will build capacity at 9 informal learning sites, which serve hundreds of thousands of students per year in their programming.
This Innovations in Development project is supported by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
In 2018, the Croucher Foundation conducted its third annual mapping exercise for the out-of-school STEM learning ecosystem in Hong Kong.
The study reveals a rich and vibrant ecosystem for out-of-school STEM in Hong Kong with over 3,000 discrete activities covering a very wide range of science disciplines. This third report indicates extremely rapid growth in available out-of-school STEM activities compared to 2016 and an even larger increase in the number of organisations offering out-of-school STEM activities in Hong Kong.
STEM educators are eager to foster long term collaboration with
DATE:
TEAM MEMBERS:
Siu Po LeeDavid FosterThe Croucher Foundation
There is a dearth of prominent STEM role models for underrepresented populations. For example, according to a 2017 survey, only 3.1% of physicists in the United States are Black, only 2.1% are Hispanic, and only 0.5% are Native American. The project will help bridge these gaps by developing exhibits that include simulations of historical scientific experiments enacted by little-known scientists of color, virtual reality encounters that immerse participants in the scientists' discovery process, and other content that allows visitors to interact with the exhibits and explore the exhibits' themes. The project will develop transportable, interactive exhibits focusing on light: how we perceive light, sources of light from light bulbs to stars, uses of real and artificial light in human endeavors, and past and current STEM innovators whose work helps us understand, create, and harness light now. The exhibits will be developed in three stages, each exploring a characteristic of light (Color, Energy, or Time). Each theme will be explored via multiple deliveries: short documentary and animated films, virtual reality experiences, interactive "photobooths," and technology-based inquiry activities. The exhibit components will be copied at seven additional sites, which will host the exhibits for their audiences, and the project's digital assets will enable other STEM learning organizations to duplicate the exhibits. The exhibits will be designed to address common gaps in understanding, among adults as well as younger learners, about light. What light really is and does, in scientific terms, is one type of hidden story these exhibits will convey to general audiences. Two other types of science stories the exhibits will tell: how contemporary research related to light, particularly in astrophysics, is unveiling the hidden stories of our universe; and hidden stories of STEM innovators, past and present, women and men, from diverse backgrounds. These stories will provide needed role models for the adolescent learners, helping them learn complex STEM content while showing them how scientific research is conducted and the diverse community of people who can contribute to STEM innovations and discoveries.
The project deliverables will be designed to present complex physics content through coherent, immersive, and embodied learning experiences that have been demonstrated to promote engagement and deeper learning. The project will research whether participants, through interacting with these exhibits, can begin to integrate discrete ideas and make connections with complex scientific content that would be difficult without technology support. For example, students and other novices often lack the expertise necessary to make distinctions between what is needed and what is extra within scientific problems. The proposed study follows a Design-Based Research (DBR) approach characterized by iterative cycles of data collection, analysis, and reflection to inform the design of educational innovations and advance educational theory. Project research includes conceiving, building, and testing iterative phases, which will enable the project to capture the complexity of learning and engagement in informal learning settings. Research participants will complete a range of research activities, including focus group interviews, observation, and pre-post assessment of science content knowledge and dispositions.
By showcasing such role models and informing about related STEM content, this project will widen perspectives of audiences in informal learning settings, particularly adolescents from groups underrepresented in STEM fields. Research findings and methodologies will be shared widely in the informal STEM learning community, building the field's knowledge of effective ways to broaden participation in informal science learning, and thus increase broaden participation in and preparation for the STEM-based workforce.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Todd BoyetteJill HammJanice AndersonCrystal Harden
Antarctic Dinosaurs: A Giant Screen Film and Outreach Project aims to leverage the popularity and charisma of dinosaurs to draw museum audiences into a captivating educational journey, revealing the history and transformation of Antarctica and the planet’s polar ecosystems, and exploring the forces that continue to shape the continent. In addition to bringing to life a wealth of unfamiliar dinosaurs, amphibians and proto-mammals, this project will journey beyond the bones to reveal a more nuanced, multi-disciplinary interpretation of paleontology and Antarctica’s profound changes.
Centered
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. Informal STEM educational activities have proliferated widely in the US over the last 20 years. Additional research will further validate the long-term benefits of this mode of learning. Thus, elaborating the multitude of variables in informal learning and how those variables can be used for individual learning is yet to be defined for the circumstances of the learners. Thus, the primary objective of this work is to produce robust and detailed evidence to help shape both practice and policy for informal STEM learning in a broad array of common circumstances such as rural, urban, varying economic situations, and unique characteristics and cultures of citizen groups. Rather than pursuing a universal model of informal learning, the principal investigator will develop a series of comprehensive models that will support learning in informal environments for various demographic groups. The research will undertake a longitudinal mixed-methods approach of Out of School Time/informal STEM experiences over a five-year time span of data collection for youth ages 9-19 in urban, suburban, town, and rural communities. The evidence base will include data on youth experiences of informal STEM, factors that exert an influence on participation in informal STEM, the impact of participation on choices about educational pathways and careers, and preferences for particular types of learning activities. The quantitative data will include youth surveys, program details (e.g. duration of program, length of each program session, youth/facilitator ratio, etc.), and demographics. The qualitative data will include on-site informal interviews with youth and facilitators, and program documentation. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.