This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
Through the T523: Formative Evaluation for Educational Product Development course, our team conducted a semester-long formative evaluation for the Museum of Science, Boston (MoS) Gaia Exhibit. The Gaia Exhibit (Gaia) is a new, temporary art installation located in the MoS’s Blue Wing exhibition hall. Gaia that strives to inspire appreciation for the earth and climate change awareness. The exhibit displays imagery of the Earth’s surface on a twenty feet diameter, three-dimensional globe. Additional exhibit elements include projected questions on the floor to prompt reflection and exhibit-
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
The Accessible Oceans study will design auditory displays that support learning and understanding of ocean data in informal learning environments like museums, science centers, and aquariums. Most data presentations in these spaces use visual display techniques such as graphs, charts, and computer-generated visualizations, resulting in inequitable access for learners with vision impairment or other print-related disabilities. While music, sound effects, and environmental sounds are sometimes used, these audio methods are inadequate for conveying quantitative information. The project will use sonification (turning data into sound) to convey meaningful aspects of ocean science data to increase access to ocean data and ocean literacy. The project will advance knowledge on the design of auditory displays for all learners, with and without disabilities, as well as advance the use of technology for STEM formal and informal education. The study will include 425 participants but will reach tens of thousands through the development of education materials, public reporting, and social media. The study will partner with the Smithsonian National Museum of Natural History, Woods Hole Oceanographic Institution Ocean Discovery Center, the Georgia Aquarium, the Eugene Science Center, the Atlanta Center for the Visually Impaired, and Perkins School for the Blind.
The project will leverage existing educational ocean datasets from the NSF-funded Ocean Observatories Initiative to produce and evaluate the feasibility of using integrated auditory displays to communicate tiered learning objectives of oceanographic principles. Integrated auditory displays will each be comprised of a data sonification and a context-setting audio introduction that will help to make sure all users start with the same basic information about the phenomenon. The displays will be developed through a user-centered design process that will engage ocean science experts, visually impaired students and adults (and their teachers), and design-oriented undergraduate and graduate students. The project will support advocacy skills for inclusive design and will provide valuable training opportunities for graduate and undergraduate students in human-centered design and accessibility. The project will have foundational utility in auditory display, STEM education, human-computer interaction, and other disciplines, contributing new strategies for representing quantitative information that can be applied across STEM disciplines that use similar visual data displays. The project will generate publicly accessible resources to advance studies of inclusive approaches on motivating learners with and without disabilities to learn more about and consider careers in STEM.
This Pilots and Feasibility Studies project is supported by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
There is a dearth of prominent STEM role models for underrepresented populations. For example, according to a 2017 survey, only 3.1% of physicists in the United States are Black, only 2.1% are Hispanic, and only 0.5% are Native American. The project will help bridge these gaps by developing exhibits that include simulations of historical scientific experiments enacted by little-known scientists of color, virtual reality encounters that immerse participants in the scientists' discovery process, and other content that allows visitors to interact with the exhibits and explore the exhibits' themes. The project will develop transportable, interactive exhibits focusing on light: how we perceive light, sources of light from light bulbs to stars, uses of real and artificial light in human endeavors, and past and current STEM innovators whose work helps us understand, create, and harness light now. The exhibits will be developed in three stages, each exploring a characteristic of light (Color, Energy, or Time). Each theme will be explored via multiple deliveries: short documentary and animated films, virtual reality experiences, interactive "photobooths," and technology-based inquiry activities. The exhibit components will be copied at seven additional sites, which will host the exhibits for their audiences, and the project's digital assets will enable other STEM learning organizations to duplicate the exhibits. The exhibits will be designed to address common gaps in understanding, among adults as well as younger learners, about light. What light really is and does, in scientific terms, is one type of hidden story these exhibits will convey to general audiences. Two other types of science stories the exhibits will tell: how contemporary research related to light, particularly in astrophysics, is unveiling the hidden stories of our universe; and hidden stories of STEM innovators, past and present, women and men, from diverse backgrounds. These stories will provide needed role models for the adolescent learners, helping them learn complex STEM content while showing them how scientific research is conducted and the diverse community of people who can contribute to STEM innovations and discoveries.
The project deliverables will be designed to present complex physics content through coherent, immersive, and embodied learning experiences that have been demonstrated to promote engagement and deeper learning. The project will research whether participants, through interacting with these exhibits, can begin to integrate discrete ideas and make connections with complex scientific content that would be difficult without technology support. For example, students and other novices often lack the expertise necessary to make distinctions between what is needed and what is extra within scientific problems. The proposed study follows a Design-Based Research (DBR) approach characterized by iterative cycles of data collection, analysis, and reflection to inform the design of educational innovations and advance educational theory. Project research includes conceiving, building, and testing iterative phases, which will enable the project to capture the complexity of learning and engagement in informal learning settings. Research participants will complete a range of research activities, including focus group interviews, observation, and pre-post assessment of science content knowledge and dispositions.
By showcasing such role models and informing about related STEM content, this project will widen perspectives of audiences in informal learning settings, particularly adolescents from groups underrepresented in STEM fields. Research findings and methodologies will be shared widely in the informal STEM learning community, building the field's knowledge of effective ways to broaden participation in informal science learning, and thus increase broaden participation in and preparation for the STEM-based workforce.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Todd BoyetteJill HammJanice AndersonCrystal Harden
Charles Darwin is largely unknown and poorly understood as a historical figure. Similarly, the fundamental principles of evolution are often miss-stated, misunderstood, or entirely rejected by large numbers of Americans. Simply trying to communicate more facts about Darwin, or facts supporting the principles of evolution is inadequate; neither students nor members of the public will care or retain the information. On the contrary, building facts into a one-on-one conversational narrative creates an memorable opportunity to learn. Here, we create a digital-media, self-guided question and answer
DATE:
TEAM MEMBERS:
David J. LampeBrinley KantorskiJohn Pollock
The summative evaluation focuses on two project components: (1) an IMAX® Dome film, titled Coral Reef Adventure, and (2) an associated interactive exhibit, titled Weird, Wild and Underwater, intended to be displayed in museum and science center lobbies. The general goals for the summative evaluation study were to assess the appeal of "Coral Reef Adventure" film and the lobby exhibit; acquisition of scientific knowledge and understanding as related to the project’s learning goals and understanding of film topics; and the impact that the exhibit has on viewers of the film. A separate-sample
Given the importance of learning to economic and life success, this review seeks to broaden the conception of learning beyond traditional formal education. Learning occurs every day in many ways and in a range of settings. This broad scope of learning--termed "informal learning"--is increasingly important in the rapidly changing knowledge economy. As such, in this review paper, we examine the different types of informal learning, their opportunities and challenges, and their issues of access and equity. Spanning multiple disciplines, e draw particular attention to the workplace and adult
DATE:
TEAM MEMBERS:
Michelle Van NoyHeather JamesCrystal Bedley
From 2013-2016, Pacific Science Center, implemented the Exploring Earth Systems Sciences (EESS) project with the purpose of developing and delivering scripted demonstrations utilizing the Science On a Sphere (SOS) technology in order to promote understanding of and increase interest in Earth systems sciences. Specifically, the grant allowed the Science Interpretation team to research and write 20-minute presentations, targeted towards visitors aged 11 and older, about nine unique topics such as: climate change, weather, seasons, or the Polar Regions. Staff were then provided training in
Under a subcontract with Randi Korn & Associates, who conducted a study of the on‐site museum exhibit, RMC was engaged to conduct an evaluation of the Places of Invention online map site for the Jerome and Dorothy Lemelson Center for the Study of Invention and Innovation. The Places of Invention online map, part of the 3,500 square foot on‐site exhibit, was developed as a platform for collecting invention stories related to specific places or landscapes submitted by Smithsonian staff, Smithsonian Affiliations, and visitors to the online map. RMC investigated three key topics related to
With support from the National Science Foundation, MacGillivray Freeman Films has produced an IMAX® film titled, Journey into Amazing Caves. The 40-minute film follows two women cavers on an expedition as they explore limestone caverns of the Grand Can-yon, underwater caves of the Yucatan and ice caves of Greenland. Multimedia Research implemented a summative evaluation focused on the following major outcomes: To what extent and in what ways did the film appeal to viewers? To what extent did the film achieve its intended viewing goals? What did viewers perceive that they learned from the
With funding from the National Science Foundation, NOVA/WGBH Boston with the participation of 14 U.S. and 4 international science museums have produced an IMAX/OMNIMAX film titled, Special Effects. The 40-minute film shows the techniques and methods that special effects filmmakers use along with their understanding of the human visual system to create movie illusions. Multimedia Research implemented a summative evaluation focused on the following major outcomes: To what extent did the program appeal to adult viewers? To what extent did the program achieve its intended viewing goals? What
Funded by the National Science Foundation, the Science of Sharing project (SoS) was a collaboration between the Exploratorium, the Museum of Life and Science, Dialogue Social Enterprise and The Heroic Imagination Project. SoS included two major components for members of the public to engage with: a permanent collection of interactive, multi-user exhibits at the Exploratorium, and a series of social-media based activities called Experimonths. SoS exhibits and Experimonths were designed to allow visitors to experiment with cooperation, trust, and social dilemmas, connect those experiences to