This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
To build understanding of the essential needs involved in human exploration on Mars, the museum will create the Build a Mars Habitat – Survive and Thrive exhibit which allows museum visitors, especially school field trips and families with children in grades 4-8, to design and construct their own imaginary habitat for successful living on Mars using interchangeable building pieces. This would be designed to appeal particularly to girls, be accessible to audiences using a universal design approach, and be understood by Spanish-language visitors. Partnerships include the National Informal STEM Education Network (NISENet), NASA Ames Research Center, and NASA Marshall Space Flight Center. The project team will also develop professional development materials for both facilitated and unfacilitated experiences to accompany the exhibit. This immersive experience augments the existing “Sun, Earth, Universe” exhibit that was recently distributed to 52 science and children’s museums across the U.S. by NISENet, collectively reporting attendance of over 10 million visitors per year. The exhibition serves as a platform for scientists and museum staff and volunteers to engage visitors with additional facilitated educational programming and hands-on experiences. Anticipated STEM learning outcomes include audience’s increased interest and positive attitudes towards learning about space exploration, increase in informal education professionals’ capacity to engage public audiences in space exploration, and strengthened partnerships among NASA and museums.
The Front-End Evaluation for the Mars Habitat exhibit component was conducted to inform the project team about overall public reactions to the concept of the exhibit, as well as to gather feedback about content, activity and the potential structure and building aspects of the component. This data was also used to help guide the development of an exhibit prototype and the subsequent testing of related ideas, materials and builds. This document includes the full data set and results of the front-end data collection.
The questions that were used for this evaluation included three main focus
As new technologies continue to dominate the world, access to and participation in science, technology, engineering, mathematics (STEM), and computing has become a critical focus of education research, practice, and policy. This issue is exceptionally relevant for American Indians, who remain underrepresented as only 0.2% of the STEM workforce, even though they make up 2% of the U.S. population. In response to this need, this Faculty Early Career Development Program (CAREER) project takes a community-driven design approach, a collaborative design process in which Indigenous partners maintain sovereignty as designers, to collaboratively create three place-based storytelling experiences, stories told in historical and cultural places through location-based media. The place-based storytelling experiences will be digital installations at three culturally, politically, and historically significant sites in the local community where the public can engage with Indigenous science. The work is being done in partnership with the Northwestern Band of the Shoshone Nation (NWBSN).
The principal investigator and the NWBSN will investigate: (a) what are effective strategies and processes to conduct community-driven design with Indigenous partners?; (b) how does designing place-based storytelling experiences develop tribal members' design, technical, and computational skills?; (c) how does designing these experiences impact tribal members' scientific, technological, and cultural identities? The goals are to establish a process of community-driven design, build infrastructure to support this process, and understand how this methodological approach can result in culturally-appropriate ways to engage with science through technology. The principal investigator will work with the tribe to complete three intergenerational design cycles (a design cycle is made up of multiple design iterations). Each design cycle will result in one place-based storytelling experience. The goal is to include roughly 15 youth (ages 6-18), 10 Elders, and 10 other community members (i.e. members ages 18-50, likely parents) in each design cycle (35 tribal members total). Some designers are likely to participate in multiple design cycles. The tribe currently has 48 youth ages 6-18 and the project aims to engage at least 30 across all three design cycles. Over four years of designing three different experiences, the NWBSN aims to recruit at least 100 tribal members (just under 20% of the tribe) to make contributions (as designers, storytellers, or to provide cultural artifacts or design feedback).
This CAREER award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
We examined the conversational reflections of 248 families with 6–11‐year‐old children shortly after they visited a tinkering exhibit. Our aim was to understand the conditions of tinkering and conversational reflection that can enhance STEM learning opportunities for young children. We discuss implications for the design of tinkering and reflection activities that can both reveal and advance STEM learning.
There is a dearth of prominent STEM role models for underrepresented populations. For example, according to a 2017 survey, only 3.1% of physicists in the United States are Black, only 2.1% are Hispanic, and only 0.5% are Native American. The project will help bridge these gaps by developing exhibits that include simulations of historical scientific experiments enacted by little-known scientists of color, virtual reality encounters that immerse participants in the scientists' discovery process, and other content that allows visitors to interact with the exhibits and explore the exhibits' themes. The project will develop transportable, interactive exhibits focusing on light: how we perceive light, sources of light from light bulbs to stars, uses of real and artificial light in human endeavors, and past and current STEM innovators whose work helps us understand, create, and harness light now. The exhibits will be developed in three stages, each exploring a characteristic of light (Color, Energy, or Time). Each theme will be explored via multiple deliveries: short documentary and animated films, virtual reality experiences, interactive "photobooths," and technology-based inquiry activities. The exhibit components will be copied at seven additional sites, which will host the exhibits for their audiences, and the project's digital assets will enable other STEM learning organizations to duplicate the exhibits. The exhibits will be designed to address common gaps in understanding, among adults as well as younger learners, about light. What light really is and does, in scientific terms, is one type of hidden story these exhibits will convey to general audiences. Two other types of science stories the exhibits will tell: how contemporary research related to light, particularly in astrophysics, is unveiling the hidden stories of our universe; and hidden stories of STEM innovators, past and present, women and men, from diverse backgrounds. These stories will provide needed role models for the adolescent learners, helping them learn complex STEM content while showing them how scientific research is conducted and the diverse community of people who can contribute to STEM innovations and discoveries.
The project deliverables will be designed to present complex physics content through coherent, immersive, and embodied learning experiences that have been demonstrated to promote engagement and deeper learning. The project will research whether participants, through interacting with these exhibits, can begin to integrate discrete ideas and make connections with complex scientific content that would be difficult without technology support. For example, students and other novices often lack the expertise necessary to make distinctions between what is needed and what is extra within scientific problems. The proposed study follows a Design-Based Research (DBR) approach characterized by iterative cycles of data collection, analysis, and reflection to inform the design of educational innovations and advance educational theory. Project research includes conceiving, building, and testing iterative phases, which will enable the project to capture the complexity of learning and engagement in informal learning settings. Research participants will complete a range of research activities, including focus group interviews, observation, and pre-post assessment of science content knowledge and dispositions.
By showcasing such role models and informing about related STEM content, this project will widen perspectives of audiences in informal learning settings, particularly adolescents from groups underrepresented in STEM fields. Research findings and methodologies will be shared widely in the informal STEM learning community, building the field's knowledge of effective ways to broaden participation in informal science learning, and thus increase broaden participation in and preparation for the STEM-based workforce.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Todd BoyetteJill HammJanice AndersonCrystal Harden
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
Co-led by the University of Washington and Science Gallery Dublin, this project aims to drive and transform the next generation of broadening participation efforts targeting teen-aged youth from communities historically underrepresented in STEM fields. This project investigates how out-of-school time (OST) programs that integrate epistemic practices of the arts, sciences, computer science, and other disciplines, in the context of consequential activities (such as creating radio segments, designing museum exhibitions, or building online games), can more broadly appeal to and engage youth who do not already identify as STEM learners. STEM-related skills and capacities (such as computational thinking, design, data visualizations, and digital storytelling) are key to productive and creative participation in many future civic and workplace activities, and are driving the 30 fastest-growing occupations in the US. But many new jobs will entail a hybrid blend of skills, such as programming and design skills that many students who have disengaged with academic STEM pathways may already have and would be eager to develop further. There is not currently a strong foundation of research-based evidence to guide the design, implementation, and evaluation transdisciplinary programs - in which STEM skills are embedded as tools for meaningful participation - or how such approaches relate to long-term outcomes. Hypothesizing that OST programs which effectively engage youth during their high-leverage teenage years can significantly impact youths' longer-term STEM learning trajectories, this project will involve: 1) Five 3-year studies documenting learning in different technology-rich contexts: Making Afterschool, Media Production, Museum Exhibition Design, Digital Arts Programs, and Pop-Up/Street Science Programs; 2) A 4-year longitudinal study, involving 100 youth from the above programs; 3) The creation of a number of practical measurement tools that can be used to monitor how programs are leveraging the intersections of the arts and sciences to support student engagement and learning; and 4) A Professional Development program conducted at informal science education conferences in the EU and US to engage the informal STEM field with emerging findings. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences to better understand, strengthen, and coordinate STEM engagement and learning. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments.
Transdisciplinary, equity-oriented OST programs can provide supportive social contexts in which STEM concepts and practices are taken up as the means for meaningful participation in valued activities, building students' STEM skills in ways that can propel their future academic, career, and lifelong learning choices. This project will build the knowledge base about these emerging 21st century transdisciplinary approaches to broadening participation investigating: 1) The epistemic intersections across a range of disciplines (art, science, computation, design) that operate to broaden appeal and meaningful participation for underrepresented youth; 2) How transdisciplinary activities undertaken in the context of consequential learning (e.g., producing a radio segment, designing an exhibition for the general public) can illuminate the relevance of STEM to young people's lives, concerns, and futures; and 3) How participation in such programs can propel students' longer-term life choices and STEM learning trajectories. The project is a collaboration of the University of Washington, Science Gallery Dublin, Indiana University, Youth Radio in Oakland California, Guerilla Science in New York and London, and the London School of Economics.
This article presents some of the challenges faced in developing an interactive exhibit on nanoscience and nanotechnology in Brazil. Presenting a scientific-technological area which is still in formation and which is little known by the population leads to a (re)consideration of the role of museums and science centers in the conformation and consolidation of scientific practice itself. Museographically, the exhibit deals with the challenge of making matter visible in an expression which is distant from the human perception. Some reflections are presented here on the option of musealization
DATE:
TEAM MEMBERS:
Sandra MurrielloDjana ContierMarcelo Knobel
Under a subcontract with Randi Korn & Associates, who conducted a study of the on‐site museum exhibit, RMC was engaged to conduct an evaluation of the Places of Invention online map site for the Jerome and Dorothy Lemelson Center for the Study of Invention and Innovation. The Places of Invention online map, part of the 3,500 square foot on‐site exhibit, was developed as a platform for collecting invention stories related to specific places or landscapes submitted by Smithsonian staff, Smithsonian Affiliations, and visitors to the online map. RMC investigated three key topics related to
Flying Higher will develop a permanent hands-on exhibit that conveys the fundamentals of flight, technology, materials science, and NASA’s role in aeronautics for learners ages 3-12 years and their parents/caregivers and teachers. The exhibit, public programs, school and teacher programs, and teacher professional development will develop a pipeline of skilled workers to support community workforce needs and communicate NASA’s contributions to the nation and world. An innovative partnership with Claflin University (an historically black college) and Columbia College (a women’s liberal arts college) will provide undergraduate coursework in informal science education to support pre-service learning opportunities and paid employment for students seeking careers in education and/or STEM fields. The projects goals are:
1) To educate multi-generational family audiences about the principles and the future of aeronautics; provide hands-on, accessible, and immersive opportunities to explore state-of-the-art NASA technology; and demonstrate the cultural impact of flight in our global community.
2) To provide educational standards-based programming to teachers and students in grades K–8 on NASA-driven research topics, giving the students opportunities to explore these topics and gain exposure to science careers at NASA; and to offer teachers support in presenting STEM topics.
3) To create and implement a professional development program to engage pre-service teachers in presenting museum-based programs focused on aeronautics and engineering. This program will provide undergraduate degree credits, service learning, and paid employment to students that supports STEM instruction in the classroom, explores the benefits of informal science education, and encourages post-graduate opportunities in STEM fields.
The Virginia Institute of Marine Science (VIMS) and The Watermen's Museum, Yorktown, VA, will produce an underwater robotics research and discovery education program in conjunction with time-sensitive, underwater archeological research exploring recently discovered shipwrecks of General Cornwallis's lost fleet in the York River. The urgency of the scientific research is based upon the dynamic environment of the York River with its strong tidal currents, low visibility, and seasonal hypoxia that can rapidly deteriorate the ships, which have been underwater since 1781. Geophysical experts believe that further erosion is likely once the wrecks are exposed. Given the unknown deterioration rate of the shipwrecks coupled with the constraints of implementing the project during the 2011-2012 school-year, any delays would put the scientific research back at least 18 months - a potentially devastating delay for documenting the ships. The monitoring and studying of the historic ships will be conducted by elementary through high school-aged participants and their teachers who will collect the data underwater through robotic missions using VideoRay Remotely Operated Vehicles (ROVs) and a Fetch Automated Underwater Vehicle (AUV) from a command station at The Watermen's Museum. Students and teachers will be introduced to the science, mathematics, and integrated technologies associated with robotic underwater research and will experience events that occur on a real expedition, including mission planning, execution, monitoring, and data analysis. Robotic missions will be conducted within the unique, underwater setting of the historical shipwrecks. Such research experiences and professional development are intended to serve as a key to stimulating student interest in underwater archeological research, the marine environment and ocean science, advanced research using new technologies, and the array of opportunities presented for scientific and creative problem solving associated with underwater research. A comprehensive, outcomes-based formative and summative, external evaluation of the project will be conducted by Dr. L. Art Safer, Loyola University. The evaluation will inform the project's implementation efforts and investigate the project's impact. The newly formed partnership between the Waterman's Museum and VIMS will expand the ISE Program's objectives to forge new partnerships among informal venues, and to expand the use of advanced technologies for informal STEM learning. Extensive public dissemination during and after the project duration, includes but is not limited to, hosting an "Expedition to the Wrecks" web portal on the VIMS BRIDGE site for K-12 educators providing real-time results of the project and live webcasts. The website will be linked to the education portal at the Association for Unmanned Vehicle Systems International, the world's largest organization devoted to promoting unmanned systems and to the FIRST Robotics community through the Virginia portal. The website will be promoted through scientific societies, the National Marine Educators Association, National Science Teachers Association, and ASTC. Links will be provided to the Center for Archeological Research at the College of William and Mary and the Immersion Presents web portal--consultants to Dr. Bob Ballard's K-12 projects and JASON explorations. The NPS Colonial National Historic Park and the Riverwalk Landing will create public exhibits about the shipwreck's archeological and scientific significance, and will provide live observation of the research and the exploration technologies employed in this effort.