Identifying causal relationships is an important aspect of research and evaluation in visitor studies, such as making claims about the learning outcomes of a program or exhibit. Experimental and quasi-experimental approaches are powerful tools for addressing these causal questions. However, these designs are arguably underutilized in visitor studies. In this article, we offer examples of the use of experimental and quasi-experimental designs in science museums to aide investigators interested in expanding their methods toolkit and increasing their ability to make strong causal claims about
Although discussions of museums often revolve around exhibits, educators in these spaces have the potential to create in-depth, social learning experiences beyond what is possible at exhibits alone. There is still little empirical research, however, to inform how we understand, approach, and improve museum facilitation practices. In this study, we sought to address this gap by quantifying the impact of facilitation by trained educators working with visitors at interactive museum exhibits and comparing this to visitor engagement and learning outcomes for families without educator support. Using
Mathematics plays a significant role in understanding and participating in science, technology, and engineering (STEM). Research shows that early mathematics experiences in everyday life are critical to the development of children's mathematical knowledge. This project will explore an innovative approach to fostering parent-child math interactions and conversations related to mathematical ideas. The approach will use community-based, exhibit installations called Mathscapes. These are artistic, culturally relevant, easily accessible, physical installations designed to encourage adults and children (ages 3 to 7) to use their immediate environment to playfully explore key early math concepts. The project also addresses a need for research about the cultural experiences and resources that marginalized children and families bring to mathematical conversations. Understanding parent-child interactions about mathematics community settings could result in new knowledge about early math learning among low income children and parents. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This exploratory study will design and investigate an innovative approach to encouraging math talk and math-related interactions between parents and children (ages 3-7) through the creation of MathScapes. These are temporary physical installations designed to use the immediate environment to playfully explore mathematical concepts. This study will be conducted in two Boston neighborhoods that are populated by low-income, non-dominant minority and immigrant families. Adopting a case study approach, the project will use observational methods, discourse analysis of parent/child talk, and interviews to study the interactions of 200 families at two neighborhood Mathscape installations. LENA devices will be used to capture parent/child talk at the Mathscapes while researchers use observational methods to document participant interactions, talk, and gestures. Data sources will include audio recordings of family talk, field notes of family interactions at Mathscape installations, surveys, and interviews. A qualitative approach will be used to produce research findings at multiple levels. The focus of the analysis will be to understand if this approach enhances the quality and quantity of math talk between parents and children. The project will be carried out by a research-practice-community partnership in Boston, Massachusetts that includes community mathematics educators, education researchers, and participating children and families. The design of community installations could promote engagement with math through adult/child conversations in culturally-relevant contexts situated in the local environment. By addressing the cultural experiences and resources of young people, the project could greatly enhance our understanding of how to leverage the resources that children and families bring to engaging with mathematics.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Omowale MosesDanny MartinCatherine O'ConnorNermeen Darshoush
resourceevaluationProfessional Development, Conferences, and Networks
Researching the Value of Educator Actions for Learning (REVEAL) is an NSF-funded research project, led by the Oregon Museum of Science and Industry (OMSI) in collaboration with TERC and Oregon State University (OSU), which studied the impact of science center staff facilitation strategies at math exhibits. Building on and using exhibits from Design Zone—an interactive math exhibition which engaged visitors in exploring algebraic relationships and functions—the study was designed to add to the scant existing literature about the impact of staff facilitation on visitors. The study also aimed to
Front-line staff are an integral part of the visitor experience at museums and science centers across the country, facilitating activities and programs, leading classes, and more. But do these staff make a difference for visitor learning? And what are the most effective facilitation strategies and approaches? In 2013, the Oregon Museum of Science and Industry (OMSI) received funding from the National Science Foundation for a three-year study, Researching the Value of Educator Actions for Learning (REVEAL), to begin to address these questions. Building on the Design Zone exhibition, REVEAL
The Oregon Museum of Science and Industry (OMSI), located in Portland, is a hands-on science museum. In 2013, OMSI received funding from the National Science Foundation for the project Researching the Value of Educator Actions for Learning (REVEAL) to study how museum educators can better help families learn math while interacting with museum exhibits. Through REVEAL, OMSI was able to partner with Adelante Mujeres, a non-profit community organization located in Forest Grove that educates and empowers Latina women and their families. Here we share some of the lessons learned from the
This study was a longitudinal summative evaluation of repeat visitors’ experiences in four Math Moves! exhibitions that were developed as part of a large collaborative exhibition development project called Math Core for Museums, and mounted at four museums around the country: Museum of Science (Boston); Museum of Life & Science (Durham, NC); Explora (Albuquerque); and Science Museum of Minnesota (St. Paul). The summative evaluation purposively selected four family groups at each institution and collected naturalistic data as the 16 groups engaged with the exhibits from 4-6 times over a two
The REVEAL project is an NSF funded project to learn about how facilitation impacts family’s experiences of math exhibits. The goal of the project was to iteratively develop and refine a theoretical model of how staff facilitation deepens and extends family mathematical discourse at interactive exhibits. This model underwent rigorous testing and ultimately provided the evidence and research-based tools to support PD efforts for informal STEM educators. As part of this testing the learnings from developing at OMSI (Oregon Museum of Science and Industry, in Portland, Oregon) were applied in an
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. REVEAL is using a two-phase research design, including a phase 1 design-based research study followed by a phase 2 experimental study, to investigate and measure the impact of staff facilitation on family mathematical discourse at exhibits and identify factors that influence the outcomes of these interactions. The project has an emphasis on culturally responsive research and education approaches.
Many museum professionals believe that immersive exhibits—those that surround visitors—provide more attractive, engaging and effective learning experiences than tabletop exhibits. We investigated this claim by comparing visitors’ experiences of the two exhibit types, using pairs of exhibits that differed in scale (immersive vs. tabletop), but shared the same content and similar visitor activity. We randomly selected, videotaped, interviewed, and sent follow-up surveys to sixty families who experienced immersive exhibits and sixty families who experienced tabletop exhibits. We found that each
This multiplatform media and science center project is designed to engage audiences in humanity's deepest questions like the nature of love, reality, time and death in both scientific and humanistic terms. Project deliverables include 5 hour-long radio programs for broadcast on NPR stations, public events/museum exhibits at the Exploratorium in San Francisco, kiosks in venues throughout the city, and a social media engagement campaign. The audience of the project is large and diverse using mass media and the internet. But the project will specifically target young, online, and minority audiences using various strategies. The project is designed to help a diverse audience understand the impact of new scientific developments as well as the basic science, technology, engineering and math needed to be responsible, informed citizens. Innovative elements of the project include the unique format of the radio programs that explore complex topics in an engaging and compelling way, the visitor engagement strategy at the Exploratorium, and the social media strategy that reaches niche audiences who might never listen to the radio broadcasts, but find the podcasts and blogs engaging. The Exploratorium will be opening a new building in 2013 and will include exhibits and programs that are testing grounds for this project. This is a new model that aligns the radio content with exhibitions, social media, and in person events at the Exploratorium, providing a unique holistic approach. The project is designed to inspire people to think and talk about science and want to find out more. The evaluation will measure the impacts on the targeted audiences reached by each of the key delivery methods. Data will be collected using focus groups; intercept interviews with people in public places, and longitudinal panels. The focus will be on 5 targeted audiences (young adults, families with children, non-NPR listeners, underrepresented minorities, and adults without college experience). This comprehensive evaluation will likely contribute important knowledge to the field based on this multiple-platform collaborative model.
The Exploratorium, in collaboration with the Boys and Girls Club Columbia Park (BGC) in the Mission District of San Francisco, is implementing a two-year exploratory project designed to support informal education in science, technology, engineering, and mathematics (STEM) within underserved Latino communities. Building off of and expanding on non-STEM-related efforts in a few major U.S. cities and Europe, the Exploratorium, BGC, and residents of the District will engage in a STEM exhibit and program co-development process that will physically convert metered parking spaces in front of the Club into transformative public places called "parklets." The BGC parklet will feature interactive, bilingual science and technology exhibits, programs and events targeting audiences including youth ages 8 - 17 and intergenerational families and groups primarily in the Mission District and users of the BGC. Parklet exhibits and programs will focus on STEM content related to "Observing the Urban Environment," with a focus on community sustainability. The project explores one approach to working with and engaging the public in their everyday environment with relevant STEM learning experiences. The development and evaluation processes are being positioned as a model for possible expansion throughout the city and to other cities.