Informal learning environments such as science centers and museums are instrumental in the promotion of science, technology, engineering, and mathematics (STEM) education. These settings provide children with the chance to engage in self-directed activities that can create a of lifelong interest and persistence in STEM. On the other hand, the presence of parents in these settings allows children the opportunity to work together and engage in conversations that can boost understanding and enhance learning of STEM topics. To date, a considerable amount of research has focused on adult-child
The Miami Children’s Museum (MCM) contracted RK&A to conduct a summative evaluation of the Construction Zone exhibition, which was funded in part by IMLS. The evaluation focused on understanding the overall experience for walk-in visitors to the exhibition. It also explored visitor experiences with three specific exhibits with attention to problem-solving, experimentation with building materials, and collaboration.
How did we approach this study?
RK&A used two methodologies to evaluate the exhibition: interviews and focused observations. RK&A conducted 51 open-ended interviews with a
Computational Thinking (CT) is a relatively new educational focus and a clear need for learners as a 21st century skill. This proposal tackles this challenging new area for young learners, an area greatly in need of research and learning materials. The Principal Investigators will develop and implement integrated STEM+C museum exhibits and integrate CT in their existing engineering design based PictureSTEM curriculum for K-2 students. They will also pilot assessments of the CT components of the PictureSTEM curriculum. This work will make a unique contribution to the available STEM+C learning materials and assessments. There are few such materials for the kindergarten to second grade (K-2) population they will work with. They will research the effects of the curriculum and the exhibits with a mixed methods approach. First, they will collect observational data and conduct case studies to discover the important elements of an integrated STEM+C experience in both the formal in-school setting with the curriculum and in the informal out-of-school setting with families interacting with the museum exhibits. This work will provide a novel way to understand the important question of how in- and out-of-school experiences contribute to the development of STEM and CT thinking and learning. Finally, they will collect data from all participants to discover the ways that their activities lead to increases in STEM+C knowledge and interest.
The Principal Investigators will build on an integrated STEM curriculum by integrating CT and develop integrated museum exhibits. They base both activities on engineering design implemented through challenge based programming activities. They will research and/or develop assessments of both STEM+C integrated thinking and CT. Their research strategy combines Design Based Research and quantitative assessment of the effectiveness of the materials for learning CT. In the first two years of their study, they will engage in iterations on the design of the curriculum and the exhibits based on observation and case-study data. There will be 16 cases that draw from each grade level and involve data collection for the case student in both schools and museums. They will also use this work to illuminate what integrated STEM+C thinking and learning looks like across formal and informal learning environments. Based in some part on what they discover in this first phase, they will conduct the quantitative assessments with all (or at least most) students participating in the study
Escape rooms are an engaging and increasingly popular game format in which a team of players is “locked” in a room and challenged to solve a series of narrative-embedded puzzles encoded in the room’s artifacts in order to “escape” within a set period of time. The University of California Museum of Paleontology, with partners University of Kansas Natural History Museum and the California Academy of Sciences, aim to develop, evaluate, and disseminate a “serious game” (i.e., a game designed for a purpose other than entertainment) based on the escape room model. Our traveling/loanable pop-up escape room and associated extension activities will engage diverse families (ages 8 and up) in museums and libraries in solving a biomedical mystery that teaches fundamental concepts in biology, engages critical-thinking and collaboration skills, and stimulates interest in biomedical careers. STEM Escape will address NGSS-aligned content central to medical research – in particular, it will communicate basic concepts regarding evolutionary relationships, a topic with relevance to a wide variety of medical applications, such as determining the source of emerging infectious diseases, tracking the progression of disease within a host, and identifying new medicines. The project is designed to lay the groundwork for extended family interactions surrounding scientific content and biomedical careers. The immersive game will be supplemented by a set of solo and docent-led follow-up activities that reinforce key concepts and emphasize connections between players’ experience in the game and biomedical research careers. Learners will also receive takeaway media (e.g., activity book) that highlights a diverse set of NIH-funded researchers whose work directly relies on evolutionary patterns/processes. Caregivers will have the option of receiving a follow-up email with free at-home activities. The themed inflatable pop-up room will be wheelchair-accessible and all materials will be bilingual in English and Spanish. The STEM Escape experience will be developed with and for the diverse audiences visiting urban/suburban natural history museums and libraries, as well as with and for rural families, whom we will reach through rural libraries. The project will also produce and evaluate a suite of support materials to facilitate institutional adoption and deployment of the experience. Nine host sites across the country have committed to hosting the room (with an additional two sites in the planning stages), and after the life of the grant, the room will continue to make an impact as a rentable traveling exhibit. Long term, this project will improve the public’s understanding of medically relevant evolutionary content, increase interest in biomedical careers, particularly among underserved groups targeted, and improve our understanding of how immersive games can be used to serve educational objectives.
The Oregon Museum of Science and Industry (OMSI), in collaboration with neuroscientists at the Oregon Health & Science University (OHSU), museum professionals, and community partners, proposes to create a 1,000 to 1,500-square-foot traveling exhibition, accompanying website, and complementary programming to promote public understanding of neuroscience research and its relevance to healthy brain development in early childhood. The exhibition and programs will focus on current research on the developing brain, up to age 5, and will reach a national audience of adult caregivers of young children and their families, with a special emphasis on Latino families. The project will be developed bi-culturally and bilingually (English/Spanish) in order to better engage underrepresented Latino audiences. The exhibition and programs will be designed and tested with family audiences.
The exhibition project, Interactive Family Learning in Support of Early Brain Development, has four goals that primarily target adult caregivers of children up to age 5:
Foster engagement with and interest in neurodevelopment during early childhood
Enhance awareness of how neuroscience research leads to knowledge about healthy development in early childhood
Inform and empower adult caregivers to enrich their children’s early learning experiences
Reach diverse family audiences, especially Latino caregivers and their families
A collaborative, multidisciplinary team of neuroscience researchers, experts in early childhood education, museum educators, and OMSI personnel with expertise in informal science education and bilingual exhibit development will work together to ensure that current science is accurately interpreted and effectively presented to reach the target audiences. The project will foster better public understanding of early brain development and awareness and confidence in caregivers in using play to enrich their children’s experiences and support healthy brain development. Visitors will explore neuroscience and early childhood development through a variety of forms—multi-sensory, hands-on interactive exhibits, graphic panels, real objects, facilitated experiences, and an accompanying website.
Following the five-year development process, the exhibition will begin an eight-year national tour, during which it will reach more than one million people.
Informal learning institutions, such as science centers and museums, are well-positioned to broaden participation in engineering pathways by providing children from underrepresented groups with motivational, self-directed engineering design experiences. Though many informal learning institutions offer opportunities for young visitors to engage in engineering activities, little is known about the specific features of these activities that support children's motivation in engineering design processes such as problem scoping, testing, and iteration. This project will address this gap and advance foundational knowledge by identifying features of engineering design activities, as implemented within an informal setting, which support underrepresented children's engineering motivation and persistence in engineering tasks. Researchers at New York Hall of Science (NYSCI) will observe children interacting with families and museum educators as they engage in different engineering design activities in NYSCI's Design Lab, an exhibition space devoted to hands-on exploration of engineering design. They will also survey and interview the children and their caregivers about these experiences. Analyses of these data sources will result in a description of features of design activities foster motivation and task persistence in engineering design. Findings will be disseminated nationally to other informal learning institutions, which in turn can use the knowledge generated from this project to create motivational, research-based, field-tested engineering design experiences for young visitors, especially for children from underrepresented groups. The experiences may encourage children to further pursue engineering pathways, resulting in a diversified engineering workforce with the potential to drive and sustain national innovation and global technological leadership.
This project uses the framework of goal orientation, defined as learners' self-reflection of why and how they engage in tasks, to understand whether, how, and why underrepresented 7-12-year-olds engage in engineering design activities in an informal learning institution. Though previous research has suggested that goal orientation is strongly, positively related to learning and motivation in formal settings such as schools, research in informal settings has not robustly accounted for the role of goal orientation in participants' engagement with learning tasks in these unique learning environments. To better understand how children's goal orientations contribute to their motivation in engineering in informal learning institutions, researchers will answer the following research questions: (1) What are underrepresented children's goals and goal orientations while participating in engineering design activities in an informal setting? (2) What contextual factors--including facilitation strategies, materials, task relevance, and social interactions with family members--may support or discourage the adoption of different goal orientations? (3) How do goal orientations relate to children's learning experience in the engineering design activities and the likelihood that they will test and iterate their solutions? These questions will be answered through a mixed-method research study conducted with approximately 200 families, with children aged 7-12, recruited from underrepresented groups. Semi-structured clinical interviews, conducted with 20% of the children and their caregivers, as well as observations and surveys gathered from all families, will provide information on the children's goal orientation and engagement as they relate to specific engineering design activities. Qualitative content analyses and multilevel structural equation modeling will result in findings that will be disseminated widely to other institutions of informal learning. Ultimately, this project will generate new empirical knowledge regarding the features of engineering design activities in informal learning environments that increase engineering engagement and motivation among underrepresented children, thereby broadening participation in engineering pathways.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This project will focus on addressing the challenges faced by rural youth with a particular emphasis on those youth who are English Language Learners. The project will provide informal education via libraries and librarians which can provide unique opportunities for rural youth and communities. Building on several years of research and experimentation, this project will augment the formal education sector, as well. The settings for the project are 12 rural school districts in largely Latinx communities. The project partners are the Space Science Institute, the American Library Association (ALA), the Institute for Learning Innovation and the Twin Cities Public Television. Expertise from the Latinx community will play a significant part in the project. The project will engage learners from diverse backgrounds, ages, and interests in science through a coordinated and tested strategy incorporating three Learning Pathways (i.e., Science Learning Spaces, Programs, and Science Kits) in a public library environment. The results should yield a model for Nationwide application.
The main goals are: 1) to establish learning pathways to engage rural communities through exhibit host libraries and (2) to increase art-rich STEM learning opportunities for rural communities through libraries and their support systems. Building on an established training model, the project will introduce library staff to the STEAM content of the exhibits and guide them in developing their own STEAM Learning Pathways. SciGirls digital media, hands-on activities, family resources, and a training network will expand the depth and reach of the project. The project draws on existing professional infrastructure to increase library staff capacity through ALA and the Institute's established community of practice. The researchers will study the efficacy of each pathway, alone and in tandem, on participant's interest development and persistence. The research will use a mixed-methods design-based approach that involves questionnaires, interviews and case studies.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Libraries can provide unique opportunities for rural youth and communities. Phase III of the STAR Library Network will be a collaboration with 12 rural school districts in largely Latinx communities to address the challenges faced by rural youth, particularly English Language Learners. The project will use a coordinated and tested strategy to establish three learning pathways in public libraries: science learning spaces with exhibits, library programs, and science kits. These resources will provide learners with art-rich STEM learning opportunities.
Partners
Project partners include the Space Science Institute, the American Library Association (ALA), the Institute for Learning Innovation, and Twin Cities Public Television. The project will rely significantly on expertise from the Latinx community.
Project Plan
Building on an established librarian training model, the project will introduce library staff to the STEAM content and guide them in developing their own STEAM Learning Pathways. The project will draw on existing professional infrastructure from the ALA and the Institute for Learning Innovation’s established community of practice. SciGirls digital media, hands-on activities, family resources, and a training network will expand the depth and reach of the project.
The Research
The research team will study the efficacy of each pathway, alone and in tandem, on participant’s interest development and persistence. The research will use a mixed-methods design-based approach that involves questionnaires, interviews, and case studies. The results should yield a model for nationwide application and contribute insights for the formal education sector.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The project will refine, research and disseminate making exhibits and events that the museum has developed and tested to support early engineering skill development. The project will use cardboard, a familiar and flexible material, to support the activities. The goal is to develop insights and resources for informal educators across the museum field and beyond into how to effectively structure and facilitate open-ended maker education experiences for visitors that expand the number and kinds of museums and families who can engage in these activities. Maker education is often linked to Science, Technology, Engineering and Mathematics (STEM) learning and uses hands-on and collaborative approaches to support activities and projects that foster creativity, interest, and skill development. To address patterns of inequitable access to and participation in both formal and informal learning opportunities, the project will be designed to engage families from under-represented communities and research how they participate in informal engineering activities and environments. The project will make a suite of resources available for museums and other ISE practitioners that will be developed through iterative testing at all of the different settings. These resources will be made widely available via an open access online portal.
The project will research how effectively the use of cardboard making exhibits and events engage families, particularly families from underrepresented groups, in STEM and early engineering. The project's theoretical framework combines elements of: (1) learning sciences theories of family learning in museums; (2) making as a learning process; (3) early engineering practices and dispositions, and (4) equity in museums and the maker movement. The research will be conducted within two multi-month implementations of a large-scale Cardboard Engineering gallery at the Science Museum of Minnesota and two-week scaled implementations of the gallery at each of three recruited partner museum sites. The project design interweaves evaluation and research aims. Paired observations and surveys will be used to research how effectively the project is working in different venues. This integration of research and evaluation will generate a large data set from which to generalize about cardboard making across contexts. Case studies will be used to identify barriers to engagement that can be remedied, but they will provide a rich data set for understanding family learning and engineering in making. Research findings and products will be posted on the Center for Informal Science Education website and submitted for publication in peer-reviewed journals such as Visitor Studies, ASTC Dimensions, the Journal of Pre-College Engineering Education Research and others.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This video captures the energy and potetial of the Designing our Tomorrow project. It is intended to complement presentations and posters about Designing our Tomorrow.
The Designing Our Tomorrow project aims to develop a framework for creating exhibit-based engineering design challenges and expand an existing model of facilitation for use in engineering exhibits. Designing our Tomorrow seeks to broaden participation in engineering and build capacity within the informal science education (ISE) field while raising public awareness of the importance of sustainable engineering design practices
Identifying causal relationships is an important aspect of research and evaluation in visitor studies, such as making claims about the learning outcomes of a program or exhibit. Experimental and quasi-experimental approaches are powerful tools for addressing these causal questions. However, these designs are arguably underutilized in visitor studies. In this article, we offer examples of the use of experimental and quasi-experimental designs in science museums to aide investigators interested in expanding their methods toolkit and increasing their ability to make strong causal claims about
Organizations, institutions, or initiatives often do not engage these influential adults as effectively as they might, nor are they always sensitive to the perspectives, needs, and expertise that caregivers bring to the activities in which their children participate. STEM educators and science communicators can better support youth when they effectively engage parents in relevant aspects of the work by considering whether parents are part of the intended audience and if so, how they can participate.
About this resource:
This is a practice brief produced by CAISE's Broadening
DATE:
TEAM MEMBERS:
Dale McCreedyMicaela BalzerBhaskar UpadhyayCenter for Advancement of Informal Science Education (CAISE)