Data science is ever-present in modern life. The need to learn with and about data science is becoming increasingly important in a world where the quantity of data is constantly growing, where one’s own data are often being harvested and marketed, where data science career opportunities are rapidly increasing, and where understanding statistics, data sources, and data representation is integral to understanding STEM and the world around us. Museums have the opportunity to play a critical role in introducing the public to data science concepts in ways that center personal relevance, social connections and collaborative learning. However, data science and statistics are difficult concepts to distill and provide meaningful engagement with during the brief learning experiences typical to science museums. This Pilot and Feasibility study brings together data scientists, data science educators, and museum exhibit designers to consider these questions:
What are the important data science concepts for the public to explore and understand in museum exhibits?
How can museum exhibits be designed to support visitors with diverse backgrounds and experiences to engage with these data science concepts?
What principles can shape these designs to promote broadening participation in data science specifically and STEM more broadly?
This Pilot and Feasibility project combines multidisciplinary expert convening, feasibility testing, and early exploratory prototyping around the focal topic of data science exhibits. Project partners, TERC, the Museum of Science, Boston, and The Tech Interactive in San Jose will engage in an iterative process to develop a theoretical grounding and practical guidance for museum practitioners. The project will include two convenings, bringing together teams of experts from the fields of data science, data science education and museum exhibit design. Prior to the first convening, an initial literature summary and a survey of convening participants will be conducted, culminating in a preliminary list of big ideas about data science. Periodically, participants will have the opportunity to rank, annotate and expand this list, as a form of ongoing data collection. During the convenings, participants will explore the preliminary list, share related work from the three disciplines, engage with related data science activities in small groups, and work together to build consensus around promising data science topics and approaches for exhibits. Participant evaluation will allow for iterative improvement of the convenings and the capture of missed points or overlooked topics. After each convening, museum partners will create prototypes that respond to the convening conversations. Prototypes will be pilot tested (evaluated) with an intentionally recruited group of families that includes both frequent visitors and those who are less likely to visit the museum; diversity in terms of race, languages and dis/ability will be reflected in selection. Pilot data collection will consist of structured observations and interviews. Results from the first round of prototyping will be shared with convening participants as a way to modify the list of big ideas and to further interrogate the feasibility of communicating these ideas in an exhibit format. Results from the convenings and from both rounds of prototyping will be combined in a guiding document that will be shared on all three partner websites, and more broadly with the informal STEM learning field. The team will also host a workshop for practitioners interested in designing data science exhibits, and present at a conference focused on museum exhibits and their design.
The Institute for Native Pacific Education and Culture (INPEACE) will create a mobile science exhibit to support improved academic outcomes in science and math for students from pre-school to eighth grade. With the collaboration of science experts, teachers, students, and cultural practitioners, the project team will identify and design three core exhibits using a culture-based educational approach. The project will link indigenous knowledge and practices with scientific theory, providing hands-on experiences designed to engage youth in STEM learning. The 'Ike Hawai'i Science Center Exhibit will visit rural Native Hawaiian communities on O'ahu and at least one other island. It will be available to public audiences of all ages.
Marbles Kids Museum will develop tools and strategies to train its staff, volunteers, and interns to engage infants, toddlers, and preschool children in activities and conversations that lay the foundation for critical early math skills. The staff capacity-building project will deepen the museum staff's understanding of early math skills, how to foster those skills, and why investment in early math is critical to long term success in school. With a content coach, the museum will research and develop early math resources, activities, and exhibit enhancements that engage children and their families. Additionally, the museum will seek to understand community needs related to early math learning, and create content for professional development video modules. The museum will modify the professional development modules to create caregiver workshops focused on fostering early math learning through everyday activities and play at home. Museum staff will share tools and lessons learned through a regional museum convening and at national conferences.
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Math is everywhere in the world, but youth may see math as disconnected from their everyday experiences and wonder how math is relevant to their lives. There is evidence that informal math done by children is highly effective, involving efficiency, flexibility, and socializing. Yet, more is needed to understand how educators can support math engagement outside of school, and the role these out-of-school experiences can play relative to the classroom and lifelong STEM learning. This Innovations and Development Project seeks to conduct research on a location-based mobile app for informal mathematics learning. This research takes place at 9 informal learning sites and involves iteratively designing an app in which learners can view and contribute to an interactive map of math walk “stops” at these sites. Learners will be able to select locations and watch short videos or view pictures with text that describe how mathematical principles are present in their surroundings. For example, learners could use the app to discover how a painting by a local Latino artist uses ratio and scale, or how a ramp in downtown was designed with a specific slope to accommodate wheelchairs. Research studies will examine the affordances of augmented reality (AR) overlays where learners can hold up the camera of their mobile device, and see mathematical representations (e.g., lines, squares) layered over real-world objects in their camera feed. Research studies will also examine the impact of having learners create their own math walk stops at local informal learning sites, uploading pictures, descriptions, and linking audio they narrate, where they make observations about how math appears in their surroundings and pose interesting questions about STEM ideas and connections they wonder about.
This project draws on research on informal math learning, problem-posing, and culturally-sustaining pedagogies to conduct cycles of participatory design-based research on technology-supported math walks. The research questions are: How does posing mathematical scenarios in community-imbedded math walks impact learners’ attitudes about mathematics? How can experiencing AR overlays on real world objects highlight mathematical principles and allow learners to see math in the world around them? How can learners and informal educators be engaged as disseminators of content they create and as reviewers of mathematical content created by others? To answer these questions, five studies will be conducted where learners create math walk stops: without technology (Study 1), with a prototype version of the app (Study 2), and with or without AR overlays (Study 3). Studies will also compare children's experiences receiving math walk stops vs. creating their own stops (Study 4) and explore learners reviewing math walk stops made by their peers (Study 5). Using a community ethnography approach with qualitative and quantitative process data of how youth engage with the app and with each other, the project will determine how the development of math interest can be facilitated, how learner-driven problem generation can be scaffolded, and under what circumstances app-based math walks are most effective. The results will contribute to research on the development of interest, problem-posing, informal mathematics learning, and digital supports for STEM learning such as AR. This project will promote innovation and have strategic impact through a digital infrastructure that could be scaled up to support STEM walks anywhere in the world, while also building a local STEM learning ecosystem among informal learning sites focused on informal mathematics. This project is a partnership between Southern Methodist University, a nonprofit, talkSTEM that facilitates the creation of community math walks, and 9 informal learning providers. The project will directly serve approximately 500 grades 4-8 learners and 30-60 informal educators. The project will build capacity at 9 informal learning sites, which serve hundreds of thousands of students per year in their programming.
This Innovations in Development project is supported by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Sense-making with data through the process of visualization—recognizing and constructing meaning with these data—has been of interest to learning researchers for many years. Results of a variety of data visualization projects in museums and science centers suggest that visitors have a rudimentary understanding of and ability to interpret the data that appear in even simple data visualizations. This project supports the need for data visualization experiences to be appealing, accommodate short and long-term exploration, and address a range of visitors’ prior knowledge. Front-end evaluation
Identifying causal relationships is an important aspect of research and evaluation in visitor studies, such as making claims about the learning outcomes of a program or exhibit. Experimental and quasi-experimental approaches are powerful tools for addressing these causal questions. However, these designs are arguably underutilized in visitor studies. In this article, we offer examples of the use of experimental and quasi-experimental designs in science museums to aide investigators interested in expanding their methods toolkit and increasing their ability to make strong causal claims about
Although discussions of museums often revolve around exhibits, educators in these spaces have the potential to create in-depth, social learning experiences beyond what is possible at exhibits alone. There is still little empirical research, however, to inform how we understand, approach, and improve museum facilitation practices. In this study, we sought to address this gap by quantifying the impact of facilitation by trained educators working with visitors at interactive museum exhibits and comparing this to visitor engagement and learning outcomes for families without educator support. Using
This paper describes an NSF-funded study which explored the relationship between female-responsive exhibit designs and girls’ engagement. Across three participating science centers, 906 museum visitors ages 8 to 13 were observed at 334 interactive physics, math, engineering, and perception exhibits. We measured girls’ engagement based on whether they chose to use or return to the exhibits, opted to spend more time at them, or demonstrated deeper engagement behavior. Findings suggest that the design strategies identified in our previously developed Female-Responsive Design Framework can inform
This paper describes the development of a Female-Responsive Design Framework for Informal Science Education (ISE). The FRD Framework translates ideas from Culturally Responsive Pedagogy to discover and recommend pedagogical strategies that apply to females and design. This paper describes our synthesis of prior research about females’ social, historical, and cultural practices in STEM learning from a variety of fields. The paper further details our process of developing the FRD Framework with the help of museum practitioners, female youth, researchers, and experts from the fields of design
Mathematics plays a significant role in understanding and participating in science, technology, and engineering (STEM). Research shows that early mathematics experiences in everyday life are critical to the development of children's mathematical knowledge. This project will explore an innovative approach to fostering parent-child math interactions and conversations related to mathematical ideas. The approach will use community-based, exhibit installations called Mathscapes. These are artistic, culturally relevant, easily accessible, physical installations designed to encourage adults and children (ages 3 to 7) to use their immediate environment to playfully explore key early math concepts. The project also addresses a need for research about the cultural experiences and resources that marginalized children and families bring to mathematical conversations. Understanding parent-child interactions about mathematics community settings could result in new knowledge about early math learning among low income children and parents. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This exploratory study will design and investigate an innovative approach to encouraging math talk and math-related interactions between parents and children (ages 3-7) through the creation of MathScapes. These are temporary physical installations designed to use the immediate environment to playfully explore mathematical concepts. This study will be conducted in two Boston neighborhoods that are populated by low-income, non-dominant minority and immigrant families. Adopting a case study approach, the project will use observational methods, discourse analysis of parent/child talk, and interviews to study the interactions of 200 families at two neighborhood Mathscape installations. LENA devices will be used to capture parent/child talk at the Mathscapes while researchers use observational methods to document participant interactions, talk, and gestures. Data sources will include audio recordings of family talk, field notes of family interactions at Mathscape installations, surveys, and interviews. A qualitative approach will be used to produce research findings at multiple levels. The focus of the analysis will be to understand if this approach enhances the quality and quantity of math talk between parents and children. The project will be carried out by a research-practice-community partnership in Boston, Massachusetts that includes community mathematics educators, education researchers, and participating children and families. The design of community installations could promote engagement with math through adult/child conversations in culturally-relevant contexts situated in the local environment. By addressing the cultural experiences and resources of young people, the project could greatly enhance our understanding of how to leverage the resources that children and families bring to engaging with mathematics.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Omowale MosesDanny MartinCatherine O'ConnorNermeen Darshoush
As the world is increasingly dependent upon computing and computational processes associated with data analysis, it is essential to gain a better understanding of the visualization technologies that are used to make meaning of massive scientific data. It is also essential that the infrastructure, the very means by which technologies are developed for improving the public's engagement in science itself, be better understood. Thus, this AISL Innovations in Development project will address the critical need for the public to learn how to interpret and understand highly complex and visualized scientific data. The project will design, develop and study a new technology platform, xMacroscope, as a learning tool that will allow visitors at the Science Museum of Minnesota and the Center of Science and Industry, to create, view, understand, and interact with different data sets using diverse visualization types. The xMacroscope will support rapid research prototyping of public experiences at selected exhibits, such as collecting data on a runner's speed and height and the visualized representation of such data. The xMacroscope will provide research opportunities for exhibit designers, education researchers, and learning scientists to study diverse audiences at science centers in order to understand how learning about data through the xMacroscope tool may inform definitions of data literacy. The research will advance the state of the art in visualization technology, which will have broad implications for teaching and learning of scientific data in both informal and formal learning environments. The project will lead to better understanding by science centers on how to present data to the public more effectively through visualizations that are based upon massive amounts of data. Technology results and research findings will be disseminated broadly through professional publications and presentations at science, education, and technology conferences. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project is driven by the assumption that in the digital information age, being able to create and interpret data visualizations is an important literacy for the public. The research will seek to define, measure, and advance data visualization literacy. The project will engage the public in using the xMacrocope at the Science Museum of Minnesota and at the Center of Science and Industry's (COSI) science museum and research center in Columbus, Ohio. In both museum settings the public will interact with different datasets and diverse types of visualizations. Using the xMacroscope platform, personal attributes and capabilities will be measured and personalized data visualizations will be constructed. Existing theories of learning (constructivist and constructionist) will be extended to capture the learning and use of data visualization literacy. In addition, the project team will conduct a meta-review related to different types of literacy and will produce a definition with performance measures to assess data visualization literacy - currently broadly defined in the project as the ability to read, understand, and create data visualizations. The research has potential for significant impact in the field of science and technology education and education research on visual learning. It will further our understanding of the nature of data visualization literacy learning and define opportunities for visualizing data in ways that are both personally and culturally meaningful. The project expects to advance the understanding of the role of personalization in the learning process using iterative design-based research methodologies to advance both theory and practice in informal learning settings. An iterative design process will be applied for addressing the research questions by correlating visualizations to individual actions and contributions, exploring meaning-making studies of visualization construction, and testing the xMacroscope under various conditions of crowdedness and busyness in a museum context. The evaluation plan is based upon a logic model and the evaluation will iteratively inform the direction, process, and productivity of the project.
Educators have been increasingly interested in teaching mathematics in informal settings. However, there is little research on the actual learning outcomes of out-of-school mathematics instruction or the role of interest in explaining the outcomes. In this study, 793 12-year-old pupils were taken into a science center mathematics exhibition in Latvia and Sweden, measuring their prior knowledge of the contents of the exhibition, general cognitive competences and individual interest in school mathematics before the visit, and their situational interest and learning outcomes after the exhibition
DATE:
TEAM MEMBERS:
Mari-Pauliina VainikainenHannu SalmiHelena Thuneberg