Reflections from a researcher and caregiver on the process of working together on a study examining strategies to communicate the relevance of engineering practices at exhibits.
This guide shares some of the successes and challenges behind the Science Museum of Minnesota’s Cardboard City exhibition and our partnership with museums across the country through Cardboard Collaborative.
The Cardboard Collaborative is the product of 10 years of work at the Science Museum of Minnesota and part of a larger collaboration with local community organizations to center BIPOC family priorities and experiences. This guide is intended to share what they have learned and support others to create their own cardboard maker worlds.
This analysis examines how assembly-style making activities support creative expression and early engineering learning. We suggest makerspace designers and educators consider include assembly-style making activities in the mix of options available to support makers who are less comfortable with making initially.
This project is designed to support collaboration between informal STEM learning (ISL) researchers, designers, and educators with sound researchers and acoustic ecologists to jointly explore the role of auditory experiences—soundscapes—on learning. In informal STEM learning spaces, where conversation advances STEM learning and is a vital part of the experience of exploring STEM phenomena with family and friends, attention to the impacts of soundscapes can have an important bearing on learning. Understanding how soundscapes may facilitate, spark, distract from, or even overwhelm thinking and conversation will provide ISL educators and designers evidence to inform their practice. The project is structured to reflect the complexity of ISL audiences and experiences; thus, partners include the North Park Village Nature Center located in in a diverse immigrant neighborhood in Chicago; Wild Indigo, a Great Lakes Audubon program primarily serving African American visitors in Midwest cities; an after-school/summer camp provider, STEAMing Ahead New Mexico, serving families in the rural southwest corner of New Mexico, and four sites in Ohio, MetroParks, Columbus Zoo and Aquarium, Franklin Park Conservatory and Botanical Gardens, and the Center of Science and Industry.
Investigators will conduct large-scale exploratory research to answer an understudied research question: How do environmental sounds impact STEM learning in informal learning spaces? Researchers and practitioners will characterize and describe the soundscapes throughout the different outdoor and indoor exhibit/learning spaces. Researchers will observe 800 visitors, tracking attraction, attention, dwell time, and shared learning. In addition to observations, researchers will join another 150 visitors for think-aloud interviews, where researchers will walk alongside visitors and capture pertinent notes while visitors describe their experience in real time. Correlational and cluster analyses using machine learning algorithms will be used to identify patterns across different sounds, soundscapes, responses, and reflections of research participants. In particular, the analyses will identify characteristics of sounds that correlate with increased attention and shared learning. Throughout the project, a team of evaluators will monitor progress and support continuous improvement, including guidance for developing culturally responsive research metrics co-defined with project partners. Evaluators will also document the extent to which the project impacts capacity building, and influences planning and design considerations for project partners. This exploratory study is the initial in a larger research agenda, laying the groundwork for future experimental study designs that test causal claims about the relationships between specific soundscapes and visitor learning. Results of this study will be disseminated widely to informal learning researchers and practitioners through workshops, presentations, journal articles, facilitated conversations, and a short film that aligns with the focus and findings of the research.
DATE:
-
TEAM MEMBERS:
Martha MersonJustin MeyerDaniel Shanahan
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
The STEAM Para Todos project will transform a prominent exhibit in the Marbles Kids Museum into a vibrant space that fosters culturally relevant STEAM learning and exploration for all museum visitors, particularly the growing Hispanic, dual-language learner population in Wake County, N.C. The three-year project will involve research, testing, design, installation, and evaluation. The museum will work with the school system, STEM partners, the local arts community, and organizations engaged with the Hispanic community to develop the exhibit. Guiding the project will be a community of practice, comprised of museum professionals; researchers with expertise in STEAM education, dual language learners, and culturally responsive informal learning; partners from STEM businesses; creative arts organizations; the Wake County Public School System; and stakeholders from the exhibit's intended audience. Project partners include Wake County Public School System, Que Pasa, US2020, Visual Arts Exchange, North Carolina Society of Hispanic Professionals, and Google Fiber.
Hands-on tinkering experiences can help promote more equitable STEM learning opportunities for children from diverse backgrounds (Bevan, 2017; Vossoughi & Bevan, 2014). Latine heritage families naturally engage in and talk about engineering practices during and after tinkering in a children’s museum (Acosta & Haden, in press). We asked how the everyday practice of oral stories and storytelling could be leveraged during an athome tinkering activity to support children’s informal engineering and spatial learning.
Access to STEM information is unequal, with rural and poor communities often receiving the fewest public education science and science literacy opportunities. Rural areas also face unique STEM teaching and technology integration challenges. In fact, LatinX communities in rural areas are less likely to have access to educational resources and language supports available to LatinX communities in urban centers. This project will help address these inequities by engaging rural librarians, bilingual science communicators, polar scientists, and a technical team to create a series of five bilingual virtual reality (VR) experiences to enhance STEM understanding and appreciation. Project researchers will create a new channel for disseminating polar science, working first with rural Latinx communities in Wisconsin to create a new network between rural communities and university researchers. Involving rural librarians in the co-design of instruction process will produce new ways for rural libraries to engage their local communities and their growing Latinx populations with polar science learning experiences. Each of the five VR experiences will focus on a different area of research, using the captivating Arctic and Antarctic environments as a central theme to convey science. VR is a particularly powerful and apt approach, making it possible to visit places that most cannot experience first-hand while also learning about the wide range of significant research taking place in polar regions. After design, prototyping and testing are finished, the VR experiences will be freely available for use nationally in both rural and urban settings. Public engagement with science creates a multitude of mutual benefits that result from a better-informed society. These benefits include greater trust and more reasoned scrutiny of science along with increased interest in STEM careers, many of which have higher earning potential. The project team will partner with 51 rural libraries which are valued community outlets valuable outlets to improve science literacy and public engagement with science. The effects of this project will be seen with thousands of community members who take part in the testing of prototype VR experiences during development and scaled engagement through ongoing library programs utilizing the final VR experiences for years to come.
This project will create new informal STEM learning assessment techniques through combining prior efforts in the areas of educational data mining for stealth assessment and viewpoint similarity metrics through monitoring gaze direction. Results of the project contribute to the field of educational data mining (EDM), focusing on adopting its methods for VR learning experiences. EDM is a process of using fine grained interaction data from a digital system to support educationally relevant conclusions and has been applied extensively to intelligent tutors and more recently, educational videogames. This project will continue building on existing approaches by expanding to include the unique affordances of VR learning media, specifically gaze. The project will focus on predicting user quitting as well as assessing key learning goals within each experience and triangulate these predictive models with user observations and post-experience surveys. The eventual application of this foundational research would address the problem in assessing a learner using measures external to the experience itself (i.e., surveys) and instead provide new methods that instrument learners using only data generated by their actions within the learning context. These techniques will provide a new means for evaluating informal learning in immersive technology settings without need for explicit tagging. The findings from this project will enable a greater understanding of the relationship between a user’s experience and their learning outcomes, which may prove integral in the creation of educational interventions using VR technology.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments. This project is also supported by the Office of Polar Programs.
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.