This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Math is everywhere in the world, but youth may see math as disconnected from their everyday experiences and wonder how math is relevant to their lives. There is evidence that informal math done by children is highly effective, involving efficiency, flexibility, and socializing. Yet, more is needed to understand how educators can support math engagement outside of school, and the role these out-of-school experiences can play relative to the classroom and lifelong STEM learning. This Innovations and Development Project seeks to conduct research on a location-based mobile app for informal mathematics learning. This research takes place at 9 informal learning sites and involves iteratively designing an app in which learners can view and contribute to an interactive map of math walk “stops” at these sites. Learners will be able to select locations and watch short videos or view pictures with text that describe how mathematical principles are present in their surroundings. For example, learners could use the app to discover how a painting by a local Latino artist uses ratio and scale, or how a ramp in downtown was designed with a specific slope to accommodate wheelchairs. Research studies will examine the affordances of augmented reality (AR) overlays where learners can hold up the camera of their mobile device, and see mathematical representations (e.g., lines, squares) layered over real-world objects in their camera feed. Research studies will also examine the impact of having learners create their own math walk stops at local informal learning sites, uploading pictures, descriptions, and linking audio they narrate, where they make observations about how math appears in their surroundings and pose interesting questions about STEM ideas and connections they wonder about.
This project draws on research on informal math learning, problem-posing, and culturally-sustaining pedagogies to conduct cycles of participatory design-based research on technology-supported math walks. The research questions are: How does posing mathematical scenarios in community-imbedded math walks impact learners’ attitudes about mathematics? How can experiencing AR overlays on real world objects highlight mathematical principles and allow learners to see math in the world around them? How can learners and informal educators be engaged as disseminators of content they create and as reviewers of mathematical content created by others? To answer these questions, five studies will be conducted where learners create math walk stops: without technology (Study 1), with a prototype version of the app (Study 2), and with or without AR overlays (Study 3). Studies will also compare children's experiences receiving math walk stops vs. creating their own stops (Study 4) and explore learners reviewing math walk stops made by their peers (Study 5). Using a community ethnography approach with qualitative and quantitative process data of how youth engage with the app and with each other, the project will determine how the development of math interest can be facilitated, how learner-driven problem generation can be scaffolded, and under what circumstances app-based math walks are most effective. The results will contribute to research on the development of interest, problem-posing, informal mathematics learning, and digital supports for STEM learning such as AR. This project will promote innovation and have strategic impact through a digital infrastructure that could be scaled up to support STEM walks anywhere in the world, while also building a local STEM learning ecosystem among informal learning sites focused on informal mathematics. This project is a partnership between Southern Methodist University, a nonprofit, talkSTEM that facilitates the creation of community math walks, and 9 informal learning providers. The project will directly serve approximately 500 grades 4-8 learners and 30-60 informal educators. The project will build capacity at 9 informal learning sites, which serve hundreds of thousands of students per year in their programming.
This Innovations in Development project is supported by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Informal STEM education spaces like museums can intentionally serve surrounding communities and support sustainable and accessible engagement. Building from this base, the project takes a stance that the intersection of the museum, home/family life and the youth’s internal practices and disciplinary sense of self are rooted in history and culture. Thus, this CAREER work builds on the following principles: Black families and youth have rightful presence in STEM and in STEM learning environments; Black families are valuable learning partners; and Black youths need counterspaces to explore STEM as one mechanism for creating future disciplinary agency. In partnership with the Henry Ford Museum and the Detroit-Area Pre-College Engineering Program, the project seeks to (a) expand the field's understanding of how Black youth engineer and innovate; (b) investigate the influence of a culturally relevant curriculum on their engineering practices and identity, knowledge, and confidence; and (c) describe the ways Black families and museums support youth in engineering learning experiences. The work will center on the 20-hour “Innovate” curriculum which was designed by the museum to bridge design, innovation, and creation practices with the artifacts of innovators throughout time. The project comprises six weekend “Innovate” sessions and an at-home innovation experience plus participation in an annual Invention Convention. By focusing on these aims, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
The main research questions of this multiphase CAREER award are: (1) What practices do Black youths and families engage in as they address engineering, design, and innovation challenges? (2) In what ways does a culturally relevant museum-based innovation program influence the design and innovation practices and assessment performance of Black youths and families as they engage in engineering, design, and innovation across learning settings? (3) How does teaching innovation, design, and engineering through historical re-telling and reconstruction influence a youth’s perception of their own identities, abilities, and practices? and (4) How do Black families engage with informal STEM learning settings and what resources best support their engineering, design, and innovation exploration? Youth in sixth grade are the focus of the research. The work is guided by ecological systems, sociocultural learning, culturally relevant pedagogy, and community cultural wealth theories. During phase one, the focus will be to refine the curriculum and logistics of the study implementation. The investigator will enhance the curriculum to include narratives of Black innovators and engineers. Fifteen families will be recruited to participate in the program enhancement pilot and initial research cycle for phase two. In phase three another cohort of families will be recruited to participate. Survey research, narrative inquiry and digital ethnography will comprise the approaches to explore the research questions. The evaluation has a two-pronged focus: to assess (1) how well the enhanced Innovate curriculum and museum/home learning experience supports Black families’ participation and (2) how well the separate phases of the study connect and operate together to meet the research aims. The study’s findings can help families and informal practitioners leverage evidence-based approaches to support Black youth in making connections between history and out-of-school contexts to model and develop their innovative engineering practices. Additionally, this work has implications for Black undergraduate students who will develop skills through their mentorship and researcher roles, studying cultural practices and learning experiences. The research study and findings can inform the design of future museum/home learning programs and research opportunities for Black learners in informal learning spaces.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.
BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.
A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.
This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This presentation "Revealing Impacts: How does one long-term, statewide field trip program influence a community's learning ecosystem?" was shared as showcase at the 2021 Connected Learning Summit (https://app.clowdr.org/conference/clsummit2021/) held virtually from July 7-30, 2021.
In the showcase session, we shared details of an NSF funded collaborative project between the Gulf of Maine Research Institute, Oregon State University and TERC to understand how a longstanding, statewide field trip program, LabVenture, influences a community’s learning ecosystem. The project uses the construct
We used a combination of keyword- and human-coding-based strategies to identify and characterize the degree to which four key science communication journals have included research articles focused on the communication of basic science (N = 2,386). These journals included Public Understanding of Science, Science Communication, the Journal of Science Communication, and the International Journal of Science Education, Part B: Communication and Public Engagement. Our intention is to give those interested in basic-science-related communication the ability to speak to the degree to which an evidence
In this paper, our collaborative project team shares design principles and lessons learned from research for designing an app to support families’ joint engagement with media and promote powerful shared learning experiences. We provide a rationale, based on research literature, for why a second-screen app in particular addresses our project goals. In addition, we describe the Splash and Bubbles for Parents app components as well as the co-design process and design-based research studies conducted to inform its design and development. Finally, our team offers design principles grounded in
The assumptions, expectations, and potential for conducting a research synthesis (or any type of literature review) have evolved significantly in recent decades. With advancements in sophisticated and accessible analytical software, combined with the use of systematic protocols, reviews are increasingly generating results that can advance knowledge and practice. But, while reviews, synthesis or meta-analysis have the capacity to inform practice in unique ways, they are also fraught with their own methodological, ethical, and practical issues.
Drawing on the Addressing Societal Challenges
Poster presentation from the 2020 Association of Science and Technology Centers Annual Conference.
This poster presented preliminary findings from a configurative literature synthesis on how the literature posted on the InformalScience.org website, in peer-reviewed journals, and in the ProQuest archive of Theses and Dissertations report about how informal learning institutions are advancing the use of STEM knowledge and scientific reasoning in the ways that can help individuals and communities address the societal challenges of our time?
A year into the COVID-19 pandemic, the world continues to struggle with the many ways our lives have changed and the uncertainty that remains about the future. Vaccines are being widely administered, but how and when life will return to “normal” remains unknown. During this time, caregivers continue to seek out information to address the questions, worries, and information needs their children have about this unique moment in their lives. Our NSF-funded RAPID research project has helped to uncover some of these questions, worries, and needs by talking to caregivers of listeners of the children
This book chapter describes zoo and aquariums' history of conservation education programming for students and teachers. It showcases several examples of student-teacher-scientist partnerships, including Project TRUE, highlighting the program's success at cultivating sustained interest in science careers among high school youth.
Zoos and aquariums have a long history of providing conservation education to students and teachers. As the conservation work of zoos and aquariums has grown, so have the opportunities to connect students and teachers to the work of these scientists. This chapter