This report presents highlights from a Fall 2020 evaluation conducted with 69 STEAM teachers from across the U.S., all of whom are part of the National Air and Space Museum's Teacher Innovator Institute (TII). Due to the impact of the COVID-19 pandemic on classrooms and the museum's teacher PD program, the evaluation in Fall 2020 focused on understanding the conditions, adaptations, challenges, and success stories of this population of teachers from across the country. The findings in this report provide insight into the variations in teaching conditions (depending on geography and urbanity
Informal learning institutions, such as museums, science centers, and community-based organizations, play a critical role in providing opportunities for students to engage in science, technology, engineering, and mathematics (STEM) activities during out-of-school time hours. In recent years, thousands of studies, evaluations, and conference proceedings have been published measuring the impact that these programs have had on their participants. However, because studies of informal science education (ISE) programs vary considerably in how they are designed and in the quality of their designs, it
But many young people face signifcant economic, cultural, historical, and/or social obstacles that distance them from STEM as a meaningful or viable option— these range from under-resourced schools, race- and gender-based discrimination, to the dominant cultural norms of STEM professions or the historical uses of STEM to oppress or disadvantage socio-economically marginalized communities (Philip and Azevedo 2017). As a result, participation in STEM-organized hobby groups, academic programs, and professions remains low among many racial, ethnic, and gender groups (Dawson 2017). One solution to
Production of a mobile-optimized website, a walking tour, and a museum exhibition exploring the history of underground and submerged sites in downtown San Francisco and the Bay.
The Exploratorium seeks support for the production and distribution of San Francisco's Buried History, a project that uses digital technology to engage the public in a physical and virtual exploration of the urban history of Downtown San Francisco. Specifically, Buried History uses a mobile-optimized web site, a walking tour, and accompanying museum exhibit to explore seventeen underground sites that provide fascinating clues as to how the landscape was used and altered over time, as well as to how past inhabitants of the area lived, worked and died. The project will prompt the public to become curious about the rich historical and cultural information right beneath their feet, and the story that information tells of how and why human activity transformed the landscape of San Francisco. In doing so, Buried History will engage users in adopting a more nuanced sense of place—encouraging its audience to learn from historical insights while developing perspectives on contemporary issues.
Science learning occurs throughout people's lives, inside and outside of school, in formal, informal, and nonformal settings. While museums have long played a role in science education, learning in this and other informal settings has not been studied nor understood as deeply as in formal settings (i.e., schools and classrooms). This position paper, written by learning researchers in a science museum engaged in equity and access work, notes that while the researchers consider the ethics of their work regularly and deeply, little formal guidance exists for the ethical challenges they routinely
From 2018 to 2020, the Emerging Research on Identity, Representation & Inclusion in Museums project team set out to document graduate-level research on identity in the museum field, and support professionals’ ongoing research and publishing on these topics. Researchers at Knology synthesized over 90 graduate student theses about identity and museums from 2000 to 2018. In parallel, we interviewed a sample of the authors whose work appeared in the literature review, to understand how identity research has played a role in their careers. To support new and ongoing identity research, we hosted a
Diversity, equity, accessibility, and inclusion (DEAI) have become central concerns for museums. Across the field, leaders are asking—with increasing urgency—how museums can diversify their visitors, staff, and boards; create welcoming and inclusive environments and workplaces; and ensure that museum offerings reflect a broad range of interests, experiences, and needs.
Museums have approached DEAI efforts in different ways and at different levels, from developing special exhibits and events for specific audiences to offering staff diversity training to board development. Despite more than
The Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. An ongoing challenge to the design of effective STEM learning exhibits for diverse young children is the absence of reliable and evidence-based resources that designers can apply to the design of STEM exhibits that draw upon play as a child's primary pedagogy, while simultaneously engaging children with STEM content and processes that support development of STEM skills such as observation. To address these challenges, the project team will use a collaborative process in which learning researchers and informal STEM practitioners iteratively develop, design, and test the STEM for Play Framework that could then be applied to the design of STEM-focused exhibits that support play and STEM skill use among early learners.
This Research in Service to Practice project will address these questions: 1) What is a framework for play in early STEM learning that is inclusive of children's cultural influences?; 2) To what extent do interactions between early learners (ages 3-8) and caregivers or peers at exhibits influence the structure and effectiveness of play for supporting STEM skill development?; 3) How do practitioners link play to STEM skill development, and to what extent does a framework for play in early STEM learning assist in identifying types of play that supports early STEM skill development?; and 4) What do practitioners identify as best practices in exhibit design that support the development of STEM skills for early childhood audiences, and conversely, to what extent do practitioners perceive specific aspects of the design as influential to play? The project team will address these questions across four phases of study that will include (a) development of a critical research synthesis to inform the initial STEM for Play framework; (b) the use of surveys, focus groups, and interviews to solicit feedback from practitioners; (c) testing and revising the framework by conducting structured observations of STEM exhibits at multiple museums. The project team will use multiple analytic approaches including qualitative thematic analyses as well as inferential statistics. Results will be disseminated to children?s museums, science centers, and research communities.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this RAPID project is to better understand how an informal science education organization and its STEM resources can partner with community groups and their expertise to support people's ability to understand, process, and work toward dismantling systemic racism. The project will draw from exhibition and programming resources that have been developed and refined over almost two decades of engagement with the topics of STEM, race, and racism in a science museum context. Examples of STEM programming include data and data visualization, how biology and environment shape behavior and perception, and the use of technology to communicate. This project will build on previously developed relationships in three regions to design and facilitate virtual STEM-informed activities and conversations about race in each regional site. These activities and training will support participants to better understand, process, and work toward dismantling systemic racism.
This RAPID project is timely given the Covid-19 pandemic and the increased awareness of the ongoing impact of systemic racism. The project will address the following questions:
What kinds of virtual STEM-informed activities allow for community members to explore, understand, or act upon the impacts of systemic racism? What are key features of those activities, from the perspective of participants? What are promising changes that community members report as a result of these activities? How are science-based resources perceived, and how do participants perceive they are learning STEM?
What supports allow the regional project group members and museum staff to collaborate successfully, and what obstacles slow that work down?
How do local collaboratives define long-term success of their work, and how can they track their progress over time? The project team and the regional project group members bring a range of experience in community engagement, science education programming, and informal science learning research.
The project will develop this new knowledge for the informal science education field and other local stakeholders through qualitative and participatory research and virtual STEM-informed activities that are responsive to the changing needs of community members. The project will begin in August 2020 as the ability to understand the research questions requires immediate collection of data. Because of the essential nature of this type of research for the informal STEM learning field, the team plans to analyze data and start initial dissemination by the fall of 2020 with additional data collection, analysis, and dissemination continuing as the project progresses.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Across the country, educators and mentors in informal settings have provided youth with opportunities to persist and thrive along STEM (science, technology, engineering, and mathematics) trajectories. Unfortunately, the current COVID-19 pandemic may limit youths' opportunities to continue pursuing STEM pathways by removing their access to important resources, such as mentors in science labs and other STEM learning spaces. The impact of the pandemic may be especially harmful for youth from underrepresented groups whose families have been disproportionately affected by this crisis. The purpose of this project is to study the impact of COVID-19 on the STEM trajectories of teenagers from underrepresented groups who had previously worked with scientists as mentors before the pandemic. A survey, which will be administered to hundreds of teenagers, will identify the supports that they used to successfully navigate disruptions as they continued to pursue college and career pathways in STEM. For teenagers who decided not to actively pursue STEM pathways during the pandemic, this survey will illuminate how loss of supports and new challenges discouraged their active pursuit of STEM. By identifying supports and challenges that encouraged or discouraged STEM pursuits, this project will advance knowledge on how informal learning programs can support underrepresented teenagers in persisting along STEM pathways during national crises and emergencies.
The American Museum of Natural History will conduct mixed-methods research to explore the impact of the pandemic on the STEM trajectories of underrepresented teenagers. They will administer surveys to 560 teenagers from underrepresented groups who previously participated in the New York City Science Research Mentoring Consortium. The survey will ascertain whether and how the youth found access to new supports or lost access to former supports; whether they face new challenges and how they have responded to those challenges; and whether and how their feelings about pursuing STEM in college and beyond have changed. Teenagers who complete the survey will identify adults in their lives who have been important in supporting their pursuits in STEM, and two adults per teenager will also be invited to complete surveys on perceived disruptions. Latent class analyses, cognitive interviews, and consultation with youth and survey experts will be used to establish survey validity, while the survey results will be analyzed via two-mode social network analysis. Additionally, 16 teenagers will participate in in-depth interviews regarding the impact of the pandemic on their STEM trajectories. Findings and implications for practice will be disseminated widely to researchers, educators, and mentors in informal science education. These findings will help stakeholders to provide better supports for underrepresented youth during the current pandemic and during future national emergencies. This project is funded by the Advanced Informal STEM Learning (AISL) program. As part of its overall strategy to enhance learning in informal environments, the AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This RAPID award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Preeti GuptaTimothy PodkulKaren Hammerness
While museums strive to be as inclusive and welcoming as possible to all visitors, data from many institutions shows that audiences are still disproportionately white, well-educated, and more affluent than the average local population. One contributing factor to the lack of progress is that staff often create programs that work to create inclusivity from their own perspective, rather than grounding the work in a broader vision of the museum experience. This project will allow for a deeper exploration of how visitors, particularly those from groups that visit less frequently, experience a museum visit, and how their sense of belonging is supported or eroded during their visit. The team believes this sense is built up or taken away through specific moments of engagement or alienation and will explore these moments that matter through the work. Through intensive work at one museum, and additional work at three other museums, the project will look for themes and insights that can help all museums to create more positive moments that matter for all audiences. Specifically, the project will result in a) insights for museums in supporting a visitor-based sense of belonging, b) shared methods for working with visitors that could be applied by other researchers to explore specifics in a particular setting, and c) grounding work to develop survey questions for use across the field. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Building on existing work around exclusion and inclusion in everyday science learning, this project aims to formally define what a sense of belonging means in the science and natural history museum context as a construct for understanding inclusivity. The research team hypothesizes that the majority of experiences in an entire museum visit have a relatively neutral effect on visitor sense of belonging; however, at times, visitors may experience positive or negative moments, and these moments that matter may influence a visitor's STEM engagement, interest, and/or identity. This exploratory work will help to develop and ground the construct of sense of belonging within the museum visitor's experiences, to identify visitor moments that matter using an equity approach that intentionally centers the experiences of visitors from underrepresented groups, and to form the basis for future research that would support the development of a fieldwide measure of sense of belonging. The research study will focus on defining the construct of sense of belonging so it 1) aligns with the research literature and 2) is grounded in the experiences of science/natural history museum visitors. Photovoice data collection method and interviews will be used with visitors ages six and above to identify moments that matter for them during a visit to a science/natural history museum. This project will create new understanding of this construct for not only science/natural history museums and the larger informal science education (ISE) field, but fill a gap in the overall literature around the construct of sense of belonging. The project will also provide new learnings for the ISE field on how to adapt and use the photovoice method to study complex constructs, such as sense of belonging, in science/natural history museums.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
There is a national need to expand opportunities to learn coding and computational thinking in informal science, technology, engineering, and mathematics (STEM) education. These skills are increasingly needed in STEM disciplines. As young people learn to code, they engage in computational thinking concepts and practices which are problem solving strategies that include repeated process (iterative) design skills. This project promotes innovation by designing and developing activities for tinkering spaces (a space filled with materials for hands-on exploration of STEM) combined with coding in informal learning organizations such as museums, and community centers. The project supports both tinkering and making as methods to meaningfully incorporate computational thinking in STEM learning experiences. The tinkering approach to learning is characterized by hands-on, trial and error engagement. Making is similar to tinkering with additional attention to learning with peer groups. The long-term goal of the project is to enable informal educators to engage in STEM programming with youth and families from underrepresented groups. The project brings together interdisciplinary teams from the Department of Information Science at the University of Colorado Boulder (CU Boulder), the Tinkering Studio at the Exploratorium, and the Lifelong Kindergarten research group at the Massachusetts Institution of Technology. In collaboration with local partner sites, the project team will design and disseminate a collection of six computational tinkering activity areas that engage learners in creative explorations using a combination of physical objects and computational code. The team will develop visual coding "microworlds" for each of the activity areas, specialized sets of coding blocks designed to provide scaffolding. Additionally, the project team will design and develop facilitation guides to document these activities and facilitation strategies, as well as workshops to better support facilitators in making and tinkering spaces.
The project enhances knowledge building through investigations of what instructional supports informal educators need to develop effective facilitation practices that engage underrepresented youth and families in STEM computational learning experiences. Study participants will include informal educators in museum, library, and community-based settings with varying backgrounds and experiences facilitating computing activities. The project team will also engage youth and families from underrepresented groups through collaborative efforts with community-based partners. Research questions include: 1) What challenges and barriers do informal learning educator, face to engage their learners in design-based activities with computing? 2) What supports informal learning educators to take on key facilitation practices that support children and families in computational tinkering activities? 3) In jointly engaging in these computational tinkering activities, how do the activities and informal learning educators? facilitation of these activities impact children's and families' development of computational tinkering and identities as creators and learners with computing? To answer these research questions the project will use qualitative ethnographic methods to study the developing interactions between learners and facilitators at three local sites. Comparative case studies of facilitators across the local partner sites will also be used to examine what supports facilitators to take on key facilitation practices. Data sources will include participant observation of facilitators and families, documentation in the form of photos, videos, and audio recordings, project artifacts, bi-monthly short surveys with reflective prompts, and interviews with facilitators and families.
This award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.