Final External Evaluation Report for Informal STEM Learning at Biological Field Stations, an NSF AISL Exploratory Pathways project, which studied the pedagogical and andragogical characteristics of informal educational outreach activities at field stations. This report summarizes the project team’s major research activities and the contextual factors that supported that work.
Appendix includes interview protocol.
With support from the National Science Foundation, the STEM Effect project was undertaken in partnership by staff from the Education Development Center, the National Girls Collaborative Project (NGCP) and the Intrepid Sea, Air & Space Museum. Through a variety of methods, the project convened representatives from cultural institutions (museums, science centers, zoos, botanical gardens and aquaria) from across the country which provide STEM programming aimed at increasing the participation of girls and women in science, technology, engineering and mathematics (STEM), along with researchers, and
Science learning occurs throughout people's lives, inside and outside of school, in formal, informal, and nonformal settings. While museums have long played a role in science education, learning in this and other informal settings has not been studied nor understood as deeply as in formal settings (i.e., schools and classrooms). This position paper, written by learning researchers in a science museum engaged in equity and access work, notes that while the researchers consider the ethics of their work regularly and deeply, little formal guidance exists for the ethical challenges they routinely
From 2018 to 2020, the Emerging Research on Identity, Representation & Inclusion in Museums project team set out to document graduate-level research on identity in the museum field, and support professionals’ ongoing research and publishing on these topics. Researchers at Knology synthesized over 90 graduate student theses about identity and museums from 2000 to 2018. In parallel, we interviewed a sample of the authors whose work appeared in the literature review, to understand how identity research has played a role in their careers. To support new and ongoing identity research, we hosted a
Diversity, equity, accessibility, and inclusion (DEAI) have become central concerns for museums. Across the field, leaders are asking—with increasing urgency—how museums can diversify their visitors, staff, and boards; create welcoming and inclusive environments and workplaces; and ensure that museum offerings reflect a broad range of interests, experiences, and needs.
Museums have approached DEAI efforts in different ways and at different levels, from developing special exhibits and events for specific audiences to offering staff diversity training to board development. Despite more than
The AZA Social Science Research Agenda 2020 is intended to be a compass to guide social science social science research by and about zoos and aquariums in the AZA community. It reflects the priorities,trends, and emerging issues that social scientists and practitioners in the AZA community have identified as the most relevant to address to help them meet their missions. While the primary audience for the agenda is the AZA community, its applicability extends beyond the AZA membership to other zoos and aquariums. The key research questions and accompanying sub-questions also hold relevance for
DATE:
TEAM MEMBERS:
Joy KubarekJackie OgdenShelly GrowAmy Rutherford
This paper examines the differences and challenges encountered when trying to create informal blended (virtual and hands-on) engineering design STEM activities. It contrasts the creation of STEM activities for formal and informal learning environments, stressing that the differences extend far beyond the length of the activity or depth of any learning goals. The discussion begins with an examination of differences between the two learning environments that need to be taken into consideration. These differences include the physical environments, organizational structures, and the goals or
Across the United States, individuals, organizations, and communities are wrestling with a wide array of challenging and persistent science, technology, engineering, and mathematics (STEM)-related problems. A few examples include ensuring more equitable access to STEM careers; building capacity for rural libraries to support STEM learning; and supporting greater cyber literacy among youth. The good news is that thousands of individuals, organizations, and communities are coming up with great ideas for how to confront these problems; many of them supported by the NSF. Unfortunately, most will encounter significant roadblocks to success along the way, but not because of bad ideas. Most change agents falter along the lengthy and often convoluted pathway between idea and successful execution because they bump up against barriers they do not expect or know how to overcome. This Pilot and Feasibility Study will create Learning Solutions, a multi-platform program designed to support those people and entities engaged in work that cultivates the public's understanding of, engagement with, and interest in STEM fields and STEM-related information. First, the project will systematically identify the real, but often unspoken issues that individuals, organizations, and communities run into as they work to bring about significant and impactful STEM-related change. Then, the project will assemble, curate, and make digitally available a collection of tools, resources and strategies designed to help someone understand and resolve these kinds of issues if and when they arise. By better understanding the experiences of change agents, the challenges they face, and the creative learning solutions they enact, this project will ensure that more change agents successfully access the learning know-how they need, when they need it, in curated, easy-to-digest formats. This award is funded by the Advanced Informal STEM Learning program which contributes to STEM engagement and literacy, workforce development, and educational success via supporting new approaches to and evidence-based understanding of STEM learning in informal environments. Learning Solutions will build capacity and will help more professionals successfully bring more good ideas to fruition.
The target audience for this Pilot & Feasibility phase of Learning Solutions will be STEM professionals working at the intersection of STEM and society across diverse sectors. It will focus on change agents -- individuals who want to be or who already are engaged in community-based, action-oriented STEM-related change projects, whether acting on their own, within an organization, or as part of a broader community of organizations. To achieve the goal of making STEM-related change easier to accomplish, Learning Solutions will implement a multi-step process. With input from five Critical Advisors, 20 Key Informants, and ultimately hundreds of change agents, project staff will: 1) Utilize an iterative process of in-depth interviews and broadly disseminated surveys to identify the major understandings, skills and processes that current and past STEM-related change agents have experienced as impediments to their success; 2) Determine how best to describe and categorize these issues across diverse problem spaces; 3) Select twelve issues, based on which are the most frequently mentioned and/or perceived to be the most critical or challenging, and research and curate the best and most authoritative resources responsive to these dozen issues; and finally, 4) Use a variety of platforms (e.g., social media, traditional media, digital and in print publications, podcasts, panels, and group presentations) and utilization metrics to ensure effective digital delivery of potential solutions to the selected issues. By the project's end, we will have identified some of the key challenges the STEM-related change agents who work in communities across America regularly encounter, as well as the feasibility of developing a mechanism for helping those change agents discover preexisting and readily accessible resources to assist them in resolving those challenges.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
John H FalkElysa CorinStacey Sheehan
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this pilot and feasibility study is to increase participation in informal STEM learning in rural Idaho through Stories of Fire, a program based on personal narratives of wildland fire. Idaho is a rural state, with an average population of just 19 people per square mile, the fourth lowest population density in the United States. The state is experiencing increasingly severe wildfire, and effective responses to such environmental change require a better understanding of the underlying science. Contextualizing science learning, making connections between everyday lives and a sense of place can engage learners and bring about a better understanding of wildfire. This project will bring together a science communicator, a narratologist, a fire ecologist, and a specialist on emotions and public lands. They will work collaboratively with informal educators based in rural areas of Idaho underrepresented in STEM fields. Rural areas are rich in knowledge based on years of cumulative observations, cultural beliefs, and practices shared through community networks. This project builds on these rural assets while addressing the challenges rural populations face. The project addresses broadening participation in STEM through narrative practices that encourage more diverse ways of knowing, being, and representing science.
This research study will explore: 1) what mechanisms of narrative (storytelling) most effectively integrate individuals? personal experiences and accurate STEM content in fire science communication, and 2) what audience-centered approaches best facilitate narrative approaches to informal STEM learning. This project engages four levels of participants over four phases of research and programming: 1) The research team will interview and analyze the narratives of 40 Frontliners (e.g., wildland firefighters and evacuees) from the inland Northwest region with first-hand experience with wildfire. 2) They will conduct a narrative workshop to train 20 informal STEM Educators from across the state on audience-centered approaches that facilitate participant storytelling about fire. 3) Educators will pilot their own narrative-based informal science learning programs with program participants in their rural home communities across the state, 4) A professional podcaster will create two podcasts modeled on our research findings for public audiences reached through media.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Teresa CohnLeda KobziarJennifer LadinoErin James
In informal science contexts, the word tinkering describes a learning process that combines art, science, and technology through hands-on inquiry. With the growth in popularity of the making and tinkering movements nationwide, these practices are increasingly making their way into early childhood environments where they have great promise to positively impact the early STEM learning experiences of young children. This 2-day conference hosted at the Exploratorium in San Francisco will bring together stakeholders exploring applications of tinkering in informal early childhood environments. The conference will provide opportunities to explore the role, value, and challenges associated with implementing meaningful tinkering interventions in learning environments serving young children. The project seeks to 1) Convene stakeholders from the tinkering and early childhood programs; and 2) further the exploration and evolution of practitioner and researcher knowledge about tinkering in early childhood contexts. The long-term goal is to support more young children being introduced to STEM learning through tinkering's adaptable approaches to STEM-learning that align with the developmental needs of this young population.
This project will collaboratively analyze and document the state of the field of STEM-rich tinkering in informal early childhood contexts. Additionally, the project will deepen relationships across the early childhood tinkering ecosystem. Additional outcomes include an effort to provide tangible resources to the field highlighting current promising practices and future opportunities for development. The conference will also provide an understanding of how tinkering interventions may contribute to the development of STEM interest, identity and learning amongst early childhood audiences. Finally, the conference will bring together research and practitioners to explore how tinkering in early childhood settings can be used effectively to meet the needs of diverse learners including learners from underserved and underrepresented communities. The project will recruit a total of 75 participants with backgrounds in the field of tinkering and STEM learning, early childhood research, and professional development practices representing a diverse set of institutions and organizations. Research questions for the conference will focus on: 1) What types of supports and professional development do early childhood educators need to facilitate early STEM learning through tinkering? 2) What types of built environment and hands-on materials best support young children's ability to learn STEM content and practices through tinkering? 3) What types of strategies best support caregiver involvement in young children's learning? 4) What is the role of early childhood tinkering in young children?s STEM learning, interest, and identity development? 5) How can culturally and linguistically sustaining pedagogies be used to ensure equity across a diversity of young learners and their families? To answer these research questions the project will use qualitative methods before, during and post-conference. Research methods will include a landscape analysis identifying needs of participants, surveys, observations and informal interviews with participants.
This Conference award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. An ongoing challenge to the design of effective STEM learning exhibits for diverse young children is the absence of reliable and evidence-based resources that designers can apply to the design of STEM exhibits that draw upon play as a child's primary pedagogy, while simultaneously engaging children with STEM content and processes that support development of STEM skills such as observation. To address these challenges, the project team will use a collaborative process in which learning researchers and informal STEM practitioners iteratively develop, design, and test the STEM for Play Framework that could then be applied to the design of STEM-focused exhibits that support play and STEM skill use among early learners.
This Research in Service to Practice project will address these questions: 1) What is a framework for play in early STEM learning that is inclusive of children's cultural influences?; 2) To what extent do interactions between early learners (ages 3-8) and caregivers or peers at exhibits influence the structure and effectiveness of play for supporting STEM skill development?; 3) How do practitioners link play to STEM skill development, and to what extent does a framework for play in early STEM learning assist in identifying types of play that supports early STEM skill development?; and 4) What do practitioners identify as best practices in exhibit design that support the development of STEM skills for early childhood audiences, and conversely, to what extent do practitioners perceive specific aspects of the design as influential to play? The project team will address these questions across four phases of study that will include (a) development of a critical research synthesis to inform the initial STEM for Play framework; (b) the use of surveys, focus groups, and interviews to solicit feedback from practitioners; (c) testing and revising the framework by conducting structured observations of STEM exhibits at multiple museums. The project team will use multiple analytic approaches including qualitative thematic analyses as well as inferential statistics. Results will be disseminated to children?s museums, science centers, and research communities.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
A makerspace is a place where participants explore their own interests and learn by creating, tinkering, and inventing artifacts through the use of a rich variety of tools and materials. This project will develop and research a flexible model for makerspaces that can be adapted to local settings to support informal STEM learning for hospitalized, chronically ill patients in pediatric environments who are predominantly youth of color from low-income backgrounds. These youth are subject to health disparities and healthcare inequities. Their frequent absence from school and other activities disrupt friendship formations, reduce their opportunities for social support, reduce their access to environments where they can feel a sense of self-agency through learning and creative activities. Through patient centered co-design, this project will build adaptable STEM makerspace environments conducive to STEM-rich learning, the exercise of self-agency, and development of STEM identity. Project design will focus on the sensitive nature of working with vulnerable populations (i.e., immunocompromised patients). The project will develop and disseminate several resources: (1) a flexible makerspace model that can be adapted to work in different pediatric settings; (2) research methods for conducting research in highly sensitive environments with and alongside young patients; and (3) professional development resources and a playbook including guidebook and facilitators guide that will articulate principles and processes for designing, implementing and sustaining makerspaces in pediatric settings. These resources will be widely disseminated through maker and other informal STEM networks.
The project will pursue two innovations. First, the project will develop the physical design of adaptable informal STEM makerspaces in pediatric settings. Second, the project will develop innovative patient-centered methodologies for studying approaches to physical design and the effects of makerspace installations for informal STEM-learning, self-agency, and STEM identity development. Using a design-based research approach, the project will investigate: (1) the extent to which physical makerspace designs support access to material, relational, and ideational resources for STEM-learning and well-being; (2) the extent to which makerspace installations, researchers, and medical care staff support patients in accessing and generating tools and other resources for personal learning and a sense of agency; and (3) the extent to which makerspace design with a focus on affording material, relational, and ideational resources provide rich opportunities for young patients to explore their own interests and cultivate STEM identities. One of the project's innovations, beyond development of adaptable makerspace model involves developing an innovative patient-centered methodology for conducting educational research toward broadening participation in STEM in highly sensitive medical care environments. The project will employ a mixed-methods research design and collect a variety of data to address these areas of research including documentation of makerspace design plans and renderings, observational data gathered through fieldnotes, video and audio recordings, informal interviews with patients, their families, and child-care staff, and patient generated artifacts. Articles for researchers and practitioners will be submitted for publication to appropriate professional journals and peer-reviewed publications.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.