This resource presents a list of categories of “imaginative ways of thinking” as well as word clouds illustrating the huge range of ways imagination is described in literature at the intersections of imagination and STEM. This resource reflects results from a comprehensive review of 137 pieces of literature addressing the intersections of imagination and STEM.
This whitepaper introduces the Strategic Outcomes Framework, a taxonomy of outcome types within eight outcome categories (interest, attitude, knowledge, STEM skills, 21st century skills and social emotional evelopment, behavior, STEM capital, and career path). It summarizes proceedings of the NSF-funded Strategic Outcome Progressions Conference: Exploring a Framework for Measuring Informal Education Outcomes and Institutional Impact (award # 2039209) and changes made to the framework as a result. Among these changes are the necessity of nesting the framework within what we have come to call
This project's goal is to advance the field by providing resources that empower STEM educators to design and deliver high-quality connected learning experiences based on relevant research and incorporating evidence-based practices.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Through an NSF-funded literature review, professional survey, and virtual convening, the Museum of Science, Boston is systematically documenting intersections between imagination, STEM and learning to create research-based resources for positioning and attending to imaginative ways of thinking in informal STEM learning environments. This poster shares an overview of our research methods and preliminary findings (as of Sept 2021).
This poster was presented at the 2021 NSF AISL Awardee Meeting.
The Museum of Science, Boston received funding from the National Science Foundation to carry out a conference grant exploring connections between research and practice at the intersections of imagination, STEM (science, technology, engineering, and mathematics), and ISE (informal STEM education). A series of virtual convening events were held from September 8-17, 2021. The proceedings of these events are documented in this report to summarize the content of the convening activities as they were implemented, provide references and citations for the content delivered, and acknowledge the
This project will host a workshop in order to identify and synthesize research findings from NSF awards that addressed the unanticipated effects of the COVID-19 pandemic on STEM teaching and learning. The interruptions from the pandemic had dramatic, widespread effects in education. Across the nation, teachers, students, parents, staff, and school administrators experienced extended school closures and a rapid and unexpected shift to virtual instruction. Although long-term consequences are unknown, early observations revealed deeper disparities in access and opportunity for many students of color. These inequities extend beyond STEM education and include challenges to student’s mental health and wellbeing. In spring 2020, NSF invited researchers to submit educational research proposals in response to this national crisis. Each award has its own dissemination and plans for broader impacts, yet the public is underserved by separate reports published in many different venues. To enable stakeholders to find and discern the most important insights, our research team will aggregate and organize major findings across these projects via a workshop, synthesize key findings, identify unresolved issues, and communicate overall insights to broader audiences.
To synthesize findings, Digital Promise will organize and convene a workshop with NSF awardees who conducted research on the educational impacts of the pandemic. Workshop attendees will participate in answering four questions: (1) What are the major themes and topics across the different NSF awards? (2) How were imperatives to address emerging inequities related to STEM education addressed in research plans and findings? (3) Within each topic or theme, what are the major findings, insights and recommendations for teaching and learning in STEM? (4) Across awardees, what was learned about doing RAPID research during a pandemic, and what are recommendations for improvement when subsequent needs for RAPID research in education arise? Data sources for the synthesis will be collected from project artifacts (e.g., reports, journal articles, practitioner resources, etc.), pre/post-workshop surveys, and workshop outputs from workshop presentations, panel discussions, and small group discussions. Interviews with a subset of workshop attendees will provide insight into what was learned about conducting research during a global pandemic. Data will be codified, categorized, and coded using established qualitative methods. Digital Promise’s broad network of partners and collaborators will achieve broad dissemination and outreach to education stakeholders at both the K-12 and postsecondary levels. This project is jointly funded by the Advancing Informal STEM Learning (AISL) program, the Discovery Research PreK-12 program (DRK-12) program, the EHR Core Research (ECR:Core) program, and the Innovative Technology Experiences for Students and Teachers (ITEST) program.
Although virtual conferences have become commonplace in the age of COVID-19, this format poses both challenges and opportunities for organizers to design, implement, and engage participants in productive and connected ways. We created this brief to share an example of the process and lessons learned as we designed and hosted a virtual NSF-funded conference called: Mapping Connections Between STEM and Social-Emotional Development (SED) in Out-of-School Time (OST) Programs. This conference focused on identifying outcomes at the interface of STEM and SED in OST research and practice (e.g
In informal science contexts, the word tinkering describes a learning process that combines art, science, and technology through hands-on inquiry. With the growth in popularity of the making and tinkering movements nationwide, these practices are increasingly making their way into early childhood environments where they have great promise to positively impact the early STEM learning experiences of young children. This 2-day conference hosted at the Exploratorium in San Francisco will bring together stakeholders exploring applications of tinkering in informal early childhood environments. The conference will provide opportunities to explore the role, value, and challenges associated with implementing meaningful tinkering interventions in learning environments serving young children. The project seeks to 1) Convene stakeholders from the tinkering and early childhood programs; and 2) further the exploration and evolution of practitioner and researcher knowledge about tinkering in early childhood contexts. The long-term goal is to support more young children being introduced to STEM learning through tinkering's adaptable approaches to STEM-learning that align with the developmental needs of this young population.
This project will collaboratively analyze and document the state of the field of STEM-rich tinkering in informal early childhood contexts. Additionally, the project will deepen relationships across the early childhood tinkering ecosystem. Additional outcomes include an effort to provide tangible resources to the field highlighting current promising practices and future opportunities for development. The conference will also provide an understanding of how tinkering interventions may contribute to the development of STEM interest, identity and learning amongst early childhood audiences. Finally, the conference will bring together research and practitioners to explore how tinkering in early childhood settings can be used effectively to meet the needs of diverse learners including learners from underserved and underrepresented communities. The project will recruit a total of 75 participants with backgrounds in the field of tinkering and STEM learning, early childhood research, and professional development practices representing a diverse set of institutions and organizations. Research questions for the conference will focus on: 1) What types of supports and professional development do early childhood educators need to facilitate early STEM learning through tinkering? 2) What types of built environment and hands-on materials best support young children's ability to learn STEM content and practices through tinkering? 3) What types of strategies best support caregiver involvement in young children's learning? 4) What is the role of early childhood tinkering in young children?s STEM learning, interest, and identity development? 5) How can culturally and linguistically sustaining pedagogies be used to ensure equity across a diversity of young learners and their families? To answer these research questions the project will use qualitative methods before, during and post-conference. Research methods will include a landscape analysis identifying needs of participants, surveys, observations and informal interviews with participants.
This Conference award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The National Science Teachers Association will convene a conference that will bring together STEM researchers and practitioners to review the growing connected science learning movement. A connected science learning environment has been described as a robust science ecology containing a wide variety of programs, across a range of institutions and places, allowing youth different and multiple ways to engage with STEM. Such environments can include small partnerships, such as a science museum and K-12 schools, or a large, community-wide network of a variety of organizations such as K-12 schools, museums, universities, government agencies, and community organizations. The conference will bring together over forty participants, who will meet in a series of several online meetings. The conference will result in a series of papers, articles in the online Connected Science Learning journal and other publications, a series of webinars and online forums where participants can engage with themes identified in the conference, and conference presentations at the annual meetings of organizations including the National Science Teachers Association, the Association of Science-Technology Centers, and others. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The conference will: (1) document the research foundation that supports and demonstrates the impact and value of high-quality connected science learning experiences; (2) identify areas for which future research is recommended; and (3) provide effective, practitioner-focused resources that advance connected STEM learning. The conference will include participants that represent a wide range of researchers and practitioners in informal and formal STEM education, as well as representing gender, racial/ethnic and geographical diversity. The results and products of the conference will be instrumental in developing the understanding and appreciation for connecting STEM learning and ultimately improving connected STEM learning for K-12 youth. The importance of emphasizing diversity, equity, and accessibility will be strongly represented in the key evidence identified through the conference and will be reflected in the resources that will be disseminated to a broader audience.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Various measures exist to assess learning outcomes from informal science, technology, engineering, or math (STEM) education programming, especially for youth audiences. Although there has been growing interest in the field among practitioners, researchers and evaluators for the development and implementation of shared, common STEM measures and frameworks, informal STEM learning (ISL) institutions (e.g., museums, zoos, aquaria, botanic gardens, and the like) face a unique challenge when they design and evaluate educational programs. By nature of the broad-ranging topic areas these institutions emphasize, programming seeks to reach audiences that vary in age, ability, cultural background, interest, and more. Participation also varies--for example, participants choose which in a series of exhibits they attend and how much time they spend at each. Given this planned-for variance, how do educators target appropriate learning outcomes? To what extent do outcomes map to activity complexity? How does programming success link to institutional goals? One solution may be a framework of outcome progressions. Progressions are within outcome categories (e.g., interest, attitude, knowledge, skills, behavior, science capital, etc.), the ordinal series of effects that can be mapped to programming that ranges from short duration with simple content (e.g. a hallway cart demonstration can trigger situational interest) to extended duration with complex content (e.g. a youth internship can generate well-developed personal interest). STEM educators, evaluators and researchers working in or with ISL institutions will come together to consider the utility and feasibility of an outcome progressions framework. With this framework STEM learning institution educators may be better equipped to understand the impact of their programming and how to design for it. This work will be undertaken by the COSI Center for Research and Evaluation in conjunction with the Office of Education, Outreach, and Visitor Services of the National Museum of Natural History and the PEAR Institute.
The primary aim of this multi-day virtual convening is to inform future development of the framework for outcome progressions. These progressions will reflect and accommodate outcomes targeted by existing and shared evaluation measures. The framework will provide informal educators and evaluators with (1) a way of aligning outcome expectations with programming depth and dosage; (2) outcome choices achievable with various depths of programming; (3) a strategic tool for planning institution-wide targeted outcomes across a full portfolio of institution educational programming; and (4) a tool for documenting an education department's varied outcomes across the full range of possible outcomes. To create rich and informed critical discussion, the conference will involve research consultant experts representing each outcome category; practitioners representing diverse programming; and evaluation theorists familiar with the broad needs of informal learning institutions. A conference subcommittee with expertise in culturally responsive and equitable program development and evaluation will ensure the agenda contains flexibility to generate emergent equitable and inclusive conversations. Conference participants will review and contribute to the soundness and utility of these categorizations as well as the progressions within them. These insights and inputs will inform future development of the framework as a valid and reliable tool. Deliverables include a paper summarizing the findings from the convenings and a related webinar that describes the framework and recommendations for its use. These will be shared broadly via the informalscience.org website and other professional venues.
This conference is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
In this virtual conference, The PEAR Institute convened over 40 practitioners and researchers to explore the power of an integrated vision of STEM and social-emotional development (SED). This conference aimed to 1) create a collaboration of out-of-school time (OST) leaders, practitioners, and researchers to map the overlays of STEM and SED; 2) identify best practices for integrated STEM-SED programming; 3) explore common existing and potential measures; and 4) identify how data is measured, communicated, and used for skills that are important to both STEM and SED. Through this collaboration, we aimed to initiate the conversations, establish partnerships, and build the capacity for assessment of STEM and SED in informal STEM learning programs.
Rather than seeking consensus, this conference sought to unearth questions and generate new ideas to lay a foundation for future research and practice, a way to inform the field about high-quality research and practice to promote cross-disciplinary collaboration and synergy between STEM and SED.
Conference deliverables include a conference report, an informal key findings webinar, and conference website (https://www.thepearinstitute.org/stem-sed-conference-2020). The website includes links to a participant directory, conference at-a-glance overview, agendas, readings, and additional resources identified during the conference.