This report presents summative evaluation results for a National Science Foundation funded project entitled Grounding Institutional Partnerships in Structures for Broader Impacts Design (BID). The project represents a collaboration between five institutions: Institute for Learning Innovation, The STEM Research Center at Oregon State University, Scicenter, University of Washington-Bothell, and University of Wisconsin-Madison. BID aimed at creating an inter-institutional structure and toolkit to assist higher education institutions (HEIs) and informal science education organizations (ISEs) in
In July 2020, Dr. Brigid Barron and her team at Stanford University’s Graduate School of Education and the Joan Ganz Cooney Center convened a virtual workshop to mobilize a community of investigators to explore innovative methods for studying family and community learning during the pandemic. Participants included NSF RAPID-COVID grantees from Stanford University, University of Washington, and the University of Michigan.
This report summarizes the strategies and insights generated at this workshop so that they may be shared among a wider network of researchers, practitioners, funders, and
This project will host a workshop in order to identify and synthesize research findings from NSF awards that addressed the unanticipated effects of the COVID-19 pandemic on STEM teaching and learning. The interruptions from the pandemic had dramatic, widespread effects in education. Across the nation, teachers, students, parents, staff, and school administrators experienced extended school closures and a rapid and unexpected shift to virtual instruction. Although long-term consequences are unknown, early observations revealed deeper disparities in access and opportunity for many students of color. These inequities extend beyond STEM education and include challenges to student’s mental health and wellbeing. In spring 2020, NSF invited researchers to submit educational research proposals in response to this national crisis. Each award has its own dissemination and plans for broader impacts, yet the public is underserved by separate reports published in many different venues. To enable stakeholders to find and discern the most important insights, our research team will aggregate and organize major findings across these projects via a workshop, synthesize key findings, identify unresolved issues, and communicate overall insights to broader audiences.
To synthesize findings, Digital Promise will organize and convene a workshop with NSF awardees who conducted research on the educational impacts of the pandemic. Workshop attendees will participate in answering four questions: (1) What are the major themes and topics across the different NSF awards? (2) How were imperatives to address emerging inequities related to STEM education addressed in research plans and findings? (3) Within each topic or theme, what are the major findings, insights and recommendations for teaching and learning in STEM? (4) Across awardees, what was learned about doing RAPID research during a pandemic, and what are recommendations for improvement when subsequent needs for RAPID research in education arise? Data sources for the synthesis will be collected from project artifacts (e.g., reports, journal articles, practitioner resources, etc.), pre/post-workshop surveys, and workshop outputs from workshop presentations, panel discussions, and small group discussions. Interviews with a subset of workshop attendees will provide insight into what was learned about conducting research during a global pandemic. Data will be codified, categorized, and coded using established qualitative methods. Digital Promise’s broad network of partners and collaborators will achieve broad dissemination and outreach to education stakeholders at both the K-12 and postsecondary levels. This project is jointly funded by the Advancing Informal STEM Learning (AISL) program, the Discovery Research PreK-12 program (DRK-12) program, the EHR Core Research (ECR:Core) program, and the Innovative Technology Experiences for Students and Teachers (ITEST) program.
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
Ronda JensonKelly Roberts
resourceresearchProfessional Development, Conferences, and Networks
As science communication programs grow worldwide, effective evaluation and assessment metrics lag. While there is no consensus on evaluation protocols specifically for science communication training, there is agreement on elements of effective training: listening, empathy, and knowing your audience — core tenets of improvisation. We designed an evaluation protocol, tested over three years, based on validated and newly developed scales for an improvisation-based communication training at the Alan Alda Center for Communicating Science. Initial results suggest that ‘knowing your audience’ should
DATE:
TEAM MEMBERS:
Christine O’ConnellMerryn McKinnonJordan Labouff
resourceprojectProfessional Development, Conferences, and Networks
This three-year project focuses on professional research experiences for middle and high school STEM teachers through investigations of the Great American Biotic Interchange (GABI). Each year 10 teachers (in diverse fields including biology, chemistry, earth and environmental sciences, and oceanography) and three to five professional paleontologists will participate in a four-phase process of professional development, including: a (1) pre-trip orientation (May); (2) 12 days in Panama in July collecting fossils from previously reported, as well as newly discovered, sites; (3) a post-trip on-line (cyber-enabled) Community of Practice; and (4) a final wrap-up at the end of each cohort (December). In addition, some of the teachers may also elect to partner with scientists in their research laboratories, principally located in California, Florida, and New Mexico. The partners in Panama are from the Universidad Autónoma de Chiriquí (UNACHI), including faculty and students, as well as STEM teachers from schools in Panama. Teachers that participate in this RET will develop lesson plans related to fossils, paleontology, evolution, geology, past climate change, and related content aligned with current STEM standards.
The GABI, catalyzed by the formation of the Isthmus of Panama during the Neogene, had a profound effect on the evolution and geography of terrestrial organisms throughout the Americas and marine organisms globally. For example, more than 100 genera of terrestrial mammals dispersed between the Americas, and numerous marine organisms had their interoceanic distributions cut in half by the formation of the Isthmus. Rather than being considered a single event that occurred about 4 million years ago, the GABI likely represents a series of dispersals over the past 10 million years, some of which occurred before full closure of the Isthmus. New fossil discoveries in Panama resulting from the GABI RET (Research Experiences for Teachers) are thus contributing to the understanding of the complexity and timing of the GABI during the Neogene.
This award is being co-funded with the Office International and Integrative Activities.
This document describes the summative project evaluation of 5 annual cohorts of STE(A)M teachers, mostly from California, Florida, and New Mexico participating in out-of-school authentic research experiences collecting fossils and learning about geology, biology, and the natural history along the Panama Canal, and their experiences with museums and research collections. The STEM content of this project is based on the Great American Biotic Interchange (GABI) of animals and plants across the Isthmus of Panama over the past 5 million years. This report also describes the efficacy of sustained
Summative evaluation study for the Space Earth and Informal Science Education (SEISE) project examining professional impacts including project reach, partnerships, professional knowledge, and professionals' use of the project’s public-facing products and their implementation of practices for engaging the public
Over the course of the five-year NASA grant, the Space and Earth Informal STEM Education (SEISE) project offered a range of free professional development opportunities and resources to support informal educators’ ability to offer Earth and space programming and to partner with others
Community voice, alongside academic voice, is essential to the core community engagement principle of reciprocity—the seeking, recognizing, respecting, and incorporating the knowledge, perspectives, and resources that each partner brings to a collaboration. Increasing the extent to which academic conferences honor reciprocity with community members is important for many reasons. For example, community perspectives often enhance knowledge generation and potentially transform scholarship, practice, and outcomes for all stakeholders. However, community presence and participation at academic
The Researching Invention Education white paper compiles contributions from a community of individuals and organizations working in Invention Education (IvE) in the United States. IvE is a term that refers to the practice of teaching students how to problem-solve and think like inventors in order to become positive change-makers in the world. The paper was written by researchers interested in IvE who attended the 2018 InventEd convening hosted by The Lemelson Foundation. The group worked together for a year to publish their findings that were then uncovered at the 2019 InventEd convening in
DATE:
TEAM MEMBERS:
Audra SkukauskaiteStephanie CouchLeslie Flynn
resourceresearchProfessional Development, Conferences, and Networks
A survey-based needs assessment at the University of Nebraska-Lincoln, a research- intensive land grant university, explored ways to meet the goal of increasing science, technology, engineering, and mathematics (STEM) outreach. 40% of surveyed faculty reported barriers to doing STEM outreach. Over 50% of faculty reported an inability to individually resolve barriers to STEM outreach in ways that ensure broader community engagement in their research through outreach. Using a Sociological lens, the current study examined institutional-level barriers and enablers to faculty engaging in outreach
DATE:
TEAM MEMBERS:
Kiyomi DeardsSaundra FrerichsPatricia Wonch HillJulia McQuillan
This report presents highlights from a Fall 2020 evaluation conducted with 69 STEAM teachers from across the U.S., all of whom are part of the National Air and Space Museum's Teacher Innovator Institute (TII). Due to the impact of the COVID-19 pandemic on classrooms and the museum's teacher PD program, the evaluation in Fall 2020 focused on understanding the conditions, adaptations, challenges, and success stories of this population of teachers from across the country. The findings in this report provide insight into the variations in teaching conditions (depending on geography and urbanity