In July 2020, Dr. Brigid Barron and her team at Stanford University’s Graduate School of Education and the Joan Ganz Cooney Center convened a virtual workshop to mobilize a community of investigators to explore innovative methods for studying family and community learning during the pandemic. Participants included NSF RAPID-COVID grantees from Stanford University, University of Washington, and the University of Michigan.
This report summarizes the strategies and insights generated at this workshop so that they may be shared among a wider network of researchers, practitioners, funders, and
This project will host a workshop in order to identify and synthesize research findings from NSF awards that addressed the unanticipated effects of the COVID-19 pandemic on STEM teaching and learning. The interruptions from the pandemic had dramatic, widespread effects in education. Across the nation, teachers, students, parents, staff, and school administrators experienced extended school closures and a rapid and unexpected shift to virtual instruction. Although long-term consequences are unknown, early observations revealed deeper disparities in access and opportunity for many students of color. These inequities extend beyond STEM education and include challenges to student’s mental health and wellbeing. In spring 2020, NSF invited researchers to submit educational research proposals in response to this national crisis. Each award has its own dissemination and plans for broader impacts, yet the public is underserved by separate reports published in many different venues. To enable stakeholders to find and discern the most important insights, our research team will aggregate and organize major findings across these projects via a workshop, synthesize key findings, identify unresolved issues, and communicate overall insights to broader audiences.
To synthesize findings, Digital Promise will organize and convene a workshop with NSF awardees who conducted research on the educational impacts of the pandemic. Workshop attendees will participate in answering four questions: (1) What are the major themes and topics across the different NSF awards? (2) How were imperatives to address emerging inequities related to STEM education addressed in research plans and findings? (3) Within each topic or theme, what are the major findings, insights and recommendations for teaching and learning in STEM? (4) Across awardees, what was learned about doing RAPID research during a pandemic, and what are recommendations for improvement when subsequent needs for RAPID research in education arise? Data sources for the synthesis will be collected from project artifacts (e.g., reports, journal articles, practitioner resources, etc.), pre/post-workshop surveys, and workshop outputs from workshop presentations, panel discussions, and small group discussions. Interviews with a subset of workshop attendees will provide insight into what was learned about conducting research during a global pandemic. Data will be codified, categorized, and coded using established qualitative methods. Digital Promise’s broad network of partners and collaborators will achieve broad dissemination and outreach to education stakeholders at both the K-12 and postsecondary levels. This project is jointly funded by the Advancing Informal STEM Learning (AISL) program, the Discovery Research PreK-12 program (DRK-12) program, the EHR Core Research (ECR:Core) program, and the Innovative Technology Experiences for Students and Teachers (ITEST) program.
Many Black youth in both urban and rural areas lack engaging opportunities to learn mathematics in a manner that leads to full participation in STEM. The Young People’s Project (YPP), the Baltimore Algebra Project (BAP), and the Education for Liberation Network (EdLib) each have over two decades of experience working on this issue. In the city of Baltimore, where 90% of youth in poverty are Black, and only 5% of these students meet or exceed expectations in math, BAP, a youth led organization, develops and employs high school and college age youth to provide after-school tutoring in Algebra 1, and to advocate for a more just education for themselves and their peers. YPP works in urban or rural low income communities that span the country developing Math Literacy Worker programs that employ young people ages 14-22 to create spaces to help their younger peers learn math. Building on these deep and rich experiences, this Innovations in Development project studies how Black students see themselves as mathematicians in the context of paid peer-to-peer math teaching--a combined social, pedagogical, and economic strategy. Focusing primarily in Baltimore, the project studies how young people grow into new self-definitions through their work in informal, student-determined math learning spaces, structured collaboratively with adults who are experts in both mathematics and youth development. The project seeks to demonstrate the benefits of investing in young people as learners, teachers, and educational collaborators as part of a core strategy to improve math learning outcomes for all students.
The project uses a mixed methods approach to describe how mathematical identity develops over time in young people employed in a Youth-Directed Mathematics Collaboratory. 60 high school aged students with varying mathematical backgrounds (first in Baltimore and later in Boston) will learn how to develop peer- and near-peer led math activities with local young people in informal settings, after-school programs, camps, and community centers, reaching approximately 600 youth/children. The high school aged youth employed in this project will develop their own math skills and their own pedagogical skills through the already existing YPP and BAP structures, made up largely of peers and near-peers just like themselves. They will also participate in on-going conversations within the Collaboratory and with the community about the cultural significance of doing mathematics, which for YPP and BAP is a part of the ongoing Civil Rights/Human Rights movement. Mathematical identity will be studied along four dimensions: (a) students’ sequencing and interpretation of past mathematical experiences (autobiographical identity); (b) other people’s talk to them and their talk about themselves as learners, doers, and teachers of mathematics (discoursal identity); (c) the development of their own voices in descriptions and uses of mathematical knowledge and ideas (authorial identity); and (d) their acceptance or rejection of available selfhoods (socio-culturally available identity). Intended outcomes from the project include a clear description of how mathematical identity develops in paid peer-teaching contexts, and growing recognition from both local communities and policy-makers that young people have a key role to play, not only as learners, but also as teachers and as co-researchers of mathematics education.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Jay GillenMaisha MosesThomas NikundiweNaama LewisAlice Cook
Milwaukee has established itself as a leader in water management and technology, hosting a widely recognized cluster of industrial, governmental, nonprofit, and academic activity focused on freshwater. At the same time, Milwaukee faces a wide range of challenges with freshwater, some unique to the region and others common to cities throughout the country. These challenges include vulnerability to flooding and combined sewer overflows after heavy rainfall, biological and pharmaceutical contamination in surface water, lead in drinking water infrastructure, and inequity in access to beaches and other recreational water amenities. Like other cities, Milwaukee grapples with the challenges global climate change imposes on urban water systems, including changing patterns of precipitation and drought.
These problems are further complicated by Milwaukee's acute racial and economic residential segregation. With a population of approximately 595,000, embedded within a metropolitan area of over 1.5 million, Milwaukee remains one of the country's most segregated cities. There is increasing urgency to engage the public--and especially those who are most vulnerable to environmental impacts--more deeply in the stewardship of urban water and in the task of creating sustainable urban futures. The primary goal of this four-year project is to foster community-engaged learning and environmental stewardship by developing a framework that integrates art with Science, Technology, Engineering, and Mathematics (STEM) experiences along with geography, water management, and social science. Synergies between STEM learning and the arts suggest that collaborations among artists, scientists, and communities can open ways to bring informal learning about the science of sustainability to communities.
WaterMarks provides an artist generated conceptual framework developed by Mary Miss / City as Living Laboratory (CALL) to help people better understand their relationship to the water systems and infrastructure that support their lives. Project activities include artist/scientist/community member-led Walks, which are designed to engage intergenerational participants both from the neighborhoods and from across the city, in considering the conditions, characteristics, histories, and ecosystems of neighborhoods. Walks are expanded upon in Workshops with residents, local scientists/experts, and other stakeholders, and include exploring current water-related environmental challenges and proposing solutions. The Workshops draw on diverse perspectives, including lived experience, scientific knowledge, and policy expertise. Art projects created by local artists amplify community engagement with the topics, including programming for teens and young adults. Free Wi-Fi will be integrated into various Marker sites around the city providing access to online, self-guided learning opportunities exploring the water systems and issues facing surrounding neighborhoods. Current programming focuses primarily on Milwaukee's predominantly African American near North Side and the predominantly Latinx/Hispanic near South Side. Many neighborhoods in these sections are vulnerable to such problems as frequent flooding, lead contamination in drinking water, inequities in safety and maintenance of green space, and less access to Lake Michigan, the city's primary natural resource and recreational amenity.
The WaterMarks project advances informal STEM learning in at least two ways. First, while the WaterMarks project is designed to fit Milwaukee, the project includes the development of an Adaptable Model Guide. The Guide is designed so that other cities can modify and employ its inclusive structure, programming, and process of collaboration among artists, scientists, partner organizations, and residents to promote citywide civic engagement in urban sustainability through the combination of informal STEM learning and public art. The Guide will be developed by a Community-University Working Group (CULab) hosted by UW-Milwaukee's Center for Community-Based Learning, Leadership, and Research and made up of diverse community and campus-wide stakeholders. In addition to overseeing the Guide’s creation, CULab will conceptualize onboarding and mentorship strategies for new participants as well as a framework for the program’s expansion and sustainability.
Second, through evaluation and research, the project will build a theoretical model for the relationships among science learning, engagement with the arts, and the distinctive contexts of different neighborhoods within an urban social-ecological system. The evaluation team, COSI’s Center for Research and Evaluation, and led by Co-PI Donnelly Hayde, aims to conduct formative, summative, and process evaluation of the Watermarks project, with the additional goal of producing evaluative research findings that can contribute to the broader field of informal learning. Evaluation foci include: How does the implementation of WaterMarks support positive outcomes for the project’s communities and the development of an adaptable model for city-scale informal science learning about urban environments? 2. To what extent do the type and degree of outcome-related change experienced by participating community residents vary across and/or between project sites? What factors, if any, appear to be linked to these changes? 3. To what extent and in what ways do the activities of the WaterMarks projects appear to have in situ effects related to the experience of place at project sites?
The project’s research team led by PI Ryan Holifield and Co-PI Woonsup Choi, will investigate how visual artistic activities introduced by the programming team as part of the Walks (and potentially other engagement activities) interact with personal, sociocultural, and physical contexts to produce distinctive experiences and outcomes of informal science learning about urban water systems. The aim of the research will be to synthesize the results from the different WaterMarks sites into an analysis generalizable beyond specific neighborhoods and applicable to other cities. The project's research questions include: 1. How does participation in Walks focused on visual artistic activities affect outcomes and experiences of informal STEM learning about urban water systems? 2. How do outcomes and experiences of informal STEM learning vary across different urban water topics, participants from different demographic groups, and contrasting sociocultural and biophysical contexts?
This Innovations in Development project is led by the University of Wisconsin-Milwaukee (UWM), in collaboration with City as Living Laboratory (CALL) and the COSI Center for Research and Evaluation.
HBCUs are critical to producing a diverse and inclusive workforce as they graduate a disproportionate number of African American future STEM workers and STEM leaders. Although the National Science Foundation is fully committed to diversity and inclusion, there has been little research to determine why Historically Black Colleges and Universities are not fully participating in the NSF STEM educational research opportunities. The project will investigate the challenges, needs and support for Historically Black Colleges and Universities (HBCUs) to succeed in applying for educational research support from the National Science Foundation (NSF). Participants will be recruited from 96 HBCUs that are eligible to apply for such funding and will include the wide range of college and university administration and faculty that are involved in the preparation of research projects and related applications for research funding. The investigation will focus primarily on the Division of Research on Learning in Informal and Formal Settings (DRL) within NSF. The investigation will: 1) determine the submission rate and funding success rate of HBCUs within the DRL funding mechanisms; 2) determine why a greater proportion of HBCUs are not successful in their applications of research or do not apply; and 3) determine what factors, such as institutional support, research expertise, and professional development, could lead to a larger number of research proposals from HBCUs and greater success in obtaining funding. The project has the potential to have significant influence on the national educational and research agenda by providing empirical findings on the best approach to support and encourage HBCU participation in DRL educational research funding programs.
This exploratory research project will investigate what changes and/or supports would contribute to significantly increasing the number of applications and successful grant awards for STEM educational research project proposed by HBCUs. The project has the following research questions: (1) What factors discourage participation of HBCUs in the DRL funding mechanisms and what are the best practices to encourage participation? (2) What approaches have been successful for HBCUs to obtain DRL funding? (3) What dynamic capabilities are necessary for HBCU researchers to successfully submit STEM proposals to NSF? (4) What changes would be helpful to reduce or eliminate any barriers for HBCU applications for DRL educational research funding and what supports, such as professional development, would contribute to greater success in obtaining funding? Participants will be recruited from the 96 eligible HBCUs and will include both individuals from within the administration (e.g., Office Sponsored Programs, Deans, VP, etc.) as well as from within the faculty. The research will collect variety of quantitative and qualitative data designed to support a comprehensive analysis of factors addressing the research questions. The project will develop research findings and recommendations that are relevant to faculty, administrators, and policymakers for improving HBCU participation in research funding opportunities. Results of project research will be widely disseminated to HBCUs and other Minority Serving Institutions (MSIs) through a project website, peer reviewed journals, newsletters, and conference presentations.
This project is funded by the Innovative Technology Experiences for Students and Teachers (ITEST), the Advancing Informal STEM Learning (AISL), and the Discovery Research PreK-12 (DRK-12) programs. These programs which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' and general public knowledge and interest in science, technology, engineering, and mathematics (STEM).
DATE:
-
TEAM MEMBERS:
Cynthia TrawickJohn HaynesTriscia HendricksonTerry Mills
The assumptions, expectations, and potential for conducting a research synthesis (or any type of literature review) have evolved significantly in recent decades. With advancements in sophisticated and accessible analytical software, combined with the use of systematic protocols, reviews are increasingly generating results that can advance knowledge and practice. But, while reviews, synthesis or meta-analysis have the capacity to inform practice in unique ways, they are also fraught with their own methodological, ethical, and practical issues.
Drawing on the Addressing Societal Challenges
Poster presentation from the 2020 Association of Science and Technology Centers Annual Conference.
This poster presented preliminary findings from a configurative literature synthesis on how the literature posted on the InformalScience.org website, in peer-reviewed journals, and in the ProQuest archive of Theses and Dissertations report about how informal learning institutions are advancing the use of STEM knowledge and scientific reasoning in the ways that can help individuals and communities address the societal challenges of our time?
The National Science Teachers Association will convene a conference that will bring together STEM researchers and practitioners to review the growing connected science learning movement. A connected science learning environment has been described as a robust science ecology containing a wide variety of programs, across a range of institutions and places, allowing youth different and multiple ways to engage with STEM. Such environments can include small partnerships, such as a science museum and K-12 schools, or a large, community-wide network of a variety of organizations such as K-12 schools, museums, universities, government agencies, and community organizations. The conference will bring together over forty participants, who will meet in a series of several online meetings. The conference will result in a series of papers, articles in the online Connected Science Learning journal and other publications, a series of webinars and online forums where participants can engage with themes identified in the conference, and conference presentations at the annual meetings of organizations including the National Science Teachers Association, the Association of Science-Technology Centers, and others. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The conference will: (1) document the research foundation that supports and demonstrates the impact and value of high-quality connected science learning experiences; (2) identify areas for which future research is recommended; and (3) provide effective, practitioner-focused resources that advance connected STEM learning. The conference will include participants that represent a wide range of researchers and practitioners in informal and formal STEM education, as well as representing gender, racial/ethnic and geographical diversity. The results and products of the conference will be instrumental in developing the understanding and appreciation for connecting STEM learning and ultimately improving connected STEM learning for K-12 youth. The importance of emphasizing diversity, equity, and accessibility will be strongly represented in the key evidence identified through the conference and will be reflected in the resources that will be disseminated to a broader audience.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Addressing Societal Challenges through STEM (ASCs) received NSF AISL funding to conduct a Literature Review and Synthesis to answer the question: How are informal learning institutions advancing the use of STEM knowledge and scientific reasoning in the ways that individuals, families, and communities understand what they can do, and apply their learning to solving the societal challenges of our time? Using a definition of societal challenges based on research around the public understanding of social problems, this systematic literature review will identify, analyze, and synthesize three bodies of peer and field-reviewed literature (peer-reviewed journals, graduate theses, and evaluation reports of nationally-funded project).
Over the past decade, Informal STEM learning organizations have increasingly engaged in innovative ways to present STEM knowledge within the context of societal challenges such as climate change, energy sources, cyber-security, Nanotechnologies, coastal resilience, and other topics. These efforts significantly expand the traditional work of Informal STEM Learning (ISL) organizations, often leading to new types of interventions, partnerships, impacts, and assessment tools. Analyzing and interpreting the aggregate of this work will advance theoretical and practical knowledge about the potential of ISL’s in advancing the place of STEM in addressing societal challenges.
Demonstrating and articulating the characteristics of how ISL organizations are addressing societal challenges, encourages and informs the ways institutions can address the NSF strategic goal to “Advance the capability of the Nation to meet current and future challenges.” The project outputs aim to Enhance Knowledge-building, Build Capacity of the Field, and Maximize Strategic Impact by informing the strategies used by organizations and individuals. The results also aim to Broaden Participation by articulating the ways STEM knowledge is embedded and linked to personal experiences and choices.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. Informal STEM educational activities have proliferated widely in the US over the last 20 years. Additional research will further validate the long-term benefits of this mode of learning. Thus, elaborating the multitude of variables in informal learning and how those variables can be used for individual learning is yet to be defined for the circumstances of the learners. Thus, the primary objective of this work is to produce robust and detailed evidence to help shape both practice and policy for informal STEM learning in a broad array of common circumstances such as rural, urban, varying economic situations, and unique characteristics and cultures of citizen groups. Rather than pursuing a universal model of informal learning, the principal investigator will develop a series of comprehensive models that will support learning in informal environments for various demographic groups. The research will undertake a longitudinal mixed-methods approach of Out of School Time/informal STEM experiences over a five-year time span of data collection for youth ages 9-19 in urban, suburban, town, and rural communities. The evidence base will include data on youth experiences of informal STEM, factors that exert an influence on participation in informal STEM, the impact of participation on choices about educational pathways and careers, and preferences for particular types of learning activities. The quantitative data will include youth surveys, program details (e.g. duration of program, length of each program session, youth/facilitator ratio, etc.), and demographics. The qualitative data will include on-site informal interviews with youth and facilitators, and program documentation. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Often called "self-plagiarism," text recycling occurs frequently in scientific writing. Over the past decade, increasing numbers of scientific journals have begun using plagiarism detection software to screen submitted manuscripts. As a result, large numbers of cases of text recycling are being identified, yet there is no consensus on what constitutes ethically acceptable practice. Text recycling is thus an increasingly important and controversial ethical issue in scientific communication. However, little actual research has been conducted on text recycling and it is rarely addressed in the ethical training of researchers or in scientific writing textbooks or websites. To promote the ethical and appropriate use of text recycling, this project will be conducted in two phases: In Phase 1, the researchers will investigate the ethical, practical, and legal aspects of text recycling as relevant for professional researchers, students, and publishers. In Phase 2, the investigators will produce educational materials and develop model language for text recycling guidelines and author-publisher contracts that can be adapted by educational institutions, research organizations, and publishers.
This project is a multi-institutional, multidisciplinary investigation of text recycling, the reuse of material from one?s previous work in a new manuscript. In Phase 1, the researchers will investigate questions such as these: What do expert researchers, students, and others involved in scientific communication believe to be appropriate practice, and why? Where is there a clear consensus among experts and where is there substantive disagreement? How often do professional scientists actually recycle material, and in what ways? Under what circumstances does text recycling violate publisher contracts or copyright laws? One facet of this research will involve interviewing and surveying experienced STEM faculty, students, journal editors, and others regarding the ethics of text recycling. A second facet will analyze a corpus of published scientific papers to investigate how researchers recycle text in practice and how this has changed over time. The third facet involves analyzing publisher contracts to better understand the rights of publishers and authors regarding text recycling and to assess their legal validity. In Phase 2, the investigators will use findings from Phase 1 to develop, test, and disseminate two kinds of materials: The first are web and print based instructional materials for STEM students (and others new to STEM research) explaining the ethical, legal, and practical issues involved with text recycling, as well as accompanying documents for faculty, administrators, and librarians. The second are model policies and guidelines for text recycling that address appropriate practice in both academic and professional settings. The investigators will obtain feedback on drafts of these materials from potential users and revise them accordingly, after which they will be disseminated.