This report presents summative evaluation results for a National Science Foundation funded project entitled Grounding Institutional Partnerships in Structures for Broader Impacts Design (BID). The project represents a collaboration between five institutions: Institute for Learning Innovation, The STEM Research Center at Oregon State University, Scicenter, University of Washington-Bothell, and University of Wisconsin-Madison. BID aimed at creating an inter-institutional structure and toolkit to assist higher education institutions (HEIs) and informal science education organizations (ISEs) in
The Center for Advancing the Societal Impacts of Research (CASIR) will advance the rigor, relevance, and practice of broader impacts (BI) by (a) cultivating and strengthening the existent and emerging BI expert community; (b) building capacity of researchers and educators to enhance and articulate the broader impacts of their work; and (c) creating socio-technical infrastructure able to adapt to stakeholder needs as BI continues to grow and evolve. CASIR builds on the foundational work of the National Alliance for Broader Impacts and will advance the practice of translating scientific research for public understanding and meet the growing demand for innovative BI training and resources.
The Center will develop resources and provide professional development to diverse audiences across multiple institution types and settings, including research-intensive universities, minority-serving institutions, technical and community colleges, and primarily undergraduate institutions in the jurisdictions of the Established Program to Stimulate Competitive Research. CASIR will directly enhance BI capacity at the individual, departmental, institutional, and national levels. Particular focus will be given to individual researchers and institutions representing and serving traditionally under-served populations. In addition, CASIR will facilitate dialogue and collaboration around evidence-based approaches to enhancing, evaluating, and documenting research impacts. Overall, the work will be valuable to the community of researchers driving discovery, the community of professionals who provide BI support and collaboration with researchers, and the public which stands to benefit from research and education projects that are well-designed and executed in a way that enhances their broader impacts.
NSF-wide support for this Center augments the Foundation's current efforts to educate research communities about the importance of the broader impacts criterion in the review process and to communicate the societal benefits of fundamental science and engineering research. CASIR's emphasis on documentation, evidence, and best practices will support an evidence-building approach to investing in discovery and innovation.
This award is co-funded by the Office of Integrative Activities (OIA) and the following Directorates: Biological Sciences (BIO), Computer and Information Science and Engineering (CISE), Education and Human Resources (EHR), Engineering (ENG), Geosciences (GEO), Mathematical and Physical Sciences (MPS), and Social, Behavioral, and Economic Sciences (SBE).
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This project supports the Broader Impacts and Outreach Network for Institutional Collaboration (BIONIC), a national Research Coordination Network of Broader Impacts to support professionals who assist researchers to design, implement, and evaluate the Broader Impacts activities for NSF proposals and awards. All NSF proposals are evaluated not only on the Intellectual Merit of the proposed research, but also on the Broader Impacts of the proposed work, such as societal relevance, educational outreach, and community engagement. Many institutions have begun employing Broader Impacts support professionals, but in most cases, these individuals have not worked as a group to identify and share best practices. As a consequence, there has been much duplication of effort. Through coordination, BIONIC is expected to improve efficiency, reduce redundancy, and have significant impact in several areas: 1) Researchers will benefit from an increased understanding of the Broader Impacts merit review criterion and increased access to collaborators who can help them design, implement, and evaluate their Broader Impacts activities; 2) Institutions and research centers will increase their capacity to support Broader Impacts via mentoring for Broader Impacts professionals and consulting on how to build Broader Impacts support infrastructure, with attention to inclusion of non-research-intensive universities, Historically Black Colleges and Universities, and Hispanic- and Minority-Serving Institutions that may not have the resources to support an institutional Broader Impacts office; and 3) NSF, itself, will benefit from a systematic and consistent approach to Broader Impacts that will lead to better fulfillment of the Broader Impacts criterion by researchers, better evaluation of Broader Impacts activities by reviewers and program officers, and a system for evaluating the effectiveness of Broader Impacts activities in the aggregate, as mandated by Congress and the National Science Board. Through its many planned activities, BIONIC will ultimately help advance the societal aims that the Broader Impacts merit review criterion was meant to achieve.
The main goals of the project will be accomplished through the four specific objectives: 1) Identify and curate promising models, practices, and evaluation methods for the Broader Impacts community; 2) Expand engagement in, and support the development of, high-quality Broader Impacts activities by educating current and future faculty and researchers on effective practices; 3) Develop the human resources necessary for sustained growth and increased diversity of the Broader Impacts community; and 4) Promote cross-institutional collaboration and dissemination for Broader Impacts programs, practices, models, materials, and resources. BIONIC will facilitate collaborative Broader Impacts work across institutions, help leverage previously developed resources, support professional development, and train new colleagues to enter into the Broader Impacts field. This project will improve the quality and sustainability of Broader Impacts investments, as researchers continue to create unique and effective activities that are curated and broadly disseminated. BIONIC will create a network designed to assist NSF-funded researchers at their institutions in achieving the goals of the Broader Impacts Review Criterion. In so doing, BIONIC will promote Broader Impacts activities locally, nationally, and internationally and help to advance the Broader Impacts field.
This award is co-funded by the Divisions of Molecular and Cellular Biosciences and Emerging Frontiers in the Directorate for Biological Sciences and by the Division of Chemistry in the Directorate for Mathematics and Physical Sciences.
Scientists (and engineers) wishing to conduct public engagement do so in the context of established disciplinary norms and complex institutional systems that may support or limit their success. This report seeks to convey the known complexity, unique challenges, and opportunities for universities to better support for scientists in their public engagement work. The report is intended to drive discussion towards deeper exploration and development of actionable next steps.
This is a report from Workshop III: Academic Institutions, part of the Support Systems for Scientists' Communication and
As higher education institutions (HEIs) work to enhance Broader Impacts (BI) efforts, collaborations with informal science education institutions (ISEs) (e.g. science centers, aquaria, zoos) can help them strengthen their impact and reach broader audiences. This project builds on the successful Portal to the Public (PoP) framework, bringing together the expertise and resources of HEIs and ISEs around the shared mission of engaging public audiences in current STEM research. The project is designed to address several critical needs: (1) Public outreach BI activities are relatively uncommon compared to BI that is focused within the infrastructure of academia; (2) Because collaborations with ISEs are frequently tied to individual Principal Investigators (PIs), there is limited opportunity to build a body of knowledge around the practice of partnering for BI work; and (3) Collaborations are often transient, making it more difficult for universities to view BI on an institutional level in ways that leverage particular institutional assets or strategies and even link investigators from multiple projects. The specific areas of study are: a. Develop and test a structure for education/outreach BI experience design that addresses a public audience need and meets NSF's BI criterion: The project will create disseminatable tools around the activity design process (including evaluation of learning impacts). By convening cross-disciplinary teams, the project will ensure that experiences will reflect a wide range of expertise and will help meet the needs of multiple stakeholders. These established structures will lower the barrier to entry for PIs who want to do public outreach BI. b. Design, test, and study structures for long-term, mutually beneficial HEI-ISE partnerships: The project will build on the proven PoP model to create flexible, disseminatable tools around the development of institutional partnerships at three collaborating HEI-ISE site pairings that consider each institution's resources, constraints and strategic goals, including a cross-institutional and cross-disciplinary Broader Impacts Design (BID) Team structure. Sustained partnerships will support ongoing public engagement with current STEM research. c. Anchor the partnership at the HEI with a representative from an office of research support: Research support professionals will be a core part of the BID Team and will help support institutional strategies for aligning BI activities with broader goals around community engagement. d. Study the culture of HEI-ISE partnerships, building knowledge about how these institutions can form effective, sustained and mutually beneficial collaborations. Project partners include Pacific Science Center with the University of Washington, Bothell, WA; University of Wisconsin-Madison with the Wisconsin Institute for Discovery; and the Sciencenter with Cornell University, Ithaca, NY. In addition, the Center for Research in Lifelong Learning, Oregon State University will oversee the research aspects of the project. The project's primary benefit is the development of more effective mechanisms for HEIs and ISEs to collaborate, that will better enable them to engage their communities in experiences and conversations about current STEM research and innovation. This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
As higher education institutions (HEIs) work to enhance Broader Impacts (BI) efforts, collaborations with informal science education institutions (ISEs) (e.g. science centers, aquaria, zoos) can help them strengthen their impact and reach broader audiences. This project builds on the successful Portal to the Public (PoP) framework, bringing together the expertise and resources of HEIs and ISEs around the shared mission of engaging public audiences in current STEM research. The project is designed to address several critical needs: (1) Public outreach BI activities are relatively uncommon compared to BI that is focused within the infrastructure of academia; (2) Because collaborations with ISEs are frequently tied to individual Principal Investigators (PIs), there is limited opportunity to build a body of knowledge around the practice of partnering for BI work; and (3) Collaborations are often transient, making it more difficult for universities to view BI on an institutional level in ways that leverage particular institutional assets or strategies and even link investigators from multiple projects.
The specific areas of study are:
a. Develop and test a structure for education/outreach BI experience design that addresses a public audience need and meets NSF's BI criterion: The project will create disseminatable tools around the activity design process (including evaluation of learning impacts). By convening cross-disciplinary teams, the project will ensure that experiences will reflect a wide range of expertise and will help meet the needs of multiple stakeholders. These established structures will lower the barrier to entry for PIs who want to do public outreach BI.
b. Design, test, and study structures for long-term, mutually beneficial HEI-ISE partnerships: The project will build on the proven PoP model to create flexible, disseminatable tools around the development of institutional partnerships at three collaborating HEI-ISE site pairings that consider each institution's resources, constraints and strategic goals, including a cross-institutional and cross-disciplinary Broader Impacts Design (BID) Team structure. Sustained partnerships will support ongoing public engagement with current STEM research.
c. Anchor the partnership at the HEI with a representative from an office of research support: Research support professionals will be a core part of the BID Team and will help support institutional strategies for aligning BI activities with broader goals around community engagement.
d. Study the culture of HEI-ISE partnerships, building knowledge about how these institutions can form effective, sustained and mutually beneficial collaborations.
Project partners include Pacific Science Center with the University of Washington, Bothell, WA; University of Wisconsin-Madison with the Wisconsin Institute for Discovery; and the Sciencenter with Cornell University, Ithaca, NY. In addition, the Center for Research in Lifelong Learning, Oregon State University will oversee the research aspects of the project. The project's primary benefit is the development of more effective mechanisms for HEIs and ISEs to collaborate, that will better enable them to engage their communities in experiences and conversations about current STEM research and innovation.
This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
As higher education institutions (HEIs) work to enhance Broader Impacts (BI) efforts, collaborations with informal science education institutions (ISEs) (e.g. science centers, aquaria, zoos) can help them strengthen their impact and reach broader audiences. This project builds on the successful Portal to the Public (PoP) framework, bringing together the expertise and resources of HEIs and ISEs around the shared mission of engaging public audiences in current STEM research. The project is designed to address several critical needs: (1) Public outreach BI activities are relatively uncommon compared to BI that is focused within the infrastructure of academia; (2) Because collaborations with ISEs are frequently tied to individual Principal Investigators (PIs), there is limited opportunity to build a body of knowledge around the practice of partnering for BI work; and (3) Collaborations are often transient, making it more difficult for universities to view BI on an institutional level in ways that leverage particular institutional assets or strategies and even link investigators from multiple projects. The specific areas of study are: a. Develop and test a structure for education/outreach BI experience design that addresses a public audience need and meets NSF's BI criterion: The project will create disseminatable tools around the activity design process (including evaluation of learning impacts). By convening cross-disciplinary teams, the project will ensure that experiences will reflect a wide range of expertise and will help meet the needs of multiple stakeholders. These established structures will lower the barrier to entry for PIs who want to do public outreach BI. b. Design, test, and study structures for long-term, mutually beneficial HEI-ISE partnerships: The project will build on the proven PoP model to create flexible, disseminatable tools around the development of institutional partnerships at three collaborating HEI-ISE site pairings that consider each institution's resources, constraints and strategic goals, including a cross-institutional and cross-disciplinary Broader Impacts Design (BID) Team structure. Sustained partnerships will support ongoing public engagement with current STEM research. c. Anchor the partnership at the HEI with a representative from an office of research support: Research support professionals will be a core part of the BID Team and will help support institutional strategies for aligning BI activities with broader goals around community engagement. d. Study the culture of HEI-ISE partnerships, building knowledge about how these institutions can form effective, sustained and mutually beneficial collaborations. Project partners include Pacific Science Center with the University of Washington, Bothell, WA; University of Wisconsin-Madison with the Wisconsin Institute for Discovery; and the Sciencenter with Cornell University, Ithaca, NY. In addition, the Center for Research in Lifelong Learning, Oregon State University will oversee the research aspects of the project. The project's primary benefit is the development of more effective mechanisms for HEIs and ISEs to collaborate, that will better enable them to engage their communities in experiences and conversations about current STEM research and innovation. This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Because of the siloed nature of formal educational curricula, students who opt out of STEM coursework, for whatever reason, lose the opportunity to engage with the domain of science almost entirely, thereby closing the door to the STEM workforce pipeline. This disproportionately impacts students of color and women. This project advances an alliance that consists of a consortium of community-engaged partners, including university and k-12 educational agencies, community colleges, community organizations, cultural institutions and local businesses. The project built around this alliance will leverage interdisciplinary spaces in the curriculum, particularly the humanities and social sciences, across academic levels, as a forum for integrating and applying STEM to bear on the practical, social, economic and political issues of modern life. The PIs establish a physical Community STEM Center as an anchoring institution for STEM engagement. This Center will be situated within the community that the alliance serves, bringing STEM opportunities and engagement to students instead of asking them to come where STEM education is currently provided. The activities enacted through the Community STEM Center will focus on enduring problems experienced by the communities, where students, community residents, teachers, and experts from higher education, industry and other community-based entities can come together to work on understanding them and developing evidenced centered advocacy as a means for addressing them. To facilitate the work at the Community STEM Center, the project creates a Community Ambassadors Program (CAP), leveraging participation across alliance members in partnership with the community. This Design and Development Launch Pilot will cultivate the necessary knowledgebase to develop a scalable model for implementation across diverse urban communities.
Technical Summary
This Design and Development Launch Pilot focuses on shifting the narrative of STEM education away from a solitary focus on formalized educational experiences and targets STEM content. This project develops and facilitates a parallel set of activities designed to engage under-represented students in learning how and why STEM is relevant to their lives, and approached through new and non-traditional educational dimensions. The five main objectives of this proposed pilot are to: (1) Develop a pilot alliance of community-engaged partners, including university and k-12 educational agencies, community colleges, community organizations, cultural institutions and industry;(2)Establish a physical Community STEM Advocacy Center as an anchoring institution for change embedded within the community that the pilot alliance serves; (3) Leverage interdisciplinary spaces in curricula, across academic levels, particularly the humanities and social sciences, as a forum for integrating and applying STEM to bear on the practical, social, economic and political issues of modern life; (4) Create a Community Ambassadors Program (CAP), leveraging participation across higher education pilot alliance members in partnership with the community; and (5)Conduct an evaluation of project initiatives and research regarding the usability and feasibility of a systemic approach to developing community-based, interdisciplinary pathways to broaden STEM participation pathways. Efforts to examine the impact of this community-based, interdisciplinary approach concentrates on the proximal outcomes related to STEM interest, self-efficacy and identity. Data will be collected in pre/post format across our three constituent samples: 1) Community STEM Advocacy Center participants; 2) k-12 students; and, 3) postsecondary students. Analysis of data will be conducted through MANCOVAs to account for potential co-variation among construct scores. Qualitative data will also be collected to contextualize findings and enable the development of a rich case study. At least two observations will be conducted in the Community STEM Advocacy Center and the two classroom implementations to document engagement, participant interactions and level of STEM content.
DATE:
-
TEAM MEMBERS:
Kimberly LawlessDonald WinkLudwig Carlos NitscheAixa AlfonsoJeremiah Abiade
resourceresearchProfessional Development, Conferences, and Networks
The National Academies’ Science and Technology for Sustainability Program (STS) in the division of Policy and Global Affairs was established to encourage the use of science and technology to achieve long-term sustainable development. The goal of the STS program is to contribute to sustainable improvements in human well-being by creating and strengthening the strategic connections between scientific research, technological development, and decision-making. The program concentrates on activities with the following attributes:
• Cross-cutting in nature, requiring expertise from multiple
DATE:
TEAM MEMBERS:
National Academies of Sciences, Engineering, and Medicine
This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
The Department of Computer Science and Engineering and DO-IT IT (Disabilities, Opportunities, Internetworking and Technology) at the University of Washington propose to create the AccessComputing Alliance for the purpose of increasing the participation of people with disabilities in computing careers. Alliance partners Gallaudet University, Microsoft, the NSF Regional Alliances for Persons with Disabilities in STEM (hosted by the University of Southern Maine, New Mexico State University, and UW), and SIGACCESS of the Association for Computing Machinery (ACM) and collaborators represent stakeholders from education, industry, government, and professional organizations nationwide.
Alliance activities apply proven practices to support persons with disabilities within computing programs. To increase the number of students with disabilities who successfully pursue undergraduate and graduate degrees, the alliance will run college transition and bridge, tutoring, internship, and e-mentoring programs. To increase the capacity of postsecondary computing departments to fully include students with disabilities in coursers and programs, the alliance will form communities of practice, run capacity-building institutes, and develop systemic change indicators for computing departments. To create a nationwide resource to help students with disabilities pursue computing careers and computing educators and employers, professional organizations and other stakeholders to develop more inclusive programs and share effective practices, the alliance will create and maintain a searchable AccessComputing Knowledge Base of FAQs, case studies, and effective/promising practices.
These activities will build on existing alliances and resources in a comprehensive, integrated effort. They will create nationwide collaborations among individuals with disabilities, computing professionals, employers, disability providers, and professional organizations to explore the issues that contribute to the underrepresentation of persons with disabilities and to develop, apply and assess interventions. In addition, they will support local and regional efforts to recruit and retain students with disabilities into computing and assist them in institutionalizing and replicating their programs. The alliance will work with other Alliances and organizations that serve women and underrepresented minorities to make their programs accessible to students with disabilities. Finally they will collect and publish research and implementation data to enhance scientific and technological understanding of issues related to the inclusion of people with disabilities in computing.
DATE:
-
TEAM MEMBERS:
Richard LadnerLibby CohenSheryl BurgstahlerWilliam McCarthy
After the first paradigm shift from the deficit model to two-way communication, the field of science communication is in need of a second paradigm shift. This second shift sees communication as an inherently distributed element in the socio-technical system of science and technology development. Science communication is understood both from a systems perspective and its consecutive parts, in order to get a grip on the complex and dynamic reality of science, technology development and innovation in which scientists, industrial and governmental partners and the lay public collaborate. This essay
DATE:
TEAM MEMBERS:
Maarten C.A. van der SandenSteven Flipse