In this paper we investigate how people become engaged with open data, what their motivations are, and the barriers and facilitators program participants perceive with regard to using open data effectively.
DATE:
TEAM MEMBERS:
Jack ShanleyCamillia MatukOded NovGraham Dove
resourceevaluationProfessional Development, Conferences, and Networks
Inverness Research and Oregon State University, with support and input from CAISE, conducted an evaluation of the 2021 NSF AISL Awardee Meeting which was held virtually October 19-21, 2021. The evaluation effort included observing the meeting, participating in debriefing the meeting with CAISE co-PIs, the CAISE equity audit committee, and NSF Program Officers; developing and administering a post-event survey; and analyzing data collected through both the survey and Pathable, the virtual platform.
The meeting specifically focused on inviting and including community partners, and on creating
The Center for the Advancement of Informal Science Education (CAISE) is mid-way through year five of a five-year cooperative agreement with the National Science Foundation. The NSF funded CAISE in 2007 in order to serve as a resource center to the informal science education (ISE) program, its grantees, and the larger ISE field. Inverness Research has served as the external evaluator for the past five years, documenting the development of CAISE, and the quality and value of its work to key audiences and stakeholders.
This report is a reflection on the progress of CAISE that draws upon our
Inverness Research and Oregon State University, with support and input from CAISE, conducted an evaluation of the 2021 NSF AISL Awardee Meeting which was held virtually October 19-21, 2021. The evaluation effort included observing the meeting, participating in debriefing the meeting with CAISE co-PIs, the CAISE equity audit committee, and NSF Program Officers; developing and administering a post-event survey; and analyzing data collected through both the survey and Pathable, the virtual platform.
This report summarizes the key evaluation findings. It includes the following sections:
This evaluation report highlights finding on the evaluation of the Center for Advancement of Informal Science Education (CAISE), a cooperative agreement with NSF, is a partnership of the Association of Science-Technology Centers with faculty and professionals from the University of Pittsburgh Center for Learning in Out-of-School Environments, Oregon State University, Science Museum of Minnesota, Visitor Studies Association, KQED Public Media, Advisors and other collaborators. CAISE is working to support ongoing improvement of, and NSF investments in, the national infrastructure for informal
Education Development Center, Inc. (EDC) received a grant to develop a STEM Evaluation Community from the National Science Foundation (NSF). The primary goal of this project is to increase the capacity of evaluators to produce high quality, conceptually sound, methodologically appropriate evaluations of NSF programs and projects, specifically in the area of STEM education and outreach.
In response to a need for support for evaluation capacity, articulated by those who evaluate NSF programs and projects, the STEM Evaluation Community planned to connect evaluators across directorates
In 2017, the Education Development Center (EDC) received a grant from the National Science Foundation (NSF) to bring together PIs of STEM Program Resource Centers (PRC) funded under NSF’s Education and Human Resources (EHR), evaluators of NSF STEM projects and programs, and evaluation advisors to address concerns about the quality and consistency of STEM evaluations. According to the grant proposal, the goal was “to increase the capacity of evaluators to produce high quality, conceptually sound, methodologically appropriate evaluations of NSF programs and projects, specifically in the area of
This is a report from Workshop II: Overview of Organizational Support for Public Engagement among Scientific Societies, part of the Support Systems for Scientists' Communication and Engagement workshop series. Workshop II was held Feb. 28 - Mar. 1, 2018 at the Howard Hughes Medical Institute in Chevy Chase, MD. The report provides an overview of a project aiming to help reveal how societies view the concept of “public engagement” and to provide an empirical understanding of the availability and prevalence of tools that societies currently use to support engagement efforts.
DATE:
TEAM MEMBERS:
Shupei YuanAnthony DudoJohn BesleyBrooke Smith
resourceprojectWebsites, Mobile Apps, and Online Media
The American Association for the Advancement of Science (AAAS) is creating, implementing and evaluating a forum for the NSF INCLUDES broadening participation community of practice and for engaging the NSF INCLUDES awardees and science, technology, engineering and mathematics (STEM) researchers across the nation to expand the NSF INCLUDES broadening participation network. The NSF INCLUDES program is a comprehensive national initiative designed to enhance U.S. leadership in STEM discoveries and innovations focused on NSF's commitment to diversity, inclusion, and broadening participation in these fields.
The NSF INCLUDES Open Forum will use the AAAS Trellis networking platform and the organization's experience engaging communities of practice focused on broadening participation, STEM education and STEM research. The project builds on the success of a prior NSF INCLUDES Conference award (HRD-1650509) that was addressing goals to define networking needs of the first round of NSF INCLUDES Design and Development Launch Pilots (DDLP); to develop design specifications for NSF INCLUDES networking, curating of resources, and supporting communities of practice; and to propose tools, techniques, capacities and functionalities for an NSF INCLUDES national network.
The NSF INCLUDES Open Forum project includes advisory board members with expertise in networking platforms and others with broadening participation knowledge and experience. A yearly conference for NSF INCLUDES awardees will offer participants an opportunity to learn about how Trellis platform upgrades, functionality and technology options (e.g., a smartphone application) can be used in new ways to engage a broader community of partners interested in broadening participation in STEM research and education contexts. An external evaluator will assess the activities and outcomes of the NSF INCLUDES Open Forum both during implementation and at project end. The PIs will also communicate the outcomes of the project to broader audiences, both academic and non-academic, and encourage a dialogue within the NSF INCLUDES community about the use of technology for organization and communication within a network.
DATE:
-
TEAM MEMBERS:
Shirley MalcomJosh Freeman
resourceprojectProfessional Development, Conferences, and Networks
Project SYSTEMIC (A Systems Thinking Approach to STEM Ecosystem Development in Chicago) will apply systems thinking to a community-level STEM ecosystem development effort in one of Chicago's largest and most distressed neighborhoods. The project aims to broaden participation of African American and low-income Chicago Public School students (preK-12) in STEM learning opportunities. The proposed model of collaborative change for this project builds on the work of two coordinated collective impact initiatives--the Chicago STEM Pathways Cooperative and Austin Coming Together, a network of local organizations committed to improving educational and economic outcomes for the community. A key feature of this project is that it adds innovative, interactive, visual problem structuring and solving strategies to highlight and uncover the systemic interdependencies that contribute to the BP challenge for African American youth. The project will convene a series of workshops to engage community stakeholders in the mapping of the STEM ecosystem. A broad and representative cross-section of community stakeholders will design and develop evidence-based STEM ecosystem organizing and implementation strategies. Key outcomes anticipated from this project are the development of a shared understanding, agenda, activities, and commitment to collectively address the underlying challenges of STEM access and participation for African American youth. The goal of this community-driven project is to develop a viable system model that elevates neighborhood voices, historically excluded from the problem-solving table and decision-making processes, to leverage existing assets, build local capacity, increase messaging and awareness of the value of STEM, identify needed new programs, and develop coordination/resource sharing mechanisms across partners to support implementation. The evaluation of this project will be grounded in systems thinking and culturally-responsive approaches that seek to understand the diverse perspectives of stakeholders while measuring progress toward project goals. Evaluation data will be used to assess the problem structuring process, to evaluate the organizational strategy designed to address the structured problem, and to support adaptive learning among stakeholders.
In this NSF INCLUDES Design and Development Launch Pilot the institutions of "Building on Strengths" propose to build and pilot the infrastructure, induction process, and early implementation of the Mathematician Affiliates of Color network. This network will consist of mathematicians of color from across academia and industry who want to invest time in, share their expertise with, and learn from students of color and their teachers. Building on Strengths will draw on basic needs cognitive theory to support these interactions and will focus narrowly on short and moderate term collaborations (from one month to a semester) between visiting mathematicians, students, and collaborating teachers that will involve three specific types of interactions: doing mathematics together as a habits-of-mind practice, talking about the discipline of mathematics and the experiences of mathematicians of color in that discipline, and relationship-building activities. The foundational infrastructure developed in the project will include systems for recruitment, selection and induction, a process for pairing affiliate mathematicians with classrooms, and support structures for the collaborations. To support the goals of the network a prototype virtual space will be developed in which real-time artifacts can be collected and shared from the classroom interactions. While Building on Strengths will pilot this program in the secondary context, once a viable model is established, scaling to K-16, as well as to other STEM fields, will be possible.
The research study in the project uses an exploratory sequential mixed-methods design and will be conducted in two phases. In the first, quantitative, phase of the study the following questions will be addressed: (1) Is the teacher-mathematician collaboration associated with a change for students in perception of basic human needs being met, mathematical or racial identities, or beliefs about mathematics or who can do mathematics? (2) Is the teacher-mathematician collaboration associated with a change for adults in perceptions of the role of basic needs or in adults' identities or beliefs about mathematics or who can do mathematics? In the second, qualitative, phase of the study, two types of interactions will be selected for in-depth qualitative study, identifying cases where groups of students experienced changes in their needs, identity, and beliefs. In this qualitative case-centered phase, the following questions will be explored: (1) What is the nature of the mentor-student interaction? (2) What aspects of the intervention do students feel are most relevant to them? (3) How did the implementation of the intervention differ from the anticipated intervention? The results of the study will help improve the infrastructure for, and better support the interactions between, mathematicians of color, students of color and their mathematics teachers; the outcomes will also shed light on how students experience their interactions.
DATE:
-
TEAM MEMBERS:
Michael YoungMaisha MosesAlbert CuocoEden Badertscher