The informal science education (ISE) sector has an important role to play in addressing current societal issues, including changes in environmental conditions, systemic poverty, and societal responses to natural and manmade disasters. These complex social problems require engaging all sectors of society in deep discussions around science, engineering, technology, and mathematics (STEM) and inclusion, diversity, equity, and access (IDEA). To do this, ISE professionals need training in how to bring in diverse perspectives, support inclusive learning, and provide equal access to institutional policymaking, practices and systems. People from different backgrounds within informal science institutions (ISIs) and local communities bring new perspectives, identify new needs, and foster innovation. This broadening of perspectives is critical to address the complex social problems of the 21st century. A key part of the needed transformations in informal science institutions is the preparation of change agents within the ISE sector capable of reimagining what just and equitable informal science institutions might look like. iPAGE 2.0 is an NSF Advancing Informal STEM Learning (AISL) Innovations in Development project conducted by the Science Museum of Minnesota and the Garibay Group in concert with 27 ISIs from across the US. The overarching goal of the project is to support transformative change toward IDEA in the ISE sector. The project is based on an extension service model of knowledge diffusion which seeks to bridge the knowledge-to-action gap by creating intermediaries that can translate research into practical innovations that can be used by practitioners in ISIs. The project brings together teams of strategically placed individuals within ISIs and prepares them to work with their colleagues to enact research-based practices and practical organizational changes toward greater equity and diversity. This project is funded by the AISL program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This ISE professional development initiative will work with annual first-year cohorts consisting of leadership teams from 4-6 ISIs. Each new cohort will spend 11 days together in a 5-day institute and three 2-day colloquia either virtually or at the Science Museum of Minnesota. Individuals and teams will adapt, implement, and refine ideas, strategies, and tools from the iPAGE 2.0 framework for use within their specific ISI context and broader professional networks and engage in ongoing communication and consultation with the iPAGE 2.0 community. All individuals on the team will develop skills, such as communication and collaboration expertise, to function as change agents acting to transform their organizations with respect to inclusion, diversity, equity, and access (IDEA) in STEM. Participants from previous cohorts will continue their roles as change agents and enhance learning in the iPAGE 2.0 community by sharing what they have learned at iPAGE 2.0 colloquia. The iPAGE 2.0 framework focuses on developing participants' understanding of 1) how structural inequalities function to reproduce social advantage and disadvantage within ISIs and the ISE sector; 2) the barriers, supports, and transmission vectors that contribute to or inhibit a continued shift in the sector toward IDEA within a network of practitioners, organizations, evaluators and researchers; and 3) how to prepare and support diversity change agents within the network. The project will employ a creative evaluation approach that combines developmental, principles-focused, arts-based, and transformative evaluation and an interactive, mixed-methods research study grounded in culturally responsive methodologies to address central questions concerning individual, organizational, and sector change. The project's primary audience is ISE professionals, and the secondary audience is researchers and evaluators working within the ISE sector. The project will work directly with an estimated 122 individuals from 27 ISIs.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This AISL Pilots and Feasibility project will study the data science learning that takes place as members of the public explore and analyze open civic data related to their everyday lives. Government services, such as education, transportation, and non-emergency municipal requests, are becoming increasingly digital. Generally, program workshops and events may be able to support participants in using such data to answer their own questions, such as: "How do City agencies respond to noise in my neighborhood?" and "How do waste and recycling services in my neighborhood compare with others?" This project seeks to understanding how such programs are designed and facilitated to support diverse communities in accessing and meaningfully analyzing data will promote innovation and knowledge building in informal data science education. The team will begin by summarizing best practices in data science education from a variety of fields. Next they will explore the design and impacts of two programs in New York City, a leader in publicly available Open Data initiatives. This phase will explore activities and facilitation approaches, participants' objectives and data literacy skills practice, and begin to identify potential barriers to entry and levels of participation. Finally, the team will build capacity for other similar organizations to explore and understand their impacts on community members' engagement with civic data. This pilot study will establish preliminary evidence of the effectiveness of these programs, and in turn, inform future research into the identifying and amplifying best practices to support public engagement with data.
This research team will begin by synthesizing data science learning best practices based on varied literatures and surveys with academic and practitioner experts.
Synthesis results will be applied as a lens to gather preliminary evidence regarding the impacts of two programs on participants' data science practices and understanding of the nature of data in the context of civics. The programs include one offered by the Mayor's Office of Data Analytics (MODA), which is the NYC agency with overall responsibility for the City's Open Data programs, and BetaNYC, a leading nonprofit organization working to improve lives through civic design, technology, and engagement with government open data. The research design triangulates ethnographic observations and artifacts, pre and post adapted surveys, and interviews with participants and facilitators. Researchers will identify programmatic metrics and adapts existing measures to assess various outcomes related to public engagement with data, including: question formulation, data set selection and manipulation, the use of data to make inferences, and understanding variability, sampling and context. These metrics will be shared through an initial assessment framework for data science learning in the context of community engagement with civic open data. Researchers will also begin to identify barriers to broader participation through literature synthesis, interviews with participants and facilitators, and conversations with other organizations in our networks, such as NYC Community Boards. Findings will determine the suitability of the programs under study and inform future research to identify and amplify best practices in supporting public engagement with data.
This project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will build and test a new model for co-created public engagement with science activities in partnership with civic, community, and scientist partners. The innovation to be tested is deliberative dialogues in science museums that help reduce the polarization about socio-scientific issues, giving people a greater voice in science, and addressing barriers that disconnect scientists from the public. The project will engage four target audiences (informal science education/ISE professionals, civic, community and scientist partners). Science museum partners include Museum of Science (MOS) Boston, Oregon Museum of Science, the Michigan Science Center, and the North Carolina Museum of Life and Science. The project is designed to have a strategic impact on how ISE institutions choose topics of STEM engagement and build public Forum programs.
There will be two evaluation teams for the project. MOS Research and Evaluation will act as formative evaluation mentors for the four partner sites as they co-create their forums. They will provide evaluation capacity building for the sites using team-based inquiry as they create and understand the potential impacts and outcomes of the model. Data collection will include panel surveys and focus groups. The evaluation will explore how the forums can decrease 1) public polarization around STEM topics and (2) the disconnect between scientists, civic organization, and the public. The external summative evaluation will be conducted by Rockman et al (REA). They will conduct a study of the project's process to help the team identify challenges and strategies for overcoming them as they work through the phases of public engagement. The summative study will focus on the project goals taking a qualitative approach. Early interviews with partner participants will explore their strengths and weaknesses in taking on this type of public engagement model including the extent of their previous work with civic partners. Later interviews will investigate what factors have enabled or hindered this project. Summative evaluation questions will also address changes in attitudes toward public engagement with science. REA will collect feedback from summit attendees through intercept interviews and post-surveys administered within a week at the event's conclusion to explore the any changes in knowledge or confidence in undertaking this type of model. REA will present findings from the external evaluation during the annual meeting of the Association of Science-Technology Centers and publish reports to Informalscience.org. Once the model has been developed and tested it will be disseminated to an initial group of 25-30 science museums and eventually to the entire ISE museum field.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The Center for Advancement of Informal Science Education (CAISE) is a National Science Foundation (NSF) funded resource center, working in cooperation with the NSF Advancing Informal STEM Learning (AISL) program to build and advance the informal STEM education field. CAISE continues the work it began in 2007--serving professional audiences in informal STEM learning, which includes those working in science centers and museums, zoos and aquariums, parks, botanical gardens and nature centers, events and festivals, libraries, making and tinkering spaces, media (TV, radio, film, social), cyberlearning and gaming, and youth, community, and out-of-school time programs.
What We Do:
CAISE seeks to characterize, highlight, and connect quality, evidence-based informal STEM learning work supported by a diversity of federal, local, and private funders by providing access to over 8,000 (and growing) resources that include project descriptions, research literature, evaluation reports and other documentation on the InformalScience.org website. In addition, CAISE convenes inquiry groups, workshops and principal investigator meetings designed to facilitate discussion and identify the needs and opportunities for informal STEM learning.
In this award, CAISE is also tasked with advancing and better integrating the professional fields of informal STEM learning and science communication by (1) broadening participation in these fields, (2) deepening links between research and practice, and (3) building capacity in evaluation and measurement. These activities are being undertaken by cross-sector task forces of established and emerging who will be responsible for conducting field-level analyses, engaging stakeholders, and creating roadmaps for future efforts. CAISE is also building on existing communication channels for dissemination to the larger field, and through the InformalScience.org website. An External Review Board and Inverness Research are providing oversight of CAISE's program activities and evaluation of the center.
Who We Are:
CAISE operates as a network of core staff housed at the Association of Science-Technology Centers (ASTC) in Washington, D.C. and co-principal investigators and other collaborators at academic institutions and informal STEM education (ISE) organizations across the U.S. Other key collaborators are the American Association for the Advancement of Science's Center for Public Engagement with Science, the National Informal STEM Education Network, and Arizona State University.