The Discovery Museums will develop and implement a continuous improvement process to improve the impact of its STEM programming by strengthening staff skills in using evaluation data. The project will begin with a series of training sessions for learning programs staff based on feedback from youth regarding the quality of the museum's program delivery and an assessment of staff competencies in positive youth development. Participating staff will benefit from a deeper understanding of data and the ability to build ongoing evaluation and positive youth development practices into their program presentations in a way that supports Social-Emotional Learning outcomes. The project will potentially result in a process and set of tools to quantify the impact of STEM programming that can be shared with other informal learning organizations.
The Aldrich Contemporary Art Museum will amplify its partnership with Hart Magnet School, a Title 1 elementary school in urban Stamford, Connecticut, by increasing exposure and access to the arts for first-fifth graders, their families, and educators. A new program model, leveraging the museum's artist exhibitions, will focus on technology and an inquiry-based approach to science. Students, educators, and families will be encouraged to see and think in new ways through on-site STEAM tours at the museum, artist-led workshops at Hart, teacher professional development, and afterschool family activities. Outside evaluators will work with the project team to develop goals and associated metrics to measure how the model of museum-school partnership can enhance student achievement, engage families more deeply in their child's school experience and community, and contribute to teacher professional development. The evaluator will also train museum staff on best practices for program assessment.
DATE:
-
TEAM MEMBERS:
Namulen Bayarsaihan
resourceevaluationProfessional Development, Conferences, and Networks
Fostering STEAM provided exceptional professional development that was highly rated by participants and contributed to expected participant learning outcomes. The in-person Fostering STEAM workshop reflected professional development best practices. Likewise, the online Fostering STEAM course reflected indicators of effective online continuing education and professional development.
The Fostering STEAM professional development contributed to significant self-reported growth in principles or beliefs related to the Fostering STEAM instructional approach, as well as preparedness to develop and
The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
DATE:
-
TEAM MEMBERS:
Kris Scopinich
resourceprojectProfessional Development, Conferences, and Networks
The Lawrence Hall of Science will build the capacity of staff from different programmatic departments to systematically evaluate their programs in strategic alignment with the museum's newly revised Theory of Action. Based on best practices in evaluation capacity building, the museum will create a strategic plan for evaluation that provides ongoing opportunities for staff to engage in evaluation practice. To build capacity and foster a culture of continuous improvement, program teams will participate in a variety of activities such as trainings to build knowledge about evaluation; meetings to discuss purpose and methods of evaluation; group inquiry about evaluation measures, outcomes, and data; and conducting evaluation with support from evaluators. Project outcomes for museum staff will include increased knowledge of evaluation design; increased skill in designing and conducting evaluation; ongoing and continuous use of evaluation data to improve decision making and programs; and enthusiasm for evaluation as part of the process of strategic learning.
The ChemAttitudes project recieved supplemental funding to create materials for train-the-trainer workshops in order to inoculate the chemistry outreach community with members who have the knowledge and resources to train others on strategies for stimulating interest, sense of relevance, and feelings of self-efficacy that were tested in the earlier work of the project. The project team recruited participants from minority serving professional organizations as a strategy for broadening participation. Can it work? Did it work?
This poster was presented at the 2021 NSF AISL Awardee Meeting.
To advance justice, equity, diversity, and inclusion in science, we must first understand and improve the dominant-culture frameworks that impede progress and, second, we must intentionally create more equitable models. The present authors call ourselves the ICBOs and Allies Workgroup (ICBOs stands for independent community-based organizations), and we represent communities historically excluded from the sciences. Together with institutional allies and advisors, we began our research because we wanted our voices to be heard, and we hoped to bring a different perspective to doing science with
DATE:
TEAM MEMBERS:
María Cecilia Alvarez RicaldeJuan Flores ValadezCatherine CrumJohn AnnoniRick BonneyMateo Luna CastelliMarilú López FrettsBrigid LuceyKaren PurcellJ. Marcelo BontaPatricia CampbellMakeda CheatomBerenice RodriguezYao Augustine FoliJosé GonzálezJosé Miguel Hernández HurtadoSister Sharon HoraceKaren KitchenPepe Marcos-IgaTanya SchuhPhyllis Edwards TurnerBobby WilsonFanny Villarreal
In collaboration with the Association of Science-Technology Centers (ASTC), Association of Children’s Museums (ACM) and Immersive Learning Research Network (iLRN), and with support from the National Science Foundation, the Institute for Learning Innovation will virtually bring together 4-5 dozen diverse (expertise and role, background, demographics, geography) thoughtful STEM learning professionals to collaboratively re-imagine the future of the science museum community, in particular the particularly vulnerable small to medium size science museum sector. Participants will be asked to think
Inverness Research and Oregon State University, with support and input from CAISE, conducted an evaluation of the 2021 NSF AISL Awardee Meeting which was held virtually October 19-21, 2021. The evaluation effort included observing the meeting, participating in debriefing the meeting with CAISE co-PIs, the CAISE equity audit committee, and NSF Program Officers; developing and administering a post-event survey; and analyzing data collected through both the survey and Pathable, the virtual platform.
This report summarizes the key evaluation findings. It includes the following sections:
This whitepaper introduces the Strategic Outcomes Framework, a taxonomy of outcome types within eight outcome categories (interest, attitude, knowledge, STEM skills, 21st century skills and social emotional evelopment, behavior, STEM capital, and career path). It summarizes proceedings of the NSF-funded Strategic Outcome Progressions Conference: Exploring a Framework for Measuring Informal Education Outcomes and Institutional Impact (award # 2039209) and changes made to the framework as a result. Among these changes are the necessity of nesting the framework within what we have come to call
Across literature on STEM practice and STEM education, definitions of "imagination" vary in a number of ways. The visual tool below presents a way to organize the characteristics of these definitions along three dimensions: essence, ways of thinking, and context. Using this framework, you can build definitions of imagination relevant to your work.
Through an NSF-funded literature review, professional survey, and virtual convening, the Museum of Science, Boston is systematically documenting intersections between imagination, STEM and learning to create research-based resources for positioning and attending to imaginative ways of thinking in informal STEM learning environments. This poster shares an overview of our research methods and preliminary findings (as of Sept 2021).
This poster was presented at the 2021 NSF AISL Awardee Meeting.