This memo report shares findings from sessions including general responses to the Framework and reaction to the specific Framework domains. To conclude, the report looks ahead to how these findings will inform future work on the project.
A panel to explore the transferability of the Framework and the underlying research from the DACUM Competency Profiles across types of informal science institutions was held at COSI on March 20-21, 2023. This memo report shares findings from the sessions including general responses to the Framework and reaction to the specific Framework domains. To conclude, the report looks ahead to how these findings will inform future work on the project.
This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
The On-the-Spot Feedback project was an iterative design and research project, which developed and tested a training model to help scientists build strategies to gather audience feedback into their outreach activities, allowing them to adjust and shift their communication and outreach on-the-spot, based on real time audience feedback.
Each year, millions of Americans visit science centers and museums, children’s museums, zoos, aquariums, nature centers, planetariums, and similar institutions. Recognized as trusted and popular places for educational and leisure experiences, these institutions are uniquely capable of engaging people across a spectrum of beliefs, experiences, and identities on topics related to science, technology, engineering, and mathematics (STEM), as well as addressing pressing societal problems related to science, technology, and innovation. However, the potential impacts of these institutions are largely dependent on the skills, knowledge, and abilities of the professionals working at them. Following the onset of the COVID-19 pandemic and the need to shift the nature of work, the informal STEM learning workforce was dramatically impacted. The recent period of disruption is a time for innovation. The field is well-positioned to promote new models of professional learning and development that are grounded in the values and practices of informal learning. This project will benefit local communities across the United States and society at large by advancing the capacity of science-engagement professionals to respond to societal needs, concerns, and interests more effectively through their institutions’ exhibitions, education and learning programs, and various forms of public engagement (e.g., community outreach events, supports for teachers/educators and schools). Led by the Association of Science and Technology Centers in collaboration with the Center of Science and Industry’s Center for Research and Evaluation and Oregon State University’s STEM Research Center, this work will build on the Informal STEM Learning (ISL) Professional Competency Framework developed and validated with prior National Science Foundation funding. Competency frameworks are increasingly used across many sectors to identify the suite of skills, knowledge, and capabilities necessary to be successful in a particular area of work. Given dramatic changes to the ISL workplace in the last two years, there is an even stronger potential for the Framework, particularly if newly developed supports can link the Framework to the current, emerging, and continuing needs of the workforce.
Guided by a systematic process for designing training and instructional materials, this project will first capture changes in the ways diverse informal STEM learning professionals describe, pursue, and achieve competencies to produce a revised Framework. Next, the project will collaboratively develop companion resources with diverse professionals through a series of participatory design workshops, using a sequential and iterative approach. The resources are expected to include indicators of professional competencies, self-assessments, training tools, and other types of resources that have the potential to significantly advance the professional learning (as undertaken by individuals and institutions) and the professional development capacity (as provided by institutions, associations, and other organizations) of the informal STEM learning field. Next, the project will share final products–including a refreshed website that hosts the updated Framework and newly-developed suite of tools–with professional association and network partners who can disseminate directly to the institutions and professionals who are developing and practicing these competencies. The project will gather evidence from a small number of early adopters, providing data on specific use-case scenarios. Finally, the project will document the potential impact of the Framework on the field by measuring how the Framework is perceived by informal STEM learning professionals as usable, useful, and beginning to be “in-use." Over time—and with increased use—the Framework and its companion resources hold the promise of contributing to the opening of the field to professionals with identities currently underrepresented through more transparent expectation and clearer growth pathways.
Developing a growth mindset has been identified as a key strategy for increasing youth achievement, motivation, and resiliency (Rattan et al. 2015). At its core, growth mindset describes the idea that one’s abilities can change through using new learning strategies and receiving appropriate mentoring (Dweck 2008). In contrast, a fixed mindset relates to the idea that ability is inherent and cannot be changed. We have taken up the concept of growth mindset and developed it specifically for the context of STEAM (science, technology, engineering, art, and math), a growing area of focus in both in