As science communication programs grow worldwide, effective evaluation and assessment metrics lag. While there is no consensus on evaluation protocols specifically for science communication training, there is agreement on elements of effective training: listening, empathy, and knowing your audience — core tenets of improvisation. We designed an evaluation protocol, tested over three years, based on validated and newly developed scales for an improvisation-based communication training at the Alan Alda Center for Communicating Science. Initial results suggest that ‘knowing your audience’ should
DATE:
TEAM MEMBERS:
Christine O’ConnellMerryn McKinnonJordan Labouff
resourceevaluationProfessional Development, Conferences, and Networks
This document describes the summative project evaluation of 5 annual cohorts of STE(A)M teachers, mostly from California, Florida, and New Mexico participating in out-of-school authentic research experiences collecting fossils and learning about geology, biology, and the natural history along the Panama Canal, and their experiences with museums and research collections. The STEM content of this project is based on the Great American Biotic Interchange (GABI) of animals and plants across the Isthmus of Panama over the past 5 million years. This report also describes the efficacy of sustained
This workshop is funded through the "Dear Colleague Letter: Principles for the Design of Digital Science, Technology, Engineering, and Mathematics (STEM) Learning Environments (NSF 18-017)." In today's educational climate, organizations are creating physical learning spaces for hands-on STEM activities, often called makerspaces, co-working spaces, innovation labs, or fablabs. These spaces have evolved to be interdisciplinary centers that personalize learning for individual, diverse learners in collaborative settings. When designed well, these physical spaces create communities that contextualize learning around participants' goals and thus address STEM learning in a dynamic and integrated way. Participation in these learning environments encourages the cultivation of STEM identities for young people and can positively direct their career trajectories into STEM fields. This workshop will bring together a community of collaborators from multiple stakeholder groups including academia, public libraries, museums, community based organizations, non-profits, media makers and distribution channels, and educators within and beyond K-12 schools. Led by the University of Arizona, and held at Biosphere 2, an international research facility, participants will engage in activities that invite experimentation with distributed learning technologies to examine ways to adapt learning to the changing technological landscape and create robust, dynamic online learning environments. The workshop will culminate in a synthesis of design principles, assessment approaches, and tools that will be shared widely. Partnerships arising from the workshop will pave the way for sustained efforts in this area that span research and practice communities. Outcomes will address research and development of the next generation of digitally distributed learning environments.
The three day workshop convening will provide a unique forum to (1) exchange innovative ideas and share challenges and opportunities, (2) connect practical and research-based expertise and (3) form cross-institutional and cross-community partnerships that envision, propose, and implement opportunities for collecting and analyzing data to systematically inform the collective understanding. Participation-based activities will include design-based experiences, participatory activities, demonstrations of works in progress, prototyping, creative pitching, practitioner lightning talks, small group breakouts, hands-on design activities, and an 'unconference' style synthesis of bold ideas. Participants will be invited to experiment with distributed learning technologies. Five focus areas for the workshop include (1) inclusivity of learning spaces that invite multiple perspectives and full participation, (2) documenting learning in ways that are linked to outcomes and impacts for all learners, (3) implementing the use of new technologies in diverse settings, such as the workforce, (4) interpersonal interactions and peer-to-peer learning that may encourage a STEM career-path, and, (5) methods for collecting and analyzing data at the intersection of people, the learning environment, and new technologies at multiple levels. Outcomes of the workshop will serve to advance knowledge regarding critical gaps and opportunities and identify and characterize models of collaboration, networking, and innovation that operate within and across studio-based STEM learning environments.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
In this paper, our collaborative project team shares design principles and lessons learned from research for designing an app to support families’ joint engagement with media and promote powerful shared learning experiences. We provide a rationale, based on research literature, for why a second-screen app in particular addresses our project goals. In addition, we describe the Splash and Bubbles for Parents app components as well as the co-design process and design-based research studies conducted to inform its design and development. Finally, our team offers design principles grounded in
The assumptions, expectations, and potential for conducting a research synthesis (or any type of literature review) have evolved significantly in recent decades. With advancements in sophisticated and accessible analytical software, combined with the use of systematic protocols, reviews are increasingly generating results that can advance knowledge and practice. But, while reviews, synthesis or meta-analysis have the capacity to inform practice in unique ways, they are also fraught with their own methodological, ethical, and practical issues.
Drawing on the Addressing Societal Challenges
Poster presentation from the 2020 Association of Science and Technology Centers Annual Conference.
This poster presented preliminary findings from a configurative literature synthesis on how the literature posted on the InformalScience.org website, in peer-reviewed journals, and in the ProQuest archive of Theses and Dissertations report about how informal learning institutions are advancing the use of STEM knowledge and scientific reasoning in the ways that can help individuals and communities address the societal challenges of our time?
A year into the COVID-19 pandemic, the world continues to struggle with the many ways our lives have changed and the uncertainty that remains about the future. Vaccines are being widely administered, but how and when life will return to “normal” remains unknown. During this time, caregivers continue to seek out information to address the questions, worries, and information needs their children have about this unique moment in their lives. Our NSF-funded RAPID research project has helped to uncover some of these questions, worries, and needs by talking to caregivers of listeners of the children
This poster describes the Addressing Societal Challenges through STEM (ASCS) project. The project's research goal is to identify and describe the range of ways that informal STEM learning (ISL) institutions are addressing societal challenges and how STEM knowledge and scientific reasoning are situated in that engagement.
The poster was presented at the American Association of Museums (AAM) 2020 Virtual Conference.
Peg + Cat is a popular broadcast television series, developed by The Fred Rogers Company and airing on PBS, in which a girl named Peg and her sidekick, Cat, solve everyday problems using mathematics, creativity, persistence, and humor. Peg + Cat: Developing Preschoolers’ Early Math Skills was a three-year project, funded by the National Science Foundation, that aimed to impact children’s interest and engagement with mathematics, as well as their development of positive social-emotional skills. The project supported early math learning via the creation of additional Peg + Cat episodes, online
This article describes a collaborative research project designed to learn about teacher identity in relation to teacher learning experiences that centered informal science education places and approaches. This article is relevant for people who do research on teacher learning, design teacher learning experiences, especially in informal science settings and evaluators of such programs. This article will allow relevant audiences to think about the implications of teachers' social identities in relation to thier students and in relation to how they adapt and use informal science material
How can we begin to chart a course toward a future for science museums in which we maintain our status as sources of trusted information, while also fulfilling our potential as sites of genuine participation and social interaction? In 2019, with funding from the National Science Foundation, the New York Hall of Science hosted a three day conference to discuss new and equitable approaches to exhibit design. With leading exhibit designers, educators, researchers, and community engagement specialists, we began to rethink the exhibit design process, toward a goal of helping our museums become more
The Discovery Center for Evaluation, Research, and Professional Learning (Discovery Center) served as external evaluator for the STEM in the PlayScape project. The broad purpose of the evaluation was to provide annual feedback and a final summative assessment of the project’s ability to meet its stated objectives. Project objectives were to:
Create early childhood digital modules to promote STEM learning on playscapes.
Investigate the impact of trained teachers on children’s STEM learning on playscapes.
Investigate what critical elements of playscapes are portable and adaptable to