As science communication programs grow worldwide, effective evaluation and assessment metrics lag. While there is no consensus on evaluation protocols specifically for science communication training, there is agreement on elements of effective training: listening, empathy, and knowing your audience — core tenets of improvisation. We designed an evaluation protocol, tested over three years, based on validated and newly developed scales for an improvisation-based communication training at the Alan Alda Center for Communicating Science. Initial results suggest that ‘knowing your audience’ should
DATE:
TEAM MEMBERS:
Christine O’ConnellMerryn McKinnonJordan Labouff
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.
BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.
A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.
This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Presentation slides from the session "Social Science Research Collaboration: Advance the field and your Organization" shared at the 2020 AZA Annual Conference (Virtual).
Using their imagination and creativity, inventors have made significant contributions to our world throughout the course of human history. In recent times, a growing community has responded to the need for more intensive research on Invention Education and within the last several years has begun organizing itself around collaborative action that will accelerate the uptake and practice of Invention Education. The purpose of this document is to provide a comprehensive community-driven framework and set of principles for Invention Education that can support its growth within formal and informal
IMPACT NC is a collaboration between the North Carolina science centers and museums and NC State University (NCSU) to build and foster a Community of Practice (CoP) for collective evaluation among the 54 partner organizations across the state of North Carolina. Funded by IMLS Museum Leadership Grant (MG-70-19-0019-19).
The goals of IMPACT NC are:
Identification of a set of shared goals for informal science education across the state.
Development of metrics to assess these goals.
Enhanced capacity of the Community of Practice of science museums to conduct evaluation centered on these collective evaluation goals and metrics.
Improved cohesion among science museums and other partners in NC (e.g. university collaborators, non-profit organizations) as they collectively work toward shared goals.
Development of a system for reporting program outcomes using shared metrics that is integrated into annual reporting or grant proposal processes across NC, thereby informing decision making.
To better understand STEM interest development during adolescence in an urban community, we examined how “STEM Interested” youth differed from disinterested youth and how interest changed over time from age 11/12 to 12/13. We surveyed youth to measure interest in four components of STEM, used cluster analysis to categorize youth based on STEM interest, and examined how interest profiles and pathways differed for several explanatory factors (e.g., parental support, gender). Three STEM interest profiles emerged from the analysis: Stem Interested, Math Disinterested, and STEM Disinterested. Only
Drawing on results from a recent national study, we draw attention to the importance of the experiential learning cycle for enhancing meaningful outcomes of interpretive and educational experiences. The experiential learning cycle involves participating in a concrete experience, reflecting on that experience, drawing out lessons learned and principles from that reflection, and putting that knowledge to work in a new situation. Recent studies reveal that attention to completing all four stages of the experiential learning cycle can enhance positive outcomes for participants in educational and
Computing fields are foundational to most STEM disciplines and the only STEM discipline to show a consistent decline in women's representation since 1990, making it an important field for STEM educators to study. The explanation for the underrepresentation of women and girls in computing is twofold: a sense that they do not fit within the stereotypes associated with computing and a lack of access to computer games and technologies beginning at an early age (Richard, 2016).
Informal coding education programs are uniquely situated to counter these hurdles because they can offer additional
This poster describes the Addressing Societal Challenges through STEM (ASCS) project. The project's research goal is to identify and describe the range of ways that informal STEM learning (ISL) institutions are addressing societal challenges and how STEM knowledge and scientific reasoning are situated in that engagement.
The poster was presented at the American Association of Museums (AAM) 2020 Virtual Conference.
This article describes a collaborative research project designed to learn about teacher identity in relation to teacher learning experiences that centered informal science education places and approaches. This article is relevant for people who do research on teacher learning, design teacher learning experiences, especially in informal science settings and evaluators of such programs. This article will allow relevant audiences to think about the implications of teachers' social identities in relation to thier students and in relation to how they adapt and use informal science material
Overlaying Computer Science (CS) courses on top of inequitable schooling systems will not move us toward “CS for All.” This paper prioritizes the perspectives of minoritized students enrolled in high school CS classrooms across a large, urban school district in the Western United States, to help inform how CS can truly be for all.
DATE:
TEAM MEMBERS:
Jean RyooTiera TanksleyCynthia EstradaJane Margolis